2024-02-19T18:39:08.672 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-19T18:39:08.672 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 0a 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --archive /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566595 --name pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi --verbose --owner scheduled_pdonnell@teuthology -- /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566595/orig.config.yaml 2024-02-19T18:39:08.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T18:39:08.819 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566595 branch: wip-batrick-testing-20240215.160715 description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 0a 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: pdonnell@redhat.com first_in_suite: false job_id: '7566595' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/v18.2.1 ' name: pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-batrick-testing-20240215.160715 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: f78a58c0ffd401d1493058a1022c35f011d65275 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: f78a58c0ffd401d1493058a1022c35f011d65275 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: i64440 sha1: 1ce7ea8877c709fa862eac608550374bd96e166e owner: scheduled_pdonnell@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 2975 sha1: f78a58c0ffd401d1493058a1022c35f011d65275 sleep_before_teardown: 0 suite: fs:upgrade:mds_upgrade_sequence suite_branch: i64440 suite_path: /home/teuthworker/src/github.com_batrick_ceph_1ce7ea8877c709fa862eac608550374bd96e166e/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: 1ce7ea8877c709fa862eac608550374bd96e166e targets: smithi096.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNaiu2TWkuWMgMARXIjr/sxbakwkusxgXjCZA7XV+yNjUvznbL84PKjCiP8lawFKnC48LvVvCNilFmjL47o8+/g= smithi125.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCOsE1pTyJA+Xbf63U9JrYTq90ldeiLzSJ/F+pNVpxUnICd6SwhSNmvgQR5noQg7Sqzt+O5KsAfH5IrR4OdQ99A= tasks: - install: exclude_packages: - ceph-volume tag: v18.2.1 - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.io/ceph/ceph:v18.2.1 roleless: true - print: '**** done end installing v18.2.1 cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - full_sequential_finally: - sleep: duration: 3600 - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-19_18:28:45 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-02-19T18:39:08.820 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_1ce7ea8877c709fa862eac608550374bd96e166e/qa; will attempt to use it 2024-02-19T18:39:08.820 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_1ce7ea8877c709fa862eac608550374bd96e166e/qa/tasks 2024-02-19T18:39:08.820 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-19T18:39:08.822 INFO:teuthology.task.internal:Checking packages... 2024-02-19T18:39:08.845 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f78a58c0ffd401d1493058a1022c35f011d65275' 2024-02-19T18:39:08.845 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-19T18:39:08.846 INFO:teuthology.packaging:ref: None 2024-02-19T18:39:08.846 INFO:teuthology.packaging:tag: None 2024-02-19T18:39:08.846 INFO:teuthology.packaging:branch: wip-batrick-testing-20240215.160715 2024-02-19T18:39:08.846 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T18:39:08.846 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-batrick-testing-20240215.160715 2024-02-19T18:39:09.224 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1450.gf78a58c0 2024-02-19T18:39:09.225 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-19T18:39:09.232 INFO:teuthology.task.internal:no buildpackages task found 2024-02-19T18:39:09.232 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-19T18:39:09.354 INFO:teuthology.task.internal:Saving configuration 2024-02-19T18:39:09.375 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-19T18:39:09.381 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-19T18:39:09.407 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566595', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-19 18:29:39.234270', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNaiu2TWkuWMgMARXIjr/sxbakwkusxgXjCZA7XV+yNjUvznbL84PKjCiP8lawFKnC48LvVvCNilFmjL47o8+/g='} 2024-02-19T18:39:09.427 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566595', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-19 18:29:39.232832', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCOsE1pTyJA+Xbf63U9JrYTq90ldeiLzSJ/F+pNVpxUnICd6SwhSNmvgQR5noQg7Sqzt+O5KsAfH5IrR4OdQ99A='} 2024-02-19T18:39:09.427 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-19T18:39:09.434 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-02-19T18:39:09.434 INFO:teuthology.task.internal:roles: ubuntu@smithi125.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-02-19T18:39:09.434 INFO:teuthology.run_tasks:Running task console_log... 2024-02-19T18:39:09.506 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f71c73120d0>, signals=[15]) 2024-02-19T18:39:09.506 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-19T18:39:09.513 INFO:teuthology.task.internal:Opening connections... 2024-02-19T18:39:09.513 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi096.front.sepia.ceph.com 2024-02-19T18:39:09.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:39:09.616 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi125.front.sepia.ceph.com 2024-02-19T18:39:09.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:39:09.704 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-19T18:39:09.712 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2024-02-19T18:39:09.729 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2024-02-19T18:39:09.730 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2024-02-19T18:39:09.785 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream" 2024-02-19T18:39:09.785 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="9" 2024-02-19T18:39:09.785 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos" 2024-02-19T18:39:09.785 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:39:09.785 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="9" 2024-02-19T18:39:09.785 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:39:09.785 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:39:09.785 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2024-02-19T18:39:09.785 INFO:teuthology.orchestra.run.smithi096.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:39:09.786 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:39:09.786 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:39:09.786 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:39:09.786 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:39:09.786 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:39:09.786 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2024-02-19T18:39:09.806 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2024-02-19T18:39:09.824 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2024-02-19T18:39:09.824 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2024-02-19T18:39:09.880 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream" 2024-02-19T18:39:09.881 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="9" 2024-02-19T18:39:09.881 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos" 2024-02-19T18:39:09.881 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora" 2024-02-19T18:39:09.881 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="9" 2024-02-19T18:39:09.881 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el9" 2024-02-19T18:39:09.881 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T18:39:09.881 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2024-02-19T18:39:09.881 INFO:teuthology.orchestra.run.smithi125.stdout:LOGO="fedora-logo-icon" 2024-02-19T18:39:09.881 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T18:39:09.881 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/" 2024-02-19T18:39:09.881 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T18:39:09.881 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T18:39:09.881 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T18:39:09.882 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2024-02-19T18:39:09.897 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-19T18:39:09.907 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-19T18:39:09.912 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-19T18:39:09.912 DEBUG:teuthology.orchestra.run.smithi096:> test '!' -e /home/ubuntu/cephtest 2024-02-19T18:39:09.915 DEBUG:teuthology.orchestra.run.smithi125:> test '!' -e /home/ubuntu/cephtest 2024-02-19T18:39:09.937 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-19T18:39:09.943 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-19T18:39:09.943 DEBUG:teuthology.orchestra.run.smithi096:> test -z $(ls -A /var/lib/ceph) 2024-02-19T18:39:09.970 DEBUG:teuthology.orchestra.run.smithi125:> test -z $(ls -A /var/lib/ceph) 2024-02-19T18:39:10.082 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-19T18:39:10.137 INFO:teuthology.run_tasks:Running task kernel... 2024-02-19T18:39:10.152 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-19T18:39:10.152 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-19T18:39:10.152 DEBUG:teuthology.orchestra.run.smithi096:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-19T18:39:10.153 DEBUG:teuthology.orchestra.run.smithi125:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-19T18:39:10.168 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T18:39:10.169 DEBUG:teuthology.orchestra.run.smithi125:> uname -r 2024-02-19T18:39:10.169 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T18:39:10.170 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-02-19T18:39:10.224 INFO:teuthology.orchestra.run.smithi096.stdout:5.14.0-361.el9.x86_64 2024-02-19T18:39:10.224 INFO:teuthology.task.kernel:Running kernel on smithi096: 5.14.0-361.el9.x86_64 2024-02-19T18:39:10.224 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum install -y kernel 2024-02-19T18:39:10.225 INFO:teuthology.orchestra.run.smithi125.stdout:5.14.0-361.el9.x86_64 2024-02-19T18:39:10.225 INFO:teuthology.task.kernel:Running kernel on smithi125: 5.14.0-361.el9.x86_64 2024-02-19T18:39:10.226 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum install -y kernel 2024-02-19T18:39:12.662 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS-9 - AppStream 8.8 MB/s | 6.7 MB 00:00 2024-02-19T18:39:12.734 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS-9 - AppStream 7.6 MB/s | 6.7 MB 00:00 2024-02-19T18:39:14.668 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS-9 - BaseOS 2.6 MB/s | 2.0 MB 00:00 2024-02-19T18:39:14.838 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS-9 - BaseOS 1.9 MB/s | 2.0 MB 00:01 2024-02-19T18:39:15.703 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-02-19T18:39:17.604 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-02-19T18:39:22.540 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.1 MB 00:01 2024-02-19T18:39:24.347 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 15 kB 00:00 2024-02-19T18:39:26.481 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 9 - BaseOS 720 kB/s | 8.0 MB 00:11 2024-02-19T18:39:35.457 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 9 - AppStream 2.5 MB/s | 19 MB 00:07 2024-02-19T18:39:40.532 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 6.1 MB 00:01 2024-02-19T18:39:41.824 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 9 - Extras packages 84 kB/s | 15 kB 00:00 2024-02-19T18:40:07.459 INFO:teuthology.orchestra.run.smithi125.stdout:Extra Packages for Enterprise Linux 818 kB/s | 20 MB 00:25 2024-02-19T18:40:12.289 INFO:teuthology.orchestra.run.smithi125.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-02-19T18:40:14.546 INFO:teuthology.orchestra.run.smithi125.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-19T18:40:14.546 INFO:teuthology.orchestra.run.smithi125.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-19T18:40:14.647 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:40:14.659 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:40:14.660 INFO:teuthology.orchestra.run.smithi125.stdout: Package Arch Version Repository Size 2024-02-19T18:40:14.660 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:40:14.660 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2024-02-19T18:40:14.660 INFO:teuthology.orchestra.run.smithi125.stdout: kernel x86_64 5.14.0-421.el9 CentOS-BaseOS 6.1 M 2024-02-19T18:40:14.660 INFO:teuthology.orchestra.run.smithi125.stdout:Installing dependencies: 2024-02-19T18:40:14.660 INFO:teuthology.orchestra.run.smithi125.stdout: kernel-core x86_64 5.14.0-421.el9 CentOS-BaseOS 21 M 2024-02-19T18:40:14.660 INFO:teuthology.orchestra.run.smithi125.stdout: kernel-modules x86_64 5.14.0-421.el9 CentOS-BaseOS 39 M 2024-02-19T18:40:14.660 INFO:teuthology.orchestra.run.smithi125.stdout: kernel-modules-core x86_64 5.14.0-421.el9 CentOS-BaseOS 33 M 2024-02-19T18:40:14.660 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:40:14.660 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2024-02-19T18:40:14.660 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:40:14.660 INFO:teuthology.orchestra.run.smithi125.stdout:Install 4 Packages 2024-02-19T18:40:14.660 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:40:14.661 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 100 M 2024-02-19T18:40:14.661 INFO:teuthology.orchestra.run.smithi125.stdout:Installed size: 123 M 2024-02-19T18:40:14.661 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2024-02-19T18:40:14.999 INFO:teuthology.orchestra.run.smithi125.stdout:(1/4): kernel-5.14.0-421.el9.x86_64.rpm 18 MB/s | 6.1 MB 00:00 2024-02-19T18:40:15.524 INFO:teuthology.orchestra.run.smithi125.stdout:(2/4): kernel-core-5.14.0-421.el9.x86_64.rpm 24 MB/s | 21 MB 00:00 2024-02-19T18:40:16.115 INFO:teuthology.orchestra.run.smithi125.stdout:(3/4): kernel-modules-core-5.14.0-421.el9.x86_6 30 MB/s | 33 MB 00:01 2024-02-19T18:40:16.566 INFO:teuthology.orchestra.run.smithi125.stdout:(4/4): kernel-modules-5.14.0-421.el9.x86_64.rpm 21 MB/s | 39 MB 00:01 2024-02-19T18:40:16.569 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:40:16.569 INFO:teuthology.orchestra.run.smithi125.stdout:Total 52 MB/s | 100 MB 00:01 2024-02-19T18:40:16.570 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2024-02-19T18:40:16.955 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2024-02-19T18:40:16.955 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2024-02-19T18:40:17.975 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2024-02-19T18:40:17.976 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2024-02-19T18:40:20.395 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2024-02-19T18:40:21.059 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : kernel-modules-core-5.14.0-421.el9.x86_64 1/4 2024-02-19T18:40:21.191 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-19T18:40:23.946 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-19T18:40:24.125 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-19T18:40:28.870 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-19T18:40:29.071 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : kernel-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:40:33.862 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:40:52.065 INFO:teuthology.orchestra.run.smithi096.stdout:Extra Packages for Enterprise Linux 238 kB/s | 20 MB 01:27 2024-02-19T18:40:56.922 INFO:teuthology.orchestra.run.smithi096.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-02-19T18:40:59.104 INFO:teuthology.orchestra.run.smithi096.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-19T18:40:59.104 INFO:teuthology.orchestra.run.smithi096.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-19T18:40:59.194 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:40:59.206 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:40:59.206 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2024-02-19T18:40:59.206 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:40:59.206 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2024-02-19T18:40:59.206 INFO:teuthology.orchestra.run.smithi096.stdout: kernel x86_64 5.14.0-421.el9 CentOS-BaseOS 6.1 M 2024-02-19T18:40:59.206 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2024-02-19T18:40:59.206 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-core x86_64 5.14.0-421.el9 CentOS-BaseOS 21 M 2024-02-19T18:40:59.206 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-modules x86_64 5.14.0-421.el9 CentOS-BaseOS 39 M 2024-02-19T18:40:59.206 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-modules-core x86_64 5.14.0-421.el9 CentOS-BaseOS 33 M 2024-02-19T18:40:59.206 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:40:59.206 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2024-02-19T18:40:59.207 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:40:59.207 INFO:teuthology.orchestra.run.smithi096.stdout:Install 4 Packages 2024-02-19T18:40:59.207 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:40:59.207 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 100 M 2024-02-19T18:40:59.207 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 123 M 2024-02-19T18:40:59.207 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2024-02-19T18:40:59.690 INFO:teuthology.orchestra.run.smithi096.stdout:(1/4): kernel-5.14.0-421.el9.x86_64.rpm 13 MB/s | 6.1 MB 00:00 2024-02-19T18:41:00.282 INFO:teuthology.orchestra.run.smithi096.stdout:(2/4): kernel-core-5.14.0-421.el9.x86_64.rpm 19 MB/s | 21 MB 00:01 2024-02-19T18:41:01.357 INFO:teuthology.orchestra.run.smithi096.stdout:(3/4): kernel-modules-core-5.14.0-421.el9.x86_6 20 MB/s | 33 MB 00:01 2024-02-19T18:41:01.782 INFO:teuthology.orchestra.run.smithi096.stdout:(4/4): kernel-modules-5.14.0-421.el9.x86_64.rpm 15 MB/s | 39 MB 00:02 2024-02-19T18:41:01.785 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:41:01.785 INFO:teuthology.orchestra.run.smithi096.stdout:Total 39 MB/s | 100 MB 00:02 2024-02-19T18:41:01.786 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2024-02-19T18:41:02.175 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2024-02-19T18:41:02.176 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2024-02-19T18:41:03.130 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:41:03.130 INFO:teuthology.orchestra.run.smithi125.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-19T18:41:03.131 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:41:03.200 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:41:03.200 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2024-02-19T18:41:03.201 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2024-02-19T18:41:03.604 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: kernel-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:41:03.604 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : kernel-5.14.0-421.el9.x86_64 1/4 2024-02-19T18:41:03.604 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-19T18:41:03.604 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-19T18:41:04.048 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:41:04.049 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:41:04.049 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2024-02-19T18:41:04.049 INFO:teuthology.orchestra.run.smithi125.stdout: kernel-5.14.0-421.el9.x86_64 2024-02-19T18:41:04.049 INFO:teuthology.orchestra.run.smithi125.stdout: kernel-core-5.14.0-421.el9.x86_64 2024-02-19T18:41:04.049 INFO:teuthology.orchestra.run.smithi125.stdout: kernel-modules-5.14.0-421.el9.x86_64 2024-02-19T18:41:04.049 INFO:teuthology.orchestra.run.smithi125.stdout: kernel-modules-core-5.14.0-421.el9.x86_64 2024-02-19T18:41:04.049 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:41:04.049 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:41:04.538 DEBUG:teuthology.orchestra.run.smithi125:> rpm -q kernel | sort -rV | head -n 1 2024-02-19T18:41:04.669 INFO:teuthology.orchestra.run.smithi125.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-19T18:41:04.669 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-19T18:41:04.669 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-421.el9.x86_64 2024-02-19T18:41:04.669 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-19T18:41:04.669 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-19T18:41:04.669 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-02-19T18:41:04.670 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi125.front.sepia.ceph.com, path=None, version=distro) 2024-02-19T18:41:04.670 DEBUG:teuthology.orchestra.run.smithi125:> rpm -q kernel | sort -rV | head -n 1 2024-02-19T18:41:04.779 INFO:teuthology.orchestra.run.smithi125.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-19T18:41:04.779 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-19T18:41:04.779 DEBUG:teuthology.orchestra.run.smithi125:> sudo rpm -qi grub2-tools 2024-02-19T18:41:04.824 INFO:teuthology.orchestra.run.smithi125.stdout:Name : grub2-tools 2024-02-19T18:41:04.824 INFO:teuthology.orchestra.run.smithi125.stdout:Epoch : 1 2024-02-19T18:41:04.824 INFO:teuthology.orchestra.run.smithi125.stdout:Version : 2.06 2024-02-19T18:41:04.824 INFO:teuthology.orchestra.run.smithi125.stdout:Release : 68.el9 2024-02-19T18:41:04.824 INFO:teuthology.orchestra.run.smithi125.stdout:Architecture: x86_64 2024-02-19T18:41:04.824 INFO:teuthology.orchestra.run.smithi125.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-19T18:41:04.824 INFO:teuthology.orchestra.run.smithi125.stdout:Group : Unspecified 2024-02-19T18:41:04.825 INFO:teuthology.orchestra.run.smithi125.stdout:Size : 8264254 2024-02-19T18:41:04.825 INFO:teuthology.orchestra.run.smithi125.stdout:License : GPLv3+ 2024-02-19T18:41:04.825 INFO:teuthology.orchestra.run.smithi125.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-19T18:41:04.825 INFO:teuthology.orchestra.run.smithi125.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-19T18:41:04.825 INFO:teuthology.orchestra.run.smithi125.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-19T18:41:04.825 INFO:teuthology.orchestra.run.smithi125.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-19T18:41:04.825 INFO:teuthology.orchestra.run.smithi125.stdout:Packager : builder@centos.org 2024-02-19T18:41:04.825 INFO:teuthology.orchestra.run.smithi125.stdout:Vendor : CentOS 2024-02-19T18:41:04.825 INFO:teuthology.orchestra.run.smithi125.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-19T18:41:04.825 INFO:teuthology.orchestra.run.smithi125.stdout:Summary : Support tools for GRUB. 2024-02-19T18:41:04.825 INFO:teuthology.orchestra.run.smithi125.stdout:Description : 2024-02-19T18:41:04.825 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:41:04.825 INFO:teuthology.orchestra.run.smithi125.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-19T18:41:04.826 INFO:teuthology.orchestra.run.smithi125.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-19T18:41:04.826 INFO:teuthology.orchestra.run.smithi125.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-19T18:41:04.826 INFO:teuthology.orchestra.run.smithi125.stdout:hardware devices. 2024-02-19T18:41:04.826 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:41:04.826 INFO:teuthology.orchestra.run.smithi125.stdout:This subpackage provides tools for support of all platforms. 2024-02-19T18:41:04.827 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-19T18:41:04.827 INFO:teuthology.task.kernel:Updating grub on smithi125 to boot 5.14.0-421.el9.x86_64 2024-02-19T18:41:04.827 DEBUG:teuthology.orchestra.run.smithi125:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-19T18:41:05.452 INFO:teuthology.orchestra.run.smithi125.stderr:Generating grub configuration file ... 2024-02-19T18:41:05.588 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2024-02-19T18:41:06.348 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-modules-core-5.14.0-421.el9.x86_64 1/4 2024-02-19T18:41:06.475 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-19T18:41:06.877 INFO:teuthology.orchestra.run.smithi125.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-19T18:41:06.898 INFO:teuthology.orchestra.run.smithi125.stderr:done 2024-02-19T18:41:06.900 DEBUG:teuthology.orchestra.run.smithi125:> mktemp 2024-02-19T18:41:06.956 INFO:teuthology.orchestra.run.smithi125.stdout:/tmp/tmp.NxtkUI6u7Y 2024-02-19T18:41:06.957 DEBUG:teuthology.orchestra.run.smithi125:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.NxtkUI6u7Y 2024-02-19T18:41:07.036 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0666 /tmp/tmp.NxtkUI6u7Y 2024-02-19T18:41:07.176 DEBUG:teuthology.orchestra.remote:smithi125:/tmp/tmp.NxtkUI6u7Y is 6KB 2024-02-19T18:41:07.225 DEBUG:teuthology.orchestra.run.smithi125:> rm -fr /tmp/tmp.NxtkUI6u7Y 2024-02-19T18:41:07.242 DEBUG:teuthology.orchestra.run.smithi125:> sudo /bin/ls /boot/loader/entries || true 2024-02-19T18:41:07.304 INFO:teuthology.orchestra.run.smithi125.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-19T18:41:07.304 INFO:teuthology.orchestra.run.smithi125.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-19T18:41:07.305 INFO:teuthology.orchestra.run.smithi125.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-19T18:41:07.305 INFO:teuthology.orchestra.run.smithi125.stdout:15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64.conf 2024-02-19T18:41:07.306 DEBUG:teuthology.orchestra.run.smithi125:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64 2024-02-19T18:41:07.456 DEBUG:teuthology.orchestra.run.smithi125:> sudo shutdown -r now 2024-02-19T18:41:09.207 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-19T18:41:09.385 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-19T18:41:14.080 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-19T18:41:14.204 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : kernel-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:41:18.940 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:41:37.460 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-02-19T18:41:37.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2024-02-19T18:41:37.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:41:48.166 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-core-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:41:48.166 INFO:teuthology.orchestra.run.smithi096.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-19T18:41:48.166 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:41:48.233 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-modules-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:41:48.676 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: kernel-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:41:48.676 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-5.14.0-421.el9.x86_64 1/4 2024-02-19T18:41:48.676 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-core-5.14.0-421.el9.x86_64 2/4 2024-02-19T18:41:48.676 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-modules-5.14.0-421.el9.x86_64 3/4 2024-02-19T18:41:49.097 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : kernel-modules-core-5.14.0-421.el9.x86_64 4/4 2024-02-19T18:41:49.097 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:41:49.097 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2024-02-19T18:41:49.097 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-5.14.0-421.el9.x86_64 2024-02-19T18:41:49.097 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-core-5.14.0-421.el9.x86_64 2024-02-19T18:41:49.097 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-modules-5.14.0-421.el9.x86_64 2024-02-19T18:41:49.097 INFO:teuthology.orchestra.run.smithi096.stdout: kernel-modules-core-5.14.0-421.el9.x86_64 2024-02-19T18:41:49.097 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:41:49.097 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:41:49.588 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q kernel | sort -rV | head -n 1 2024-02-19T18:41:49.717 INFO:teuthology.orchestra.run.smithi096.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-19T18:41:49.717 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-19T18:41:49.717 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-421.el9.x86_64 2024-02-19T18:41:49.718 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-19T18:41:49.718 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-19T18:41:49.718 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-02-19T18:41:49.718 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi096.front.sepia.ceph.com, path=None, version=distro) 2024-02-19T18:41:49.718 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q kernel | sort -rV | head -n 1 2024-02-19T18:41:49.825 INFO:teuthology.orchestra.run.smithi096.stdout:kernel-5.14.0-421.el9.x86_64 2024-02-19T18:41:49.826 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-421.el9.x86_64 2024-02-19T18:41:49.826 DEBUG:teuthology.orchestra.run.smithi096:> sudo rpm -qi grub2-tools 2024-02-19T18:41:49.860 INFO:teuthology.orchestra.run.smithi096.stdout:Name : grub2-tools 2024-02-19T18:41:49.860 INFO:teuthology.orchestra.run.smithi096.stdout:Epoch : 1 2024-02-19T18:41:49.860 INFO:teuthology.orchestra.run.smithi096.stdout:Version : 2.06 2024-02-19T18:41:49.860 INFO:teuthology.orchestra.run.smithi096.stdout:Release : 68.el9 2024-02-19T18:41:49.860 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: x86_64 2024-02-19T18:41:49.860 INFO:teuthology.orchestra.run.smithi096.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-19T18:41:49.860 INFO:teuthology.orchestra.run.smithi096.stdout:Group : Unspecified 2024-02-19T18:41:49.860 INFO:teuthology.orchestra.run.smithi096.stdout:Size : 8264254 2024-02-19T18:41:49.860 INFO:teuthology.orchestra.run.smithi096.stdout:License : GPLv3+ 2024-02-19T18:41:49.860 INFO:teuthology.orchestra.run.smithi096.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-19T18:41:49.861 INFO:teuthology.orchestra.run.smithi096.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-19T18:41:49.861 INFO:teuthology.orchestra.run.smithi096.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-19T18:41:49.861 INFO:teuthology.orchestra.run.smithi096.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-19T18:41:49.861 INFO:teuthology.orchestra.run.smithi096.stdout:Packager : builder@centos.org 2024-02-19T18:41:49.861 INFO:teuthology.orchestra.run.smithi096.stdout:Vendor : CentOS 2024-02-19T18:41:49.861 INFO:teuthology.orchestra.run.smithi096.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-19T18:41:49.861 INFO:teuthology.orchestra.run.smithi096.stdout:Summary : Support tools for GRUB. 2024-02-19T18:41:49.861 INFO:teuthology.orchestra.run.smithi096.stdout:Description : 2024-02-19T18:41:49.861 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:41:49.861 INFO:teuthology.orchestra.run.smithi096.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-19T18:41:49.861 INFO:teuthology.orchestra.run.smithi096.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-19T18:41:49.861 INFO:teuthology.orchestra.run.smithi096.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-19T18:41:49.861 INFO:teuthology.orchestra.run.smithi096.stdout:hardware devices. 2024-02-19T18:41:49.861 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:41:49.861 INFO:teuthology.orchestra.run.smithi096.stdout:This subpackage provides tools for support of all platforms. 2024-02-19T18:41:49.862 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-19T18:41:49.862 INFO:teuthology.task.kernel:Updating grub on smithi096 to boot 5.14.0-421.el9.x86_64 2024-02-19T18:41:49.863 DEBUG:teuthology.orchestra.run.smithi096:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-19T18:41:50.479 INFO:teuthology.orchestra.run.smithi096.stderr:Generating grub configuration file ... 2024-02-19T18:41:51.944 INFO:teuthology.orchestra.run.smithi096.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-19T18:41:51.986 INFO:teuthology.orchestra.run.smithi096.stderr:done 2024-02-19T18:41:51.988 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-02-19T18:41:52.004 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.YElYKDkee6 2024-02-19T18:41:52.005 DEBUG:teuthology.orchestra.run.smithi096:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YElYKDkee6 2024-02-19T18:41:52.073 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.YElYKDkee6 2024-02-19T18:41:52.218 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.YElYKDkee6 is 6KB 2024-02-19T18:41:52.268 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.YElYKDkee6 2024-02-19T18:41:52.283 DEBUG:teuthology.orchestra.run.smithi096:> sudo /bin/ls /boot/loader/entries || true 2024-02-19T18:41:52.357 INFO:teuthology.orchestra.run.smithi096.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-19T18:41:52.357 INFO:teuthology.orchestra.run.smithi096.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-19T18:41:52.357 INFO:teuthology.orchestra.run.smithi096.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-19T18:41:52.357 INFO:teuthology.orchestra.run.smithi096.stdout:15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64.conf 2024-02-19T18:41:52.358 DEBUG:teuthology.orchestra.run.smithi096:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-421.el9.x86_64 2024-02-19T18:41:52.521 DEBUG:teuthology.orchestra.run.smithi096:> sudo shutdown -r now 2024-02-19T18:42:12.156 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-02-19T18:42:21.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2024-02-19T18:42:21.166 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:42:22.525 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-02-19T18:42:22.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-02-19T18:42:22.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:42:24.220 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-02-19T18:42:36.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2024-02-19T18:42:36.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:42:39.292 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.125 2024-02-19T18:42:54.306 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2024-02-19T18:42:54.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:42:54.664 DEBUG:teuthology.orchestra.run.smithi125:> true 2024-02-19T18:42:55.076 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2024-02-19T18:42:55.076 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-421.el9.x86_64"... 2024-02-19T18:42:55.078 DEBUG:teuthology.orchestra.run.smithi125:> uname -r 2024-02-19T18:42:55.091 INFO:teuthology.orchestra.run.smithi125.stdout:5.14.0-421.el9.x86_64 2024-02-19T18:42:55.092 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-421.el9.x86_64 vs 5.14.0-421.el9.x86_64 2024-02-19T18:42:55.092 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-19T18:42:55.092 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-19T18:42:56.093 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-02-19T18:42:56.093 DEBUG:teuthology.orchestra.run.smithi125:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-19T18:42:56.199 INFO:teuthology.orchestra.run.smithi125.stdout:ttyS1 2024-02-19T18:42:56.265 DEBUG:teuthology.parallel:result is None 2024-02-19T18:43:22.528 DEBUG:teuthology.orchestra.remote:timed out 2024-02-19T18:43:31.530 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-02-19T18:43:31.531 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:43:32.994 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-02-19T18:43:33.426 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-02-19T18:43:33.426 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-421.el9.x86_64"... 2024-02-19T18:43:33.427 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-02-19T18:43:33.441 INFO:teuthology.orchestra.run.smithi096.stdout:5.14.0-421.el9.x86_64 2024-02-19T18:43:33.442 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-421.el9.x86_64 vs 5.14.0-421.el9.x86_64 2024-02-19T18:43:33.442 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-19T18:43:33.442 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-19T18:43:34.443 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-02-19T18:43:34.443 DEBUG:teuthology.orchestra.run.smithi096:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-19T18:43:34.542 INFO:teuthology.orchestra.run.smithi096.stdout:ttyS1 2024-02-19T18:43:34.581 DEBUG:teuthology.parallel:result is None 2024-02-19T18:43:34.581 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-19T18:43:34.593 INFO:teuthology.task.internal:Creating test directory... 2024-02-19T18:43:34.593 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-19T18:43:34.595 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-19T18:43:34.618 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-19T18:43:34.675 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-19T18:43:34.695 INFO:teuthology.task.internal:Creating archive directory... 2024-02-19T18:43:34.695 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-19T18:43:34.713 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-19T18:43:34.742 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-19T18:43:34.753 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-19T18:43:34.753 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-19T18:43:34.766 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-19T18:43:34.799 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-19T18:43:34.812 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-19T18:43:34.822 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-19T18:43:34.846 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-19T18:43:34.846 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-19T18:43:34.873 INFO:teuthology.task.internal:Configuring sudo... 2024-02-19T18:43:34.874 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-19T18:43:34.892 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-19T18:43:34.922 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-19T18:43:34.935 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-19T18:43:34.936 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-19T18:43:34.962 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-19T18:43:34.979 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-19T18:43:35.055 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-19T18:43:35.110 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-19T18:43:35.216 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-19T18:43:35.247 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-02-19T18:43:35.248 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-19T18:43:35.325 DEBUG:teuthology.orchestra.run.smithi125:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-19T18:43:35.383 DEBUG:teuthology.orchestra.run.smithi125:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-19T18:43:35.435 DEBUG:teuthology.orchestra.run.smithi125:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-19T18:43:35.521 DEBUG:teuthology.orchestra.run.smithi125:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-19T18:43:35.566 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-02-19T18:43:35.566 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-19T18:43:35.636 DEBUG:teuthology.orchestra.run.smithi096:> sudo service rsyslog restart 2024-02-19T18:43:35.639 DEBUG:teuthology.orchestra.run.smithi125:> sudo service rsyslog restart 2024-02-19T18:43:35.685 INFO:teuthology.orchestra.run.smithi096.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-19T18:43:35.732 INFO:teuthology.orchestra.run.smithi125.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-19T18:43:36.233 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-19T18:43:36.252 INFO:teuthology.task.internal:Starting timer... 2024-02-19T18:43:36.252 INFO:teuthology.run_tasks:Running task pcp... 2024-02-19T18:43:36.304 INFO:teuthology.run_tasks:Running task selinux... 2024-02-19T18:43:36.337 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-02-19T18:43:36.338 DEBUG:teuthology.orchestra.run.smithi096:> sudo service auditd rotate 2024-02-19T18:43:36.397 INFO:teuthology.orchestra.run.smithi096.stdout:Rotating logs: 2024-02-19T18:43:36.399 DEBUG:teuthology.orchestra.run.smithi125:> sudo service auditd rotate 2024-02-19T18:43:36.453 INFO:teuthology.orchestra.run.smithi125.stdout:Rotating logs: 2024-02-19T18:43:36.453 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-19T18:43:36.453 DEBUG:teuthology.orchestra.run.smithi096:> /usr/sbin/getenforce 2024-02-19T18:43:36.489 INFO:teuthology.orchestra.run.smithi096.stdout:Permissive 2024-02-19T18:43:36.489 DEBUG:teuthology.orchestra.run.smithi125:> /usr/sbin/getenforce 2024-02-19T18:43:36.514 INFO:teuthology.orchestra.run.smithi125.stdout:Permissive 2024-02-19T18:43:36.514 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi096.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi125.front.sepia.ceph.com': 'permissive'} 2024-02-19T18:43:36.515 DEBUG:teuthology.orchestra.run.smithi096:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-19T18:43:36.559 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T18:43:36.559 DEBUG:teuthology.orchestra.run.smithi125:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-19T18:43:36.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T18:43:36.590 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-19T18:43:36.590 DEBUG:teuthology.orchestra.run.smithi096:> sudo /usr/sbin/setenforce permissive 2024-02-19T18:43:36.637 DEBUG:teuthology.orchestra.run.smithi125:> sudo /usr/sbin/setenforce permissive 2024-02-19T18:43:36.674 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-19T18:43:36.685 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-19T18:43:36.830 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-19T18:43:36.832 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi096.front.sepia.ceph.com,smithi125.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-19T18:48:58.540 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi096.front.sepia.ceph.com'), Remote(name='ubuntu@smithi125.front.sepia.ceph.com')] 2024-02-19T18:48:58.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-02-19T18:48:58.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:48:58.631 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-02-19T18:48:58.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-02-19T18:48:58.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2024-02-19T18:48:58.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T18:48:58.795 DEBUG:teuthology.orchestra.run.smithi125:> true 2024-02-19T18:48:58.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2024-02-19T18:48:58.874 INFO:teuthology.run_tasks:Running task clock... 2024-02-19T18:48:58.885 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-19T18:48:58.885 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-19T18:48:58.886 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-19T18:48:58.888 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-19T18:48:58.888 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-19T18:48:58.917 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-19T18:48:58.933 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-19T18:48:58.944 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-19T18:48:58.960 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-19T18:48:58.962 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: ntpd: command not found 2024-02-19T18:48:58.975 INFO:teuthology.orchestra.run.smithi096.stdout:506 Cannot talk to daemon 2024-02-19T18:48:58.989 INFO:teuthology.orchestra.run.smithi125.stderr:sudo: ntpd: command not found 2024-02-19T18:48:58.992 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-19T18:48:59.003 INFO:teuthology.orchestra.run.smithi125.stdout:506 Cannot talk to daemon 2024-02-19T18:48:59.008 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-19T18:48:59.019 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-19T18:48:59.035 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-19T18:48:59.061 INFO:teuthology.orchestra.run.smithi096.stderr:bash: line 1: ntpq: command not found 2024-02-19T18:48:59.065 INFO:teuthology.orchestra.run.smithi096.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-19T18:48:59.065 INFO:teuthology.orchestra.run.smithi096.stdout:=============================================================================== 2024-02-19T18:48:59.065 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T18:48:59.065 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T18:48:59.065 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T18:48:59.065 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T18:48:59.088 INFO:teuthology.orchestra.run.smithi125.stderr:bash: line 1: ntpq: command not found 2024-02-19T18:48:59.092 INFO:teuthology.orchestra.run.smithi125.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-19T18:48:59.092 INFO:teuthology.orchestra.run.smithi125.stdout:=============================================================================== 2024-02-19T18:48:59.092 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T18:48:59.092 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T18:48:59.092 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T18:48:59.092 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T18:48:59.092 INFO:teuthology.run_tasks:Running task install... 2024-02-19T18:48:59.100 DEBUG:teuthology.task.install:project ceph 2024-02-19T18:48:59.101 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275'}} 2024-02-19T18:48:59.101 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v18.2.1', 'flavor': 'default', 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275'} 2024-02-19T18:48:59.101 INFO:teuthology.task.install:Using flavor: default 2024-02-19T18:48:59.106 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-19T18:48:59.106 INFO:teuthology.task.install:extra packages: [] 2024-02-19T18:48:59.107 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275', 'tag': 'v18.2.1', 'wait_for_package': False} 2024-02-19T18:48:59.107 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-19T18:48:59.107 INFO:teuthology.packaging:ref: None 2024-02-19T18:48:59.107 INFO:teuthology.packaging:tag: v18.2.1 2024-02-19T18:48:59.107 INFO:teuthology.packaging:branch: None 2024-02-19T18:48:59.107 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T18:48:59.424 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph-ci v18.2.1^{} -> None 2024-02-19T18:48:59.425 INFO:teuthology.packaging:Tag 'v18.2.1' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-02-19T18:49:01.164 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph v18.2.1^{} -> 7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-02-19T18:49:01.164 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-02-19T18:49:01.167 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275', 'tag': 'v18.2.1', 'wait_for_package': False} 2024-02-19T18:49:01.167 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-19T18:49:01.167 INFO:teuthology.packaging:ref: None 2024-02-19T18:49:01.167 INFO:teuthology.packaging:tag: v18.2.1 2024-02-19T18:49:01.167 INFO:teuthology.packaging:branch: None 2024-02-19T18:49:01.167 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T18:49:01.167 INFO:teuthology.packaging:Tag 'v18.2.1' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-02-19T18:49:01.168 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-02-19T18:49:01.525 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/ 2024-02-19T18:49:01.525 INFO:teuthology.task.install.rpm:Package version is 18.2.1-0 2024-02-19T18:49:01.531 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/ 2024-02-19T18:49:01.531 INFO:teuthology.task.install.rpm:Package version is 18.2.1-0 2024-02-19T18:49:01.563 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-19T18:49:01.563 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-02-19T18:49:01.563 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-19T18:49:01.565 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-19T18:49:01.565 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-02-19T18:49:01.565 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-19T18:49:01.598 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-19T18:49:01.598 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-19T18:49:01.598 INFO:teuthology.packaging:ref: None 2024-02-19T18:49:01.598 INFO:teuthology.packaging:tag: v18.2.1 2024-02-19T18:49:01.598 INFO:teuthology.packaging:branch: None 2024-02-19T18:49:01.598 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T18:49:01.598 DEBUG:teuthology.orchestra.run.smithi125:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-19T18:49:01.599 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-19T18:49:01.599 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-19T18:49:01.599 INFO:teuthology.packaging:ref: None 2024-02-19T18:49:01.599 INFO:teuthology.packaging:tag: v18.2.1 2024-02-19T18:49:01.599 INFO:teuthology.packaging:branch: None 2024-02-19T18:49:01.600 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T18:49:01.600 DEBUG:teuthology.orchestra.run.smithi096:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-19T18:49:01.669 DEBUG:teuthology.orchestra.run.smithi125:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-19T18:49:01.671 DEBUG:teuthology.orchestra.run.smithi096:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-19T18:49:01.752 DEBUG:teuthology.orchestra.run.smithi125:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-19T18:49:01.753 DEBUG:teuthology.orchestra.run.smithi096:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-19T18:49:01.820 INFO:teuthology.orchestra.run.smithi125.stdout:check_obsoletes = 1 2024-02-19T18:49:01.822 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum clean all 2024-02-19T18:49:01.822 INFO:teuthology.orchestra.run.smithi096.stdout:check_obsoletes = 1 2024-02-19T18:49:01.823 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum clean all 2024-02-19T18:49:02.059 INFO:teuthology.orchestra.run.smithi125.stdout:74 files removed 2024-02-19T18:49:02.068 INFO:teuthology.orchestra.run.smithi096.stdout:74 files removed 2024-02-19T18:49:02.086 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install ceph-radosgw 2024-02-19T18:49:02.095 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-radosgw 2024-02-19T18:49:02.554 INFO:teuthology.orchestra.run.smithi096.stdout:ceph packages for x86_64 531 kB/s | 76 kB 00:00 2024-02-19T18:49:02.609 INFO:teuthology.orchestra.run.smithi125.stdout:ceph packages for x86_64 366 kB/s | 76 kB 00:00 2024-02-19T18:49:02.738 INFO:teuthology.orchestra.run.smithi096.stdout:ceph noarch packages 70 kB/s | 9.4 kB 00:00 2024-02-19T18:49:02.793 INFO:teuthology.orchestra.run.smithi125.stdout:ceph noarch packages 69 kB/s | 9.4 kB 00:00 2024-02-19T18:49:02.914 INFO:teuthology.orchestra.run.smithi096.stdout:ceph source packages 16 kB/s | 2.2 kB 00:00 2024-02-19T18:49:02.968 INFO:teuthology.orchestra.run.smithi125.stdout:ceph source packages 16 kB/s | 2.2 kB 00:00 2024-02-19T18:49:03.966 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS-9 - AppStream 6.6 MB/s | 6.7 MB 00:01 2024-02-19T18:49:04.046 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS-9 - AppStream 6.4 MB/s | 6.7 MB 00:01 2024-02-19T18:49:05.758 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS-9 - BaseOS 2.9 MB/s | 2.0 MB 00:00 2024-02-19T18:49:05.771 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS-9 - BaseOS 3.2 MB/s | 2.0 MB 00:00 2024-02-19T18:49:09.236 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 9 - BaseOS 2.5 MB/s | 8.0 MB 00:03 2024-02-19T18:49:09.606 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - BaseOS 2.3 MB/s | 8.0 MB 00:03 2024-02-19T18:49:15.487 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 9 - AppStream 3.7 MB/s | 19 MB 00:05 2024-02-19T18:49:22.946 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 9 - CRB 1.5 MB/s | 6.1 MB 00:03 2024-02-19T18:49:24.880 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 15 kB 00:00 2024-02-19T18:49:26.664 INFO:teuthology.orchestra.run.smithi125.stdout:Extra Packages for Enterprise Linux 12 MB/s | 20 MB 00:01 2024-02-19T18:49:31.547 INFO:teuthology.orchestra.run.smithi125.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-02-19T18:49:34.108 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:49:34.111 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:49:34.111 INFO:teuthology.orchestra.run.smithi125.stdout: Package Arch Version Repository Size 2024-02-19T18:49:34.111 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:49:34.112 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2024-02-19T18:49:34.112 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-radosgw x86_64 2:18.2.1-0.el9 ceph 7.7 M 2024-02-19T18:49:34.112 INFO:teuthology.orchestra.run.smithi125.stdout:Upgrading: 2024-02-19T18:49:34.112 INFO:teuthology.orchestra.run.smithi125.stdout: librados2 x86_64 2:18.2.1-0.el9 ceph 3.3 M 2024-02-19T18:49:34.112 INFO:teuthology.orchestra.run.smithi125.stdout: librbd1 x86_64 2:18.2.1-0.el9 ceph 3.0 M 2024-02-19T18:49:34.112 INFO:teuthology.orchestra.run.smithi125.stdout:Installing dependencies: 2024-02-19T18:49:34.112 INFO:teuthology.orchestra.run.smithi125.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-19T18:49:34.112 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-base x86_64 2:18.2.1-0.el9 ceph 5.2 M 2024-02-19T18:49:34.112 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-common x86_64 2:18.2.1-0.el9 ceph 18 M 2024-02-19T18:49:34.112 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-selinux x86_64 2:18.2.1-0.el9 ceph 24 k 2024-02-19T18:49:34.112 INFO:teuthology.orchestra.run.smithi125.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-02-19T18:49:34.113 INFO:teuthology.orchestra.run.smithi125.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-19T18:49:34.113 INFO:teuthology.orchestra.run.smithi125.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-19T18:49:34.113 INFO:teuthology.orchestra.run.smithi125.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-19T18:49:34.113 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs2 x86_64 2:18.2.1-0.el9 ceph 658 k 2024-02-19T18:49:34.113 INFO:teuthology.orchestra.run.smithi125.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-19T18:49:34.113 INFO:teuthology.orchestra.run.smithi125.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-19T18:49:34.113 INFO:teuthology.orchestra.run.smithi125.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-19T18:49:34.113 INFO:teuthology.orchestra.run.smithi125.stdout: libradosstriper1 x86_64 2:18.2.1-0.el9 ceph 474 k 2024-02-19T18:49:34.113 INFO:teuthology.orchestra.run.smithi125.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-19T18:49:34.113 INFO:teuthology.orchestra.run.smithi125.stdout: librgw2 x86_64 2:18.2.1-0.el9 ceph 4.5 M 2024-02-19T18:49:34.113 INFO:teuthology.orchestra.run.smithi125.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-19T18:49:34.113 INFO:teuthology.orchestra.run.smithi125.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-19T18:49:34.113 INFO:teuthology.orchestra.run.smithi125.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-19T18:49:34.113 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-argparse x86_64 2:18.2.1-0.el9 ceph 45 k 2024-02-19T18:49:34.114 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-common x86_64 2:18.2.1-0.el9 ceph 124 k 2024-02-19T18:49:34.114 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cephfs x86_64 2:18.2.1-0.el9 ceph 161 k 2024-02-19T18:49:34.114 INFO:teuthology.orchestra.run.smithi125.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-19T18:49:34.114 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rados x86_64 2:18.2.1-0.el9 ceph 321 k 2024-02-19T18:49:34.114 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rbd x86_64 2:18.2.1-0.el9 ceph 297 k 2024-02-19T18:49:34.114 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rgw x86_64 2:18.2.1-0.el9 ceph 99 k 2024-02-19T18:49:34.114 INFO:teuthology.orchestra.run.smithi125.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-19T18:49:34.114 INFO:teuthology.orchestra.run.smithi125.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-19T18:49:34.114 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:49:34.114 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2024-02-19T18:49:34.114 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:49:34.114 INFO:teuthology.orchestra.run.smithi125.stdout:Install 28 Packages 2024-02-19T18:49:34.114 INFO:teuthology.orchestra.run.smithi125.stdout:Upgrade 2 Packages 2024-02-19T18:49:34.114 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:49:34.115 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 53 M 2024-02-19T18:49:34.115 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2024-02-19T18:49:34.348 INFO:teuthology.orchestra.run.smithi125.stdout:(1/30): ceph-base-18.2.1-0.el9.x86_64.rpm 28 MB/s | 5.2 MB 00:00 2024-02-19T18:49:34.373 INFO:teuthology.orchestra.run.smithi125.stdout:(2/30): ceph-selinux-18.2.1-0.el9.x86_64.rpm 976 kB/s | 24 kB 00:00 2024-02-19T18:49:34.407 INFO:teuthology.orchestra.run.smithi125.stdout:(3/30): libcephfs2-18.2.1-0.el9.x86_64.rpm 19 MB/s | 658 kB 00:00 2024-02-19T18:49:34.440 INFO:teuthology.orchestra.run.smithi125.stdout:(4/30): libradosstriper1-18.2.1-0.el9.x86_64.rp 14 MB/s | 474 kB 00:00 2024-02-19T18:49:34.541 INFO:teuthology.orchestra.run.smithi125.stdout:(5/30): ceph-radosgw-18.2.1-0.el9.x86_64.rpm 20 MB/s | 7.7 MB 00:00 2024-02-19T18:49:34.566 INFO:teuthology.orchestra.run.smithi125.stdout:(6/30): python3-ceph-argparse-18.2.1-0.el9.x86_ 1.8 MB/s | 45 kB 00:00 2024-02-19T18:49:34.583 INFO:teuthology.orchestra.run.smithi125.stdout:(7/30): python3-ceph-common-18.2.1-0.el9.x86_64 7.4 MB/s | 124 kB 00:00 2024-02-19T18:49:34.617 INFO:teuthology.orchestra.run.smithi125.stdout:(8/30): python3-cephfs-18.2.1-0.el9.x86_64.rpm 4.7 MB/s | 161 kB 00:00 2024-02-19T18:49:34.650 INFO:teuthology.orchestra.run.smithi125.stdout:(9/30): python3-rados-18.2.1-0.el9.x86_64.rpm 9.4 MB/s | 321 kB 00:00 2024-02-19T18:49:34.709 INFO:teuthology.orchestra.run.smithi125.stdout:(10/30): librgw2-18.2.1-0.el9.x86_64.rpm 17 MB/s | 4.5 MB 00:00 2024-02-19T18:49:34.734 INFO:teuthology.orchestra.run.smithi125.stdout:(11/30): python3-rgw-18.2.1-0.el9.x86_64.rpm 3.9 MB/s | 99 kB 00:00 2024-02-19T18:49:34.759 INFO:teuthology.orchestra.run.smithi125.stdout:(12/30): python3-rbd-18.2.1-0.el9.x86_64.rpm 2.7 MB/s | 297 kB 00:00 2024-02-19T18:49:35.010 INFO:teuthology.orchestra.run.smithi125.stdout:(13/30): ceph-common-18.2.1-0.el9.x86_64.rpm 22 MB/s | 18 MB 00:00 2024-02-19T18:49:35.093 INFO:teuthology.orchestra.run.smithi125.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 295 kB/s | 106 kB 00:00 2024-02-19T18:49:35.119 INFO:teuthology.orchestra.run.smithi125.stdout:(15/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 415 kB/s | 44 kB 00:00 2024-02-19T18:49:35.144 INFO:teuthology.orchestra.run.smithi125.stdout:(16/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 414 kB/s | 159 kB 00:00 2024-02-19T18:49:35.278 INFO:teuthology.orchestra.run.smithi125.stdout:(17/30): librdkafka-1.6.1-102.el9.x86_64.rpm 3.5 MB/s | 661 kB 00:00 2024-02-19T18:49:35.303 INFO:teuthology.orchestra.run.smithi125.stdout:(18/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.5 MB/s | 282 kB 00:00 2024-02-19T18:49:35.320 INFO:teuthology.orchestra.run.smithi125.stdout:(19/30): python3-prettytable-0.7.2-27.el9.noarc 235 kB/s | 41 kB 00:00 2024-02-19T18:49:35.637 INFO:teuthology.orchestra.run.smithi125.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 309 kB/s | 111 kB 00:00 2024-02-19T18:49:35.695 INFO:teuthology.orchestra.run.smithi125.stdout:(21/30): libarrow-doc-9.0.0-10.el9.noarch.rpm 445 kB/s | 26 kB 00:00 2024-02-19T18:49:35.745 INFO:teuthology.orchestra.run.smithi125.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 973 kB/s | 49 kB 00:00 2024-02-19T18:49:35.779 INFO:teuthology.orchestra.run.smithi125.stdout:(23/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 673 kB/s | 309 kB 00:00 2024-02-19T18:49:35.812 INFO:teuthology.orchestra.run.smithi125.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-02-19T18:49:35.938 INFO:teuthology.orchestra.run.smithi125.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2024-02-19T18:49:36.346 INFO:teuthology.orchestra.run.smithi125.stdout:(26/30): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.4 MB/s | 838 kB 00:00 2024-02-19T18:49:36.422 INFO:teuthology.orchestra.run.smithi125.stdout:(27/30): librados2-18.2.1-0.el9.x86_64.rpm 44 MB/s | 3.3 MB 00:00 2024-02-19T18:49:36.480 INFO:teuthology.orchestra.run.smithi125.stdout:(28/30): librbd1-18.2.1-0.el9.x86_64.rpm 52 MB/s | 3.0 MB 00:00 2024-02-19T18:49:36.889 INFO:teuthology.orchestra.run.smithi125.stdout:(29/30): thrift-0.15.0-2.el9.x86_64.rpm 1.7 MB/s | 1.6 MB 00:00 2024-02-19T18:49:38.122 INFO:teuthology.orchestra.run.smithi125.stdout:(30/30): libarrow-9.0.0-10.el9.x86_64.rpm 1.6 MB/s | 4.4 MB 00:02 2024-02-19T18:49:38.130 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:49:38.130 INFO:teuthology.orchestra.run.smithi125.stdout:Total 13 MB/s | 53 MB 00:04 2024-02-19T18:49:38.130 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2024-02-19T18:49:38.166 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2024-02-19T18:49:38.166 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2024-02-19T18:49:38.608 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2024-02-19T18:49:38.608 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2024-02-19T18:49:39.988 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2024-02-19T18:49:40.082 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-02-19T18:49:40.110 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-02-19T18:49:40.160 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-02-19T18:49:40.519 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-02-19T18:49:40.551 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : librados2-2:18.2.1-0.el9.x86_64 5/32 2024-02-19T18:49:40.643 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librados2-2:18.2.1-0.el9.x86_64 5/32 2024-02-19T18:49:40.715 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rados-2:18.2.1-0.el9.x86_64 6/32 2024-02-19T18:49:40.744 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libcephfs2-2:18.2.1-0.el9.x86_64 7/32 2024-02-19T18:49:40.807 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libcephfs2-2:18.2.1-0.el9.x86_64 7/32 2024-02-19T18:49:40.835 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-02-19T18:49:40.879 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-ceph-argparse-2:18.2.1-0.el9.x86_64 9/32 2024-02-19T18:49:40.945 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cephfs-2:18.2.1-0.el9.x86_64 10/32 2024-02-19T18:49:40.971 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libradosstriper1-2:18.2.1-0.el9.x86_64 11/32 2024-02-19T18:49:41.037 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libradosstriper1-2:18.2.1-0.el9.x86_64 11/32 2024-02-19T18:49:41.143 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-02-19T18:49:41.179 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/32 2024-02-19T18:49:41.220 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-02-19T18:49:41.252 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-02-19T18:49:41.279 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/32 2024-02-19T18:49:41.314 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-02-19T18:49:41.347 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-02-19T18:49:41.651 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-02-19T18:49:41.679 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : librbd1-2:18.2.1-0.el9.x86_64 20/32 2024-02-19T18:49:41.768 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librbd1-2:18.2.1-0.el9.x86_64 20/32 2024-02-19T18:49:41.808 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rbd-2:18.2.1-0.el9.x86_64 21/32 2024-02-19T18:49:41.856 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-02-19T18:49:42.255 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 23/32 2024-02-19T18:49:42.281 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librgw2-2:18.2.1-0.el9.x86_64 24/32 2024-02-19T18:49:42.344 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librgw2-2:18.2.1-0.el9.x86_64 24/32 2024-02-19T18:49:42.411 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rgw-2:18.2.1-0.el9.x86_64 25/32 2024-02-19T18:49:42.442 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-ceph-common-2:18.2.1-0.el9.x86_64 26/32 2024-02-19T18:49:44.547 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-02-19T18:49:44.580 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-02-19T18:49:44.993 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - AppStream 571 kB/s | 19 MB 00:34 2024-02-19T18:49:45.140 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-02-19T18:49:45.183 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-base-2:18.2.1-0.el9.x86_64 28/32 2024-02-19T18:49:45.276 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-base-2:18.2.1-0.el9.x86_64 28/32 2024-02-19T18:49:45.276 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-19T18:49:45.276 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-19T18:49:45.277 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:49:45.318 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-selinux-2:18.2.1-0.el9.x86_64 29/32 2024-02-19T18:49:49.051 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.1 MB 00:00 2024-02-19T18:49:50.394 INFO:teuthology.orchestra.run.smithi096.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 15 kB 00:00 2024-02-19T18:49:52.195 INFO:teuthology.orchestra.run.smithi096.stdout:Extra Packages for Enterprise Linux 12 MB/s | 20 MB 00:01 2024-02-19T18:49:54.924 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-selinux-2:18.2.1-0.el9.x86_64 29/32 2024-02-19T18:49:54.924 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /sys 2024-02-19T18:49:54.924 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /proc 2024-02-19T18:49:54.925 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /mnt 2024-02-19T18:49:54.925 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /var/tmp 2024-02-19T18:49:54.925 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /home 2024-02-19T18:49:54.925 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /root 2024-02-19T18:49:54.925 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /tmp 2024-02-19T18:49:54.925 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:49:55.658 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-radosgw-2:18.2.1-0.el9.x86_64 30/32 2024-02-19T18:49:55.682 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-0.el9.x86_64 30/32 2024-02-19T18:49:55.682 INFO:teuthology.orchestra.run.smithi125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:49:55.682 INFO:teuthology.orchestra.run.smithi125.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-19T18:49:55.682 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-19T18:49:55.683 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-19T18:49:55.683 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:49:55.684 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-02-19T18:49:55.769 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-02-19T18:49:55.769 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-02-19T18:49:56.912 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-02-19T18:49:56.912 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-base-2:18.2.1-0.el9.x86_64 1/32 2024-02-19T18:49:56.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-common-2:18.2.1-0.el9.x86_64 2/32 2024-02-19T18:49:56.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-radosgw-2:18.2.1-0.el9.x86_64 3/32 2024-02-19T18:49:56.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-selinux-2:18.2.1-0.el9.x86_64 4/32 2024-02-19T18:49:56.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephfs2-2:18.2.1-0.el9.x86_64 5/32 2024-02-19T18:49:56.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libradosstriper1-2:18.2.1-0.el9.x86_64 6/32 2024-02-19T18:49:56.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librgw2-2:18.2.1-0.el9.x86_64 7/32 2024-02-19T18:49:56.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-ceph-argparse-2:18.2.1-0.el9.x86_64 8/32 2024-02-19T18:49:56.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-ceph-common-2:18.2.1-0.el9.x86_64 9/32 2024-02-19T18:49:56.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cephfs-2:18.2.1-0.el9.x86_64 10/32 2024-02-19T18:49:56.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rados-2:18.2.1-0.el9.x86_64 11/32 2024-02-19T18:49:56.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rbd-2:18.2.1-0.el9.x86_64 12/32 2024-02-19T18:49:56.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rgw-2:18.2.1-0.el9.x86_64 13/32 2024-02-19T18:49:56.913 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-02-19T18:49:56.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-02-19T18:49:56.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-02-19T18:49:56.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-02-19T18:49:56.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-02-19T18:49:56.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-02-19T18:49:56.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-02-19T18:49:56.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-02-19T18:49:56.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 22/32 2024-02-19T18:49:56.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 23/32 2024-02-19T18:49:56.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-02-19T18:49:56.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-02-19T18:49:56.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 26/32 2024-02-19T18:49:56.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-02-19T18:49:56.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-02-19T18:49:56.914 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librados2-2:18.2.1-0.el9.x86_64 29/32 2024-02-19T18:49:56.915 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-02-19T18:49:56.915 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librbd1-2:18.2.1-0.el9.x86_64 31/32 2024-02-19T18:49:57.011 INFO:teuthology.orchestra.run.smithi096.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-02-19T18:49:57.936 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-02-19T18:49:57.936 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:49:57.936 INFO:teuthology.orchestra.run.smithi125.stdout:Upgraded: 2024-02-19T18:49:57.936 INFO:teuthology.orchestra.run.smithi125.stdout: librados2-2:18.2.1-0.el9.x86_64 librbd1-2:18.2.1-0.el9.x86_64 2024-02-19T18:49:57.937 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2024-02-19T18:49:57.937 INFO:teuthology.orchestra.run.smithi125.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-19T18:49:57.937 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-base-2:18.2.1-0.el9.x86_64 2024-02-19T18:49:57.937 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-common-2:18.2.1-0.el9.x86_64 2024-02-19T18:49:57.937 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-radosgw-2:18.2.1-0.el9.x86_64 2024-02-19T18:49:57.937 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-selinux-2:18.2.1-0.el9.x86_64 2024-02-19T18:49:57.937 INFO:teuthology.orchestra.run.smithi125.stdout: fmt-8.1.1-5.el9.x86_64 2024-02-19T18:49:57.937 INFO:teuthology.orchestra.run.smithi125.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-19T18:49:57.937 INFO:teuthology.orchestra.run.smithi125.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-19T18:49:57.937 INFO:teuthology.orchestra.run.smithi125.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-19T18:49:57.937 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs2-2:18.2.1-0.el9.x86_64 2024-02-19T18:49:57.937 INFO:teuthology.orchestra.run.smithi125.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-19T18:49:57.937 INFO:teuthology.orchestra.run.smithi125.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-19T18:49:57.938 INFO:teuthology.orchestra.run.smithi125.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-19T18:49:57.938 INFO:teuthology.orchestra.run.smithi125.stdout: libradosstriper1-2:18.2.1-0.el9.x86_64 2024-02-19T18:49:57.938 INFO:teuthology.orchestra.run.smithi125.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-19T18:49:57.938 INFO:teuthology.orchestra.run.smithi125.stdout: librgw2-2:18.2.1-0.el9.x86_64 2024-02-19T18:49:57.938 INFO:teuthology.orchestra.run.smithi125.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-19T18:49:57.938 INFO:teuthology.orchestra.run.smithi125.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-19T18:49:57.938 INFO:teuthology.orchestra.run.smithi125.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-19T18:49:57.938 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-argparse-2:18.2.1-0.el9.x86_64 2024-02-19T18:49:57.938 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-common-2:18.2.1-0.el9.x86_64 2024-02-19T18:49:57.938 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cephfs-2:18.2.1-0.el9.x86_64 2024-02-19T18:49:57.938 INFO:teuthology.orchestra.run.smithi125.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-19T18:49:57.938 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rados-2:18.2.1-0.el9.x86_64 2024-02-19T18:49:57.938 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rbd-2:18.2.1-0.el9.x86_64 2024-02-19T18:49:57.938 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rgw-2:18.2.1-0.el9.x86_64 2024-02-19T18:49:57.939 INFO:teuthology.orchestra.run.smithi125.stdout: re2-1:20211101-3.el9.x86_64 2024-02-19T18:49:57.939 INFO:teuthology.orchestra.run.smithi125.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-19T18:49:57.939 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:49:57.939 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:49:58.299 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install ceph-test 2024-02-19T18:49:58.876 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:00:27 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:49:59.040 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:49:59.041 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:49:59.041 INFO:teuthology.orchestra.run.smithi125.stdout: Package Arch Version Repository Size 2024-02-19T18:49:59.041 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:49:59.041 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2024-02-19T18:49:59.041 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-test x86_64 2:18.2.1-0.el9 ceph 40 M 2024-02-19T18:49:59.041 INFO:teuthology.orchestra.run.smithi125.stdout:Installing dependencies: 2024-02-19T18:49:59.041 INFO:teuthology.orchestra.run.smithi125.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-19T18:49:59.041 INFO:teuthology.orchestra.run.smithi125.stdout: libcephsqlite x86_64 2:18.2.1-0.el9 ceph 165 k 2024-02-19T18:49:59.041 INFO:teuthology.orchestra.run.smithi125.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-19T18:49:59.041 INFO:teuthology.orchestra.run.smithi125.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-19T18:49:59.041 INFO:teuthology.orchestra.run.smithi125.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-19T18:49:59.042 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:49:59.042 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2024-02-19T18:49:59.042 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:49:59.042 INFO:teuthology.orchestra.run.smithi125.stdout:Install 6 Packages 2024-02-19T18:49:59.042 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:49:59.042 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 41 M 2024-02-19T18:49:59.042 INFO:teuthology.orchestra.run.smithi125.stdout:Installed size: 167 M 2024-02-19T18:49:59.042 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2024-02-19T18:49:59.166 INFO:teuthology.orchestra.run.smithi125.stdout:(1/6): libcephsqlite-18.2.1-0.el9.x86_64.rpm 1.3 MB/s | 165 kB 00:00 2024-02-19T18:49:59.324 INFO:teuthology.orchestra.run.smithi125.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.0 MB/s | 300 kB 00:00 2024-02-19T18:49:59.350 INFO:teuthology.orchestra.run.smithi125.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 343 kB/s | 63 kB 00:00 2024-02-19T18:49:59.681 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:49:59.698 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:49:59.698 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2024-02-19T18:49:59.698 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:49:59.698 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2024-02-19T18:49:59.698 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-radosgw x86_64 2:18.2.1-0.el9 ceph 7.7 M 2024-02-19T18:49:59.698 INFO:teuthology.orchestra.run.smithi096.stdout:Upgrading: 2024-02-19T18:49:59.698 INFO:teuthology.orchestra.run.smithi096.stdout: librados2 x86_64 2:18.2.1-0.el9 ceph 3.3 M 2024-02-19T18:49:59.699 INFO:teuthology.orchestra.run.smithi096.stdout: librbd1 x86_64 2:18.2.1-0.el9 ceph 3.0 M 2024-02-19T18:49:59.699 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2024-02-19T18:49:59.699 INFO:teuthology.orchestra.run.smithi096.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-19T18:49:59.699 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base x86_64 2:18.2.1-0.el9 ceph 5.2 M 2024-02-19T18:49:59.699 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-common x86_64 2:18.2.1-0.el9 ceph 18 M 2024-02-19T18:49:59.699 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-selinux x86_64 2:18.2.1-0.el9 ceph 24 k 2024-02-19T18:49:59.699 INFO:teuthology.orchestra.run.smithi096.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-02-19T18:49:59.699 INFO:teuthology.orchestra.run.smithi096.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-19T18:49:59.699 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-19T18:49:59.699 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-19T18:49:59.699 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2 x86_64 2:18.2.1-0.el9 ceph 658 k 2024-02-19T18:49:59.699 INFO:teuthology.orchestra.run.smithi096.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-19T18:49:59.699 INFO:teuthology.orchestra.run.smithi096.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-19T18:49:59.699 INFO:teuthology.orchestra.run.smithi096.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-19T18:49:59.700 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1 x86_64 2:18.2.1-0.el9 ceph 474 k 2024-02-19T18:49:59.700 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-19T18:49:59.700 INFO:teuthology.orchestra.run.smithi096.stdout: librgw2 x86_64 2:18.2.1-0.el9 ceph 4.5 M 2024-02-19T18:49:59.700 INFO:teuthology.orchestra.run.smithi096.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-19T18:49:59.700 INFO:teuthology.orchestra.run.smithi096.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-19T18:49:59.700 INFO:teuthology.orchestra.run.smithi096.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-19T18:49:59.700 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse x86_64 2:18.2.1-0.el9 ceph 45 k 2024-02-19T18:49:59.700 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common x86_64 2:18.2.1-0.el9 ceph 124 k 2024-02-19T18:49:59.700 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs x86_64 2:18.2.1-0.el9 ceph 161 k 2024-02-19T18:49:59.700 INFO:teuthology.orchestra.run.smithi096.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-19T18:49:59.700 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados x86_64 2:18.2.1-0.el9 ceph 321 k 2024-02-19T18:49:59.700 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rbd x86_64 2:18.2.1-0.el9 ceph 297 k 2024-02-19T18:49:59.700 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw x86_64 2:18.2.1-0.el9 ceph 99 k 2024-02-19T18:49:59.701 INFO:teuthology.orchestra.run.smithi096.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-19T18:49:59.701 INFO:teuthology.orchestra.run.smithi096.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-19T18:49:59.701 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:49:59.701 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2024-02-19T18:49:59.701 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:49:59.701 INFO:teuthology.orchestra.run.smithi096.stdout:Install 28 Packages 2024-02-19T18:49:59.701 INFO:teuthology.orchestra.run.smithi096.stdout:Upgrade 2 Packages 2024-02-19T18:49:59.701 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:49:59.701 INFO:teuthology.orchestra.run.smithi125.stdout:(4/6): ceph-test-18.2.1-0.el9.x86_64.rpm 60 MB/s | 40 MB 00:00 2024-02-19T18:49:59.702 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 53 M 2024-02-19T18:49:59.702 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2024-02-19T18:49:59.725 INFO:teuthology.orchestra.run.smithi125.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 465 kB/s | 186 kB 00:00 2024-02-19T18:49:59.750 INFO:teuthology.orchestra.run.smithi125.stdout:(6/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 542 kB/s | 217 kB 00:00 2024-02-19T18:49:59.753 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:49:59.753 INFO:teuthology.orchestra.run.smithi125.stdout:Total 57 MB/s | 41 MB 00:00 2024-02-19T18:49:59.754 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2024-02-19T18:49:59.773 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2024-02-19T18:49:59.773 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2024-02-19T18:50:00.122 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2024-02-19T18:50:00.122 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2024-02-19T18:50:00.196 INFO:teuthology.orchestra.run.smithi096.stdout:(1/30): ceph-base-18.2.1-0.el9.x86_64.rpm 28 MB/s | 5.2 MB 00:00 2024-02-19T18:50:00.221 INFO:teuthology.orchestra.run.smithi096.stdout:(2/30): ceph-selinux-18.2.1-0.el9.x86_64.rpm 970 kB/s | 24 kB 00:00 2024-02-19T18:50:00.254 INFO:teuthology.orchestra.run.smithi096.stdout:(3/30): libcephfs2-18.2.1-0.el9.x86_64.rpm 19 MB/s | 658 kB 00:00 2024-02-19T18:50:00.288 INFO:teuthology.orchestra.run.smithi096.stdout:(4/30): libradosstriper1-18.2.1-0.el9.x86_64.rp 14 MB/s | 474 kB 00:00 2024-02-19T18:50:00.397 INFO:teuthology.orchestra.run.smithi096.stdout:(5/30): librgw2-18.2.1-0.el9.x86_64.rpm 41 MB/s | 4.5 MB 00:00 2024-02-19T18:50:00.438 INFO:teuthology.orchestra.run.smithi096.stdout:(6/30): python3-ceph-argparse-18.2.1-0.el9.x86_ 1.1 MB/s | 45 kB 00:00 2024-02-19T18:50:00.464 INFO:teuthology.orchestra.run.smithi096.stdout:(7/30): python3-ceph-common-18.2.1-0.el9.x86_64 4.9 MB/s | 124 kB 00:00 2024-02-19T18:50:00.497 INFO:teuthology.orchestra.run.smithi096.stdout:(8/30): python3-cephfs-18.2.1-0.el9.x86_64.rpm 4.7 MB/s | 161 kB 00:00 2024-02-19T18:50:00.606 INFO:teuthology.orchestra.run.smithi096.stdout:(9/30): ceph-radosgw-18.2.1-0.el9.x86_64.rpm 13 MB/s | 7.7 MB 00:00 2024-02-19T18:50:00.632 INFO:teuthology.orchestra.run.smithi096.stdout:(10/30): python3-rados-18.2.1-0.el9.x86_64.rpm 2.3 MB/s | 321 kB 00:00 2024-02-19T18:50:00.650 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2024-02-19T18:50:00.657 INFO:teuthology.orchestra.run.smithi096.stdout:(11/30): python3-rbd-18.2.1-0.el9.x86_64.rpm 5.8 MB/s | 297 kB 00:00 2024-02-19T18:50:00.682 INFO:teuthology.orchestra.run.smithi096.stdout:(12/30): python3-rgw-18.2.1-0.el9.x86_64.rpm 1.9 MB/s | 99 kB 00:00 2024-02-19T18:50:00.707 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 1/6 2024-02-19T18:50:00.740 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : jq-1.6-16.el9.x86_64 2/6 2024-02-19T18:50:00.790 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/6 2024-02-19T18:50:00.834 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/6 2024-02-19T18:50:00.853 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libcephsqlite-2:18.2.1-0.el9.x86_64 5/6 2024-02-19T18:50:00.941 INFO:teuthology.orchestra.run.smithi096.stdout:(13/30): ceph-common-18.2.1-0.el9.x86_64.rpm 20 MB/s | 18 MB 00:00 2024-02-19T18:50:01.049 INFO:teuthology.orchestra.run.smithi096.stdout:(14/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 418 kB/s | 44 kB 00:00 2024-02-19T18:50:01.108 INFO:teuthology.orchestra.run.smithi096.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 374 kB/s | 159 kB 00:00 2024-02-19T18:50:01.142 INFO:teuthology.orchestra.run.smithi096.stdout:(16/30): boost-program-options-1.75.0-8.el9.x86 218 kB/s | 106 kB 00:00 2024-02-19T18:50:01.208 INFO:teuthology.orchestra.run.smithi096.stdout:(17/30): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 661 kB 00:00 2024-02-19T18:50:01.234 INFO:teuthology.orchestra.run.smithi096.stdout:(18/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.2 MB/s | 282 kB 00:00 2024-02-19T18:50:01.259 INFO:teuthology.orchestra.run.smithi096.stdout:(19/30): python3-prettytable-0.7.2-27.el9.noarc 352 kB/s | 41 kB 00:00 2024-02-19T18:50:01.484 INFO:teuthology.orchestra.run.smithi096.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 403 kB/s | 111 kB 00:00 2024-02-19T18:50:01.776 INFO:teuthology.orchestra.run.smithi096.stdout:(21/30): libarrow-doc-9.0.0-10.el9.noarch.rpm 89 kB/s | 26 kB 00:00 2024-02-19T18:50:02.284 INFO:teuthology.orchestra.run.smithi096.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 96 kB/s | 49 kB 00:00 2024-02-19T18:50:03.260 INFO:teuthology.orchestra.run.smithi096.stdout:(23/30): libunwind-1.6.2-1.el9.x86_64.rpm 69 kB/s | 67 kB 00:00 2024-02-19T18:50:04.101 INFO:teuthology.orchestra.run.smithi096.stdout:(24/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 109 kB/s | 309 kB 00:02 2024-02-19T18:50:04.632 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libcephsqlite-2:18.2.1-0.el9.x86_64 5/6 2024-02-19T18:50:04.712 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-test-2:18.2.1-0.el9.x86_64 6/6 2024-02-19T18:50:05.452 INFO:teuthology.orchestra.run.smithi096.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 142 kB/s | 192 kB 00:01 2024-02-19T18:50:06.755 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-test-2:18.2.1-0.el9.x86_64 6/6 2024-02-19T18:50:06.755 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-test-2:18.2.1-0.el9.x86_64 1/6 2024-02-19T18:50:06.755 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephsqlite-2:18.2.1-0.el9.x86_64 2/6 2024-02-19T18:50:06.755 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/6 2024-02-19T18:50:06.755 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/6 2024-02-19T18:50:06.755 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : jq-1.6-16.el9.x86_64 5/6 2024-02-19T18:50:07.156 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/6 2024-02-19T18:50:07.156 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:07.156 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2024-02-19T18:50:07.156 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-test-2:18.2.1-0.el9.x86_64 jq-1.6-16.el9.x86_64 2024-02-19T18:50:07.157 INFO:teuthology.orchestra.run.smithi125.stdout: libcephsqlite-2:18.2.1-0.el9.x86_64 oniguruma-6.9.6-1.el9.5.x86_64 2024-02-19T18:50:07.157 INFO:teuthology.orchestra.run.smithi125.stdout: socat-1.7.4.1-5.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-02-19T18:50:07.157 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:07.157 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:50:07.462 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install ceph 2024-02-19T18:50:08.047 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:00:37 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:50:08.220 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:50:08.223 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:08.223 INFO:teuthology.orchestra.run.smithi125.stdout: Package Arch Version Repository Size 2024-02-19T18:50:08.223 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:08.223 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2024-02-19T18:50:08.223 INFO:teuthology.orchestra.run.smithi125.stdout: ceph x86_64 2:18.2.1-0.el9 ceph 6.4 k 2024-02-19T18:50:08.223 INFO:teuthology.orchestra.run.smithi125.stdout:Installing dependencies: 2024-02-19T18:50:08.223 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mds x86_64 2:18.2.1-0.el9 ceph 2.1 M 2024-02-19T18:50:08.223 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr x86_64 2:18.2.1-0.el9 ceph 1.4 M 2024-02-19T18:50:08.224 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-modules-core noarch 2:18.2.1-0.el9 ceph-noarch 242 k 2024-02-19T18:50:08.224 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mon x86_64 2:18.2.1-0.el9 ceph 4.4 M 2024-02-19T18:50:08.224 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-osd x86_64 2:18.2.1-0.el9 ceph 18 M 2024-02-19T18:50:08.224 INFO:teuthology.orchestra.run.smithi125.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-19T18:50:08.224 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-19T18:50:08.224 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-19T18:50:08.224 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-19T18:50:08.224 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-19T18:50:08.224 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-19T18:50:08.224 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-19T18:50:08.224 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-19T18:50:08.225 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-19T18:50:08.225 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-19T18:50:08.225 INFO:teuthology.orchestra.run.smithi125.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-19T18:50:08.225 INFO:teuthology.orchestra.run.smithi125.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-19T18:50:08.225 INFO:teuthology.orchestra.run.smithi125.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-19T18:50:08.225 INFO:teuthology.orchestra.run.smithi125.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-19T18:50:08.225 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-19T18:50:08.225 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-19T18:50:08.225 INFO:teuthology.orchestra.run.smithi125.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-19T18:50:08.225 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-19T18:50:08.225 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-19T18:50:08.225 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-19T18:50:08.226 INFO:teuthology.orchestra.run.smithi125.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-19T18:50:08.226 INFO:teuthology.orchestra.run.smithi125.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-19T18:50:08.226 INFO:teuthology.orchestra.run.smithi125.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-19T18:50:08.226 INFO:teuthology.orchestra.run.smithi125.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-19T18:50:08.226 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-19T18:50:08.226 INFO:teuthology.orchestra.run.smithi125.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-19T18:50:08.226 INFO:teuthology.orchestra.run.smithi125.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-19T18:50:08.226 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:08.226 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2024-02-19T18:50:08.226 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:08.226 INFO:teuthology.orchestra.run.smithi125.stdout:Install 33 Packages 2024-02-19T18:50:08.226 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:08.227 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 30 M 2024-02-19T18:50:08.227 INFO:teuthology.orchestra.run.smithi125.stdout:Installed size: 110 M 2024-02-19T18:50:08.227 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2024-02-19T18:50:08.677 INFO:teuthology.orchestra.run.smithi125.stdout:(1/33): ceph-18.2.1-0.el9.x86_64.rpm 66 kB/s | 6.4 kB 00:00 2024-02-19T18:50:08.727 INFO:teuthology.orchestra.run.smithi125.stdout:(2/33): ceph-mgr-18.2.1-0.el9.x86_64.rpm 9.8 MB/s | 1.4 MB 00:00 2024-02-19T18:50:08.769 INFO:teuthology.orchestra.run.smithi125.stdout:(3/33): ceph-mds-18.2.1-0.el9.x86_64.rpm 11 MB/s | 2.1 MB 00:00 2024-02-19T18:50:08.794 INFO:teuthology.orchestra.run.smithi125.stdout:(4/33): ceph-mgr-modules-core-18.2.1-0.el9.noar 9.6 MB/s | 242 kB 00:00 2024-02-19T18:50:08.886 INFO:teuthology.orchestra.run.smithi125.stdout:(5/33): ceph-mon-18.2.1-0.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-02-19T18:50:09.137 INFO:teuthology.orchestra.run.smithi125.stdout:(6/33): ceph-osd-18.2.1-0.el9.x86_64.rpm 43 MB/s | 18 MB 00:00 2024-02-19T18:50:09.212 INFO:teuthology.orchestra.run.smithi125.stdout:(7/33): python3-markupsafe-1.1.1-12.el9.x86_64. 105 kB/s | 32 kB 00:00 2024-02-19T18:50:09.237 INFO:teuthology.orchestra.run.smithi125.stdout:(8/33): python3-mako-1.1.4-6.el9.noarch.rpm 326 kB/s | 144 kB 00:00 2024-02-19T18:50:09.262 INFO:teuthology.orchestra.run.smithi125.stdout:(9/33): python3-pytz-2021.1-5.el9.noarch.rpm 382 kB/s | 47 kB 00:00 2024-02-19T18:50:09.287 INFO:teuthology.orchestra.run.smithi125.stdout:(10/33): python3-toml-0.10.2-6.el9.noarch.rpm 512 kB/s | 39 kB 00:00 2024-02-19T18:50:09.421 INFO:teuthology.orchestra.run.smithi125.stdout:(11/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 241 kB 00:00 2024-02-19T18:50:10.055 INFO:teuthology.orchestra.run.smithi125.stdout:(12/33): python3-cryptography-36.0.1-4.el9.x86_ 1.4 MB/s | 1.1 MB 00:00 2024-02-19T18:50:10.088 INFO:teuthology.orchestra.run.smithi125.stdout:(13/33): python3-ply-3.11-14.el9.noarch.rpm 128 kB/s | 103 kB 00:00 2024-02-19T18:50:10.138 INFO:teuthology.orchestra.run.smithi125.stdout:(14/33): python3-pycparser-2.20-6.el9.noarch.rp 173 kB/s | 124 kB 00:00 2024-02-19T18:50:10.143 INFO:teuthology.orchestra.run.smithi096.stdout:(26/30): parquet-libs-9.0.0-10.el9.x86_64.rpm 122 kB/s | 838 kB 00:06 2024-02-19T18:50:10.180 INFO:teuthology.orchestra.run.smithi125.stdout:(15/33): python3-requests-2.25.1-8.el9.noarch.r 903 kB/s | 113 kB 00:00 2024-02-19T18:50:10.226 INFO:teuthology.orchestra.run.smithi096.stdout:(27/30): librados2-18.2.1-0.el9.x86_64.rpm 39 MB/s | 3.3 MB 00:00 2024-02-19T18:50:10.264 INFO:teuthology.orchestra.run.smithi125.stdout:(16/33): python3-urllib3-1.26.5-5.el9.noarch.rp 1.0 MB/s | 187 kB 00:00 2024-02-19T18:50:10.293 INFO:teuthology.orchestra.run.smithi096.stdout:(28/30): librbd1-18.2.1-0.el9.x86_64.rpm 45 MB/s | 3.0 MB 00:00 2024-02-19T18:50:10.298 INFO:teuthology.orchestra.run.smithi125.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 273 kB/s | 43 kB 00:00 2024-02-19T18:50:10.348 INFO:teuthology.orchestra.run.smithi125.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 214 kB/s | 11 kB 00:00 2024-02-19T18:50:10.390 INFO:teuthology.orchestra.run.smithi125.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 821 kB/s | 172 kB 00:00 2024-02-19T18:50:10.407 INFO:teuthology.orchestra.run.smithi125.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 303 kB/s | 18 kB 00:00 2024-02-19T18:50:10.449 INFO:teuthology.orchestra.run.smithi125.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 397 kB/s | 23 kB 00:00 2024-02-19T18:50:10.465 INFO:teuthology.orchestra.run.smithi125.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 332 kB/s | 19 kB 00:00 2024-02-19T18:50:10.507 INFO:teuthology.orchestra.run.smithi125.stdout:(23/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-02-19T18:50:10.524 INFO:teuthology.orchestra.run.smithi125.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 261 kB/s | 20 kB 00:00 2024-02-19T18:50:10.541 INFO:teuthology.orchestra.run.smithi125.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 614 kB/s | 46 kB 00:00 2024-02-19T18:50:10.583 INFO:teuthology.orchestra.run.smithi125.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-02-19T18:50:10.600 INFO:teuthology.orchestra.run.smithi125.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 280 kB/s | 16 kB 00:00 2024-02-19T18:50:10.642 INFO:teuthology.orchestra.run.smithi125.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-02-19T18:50:10.667 INFO:teuthology.orchestra.run.smithi125.stdout:(29/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-02-19T18:50:10.684 INFO:teuthology.orchestra.run.smithi125.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 427 kB/s | 36 kB 00:00 2024-02-19T18:50:10.735 INFO:teuthology.orchestra.run.smithi125.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 399 kB/s | 20 kB 00:00 2024-02-19T18:50:10.768 INFO:teuthology.orchestra.run.smithi125.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-02-19T18:50:10.793 INFO:teuthology.orchestra.run.smithi125.stdout:(33/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-02-19T18:50:10.798 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:50:10.798 INFO:teuthology.orchestra.run.smithi125.stdout:Total 12 MB/s | 30 MB 00:02 2024-02-19T18:50:10.798 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2024-02-19T18:50:10.836 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2024-02-19T18:50:10.836 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2024-02-19T18:50:11.203 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2024-02-19T18:50:11.203 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2024-02-19T18:50:12.449 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2024-02-19T18:50:12.504 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-02-19T18:50:12.536 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-02-19T18:50:12.569 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-02-19T18:50:12.660 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-02-19T18:50:12.746 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-02-19T18:50:12.789 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-02-19T18:50:12.861 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-02-19T18:50:12.914 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-02-19T18:50:12.952 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-02-19T18:50:13.002 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-02-19T18:50:13.066 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-02-19T18:50:13.249 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-02-19T18:50:13.297 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-02-19T18:50:13.328 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-02-19T18:50:13.363 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-02-19T18:50:13.393 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-02-19T18:50:13.469 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-02-19T18:50:13.512 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-19T18:50:13.545 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-02-19T18:50:13.585 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-02-19T18:50:13.620 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-02-19T18:50:13.654 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-02-19T18:50:13.744 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-02-19T18:50:13.778 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-02-19T18:50:13.858 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-02-19T18:50:13.994 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-02-19T18:50:14.120 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-19T18:50:14.274 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 28/33 2024-02-19T18:50:14.298 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-2:18.2.1-0.el9.x86_64 29/33 2024-02-19T18:50:14.323 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-2:18.2.1-0.el9.x86_64 29/33 2024-02-19T18:50:14.323 INFO:teuthology.orchestra.run.smithi125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:50:14.323 INFO:teuthology.orchestra.run.smithi125.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-19T18:50:14.323 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-19T18:50:14.324 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-19T18:50:14.324 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:15.833 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-osd-2:18.2.1-0.el9.x86_64 30/33 2024-02-19T18:50:15.859 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-osd-2:18.2.1-0.el9.x86_64 30/33 2024-02-19T18:50:15.859 INFO:teuthology.orchestra.run.smithi125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:50:15.859 INFO:teuthology.orchestra.run.smithi125.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-19T18:50:15.859 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-19T18:50:15.860 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-19T18:50:15.860 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:16.317 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mon-2:18.2.1-0.el9.x86_64 31/33 2024-02-19T18:50:16.340 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mon-2:18.2.1-0.el9.x86_64 31/33 2024-02-19T18:50:16.340 INFO:teuthology.orchestra.run.smithi125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:50:16.340 INFO:teuthology.orchestra.run.smithi125.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-19T18:50:16.340 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-19T18:50:16.340 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-19T18:50:16.340 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:16.542 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mds-2:18.2.1-0.el9.x86_64 32/33 2024-02-19T18:50:16.565 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mds-2:18.2.1-0.el9.x86_64 32/33 2024-02-19T18:50:16.565 INFO:teuthology.orchestra.run.smithi125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:50:16.565 INFO:teuthology.orchestra.run.smithi125.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-19T18:50:16.565 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-19T18:50:16.566 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-19T18:50:16.566 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:16.632 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-2:18.2.1-0.el9.x86_64 33/33 2024-02-19T18:50:18.433 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-2:18.2.1-0.el9.x86_64 33/33 2024-02-19T18:50:18.433 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-2:18.2.1-0.el9.x86_64 1/33 2024-02-19T18:50:18.434 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mds-2:18.2.1-0.el9.x86_64 2/33 2024-02-19T18:50:18.434 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-2:18.2.1-0.el9.x86_64 3/33 2024-02-19T18:50:18.434 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mon-2:18.2.1-0.el9.x86_64 4/33 2024-02-19T18:50:18.434 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-osd-2:18.2.1-0.el9.x86_64 5/33 2024-02-19T18:50:18.434 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 6/33 2024-02-19T18:50:18.434 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-02-19T18:50:18.434 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-02-19T18:50:18.434 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-02-19T18:50:18.434 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-02-19T18:50:18.434 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-02-19T18:50:18.434 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-02-19T18:50:18.434 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-02-19T18:50:18.434 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-02-19T18:50:18.434 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 15/33 2024-02-19T18:50:18.434 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/33 2024-02-19T18:50:18.435 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-02-19T18:50:18.435 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-19T18:50:18.435 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-02-19T18:50:18.435 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-02-19T18:50:18.435 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-02-19T18:50:18.435 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-02-19T18:50:18.435 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-02-19T18:50:18.435 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-02-19T18:50:18.435 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-02-19T18:50:18.435 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-02-19T18:50:18.435 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-19T18:50:18.435 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-02-19T18:50:18.436 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-02-19T18:50:18.436 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-02-19T18:50:18.436 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-02-19T18:50:18.436 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-02-19T18:50:19.423 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-02-19T18:50:19.423 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:19.423 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2024-02-19T18:50:19.423 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-2:18.2.1-0.el9.x86_64 2024-02-19T18:50:19.423 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mds-2:18.2.1-0.el9.x86_64 2024-02-19T18:50:19.423 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-2:18.2.1-0.el9.x86_64 2024-02-19T18:50:19.423 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 2024-02-19T18:50:19.423 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mon-2:18.2.1-0.el9.x86_64 2024-02-19T18:50:19.423 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-osd-2:18.2.1-0.el9.x86_64 2024-02-19T18:50:19.423 INFO:teuthology.orchestra.run.smithi125.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-19T18:50:19.423 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-19T18:50:19.423 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-19T18:50:19.424 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-19T18:50:19.424 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-19T18:50:19.424 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-19T18:50:19.424 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-19T18:50:19.424 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-19T18:50:19.424 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-19T18:50:19.424 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-19T18:50:19.424 INFO:teuthology.orchestra.run.smithi125.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-19T18:50:19.424 INFO:teuthology.orchestra.run.smithi125.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-19T18:50:19.424 INFO:teuthology.orchestra.run.smithi125.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-19T18:50:19.424 INFO:teuthology.orchestra.run.smithi125.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-19T18:50:19.424 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-19T18:50:19.424 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ply-3.11-14.el9.noarch 2024-02-19T18:50:19.424 INFO:teuthology.orchestra.run.smithi125.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-19T18:50:19.424 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-19T18:50:19.425 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-19T18:50:19.425 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-19T18:50:19.425 INFO:teuthology.orchestra.run.smithi125.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-19T18:50:19.425 INFO:teuthology.orchestra.run.smithi125.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-19T18:50:19.425 INFO:teuthology.orchestra.run.smithi125.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-19T18:50:19.425 INFO:teuthology.orchestra.run.smithi125.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-19T18:50:19.425 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-19T18:50:19.425 INFO:teuthology.orchestra.run.smithi125.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-19T18:50:19.425 INFO:teuthology.orchestra.run.smithi125.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-19T18:50:19.425 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:19.425 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:50:19.742 INFO:teuthology.orchestra.run.smithi096.stdout:(29/30): thrift-0.15.0-2.el9.x86_64.rpm 113 kB/s | 1.6 MB 00:14 2024-02-19T18:50:19.768 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install ceph-base 2024-02-19T18:50:20.353 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:00:49 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:50:20.467 INFO:teuthology.orchestra.run.smithi125.stdout:Package ceph-base-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-19T18:50:20.518 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:50:20.519 INFO:teuthology.orchestra.run.smithi125.stdout:Nothing to do. 2024-02-19T18:50:20.519 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:50:20.582 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install cephadm 2024-02-19T18:50:21.165 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:00:50 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:50:21.330 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:50:21.331 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:21.331 INFO:teuthology.orchestra.run.smithi125.stdout: Package Architecture Version Repository Size 2024-02-19T18:50:21.331 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:21.331 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2024-02-19T18:50:21.331 INFO:teuthology.orchestra.run.smithi125.stdout: cephadm noarch 2:18.2.1-0.el9 ceph-noarch 221 k 2024-02-19T18:50:21.332 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:21.332 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2024-02-19T18:50:21.332 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:21.332 INFO:teuthology.orchestra.run.smithi125.stdout:Install 1 Package 2024-02-19T18:50:21.332 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:21.332 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 221 k 2024-02-19T18:50:21.332 INFO:teuthology.orchestra.run.smithi125.stdout:Installed size: 213 k 2024-02-19T18:50:21.332 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2024-02-19T18:50:21.392 INFO:teuthology.orchestra.run.smithi125.stdout:cephadm-18.2.1-0.el9.noarch.rpm 3.6 MB/s | 221 kB 00:00 2024-02-19T18:50:21.393 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:50:21.393 INFO:teuthology.orchestra.run.smithi125.stdout:Total 3.5 MB/s | 221 kB 00:00 2024-02-19T18:50:21.393 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2024-02-19T18:50:21.398 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2024-02-19T18:50:21.399 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2024-02-19T18:50:21.401 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2024-02-19T18:50:21.401 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2024-02-19T18:50:21.472 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2024-02-19T18:50:21.862 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: cephadm-2:18.2.1-0.el9.noarch 1/1 2024-02-19T18:50:21.939 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : cephadm-2:18.2.1-0.el9.noarch 1/1 2024-02-19T18:50:22.309 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: cephadm-2:18.2.1-0.el9.noarch 1/1 2024-02-19T18:50:22.587 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : cephadm-2:18.2.1-0.el9.noarch 1/1 2024-02-19T18:50:22.587 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:22.587 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2024-02-19T18:50:22.587 INFO:teuthology.orchestra.run.smithi125.stdout: cephadm-2:18.2.1-0.el9.noarch 2024-02-19T18:50:22.587 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:22.587 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:50:22.804 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install ceph-immutable-object-cache 2024-02-19T18:50:23.390 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:00:52 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:50:23.560 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:50:23.560 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:23.560 INFO:teuthology.orchestra.run.smithi125.stdout: Package Arch Version Repo Size 2024-02-19T18:50:23.561 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:23.561 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2024-02-19T18:50:23.561 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-0.el9 ceph 142 k 2024-02-19T18:50:23.561 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:23.561 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2024-02-19T18:50:23.561 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:23.561 INFO:teuthology.orchestra.run.smithi125.stdout:Install 1 Package 2024-02-19T18:50:23.561 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:23.561 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 142 k 2024-02-19T18:50:23.561 INFO:teuthology.orchestra.run.smithi125.stdout:Installed size: 395 k 2024-02-19T18:50:23.561 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2024-02-19T18:50:23.631 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-immutable-object-cache-18.2.1-0.el9.x86_64 2.0 MB/s | 142 kB 00:00 2024-02-19T18:50:23.632 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:50:23.632 INFO:teuthology.orchestra.run.smithi125.stdout:Total 1.9 MB/s | 142 kB 00:00 2024-02-19T18:50:23.632 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2024-02-19T18:50:23.640 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2024-02-19T18:50:23.640 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2024-02-19T18:50:23.691 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2024-02-19T18:50:23.691 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2024-02-19T18:50:23.855 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2024-02-19T18:50:23.924 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:50:23.948 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:50:23.948 INFO:teuthology.orchestra.run.smithi125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:50:23.948 INFO:teuthology.orchestra.run.smithi125.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-19T18:50:23.948 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:24.984 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:50:24.984 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:24.984 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2024-02-19T18:50:24.984 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 2024-02-19T18:50:24.984 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:24.984 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:50:25.206 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install ceph-mgr 2024-02-19T18:50:25.797 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:00:54 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:50:25.915 INFO:teuthology.orchestra.run.smithi125.stdout:Package ceph-mgr-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-19T18:50:25.967 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:50:25.968 INFO:teuthology.orchestra.run.smithi125.stdout:Nothing to do. 2024-02-19T18:50:25.968 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:50:26.029 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install ceph-mgr-dashboard 2024-02-19T18:50:26.605 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:00:55 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:50:26.768 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:50:26.769 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:26.769 INFO:teuthology.orchestra.run.smithi125.stdout: Package Arch Version Repository Size 2024-02-19T18:50:26.770 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:26.770 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2024-02-19T18:50:26.770 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-dashboard noarch 2:18.2.1-0.el9 ceph-noarch 1.8 M 2024-02-19T18:50:26.770 INFO:teuthology.orchestra.run.smithi125.stdout:Installing dependencies: 2024-02-19T18:50:26.770 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-grafana-dashboards noarch 2:18.2.1-0.el9 ceph-noarch 23 k 2024-02-19T18:50:26.770 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-prometheus-alerts noarch 2:18.2.1-0.el9 ceph-noarch 15 k 2024-02-19T18:50:26.770 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-02-19T18:50:26.770 INFO:teuthology.orchestra.run.smithi125.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-19T18:50:26.770 INFO:teuthology.orchestra.run.smithi125.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-19T18:50:26.770 INFO:teuthology.orchestra.run.smithi125.stdout:Installing weak dependencies: 2024-02-19T18:50:26.770 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-02-19T18:50:26.770 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:26.770 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2024-02-19T18:50:26.770 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:26.770 INFO:teuthology.orchestra.run.smithi125.stdout:Install 7 Packages 2024-02-19T18:50:26.771 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:26.771 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 2.1 M 2024-02-19T18:50:26.771 INFO:teuthology.orchestra.run.smithi125.stdout:Installed size: 8.5 M 2024-02-19T18:50:26.771 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2024-02-19T18:50:27.227 INFO:teuthology.orchestra.run.smithi125.stdout:(1/7): ceph-grafana-dashboards-18.2.1-0.el9.noa 217 kB/s | 23 kB 00:00 2024-02-19T18:50:27.251 INFO:teuthology.orchestra.run.smithi125.stdout:(2/7): ceph-prometheus-alerts-18.2.1-0.el9.noar 111 kB/s | 15 kB 00:00 2024-02-19T18:50:27.310 INFO:teuthology.orchestra.run.smithi125.stdout:(3/7): ceph-mgr-dashboard-18.2.1-0.el9.noarch.r 9.2 MB/s | 1.8 MB 00:00 2024-02-19T18:50:27.444 INFO:teuthology.orchestra.run.smithi125.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 42 kB/s | 9.0 kB 00:00 2024-02-19T18:50:27.536 INFO:teuthology.orchestra.run.smithi125.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 144 kB/s | 41 kB 00:00 2024-02-19T18:50:27.561 INFO:teuthology.orchestra.run.smithi125.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 151 kB/s | 31 kB 00:00 2024-02-19T18:50:27.636 INFO:teuthology.orchestra.run.smithi125.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 986 kB/s | 188 kB 00:00 2024-02-19T18:50:27.640 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:50:27.640 INFO:teuthology.orchestra.run.smithi125.stdout:Total 2.4 MB/s | 2.1 MB 00:00 2024-02-19T18:50:27.641 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2024-02-19T18:50:27.648 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2024-02-19T18:50:27.648 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2024-02-19T18:50:27.714 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2024-02-19T18:50:27.715 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2024-02-19T18:50:28.019 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2024-02-19T18:50:28.079 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-02-19T18:50:28.113 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-02-19T18:50:28.159 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-02-19T18:50:28.199 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-02-19T18:50:28.228 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 5/7 2024-02-19T18:50:28.464 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 6/7 2024-02-19T18:50:28.498 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 7/7 2024-02-19T18:50:29.034 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 7/7 2024-02-19T18:50:29.034 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 1/7 2024-02-19T18:50:29.034 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 2/7 2024-02-19T18:50:29.034 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 3/7 2024-02-19T18:50:29.034 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-02-19T18:50:29.034 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-02-19T18:50:29.035 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-02-19T18:50:29.343 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-02-19T18:50:29.343 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:29.343 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2024-02-19T18:50:29.343 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 2024-02-19T18:50:29.344 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 2024-02-19T18:50:29.344 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 2024-02-19T18:50:29.344 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-02-19T18:50:29.344 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-02-19T18:50:29.344 INFO:teuthology.orchestra.run.smithi125.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-19T18:50:29.344 INFO:teuthology.orchestra.run.smithi125.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-19T18:50:29.344 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:29.344 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:50:29.545 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-19T18:50:30.121 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:00:59 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:50:30.288 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:50:30.290 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:30.290 INFO:teuthology.orchestra.run.smithi125.stdout: Package Arch Version Repository Size 2024-02-19T18:50:30.290 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:30.290 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2024-02-19T18:50:30.290 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-0.el9 ceph-noarch 7.4 M 2024-02-19T18:50:30.290 INFO:teuthology.orchestra.run.smithi125.stdout:Installing dependencies: 2024-02-19T18:50:30.290 INFO:teuthology.orchestra.run.smithi125.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-19T18:50:30.290 INFO:teuthology.orchestra.run.smithi125.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-19T18:50:30.290 INFO:teuthology.orchestra.run.smithi125.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-19T18:50:30.290 INFO:teuthology.orchestra.run.smithi125.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-19T18:50:30.290 INFO:teuthology.orchestra.run.smithi125.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-19T18:50:30.290 INFO:teuthology.orchestra.run.smithi125.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-19T18:50:30.290 INFO:teuthology.orchestra.run.smithi125.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-19T18:50:30.291 INFO:teuthology.orchestra.run.smithi125.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-19T18:50:30.291 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-19T18:50:30.291 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-19T18:50:30.291 INFO:teuthology.orchestra.run.smithi125.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-19T18:50:30.291 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:30.291 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2024-02-19T18:50:30.291 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:30.291 INFO:teuthology.orchestra.run.smithi125.stdout:Install 12 Packages 2024-02-19T18:50:30.291 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:30.292 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 37 M 2024-02-19T18:50:30.292 INFO:teuthology.orchestra.run.smithi125.stdout:Installed size: 209 M 2024-02-19T18:50:30.292 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2024-02-19T18:50:30.560 INFO:teuthology.orchestra.run.smithi125.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.1-0. 38 MB/s | 7.4 MB 00:00 2024-02-19T18:50:30.585 INFO:teuthology.orchestra.run.smithi125.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 142 kB/s | 32 kB 00:00 2024-02-19T18:50:30.627 INFO:teuthology.orchestra.run.smithi125.stdout:(3/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 262 kB/s | 17 kB 00:00 2024-02-19T18:50:30.677 INFO:teuthology.orchestra.run.smithi125.stdout:(4/12): openblas-0.3.21-2.el9.x86_64.rpm 372 kB/s | 34 kB 00:00 2024-02-19T18:50:31.019 INFO:teuthology.orchestra.run.smithi125.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.6 MB/s | 3.0 MB 00:00 2024-02-19T18:50:31.203 INFO:teuthology.orchestra.run.smithi125.stdout:(6/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 8.2 MB/s | 4.7 MB 00:00 2024-02-19T18:50:31.269 INFO:teuthology.orchestra.run.smithi125.stdout:(7/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.1 MB/s | 4.8 MB 00:00 2024-02-19T18:50:31.295 INFO:teuthology.orchestra.run.smithi125.stdout:(8/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 797 kB/s | 217 kB 00:00 2024-02-19T18:50:31.995 INFO:teuthology.orchestra.run.smithi125.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-02-19T18:50:32.037 INFO:teuthology.orchestra.run.smithi125.stdout:(10/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 802 kB 00:00 2024-02-19T18:50:32.062 INFO:teuthology.orchestra.run.smithi125.stdout:(11/12): libquadmath-11.4.1-3.el9.x86_64.rpm 254 kB/s | 194 kB 00:00 2024-02-19T18:50:32.804 INFO:teuthology.orchestra.run.smithi125.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 304 kB/s | 245 kB 00:00 2024-02-19T18:50:32.807 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:50:32.807 INFO:teuthology.orchestra.run.smithi125.stdout:Total 15 MB/s | 37 MB 00:02 2024-02-19T18:50:32.827 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2024-02-19T18:50:32.852 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2024-02-19T18:50:32.853 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2024-02-19T18:50:33.299 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2024-02-19T18:50:33.300 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2024-02-19T18:50:34.006 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2024-02-19T18:50:34.077 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-02-19T18:50:34.108 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-19T18:50:34.200 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-02-19T18:50:34.236 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-19T18:50:34.415 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-19T18:50:34.443 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-19T18:50:34.524 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-19T18:50:35.106 INFO:teuthology.orchestra.run.smithi096.stdout:(30/30): libarrow-9.0.0-10.el9.x86_64.rpm 134 kB/s | 4.4 MB 00:33 2024-02-19T18:50:35.110 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:50:35.110 INFO:teuthology.orchestra.run.smithi096.stdout:Total 1.5 MB/s | 53 MB 00:35 2024-02-19T18:50:35.111 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2024-02-19T18:50:35.147 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2024-02-19T18:50:35.147 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2024-02-19T18:50:35.189 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-19T18:50:35.305 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-19T18:50:35.595 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2024-02-19T18:50:35.596 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2024-02-19T18:50:36.540 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-19T18:50:37.006 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2024-02-19T18:50:37.098 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-02-19T18:50:37.127 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-02-19T18:50:37.185 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-02-19T18:50:37.564 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-02-19T18:50:37.567 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-19T18:50:37.593 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 12/12 2024-02-19T18:50:37.601 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : librados2-2:18.2.1-0.el9.x86_64 5/32 2024-02-19T18:50:37.693 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados2-2:18.2.1-0.el9.x86_64 5/32 2024-02-19T18:50:37.774 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rados-2:18.2.1-0.el9.x86_64 6/32 2024-02-19T18:50:37.803 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephfs2-2:18.2.1-0.el9.x86_64 7/32 2024-02-19T18:50:37.865 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephfs2-2:18.2.1-0.el9.x86_64 7/32 2024-02-19T18:50:37.893 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-02-19T18:50:37.937 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ceph-argparse-2:18.2.1-0.el9.x86_64 9/32 2024-02-19T18:50:38.004 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cephfs-2:18.2.1-0.el9.x86_64 10/32 2024-02-19T18:50:38.030 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libradosstriper1-2:18.2.1-0.el9.x86_64 11/32 2024-02-19T18:50:38.078 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libradosstriper1-2:18.2.1-0.el9.x86_64 11/32 2024-02-19T18:50:38.185 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-02-19T18:50:38.228 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/32 2024-02-19T18:50:38.270 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-02-19T18:50:38.302 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-02-19T18:50:38.328 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/32 2024-02-19T18:50:38.390 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-02-19T18:50:38.422 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-02-19T18:50:38.724 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-02-19T18:50:38.752 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : librbd1-2:18.2.1-0.el9.x86_64 20/32 2024-02-19T18:50:38.849 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librbd1-2:18.2.1-0.el9.x86_64 20/32 2024-02-19T18:50:38.873 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rbd-2:18.2.1-0.el9.x86_64 21/32 2024-02-19T18:50:38.919 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-02-19T18:50:39.319 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 23/32 2024-02-19T18:50:39.346 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librgw2-2:18.2.1-0.el9.x86_64 24/32 2024-02-19T18:50:39.400 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librgw2-2:18.2.1-0.el9.x86_64 24/32 2024-02-19T18:50:39.467 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rgw-2:18.2.1-0.el9.x86_64 25/32 2024-02-19T18:50:39.498 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ceph-common-2:18.2.1-0.el9.x86_64 26/32 2024-02-19T18:50:40.121 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 12/12 2024-02-19T18:50:40.122 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 1/12 2024-02-19T18:50:40.122 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-02-19T18:50:40.122 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-02-19T18:50:40.122 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-02-19T18:50:40.122 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-19T18:50:40.122 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-19T18:50:40.122 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-02-19T18:50:40.122 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-02-19T18:50:40.122 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-02-19T18:50:40.122 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-02-19T18:50:40.122 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-02-19T18:50:40.544 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-02-19T18:50:40.544 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:40.544 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2024-02-19T18:50:40.544 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarch 2024-02-19T18:50:40.544 INFO:teuthology.orchestra.run.smithi125.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-19T18:50:40.544 INFO:teuthology.orchestra.run.smithi125.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-19T18:50:40.544 INFO:teuthology.orchestra.run.smithi125.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-19T18:50:40.544 INFO:teuthology.orchestra.run.smithi125.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-19T18:50:40.544 INFO:teuthology.orchestra.run.smithi125.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-19T18:50:40.544 INFO:teuthology.orchestra.run.smithi125.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-19T18:50:40.544 INFO:teuthology.orchestra.run.smithi125.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-19T18:50:40.544 INFO:teuthology.orchestra.run.smithi125.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-19T18:50:40.544 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-19T18:50:40.545 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-19T18:50:40.545 INFO:teuthology.orchestra.run.smithi125.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-19T18:50:40.545 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:40.545 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:50:40.920 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install ceph-mgr-rook 2024-02-19T18:50:41.506 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:01:10 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:50:41.594 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-02-19T18:50:41.636 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-02-19T18:50:41.672 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:50:41.673 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:41.673 INFO:teuthology.orchestra.run.smithi125.stdout: Package Arch Version Repository Size 2024-02-19T18:50:41.674 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:41.674 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2024-02-19T18:50:41.674 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-rook noarch 2:18.2.1-0.el9 ceph-noarch 50 k 2024-02-19T18:50:41.674 INFO:teuthology.orchestra.run.smithi125.stdout:Installing dependencies: 2024-02-19T18:50:41.674 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-19T18:50:41.674 INFO:teuthology.orchestra.run.smithi125.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-19T18:50:41.674 INFO:teuthology.orchestra.run.smithi125.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-19T18:50:41.674 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-19T18:50:41.674 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-19T18:50:41.674 INFO:teuthology.orchestra.run.smithi125.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-19T18:50:41.674 INFO:teuthology.orchestra.run.smithi125.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-19T18:50:41.674 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-19T18:50:41.675 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-19T18:50:41.675 INFO:teuthology.orchestra.run.smithi125.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-19T18:50:41.675 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-19T18:50:41.675 INFO:teuthology.orchestra.run.smithi125.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-19T18:50:41.675 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:41.675 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2024-02-19T18:50:41.675 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:41.675 INFO:teuthology.orchestra.run.smithi125.stdout:Install 13 Packages 2024-02-19T18:50:41.675 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:41.676 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 2.0 M 2024-02-19T18:50:41.676 INFO:teuthology.orchestra.run.smithi125.stdout:Installed size: 26 M 2024-02-19T18:50:41.676 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2024-02-19T18:50:42.191 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-02-19T18:50:42.231 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-base-2:18.2.1-0.el9.x86_64 28/32 2024-02-19T18:50:42.234 INFO:teuthology.orchestra.run.smithi125.stdout:(1/13): ceph-mgr-rook-18.2.1-0.el9.noarch.rpm 877 kB/s | 50 kB 00:00 2024-02-19T18:50:42.319 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-base-2:18.2.1-0.el9.x86_64 28/32 2024-02-19T18:50:42.319 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-19T18:50:42.320 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-19T18:50:42.320 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:50:42.357 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-selinux-2:18.2.1-0.el9.x86_64 29/32 2024-02-19T18:50:42.392 INFO:teuthology.orchestra.run.smithi125.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 113 kB/s | 24 kB 00:00 2024-02-19T18:50:42.434 INFO:teuthology.orchestra.run.smithi125.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 70 kB/s | 18 kB 00:00 2024-02-19T18:50:42.543 INFO:teuthology.orchestra.run.smithi125.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 881 kB/s | 132 kB 00:00 2024-02-19T18:50:42.577 INFO:teuthology.orchestra.run.smithi125.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 588 kB/s | 174 kB 00:00 2024-02-19T18:50:42.602 INFO:teuthology.orchestra.run.smithi125.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.2 MB/s | 211 kB 00:00 2024-02-19T18:50:42.627 INFO:teuthology.orchestra.run.smithi125.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 510 kB/s | 43 kB 00:00 2024-02-19T18:50:42.911 INFO:teuthology.orchestra.run.smithi125.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 53 kB/s | 15 kB 00:00 2024-02-19T18:50:42.944 INFO:teuthology.orchestra.run.smithi125.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 88 kB/s | 32 kB 00:00 2024-02-19T18:50:43.211 INFO:teuthology.orchestra.run.smithi125.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 221 kB/s | 59 kB 00:00 2024-02-19T18:50:43.236 INFO:teuthology.orchestra.run.smithi125.stdout:(11/13): python3-google-auth-2.27.0-1.el9.noarc 333 kB/s | 203 kB 00:00 2024-02-19T18:50:43.478 INFO:teuthology.orchestra.run.smithi125.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 336 kB/s | 90 kB 00:00 2024-02-19T18:50:43.578 INFO:teuthology.orchestra.run.smithi125.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.5 MB/s | 1.0 MB 00:00 2024-02-19T18:50:43.582 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:50:43.582 INFO:teuthology.orchestra.run.smithi125.stdout:Total 1.1 MB/s | 2.0 MB 00:01 2024-02-19T18:50:43.582 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2024-02-19T18:50:43.596 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2024-02-19T18:50:43.596 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2024-02-19T18:50:43.702 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2024-02-19T18:50:43.702 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2024-02-19T18:50:44.259 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2024-02-19T18:50:44.442 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-19T18:50:44.495 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-19T18:50:44.552 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-19T18:50:44.589 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-19T18:50:44.630 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-19T18:50:44.724 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-19T18:50:44.824 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 7/13 2024-02-19T18:50:44.881 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-19T18:50:45.601 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-19T18:50:45.645 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-19T18:50:45.679 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-19T18:50:45.726 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-19T18:50:45.748 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-rook-2:18.2.1-0.el9.noarch 13/13 2024-02-19T18:50:46.549 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-0.el9.noarch 13/13 2024-02-19T18:50:46.549 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-rook-2:18.2.1-0.el9.noarch 1/13 2024-02-19T18:50:46.549 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-19T18:50:46.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-19T18:50:46.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-19T18:50:46.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-19T18:50:46.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-19T18:50:46.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-19T18:50:46.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-19T18:50:46.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-19T18:50:46.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 10/13 2024-02-19T18:50:46.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-19T18:50:46.550 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-19T18:50:46.911 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-19T18:50:46.911 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:46.911 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2024-02-19T18:50:46.911 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-rook-2:18.2.1-0.el9.noarch 2024-02-19T18:50:46.911 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-19T18:50:46.911 INFO:teuthology.orchestra.run.smithi125.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-19T18:50:46.912 INFO:teuthology.orchestra.run.smithi125.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-19T18:50:46.912 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-19T18:50:46.912 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-19T18:50:46.912 INFO:teuthology.orchestra.run.smithi125.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-19T18:50:46.912 INFO:teuthology.orchestra.run.smithi125.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-19T18:50:46.912 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-19T18:50:46.912 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-19T18:50:46.912 INFO:teuthology.orchestra.run.smithi125.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-19T18:50:46.912 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-19T18:50:46.912 INFO:teuthology.orchestra.run.smithi125.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-19T18:50:46.912 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:46.912 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:50:47.174 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install ceph-mgr-cephadm 2024-02-19T18:50:47.759 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:01:16 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:50:47.926 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:50:47.927 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:47.927 INFO:teuthology.orchestra.run.smithi125.stdout: Package Arch Version Repository Size 2024-02-19T18:50:47.927 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:47.927 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2024-02-19T18:50:47.927 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-cephadm noarch 2:18.2.1-0.el9 ceph-noarch 132 k 2024-02-19T18:50:47.927 INFO:teuthology.orchestra.run.smithi125.stdout:Installing dependencies: 2024-02-19T18:50:47.927 INFO:teuthology.orchestra.run.smithi125.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-19T18:50:47.927 INFO:teuthology.orchestra.run.smithi125.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-19T18:50:47.927 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-19T18:50:47.927 INFO:teuthology.orchestra.run.smithi125.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-19T18:50:47.927 INFO:teuthology.orchestra.run.smithi125.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-19T18:50:47.927 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:47.927 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2024-02-19T18:50:47.927 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:47.927 INFO:teuthology.orchestra.run.smithi125.stdout:Install 6 Packages 2024-02-19T18:50:47.928 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:47.928 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 6.8 M 2024-02-19T18:50:47.928 INFO:teuthology.orchestra.run.smithi125.stdout:Installed size: 33 M 2024-02-19T18:50:47.928 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2024-02-19T18:50:48.364 INFO:teuthology.orchestra.run.smithi125.stdout:(1/6): ceph-mgr-cephadm-18.2.1-0.el9.noarch.rpm 1.8 MB/s | 132 kB 00:00 2024-02-19T18:50:48.798 INFO:teuthology.orchestra.run.smithi125.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 449 kB/s | 227 kB 00:00 2024-02-19T18:50:49.091 INFO:teuthology.orchestra.run.smithi125.stdout:(3/6): python3-asyncssh-2.13.2-4.el9.noarch.rpm 806 kB/s | 548 kB 00:00 2024-02-19T18:50:49.173 INFO:teuthology.orchestra.run.smithi125.stdout:(4/6): python3-babel-2.9.1-2.el9.noarch.rpm 6.6 MB/s | 5.8 MB 00:00 2024-02-19T18:50:49.189 INFO:teuthology.orchestra.run.smithi125.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 521 kB/s | 51 kB 00:00 2024-02-19T18:50:49.215 INFO:teuthology.orchestra.run.smithi125.stdout:(6/6): python3-natsort-7.1.1-5.el9.noarch.rpm 138 kB/s | 58 kB 00:00 2024-02-19T18:50:49.219 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:50:49.219 INFO:teuthology.orchestra.run.smithi125.stdout:Total 5.2 MB/s | 6.8 MB 00:01 2024-02-19T18:50:49.219 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2024-02-19T18:50:49.228 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2024-02-19T18:50:49.228 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2024-02-19T18:50:49.317 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2024-02-19T18:50:49.318 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2024-02-19T18:50:49.614 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2024-02-19T18:50:49.771 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-19T18:50:49.825 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 2/6 2024-02-19T18:50:50.335 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-19T18:50:50.410 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-19T18:50:50.470 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-19T18:50:50.495 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 6/6 2024-02-19T18:50:51.296 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 6/6 2024-02-19T18:50:51.296 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 1/6 2024-02-19T18:50:51.296 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-19T18:50:51.296 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-19T18:50:51.297 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 4/6 2024-02-19T18:50:51.297 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-19T18:50:51.592 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-19T18:50:51.592 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:51.592 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2024-02-19T18:50:51.592 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 2024-02-19T18:50:51.592 INFO:teuthology.orchestra.run.smithi125.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-19T18:50:51.592 INFO:teuthology.orchestra.run.smithi125.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-19T18:50:51.592 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-19T18:50:51.592 INFO:teuthology.orchestra.run.smithi125.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-19T18:50:51.592 INFO:teuthology.orchestra.run.smithi125.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-19T18:50:51.593 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:51.593 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:50:51.605 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-selinux-2:18.2.1-0.el9.x86_64 29/32 2024-02-19T18:50:51.605 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /sys 2024-02-19T18:50:51.605 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /proc 2024-02-19T18:50:51.605 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /mnt 2024-02-19T18:50:51.605 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /var/tmp 2024-02-19T18:50:51.605 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /home 2024-02-19T18:50:51.605 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /root 2024-02-19T18:50:51.605 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /tmp 2024-02-19T18:50:51.606 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:50:51.857 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install ceph-fuse 2024-02-19T18:50:52.360 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-radosgw-2:18.2.1-0.el9.x86_64 30/32 2024-02-19T18:50:52.384 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-0.el9.x86_64 30/32 2024-02-19T18:50:52.384 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:50:52.384 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-19T18:50:52.384 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-19T18:50:52.384 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-19T18:50:52.384 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:50:52.386 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-02-19T18:50:52.439 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:01:21 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:50:52.462 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-02-19T18:50:52.462 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-02-19T18:50:52.606 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:50:52.606 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:52.606 INFO:teuthology.orchestra.run.smithi125.stdout: Package Architecture Version Repository Size 2024-02-19T18:50:52.606 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:52.606 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2024-02-19T18:50:52.606 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-fuse x86_64 2:18.2.1-0.el9 ceph 839 k 2024-02-19T18:50:52.606 INFO:teuthology.orchestra.run.smithi125.stdout:Installing dependencies: 2024-02-19T18:50:52.607 INFO:teuthology.orchestra.run.smithi125.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-19T18:50:52.607 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:52.607 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2024-02-19T18:50:52.607 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:52.607 INFO:teuthology.orchestra.run.smithi125.stdout:Install 2 Packages 2024-02-19T18:50:52.607 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:52.607 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 918 k 2024-02-19T18:50:52.608 INFO:teuthology.orchestra.run.smithi125.stdout:Installed size: 2.7 M 2024-02-19T18:50:52.608 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2024-02-19T18:50:52.684 INFO:teuthology.orchestra.run.smithi125.stdout:(1/2): ceph-fuse-18.2.1-0.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-02-19T18:50:52.833 INFO:teuthology.orchestra.run.smithi125.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 349 kB/s | 79 kB 00:00 2024-02-19T18:50:52.834 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:50:52.835 INFO:teuthology.orchestra.run.smithi125.stdout:Total 3.9 MB/s | 918 kB 00:00 2024-02-19T18:50:52.835 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2024-02-19T18:50:52.855 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2024-02-19T18:50:52.856 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2024-02-19T18:50:52.931 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2024-02-19T18:50:52.932 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2024-02-19T18:50:53.110 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2024-02-19T18:50:53.256 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-19T18:50:53.324 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-fuse-2:18.2.1-0.el9.x86_64 2/2 2024-02-19T18:50:53.526 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-02-19T18:50:53.526 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-base-2:18.2.1-0.el9.x86_64 1/32 2024-02-19T18:50:53.526 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-common-2:18.2.1-0.el9.x86_64 2/32 2024-02-19T18:50:53.526 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-radosgw-2:18.2.1-0.el9.x86_64 3/32 2024-02-19T18:50:53.526 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-selinux-2:18.2.1-0.el9.x86_64 4/32 2024-02-19T18:50:53.526 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephfs2-2:18.2.1-0.el9.x86_64 5/32 2024-02-19T18:50:53.527 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libradosstriper1-2:18.2.1-0.el9.x86_64 6/32 2024-02-19T18:50:53.527 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librgw2-2:18.2.1-0.el9.x86_64 7/32 2024-02-19T18:50:53.527 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ceph-argparse-2:18.2.1-0.el9.x86_64 8/32 2024-02-19T18:50:53.527 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ceph-common-2:18.2.1-0.el9.x86_64 9/32 2024-02-19T18:50:53.527 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cephfs-2:18.2.1-0.el9.x86_64 10/32 2024-02-19T18:50:53.527 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rados-2:18.2.1-0.el9.x86_64 11/32 2024-02-19T18:50:53.527 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rbd-2:18.2.1-0.el9.x86_64 12/32 2024-02-19T18:50:53.527 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rgw-2:18.2.1-0.el9.x86_64 13/32 2024-02-19T18:50:53.527 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-02-19T18:50:53.528 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-02-19T18:50:53.528 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-02-19T18:50:53.528 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-02-19T18:50:53.528 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-02-19T18:50:53.528 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-02-19T18:50:53.528 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-02-19T18:50:53.528 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-02-19T18:50:53.528 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 22/32 2024-02-19T18:50:53.528 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 23/32 2024-02-19T18:50:53.528 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-02-19T18:50:53.528 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-02-19T18:50:53.528 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 26/32 2024-02-19T18:50:53.528 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-02-19T18:50:53.528 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-02-19T18:50:53.529 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados2-2:18.2.1-0.el9.x86_64 29/32 2024-02-19T18:50:53.529 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-02-19T18:50:53.529 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librbd1-2:18.2.1-0.el9.x86_64 31/32 2024-02-19T18:50:54.044 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-fuse-2:18.2.1-0.el9.x86_64 2/2 2024-02-19T18:50:54.045 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-fuse-2:18.2.1-0.el9.x86_64 1/2 2024-02-19T18:50:54.361 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-19T18:50:54.361 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:54.361 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2024-02-19T18:50:54.361 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-fuse-2:18.2.1-0.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-19T18:50:54.361 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:54.361 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:50:54.521 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-02-19T18:50:54.521 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:50:54.522 INFO:teuthology.orchestra.run.smithi096.stdout:Upgraded: 2024-02-19T18:50:54.522 INFO:teuthology.orchestra.run.smithi096.stdout: librados2-2:18.2.1-0.el9.x86_64 librbd1-2:18.2.1-0.el9.x86_64 2024-02-19T18:50:54.522 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2024-02-19T18:50:54.522 INFO:teuthology.orchestra.run.smithi096.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-19T18:50:54.522 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base-2:18.2.1-0.el9.x86_64 2024-02-19T18:50:54.522 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-common-2:18.2.1-0.el9.x86_64 2024-02-19T18:50:54.522 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-radosgw-2:18.2.1-0.el9.x86_64 2024-02-19T18:50:54.522 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-selinux-2:18.2.1-0.el9.x86_64 2024-02-19T18:50:54.522 INFO:teuthology.orchestra.run.smithi096.stdout: fmt-8.1.1-5.el9.x86_64 2024-02-19T18:50:54.522 INFO:teuthology.orchestra.run.smithi096.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-19T18:50:54.522 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-19T18:50:54.522 INFO:teuthology.orchestra.run.smithi096.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-19T18:50:54.522 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2-2:18.2.1-0.el9.x86_64 2024-02-19T18:50:54.522 INFO:teuthology.orchestra.run.smithi096.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-19T18:50:54.522 INFO:teuthology.orchestra.run.smithi096.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-19T18:50:54.522 INFO:teuthology.orchestra.run.smithi096.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-19T18:50:54.522 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1-2:18.2.1-0.el9.x86_64 2024-02-19T18:50:54.523 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-19T18:50:54.523 INFO:teuthology.orchestra.run.smithi096.stdout: librgw2-2:18.2.1-0.el9.x86_64 2024-02-19T18:50:54.523 INFO:teuthology.orchestra.run.smithi096.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-19T18:50:54.523 INFO:teuthology.orchestra.run.smithi096.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-19T18:50:54.523 INFO:teuthology.orchestra.run.smithi096.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-19T18:50:54.523 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse-2:18.2.1-0.el9.x86_64 2024-02-19T18:50:54.523 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common-2:18.2.1-0.el9.x86_64 2024-02-19T18:50:54.523 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs-2:18.2.1-0.el9.x86_64 2024-02-19T18:50:54.523 INFO:teuthology.orchestra.run.smithi096.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-19T18:50:54.523 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados-2:18.2.1-0.el9.x86_64 2024-02-19T18:50:54.523 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rbd-2:18.2.1-0.el9.x86_64 2024-02-19T18:50:54.523 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw-2:18.2.1-0.el9.x86_64 2024-02-19T18:50:54.523 INFO:teuthology.orchestra.run.smithi096.stdout: re2-1:20211101-3.el9.x86_64 2024-02-19T18:50:54.523 INFO:teuthology.orchestra.run.smithi096.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-19T18:50:54.523 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:50:54.523 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:50:54.604 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install librados-devel 2024-02-19T18:50:54.899 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-test 2024-02-19T18:50:55.204 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:01:24 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:50:55.369 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:50:55.369 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:55.369 INFO:teuthology.orchestra.run.smithi125.stdout: Package Architecture Version Repository Size 2024-02-19T18:50:55.369 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:55.369 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2024-02-19T18:50:55.369 INFO:teuthology.orchestra.run.smithi125.stdout: librados-devel x86_64 2:18.2.1-0.el9 ceph 127 k 2024-02-19T18:50:55.369 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:55.370 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2024-02-19T18:50:55.370 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:55.370 INFO:teuthology.orchestra.run.smithi125.stdout:Install 1 Package 2024-02-19T18:50:55.370 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:55.370 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 127 k 2024-02-19T18:50:55.370 INFO:teuthology.orchestra.run.smithi125.stdout:Installed size: 456 k 2024-02-19T18:50:55.370 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2024-02-19T18:50:55.429 INFO:teuthology.orchestra.run.smithi125.stdout:librados-devel-18.2.1-0.el9.x86_64.rpm 2.1 MB/s | 127 kB 00:00 2024-02-19T18:50:55.430 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:50:55.430 INFO:teuthology.orchestra.run.smithi125.stdout:Total 2.1 MB/s | 127 kB 00:00 2024-02-19T18:50:55.430 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2024-02-19T18:50:55.436 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2024-02-19T18:50:55.436 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2024-02-19T18:50:55.490 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2024-02-19T18:50:55.491 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2024-02-19T18:50:55.504 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:00:59 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:50:55.630 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2024-02-19T18:50:55.681 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:50:55.682 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:50:55.682 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2024-02-19T18:50:55.682 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:50:55.682 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2024-02-19T18:50:55.682 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-test x86_64 2:18.2.1-0.el9 ceph 40 M 2024-02-19T18:50:55.682 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2024-02-19T18:50:55.682 INFO:teuthology.orchestra.run.smithi096.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-19T18:50:55.682 INFO:teuthology.orchestra.run.smithi096.stdout: libcephsqlite x86_64 2:18.2.1-0.el9 ceph 165 k 2024-02-19T18:50:55.683 INFO:teuthology.orchestra.run.smithi096.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-19T18:50:55.683 INFO:teuthology.orchestra.run.smithi096.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-19T18:50:55.683 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-19T18:50:55.683 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:50:55.683 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2024-02-19T18:50:55.683 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:50:55.683 INFO:teuthology.orchestra.run.smithi096.stdout:Install 6 Packages 2024-02-19T18:50:55.683 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:50:55.683 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 41 M 2024-02-19T18:50:55.684 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 167 M 2024-02-19T18:50:55.684 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2024-02-19T18:50:55.727 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:50:55.810 INFO:teuthology.orchestra.run.smithi096.stdout:(1/6): libcephsqlite-18.2.1-0.el9.x86_64.rpm 1.3 MB/s | 165 kB 00:00 2024-02-19T18:50:56.188 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:50:56.319 INFO:teuthology.orchestra.run.smithi096.stdout:(2/6): ceph-test-18.2.1-0.el9.x86_64.rpm 62 MB/s | 40 MB 00:00 2024-02-19T18:50:56.344 INFO:teuthology.orchestra.run.smithi096.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 117 kB/s | 63 kB 00:00 2024-02-19T18:50:56.476 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:50:56.476 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:56.476 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2024-02-19T18:50:56.476 INFO:teuthology.orchestra.run.smithi125.stdout: librados-devel-2:18.2.1-0.el9.x86_64 2024-02-19T18:50:56.476 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:56.476 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:50:56.745 INFO:teuthology.orchestra.run.smithi096.stdout:(4/6): socat-1.7.4.1-5.el9.x86_64.rpm 283 kB/s | 300 kB 00:01 2024-02-19T18:50:56.751 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install libcephfs2 2024-02-19T18:50:57.062 INFO:teuthology.orchestra.run.smithi096.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 251 kB/s | 186 kB 00:00 2024-02-19T18:50:57.295 INFO:teuthology.orchestra.run.smithi096.stdout:(6/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 228 kB/s | 217 kB 00:00 2024-02-19T18:50:57.298 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:50:57.299 INFO:teuthology.orchestra.run.smithi096.stdout:Total 25 MB/s | 41 MB 00:01 2024-02-19T18:50:57.299 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2024-02-19T18:50:57.318 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2024-02-19T18:50:57.318 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2024-02-19T18:50:57.341 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:01:26 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:50:57.458 INFO:teuthology.orchestra.run.smithi125.stdout:Package libcephfs2-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-19T18:50:57.511 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:50:57.512 INFO:teuthology.orchestra.run.smithi125.stdout:Nothing to do. 2024-02-19T18:50:57.512 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:50:57.573 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install libcephfs-devel 2024-02-19T18:50:57.665 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2024-02-19T18:50:57.665 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2024-02-19T18:50:58.179 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:01:27 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:50:58.194 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2024-02-19T18:50:58.260 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 1/6 2024-02-19T18:50:58.294 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : jq-1.6-16.el9.x86_64 2/6 2024-02-19T18:50:58.339 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/6 2024-02-19T18:50:58.343 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:50:58.344 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:58.344 INFO:teuthology.orchestra.run.smithi125.stdout: Package Architecture Version Repository Size 2024-02-19T18:50:58.344 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:58.344 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2024-02-19T18:50:58.345 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs-devel x86_64 2:18.2.1-0.el9 ceph 31 k 2024-02-19T18:50:58.345 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:58.345 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2024-02-19T18:50:58.345 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:50:58.345 INFO:teuthology.orchestra.run.smithi125.stdout:Install 1 Package 2024-02-19T18:50:58.345 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:58.345 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 31 k 2024-02-19T18:50:58.345 INFO:teuthology.orchestra.run.smithi125.stdout:Installed size: 139 k 2024-02-19T18:50:58.345 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2024-02-19T18:50:58.388 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/6 2024-02-19T18:50:58.408 INFO:teuthology.orchestra.run.smithi125.stdout:libcephfs-devel-18.2.1-0.el9.x86_64.rpm 492 kB/s | 31 kB 00:00 2024-02-19T18:50:58.409 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:50:58.409 INFO:teuthology.orchestra.run.smithi125.stdout:Total 482 kB/s | 31 kB 00:00 2024-02-19T18:50:58.409 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2024-02-19T18:50:58.412 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2024-02-19T18:50:58.412 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2024-02-19T18:50:58.415 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephsqlite-2:18.2.1-0.el9.x86_64 5/6 2024-02-19T18:50:58.444 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2024-02-19T18:50:58.445 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2024-02-19T18:50:58.531 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2024-02-19T18:50:58.638 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:50:59.038 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:50:59.294 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:50:59.294 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:59.294 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2024-02-19T18:50:59.294 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs-devel-2:18.2.1-0.el9.x86_64 2024-02-19T18:50:59.294 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:50:59.294 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:50:59.476 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install librados2 2024-02-19T18:51:00.063 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:01:29 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:51:00.178 INFO:teuthology.orchestra.run.smithi125.stdout:Package librados2-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-19T18:51:00.230 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:51:00.231 INFO:teuthology.orchestra.run.smithi125.stdout:Nothing to do. 2024-02-19T18:51:00.231 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:51:00.293 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install librbd1 2024-02-19T18:51:00.871 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:01:29 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:51:00.984 INFO:teuthology.orchestra.run.smithi125.stdout:Package librbd1-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-19T18:51:01.036 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:51:01.037 INFO:teuthology.orchestra.run.smithi125.stdout:Nothing to do. 2024-02-19T18:51:01.037 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:51:01.099 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install python3-rados 2024-02-19T18:51:01.675 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:01:30 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:51:01.789 INFO:teuthology.orchestra.run.smithi125.stdout:Package python3-rados-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-19T18:51:01.841 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:51:01.842 INFO:teuthology.orchestra.run.smithi125.stdout:Nothing to do. 2024-02-19T18:51:01.842 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:51:01.908 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install python3-rgw 2024-02-19T18:51:02.185 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephsqlite-2:18.2.1-0.el9.x86_64 5/6 2024-02-19T18:51:02.264 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-test-2:18.2.1-0.el9.x86_64 6/6 2024-02-19T18:51:02.487 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:01:31 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:51:02.601 INFO:teuthology.orchestra.run.smithi125.stdout:Package python3-rgw-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-19T18:51:02.652 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:51:02.653 INFO:teuthology.orchestra.run.smithi125.stdout:Nothing to do. 2024-02-19T18:51:02.653 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:51:02.714 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install python3-cephfs 2024-02-19T18:51:03.298 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:01:32 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:51:03.413 INFO:teuthology.orchestra.run.smithi125.stdout:Package python3-cephfs-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-19T18:51:03.466 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:51:03.467 INFO:teuthology.orchestra.run.smithi125.stdout:Nothing to do. 2024-02-19T18:51:03.467 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:51:03.530 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install python3-rbd 2024-02-19T18:51:04.109 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:01:33 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:51:04.224 INFO:teuthology.orchestra.run.smithi125.stdout:Package python3-rbd-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-19T18:51:04.277 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:51:04.278 INFO:teuthology.orchestra.run.smithi125.stdout:Nothing to do. 2024-02-19T18:51:04.278 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:51:04.338 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install rbd-fuse 2024-02-19T18:51:04.429 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-test-2:18.2.1-0.el9.x86_64 6/6 2024-02-19T18:51:04.429 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-test-2:18.2.1-0.el9.x86_64 1/6 2024-02-19T18:51:04.429 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephsqlite-2:18.2.1-0.el9.x86_64 2/6 2024-02-19T18:51:04.429 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/6 2024-02-19T18:51:04.429 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/6 2024-02-19T18:51:04.429 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : jq-1.6-16.el9.x86_64 5/6 2024-02-19T18:51:04.850 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/6 2024-02-19T18:51:04.851 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:04.851 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2024-02-19T18:51:04.851 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-test-2:18.2.1-0.el9.x86_64 jq-1.6-16.el9.x86_64 2024-02-19T18:51:04.851 INFO:teuthology.orchestra.run.smithi096.stdout: libcephsqlite-2:18.2.1-0.el9.x86_64 oniguruma-6.9.6-1.el9.5.x86_64 2024-02-19T18:51:04.851 INFO:teuthology.orchestra.run.smithi096.stdout: socat-1.7.4.1-5.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-02-19T18:51:04.851 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:04.851 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:51:04.920 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:01:33 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:51:05.086 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:51:05.087 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:51:05.087 INFO:teuthology.orchestra.run.smithi125.stdout: Package Architecture Version Repository Size 2024-02-19T18:51:05.087 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:51:05.087 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2024-02-19T18:51:05.087 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-fuse x86_64 2:18.2.1-0.el9 ceph 86 k 2024-02-19T18:51:05.087 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:51:05.087 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2024-02-19T18:51:05.088 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:51:05.088 INFO:teuthology.orchestra.run.smithi125.stdout:Install 1 Package 2024-02-19T18:51:05.088 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:51:05.088 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 86 k 2024-02-19T18:51:05.088 INFO:teuthology.orchestra.run.smithi125.stdout:Installed size: 226 k 2024-02-19T18:51:05.088 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2024-02-19T18:51:05.139 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph 2024-02-19T18:51:05.153 INFO:teuthology.orchestra.run.smithi125.stdout:rbd-fuse-18.2.1-0.el9.x86_64.rpm 1.3 MB/s | 86 kB 00:00 2024-02-19T18:51:05.153 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:51:05.154 INFO:teuthology.orchestra.run.smithi125.stdout:Total 1.3 MB/s | 86 kB 00:00 2024-02-19T18:51:05.154 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2024-02-19T18:51:05.161 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2024-02-19T18:51:05.161 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2024-02-19T18:51:05.215 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2024-02-19T18:51:05.216 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2024-02-19T18:51:05.391 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2024-02-19T18:51:05.493 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:51:05.720 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:09 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:51:05.892 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:51:05.894 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:51:05.894 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2024-02-19T18:51:05.894 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:51:05.894 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2024-02-19T18:51:05.894 INFO:teuthology.orchestra.run.smithi096.stdout: ceph x86_64 2:18.2.1-0.el9 ceph 6.4 k 2024-02-19T18:51:05.895 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2024-02-19T18:51:05.895 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mds x86_64 2:18.2.1-0.el9 ceph 2.1 M 2024-02-19T18:51:05.895 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr x86_64 2:18.2.1-0.el9 ceph 1.4 M 2024-02-19T18:51:05.895 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core noarch 2:18.2.1-0.el9 ceph-noarch 242 k 2024-02-19T18:51:05.895 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon x86_64 2:18.2.1-0.el9 ceph 4.4 M 2024-02-19T18:51:05.895 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-osd x86_64 2:18.2.1-0.el9 ceph 18 M 2024-02-19T18:51:05.895 INFO:teuthology.orchestra.run.smithi096.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-19T18:51:05.895 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-19T18:51:05.895 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-19T18:51:05.895 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-19T18:51:05.895 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-19T18:51:05.895 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-19T18:51:05.895 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-19T18:51:05.895 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-19T18:51:05.895 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-19T18:51:05.896 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-19T18:51:05.896 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-19T18:51:05.896 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-19T18:51:05.896 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-19T18:51:05.896 INFO:teuthology.orchestra.run.smithi096.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-19T18:51:05.896 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-19T18:51:05.896 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-19T18:51:05.896 INFO:teuthology.orchestra.run.smithi096.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-19T18:51:05.896 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-19T18:51:05.896 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-19T18:51:05.896 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-19T18:51:05.896 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-19T18:51:05.896 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-19T18:51:05.896 INFO:teuthology.orchestra.run.smithi096.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-19T18:51:05.897 INFO:teuthology.orchestra.run.smithi096.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-19T18:51:05.897 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-19T18:51:05.897 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-19T18:51:05.897 INFO:teuthology.orchestra.run.smithi096.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-19T18:51:05.897 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:05.897 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2024-02-19T18:51:05.897 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:51:05.897 INFO:teuthology.orchestra.run.smithi096.stdout:Install 33 Packages 2024-02-19T18:51:05.897 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:05.898 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:51:05.898 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 30 M 2024-02-19T18:51:05.898 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 110 M 2024-02-19T18:51:05.898 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2024-02-19T18:51:06.048 INFO:teuthology.orchestra.run.smithi096.stdout:(1/33): ceph-18.2.1-0.el9.x86_64.rpm 61 kB/s | 6.4 kB 00:00 2024-02-19T18:51:06.098 INFO:teuthology.orchestra.run.smithi096.stdout:(2/33): ceph-mgr-18.2.1-0.el9.x86_64.rpm 9.3 MB/s | 1.4 MB 00:00 2024-02-19T18:51:06.149 INFO:teuthology.orchestra.run.smithi096.stdout:(3/33): ceph-mds-18.2.1-0.el9.x86_64.rpm 10 MB/s | 2.1 MB 00:00 2024-02-19T18:51:06.174 INFO:teuthology.orchestra.run.smithi096.stdout:(4/33): ceph-mgr-modules-core-18.2.1-0.el9.noar 9.5 MB/s | 242 kB 00:00 2024-02-19T18:51:06.187 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:51:06.187 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:51:06.187 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2024-02-19T18:51:06.187 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-fuse-2:18.2.1-0.el9.x86_64 2024-02-19T18:51:06.187 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:51:06.187 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:51:06.266 INFO:teuthology.orchestra.run.smithi096.stdout:(5/33): ceph-mon-18.2.1-0.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-02-19T18:51:06.414 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install rbd-mirror 2024-02-19T18:51:06.541 INFO:teuthology.orchestra.run.smithi096.stdout:(6/33): ceph-osd-18.2.1-0.el9.x86_64.rpm 40 MB/s | 18 MB 00:00 2024-02-19T18:51:06.675 INFO:teuthology.orchestra.run.smithi096.stdout:(7/33): python3-mako-1.1.4-6.el9.noarch.rpm 288 kB/s | 144 kB 00:00 2024-02-19T18:51:06.700 INFO:teuthology.orchestra.run.smithi096.stdout:(8/33): python3-markupsafe-1.1.1-12.el9.x86_64. 77 kB/s | 32 kB 00:00 2024-02-19T18:51:06.742 INFO:teuthology.orchestra.run.smithi096.stdout:(9/33): python3-pytz-2021.1-5.el9.noarch.rpm 236 kB/s | 47 kB 00:00 2024-02-19T18:51:06.767 INFO:teuthology.orchestra.run.smithi096.stdout:(10/33): python3-toml-0.10.2-6.el9.noarch.rpm 419 kB/s | 39 kB 00:00 2024-02-19T18:51:06.934 INFO:teuthology.orchestra.run.smithi096.stdout:(11/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 241 kB 00:00 2024-02-19T18:51:07.007 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:01:35 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:51:07.174 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:51:07.175 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:51:07.175 INFO:teuthology.orchestra.run.smithi125.stdout: Package Architecture Version Repository Size 2024-02-19T18:51:07.175 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:51:07.175 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2024-02-19T18:51:07.175 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-mirror x86_64 2:18.2.1-0.el9 ceph 3.0 M 2024-02-19T18:51:07.176 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:51:07.176 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2024-02-19T18:51:07.176 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:51:07.176 INFO:teuthology.orchestra.run.smithi125.stdout:Install 1 Package 2024-02-19T18:51:07.176 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:51:07.176 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 3.0 M 2024-02-19T18:51:07.176 INFO:teuthology.orchestra.run.smithi125.stdout:Installed size: 12 M 2024-02-19T18:51:07.176 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2024-02-19T18:51:07.289 INFO:teuthology.orchestra.run.smithi125.stdout:rbd-mirror-18.2.1-0.el9.x86_64.rpm 26 MB/s | 3.0 MB 00:00 2024-02-19T18:51:07.289 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:51:07.290 INFO:teuthology.orchestra.run.smithi125.stdout:Total 26 MB/s | 3.0 MB 00:00 2024-02-19T18:51:07.290 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2024-02-19T18:51:07.299 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2024-02-19T18:51:07.299 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2024-02-19T18:51:07.371 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2024-02-19T18:51:07.371 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2024-02-19T18:51:07.609 INFO:teuthology.orchestra.run.smithi096.stdout:(12/33): python3-ply-3.11-14.el9.noarch.rpm 122 kB/s | 103 kB 00:00 2024-02-19T18:51:07.634 INFO:teuthology.orchestra.run.smithi096.stdout:(13/33): python3-pycparser-2.20-6.el9.noarch.rp 177 kB/s | 124 kB 00:00 2024-02-19T18:51:07.685 INFO:teuthology.orchestra.run.smithi096.stdout:(14/33): python3-cryptography-36.0.1-4.el9.x86_ 1.2 MB/s | 1.1 MB 00:00 2024-02-19T18:51:07.769 INFO:teuthology.orchestra.run.smithi096.stdout:(15/33): python3-requests-2.25.1-8.el9.noarch.r 711 kB/s | 113 kB 00:00 2024-02-19T18:51:07.779 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2024-02-19T18:51:07.827 INFO:teuthology.orchestra.run.smithi096.stdout:(16/33): python3-urllib3-1.26.5-5.el9.noarch.rp 975 kB/s | 187 kB 00:00 2024-02-19T18:51:07.848 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:51:07.872 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:51:07.872 INFO:teuthology.orchestra.run.smithi125.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:51:07.872 INFO:teuthology.orchestra.run.smithi125.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-19T18:51:07.872 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-19T18:51:07.872 INFO:teuthology.orchestra.run.smithi125.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-19T18:51:07.873 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:51:08.536 INFO:teuthology.orchestra.run.smithi096.stdout:(17/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 224 kB/s | 172 kB 00:00 2024-02-19T18:51:08.703 INFO:teuthology.orchestra.run.smithi096.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 64 kB/s | 11 kB 00:00 2024-02-19T18:51:08.853 INFO:teuthology.orchestra.run.smithi096.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 118 kB/s | 18 kB 00:00 2024-02-19T18:51:08.999 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:51:08.999 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:51:09.000 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2024-02-19T18:51:09.000 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-mirror-2:18.2.1-0.el9.x86_64 2024-02-19T18:51:09.000 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:51:09.000 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:51:09.003 INFO:teuthology.orchestra.run.smithi096.stdout:(20/33): python3-jaraco-collections-3.0.0-8.el9 154 kB/s | 23 kB 00:00 2024-02-19T18:51:09.104 INFO:teuthology.orchestra.run.smithi096.stdout:(21/33): python3-cherrypy-18.6.1-2.el9.noarch.r 281 kB/s | 358 kB 00:01 2024-02-19T18:51:09.145 INFO:teuthology.orchestra.run.smithi096.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 137 kB/s | 19 kB 00:00 2024-02-19T18:51:09.221 INFO:teuthology.orchestra.run.smithi096.stdout:(23/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 28 kB/s | 43 kB 00:01 2024-02-19T18:51:09.241 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install rbd-nbd 2024-02-19T18:51:09.271 INFO:teuthology.orchestra.run.smithi096.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 118 kB/s | 20 kB 00:00 2024-02-19T18:51:09.305 INFO:teuthology.orchestra.run.smithi096.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 291 kB/s | 46 kB 00:00 2024-02-19T18:51:09.438 INFO:teuthology.orchestra.run.smithi096.stdout:(26/33): python3-portend-3.1.0-2.el9.noarch.rpm 123 kB/s | 16 kB 00:00 2024-02-19T18:51:09.480 INFO:teuthology.orchestra.run.smithi096.stdout:(27/33): python3-more-itertools-8.12.0-2.el9.no 304 kB/s | 79 kB 00:00 2024-02-19T18:51:09.605 INFO:teuthology.orchestra.run.smithi096.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 539 kB/s | 90 kB 00:00 2024-02-19T18:51:09.631 INFO:teuthology.orchestra.run.smithi096.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 238 kB/s | 36 kB 00:00 2024-02-19T18:51:09.790 INFO:teuthology.orchestra.run.smithi096.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 526 kB/s | 272 kB 00:00 2024-02-19T18:51:09.834 INFO:teuthology.orchestra.run.smithi125.stdout:Last metadata expiration check: 0:01:38 ago on Mon 19 Feb 2024 06:49:31 PM UTC. 2024-02-19T18:51:09.856 INFO:teuthology.orchestra.run.smithi096.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 917 kB/s | 230 kB 00:00 2024-02-19T18:51:09.956 INFO:teuthology.orchestra.run.smithi096.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 120 kB/s | 20 kB 00:00 2024-02-19T18:51:09.999 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2024-02-19T18:51:10.000 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:51:10.000 INFO:teuthology.orchestra.run.smithi125.stdout: Package Architecture Version Repository Size 2024-02-19T18:51:10.000 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:51:10.000 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2024-02-19T18:51:10.000 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-nbd x86_64 2:18.2.1-0.el9 ceph 171 k 2024-02-19T18:51:10.000 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:51:10.001 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2024-02-19T18:51:10.001 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2024-02-19T18:51:10.001 INFO:teuthology.orchestra.run.smithi125.stdout:Install 1 Package 2024-02-19T18:51:10.001 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:51:10.001 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 171 k 2024-02-19T18:51:10.001 INFO:teuthology.orchestra.run.smithi125.stdout:Installed size: 494 k 2024-02-19T18:51:10.001 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2024-02-19T18:51:10.059 INFO:teuthology.orchestra.run.smithi125.stdout:rbd-nbd-18.2.1-0.el9.x86_64.rpm 2.9 MB/s | 171 kB 00:00 2024-02-19T18:51:10.060 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:51:10.060 INFO:teuthology.orchestra.run.smithi125.stdout:Total 2.8 MB/s | 171 kB 00:00 2024-02-19T18:51:10.060 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2024-02-19T18:51:10.068 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2024-02-19T18:51:10.068 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2024-02-19T18:51:10.090 INFO:teuthology.orchestra.run.smithi096.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 930 kB/s | 427 kB 00:00 2024-02-19T18:51:10.095 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:51:10.095 INFO:teuthology.orchestra.run.smithi096.stdout:Total 7.1 MB/s | 30 MB 00:04 2024-02-19T18:51:10.095 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2024-02-19T18:51:10.124 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2024-02-19T18:51:10.124 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2024-02-19T18:51:10.133 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2024-02-19T18:51:10.134 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2024-02-19T18:51:10.265 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2024-02-19T18:51:10.373 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:51:10.508 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2024-02-19T18:51:10.509 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2024-02-19T18:51:10.828 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:51:11.130 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:51:11.130 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:51:11.130 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2024-02-19T18:51:11.130 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-nbd-2:18.2.1-0.el9.x86_64 2024-02-19T18:51:11.130 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:51:11.130 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2024-02-19T18:51:11.355 DEBUG:teuthology.parallel:result is None 2024-02-19T18:51:11.735 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2024-02-19T18:51:11.792 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-02-19T18:51:11.824 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-02-19T18:51:11.857 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-02-19T18:51:11.949 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-02-19T18:51:12.027 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-02-19T18:51:12.068 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-02-19T18:51:12.140 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-02-19T18:51:12.195 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 8/33 2024-02-19T18:51:12.233 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 9/33 2024-02-19T18:51:12.281 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ply-3.11-14.el9.noarch 10/33 2024-02-19T18:51:12.342 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 11/33 2024-02-19T18:51:12.529 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 12/33 2024-02-19T18:51:12.579 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 13/33 2024-02-19T18:51:12.618 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 14/33 2024-02-19T18:51:12.652 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 15/33 2024-02-19T18:51:12.682 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 16/33 2024-02-19T18:51:12.758 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 17/33 2024-02-19T18:51:12.792 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-19T18:51:12.826 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 19/33 2024-02-19T18:51:12.866 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 20/33 2024-02-19T18:51:12.901 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/33 2024-02-19T18:51:12.936 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 22/33 2024-02-19T18:51:13.025 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 23/33 2024-02-19T18:51:13.059 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 24/33 2024-02-19T18:51:13.138 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/33 2024-02-19T18:51:13.283 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 26/33 2024-02-19T18:51:13.409 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-19T18:51:13.563 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 28/33 2024-02-19T18:51:13.589 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-2:18.2.1-0.el9.x86_64 29/33 2024-02-19T18:51:13.614 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-2:18.2.1-0.el9.x86_64 29/33 2024-02-19T18:51:13.614 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:51:13.614 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-19T18:51:13.614 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-19T18:51:13.614 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-19T18:51:13.614 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:15.165 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-osd-2:18.2.1-0.el9.x86_64 30/33 2024-02-19T18:51:15.193 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-osd-2:18.2.1-0.el9.x86_64 30/33 2024-02-19T18:51:15.194 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:51:15.194 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-19T18:51:15.194 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-19T18:51:15.194 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-19T18:51:15.194 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:15.649 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mon-2:18.2.1-0.el9.x86_64 31/33 2024-02-19T18:51:15.673 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mon-2:18.2.1-0.el9.x86_64 31/33 2024-02-19T18:51:15.673 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:51:15.673 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-19T18:51:15.673 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-19T18:51:15.673 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-19T18:51:15.673 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:15.883 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mds-2:18.2.1-0.el9.x86_64 32/33 2024-02-19T18:51:15.906 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mds-2:18.2.1-0.el9.x86_64 32/33 2024-02-19T18:51:15.906 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:51:15.906 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-19T18:51:15.906 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-19T18:51:15.906 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-19T18:51:15.906 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:15.972 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-2:18.2.1-0.el9.x86_64 33/33 2024-02-19T18:51:17.706 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-2:18.2.1-0.el9.x86_64 33/33 2024-02-19T18:51:17.706 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-2:18.2.1-0.el9.x86_64 1/33 2024-02-19T18:51:17.706 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mds-2:18.2.1-0.el9.x86_64 2/33 2024-02-19T18:51:17.706 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-2:18.2.1-0.el9.x86_64 3/33 2024-02-19T18:51:17.706 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mon-2:18.2.1-0.el9.x86_64 4/33 2024-02-19T18:51:17.706 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-osd-2:18.2.1-0.el9.x86_64 5/33 2024-02-19T18:51:17.706 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 6/33 2024-02-19T18:51:17.706 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 7/33 2024-02-19T18:51:17.706 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 8/33 2024-02-19T18:51:17.707 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 9/33 2024-02-19T18:51:17.707 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 10/33 2024-02-19T18:51:17.707 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/33 2024-02-19T18:51:17.707 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 12/33 2024-02-19T18:51:17.707 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/33 2024-02-19T18:51:17.707 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/33 2024-02-19T18:51:17.707 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 15/33 2024-02-19T18:51:17.707 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/33 2024-02-19T18:51:17.707 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-02-19T18:51:17.707 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-19T18:51:17.708 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-02-19T18:51:17.708 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-02-19T18:51:17.708 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-02-19T18:51:17.708 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-02-19T18:51:17.708 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-02-19T18:51:17.708 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-02-19T18:51:17.708 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-02-19T18:51:17.708 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-02-19T18:51:17.708 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-19T18:51:17.708 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-02-19T18:51:17.708 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-02-19T18:51:17.708 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-02-19T18:51:17.708 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-02-19T18:51:17.708 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-02-19T18:51:18.650 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-02-19T18:51:18.650 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:18.650 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2024-02-19T18:51:18.650 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-2:18.2.1-0.el9.x86_64 2024-02-19T18:51:18.650 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mds-2:18.2.1-0.el9.x86_64 2024-02-19T18:51:18.650 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-2:18.2.1-0.el9.x86_64 2024-02-19T18:51:18.650 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 2024-02-19T18:51:18.650 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon-2:18.2.1-0.el9.x86_64 2024-02-19T18:51:18.650 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-osd-2:18.2.1-0.el9.x86_64 2024-02-19T18:51:18.650 INFO:teuthology.orchestra.run.smithi096.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-19T18:51:18.651 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-19T18:51:18.651 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-19T18:51:18.651 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-19T18:51:18.651 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-19T18:51:18.651 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-19T18:51:18.651 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-19T18:51:18.651 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-19T18:51:18.651 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-19T18:51:18.651 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-19T18:51:18.651 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-19T18:51:18.651 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-19T18:51:18.651 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-19T18:51:18.651 INFO:teuthology.orchestra.run.smithi096.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-19T18:51:18.651 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-19T18:51:18.651 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ply-3.11-14.el9.noarch 2024-02-19T18:51:18.652 INFO:teuthology.orchestra.run.smithi096.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-19T18:51:18.652 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-19T18:51:18.652 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-19T18:51:18.652 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-19T18:51:18.652 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-19T18:51:18.652 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-19T18:51:18.652 INFO:teuthology.orchestra.run.smithi096.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-19T18:51:18.652 INFO:teuthology.orchestra.run.smithi096.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-19T18:51:18.652 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-19T18:51:18.652 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-19T18:51:18.652 INFO:teuthology.orchestra.run.smithi096.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-19T18:51:18.652 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:18.652 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:51:18.953 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-base 2024-02-19T18:51:19.532 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:23 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:51:19.645 INFO:teuthology.orchestra.run.smithi096.stdout:Package ceph-base-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-19T18:51:19.696 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:51:19.697 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2024-02-19T18:51:19.697 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:51:19.760 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install cephadm 2024-02-19T18:51:20.335 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:24 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:51:20.498 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:51:20.499 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:51:20.499 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2024-02-19T18:51:20.499 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:51:20.499 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2024-02-19T18:51:20.499 INFO:teuthology.orchestra.run.smithi096.stdout: cephadm noarch 2:18.2.1-0.el9 ceph-noarch 221 k 2024-02-19T18:51:20.499 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:20.499 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2024-02-19T18:51:20.499 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:51:20.500 INFO:teuthology.orchestra.run.smithi096.stdout:Install 1 Package 2024-02-19T18:51:20.500 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:20.500 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 221 k 2024-02-19T18:51:20.500 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 213 k 2024-02-19T18:51:20.500 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2024-02-19T18:51:20.608 INFO:teuthology.orchestra.run.smithi096.stdout:cephadm-18.2.1-0.el9.noarch.rpm 2.0 MB/s | 221 kB 00:00 2024-02-19T18:51:20.609 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:51:20.609 INFO:teuthology.orchestra.run.smithi096.stdout:Total 2.0 MB/s | 221 kB 00:00 2024-02-19T18:51:20.609 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2024-02-19T18:51:20.614 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2024-02-19T18:51:20.614 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2024-02-19T18:51:20.616 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2024-02-19T18:51:20.617 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2024-02-19T18:51:20.690 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2024-02-19T18:51:21.098 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: cephadm-2:18.2.1-0.el9.noarch 1/1 2024-02-19T18:51:21.184 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephadm-2:18.2.1-0.el9.noarch 1/1 2024-02-19T18:51:21.533 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: cephadm-2:18.2.1-0.el9.noarch 1/1 2024-02-19T18:51:21.837 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephadm-2:18.2.1-0.el9.noarch 1/1 2024-02-19T18:51:21.838 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:21.838 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2024-02-19T18:51:21.838 INFO:teuthology.orchestra.run.smithi096.stdout: cephadm-2:18.2.1-0.el9.noarch 2024-02-19T18:51:21.838 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:21.838 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:51:22.061 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-immutable-object-cache 2024-02-19T18:51:22.649 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:26 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:51:22.814 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:51:22.815 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:51:22.815 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repo Size 2024-02-19T18:51:22.815 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:51:22.815 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2024-02-19T18:51:22.815 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-0.el9 ceph 142 k 2024-02-19T18:51:22.815 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:22.815 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2024-02-19T18:51:22.815 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:51:22.815 INFO:teuthology.orchestra.run.smithi096.stdout:Install 1 Package 2024-02-19T18:51:22.815 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:22.816 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 142 k 2024-02-19T18:51:22.816 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 395 k 2024-02-19T18:51:22.816 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2024-02-19T18:51:22.935 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-immutable-object-cache-18.2.1-0.el9.x86_64 1.2 MB/s | 142 kB 00:00 2024-02-19T18:51:22.936 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:51:22.936 INFO:teuthology.orchestra.run.smithi096.stdout:Total 1.2 MB/s | 142 kB 00:00 2024-02-19T18:51:22.936 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2024-02-19T18:51:22.943 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2024-02-19T18:51:22.943 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2024-02-19T18:51:22.994 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2024-02-19T18:51:22.994 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2024-02-19T18:51:23.132 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2024-02-19T18:51:23.203 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:51:23.227 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:51:23.227 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:51:23.227 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-19T18:51:23.227 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:24.193 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:51:24.193 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:24.193 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2024-02-19T18:51:24.193 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 2024-02-19T18:51:24.193 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:24.193 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:51:24.465 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-mgr 2024-02-19T18:51:25.058 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:29 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:51:25.176 INFO:teuthology.orchestra.run.smithi096.stdout:Package ceph-mgr-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-19T18:51:25.227 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:51:25.228 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2024-02-19T18:51:25.228 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:51:25.293 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-mgr-dashboard 2024-02-19T18:51:25.868 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:29 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:51:26.032 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:51:26.033 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:51:26.033 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2024-02-19T18:51:26.033 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:51:26.033 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2024-02-19T18:51:26.033 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard noarch 2:18.2.1-0.el9 ceph-noarch 1.8 M 2024-02-19T18:51:26.033 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2024-02-19T18:51:26.033 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-grafana-dashboards noarch 2:18.2.1-0.el9 ceph-noarch 23 k 2024-02-19T18:51:26.033 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-prometheus-alerts noarch 2:18.2.1-0.el9 ceph-noarch 15 k 2024-02-19T18:51:26.033 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-02-19T18:51:26.033 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-19T18:51:26.033 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-19T18:51:26.033 INFO:teuthology.orchestra.run.smithi096.stdout:Installing weak dependencies: 2024-02-19T18:51:26.034 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-02-19T18:51:26.034 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:26.034 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2024-02-19T18:51:26.034 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:51:26.034 INFO:teuthology.orchestra.run.smithi096.stdout:Install 7 Packages 2024-02-19T18:51:26.034 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:26.034 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 2.1 M 2024-02-19T18:51:26.035 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 8.5 M 2024-02-19T18:51:26.035 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2024-02-19T18:51:26.406 INFO:teuthology.orchestra.run.smithi096.stdout:(1/7): ceph-grafana-dashboards-18.2.1-0.el9.noa 165 kB/s | 23 kB 00:00 2024-02-19T18:51:26.432 INFO:teuthology.orchestra.run.smithi096.stdout:(2/7): ceph-prometheus-alerts-18.2.1-0.el9.noar 88 kB/s | 15 kB 00:00 2024-02-19T18:51:26.523 INFO:teuthology.orchestra.run.smithi096.stdout:(3/7): ceph-mgr-dashboard-18.2.1-0.el9.noarch.r 6.8 MB/s | 1.8 MB 00:00 2024-02-19T18:51:26.640 INFO:teuthology.orchestra.run.smithi096.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 39 kB/s | 9.0 kB 00:00 2024-02-19T18:51:26.824 INFO:teuthology.orchestra.run.smithi096.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 104 kB/s | 41 kB 00:00 2024-02-19T18:51:26.849 INFO:teuthology.orchestra.run.smithi096.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 94 kB/s | 31 kB 00:00 2024-02-19T18:51:27.124 INFO:teuthology.orchestra.run.smithi096.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 390 kB/s | 188 kB 00:00 2024-02-19T18:51:27.126 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:51:27.127 INFO:teuthology.orchestra.run.smithi096.stdout:Total 1.9 MB/s | 2.1 MB 00:01 2024-02-19T18:51:27.127 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2024-02-19T18:51:27.136 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2024-02-19T18:51:27.136 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2024-02-19T18:51:27.210 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2024-02-19T18:51:27.211 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2024-02-19T18:51:27.510 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2024-02-19T18:51:27.601 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-02-19T18:51:27.634 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-02-19T18:51:27.681 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-02-19T18:51:27.713 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-02-19T18:51:27.742 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 5/7 2024-02-19T18:51:27.979 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 6/7 2024-02-19T18:51:28.011 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 7/7 2024-02-19T18:51:28.534 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 7/7 2024-02-19T18:51:28.534 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 1/7 2024-02-19T18:51:28.534 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 2/7 2024-02-19T18:51:28.534 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 3/7 2024-02-19T18:51:28.534 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-02-19T18:51:28.534 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-02-19T18:51:28.534 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-02-19T18:51:28.854 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-02-19T18:51:28.855 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:28.855 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2024-02-19T18:51:28.855 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 2024-02-19T18:51:28.855 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 2024-02-19T18:51:28.855 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 2024-02-19T18:51:28.855 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-02-19T18:51:28.855 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-02-19T18:51:28.855 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-19T18:51:28.855 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-19T18:51:28.856 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:28.856 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:51:29.065 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-19T18:51:29.646 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:33 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:51:29.813 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:51:29.814 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:51:29.814 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2024-02-19T18:51:29.814 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:51:29.814 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2024-02-19T18:51:29.814 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-0.el9 ceph-noarch 7.4 M 2024-02-19T18:51:29.814 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2024-02-19T18:51:29.814 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-19T18:51:29.814 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-19T18:51:29.814 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-19T18:51:29.814 INFO:teuthology.orchestra.run.smithi096.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-19T18:51:29.814 INFO:teuthology.orchestra.run.smithi096.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-19T18:51:29.815 INFO:teuthology.orchestra.run.smithi096.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-19T18:51:29.815 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-19T18:51:29.815 INFO:teuthology.orchestra.run.smithi096.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-19T18:51:29.815 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-19T18:51:29.815 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-19T18:51:29.815 INFO:teuthology.orchestra.run.smithi096.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-19T18:51:29.815 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:29.815 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2024-02-19T18:51:29.815 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:51:29.815 INFO:teuthology.orchestra.run.smithi096.stdout:Install 12 Packages 2024-02-19T18:51:29.815 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:29.816 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 37 M 2024-02-19T18:51:29.816 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 209 M 2024-02-19T18:51:29.816 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2024-02-19T18:51:30.198 INFO:teuthology.orchestra.run.smithi096.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.1-0. 24 MB/s | 7.4 MB 00:00 2024-02-19T18:51:30.232 INFO:teuthology.orchestra.run.smithi096.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 91 kB/s | 32 kB 00:00 2024-02-19T18:51:30.290 INFO:teuthology.orchestra.run.smithi096.stdout:(3/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 187 kB/s | 17 kB 00:00 2024-02-19T18:51:30.341 INFO:teuthology.orchestra.run.smithi096.stdout:(4/12): openblas-0.3.21-2.el9.x86_64.rpm 314 kB/s | 34 kB 00:00 2024-02-19T18:51:31.199 INFO:teuthology.orchestra.run.smithi096.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 5.2 MB/s | 4.7 MB 00:00 2024-02-19T18:51:31.466 INFO:teuthology.orchestra.run.smithi096.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.2 MB/s | 4.8 MB 00:01 2024-02-19T18:51:31.491 INFO:teuthology.orchestra.run.smithi096.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 747 kB/s | 217 kB 00:00 2024-02-19T18:51:32.250 INFO:teuthology.orchestra.run.smithi096.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 802 kB 00:00 2024-02-19T18:51:33.233 INFO:teuthology.orchestra.run.smithi096.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.9 MB/s | 16 MB 00:01 2024-02-19T18:51:33.258 INFO:teuthology.orchestra.run.smithi096.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 193 kB/s | 194 kB 00:01 2024-02-19T18:51:34.709 INFO:teuthology.orchestra.run.smithi096.stdout:(11/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 634 kB/s | 3.0 MB 00:04 2024-02-19T18:51:36.025 INFO:teuthology.orchestra.run.smithi096.stdout:(12/12): python3-devel-3.9.17-2.el9.x86_64.rpm 89 kB/s | 245 kB 00:02 2024-02-19T18:51:36.028 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:51:36.029 INFO:teuthology.orchestra.run.smithi096.stdout:Total 6.0 MB/s | 37 MB 00:06 2024-02-19T18:51:36.052 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2024-02-19T18:51:36.079 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2024-02-19T18:51:36.079 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2024-02-19T18:51:36.490 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2024-02-19T18:51:36.491 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2024-02-19T18:51:37.198 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2024-02-19T18:51:37.282 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-02-19T18:51:37.313 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-19T18:51:37.405 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-02-19T18:51:37.441 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-19T18:51:37.618 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-19T18:51:37.648 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-19T18:51:37.739 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-19T18:51:38.387 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-19T18:51:38.502 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-19T18:51:39.733 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-19T18:51:40.764 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-19T18:51:40.791 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 12/12 2024-02-19T18:51:43.392 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 12/12 2024-02-19T18:51:43.393 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 1/12 2024-02-19T18:51:43.393 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-02-19T18:51:43.393 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-02-19T18:51:43.393 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-02-19T18:51:43.393 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-19T18:51:43.393 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-19T18:51:43.393 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-02-19T18:51:43.393 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-02-19T18:51:43.393 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-02-19T18:51:43.393 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-02-19T18:51:43.393 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-02-19T18:51:43.797 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-02-19T18:51:43.797 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:43.797 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2024-02-19T18:51:43.797 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarch 2024-02-19T18:51:43.797 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-19T18:51:43.797 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-19T18:51:43.797 INFO:teuthology.orchestra.run.smithi096.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-19T18:51:43.797 INFO:teuthology.orchestra.run.smithi096.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-19T18:51:43.797 INFO:teuthology.orchestra.run.smithi096.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-19T18:51:43.797 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-19T18:51:43.797 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-19T18:51:43.798 INFO:teuthology.orchestra.run.smithi096.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-19T18:51:43.798 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-19T18:51:43.798 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-19T18:51:43.798 INFO:teuthology.orchestra.run.smithi096.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-19T18:51:43.798 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:43.798 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:51:44.204 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-mgr-rook 2024-02-19T18:51:44.811 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:48 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:51:44.991 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:51:44.992 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:51:44.992 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2024-02-19T18:51:44.992 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:51:44.992 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2024-02-19T18:51:44.992 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-rook noarch 2:18.2.1-0.el9 ceph-noarch 50 k 2024-02-19T18:51:44.992 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2024-02-19T18:51:44.992 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-19T18:51:44.992 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-19T18:51:44.993 INFO:teuthology.orchestra.run.smithi096.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-19T18:51:44.993 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-19T18:51:44.993 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-19T18:51:44.993 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-19T18:51:44.993 INFO:teuthology.orchestra.run.smithi096.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-19T18:51:44.993 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-19T18:51:44.993 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-19T18:51:44.993 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-19T18:51:44.993 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-19T18:51:44.993 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-19T18:51:44.993 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:44.993 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2024-02-19T18:51:44.993 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:51:44.993 INFO:teuthology.orchestra.run.smithi096.stdout:Install 13 Packages 2024-02-19T18:51:44.994 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:44.994 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 2.0 M 2024-02-19T18:51:44.994 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 26 M 2024-02-19T18:51:44.994 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2024-02-19T18:51:45.568 INFO:teuthology.orchestra.run.smithi096.stdout:(1/13): ceph-mgr-rook-18.2.1-0.el9.noarch.rpm 818 kB/s | 50 kB 00:00 2024-02-19T18:51:45.801 INFO:teuthology.orchestra.run.smithi096.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 83 kB/s | 24 kB 00:00 2024-02-19T18:51:45.835 INFO:teuthology.orchestra.run.smithi096.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 55 kB/s | 18 kB 00:00 2024-02-19T18:51:46.068 INFO:teuthology.orchestra.run.smithi096.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 385 kB/s | 174 kB 00:00 2024-02-19T18:51:46.093 INFO:teuthology.orchestra.run.smithi096.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 453 kB/s | 132 kB 00:00 2024-02-19T18:51:46.202 INFO:teuthology.orchestra.run.smithi096.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 573 kB/s | 211 kB 00:00 2024-02-19T18:51:46.227 INFO:teuthology.orchestra.run.smithi096.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 269 kB/s | 43 kB 00:00 2024-02-19T18:51:54.385 INFO:teuthology.orchestra.run.smithi096.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 3.9 kB/s | 32 kB 00:08 2024-02-19T18:51:54.660 INFO:teuthology.orchestra.run.smithi096.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 1.8 kB/s | 15 kB 00:08 2024-02-19T18:51:54.835 INFO:teuthology.orchestra.run.smithi096.stdout:(10/13): python3-kubernetes-26.1.0-2.el9.noarch 2.3 MB/s | 1.0 MB 00:00 2024-02-19T18:51:54.927 INFO:teuthology.orchestra.run.smithi096.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 221 kB/s | 59 kB 00:00 2024-02-19T18:51:54.952 INFO:teuthology.orchestra.run.smithi096.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 769 kB/s | 90 kB 00:00 2024-02-19T18:51:55.177 INFO:teuthology.orchestra.run.smithi096.stdout:(13/13): python3-google-auth-2.27.0-1.el9.noarc 23 kB/s | 203 kB 00:08 2024-02-19T18:51:55.181 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:51:55.181 INFO:teuthology.orchestra.run.smithi096.stdout:Total 206 kB/s | 2.0 MB 00:10 2024-02-19T18:51:55.181 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2024-02-19T18:51:55.196 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2024-02-19T18:51:55.196 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2024-02-19T18:51:55.300 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2024-02-19T18:51:55.300 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2024-02-19T18:51:55.831 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2024-02-19T18:51:55.997 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-19T18:51:56.053 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-19T18:51:56.108 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-19T18:51:56.146 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-19T18:51:56.187 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-19T18:51:56.281 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-19T18:51:56.381 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 7/13 2024-02-19T18:51:56.430 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-19T18:51:57.151 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-19T18:51:57.212 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-19T18:51:57.245 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-19T18:51:57.293 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-19T18:51:57.315 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-rook-2:18.2.1-0.el9.noarch 13/13 2024-02-19T18:51:58.114 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-0.el9.noarch 13/13 2024-02-19T18:51:58.115 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-rook-2:18.2.1-0.el9.noarch 1/13 2024-02-19T18:51:58.115 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-19T18:51:58.115 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-19T18:51:58.115 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-19T18:51:58.115 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-19T18:51:58.115 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-19T18:51:58.115 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-19T18:51:58.115 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-19T18:51:58.115 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-19T18:51:58.115 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 10/13 2024-02-19T18:51:58.115 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-19T18:51:58.116 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-19T18:51:58.505 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-19T18:51:58.505 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:58.505 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2024-02-19T18:51:58.506 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-rook-2:18.2.1-0.el9.noarch 2024-02-19T18:51:58.506 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-19T18:51:58.506 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-19T18:51:58.506 INFO:teuthology.orchestra.run.smithi096.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-19T18:51:58.506 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-19T18:51:58.506 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-19T18:51:58.506 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-19T18:51:58.506 INFO:teuthology.orchestra.run.smithi096.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-19T18:51:58.506 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-19T18:51:58.506 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-19T18:51:58.506 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-19T18:51:58.506 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-19T18:51:58.506 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-19T18:51:58.506 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:58.506 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:51:58.751 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-mgr-cephadm 2024-02-19T18:51:59.338 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:02:03 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:51:59.504 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:51:59.505 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:51:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2024-02-19T18:51:59.505 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:51:59.505 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2024-02-19T18:51:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-cephadm noarch 2:18.2.1-0.el9 ceph-noarch 132 k 2024-02-19T18:51:59.505 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2024-02-19T18:51:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-19T18:51:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-19T18:51:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2 noarch 2.11.3-5.el9 CentOS-AppStream 227 k 2024-02-19T18:51:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-19T18:51:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-19T18:51:59.505 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:59.506 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2024-02-19T18:51:59.506 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:51:59.506 INFO:teuthology.orchestra.run.smithi096.stdout:Install 6 Packages 2024-02-19T18:51:59.506 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:51:59.506 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 6.8 M 2024-02-19T18:51:59.506 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 33 M 2024-02-19T18:51:59.506 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2024-02-19T18:52:00.113 INFO:teuthology.orchestra.run.smithi096.stdout:(1/6): ceph-mgr-cephadm-18.2.1-0.el9.noarch.rpm 1.6 MB/s | 132 kB 00:00 2024-02-19T18:52:00.455 INFO:teuthology.orchestra.run.smithi096.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 535 kB/s | 227 kB 00:00 2024-02-19T18:52:00.830 INFO:teuthology.orchestra.run.smithi096.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 7.2 MB/s | 5.8 MB 00:00 2024-02-19T18:52:00.847 INFO:teuthology.orchestra.run.smithi096.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 147 kB/s | 58 kB 00:00 2024-02-19T18:52:00.914 INFO:teuthology.orchestra.run.smithi096.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 611 kB/s | 51 kB 00:00 2024-02-19T18:52:02.622 INFO:teuthology.orchestra.run.smithi096.stdout:(6/6): python3-asyncssh-2.13.2-4.el9.noarch.rpm 222 kB/s | 548 kB 00:02 2024-02-19T18:52:02.626 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:52:02.627 INFO:teuthology.orchestra.run.smithi096.stdout:Total 2.2 MB/s | 6.8 MB 00:03 2024-02-19T18:52:02.627 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2024-02-19T18:52:02.637 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2024-02-19T18:52:02.637 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2024-02-19T18:52:02.731 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2024-02-19T18:52:02.731 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2024-02-19T18:52:03.037 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2024-02-19T18:52:03.204 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-19T18:52:03.257 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 2/6 2024-02-19T18:52:03.776 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-19T18:52:03.851 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-19T18:52:03.912 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-19T18:52:03.936 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 6/6 2024-02-19T18:52:04.794 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 6/6 2024-02-19T18:52:04.795 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 1/6 2024-02-19T18:52:04.795 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-19T18:52:04.795 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-19T18:52:04.795 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 4/6 2024-02-19T18:52:04.795 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-19T18:52:05.121 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-19T18:52:05.121 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:05.121 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2024-02-19T18:52:05.121 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 2024-02-19T18:52:05.121 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-19T18:52:05.121 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-19T18:52:05.121 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-19T18:52:05.121 INFO:teuthology.orchestra.run.smithi096.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-19T18:52:05.121 INFO:teuthology.orchestra.run.smithi096.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-19T18:52:05.121 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:05.121 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:52:05.389 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-fuse 2024-02-19T18:52:05.971 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:02:09 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:52:06.137 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:52:06.137 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:52:06.137 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2024-02-19T18:52:06.137 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:52:06.137 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2024-02-19T18:52:06.137 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-fuse x86_64 2:18.2.1-0.el9 ceph 839 k 2024-02-19T18:52:06.137 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2024-02-19T18:52:06.138 INFO:teuthology.orchestra.run.smithi096.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-19T18:52:06.138 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:06.138 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2024-02-19T18:52:06.138 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:52:06.138 INFO:teuthology.orchestra.run.smithi096.stdout:Install 2 Packages 2024-02-19T18:52:06.138 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:06.138 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 918 k 2024-02-19T18:52:06.138 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 2.7 M 2024-02-19T18:52:06.138 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2024-02-19T18:52:06.268 INFO:teuthology.orchestra.run.smithi096.stdout:(1/2): ceph-fuse-18.2.1-0.el9.x86_64.rpm 6.4 MB/s | 839 kB 00:00 2024-02-19T18:52:06.593 INFO:teuthology.orchestra.run.smithi096.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 173 kB/s | 79 kB 00:00 2024-02-19T18:52:06.594 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:52:06.594 INFO:teuthology.orchestra.run.smithi096.stdout:Total 2.0 MB/s | 918 kB 00:00 2024-02-19T18:52:06.595 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2024-02-19T18:52:06.616 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2024-02-19T18:52:06.616 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2024-02-19T18:52:06.693 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2024-02-19T18:52:06.693 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2024-02-19T18:52:06.875 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2024-02-19T18:52:07.016 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-19T18:52:07.084 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-fuse-2:18.2.1-0.el9.x86_64 2/2 2024-02-19T18:52:07.843 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-fuse-2:18.2.1-0.el9.x86_64 2/2 2024-02-19T18:52:07.843 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-fuse-2:18.2.1-0.el9.x86_64 1/2 2024-02-19T18:52:08.172 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-19T18:52:08.172 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:08.172 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2024-02-19T18:52:08.172 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-fuse-2:18.2.1-0.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-19T18:52:08.172 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:08.172 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:52:08.471 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install librados-devel 2024-02-19T18:52:09.068 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:02:13 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:52:09.234 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:52:09.235 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:52:09.235 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2024-02-19T18:52:09.235 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:52:09.235 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2024-02-19T18:52:09.235 INFO:teuthology.orchestra.run.smithi096.stdout: librados-devel x86_64 2:18.2.1-0.el9 ceph 127 k 2024-02-19T18:52:09.235 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:09.235 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2024-02-19T18:52:09.235 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:52:09.235 INFO:teuthology.orchestra.run.smithi096.stdout:Install 1 Package 2024-02-19T18:52:09.236 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:09.236 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 127 k 2024-02-19T18:52:09.236 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 456 k 2024-02-19T18:52:09.236 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2024-02-19T18:52:09.323 INFO:teuthology.orchestra.run.smithi096.stdout:librados-devel-18.2.1-0.el9.x86_64.rpm 1.4 MB/s | 127 kB 00:00 2024-02-19T18:52:09.324 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:52:09.324 INFO:teuthology.orchestra.run.smithi096.stdout:Total 1.4 MB/s | 127 kB 00:00 2024-02-19T18:52:09.324 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2024-02-19T18:52:09.329 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2024-02-19T18:52:09.329 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2024-02-19T18:52:09.384 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2024-02-19T18:52:09.384 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2024-02-19T18:52:09.528 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2024-02-19T18:52:09.621 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:52:10.125 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:52:10.430 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:52:10.430 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:10.430 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2024-02-19T18:52:10.430 INFO:teuthology.orchestra.run.smithi096.stdout: librados-devel-2:18.2.1-0.el9.x86_64 2024-02-19T18:52:10.430 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:10.430 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:52:10.685 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install libcephfs2 2024-02-19T18:52:11.276 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:02:15 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:52:11.392 INFO:teuthology.orchestra.run.smithi096.stdout:Package libcephfs2-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-19T18:52:11.443 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:52:11.444 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2024-02-19T18:52:11.444 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:52:11.507 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install libcephfs-devel 2024-02-19T18:52:12.093 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:02:16 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:52:12.259 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:52:12.259 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:52:12.259 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2024-02-19T18:52:12.260 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:52:12.260 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2024-02-19T18:52:12.260 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-devel x86_64 2:18.2.1-0.el9 ceph 31 k 2024-02-19T18:52:12.260 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:12.260 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2024-02-19T18:52:12.260 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:52:12.260 INFO:teuthology.orchestra.run.smithi096.stdout:Install 1 Package 2024-02-19T18:52:12.260 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:12.261 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 31 k 2024-02-19T18:52:12.261 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 139 k 2024-02-19T18:52:12.261 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2024-02-19T18:52:12.335 INFO:teuthology.orchestra.run.smithi096.stdout:libcephfs-devel-18.2.1-0.el9.x86_64.rpm 414 kB/s | 31 kB 00:00 2024-02-19T18:52:12.336 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:52:12.336 INFO:teuthology.orchestra.run.smithi096.stdout:Total 407 kB/s | 31 kB 00:00 2024-02-19T18:52:12.336 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2024-02-19T18:52:12.340 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2024-02-19T18:52:12.340 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2024-02-19T18:52:12.364 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2024-02-19T18:52:12.364 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2024-02-19T18:52:12.444 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2024-02-19T18:52:12.558 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:52:12.955 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:52:13.218 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:52:13.218 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:13.218 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2024-02-19T18:52:13.218 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-devel-2:18.2.1-0.el9.x86_64 2024-02-19T18:52:13.218 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:13.219 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:52:13.383 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install librados2 2024-02-19T18:52:13.965 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:02:17 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:52:14.080 INFO:teuthology.orchestra.run.smithi096.stdout:Package librados2-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-19T18:52:14.132 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:52:14.133 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2024-02-19T18:52:14.133 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:52:14.198 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install librbd1 2024-02-19T18:52:14.801 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:02:18 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:52:14.924 INFO:teuthology.orchestra.run.smithi096.stdout:Package librbd1-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-19T18:52:14.979 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:52:14.981 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2024-02-19T18:52:14.981 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:52:15.057 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install python3-rados 2024-02-19T18:52:15.669 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:02:19 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:52:15.789 INFO:teuthology.orchestra.run.smithi096.stdout:Package python3-rados-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-19T18:52:15.843 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:52:15.844 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2024-02-19T18:52:15.844 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:52:15.906 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install python3-rgw 2024-02-19T18:52:16.481 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:02:20 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:52:16.593 INFO:teuthology.orchestra.run.smithi096.stdout:Package python3-rgw-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-19T18:52:16.644 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:52:16.645 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2024-02-19T18:52:16.646 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:52:16.718 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install python3-cephfs 2024-02-19T18:52:17.296 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:02:21 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:52:17.408 INFO:teuthology.orchestra.run.smithi096.stdout:Package python3-cephfs-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-19T18:52:17.462 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:52:17.463 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2024-02-19T18:52:17.463 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:52:17.530 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install python3-rbd 2024-02-19T18:52:18.102 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:02:22 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:52:18.215 INFO:teuthology.orchestra.run.smithi096.stdout:Package python3-rbd-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-19T18:52:18.266 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:52:18.267 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2024-02-19T18:52:18.268 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:52:18.330 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install rbd-fuse 2024-02-19T18:52:18.910 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:02:22 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:52:19.078 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:52:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:52:19.079 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2024-02-19T18:52:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:52:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2024-02-19T18:52:19.079 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-fuse x86_64 2:18.2.1-0.el9 ceph 86 k 2024-02-19T18:52:19.079 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2024-02-19T18:52:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:52:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:Install 1 Package 2024-02-19T18:52:19.079 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 86 k 2024-02-19T18:52:19.079 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 226 k 2024-02-19T18:52:19.080 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2024-02-19T18:52:19.147 INFO:teuthology.orchestra.run.smithi096.stdout:rbd-fuse-18.2.1-0.el9.x86_64.rpm 1.2 MB/s | 86 kB 00:00 2024-02-19T18:52:19.148 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:52:19.148 INFO:teuthology.orchestra.run.smithi096.stdout:Total 1.2 MB/s | 86 kB 00:00 2024-02-19T18:52:19.148 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2024-02-19T18:52:19.155 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2024-02-19T18:52:19.155 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2024-02-19T18:52:19.211 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2024-02-19T18:52:19.211 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2024-02-19T18:52:19.345 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2024-02-19T18:52:19.445 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:52:19.872 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:52:20.176 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:52:20.176 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:20.176 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2024-02-19T18:52:20.176 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-fuse-2:18.2.1-0.el9.x86_64 2024-02-19T18:52:20.176 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:20.176 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:52:20.502 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install rbd-mirror 2024-02-19T18:52:21.093 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:02:25 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:52:21.264 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:52:21.265 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:52:21.265 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2024-02-19T18:52:21.265 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:52:21.265 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2024-02-19T18:52:21.265 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-mirror x86_64 2:18.2.1-0.el9 ceph 3.0 M 2024-02-19T18:52:21.265 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:21.265 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2024-02-19T18:52:21.265 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:52:21.265 INFO:teuthology.orchestra.run.smithi096.stdout:Install 1 Package 2024-02-19T18:52:21.265 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:21.265 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 3.0 M 2024-02-19T18:52:21.266 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 12 M 2024-02-19T18:52:21.266 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2024-02-19T18:52:21.368 INFO:teuthology.orchestra.run.smithi096.stdout:rbd-mirror-18.2.1-0.el9.x86_64.rpm 29 MB/s | 3.0 MB 00:00 2024-02-19T18:52:21.369 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:52:21.369 INFO:teuthology.orchestra.run.smithi096.stdout:Total 29 MB/s | 3.0 MB 00:00 2024-02-19T18:52:21.369 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2024-02-19T18:52:21.378 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2024-02-19T18:52:21.378 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2024-02-19T18:52:21.449 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2024-02-19T18:52:21.449 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2024-02-19T18:52:21.863 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2024-02-19T18:52:21.936 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:52:21.960 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:52:21.960 INFO:teuthology.orchestra.run.smithi096.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-19T18:52:21.961 INFO:teuthology.orchestra.run.smithi096.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-19T18:52:21.961 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-19T18:52:21.961 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-19T18:52:21.961 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:23.083 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:52:23.083 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:23.083 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2024-02-19T18:52:23.083 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-mirror-2:18.2.1-0.el9.x86_64 2024-02-19T18:52:23.083 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:23.083 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:52:23.312 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install rbd-nbd 2024-02-19T18:52:23.911 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:02:27 ago on Mon 19 Feb 2024 06:49:56 PM UTC. 2024-02-19T18:52:24.077 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2024-02-19T18:52:24.078 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:52:24.078 INFO:teuthology.orchestra.run.smithi096.stdout: Package Architecture Version Repository Size 2024-02-19T18:52:24.078 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:52:24.079 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2024-02-19T18:52:24.079 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-nbd x86_64 2:18.2.1-0.el9 ceph 171 k 2024-02-19T18:52:24.079 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:24.079 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2024-02-19T18:52:24.079 INFO:teuthology.orchestra.run.smithi096.stdout:================================================================================ 2024-02-19T18:52:24.079 INFO:teuthology.orchestra.run.smithi096.stdout:Install 1 Package 2024-02-19T18:52:24.079 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:24.079 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 171 k 2024-02-19T18:52:24.079 INFO:teuthology.orchestra.run.smithi096.stdout:Installed size: 494 k 2024-02-19T18:52:24.079 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2024-02-19T18:52:24.139 INFO:teuthology.orchestra.run.smithi096.stdout:rbd-nbd-18.2.1-0.el9.x86_64.rpm 2.8 MB/s | 171 kB 00:00 2024-02-19T18:52:24.140 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:52:24.140 INFO:teuthology.orchestra.run.smithi096.stdout:Total 2.7 MB/s | 171 kB 00:00 2024-02-19T18:52:24.140 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2024-02-19T18:52:24.148 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2024-02-19T18:52:24.148 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2024-02-19T18:52:24.204 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2024-02-19T18:52:24.204 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2024-02-19T18:52:24.355 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2024-02-19T18:52:24.446 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:52:24.897 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:52:25.216 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-02-19T18:52:25.216 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:25.217 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2024-02-19T18:52:25.217 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-nbd-2:18.2.1-0.el9.x86_64 2024-02-19T18:52:25.217 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:52:25.217 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2024-02-19T18:52:25.477 DEBUG:teuthology.parallel:result is None 2024-02-19T18:52:25.478 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-19T18:52:25.478 INFO:teuthology.packaging:ref: None 2024-02-19T18:52:25.478 INFO:teuthology.packaging:tag: v18.2.1 2024-02-19T18:52:25.478 INFO:teuthology.packaging:branch: None 2024-02-19T18:52:25.478 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T18:52:25.478 INFO:teuthology.packaging:Tag 'v18.2.1' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-02-19T18:52:25.478 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-02-19T18:52:25.620 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-19T18:52:25.641 INFO:teuthology.orchestra.run.smithi096.stdout:18.2.1-0.el9 2024-02-19T18:52:25.641 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-0.el9 2024-02-19T18:52:25.641 INFO:teuthology.task.install:The correct ceph version 18.2.1-0 is installed. 2024-02-19T18:52:25.643 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-19T18:52:25.643 INFO:teuthology.packaging:ref: None 2024-02-19T18:52:25.643 INFO:teuthology.packaging:tag: v18.2.1 2024-02-19T18:52:25.643 INFO:teuthology.packaging:branch: None 2024-02-19T18:52:25.643 INFO:teuthology.packaging:sha1: f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T18:52:25.643 INFO:teuthology.packaging:Tag 'v18.2.1' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-02-19T18:52:25.643 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-02-19T18:52:25.780 DEBUG:teuthology.orchestra.run.smithi125:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-19T18:52:25.805 INFO:teuthology.orchestra.run.smithi125.stdout:18.2.1-0.el9 2024-02-19T18:52:25.805 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-0.el9 2024-02-19T18:52:25.805 INFO:teuthology.task.install:The correct ceph version 18.2.1-0 is installed. 2024-02-19T18:52:25.806 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-19T18:52:25.807 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-02-19T18:52:25.807 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-19T18:52:25.835 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-02-19T18:52:25.835 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-19T18:52:25.877 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-19T18:52:25.878 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-02-19T18:52:25.878 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/daemon-helper 2024-02-19T18:52:25.904 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-19T18:52:25.971 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-02-19T18:52:25.972 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/daemon-helper 2024-02-19T18:52:26.003 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-19T18:52:26.073 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-19T18:52:26.073 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-02-19T18:52:26.073 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-19T18:52:26.099 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-19T18:52:26.165 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-02-19T18:52:26.166 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-19T18:52:26.194 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-19T18:52:26.260 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-19T18:52:26.260 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-02-19T18:52:26.260 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/stdin-killer 2024-02-19T18:52:26.287 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-19T18:52:26.353 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-02-19T18:52:26.353 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/stdin-killer 2024-02-19T18:52:26.381 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-19T18:52:26.449 INFO:teuthology.run_tasks:Running task print... 2024-02-19T18:52:26.461 INFO:teuthology.task.print:**** done install task... 2024-02-19T18:52:26.462 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-19T18:52:26.556 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.io/ceph/ceph:v18.2.1', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275'} 2024-02-19T18:52:26.556 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v18.2.1 2024-02-19T18:52:26.557 INFO:tasks.cephadm:Cluster fsid is 06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T18:52:26.557 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-19T18:52:26.557 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-02-19T18:52:26.557 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi096': '172.21.15.96', 'mon.smithi125': '172.21.15.125'} 2024-02-19T18:52:26.557 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-19T18:52:26.557 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname $(hostname -s) 2024-02-19T18:52:26.584 DEBUG:teuthology.orchestra.run.smithi125:> sudo hostname $(hostname -s) 2024-02-19T18:52:26.611 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-02-19T18:52:26.612 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T18:52:26.749 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/76790/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-1450-gf78a58c0', 'node_name': '172.21.2.1+braggi01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-1450.gf78a58c0'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-batrick-testing-20240215.160715/f78a58c0ffd401d1493058a1022c35f011d65275/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-02-15 19:25:41.455235', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-batrick-testing-20240215.160715', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-batrick-testing-20240215.160715/f78a58c0ffd401d1493058a1022c35f011d65275/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': 'f78a58c0ffd401d1493058a1022c35f011d65275', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/76792/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-1450-gf78a58c0', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-1450.gf78a58c0'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20240215.160715/f78a58c0ffd401d1493058a1022c35f011d65275/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-02-15 19:17:06.436952', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-batrick-testing-20240215.160715', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-batrick-testing-20240215.160715/f78a58c0ffd401d1493058a1022c35f011d65275/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-02-19T18:52:26.961 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref reef, sha1 bb2b5a32fc53d75aa463fb74c73b7d0b0ada6320 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-02-19T18:52:26.963 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/reef/bb2b5a32fc53d75aa463fb74c73b7d0b0ada6320/centos/9/x86_64/flavors/default/cephadm 2024-02-19T18:52:26.963 DEBUG:teuthology.orchestra.run.smithi096:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/bb2b5a32fc53d75aa463fb74c73b7d0b0ada6320/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-19T18:52:27.363 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-r--r--. 1 ubuntu ubuntu 214738 Feb 19 18:52 /home/ubuntu/cephtest/cephadm 2024-02-19T18:52:27.363 DEBUG:teuthology.orchestra.run.smithi125:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/bb2b5a32fc53d75aa463fb74c73b7d0b0ada6320/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-19T18:52:28.431 INFO:teuthology.orchestra.run.smithi125.stdout:-rw-r--r--. 1 ubuntu ubuntu 214738 Feb 19 18:52 /home/ubuntu/cephtest/cephadm 2024-02-19T18:52:28.431 DEBUG:teuthology.orchestra.run.smithi096:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-19T18:52:28.450 DEBUG:teuthology.orchestra.run.smithi125:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-19T18:52:28.479 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v18.2.1 on all hosts... 2024-02-19T18:52:28.479 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 pull 2024-02-19T18:52:28.493 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 pull 2024-02-19T18:52:29.299 INFO:teuthology.orchestra.run.smithi125.stderr:Pulling container image quay.io/ceph/ceph:v18.2.1... 2024-02-19T18:52:29.300 INFO:teuthology.orchestra.run.smithi096.stderr:Pulling container image quay.io/ceph/ceph:v18.2.1... 2024-02-19T18:54:17.043 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T18:54:17.044 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_version": "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)", 2024-02-19T18:54:17.044 INFO:teuthology.orchestra.run.smithi096.stdout: "image_id": "94eadd990e0a5619d90a7220f97c70d1fe3558d9b0fb9e0c1935661dd49a6d5f", 2024-02-19T18:54:17.044 INFO:teuthology.orchestra.run.smithi096.stdout: "repo_digests": [ 2024-02-19T18:54:17.044 INFO:teuthology.orchestra.run.smithi096.stdout: "quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0", 2024-02-19T18:54:17.044 INFO:teuthology.orchestra.run.smithi096.stdout: "quay.io/ceph/ceph@sha256:e540726c37a4335a713579a0c9bf4413cb31ad156d22ea1ec00ed9bbc4317f66" 2024-02-19T18:54:17.044 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-02-19T18:54:17.044 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T18:54:18.193 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2024-02-19T18:54:18.193 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)", 2024-02-19T18:54:18.193 INFO:teuthology.orchestra.run.smithi125.stdout: "image_id": "94eadd990e0a5619d90a7220f97c70d1fe3558d9b0fb9e0c1935661dd49a6d5f", 2024-02-19T18:54:18.193 INFO:teuthology.orchestra.run.smithi125.stdout: "repo_digests": [ 2024-02-19T18:54:18.193 INFO:teuthology.orchestra.run.smithi125.stdout: "quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0", 2024-02-19T18:54:18.193 INFO:teuthology.orchestra.run.smithi125.stdout: "quay.io/ceph/ceph@sha256:e540726c37a4335a713579a0c9bf4413cb31ad156d22ea1ec00ed9bbc4317f66" 2024-02-19T18:54:18.193 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2024-02-19T18:54:18.193 INFO:teuthology.orchestra.run.smithi125.stdout:} 2024-02-19T18:54:18.210 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /etc/ceph 2024-02-19T18:54:18.244 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /etc/ceph 2024-02-19T18:54:18.283 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 777 /etc/ceph 2024-02-19T18:54:18.313 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 777 /etc/ceph 2024-02-19T18:54:18.351 INFO:tasks.cephadm:Writing seed config... 2024-02-19T18:54:18.352 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-02-19T18:54:18.352 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-02-19T18:54:18.352 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-02-19T18:54:18.352 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-02-19T18:54:18.352 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-02-19T18:54:18.352 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-02-19T18:54:18.352 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-02-19T18:54:18.353 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-02-19T18:54:18.353 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-02-19T18:54:18.353 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-19T18:54:18.353 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-19T18:54:18.353 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-02-19T18:54:18.353 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-02-19T18:54:18.353 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-02-19T18:54:18.353 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-02-19T18:54:18.353 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-02-19T18:54:18.353 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-02-19T18:54:18.353 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-02-19T18:54:18.353 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-02-19T18:54:18.353 INFO:tasks.cephadm: override: [client] debug client = 20 2024-02-19T18:54:18.353 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-02-19T18:54:18.353 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-02-19T18:54:18.353 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-02-19T18:54:18.354 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-02-19T18:54:18.354 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-02-19T18:54:18.354 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-02-19T18:54:18.354 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-02-19T18:54:18.354 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-02-19T18:54:18.354 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-02-19T18:54:18.354 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-02-19T18:54:18.354 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-02-19T18:54:18.354 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-02-19T18:54:18.354 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-02-19T18:54:18.354 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-02-19T18:54:18.354 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-19T18:54:18.354 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-19T18:54:18.354 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-19T18:54:18.354 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-19T18:54:18.354 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-19T18:54:18.354 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-02-19T18:54:18.355 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-02-19T18:54:18.355 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-19T18:54:18.371 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 06580d2c-cf58-11ee-95bb-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-02-19T18:54:18.372 DEBUG:teuthology.orchestra.run.smithi096:mon.smithi096> sudo journalctl -f -n 0 -u ceph-06580d2c-cf58-11ee-95bb-87774f69a715@mon.smithi096.service 2024-02-19T18:54:18.413 INFO:tasks.cephadm:Bootstrapping... 2024-02-19T18:54:18.414 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 -v bootstrap --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.96 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-19T18:54:18.578 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2024-02-19T18:54:18.578 INFO:teuthology.orchestra.run.smithi096.stdout:cephadm ['--image', 'quay.io/ceph/ceph:v18.2.1', '-v', 'bootstrap', '--fsid', '06580d2c-cf58-11ee-95bb-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.96', '--skip-admin-label'] 2024-02-19T18:54:18.602 INFO:teuthology.orchestra.run.smithi096.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-19T18:54:18.603 INFO:teuthology.orchestra.run.smithi096.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-02-19T18:54:18.603 INFO:teuthology.orchestra.run.smithi096.stdout:Verifying podman|docker is present... 2024-02-19T18:54:18.625 INFO:teuthology.orchestra.run.smithi096.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-19T18:54:18.625 INFO:teuthology.orchestra.run.smithi096.stdout:Verifying lvm2 is present... 2024-02-19T18:54:18.625 INFO:teuthology.orchestra.run.smithi096.stdout:Verifying time synchronization is in place... 2024-02-19T18:54:18.633 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-19T18:54:18.633 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-19T18:54:18.638 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-19T18:54:18.639 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout inactive 2024-02-19T18:54:18.645 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout enabled 2024-02-19T18:54:18.651 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout active 2024-02-19T18:54:18.651 INFO:teuthology.orchestra.run.smithi096.stdout:Unit chronyd.service is enabled and running 2024-02-19T18:54:18.651 INFO:teuthology.orchestra.run.smithi096.stdout:Repeating the final host check... 2024-02-19T18:54:18.674 INFO:teuthology.orchestra.run.smithi096.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-19T18:54:18.674 INFO:teuthology.orchestra.run.smithi096.stdout:podman (/bin/podman) version 4.9.3 is present 2024-02-19T18:54:18.674 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl is present 2024-02-19T18:54:18.674 INFO:teuthology.orchestra.run.smithi096.stdout:lvcreate is present 2024-02-19T18:54:18.681 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-19T18:54:18.681 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-19T18:54:18.687 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-19T18:54:18.687 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout inactive 2024-02-19T18:54:18.692 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout enabled 2024-02-19T18:54:18.698 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout active 2024-02-19T18:54:18.698 INFO:teuthology.orchestra.run.smithi096.stdout:Unit chronyd.service is enabled and running 2024-02-19T18:54:18.698 INFO:teuthology.orchestra.run.smithi096.stdout:Host looks OK 2024-02-19T18:54:18.698 INFO:teuthology.orchestra.run.smithi096.stdout:Cluster fsid: 06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T18:54:18.698 INFO:teuthology.orchestra.run.smithi096.stdout:Acquiring lock 140622794475744 on /run/cephadm/06580d2c-cf58-11ee-95bb-87774f69a715.lock 2024-02-19T18:54:18.698 INFO:teuthology.orchestra.run.smithi096.stdout:Lock 140622794475744 acquired on /run/cephadm/06580d2c-cf58-11ee-95bb-87774f69a715.lock 2024-02-19T18:54:18.698 INFO:teuthology.orchestra.run.smithi096.stdout:Verifying IP 172.21.15.96 port 3300 ... 2024-02-19T18:54:18.699 INFO:teuthology.orchestra.run.smithi096.stdout:Verifying IP 172.21.15.96 port 6789 ... 2024-02-19T18:54:18.699 INFO:teuthology.orchestra.run.smithi096.stdout:Base mon IP(s) is [172.21.15.96:3300, 172.21.15.96:6789], mon addrv is [v2:172.21.15.96:3300,v1:172.21.15.96:6789] 2024-02-19T18:54:18.703 INFO:teuthology.orchestra.run.smithi096.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.96 metric 100 2024-02-19T18:54:18.703 INFO:teuthology.orchestra.run.smithi096.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.96 metric 100 2024-02-19T18:54:18.706 INFO:teuthology.orchestra.run.smithi096.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-02-19T18:54:18.706 INFO:teuthology.orchestra.run.smithi096.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-02-19T18:54:18.706 INFO:teuthology.orchestra.run.smithi096.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1768sec hoplimit 64 pref medium 2024-02-19T18:54:18.708 INFO:teuthology.orchestra.run.smithi096.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-02-19T18:54:18.708 INFO:teuthology.orchestra.run.smithi096.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-02-19T18:54:18.708 INFO:teuthology.orchestra.run.smithi096.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-19T18:54:18.708 INFO:teuthology.orchestra.run.smithi096.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-02-19T18:54:18.708 INFO:teuthology.orchestra.run.smithi096.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:cc0d/64 scope link 2024-02-19T18:54:18.708 INFO:teuthology.orchestra.run.smithi096.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-19T18:54:18.709 INFO:teuthology.orchestra.run.smithi096.stdout:Mon IP `172.21.15.96` is in CIDR network `172.21.0.0/20` 2024-02-19T18:54:18.709 INFO:teuthology.orchestra.run.smithi096.stdout:Mon IP `172.21.15.96` is in CIDR network `172.21.0.0/20` 2024-02-19T18:54:18.709 INFO:teuthology.orchestra.run.smithi096.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-02-19T18:54:18.709 INFO:teuthology.orchestra.run.smithi096.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-02-19T18:54:18.709 INFO:teuthology.orchestra.run.smithi096.stdout:Pulling container image quay.io/ceph/ceph:v18.2.1... 2024-02-19T18:54:19.828 INFO:teuthology.orchestra.run.smithi096.stdout:/bin/podman: stdout 94eadd990e0a5619d90a7220f97c70d1fe3558d9b0fb9e0c1935661dd49a6d5f 2024-02-19T18:54:19.828 INFO:teuthology.orchestra.run.smithi096.stdout:/bin/podman: stderr Trying to pull quay.io/ceph/ceph:v18.2.1... 2024-02-19T18:54:19.828 INFO:teuthology.orchestra.run.smithi096.stdout:/bin/podman: stderr Getting image source signatures 2024-02-19T18:54:19.828 INFO:teuthology.orchestra.run.smithi096.stdout:/bin/podman: stderr Copying blob sha256:6345d49baed062606681bf114c10cebf2c69e90ec4d758270fae85ad0cc5c86b 2024-02-19T18:54:19.828 INFO:teuthology.orchestra.run.smithi096.stdout:/bin/podman: stderr Copying blob sha256:0f642e61a11afb42c0ccb5b05f5809250ad643ed143780d6ff49a5a4c492fc38 2024-02-19T18:54:19.828 INFO:teuthology.orchestra.run.smithi096.stdout:/bin/podman: stderr Copying config sha256:94eadd990e0a5619d90a7220f97c70d1fe3558d9b0fb9e0c1935661dd49a6d5f 2024-02-19T18:54:19.828 INFO:teuthology.orchestra.run.smithi096.stdout:/bin/podman: stderr Writing manifest to image destination 2024-02-19T18:54:20.782 INFO:teuthology.orchestra.run.smithi096.stdout:ceph: stdout ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable) 2024-02-19T18:54:20.782 INFO:teuthology.orchestra.run.smithi096.stdout:Ceph version: ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable) 2024-02-19T18:54:20.782 INFO:teuthology.orchestra.run.smithi096.stdout:Extracting ceph user uid/gid from container image... 2024-02-19T18:54:21.791 INFO:teuthology.orchestra.run.smithi096.stdout:stat: stdout 167 167 2024-02-19T18:54:21.791 INFO:teuthology.orchestra.run.smithi096.stdout:Creating initial keys... 2024-02-19T18:54:22.687 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph-authtool: stdout AQDeo9NlCcR6BRAAO8aBGHBKAFXRhh+nCczNOw== 2024-02-19T18:54:23.602 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph-authtool: stdout AQDeo9NlKWdtOxAAOq1wCg7MbgHxITmWC3vJgw== 2024-02-19T18:54:24.474 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph-authtool: stdout AQDfo9NlU9tkNBAAg25bDXoUIGZSea8aNVp6mQ== 2024-02-19T18:54:24.475 INFO:teuthology.orchestra.run.smithi096.stdout:Creating initial monmap... 2024-02-19T18:54:25.430 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-19T18:54:25.430 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-02-19T18:54:25.430 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T18:54:25.430 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-19T18:54:25.430 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool for smithi096 [v2:172.21.15.96:3300,v1:172.21.15.96:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-19T18:54:25.430 INFO:teuthology.orchestra.run.smithi096.stdout:setting min_mon_release = pacific 2024-02-19T18:54:25.431 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/monmaptool: set fsid to 06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T18:54:25.431 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-19T18:54:25.431 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:54:25.431 INFO:teuthology.orchestra.run.smithi096.stdout:Creating mon... 2024-02-19T18:54:29.976 INFO:teuthology.orchestra.run.smithi096.stdout:create mon.smithi096 on 2024-02-19T18:54:30.354 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-02-19T18:54:30.611 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-02-19T18:54:31.286 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-06580d2c-cf58-11ee-95bb-87774f69a715.target → /etc/systemd/system/ceph-06580d2c-cf58-11ee-95bb-87774f69a715.target. 2024-02-19T18:54:31.286 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-06580d2c-cf58-11ee-95bb-87774f69a715.target → /etc/systemd/system/ceph-06580d2c-cf58-11ee-95bb-87774f69a715.target. 2024-02-19T18:54:32.129 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-06580d2c-cf58-11ee-95bb-87774f69a715@mon.smithi096 2024-02-19T18:54:32.129 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stderr Failed to reset failed state of unit ceph-06580d2c-cf58-11ee-95bb-87774f69a715@mon.smithi096.service: Unit ceph-06580d2c-cf58-11ee-95bb-87774f69a715@mon.smithi096.service not loaded. 2024-02-19T18:54:32.526 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-06580d2c-cf58-11ee-95bb-87774f69a715.target.wants/ceph-06580d2c-cf58-11ee-95bb-87774f69a715@mon.smithi096.service → /etc/systemd/system/ceph-06580d2c-cf58-11ee-95bb-87774f69a715@.service. 2024-02-19T18:54:33.020 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-19T18:54:33.020 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout disabled 2024-02-19T18:54:33.027 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-19T18:54:33.027 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout inactive 2024-02-19T18:54:33.027 INFO:teuthology.orchestra.run.smithi096.stdout:firewalld.service is not enabled 2024-02-19T18:54:33.027 INFO:teuthology.orchestra.run.smithi096.stdout:Not possible to enable service . firewalld.service is not available 2024-02-19T18:54:33.027 INFO:teuthology.orchestra.run.smithi096.stdout:Waiting for mon to start... 2024-02-19T18:54:33.027 INFO:teuthology.orchestra.run.smithi096.stdout:Waiting for mon... 2024-02-19T18:54:34.004 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout cluster: 2024-02-19T18:54:34.004 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout id: 06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T18:54:34.004 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-02-19T18:54:34.004 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2024-02-19T18:54:34.004 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout services: 2024-02-19T18:54:34.004 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi096 (age 0.515666s) 2024-02-19T18:54:34.004 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-02-19T18:54:34.004 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-02-19T18:54:34.005 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2024-02-19T18:54:34.005 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout data: 2024-02-19T18:54:34.005 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-02-19T18:54:34.005 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-02-19T18:54:34.005 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-02-19T18:54:34.005 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout pgs: 2024-02-19T18:54:34.005 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2024-02-19T18:54:34.005 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.429+0000 7f949a464700 1 Processor -- start 2024-02-19T18:54:34.005 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.429+0000 7f949a464700 1 -- start start 2024-02-19T18:54:34.005 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.430+0000 7f949a464700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9494106430 0x7f9494106850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:34.005 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.430+0000 7f949a464700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9494106e20 con 0x7f9494106430 2024-02-19T18:54:34.005 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.430+0000 7f9493fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9494106430 0x7f9494106850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:34.005 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.430+0000 7f9493fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9494106430 0x7f9494106850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56852/0 (socket says 172.21.15.96:56852) 2024-02-19T18:54:34.006 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.430+0000 7f9493fff700 1 -- 172.21.15.96:0/1505242874 learned_addr learned my addr 172.21.15.96:0/1505242874 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:54:34.006 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.430+0000 7f9493fff700 1 -- 172.21.15.96:0/1505242874 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9494107630 con 0x7f9494106430 2024-02-19T18:54:34.006 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.430+0000 7f9493fff700 1 --2- 172.21.15.96:0/1505242874 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9494106430 0x7f9494106850 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f94880098a0 tx=0x7f9488009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8ea6f6f6ad0651 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:34.006 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.430+0000 7f9492ffd700 1 -- 172.21.15.96:0/1505242874 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9488004180 con 0x7f9494106430 2024-02-19T18:54:34.006 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.430+0000 7f9492ffd700 1 -- 172.21.15.96:0/1505242874 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94880042e0 con 0x7f9494106430 2024-02-19T18:54:34.006 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.430+0000 7f9492ffd700 1 -- 172.21.15.96:0/1505242874 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94880036a0 con 0x7f9494106430 2024-02-19T18:54:34.006 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.431+0000 7f949a464700 1 -- 172.21.15.96:0/1505242874 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9494106430 msgr2=0x7f9494106850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:34.006 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.431+0000 7f949a464700 1 --2- 172.21.15.96:0/1505242874 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9494106430 0x7f9494106850 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f94880098a0 tx=0x7f9488009bb0 comp rx=0 tx=0).stop 2024-02-19T18:54:34.006 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.431+0000 7f949a464700 1 -- 172.21.15.96:0/1505242874 shutdown_connections 2024-02-19T18:54:34.006 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.431+0000 7f949a464700 1 --2- 172.21.15.96:0/1505242874 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9494106430 0x7f9494106850 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:34.006 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.431+0000 7f949a464700 1 -- 172.21.15.96:0/1505242874 >> 172.21.15.96:0/1505242874 conn(0x7f94941019b0 msgr2=0x7f9494103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:34.006 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.431+0000 7f949a464700 1 -- 172.21.15.96:0/1505242874 shutdown_connections 2024-02-19T18:54:34.006 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.431+0000 7f949a464700 1 -- 172.21.15.96:0/1505242874 wait complete. 2024-02-19T18:54:34.006 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.432+0000 7f949a464700 1 Processor -- start 2024-02-19T18:54:34.007 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.432+0000 7f949a464700 1 -- start start 2024-02-19T18:54:34.007 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.432+0000 7f949a464700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9494106430 0x7f94941998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:34.007 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.432+0000 7f949a464700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9494199de0 con 0x7f9494106430 2024-02-19T18:54:34.007 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.432+0000 7f9493fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9494106430 0x7f94941998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:34.007 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.432+0000 7f9493fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9494106430 0x7f94941998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56864/0 (socket says 172.21.15.96:56864) 2024-02-19T18:54:34.007 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.432+0000 7f9493fff700 1 -- 172.21.15.96:0/2651056940 learned_addr learned my addr 172.21.15.96:0/2651056940 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:54:34.007 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.432+0000 7f9493fff700 1 -- 172.21.15.96:0/2651056940 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9488009550 con 0x7f9494106430 2024-02-19T18:54:34.007 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.432+0000 7f9493fff700 1 --2- 172.21.15.96:0/2651056940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9494106430 0x7f94941998a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9488004000 tx=0x7f9488004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:34.007 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.433+0000 7f94917fa700 1 -- 172.21.15.96:0/2651056940 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9488003ce0 con 0x7f9494106430 2024-02-19T18:54:34.007 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.433+0000 7f94917fa700 1 -- 172.21.15.96:0/2651056940 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9488020070 con 0x7f9494106430 2024-02-19T18:54:34.007 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.433+0000 7f949a464700 1 -- 172.21.15.96:0/2651056940 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9494199fe0 con 0x7f9494106430 2024-02-19T18:54:34.007 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.433+0000 7f94917fa700 1 -- 172.21.15.96:0/2651056940 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9488011630 con 0x7f9494106430 2024-02-19T18:54:34.007 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.433+0000 7f949a464700 1 -- 172.21.15.96:0/2651056940 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f949419a480 con 0x7f9494106430 2024-02-19T18:54:34.007 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.433+0000 7f94917fa700 1 -- 172.21.15.96:0/2651056940 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9488022030 con 0x7f9494106430 2024-02-19T18:54:34.007 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.433+0000 7f94917fa700 1 -- 172.21.15.96:0/2651056940 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f948801b450 con 0x7f9494106430 2024-02-19T18:54:34.008 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.434+0000 7f949a464700 1 -- 172.21.15.96:0/2651056940 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9494193170 con 0x7f9494106430 2024-02-19T18:54:34.008 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.436+0000 7f94917fa700 1 -- 172.21.15.96:0/2651056940 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f9488025480 con 0x7f9494106430 2024-02-19T18:54:34.008 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.504+0000 7f949a464700 1 -- 172.21.15.96:0/2651056940 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f949402cea0 con 0x7f9494106430 2024-02-19T18:54:34.008 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.504+0000 7f94917fa700 1 -- 172.21.15.96:0/2651056940 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f9488025620 con 0x7f9494106430 2024-02-19T18:54:34.008 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.505+0000 7f949a464700 1 -- 172.21.15.96:0/2651056940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9494106430 msgr2=0x7f94941998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:34.008 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.505+0000 7f949a464700 1 --2- 172.21.15.96:0/2651056940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9494106430 0x7f94941998a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9488004000 tx=0x7f9488004750 comp rx=0 tx=0).stop 2024-02-19T18:54:34.008 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.505+0000 7f949a464700 1 -- 172.21.15.96:0/2651056940 shutdown_connections 2024-02-19T18:54:34.008 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.505+0000 7f949a464700 1 --2- 172.21.15.96:0/2651056940 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9494106430 0x7f94941998a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:34.008 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.505+0000 7f949a464700 1 -- 172.21.15.96:0/2651056940 >> 172.21.15.96:0/2651056940 conn(0x7f94941019b0 msgr2=0x7f949418ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:34.008 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.505+0000 7f949a464700 1 -- 172.21.15.96:0/2651056940 shutdown_connections 2024-02-19T18:54:34.008 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:33.505+0000 7f949a464700 1 -- 172.21.15.96:0/2651056940 wait complete. 2024-02-19T18:54:34.008 INFO:teuthology.orchestra.run.smithi096.stdout:mon is available 2024-02-19T18:54:34.008 INFO:teuthology.orchestra.run.smithi096.stdout:Assimilating anything we can from ceph.conf... 2024-02-19T18:54:34.032 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:34 smithi096 ceph-mon[28843]: from='client.? 172.21.15.96:0/2651056940' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-19T18:54:34.994 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2024-02-19T18:54:34.994 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout [global] 2024-02-19T18:54:34.994 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout fsid = 06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T18:54:34.994 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.96:3300,v1:172.21.15.96:6789] 2024-02-19T18:54:34.994 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-19T18:54:34.995 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-19T18:54:34.995 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-19T18:54:34.995 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-19T18:54:34.995 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2024-02-19T18:54:34.995 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-19T18:54:34.995 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-19T18:54:34.995 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2024-02-19T18:54:34.995 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout [osd] 2024-02-19T18:54:34.995 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-19T18:54:34.995 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-19T18:54:34.995 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-19T18:54:34.995 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-19T18:54:34.995 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-19T18:54:34.995 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.362+0000 7f245e4bc700 1 Processor -- start 2024-02-19T18:54:34.995 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.362+0000 7f245e4bc700 1 -- start start 2024-02-19T18:54:34.996 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.362+0000 7f245e4bc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2458106420 0x7f2458106840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:34.996 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.362+0000 7f245e4bc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2458106e10 con 0x7f2458106420 2024-02-19T18:54:34.996 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.362+0000 7f2457fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2458106420 0x7f2458106840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:34.996 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.362+0000 7f2457fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2458106420 0x7f2458106840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56866/0 (socket says 172.21.15.96:56866) 2024-02-19T18:54:34.996 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.362+0000 7f2457fff700 1 -- 172.21.15.96:0/2405829260 learned_addr learned my addr 172.21.15.96:0/2405829260 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:54:34.996 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.362+0000 7f2457fff700 1 -- 172.21.15.96:0/2405829260 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2458107620 con 0x7f2458106420 2024-02-19T18:54:34.996 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.362+0000 7f2457fff700 1 --2- 172.21.15.96:0/2405829260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2458106420 0x7f2458106840 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f24400098a0 tx=0x7f2440009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd61e6ba5782ca8 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:34.996 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.363+0000 7f2456ffd700 1 -- 172.21.15.96:0/2405829260 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2440004180 con 0x7f2458106420 2024-02-19T18:54:34.996 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.363+0000 7f2456ffd700 1 -- 172.21.15.96:0/2405829260 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24400042e0 con 0x7f2458106420 2024-02-19T18:54:34.996 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.363+0000 7f2456ffd700 1 -- 172.21.15.96:0/2405829260 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f24400036a0 con 0x7f2458106420 2024-02-19T18:54:34.996 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.363+0000 7f245e4bc700 1 -- 172.21.15.96:0/2405829260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2458106420 msgr2=0x7f2458106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:34.996 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.363+0000 7f245e4bc700 1 --2- 172.21.15.96:0/2405829260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2458106420 0x7f2458106840 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f24400098a0 tx=0x7f2440009bb0 comp rx=0 tx=0).stop 2024-02-19T18:54:34.996 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.363+0000 7f245e4bc700 1 -- 172.21.15.96:0/2405829260 shutdown_connections 2024-02-19T18:54:34.997 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.363+0000 7f245e4bc700 1 --2- 172.21.15.96:0/2405829260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2458106420 0x7f2458106840 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:34.997 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.363+0000 7f245e4bc700 1 -- 172.21.15.96:0/2405829260 >> 172.21.15.96:0/2405829260 conn(0x7f2458101a00 msgr2=0x7f2458103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:34.997 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.363+0000 7f245e4bc700 1 -- 172.21.15.96:0/2405829260 shutdown_connections 2024-02-19T18:54:34.997 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.363+0000 7f245e4bc700 1 -- 172.21.15.96:0/2405829260 wait complete. 2024-02-19T18:54:34.997 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.364+0000 7f245e4bc700 1 Processor -- start 2024-02-19T18:54:34.997 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.364+0000 7f245e4bc700 1 -- start start 2024-02-19T18:54:34.997 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.364+0000 7f245e4bc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2458106420 0x7f2458199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:34.997 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.364+0000 7f245e4bc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2458199dc0 con 0x7f2458106420 2024-02-19T18:54:34.997 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.364+0000 7f2457fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2458106420 0x7f2458199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:34.997 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.364+0000 7f2457fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2458106420 0x7f2458199880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56878/0 (socket says 172.21.15.96:56878) 2024-02-19T18:54:34.997 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.364+0000 7f2457fff700 1 -- 172.21.15.96:0/1224202810 learned_addr learned my addr 172.21.15.96:0/1224202810 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:54:34.997 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.365+0000 7f2457fff700 1 -- 172.21.15.96:0/1224202810 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2440009550 con 0x7f2458106420 2024-02-19T18:54:34.997 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.365+0000 7f2457fff700 1 --2- 172.21.15.96:0/1224202810 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2458106420 0x7f2458199880 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2440004000 tx=0x7f2440004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:34.997 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.365+0000 7f24557fa700 1 -- 172.21.15.96:0/1224202810 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2440003ce0 con 0x7f2458106420 2024-02-19T18:54:34.997 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.365+0000 7f24557fa700 1 -- 172.21.15.96:0/1224202810 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2440020070 con 0x7f2458106420 2024-02-19T18:54:34.998 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.365+0000 7f24557fa700 1 -- 172.21.15.96:0/1224202810 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2440011630 con 0x7f2458106420 2024-02-19T18:54:34.998 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.365+0000 7f245e4bc700 1 -- 172.21.15.96:0/1224202810 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2458199fc0 con 0x7f2458106420 2024-02-19T18:54:34.998 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.365+0000 7f245e4bc700 1 -- 172.21.15.96:0/1224202810 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245819a460 con 0x7f2458106420 2024-02-19T18:54:34.998 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.365+0000 7f24557fa700 1 -- 172.21.15.96:0/1224202810 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2440022030 con 0x7f2458106420 2024-02-19T18:54:34.998 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.365+0000 7f24557fa700 1 -- 172.21.15.96:0/1224202810 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2440025d40 con 0x7f2458106420 2024-02-19T18:54:34.998 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.366+0000 7f245e4bc700 1 -- 172.21.15.96:0/1224202810 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2458193160 con 0x7f2458106420 2024-02-19T18:54:34.998 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.368+0000 7f24557fa700 1 -- 172.21.15.96:0/1224202810 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f2440025480 con 0x7f2458106420 2024-02-19T18:54:34.998 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.435+0000 7f245e4bc700 1 -- 172.21.15.96:0/1224202810 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f245802cf20 con 0x7f2458106420 2024-02-19T18:54:34.998 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.439+0000 7f24557fa700 1 -- 172.21.15.96:0/1224202810 <== mon.0 v2:172.21.15.96:3300/0 7 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f2440011bd0 con 0x7f2458106420 2024-02-19T18:54:34.998 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.439+0000 7f24557fa700 1 -- 172.21.15.96:0/1224202810 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f2440036020 con 0x7f2458106420 2024-02-19T18:54:34.998 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.440+0000 7f245e4bc700 1 -- 172.21.15.96:0/1224202810 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2458106420 msgr2=0x7f2458199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:34.998 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.440+0000 7f245e4bc700 1 --2- 172.21.15.96:0/1224202810 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2458106420 0x7f2458199880 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f2440004000 tx=0x7f2440004750 comp rx=0 tx=0).stop 2024-02-19T18:54:34.998 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.440+0000 7f245e4bc700 1 -- 172.21.15.96:0/1224202810 shutdown_connections 2024-02-19T18:54:34.998 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.440+0000 7f245e4bc700 1 --2- 172.21.15.96:0/1224202810 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2458106420 0x7f2458199880 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:34.998 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.440+0000 7f245e4bc700 1 -- 172.21.15.96:0/1224202810 >> 172.21.15.96:0/1224202810 conn(0x7f2458101a00 msgr2=0x7f245818dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:34.999 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.440+0000 7f245e4bc700 1 -- 172.21.15.96:0/1224202810 shutdown_connections 2024-02-19T18:54:34.999 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:34.440+0000 7f245e4bc700 1 -- 172.21.15.96:0/1224202810 wait complete. 2024-02-19T18:54:34.999 INFO:teuthology.orchestra.run.smithi096.stdout:Generating new minimal ceph.conf... 2024-02-19T18:54:35.282 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:35 smithi096 ceph-mon[28843]: from='client.? 172.21.15.96:0/1224202810' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-19T18:54:35.283 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:35 smithi096 ceph-mon[28843]: from='client.? 172.21.15.96:0/1224202810' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-19T18:54:36.158 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:36 smithi096 ceph-mon[28843]: from='client.? 172.21.15.96:0/3029477633' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:54:36.165 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.514+0000 7fb0fb0c0700 1 Processor -- start 2024-02-19T18:54:36.165 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.514+0000 7fb0fb0c0700 1 -- start start 2024-02-19T18:54:36.165 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.514+0000 7fb0fb0c0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0f4106420 0x7fb0f4106840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:36.165 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.514+0000 7fb0fb0c0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4106e10 con 0x7fb0f4106420 2024-02-19T18:54:36.165 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.514+0000 7fb0f8e5c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0f4106420 0x7fb0f4106840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:36.165 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.514+0000 7fb0f8e5c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0f4106420 0x7fb0f4106840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56884/0 (socket says 172.21.15.96:56884) 2024-02-19T18:54:36.166 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.514+0000 7fb0f8e5c700 1 -- 172.21.15.96:0/1673236682 learned_addr learned my addr 172.21.15.96:0/1673236682 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:54:36.166 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.515+0000 7fb0f8e5c700 1 -- 172.21.15.96:0/1673236682 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f4107620 con 0x7fb0f4106420 2024-02-19T18:54:36.166 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.515+0000 7fb0f8e5c700 1 --2- 172.21.15.96:0/1673236682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0f4106420 0x7fb0f4106840 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb0e80098a0 tx=0x7fb0e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3136e78352963ce server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:36.166 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.515+0000 7fb0f37fe700 1 -- 172.21.15.96:0/1673236682 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0e8004180 con 0x7fb0f4106420 2024-02-19T18:54:36.166 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.515+0000 7fb0f37fe700 1 -- 172.21.15.96:0/1673236682 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb0e80042e0 con 0x7fb0f4106420 2024-02-19T18:54:36.166 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.515+0000 7fb0f37fe700 1 -- 172.21.15.96:0/1673236682 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0e8011a50 con 0x7fb0f4106420 2024-02-19T18:54:36.166 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.515+0000 7fb0fb0c0700 1 -- 172.21.15.96:0/1673236682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0f4106420 msgr2=0x7fb0f4106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:36.166 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.515+0000 7fb0fb0c0700 1 --2- 172.21.15.96:0/1673236682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0f4106420 0x7fb0f4106840 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb0e80098a0 tx=0x7fb0e8009bb0 comp rx=0 tx=0).stop 2024-02-19T18:54:36.166 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.515+0000 7fb0fb0c0700 1 -- 172.21.15.96:0/1673236682 shutdown_connections 2024-02-19T18:54:36.166 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.515+0000 7fb0fb0c0700 1 --2- 172.21.15.96:0/1673236682 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0f4106420 0x7fb0f4106840 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:36.166 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.515+0000 7fb0fb0c0700 1 -- 172.21.15.96:0/1673236682 >> 172.21.15.96:0/1673236682 conn(0x7fb0f4101a00 msgr2=0x7fb0f4103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:36.166 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.516+0000 7fb0fb0c0700 1 -- 172.21.15.96:0/1673236682 shutdown_connections 2024-02-19T18:54:36.166 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.516+0000 7fb0fb0c0700 1 -- 172.21.15.96:0/1673236682 wait complete. 2024-02-19T18:54:36.166 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.516+0000 7fb0fb0c0700 1 Processor -- start 2024-02-19T18:54:36.166 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.516+0000 7fb0fb0c0700 1 -- start start 2024-02-19T18:54:36.167 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.516+0000 7fb0fb0c0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0f4106420 0x7fb0f419a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:36.167 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.516+0000 7fb0fb0c0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f419a5f0 con 0x7fb0f4106420 2024-02-19T18:54:36.167 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.516+0000 7fb0f8e5c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0f4106420 0x7fb0f419a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:36.167 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.516+0000 7fb0f8e5c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0f4106420 0x7fb0f419a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56890/0 (socket says 172.21.15.96:56890) 2024-02-19T18:54:36.167 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.516+0000 7fb0f8e5c700 1 -- 172.21.15.96:0/3029477633 learned_addr learned my addr 172.21.15.96:0/3029477633 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:54:36.167 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.517+0000 7fb0f8e5c700 1 -- 172.21.15.96:0/3029477633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e8009550 con 0x7fb0f4106420 2024-02-19T18:54:36.167 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.517+0000 7fb0f8e5c700 1 --2- 172.21.15.96:0/3029477633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0f4106420 0x7fb0f419a0b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8006af0 tx=0x7fb0e8011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:36.167 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.517+0000 7fb0f1ffb700 1 -- 172.21.15.96:0/3029477633 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0e8003b90 con 0x7fb0f4106420 2024-02-19T18:54:36.167 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.517+0000 7fb0f1ffb700 1 -- 172.21.15.96:0/3029477633 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb0e801a8a0 con 0x7fb0f4106420 2024-02-19T18:54:36.167 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.517+0000 7fb0fb0c0700 1 -- 172.21.15.96:0/3029477633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f419a7f0 con 0x7fb0f4106420 2024-02-19T18:54:36.167 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.517+0000 7fb0f1ffb700 1 -- 172.21.15.96:0/3029477633 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0e8019880 con 0x7fb0f4106420 2024-02-19T18:54:36.167 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.517+0000 7fb0fb0c0700 1 -- 172.21.15.96:0/3029477633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f419ac90 con 0x7fb0f4106420 2024-02-19T18:54:36.167 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.517+0000 7fb0f1ffb700 1 -- 172.21.15.96:0/3029477633 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb0e802d440 con 0x7fb0f4106420 2024-02-19T18:54:36.167 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.517+0000 7fb0f1ffb700 1 -- 172.21.15.96:0/3029477633 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb0e8024860 con 0x7fb0f4106420 2024-02-19T18:54:36.167 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.518+0000 7fb0fb0c0700 1 -- 172.21.15.96:0/3029477633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f40623c0 con 0x7fb0f4106420 2024-02-19T18:54:36.168 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.520+0000 7fb0f1ffb700 1 -- 172.21.15.96:0/3029477633 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fb0e801aa10 con 0x7fb0f4106420 2024-02-19T18:54:36.168 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.586+0000 7fb0fb0c0700 1 -- 172.21.15.96:0/3029477633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fb0f410a8d0 con 0x7fb0f4106420 2024-02-19T18:54:36.168 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.587+0000 7fb0f1ffb700 1 -- 172.21.15.96:0/3029477633 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fb0e801abb0 con 0x7fb0f4106420 2024-02-19T18:54:36.168 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.587+0000 7fb0fb0c0700 1 -- 172.21.15.96:0/3029477633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0f4106420 msgr2=0x7fb0f419a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:36.168 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.588+0000 7fb0fb0c0700 1 --2- 172.21.15.96:0/3029477633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0f4106420 0x7fb0f419a0b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8006af0 tx=0x7fb0e8011a90 comp rx=0 tx=0).stop 2024-02-19T18:54:36.168 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.588+0000 7fb0fb0c0700 1 -- 172.21.15.96:0/3029477633 shutdown_connections 2024-02-19T18:54:36.168 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.588+0000 7fb0fb0c0700 1 --2- 172.21.15.96:0/3029477633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0f4106420 0x7fb0f419a0b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:36.168 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.588+0000 7fb0fb0c0700 1 -- 172.21.15.96:0/3029477633 >> 172.21.15.96:0/3029477633 conn(0x7fb0f4101a00 msgr2=0x7fb0f41027f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:36.168 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.588+0000 7fb0fb0c0700 1 -- 172.21.15.96:0/3029477633 shutdown_connections 2024-02-19T18:54:36.168 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:35.588+0000 7fb0fb0c0700 1 -- 172.21.15.96:0/3029477633 wait complete. 2024-02-19T18:54:36.168 INFO:teuthology.orchestra.run.smithi096.stdout:Restarting the monitor... 2024-02-19T18:54:36.428 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:36 smithi096 systemd[1]: Stopping Ceph mon.smithi096 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T18:54:36.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:36 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096[28838]: 2024-02-19T18:54:36.410+0000 7eff87a95700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi096 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T18:54:36.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:36 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096[28838]: 2024-02-19T18:54:36.410+0000 7eff87a95700 -1 mon.smithi096@0(leader) e1 *** Got Signal Terminated *** 2024-02-19T18:54:36.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:36 smithi096 podman[29086]: 2024-02-19 18:54:36.555036814 +0000 UTC m=+0.240285181 container died cadd10c293a37eef1de34e6c3704890824544b71be7ee2e240cb9f08bfca266f (image=quay.io/ceph/ceph:v18.2.1, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=-18.2.1, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-02-19T18:54:37.137 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:36 smithi096 podman[29086]: 2024-02-19 18:54:36.978327309 +0000 UTC m=+0.663575679 container cleanup cadd10c293a37eef1de34e6c3704890824544b71be7ee2e240cb9f08bfca266f (image=quay.io/ceph/ceph:v18.2.1, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240214, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.1) 2024-02-19T18:54:37.137 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:36 smithi096 bash[29086]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096 2024-02-19T18:54:37.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:37 smithi096 podman[29100]: 2024-02-19 18:54:37.121211675 +0000 UTC m=+0.561787413 container remove cadd10c293a37eef1de34e6c3704890824544b71be7ee2e240cb9f08bfca266f (image=quay.io/ceph/ceph:v18.2.1, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.1, io.buildah.version=1.29.1, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, RELEASE=HEAD, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-02-19T18:54:37.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:37 smithi096 systemd[1]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715@mon.smithi096.service: Deactivated successfully. 2024-02-19T18:54:37.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:37 smithi096 systemd[1]: Stopped Ceph mon.smithi096 for 06580d2c-cf58-11ee-95bb-87774f69a715. 2024-02-19T18:54:37.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:37 smithi096 systemd[1]: Starting Ceph mon.smithi096 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T18:54:38.032 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:37 smithi096 podman[29197]: 2024-02-19 18:54:37.434494862 +0000 UTC m=+0.017298041 image pull 94eadd990e0a5619d90a7220f97c70d1fe3558d9b0fb9e0c1935661dd49a6d5f quay.io/ceph/ceph:v18.2.1 2024-02-19T18:54:39.033 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:38 smithi096 podman[29197]: 2024-02-19 18:54:38.551607331 +0000 UTC m=+1.134410552 container create 23d5b9626c48850f499130afab4722d7c99671c927866e99e03ea33f55882e80 (image=quay.io/ceph/ceph:v18.2.1, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.1, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, GIT_CLEAN=True, RELEASE=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0) 2024-02-19T18:54:40.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 podman[29197]: 2024-02-19 18:54:40.258472965 +0000 UTC m=+2.841276143 container init 23d5b9626c48850f499130afab4722d7c99671c927866e99e03ea33f55882e80 (image=quay.io/ceph/ceph:v18.2.1, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.1, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-02-19T18:54:40.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 podman[29197]: 2024-02-19 18:54:40.262674657 +0000 UTC m=+2.845477838 container start 23d5b9626c48850f499130afab4722d7c99671c927866e99e03ea33f55882e80 (image=quay.io/ceph/ceph:v18.2.1, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.1, RELEASE=HEAD, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240214) 2024-02-19T18:54:40.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: set uid:gid to 167:167 (ceph:ceph) 2024-02-19T18:54:40.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable), process ceph-mon, pid 2 2024-02-19T18:54:40.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: pidfile_write: ignore empty --pid-file 2024-02-19T18:54:40.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: load: jerasure load: lrc 2024-02-19T18:54:40.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: RocksDB version: 7.9.2 2024-02-19T18:54:40.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Git sha 0 2024-02-19T18:54:40.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Compile date 2023-12-11 22:07:34 2024-02-19T18:54:40.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: DB SUMMARY 2024-02-19T18:54:40.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: DB Session ID: EPH7XZB5TM7719BIQSJB 2024-02-19T18:54:40.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: CURRENT file: CURRENT 2024-02-19T18:54:40.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: IDENTITY file: IDENTITY 2024-02-19T18:54:40.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-02-19T18:54:40.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi096/store.db dir, Total Num: 1, files: 000008.sst 2024-02-19T18:54:40.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi096/store.db: 000009.log size: 97488 ; 2024-02-19T18:54:40.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.error_if_exists: 0 2024-02-19T18:54:40.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.create_if_missing: 0 2024-02-19T18:54:40.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.paranoid_checks: 1 2024-02-19T18:54:40.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-19T18:54:40.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-19T18:54:40.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-19T18:54:40.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.env: 0x5647ddf31720 2024-02-19T18:54:40.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.fs: PosixFileSystem 2024-02-19T18:54:40.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.info_log: 0x5647e14192e0 2024-02-19T18:54:40.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_file_opening_threads: 16 2024-02-19T18:54:40.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.statistics: (nil) 2024-02-19T18:54:40.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.use_fsync: 0 2024-02-19T18:54:40.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_log_file_size: 0 2024-02-19T18:54:40.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-19T18:54:40.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-19T18:54:40.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.keep_log_file_num: 1000 2024-02-19T18:54:40.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.recycle_log_file_num: 0 2024-02-19T18:54:40.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.allow_fallocate: 1 2024-02-19T18:54:40.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.allow_mmap_reads: 0 2024-02-19T18:54:40.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.allow_mmap_writes: 0 2024-02-19T18:54:40.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.use_direct_reads: 0 2024-02-19T18:54:40.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-19T18:54:40.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.create_missing_column_families: 0 2024-02-19T18:54:40.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.db_log_dir: 2024-02-19T18:54:40.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.wal_dir: 2024-02-19T18:54:40.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-19T18:54:40.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-19T18:54:40.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-19T18:54:40.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-19T18:54:40.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-19T18:54:40.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-19T18:54:40.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.advise_random_on_open: 1 2024-02-19T18:54:40.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.db_write_buffer_size: 0 2024-02-19T18:54:40.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.write_buffer_manager: 0x5647e068a140 2024-02-19T18:54:40.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-19T18:54:40.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-19T18:54:40.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-19T18:54:40.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.rate_limiter: (nil) 2024-02-19T18:54:40.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-19T18:54:40.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.wal_recovery_mode: 2 2024-02-19T18:54:40.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.enable_thread_tracking: 0 2024-02-19T18:54:40.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.enable_pipelined_write: 0 2024-02-19T18:54:40.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.unordered_write: 0 2024-02-19T18:54:40.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-19T18:54:40.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-19T18:54:40.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-19T18:54:40.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-19T18:54:40.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.row_cache: None 2024-02-19T18:54:40.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.wal_filter: None 2024-02-19T18:54:40.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-19T18:54:40.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.allow_ingest_behind: 0 2024-02-19T18:54:40.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.two_write_queues: 0 2024-02-19T18:54:40.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.manual_wal_flush: 0 2024-02-19T18:54:40.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.wal_compression: 0 2024-02-19T18:54:40.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.atomic_flush: 0 2024-02-19T18:54:40.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-19T18:54:40.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-19T18:54:40.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-19T18:54:40.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.log_readahead_size: 0 2024-02-19T18:54:40.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-19T18:54:40.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.best_efforts_recovery: 0 2024-02-19T18:54:40.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-19T18:54:40.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-19T18:54:40.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.allow_data_in_errors: 0 2024-02-19T18:54:40.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.db_host_id: __hostname__ 2024-02-19T18:54:40.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-19T18:54:40.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_background_jobs: 2 2024-02-19T18:54:40.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_background_compactions: -1 2024-02-19T18:54:40.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_subcompactions: 1 2024-02-19T18:54:40.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-19T18:54:40.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-19T18:54:40.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-19T18:54:40.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_total_wal_size: 0 2024-02-19T18:54:40.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-19T18:54:40.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-19T18:54:40.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-19T18:54:40.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-19T18:54:40.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_open_files: -1 2024-02-19T18:54:40.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.bytes_per_sync: 0 2024-02-19T18:54:40.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-19T18:54:40.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-19T18:54:40.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compaction_readahead_size: 0 2024-02-19T18:54:40.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_background_flushes: -1 2024-02-19T18:54:40.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Compression algorithms supported: 2024-02-19T18:54:40.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-19T18:54:40.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: kZSTD supported: 0 2024-02-19T18:54:40.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: kXpressCompression supported: 0 2024-02-19T18:54:40.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: kLZ4HCCompression supported: 1 2024-02-19T18:54:40.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: kZlibCompression supported: 1 2024-02-19T18:54:40.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: kSnappyCompression supported: 1 2024-02-19T18:54:40.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: kLZ4Compression supported: 1 2024-02-19T18:54:40.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: kBZip2Compression supported: 0 2024-02-19T18:54:40.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-19T18:54:40.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-19T18:54:40.543 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi096/store.db/MANIFEST-000010 2024-02-19T18:54:40.543 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-19T18:54:40.543 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-19T18:54:40.543 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.merge_operator: 2024-02-19T18:54:40.543 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compaction_filter: None 2024-02-19T18:54:40.543 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compaction_filter_factory: None 2024-02-19T18:54:40.543 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.sst_partitioner_factory: None 2024-02-19T18:54:40.543 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-19T18:54:40.543 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-19T18:54:40.543 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5647e14193e0) 2024-02-19T18:54:40.543 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: cache_index_and_filter_blocks: 1 2024-02-19T18:54:40.543 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-19T18:54:40.543 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-19T18:54:40.543 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: pin_top_level_index_and_filter: 1 2024-02-19T18:54:40.543 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: index_type: 0 2024-02-19T18:54:40.544 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: data_block_index_type: 0 2024-02-19T18:54:40.544 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: index_shortening: 1 2024-02-19T18:54:40.544 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-19T18:54:40.544 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: checksum: 4 2024-02-19T18:54:40.544 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: no_block_cache: 0 2024-02-19T18:54:40.544 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_cache: 0x5647e072b1f0 2024-02-19T18:54:40.544 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_cache_name: BinnedLRUCache 2024-02-19T18:54:40.544 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_cache_options: 2024-02-19T18:54:40.544 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: capacity : 536870912 2024-02-19T18:54:40.544 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: num_shard_bits : 4 2024-02-19T18:54:40.544 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: strict_capacity_limit : 0 2024-02-19T18:54:40.544 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: high_pri_pool_ratio: 0.000 2024-02-19T18:54:40.544 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_cache_compressed: (nil) 2024-02-19T18:54:40.544 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: persistent_cache: (nil) 2024-02-19T18:54:40.545 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_size: 4096 2024-02-19T18:54:40.545 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_size_deviation: 10 2024-02-19T18:54:40.545 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_restart_interval: 16 2024-02-19T18:54:40.545 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: index_block_restart_interval: 1 2024-02-19T18:54:40.545 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: metadata_block_size: 4096 2024-02-19T18:54:40.545 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: partition_filters: 0 2024-02-19T18:54:40.545 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: use_delta_encoding: 1 2024-02-19T18:54:40.545 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: filter_policy: bloomfilter 2024-02-19T18:54:40.545 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: whole_key_filtering: 1 2024-02-19T18:54:40.545 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: verify_compression: 0 2024-02-19T18:54:40.545 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: read_amp_bytes_per_bit: 0 2024-02-19T18:54:40.545 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: format_version: 5 2024-02-19T18:54:40.545 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: enable_index_compression: 1 2024-02-19T18:54:40.545 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_align: 0 2024-02-19T18:54:40.545 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: max_auto_readahead_size: 262144 2024-02-19T18:54:40.545 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: prepopulate_block_cache: 0 2024-02-19T18:54:40.546 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: initial_auto_readahead_size: 8192 2024-02-19T18:54:40.546 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: num_file_reads_for_auto_readahead: 2 2024-02-19T18:54:40.546 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.write_buffer_size: 33554432 2024-02-19T18:54:40.546 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_write_buffer_number: 2 2024-02-19T18:54:40.546 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compression: NoCompression 2024-02-19T18:54:40.546 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.bottommost_compression: Disabled 2024-02-19T18:54:40.546 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.prefix_extractor: nullptr 2024-02-19T18:54:40.546 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-19T18:54:40.546 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.num_levels: 7 2024-02-19T18:54:40.546 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-19T18:54:40.546 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-19T18:54:40.546 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-19T18:54:40.546 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-19T18:54:40.546 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-19T18:54:40.546 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-19T18:54:40.547 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-19T18:54:40.547 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-19T18:54:40.547 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-19T18:54:40.547 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-19T18:54:40.547 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-19T18:54:40.547 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-19T18:54:40.547 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-19T18:54:40.547 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compression_opts.level: 32767 2024-02-19T18:54:40.547 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compression_opts.strategy: 0 2024-02-19T18:54:40.547 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-19T18:54:40.547 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-19T18:54:40.547 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-19T18:54:40.547 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-19T18:54:40.547 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compression_opts.enabled: false 2024-02-19T18:54:40.547 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-19T18:54:40.547 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-19T18:54:40.548 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-19T18:54:40.548 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-19T18:54:40.548 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.target_file_size_base: 67108864 2024-02-19T18:54:40.548 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-19T18:54:40.548 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-19T18:54:40.548 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-19T18:54:40.548 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-19T18:54:40.548 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-19T18:54:40.548 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-19T18:54:40.548 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-19T18:54:40.548 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-19T18:54:40.548 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-19T18:54:40.548 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-19T18:54:40.548 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-19T18:54:40.548 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-19T18:54:40.549 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-19T18:54:40.549 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-19T18:54:40.549 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.arena_block_size: 1048576 2024-02-19T18:54:40.549 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-19T18:54:40.549 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-19T18:54:40.549 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.disable_auto_compactions: 0 2024-02-19T18:54:40.549 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-19T18:54:40.549 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-19T18:54:40.549 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-19T18:54:40.549 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-19T18:54:40.549 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-19T18:54:40.549 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-19T18:54:40.549 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-19T18:54:40.549 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-19T18:54:40.549 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-19T18:54:40.549 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-19T18:54:40.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.table_properties_collectors: 2024-02-19T18:54:40.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.inplace_update_support: 0 2024-02-19T18:54:40.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-19T18:54:40.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-19T18:54:40.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-19T18:54:40.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-19T18:54:40.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.bloom_locality: 0 2024-02-19T18:54:40.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.max_successive_merges: 0 2024-02-19T18:54:40.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-19T18:54:40.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.paranoid_file_checks: 0 2024-02-19T18:54:40.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.force_consistency_checks: 1 2024-02-19T18:54:40.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.report_bg_io_stats: 0 2024-02-19T18:54:40.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.ttl: 2592000 2024-02-19T18:54:40.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-19T18:54:40.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-19T18:54:40.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-19T18:54:40.550 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.enable_blob_files: false 2024-02-19T18:54:40.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.min_blob_size: 0 2024-02-19T18:54:40.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.blob_file_size: 268435456 2024-02-19T18:54:40.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-19T18:54:40.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-19T18:54:40.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-19T18:54:40.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-19T18:54:40.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-19T18:54:40.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.blob_file_starting_level: 0 2024-02-19T18:54:40.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-19T18:54:40.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi096/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-02-19T18:54:40.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-02-19T18:54:40.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 69a6b136-c85f-416a-8963-0ad95b29c42d 2024-02-19T18:54:40.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708368880295910, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-02-19T18:54:40.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-02-19T18:54:40.551 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708368880297036, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 92838, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 310, "table_properties": {"data_size": 90855, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13356, "raw_average_key_size": 49, "raw_value_size": 83570, "raw_average_value_size": 310, "num_data_blocks": 11, "num_entries": 269, "num_filter_entries": 269, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1708368880, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "69a6b136-c85f-416a-8963-0ad95b29c42d", "db_session_id": "EPH7XZB5TM7719BIQSJB", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-02-19T18:54:40.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708368880297134, "job": 1, "event": "recovery_finished"} 2024-02-19T18:54:40.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-02-19T18:54:40.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi096/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-19T18:54:40.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5647e07c8000 2024-02-19T18:54:40.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: DB pointer 0x5647e07b4000 2024-02-19T18:54:40.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-19T18:54:40.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-19T18:54:40.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: ** DB Stats ** 2024-02-19T18:54:40.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T18:54:40.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-19T18:54:40.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-19T18:54:40.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T18:54:40.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-19T18:54:40.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-19T18:54:40.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T18:54:40.552 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2024-02-19T18:54:40.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: ** Compaction Stats [default] ** 2024-02-19T18:54:40.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-19T18:54:40.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-19T18:54:40.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: L0 2/0 92.54 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 118.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-19T18:54:40.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Sum 2/0 92.54 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 118.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-19T18:54:40.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 118.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-19T18:54:40.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2024-02-19T18:54:40.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: ** Compaction Stats [default] ** 2024-02-19T18:54:40.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-19T18:54:40.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T18:54:40.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 118.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-19T18:54:40.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2024-02-19T18:54:40.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-19T18:54:40.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2024-02-19T18:54:40.553 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T18:54:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-19T18:54:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-19T18:54:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-19T18:54:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-19T18:54:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-19T18:54:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Cumulative compaction: 0.00 GB write, 25.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T18:54:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Interval compaction: 0.00 GB write, 25.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T18:54:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-19T18:54:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Block cache BinnedLRUCache@0x5647e072b1f0#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-02-19T18:54:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-02-19T18:54:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2024-02-19T18:54:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-19T18:54:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: starting mon.smithi096 rank 0 at public addrs [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] at bind addrs [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi096 fsid 06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T18:54:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: mon.smithi096@-1(???) e1 preinit fsid 06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T18:54:40.554 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: mon.smithi096@-1(???).mds e1 new map 2024-02-19T18:54:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: mon.smithi096@-1(???).mds e1 print_map 2024-02-19T18:54:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: e1 2024-02-19T18:54:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T18:54:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T18:54:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: legacy client fscid: -1 2024-02-19T18:54:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2024-02-19T18:54:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: No filesystems configured 2024-02-19T18:54:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: mon.smithi096@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-19T18:54:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: mon.smithi096@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T18:54:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: mon.smithi096@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T18:54:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: mon.smithi096@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T18:54:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: mon.smithi096@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-19T18:54:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: expand_channel_meta expand map: {default=false} 2024-02-19T18:54:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: expand_channel_meta from 'false' to 'false' 2024-02-19T18:54:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: expand_channel_meta expanded map: {default=false} 2024-02-19T18:54:40.555 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: expand_channel_meta expand map: {default=info} 2024-02-19T18:54:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: expand_channel_meta from 'info' to 'info' 2024-02-19T18:54:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: expand_channel_meta expanded map: {default=info} 2024-02-19T18:54:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: expand_channel_meta expand map: {default=daemon} 2024-02-19T18:54:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: expand_channel_meta from 'daemon' to 'daemon' 2024-02-19T18:54:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: expand_channel_meta expanded map: {default=daemon} 2024-02-19T18:54:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: expand_channel_meta expand map: {default=debug} 2024-02-19T18:54:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: expand_channel_meta from 'debug' to 'debug' 2024-02-19T18:54:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: expand_channel_meta expanded map: {default=debug} 2024-02-19T18:54:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: mon.smithi096 is new leader, mons smithi096 in quorum (ranks 0) 2024-02-19T18:54:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: monmap e1: 1 mons at {smithi096=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-19T18:54:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: fsmap 2024-02-19T18:54:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: osdmap e1: 0 total, 0 up, 0 in 2024-02-19T18:54:40.556 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:40 smithi096 ceph-mon[29216]: mgrmap e1: no daemons active 2024-02-19T18:54:41.134 INFO:teuthology.orchestra.run.smithi096.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-02-19T18:54:41.381 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:41 smithi096 bash[29197]: 23d5b9626c48850f499130afab4722d7c99671c927866e99e03ea33f55882e80 2024-02-19T18:54:41.381 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:41 smithi096 systemd[1]: Started Ceph mon.smithi096 for 06580d2c-cf58-11ee-95bb-87774f69a715. 2024-02-19T18:54:42.160 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.576+0000 7efd0da5a700 1 Processor -- start 2024-02-19T18:54:42.160 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.577+0000 7efd0da5a700 1 -- start start 2024-02-19T18:54:42.160 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.577+0000 7efd0da5a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd08106430 0x7efd08106850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:42.160 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.577+0000 7efd0da5a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd08106e20 con 0x7efd08106430 2024-02-19T18:54:42.160 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.577+0000 7efd06ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd08106430 0x7efd08106850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:42.160 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.577+0000 7efd06ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd08106430 0x7efd08106850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56894/0 (socket says 172.21.15.96:56894) 2024-02-19T18:54:42.160 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.577+0000 7efd06ffd700 1 -- 172.21.15.96:0/68177152 learned_addr learned my addr 172.21.15.96:0/68177152 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:54:42.161 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.577+0000 7efd06ffd700 1 -- 172.21.15.96:0/68177152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd08107630 con 0x7efd08106430 2024-02-19T18:54:42.161 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.577+0000 7efd06ffd700 1 --2- 172.21.15.96:0/68177152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd08106430 0x7efd08106850 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efcfc0098a0 tx=0x7efcfc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbf2ba9c29b0cb1 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:42.161 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.578+0000 7efd05ffb700 1 -- 172.21.15.96:0/68177152 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcfc004180 con 0x7efd08106430 2024-02-19T18:54:42.161 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.578+0000 7efd05ffb700 1 -- 172.21.15.96:0/68177152 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7efcfc0042e0 con 0x7efd08106430 2024-02-19T18:54:42.161 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.578+0000 7efd05ffb700 1 -- 172.21.15.96:0/68177152 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcfc011a50 con 0x7efd08106430 2024-02-19T18:54:42.161 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.578+0000 7efd0da5a700 1 -- 172.21.15.96:0/68177152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd08106430 msgr2=0x7efd08106850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:42.161 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.578+0000 7efd0da5a700 1 --2- 172.21.15.96:0/68177152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd08106430 0x7efd08106850 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7efcfc0098a0 tx=0x7efcfc009bb0 comp rx=0 tx=0).stop 2024-02-19T18:54:42.161 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.578+0000 7efd0da5a700 1 -- 172.21.15.96:0/68177152 shutdown_connections 2024-02-19T18:54:42.161 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.578+0000 7efd0da5a700 1 --2- 172.21.15.96:0/68177152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd08106430 0x7efd08106850 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:42.161 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.578+0000 7efd0da5a700 1 -- 172.21.15.96:0/68177152 >> 172.21.15.96:0/68177152 conn(0x7efd081019d0 msgr2=0x7efd08103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:42.161 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.579+0000 7efd0da5a700 1 -- 172.21.15.96:0/68177152 shutdown_connections 2024-02-19T18:54:42.161 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.579+0000 7efd0da5a700 1 -- 172.21.15.96:0/68177152 wait complete. 2024-02-19T18:54:42.161 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.579+0000 7efd0da5a700 1 Processor -- start 2024-02-19T18:54:42.161 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.579+0000 7efd0da5a700 1 -- start start 2024-02-19T18:54:42.161 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.580+0000 7efd0da5a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd08106430 0x7efd0807bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:42.162 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.580+0000 7efd0da5a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0807c1a0 con 0x7efd08106430 2024-02-19T18:54:42.162 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.580+0000 7efd06ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd08106430 0x7efd0807bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:42.162 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.580+0000 7efd06ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd08106430 0x7efd0807bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56906/0 (socket says 172.21.15.96:56906) 2024-02-19T18:54:42.162 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.580+0000 7efd06ffd700 1 -- 172.21.15.96:0/842004961 learned_addr learned my addr 172.21.15.96:0/842004961 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:54:42.162 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.580+0000 7efd06ffd700 1 -- 172.21.15.96:0/842004961 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcfc009550 con 0x7efd08106430 2024-02-19T18:54:42.162 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.580+0000 7efd06ffd700 1 --2- 172.21.15.96:0/842004961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd08106430 0x7efd0807bc60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009520 tx=0x7efcfc011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:42.162 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.580+0000 7efd0ca58700 1 -- 172.21.15.96:0/842004961 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcfc003a80 con 0x7efd08106430 2024-02-19T18:54:42.162 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.580+0000 7efd0ca58700 1 -- 172.21.15.96:0/842004961 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7efcfc003be0 con 0x7efd08106430 2024-02-19T18:54:42.162 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.580+0000 7efd0ca58700 1 -- 172.21.15.96:0/842004961 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcfc0197b0 con 0x7efd08106430 2024-02-19T18:54:42.162 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.580+0000 7efd0da5a700 1 -- 172.21.15.96:0/842004961 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0807a2b0 con 0x7efd08106430 2024-02-19T18:54:42.162 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.580+0000 7efd0da5a700 1 -- 172.21.15.96:0/842004961 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0807a750 con 0x7efd08106430 2024-02-19T18:54:42.162 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.581+0000 7efd0ca58700 1 -- 172.21.15.96:0/842004961 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efcfc019d20 con 0x7efd08106430 2024-02-19T18:54:42.162 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.581+0000 7efd0ca58700 1 -- 172.21.15.96:0/842004961 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7efcfc024800 con 0x7efd08106430 2024-02-19T18:54:42.162 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.581+0000 7efd0da5a700 1 -- 172.21.15.96:0/842004961 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd080623c0 con 0x7efd08106430 2024-02-19T18:54:42.162 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.584+0000 7efd0ca58700 1 -- 172.21.15.96:0/842004961 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7efcfc01ac30 con 0x7efd08106430 2024-02-19T18:54:42.162 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.649+0000 7efd0da5a700 1 -- 172.21.15.96:0/842004961 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7efd081a01f0 con 0x7efd08106430 2024-02-19T18:54:42.162 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.651+0000 7efd0ca58700 1 -- 172.21.15.96:0/842004961 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7efcfc005a20 con 0x7efd08106430 2024-02-19T18:54:42.163 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.652+0000 7efd0da5a700 1 -- 172.21.15.96:0/842004961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd08106430 msgr2=0x7efd0807bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:42.163 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.652+0000 7efd0da5a700 1 --2- 172.21.15.96:0/842004961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd08106430 0x7efd0807bc60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009520 tx=0x7efcfc011ab0 comp rx=0 tx=0).stop 2024-02-19T18:54:42.163 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.652+0000 7efd0da5a700 1 -- 172.21.15.96:0/842004961 shutdown_connections 2024-02-19T18:54:42.163 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.652+0000 7efd0da5a700 1 --2- 172.21.15.96:0/842004961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd08106430 0x7efd0807bc60 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:42.163 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.652+0000 7efd0da5a700 1 -- 172.21.15.96:0/842004961 >> 172.21.15.96:0/842004961 conn(0x7efd081019d0 msgr2=0x7efd081030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:42.163 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.652+0000 7efd0da5a700 1 -- 172.21.15.96:0/842004961 shutdown_connections 2024-02-19T18:54:42.163 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:41.653+0000 7efd0da5a700 1 -- 172.21.15.96:0/842004961 wait complete. 2024-02-19T18:54:42.163 INFO:teuthology.orchestra.run.smithi096.stdout:Wrote config to /etc/ceph/ceph.conf 2024-02-19T18:54:42.178 INFO:teuthology.orchestra.run.smithi096.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-19T18:54:42.178 INFO:teuthology.orchestra.run.smithi096.stdout:Creating mgr... 2024-02-19T18:54:42.179 INFO:teuthology.orchestra.run.smithi096.stdout:Verifying port 0.0.0.0:9283 ... 2024-02-19T18:54:42.179 INFO:teuthology.orchestra.run.smithi096.stdout:Verifying port 0.0.0.0:8765 ... 2024-02-19T18:54:42.179 INFO:teuthology.orchestra.run.smithi096.stdout:Verifying port 0.0.0.0:8443 ... 2024-02-19T18:54:42.417 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-06580d2c-cf58-11ee-95bb-87774f69a715@mgr.smithi096.zsjdff 2024-02-19T18:54:42.417 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stderr Failed to reset failed state of unit ceph-06580d2c-cf58-11ee-95bb-87774f69a715@mgr.smithi096.zsjdff.service: Unit ceph-06580d2c-cf58-11ee-95bb-87774f69a715@mgr.smithi096.zsjdff.service not loaded. 2024-02-19T18:54:42.568 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-06580d2c-cf58-11ee-95bb-87774f69a715.target.wants/ceph-06580d2c-cf58-11ee-95bb-87774f69a715@mgr.smithi096.zsjdff.service → /etc/systemd/system/ceph-06580d2c-cf58-11ee-95bb-87774f69a715@.service. 2024-02-19T18:54:42.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:42 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/842004961' entity='client.admin' 2024-02-19T18:54:43.130 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-19T18:54:43.130 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout disabled 2024-02-19T18:54:43.137 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-19T18:54:43.137 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout inactive 2024-02-19T18:54:43.137 INFO:teuthology.orchestra.run.smithi096.stdout:firewalld.service is not enabled 2024-02-19T18:54:43.137 INFO:teuthology.orchestra.run.smithi096.stdout:Not possible to enable service . firewalld.service is not available 2024-02-19T18:54:43.145 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-19T18:54:43.145 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout disabled 2024-02-19T18:54:43.152 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-19T18:54:43.153 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout inactive 2024-02-19T18:54:43.153 INFO:teuthology.orchestra.run.smithi096.stdout:firewalld.service is not enabled 2024-02-19T18:54:43.153 INFO:teuthology.orchestra.run.smithi096.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-02-19T18:54:43.153 INFO:teuthology.orchestra.run.smithi096.stdout:Waiting for mgr to start... 2024-02-19T18:54:43.153 INFO:teuthology.orchestra.run.smithi096.stdout:Waiting for mgr... 2024-02-19T18:54:43.930 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:43 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/904795483' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-19T18:54:44.202 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2024-02-19T18:54:44.202 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout { 2024-02-19T18:54:44.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "fsid": "06580d2c-cf58-11ee-95bb-87774f69a715", 2024-02-19T18:54:44.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "health": { 2024-02-19T18:54:44.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-19T18:54:44.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-19T18:54:44.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-19T18:54:44.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:44.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-19T18:54:44.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-19T18:54:44.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 0 2024-02-19T18:54:44.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:54:44.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-19T18:54:44.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "smithi096" 2024-02-19T18:54:44.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:54:44.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-02-19T18:54:44.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-19T18:54:44.204 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:54:44.204 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-02-19T18:54:44.204 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-19T18:54:44.204 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:44.204 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-19T18:54:44.204 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:54:44.204 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-19T18:54:44.204 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-19T18:54:44.204 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-19T18:54:44.211 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-19T18:54:44.211 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-19T18:54:44.211 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-19T18:54:44.211 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:44.211 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-19T18:54:44.211 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-19T18:54:44.211 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-19T18:54:44.211 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-19T18:54:44.211 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-19T18:54:44.212 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-19T18:54:44.212 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-19T18:54:44.212 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-19T18:54:44.212 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-19T18:54:44.212 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:44.212 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-19T18:54:44.212 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:54:44.212 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-19T18:54:44.212 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-19T18:54:44.212 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:44.212 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-19T18:54:44.212 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-19T18:54:44.212 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-19T18:54:44.212 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-19T18:54:44.212 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-19T18:54:44.213 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-19T18:54:44.213 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "restful" 2024-02-19T18:54:44.213 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:54:44.213 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-19T18:54:44.213 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:44.213 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-19T18:54:44.213 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:54:44.213 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "modified": "2024-02-19T18:54:33.003154+0000", 2024-02-19T18:54:44.213 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-19T18:54:44.213 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:44.213 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-19T18:54:44.213 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout } 2024-02-19T18:54:44.213 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.536+0000 7f95cb91c700 1 Processor -- start 2024-02-19T18:54:44.213 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.536+0000 7f95cb91c700 1 -- start start 2024-02-19T18:54:44.213 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.536+0000 7f95cb91c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95c4106ee0 0x7f95c41092d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:44.213 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.536+0000 7f95cb91c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c4079e80 con 0x7f95c4106ee0 2024-02-19T18:54:44.213 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.536+0000 7f95c96b8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95c4106ee0 0x7f95c41092d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:44.214 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.537+0000 7f95c96b8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95c4106ee0 0x7f95c41092d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45862/0 (socket says 172.21.15.96:45862) 2024-02-19T18:54:44.214 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.537+0000 7f95c96b8700 1 -- 172.21.15.96:0/742370114 learned_addr learned my addr 172.21.15.96:0/742370114 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:54:44.214 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.537+0000 7f95c96b8700 1 -- 172.21.15.96:0/742370114 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c4109810 con 0x7f95c4106ee0 2024-02-19T18:54:44.214 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.537+0000 7f95c96b8700 1 --2- 172.21.15.96:0/742370114 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95c4106ee0 0x7f95c41092d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f95c00098a0 tx=0x7f95c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead41220e697e38d server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:44.214 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.537+0000 7f95bbfff700 1 -- 172.21.15.96:0/742370114 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f95c0004180 con 0x7f95c4106ee0 2024-02-19T18:54:44.214 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.537+0000 7f95bbfff700 1 -- 172.21.15.96:0/742370114 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f95c00042e0 con 0x7f95c4106ee0 2024-02-19T18:54:44.214 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.537+0000 7f95bbfff700 1 -- 172.21.15.96:0/742370114 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f95c0011a50 con 0x7f95c4106ee0 2024-02-19T18:54:44.214 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.538+0000 7f95cb91c700 1 -- 172.21.15.96:0/742370114 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95c4106ee0 msgr2=0x7f95c41092d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:44.214 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.538+0000 7f95cb91c700 1 --2- 172.21.15.96:0/742370114 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95c4106ee0 0x7f95c41092d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f95c00098a0 tx=0x7f95c0009bb0 comp rx=0 tx=0).stop 2024-02-19T18:54:44.214 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.538+0000 7f95cb91c700 1 -- 172.21.15.96:0/742370114 shutdown_connections 2024-02-19T18:54:44.214 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.538+0000 7f95cb91c700 1 --2- 172.21.15.96:0/742370114 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95c4106ee0 0x7f95c41092d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:44.214 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.538+0000 7f95cb91c700 1 -- 172.21.15.96:0/742370114 >> 172.21.15.96:0/742370114 conn(0x7f95c41008b0 msgr2=0x7f95c4102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:44.214 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.538+0000 7f95cb91c700 1 -- 172.21.15.96:0/742370114 shutdown_connections 2024-02-19T18:54:44.214 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.538+0000 7f95cb91c700 1 -- 172.21.15.96:0/742370114 wait complete. 2024-02-19T18:54:44.214 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.539+0000 7f95cb91c700 1 Processor -- start 2024-02-19T18:54:44.214 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.539+0000 7f95cb91c700 1 -- start start 2024-02-19T18:54:44.215 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.539+0000 7f95cb91c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95c4106ee0 0x7f95c4106840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:44.215 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.539+0000 7f95cb91c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c4106d80 con 0x7f95c4106ee0 2024-02-19T18:54:44.215 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.539+0000 7f95c96b8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95c4106ee0 0x7f95c4106840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:44.215 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.539+0000 7f95c96b8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95c4106ee0 0x7f95c4106840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45878/0 (socket says 172.21.15.96:45878) 2024-02-19T18:54:44.215 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.539+0000 7f95c96b8700 1 -- 172.21.15.96:0/904795483 learned_addr learned my addr 172.21.15.96:0/904795483 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:54:44.215 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.539+0000 7f95c96b8700 1 -- 172.21.15.96:0/904795483 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c0009550 con 0x7f95c4106ee0 2024-02-19T18:54:44.215 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.539+0000 7f95c96b8700 1 --2- 172.21.15.96:0/904795483 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95c4106ee0 0x7f95c4106840 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f95c0003f80 tx=0x7f95c0011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:44.215 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.539+0000 7f95ba7fc700 1 -- 172.21.15.96:0/904795483 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f95c0003a80 con 0x7f95c4106ee0 2024-02-19T18:54:44.215 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.540+0000 7f95ba7fc700 1 -- 172.21.15.96:0/904795483 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f95c0003be0 con 0x7f95c4106ee0 2024-02-19T18:54:44.215 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.540+0000 7f95cb91c700 1 -- 172.21.15.96:0/904795483 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c4104e90 con 0x7f95c4106ee0 2024-02-19T18:54:44.215 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.540+0000 7f95ba7fc700 1 -- 172.21.15.96:0/904795483 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f95c0019820 con 0x7f95c4106ee0 2024-02-19T18:54:44.215 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.540+0000 7f95cb91c700 1 -- 172.21.15.96:0/904795483 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c4105330 con 0x7f95c4106ee0 2024-02-19T18:54:44.215 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.540+0000 7f95ba7fc700 1 -- 172.21.15.96:0/904795483 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f95c002d440 con 0x7f95c4106ee0 2024-02-19T18:54:44.215 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.540+0000 7f95ba7fc700 1 -- 172.21.15.96:0/904795483 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f95c0024810 con 0x7f95c4106ee0 2024-02-19T18:54:44.216 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.541+0000 7f95cb91c700 1 -- 172.21.15.96:0/904795483 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c410a560 con 0x7f95c4106ee0 2024-02-19T18:54:44.216 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.543+0000 7f95ba7fc700 1 -- 172.21.15.96:0/904795483 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f95c001acc0 con 0x7f95c4106ee0 2024-02-19T18:54:44.216 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.614+0000 7f95cb91c700 1 -- 172.21.15.96:0/904795483 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f95c4105990 con 0x7f95c4106ee0 2024-02-19T18:54:44.216 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.615+0000 7f95ba7fc700 1 -- 172.21.15.96:0/904795483 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f95c00249d0 con 0x7f95c4106ee0 2024-02-19T18:54:44.216 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.616+0000 7f95cb91c700 1 -- 172.21.15.96:0/904795483 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95c4106ee0 msgr2=0x7f95c4106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:44.216 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.616+0000 7f95cb91c700 1 --2- 172.21.15.96:0/904795483 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95c4106ee0 0x7f95c4106840 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f95c0003f80 tx=0x7f95c0011ab0 comp rx=0 tx=0).stop 2024-02-19T18:54:44.216 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.616+0000 7f95cb91c700 1 -- 172.21.15.96:0/904795483 shutdown_connections 2024-02-19T18:54:44.216 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.616+0000 7f95cb91c700 1 --2- 172.21.15.96:0/904795483 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95c4106ee0 0x7f95c4106840 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:44.216 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.616+0000 7f95cb91c700 1 -- 172.21.15.96:0/904795483 >> 172.21.15.96:0/904795483 conn(0x7f95c41008b0 msgr2=0x7f95c41016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:44.216 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.616+0000 7f95cb91c700 1 -- 172.21.15.96:0/904795483 shutdown_connections 2024-02-19T18:54:44.216 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:43.616+0000 7f95cb91c700 1 -- 172.21.15.96:0/904795483 wait complete. 2024-02-19T18:54:44.216 INFO:teuthology.orchestra.run.smithi096.stdout:mgr not available, waiting (1/15)... 2024-02-19T18:54:46.889 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:46 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/3885725740' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-19T18:54:47.860 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2024-02-19T18:54:47.860 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout { 2024-02-19T18:54:47.860 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "fsid": "06580d2c-cf58-11ee-95bb-87774f69a715", 2024-02-19T18:54:47.860 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "health": { 2024-02-19T18:54:47.860 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-19T18:54:47.860 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-19T18:54:47.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-19T18:54:47.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:47.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-19T18:54:47.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-19T18:54:47.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 0 2024-02-19T18:54:47.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:54:47.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-19T18:54:47.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "smithi096" 2024-02-19T18:54:47.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:54:47.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-02-19T18:54:47.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-19T18:54:47.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:54:47.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-02-19T18:54:47.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-19T18:54:47.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:47.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-19T18:54:47.862 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:54:47.862 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-19T18:54:47.862 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-19T18:54:47.862 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-19T18:54:47.869 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-19T18:54:47.869 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-19T18:54:47.869 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-19T18:54:47.869 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:47.869 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-19T18:54:47.869 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-19T18:54:47.870 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-19T18:54:47.870 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-19T18:54:47.870 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-19T18:54:47.870 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-19T18:54:47.870 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-19T18:54:47.870 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-19T18:54:47.870 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-19T18:54:47.870 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:47.870 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-19T18:54:47.870 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:54:47.870 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-19T18:54:47.870 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-19T18:54:47.870 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:47.870 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-19T18:54:47.870 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-19T18:54:47.870 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-19T18:54:47.870 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-19T18:54:47.871 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-19T18:54:47.871 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-19T18:54:47.871 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "restful" 2024-02-19T18:54:47.871 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:54:47.871 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-19T18:54:47.871 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:47.871 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-19T18:54:47.871 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:54:47.871 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "modified": "2024-02-19T18:54:33.003154+0000", 2024-02-19T18:54:47.871 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-19T18:54:47.871 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:47.871 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-19T18:54:47.871 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout } 2024-02-19T18:54:47.871 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.709+0000 7efd456f4700 1 Processor -- start 2024-02-19T18:54:47.871 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.709+0000 7efd456f4700 1 -- start start 2024-02-19T18:54:47.871 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.709+0000 7efd456f4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40106f10 0x7efd40109300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:47.871 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.709+0000 7efd456f4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd40074620 con 0x7efd40106f10 2024-02-19T18:54:47.872 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.710+0000 7efd3effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40106f10 0x7efd40109300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:47.872 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.710+0000 7efd3effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40106f10 0x7efd40109300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45894/0 (socket says 172.21.15.96:45894) 2024-02-19T18:54:47.872 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.710+0000 7efd3effd700 1 -- 172.21.15.96:0/3715027456 learned_addr learned my addr 172.21.15.96:0/3715027456 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:54:47.872 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.710+0000 7efd3effd700 1 -- 172.21.15.96:0/3715027456 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd40109840 con 0x7efd40106f10 2024-02-19T18:54:47.872 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.710+0000 7efd3effd700 1 --2- 172.21.15.96:0/3715027456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40106f10 0x7efd40109300 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efd300098a0 tx=0x7efd30009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3dc12811b1821f8 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:47.872 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.710+0000 7efd3dffb700 1 -- 172.21.15.96:0/3715027456 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd30004180 con 0x7efd40106f10 2024-02-19T18:54:47.872 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.710+0000 7efd3dffb700 1 -- 172.21.15.96:0/3715027456 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7efd300042e0 con 0x7efd40106f10 2024-02-19T18:54:47.872 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.710+0000 7efd3dffb700 1 -- 172.21.15.96:0/3715027456 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd30011a50 con 0x7efd40106f10 2024-02-19T18:54:47.872 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.711+0000 7efd456f4700 1 -- 172.21.15.96:0/3715027456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40106f10 msgr2=0x7efd40109300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:47.872 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.711+0000 7efd456f4700 1 --2- 172.21.15.96:0/3715027456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40106f10 0x7efd40109300 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efd300098a0 tx=0x7efd30009bb0 comp rx=0 tx=0).stop 2024-02-19T18:54:47.872 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.711+0000 7efd456f4700 1 -- 172.21.15.96:0/3715027456 shutdown_connections 2024-02-19T18:54:47.872 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.711+0000 7efd456f4700 1 --2- 172.21.15.96:0/3715027456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40106f10 0x7efd40109300 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:47.872 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.711+0000 7efd456f4700 1 -- 172.21.15.96:0/3715027456 >> 172.21.15.96:0/3715027456 conn(0x7efd401008c0 msgr2=0x7efd40102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:47.872 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.711+0000 7efd456f4700 1 -- 172.21.15.96:0/3715027456 shutdown_connections 2024-02-19T18:54:47.872 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.711+0000 7efd456f4700 1 -- 172.21.15.96:0/3715027456 wait complete. 2024-02-19T18:54:47.872 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.712+0000 7efd456f4700 1 Processor -- start 2024-02-19T18:54:47.873 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.712+0000 7efd456f4700 1 -- start start 2024-02-19T18:54:47.873 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.712+0000 7efd456f4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40106f10 0x7efd4019a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:47.873 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.712+0000 7efd456f4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4019a650 con 0x7efd40106f10 2024-02-19T18:54:47.873 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.713+0000 7efd3effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40106f10 0x7efd4019a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:47.873 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.713+0000 7efd3effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40106f10 0x7efd4019a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45910/0 (socket says 172.21.15.96:45910) 2024-02-19T18:54:47.873 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.713+0000 7efd3effd700 1 -- 172.21.15.96:0/3885725740 learned_addr learned my addr 172.21.15.96:0/3885725740 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:54:47.873 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.713+0000 7efd3effd700 1 -- 172.21.15.96:0/3885725740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd30009550 con 0x7efd40106f10 2024-02-19T18:54:47.873 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.713+0000 7efd3effd700 1 --2- 172.21.15.96:0/3885725740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40106f10 0x7efd4019a110 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efd30003f80 tx=0x7efd30011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:47.873 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.713+0000 7efd27fff700 1 -- 172.21.15.96:0/3885725740 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd30003a80 con 0x7efd40106f10 2024-02-19T18:54:47.873 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.713+0000 7efd27fff700 1 -- 172.21.15.96:0/3885725740 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7efd30003be0 con 0x7efd40106f10 2024-02-19T18:54:47.873 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.713+0000 7efd27fff700 1 -- 172.21.15.96:0/3885725740 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efd30019820 con 0x7efd40106f10 2024-02-19T18:54:47.873 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.713+0000 7efd456f4700 1 -- 172.21.15.96:0/3885725740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd4019a850 con 0x7efd40106f10 2024-02-19T18:54:47.873 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.713+0000 7efd456f4700 1 -- 172.21.15.96:0/3885725740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd4019acf0 con 0x7efd40106f10 2024-02-19T18:54:47.873 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.713+0000 7efd27fff700 1 -- 172.21.15.96:0/3885725740 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efd30019d50 con 0x7efd40106f10 2024-02-19T18:54:47.873 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.713+0000 7efd27fff700 1 -- 172.21.15.96:0/3885725740 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7efd300248a0 con 0x7efd40106f10 2024-02-19T18:54:47.873 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.714+0000 7efd456f4700 1 -- 172.21.15.96:0/3885725740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd400623c0 con 0x7efd40106f10 2024-02-19T18:54:47.874 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.716+0000 7efd27fff700 1 -- 172.21.15.96:0/3885725740 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7efd3001acc0 con 0x7efd40106f10 2024-02-19T18:54:47.874 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.788+0000 7efd456f4700 1 -- 172.21.15.96:0/3885725740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7efd4019d810 con 0x7efd40106f10 2024-02-19T18:54:47.874 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.789+0000 7efd27fff700 1 -- 172.21.15.96:0/3885725740 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7efd30035090 con 0x7efd40106f10 2024-02-19T18:54:47.874 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.790+0000 7efd456f4700 1 -- 172.21.15.96:0/3885725740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40106f10 msgr2=0x7efd4019a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:47.874 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.790+0000 7efd456f4700 1 --2- 172.21.15.96:0/3885725740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40106f10 0x7efd4019a110 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efd30003f80 tx=0x7efd30011ab0 comp rx=0 tx=0).stop 2024-02-19T18:54:47.874 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.790+0000 7efd456f4700 1 -- 172.21.15.96:0/3885725740 shutdown_connections 2024-02-19T18:54:47.874 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.790+0000 7efd456f4700 1 --2- 172.21.15.96:0/3885725740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd40106f10 0x7efd4019a110 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:47.874 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.790+0000 7efd456f4700 1 -- 172.21.15.96:0/3885725740 >> 172.21.15.96:0/3885725740 conn(0x7efd401008c0 msgr2=0x7efd40101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:47.874 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.790+0000 7efd456f4700 1 -- 172.21.15.96:0/3885725740 shutdown_connections 2024-02-19T18:54:47.874 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:46.790+0000 7efd456f4700 1 -- 172.21.15.96:0/3885725740 wait complete. 2024-02-19T18:54:47.874 INFO:teuthology.orchestra.run.smithi096.stdout:mgr not available, waiting (2/15)... 2024-02-19T18:54:49.991 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:49 smithi096 ceph-mon[29216]: Activating manager daemon smithi096.zsjdff 2024-02-19T18:54:49.992 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:49 smithi096 ceph-mon[29216]: mgrmap e2: smithi096.zsjdff(active, starting, since 0.00281147s) 2024-02-19T18:54:49.992 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:49 smithi096 ceph-mon[29216]: from='mgr.14100 172.21.15.96:0/2046991800' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T18:54:49.992 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:49 smithi096 ceph-mon[29216]: from='mgr.14100 172.21.15.96:0/2046991800' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T18:54:49.992 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:49 smithi096 ceph-mon[29216]: from='mgr.14100 172.21.15.96:0/2046991800' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T18:54:49.992 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:49 smithi096 ceph-mon[29216]: from='mgr.14100 172.21.15.96:0/2046991800' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2024-02-19T18:54:49.992 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:49 smithi096 ceph-mon[29216]: from='mgr.14100 172.21.15.96:0/2046991800' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr metadata", "who": "smithi096.zsjdff", "id": "smithi096.zsjdff"}]: dispatch 2024-02-19T18:54:49.992 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:49 smithi096 ceph-mon[29216]: Manager daemon smithi096.zsjdff is now available 2024-02-19T18:54:49.992 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:49 smithi096 ceph-mon[29216]: from='mgr.14100 172.21.15.96:0/2046991800' entity='mgr.smithi096.zsjdff' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.zsjdff/mirror_snapshot_schedule"}]: dispatch 2024-02-19T18:54:49.992 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:49 smithi096 ceph-mon[29216]: from='mgr.14100 172.21.15.96:0/2046991800' entity='mgr.smithi096.zsjdff' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.zsjdff/trash_purge_schedule"}]: dispatch 2024-02-19T18:54:49.992 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:49 smithi096 ceph-mon[29216]: from='mgr.14100 172.21.15.96:0/2046991800' entity='mgr.smithi096.zsjdff' 2024-02-19T18:54:49.992 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:49 smithi096 ceph-mon[29216]: from='mgr.14100 172.21.15.96:0/2046991800' entity='mgr.smithi096.zsjdff' 2024-02-19T18:54:49.993 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:49 smithi096 ceph-mon[29216]: from='mgr.14100 172.21.15.96:0/2046991800' entity='mgr.smithi096.zsjdff' 2024-02-19T18:54:50.849 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2024-02-19T18:54:50.849 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout { 2024-02-19T18:54:50.849 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "fsid": "06580d2c-cf58-11ee-95bb-87774f69a715", 2024-02-19T18:54:50.849 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "health": { 2024-02-19T18:54:50.850 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-19T18:54:50.850 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-19T18:54:50.850 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-19T18:54:50.850 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:50.850 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-19T18:54:50.850 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-19T18:54:50.850 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 0 2024-02-19T18:54:50.850 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:54:50.850 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-19T18:54:50.850 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "smithi096" 2024-02-19T18:54:50.850 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:54:50.850 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-02-19T18:54:50.850 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-19T18:54:50.850 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:54:50.850 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-02-19T18:54:50.851 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-19T18:54:50.851 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:50.851 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-19T18:54:50.851 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:54:50.851 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-19T18:54:50.851 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-19T18:54:50.851 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-19T18:54:50.851 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-19T18:54:50.858 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-19T18:54:50.858 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-19T18:54:50.859 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:50.859 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-19T18:54:50.859 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-19T18:54:50.859 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-19T18:54:50.859 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-19T18:54:50.859 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-19T18:54:50.859 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-19T18:54:50.859 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-19T18:54:50.859 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-19T18:54:50.859 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-19T18:54:50.859 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:50.859 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-19T18:54:50.859 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:54:50.859 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-19T18:54:50.859 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-19T18:54:50.860 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:50.860 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-19T18:54:50.860 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-19T18:54:50.860 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-19T18:54:50.860 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-19T18:54:50.860 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-19T18:54:50.860 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-19T18:54:50.860 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "restful" 2024-02-19T18:54:50.860 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:54:50.860 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-19T18:54:50.860 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:50.860 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-19T18:54:50.860 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:54:50.860 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "modified": "2024-02-19T18:54:33.003154+0000", 2024-02-19T18:54:50.860 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-19T18:54:50.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:50.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-19T18:54:50.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout } 2024-02-19T18:54:50.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.262+0000 7f5cefe93700 1 Processor -- start 2024-02-19T18:54:50.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.262+0000 7f5cefe93700 1 -- start start 2024-02-19T18:54:50.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.262+0000 7f5cefe93700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce807beb0 0x7f5ce807a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:50.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.262+0000 7f5cefe93700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce807a8e0 con 0x7f5ce807beb0 2024-02-19T18:54:50.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.262+0000 7f5cedc2f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce807beb0 0x7f5ce807a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:50.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.262+0000 7f5cedc2f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce807beb0 0x7f5ce807a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45976/0 (socket says 172.21.15.96:45976) 2024-02-19T18:54:50.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.262+0000 7f5cedc2f700 1 -- 172.21.15.96:0/2411624347 learned_addr learned my addr 172.21.15.96:0/2411624347 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:54:50.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.263+0000 7f5cedc2f700 1 -- 172.21.15.96:0/2411624347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce807aa20 con 0x7f5ce807beb0 2024-02-19T18:54:50.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.263+0000 7f5cedc2f700 1 --2- 172.21.15.96:0/2411624347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce807beb0 0x7f5ce807a310 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40098a0 tx=0x7f5ce4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b65070bbdf27be server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:50.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.263+0000 7f5cecc2d700 1 -- 172.21.15.96:0/2411624347 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ce4004180 con 0x7f5ce807beb0 2024-02-19T18:54:50.861 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.263+0000 7f5cecc2d700 1 -- 172.21.15.96:0/2411624347 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5ce40042e0 con 0x7f5ce807beb0 2024-02-19T18:54:50.862 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.263+0000 7f5cecc2d700 1 -- 172.21.15.96:0/2411624347 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ce4011a50 con 0x7f5ce807beb0 2024-02-19T18:54:50.862 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.264+0000 7f5cefe93700 1 -- 172.21.15.96:0/2411624347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce807beb0 msgr2=0x7f5ce807a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:50.862 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.264+0000 7f5cefe93700 1 --2- 172.21.15.96:0/2411624347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce807beb0 0x7f5ce807a310 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40098a0 tx=0x7f5ce4009bb0 comp rx=0 tx=0).stop 2024-02-19T18:54:50.862 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.264+0000 7f5cefe93700 1 -- 172.21.15.96:0/2411624347 shutdown_connections 2024-02-19T18:54:50.862 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.264+0000 7f5cefe93700 1 --2- 172.21.15.96:0/2411624347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce807beb0 0x7f5ce807a310 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:50.862 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.264+0000 7f5cefe93700 1 -- 172.21.15.96:0/2411624347 >> 172.21.15.96:0/2411624347 conn(0x7f5ce8101a00 msgr2=0x7f5ce8103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:50.862 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.264+0000 7f5cefe93700 1 -- 172.21.15.96:0/2411624347 shutdown_connections 2024-02-19T18:54:50.862 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.264+0000 7f5cefe93700 1 -- 172.21.15.96:0/2411624347 wait complete. 2024-02-19T18:54:50.862 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.264+0000 7f5cefe93700 1 Processor -- start 2024-02-19T18:54:50.862 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.264+0000 7f5cefe93700 1 -- start start 2024-02-19T18:54:50.862 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.264+0000 7f5cefe93700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce807beb0 0x7f5ce819c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:50.862 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.264+0000 7f5cefe93700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce819c840 con 0x7f5ce807beb0 2024-02-19T18:54:50.862 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.264+0000 7f5cedc2f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce807beb0 0x7f5ce819c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:50.862 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.264+0000 7f5cedc2f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce807beb0 0x7f5ce819c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45984/0 (socket says 172.21.15.96:45984) 2024-02-19T18:54:50.862 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.265+0000 7f5cedc2f700 1 -- 172.21.15.96:0/3138559478 learned_addr learned my addr 172.21.15.96:0/3138559478 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:54:50.863 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.265+0000 7f5cedc2f700 1 -- 172.21.15.96:0/3138559478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce4009550 con 0x7f5ce807beb0 2024-02-19T18:54:50.863 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.265+0000 7f5cedc2f700 1 --2- 172.21.15.96:0/3138559478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce807beb0 0x7f5ce819c300 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4006af0 tx=0x7f5ce4011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:50.863 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.265+0000 7f5cdeffd700 1 -- 172.21.15.96:0/3138559478 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ce4003b90 con 0x7f5ce807beb0 2024-02-19T18:54:50.863 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.265+0000 7f5cdeffd700 1 -- 172.21.15.96:0/3138559478 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5ce401a8a0 con 0x7f5ce807beb0 2024-02-19T18:54:50.863 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.265+0000 7f5cdeffd700 1 -- 172.21.15.96:0/3138559478 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5ce4019880 con 0x7f5ce807beb0 2024-02-19T18:54:50.863 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.265+0000 7f5cefe93700 1 -- 172.21.15.96:0/3138559478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce819ca40 con 0x7f5ce807beb0 2024-02-19T18:54:50.863 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.265+0000 7f5cefe93700 1 -- 172.21.15.96:0/3138559478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce819cee0 con 0x7f5ce807beb0 2024-02-19T18:54:50.863 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.266+0000 7f5cdeffd700 1 -- 172.21.15.96:0/3138559478 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 2) v1 ==== 45039+0+0 (secure 0 0 0) 0x7f5ce4019b40 con 0x7f5ce807beb0 2024-02-19T18:54:50.863 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.266+0000 7f5cdeffd700 1 -- 172.21.15.96:0/3138559478 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5ce404c230 con 0x7f5ce807beb0 2024-02-19T18:54:50.863 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.266+0000 7f5cefe93700 1 -- 172.21.15.96:0/3138559478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce810c780 con 0x7f5ce807beb0 2024-02-19T18:54:50.863 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.268+0000 7f5cdeffd700 1 -- 172.21.15.96:0/3138559478 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f5ce4019df0 con 0x7f5ce807beb0 2024-02-19T18:54:50.863 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.338+0000 7f5cefe93700 1 -- 172.21.15.96:0/3138559478 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f5ce810c970 con 0x7f5ce807beb0 2024-02-19T18:54:50.863 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.339+0000 7f5cdeffd700 1 -- 172.21.15.96:0/3138559478 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1247 (secure 0 0 0) 0x7f5ce40172b0 con 0x7f5ce807beb0 2024-02-19T18:54:50.863 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.339+0000 7f5cefe93700 1 -- 172.21.15.96:0/3138559478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce807beb0 msgr2=0x7f5ce819c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:50.863 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.339+0000 7f5cefe93700 1 --2- 172.21.15.96:0/3138559478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce807beb0 0x7f5ce819c300 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5ce4006af0 tx=0x7f5ce4011a90 comp rx=0 tx=0).stop 2024-02-19T18:54:50.864 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.339+0000 7f5cefe93700 1 -- 172.21.15.96:0/3138559478 shutdown_connections 2024-02-19T18:54:50.864 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.339+0000 7f5cefe93700 1 --2- 172.21.15.96:0/3138559478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ce807beb0 0x7f5ce819c300 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:50.864 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.339+0000 7f5cefe93700 1 -- 172.21.15.96:0/3138559478 >> 172.21.15.96:0/3138559478 conn(0x7f5ce8101a00 msgr2=0x7f5ce81030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:50.864 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.339+0000 7f5cefe93700 1 -- 172.21.15.96:0/3138559478 shutdown_connections 2024-02-19T18:54:50.864 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:50.339+0000 7f5cefe93700 1 -- 172.21.15.96:0/3138559478 wait complete. 2024-02-19T18:54:50.864 INFO:teuthology.orchestra.run.smithi096.stdout:mgr not available, waiting (3/15)... 2024-02-19T18:54:51.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:51 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/3138559478' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-19T18:54:51.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:51 smithi096 ceph-mon[29216]: mgrmap e3: smithi096.zsjdff(active, since 1.00608s) 2024-02-19T18:54:53.532 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:53 smithi096 ceph-mon[29216]: mgrmap e4: smithi096.zsjdff(active, since 2s) 2024-02-19T18:54:54.104 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2024-02-19T18:54:54.104 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout { 2024-02-19T18:54:54.104 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "fsid": "06580d2c-cf58-11ee-95bb-87774f69a715", 2024-02-19T18:54:54.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "health": { 2024-02-19T18:54:54.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-19T18:54:54.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-19T18:54:54.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-19T18:54:54.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:54.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-19T18:54:54.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-19T18:54:54.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 0 2024-02-19T18:54:54.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:54:54.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-19T18:54:54.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "smithi096" 2024-02-19T18:54:54.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:54:54.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2024-02-19T18:54:54.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-19T18:54:54.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:54:54.105 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-02-19T18:54:54.106 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-19T18:54:54.106 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:54.106 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-19T18:54:54.106 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:54:54.106 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-19T18:54:54.106 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-19T18:54:54.106 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-19T18:54:54.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-19T18:54:54.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-19T18:54:54.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-19T18:54:54.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:54.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-19T18:54:54.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-19T18:54:54.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-19T18:54:54.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-19T18:54:54.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-19T18:54:54.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-19T18:54:54.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-19T18:54:54.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-19T18:54:54.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-19T18:54:54.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:54.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-19T18:54:54.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:54:54.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-19T18:54:54.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-19T18:54:54.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:54.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-19T18:54:54.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-19T18:54:54.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-19T18:54:54.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-19T18:54:54.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-19T18:54:54.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-19T18:54:54.116 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "restful" 2024-02-19T18:54:54.116 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ], 2024-02-19T18:54:54.116 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-19T18:54:54.116 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:54.116 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-19T18:54:54.116 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-19T18:54:54.116 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "modified": "2024-02-19T18:54:33.003154+0000", 2024-02-19T18:54:54.116 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-19T18:54:54.116 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout }, 2024-02-19T18:54:54.116 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-19T18:54:54.116 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout } 2024-02-19T18:54:54.116 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.245+0000 7fdaaea2f700 1 Processor -- start 2024-02-19T18:54:54.116 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.245+0000 7fdaaea2f700 1 -- start start 2024-02-19T18:54:54.116 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.245+0000 7fdaaea2f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8106420 0x7fdaa8106840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:54.117 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.245+0000 7fdaaea2f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa8106e10 con 0x7fdaa8106420 2024-02-19T18:54:54.117 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.245+0000 7fdaa7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8106420 0x7fdaa8106840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:54.117 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.245+0000 7fdaa7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8106420 0x7fdaa8106840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:45998/0 (socket says 172.21.15.96:45998) 2024-02-19T18:54:54.117 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.245+0000 7fdaa7fff700 1 -- 172.21.15.96:0/3373522614 learned_addr learned my addr 172.21.15.96:0/3373522614 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:54:54.117 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.246+0000 7fdaa7fff700 1 -- 172.21.15.96:0/3373522614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa8107620 con 0x7fdaa8106420 2024-02-19T18:54:54.117 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.246+0000 7fdaa7fff700 1 --2- 172.21.15.96:0/3373522614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8106420 0x7fdaa8106840 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fda980098a0 tx=0x7fda98009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea880d476a24b9d server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:54.117 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.246+0000 7fdaa6ffd700 1 -- 172.21.15.96:0/3373522614 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda98004180 con 0x7fdaa8106420 2024-02-19T18:54:54.117 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.246+0000 7fdaa6ffd700 1 -- 172.21.15.96:0/3373522614 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fda980042e0 con 0x7fdaa8106420 2024-02-19T18:54:54.117 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.246+0000 7fdaa6ffd700 1 -- 172.21.15.96:0/3373522614 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda98011a50 con 0x7fdaa8106420 2024-02-19T18:54:54.117 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.247+0000 7fdaaea2f700 1 -- 172.21.15.96:0/3373522614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8106420 msgr2=0x7fdaa8106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:54.117 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.247+0000 7fdaaea2f700 1 --2- 172.21.15.96:0/3373522614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8106420 0x7fdaa8106840 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fda980098a0 tx=0x7fda98009bb0 comp rx=0 tx=0).stop 2024-02-19T18:54:54.117 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.247+0000 7fdaaea2f700 1 -- 172.21.15.96:0/3373522614 shutdown_connections 2024-02-19T18:54:54.117 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.247+0000 7fdaaea2f700 1 --2- 172.21.15.96:0/3373522614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8106420 0x7fdaa8106840 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:54.117 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.247+0000 7fdaaea2f700 1 -- 172.21.15.96:0/3373522614 >> 172.21.15.96:0/3373522614 conn(0x7fdaa8101a00 msgr2=0x7fdaa8103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:54.118 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.247+0000 7fdaaea2f700 1 -- 172.21.15.96:0/3373522614 shutdown_connections 2024-02-19T18:54:54.118 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.247+0000 7fdaaea2f700 1 -- 172.21.15.96:0/3373522614 wait complete. 2024-02-19T18:54:54.118 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.247+0000 7fdaaea2f700 1 Processor -- start 2024-02-19T18:54:54.118 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.247+0000 7fdaaea2f700 1 -- start start 2024-02-19T18:54:54.118 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.248+0000 7fdaaea2f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8106420 0x7fdaa819a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:54.118 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.248+0000 7fdaaea2f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa819a5f0 con 0x7fdaa8106420 2024-02-19T18:54:54.118 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.248+0000 7fdaa7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8106420 0x7fdaa819a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:54.118 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.248+0000 7fdaa7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8106420 0x7fdaa819a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46002/0 (socket says 172.21.15.96:46002) 2024-02-19T18:54:54.118 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.248+0000 7fdaa7fff700 1 -- 172.21.15.96:0/798954473 learned_addr learned my addr 172.21.15.96:0/798954473 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:54:54.118 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.248+0000 7fdaa7fff700 1 -- 172.21.15.96:0/798954473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda98009550 con 0x7fdaa8106420 2024-02-19T18:54:54.118 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.248+0000 7fdaa7fff700 1 --2- 172.21.15.96:0/798954473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8106420 0x7fdaa819a0b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fda98000c00 tx=0x7fda98011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:54.118 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.248+0000 7fdaa57fa700 1 -- 172.21.15.96:0/798954473 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda98003b90 con 0x7fdaa8106420 2024-02-19T18:54:54.118 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.249+0000 7fdaa57fa700 1 -- 172.21.15.96:0/798954473 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fda980248b0 con 0x7fdaa8106420 2024-02-19T18:54:54.118 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.249+0000 7fdaaea2f700 1 -- 172.21.15.96:0/798954473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa819a7f0 con 0x7fdaa8106420 2024-02-19T18:54:54.118 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.249+0000 7fdaa57fa700 1 -- 172.21.15.96:0/798954473 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda9801a8e0 con 0x7fdaa8106420 2024-02-19T18:54:54.119 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.249+0000 7fdaaea2f700 1 -- 172.21.15.96:0/798954473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa819ac90 con 0x7fdaa8106420 2024-02-19T18:54:54.119 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.249+0000 7fdaa57fa700 1 -- 172.21.15.96:0/798954473 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 4) v1 ==== 45272+0+0 (secure 0 0 0) 0x7fda9801aba0 con 0x7fdaa8106420 2024-02-19T18:54:54.119 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.250+0000 7fdaa57fa700 1 --2- 172.21.15.96:0/798954473 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7fda900382d0 0x7fda9003a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:54.119 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.250+0000 7fdaaea2f700 1 -- 172.21.15.96:0/798954473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa80623c0 con 0x7fdaa8106420 2024-02-19T18:54:54.119 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.250+0000 7fdaa57fa700 1 -- 172.21.15.96:0/798954473 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fda9804c060 con 0x7fdaa8106420 2024-02-19T18:54:54.119 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.250+0000 7fdaa77fe700 1 --2- 172.21.15.96:0/798954473 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7fda900382d0 0x7fda9003a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:54.119 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.250+0000 7fdaa77fe700 1 --2- 172.21.15.96:0/798954473 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7fda900382d0 0x7fda9003a790 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fda9c006fd0 tx=0x7fda9c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:54.119 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.255+0000 7fdaa57fa700 1 -- 172.21.15.96:0/798954473 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fda980233a0 con 0x7fdaa8106420 2024-02-19T18:54:54.119 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.517+0000 7fdaaea2f700 1 -- 172.21.15.96:0/798954473 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fdaa819da70 con 0x7fdaa8106420 2024-02-19T18:54:54.119 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.517+0000 7fdaa57fa700 1 -- 172.21.15.96:0/798954473 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7fdaa819da70 con 0x7fdaa8106420 2024-02-19T18:54:54.119 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.519+0000 7fdaaea2f700 1 -- 172.21.15.96:0/798954473 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7fda900382d0 msgr2=0x7fda9003a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:54.119 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.519+0000 7fdaaea2f700 1 --2- 172.21.15.96:0/798954473 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7fda900382d0 0x7fda9003a790 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fda9c006fd0 tx=0x7fda9c006e40 comp rx=0 tx=0).stop 2024-02-19T18:54:54.119 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.519+0000 7fdaaea2f700 1 -- 172.21.15.96:0/798954473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8106420 msgr2=0x7fdaa819a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:54.119 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.519+0000 7fdaaea2f700 1 --2- 172.21.15.96:0/798954473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8106420 0x7fdaa819a0b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fda98000c00 tx=0x7fda98011ab0 comp rx=0 tx=0).stop 2024-02-19T18:54:54.119 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.519+0000 7fdaaea2f700 1 -- 172.21.15.96:0/798954473 shutdown_connections 2024-02-19T18:54:54.120 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.519+0000 7fdaaea2f700 1 --2- 172.21.15.96:0/798954473 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7fda900382d0 0x7fda9003a790 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:54.120 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.519+0000 7fdaaea2f700 1 --2- 172.21.15.96:0/798954473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaa8106420 0x7fdaa819a0b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:54.120 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.519+0000 7fdaaea2f700 1 -- 172.21.15.96:0/798954473 >> 172.21.15.96:0/798954473 conn(0x7fdaa8101a00 msgr2=0x7fdaa81027f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:54.120 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.519+0000 7fdaaea2f700 1 -- 172.21.15.96:0/798954473 shutdown_connections 2024-02-19T18:54:54.120 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:53.519+0000 7fdaaea2f700 1 -- 172.21.15.96:0/798954473 wait complete. 2024-02-19T18:54:54.120 INFO:teuthology.orchestra.run.smithi096.stdout:mgr is available 2024-02-19T18:54:54.419 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:54 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/798954473' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-19T18:54:55.248 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2024-02-19T18:54:55.248 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout [global] 2024-02-19T18:54:55.248 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout fsid = 06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T18:54:55.248 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-19T18:54:55.248 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-19T18:54:55.248 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-19T18:54:55.248 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-19T18:54:55.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2024-02-19T18:54:55.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-19T18:54:55.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-19T18:54:55.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 2024-02-19T18:54:55.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout [osd] 2024-02-19T18:54:55.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-19T18:54:55.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-19T18:54:55.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-19T18:54:55.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-19T18:54:55.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-19T18:54:55.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.500+0000 7f1f75183700 1 Processor -- start 2024-02-19T18:54:55.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.500+0000 7f1f75183700 1 -- start start 2024-02-19T18:54:55.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.500+0000 7f1f75183700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f70106f20 0x7f1f70109310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:55.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.500+0000 7f1f75183700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f70079e60 con 0x7f1f70106f20 2024-02-19T18:54:55.249 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.500+0000 7f1f6ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f70106f20 0x7f1f70109310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:55.250 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.500+0000 7f1f6ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f70106f20 0x7f1f70109310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58578/0 (socket says 172.21.15.96:58578) 2024-02-19T18:54:55.250 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.500+0000 7f1f6ed9d700 1 -- 172.21.15.96:0/3367167280 learned_addr learned my addr 172.21.15.96:0/3367167280 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:54:55.250 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.500+0000 7f1f6ed9d700 1 -- 172.21.15.96:0/3367167280 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f70109850 con 0x7f1f70106f20 2024-02-19T18:54:55.250 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.500+0000 7f1f6ed9d700 1 --2- 172.21.15.96:0/3367167280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f70106f20 0x7f1f70109310 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009e80 tx=0x7f1f6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d75bfe4053be63f server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:55.250 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.500+0000 7f1f6dd9b700 1 -- 172.21.15.96:0/3367167280 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1f6800e070 con 0x7f1f70106f20 2024-02-19T18:54:55.250 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.501+0000 7f1f6dd9b700 1 -- 172.21.15.96:0/3367167280 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1f68003e90 con 0x7f1f70106f20 2024-02-19T18:54:55.250 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.501+0000 7f1f6dd9b700 1 -- 172.21.15.96:0/3367167280 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1f68004380 con 0x7f1f70106f20 2024-02-19T18:54:55.250 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.501+0000 7f1f75183700 1 -- 172.21.15.96:0/3367167280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f70106f20 msgr2=0x7f1f70109310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:55.250 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.501+0000 7f1f75183700 1 --2- 172.21.15.96:0/3367167280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f70106f20 0x7f1f70109310 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009e80 tx=0x7f1f6800b330 comp rx=0 tx=0).stop 2024-02-19T18:54:55.250 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.501+0000 7f1f75183700 1 -- 172.21.15.96:0/3367167280 shutdown_connections 2024-02-19T18:54:55.250 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.501+0000 7f1f75183700 1 --2- 172.21.15.96:0/3367167280 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f70106f20 0x7f1f70109310 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:55.250 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.501+0000 7f1f75183700 1 -- 172.21.15.96:0/3367167280 >> 172.21.15.96:0/3367167280 conn(0x7f1f701008d0 msgr2=0x7f1f70102d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:55.250 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.501+0000 7f1f75183700 1 -- 172.21.15.96:0/3367167280 shutdown_connections 2024-02-19T18:54:55.250 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.501+0000 7f1f75183700 1 -- 172.21.15.96:0/3367167280 wait complete. 2024-02-19T18:54:55.250 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.502+0000 7f1f75183700 1 Processor -- start 2024-02-19T18:54:55.251 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.502+0000 7f1f75183700 1 -- start start 2024-02-19T18:54:55.251 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.502+0000 7f1f75183700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f70106f20 0x7f1f70106880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:55.251 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.502+0000 7f1f75183700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f70106dc0 con 0x7f1f70106f20 2024-02-19T18:54:55.251 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.502+0000 7f1f6ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f70106f20 0x7f1f70106880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:55.251 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.502+0000 7f1f6ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f70106f20 0x7f1f70106880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58582/0 (socket says 172.21.15.96:58582) 2024-02-19T18:54:55.251 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.502+0000 7f1f6ed9d700 1 -- 172.21.15.96:0/1955282051 learned_addr learned my addr 172.21.15.96:0/1955282051 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:54:55.251 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.503+0000 7f1f6ed9d700 1 -- 172.21.15.96:0/1955282051 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f68009b30 con 0x7f1f70106f20 2024-02-19T18:54:55.251 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.503+0000 7f1f6ed9d700 1 --2- 172.21.15.96:0/1955282051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f70106f20 0x7f1f70106880 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800d010 tx=0x7f1f68004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:55.251 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.503+0000 7f1f57fff700 1 -- 172.21.15.96:0/1955282051 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1f6800e040 con 0x7f1f70106f20 2024-02-19T18:54:55.251 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.503+0000 7f1f57fff700 1 -- 172.21.15.96:0/1955282051 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1f68003c30 con 0x7f1f70106f20 2024-02-19T18:54:55.251 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.503+0000 7f1f75183700 1 -- 172.21.15.96:0/1955282051 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f70104ed0 con 0x7f1f70106f20 2024-02-19T18:54:55.251 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.503+0000 7f1f57fff700 1 -- 172.21.15.96:0/1955282051 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1f6801b790 con 0x7f1f70106f20 2024-02-19T18:54:55.251 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.503+0000 7f1f75183700 1 -- 172.21.15.96:0/1955282051 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f701053d0 con 0x7f1f70106f20 2024-02-19T18:54:55.251 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.504+0000 7f1f57fff700 1 -- 172.21.15.96:0/1955282051 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 4) v1 ==== 45272+0+0 (secure 0 0 0) 0x7f1f68019040 con 0x7f1f70106f20 2024-02-19T18:54:55.252 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.504+0000 7f1f57fff700 1 --2- 172.21.15.96:0/1955282051 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f1f580382e0 0x7f1f5803a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:55.252 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.504+0000 7f1f57fff700 1 -- 172.21.15.96:0/1955282051 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1f6804bcc0 con 0x7f1f70106f20 2024-02-19T18:54:55.252 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.504+0000 7f1f75183700 1 -- 172.21.15.96:0/1955282051 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f70062430 con 0x7f1f70106f20 2024-02-19T18:54:55.252 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.504+0000 7f1f6e59c700 1 --2- 172.21.15.96:0/1955282051 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f1f580382e0 0x7f1f5803a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:55.252 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.504+0000 7f1f6e59c700 1 --2- 172.21.15.96:0/1955282051 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f1f580382e0 0x7f1f5803a7a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1f64006fd0 tx=0x7f1f64006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:55.252 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.509+0000 7f1f57fff700 1 -- 172.21.15.96:0/1955282051 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1f70062430 con 0x7f1f70106f20 2024-02-19T18:54:55.252 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.695+0000 7f1f75183700 1 -- 172.21.15.96:0/1955282051 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f1f700623c0 con 0x7f1f70106f20 2024-02-19T18:54:55.252 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.696+0000 7f1f57fff700 1 -- 172.21.15.96:0/1955282051 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f1f6804a190 con 0x7f1f70106f20 2024-02-19T18:54:55.252 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.698+0000 7f1f75183700 1 -- 172.21.15.96:0/1955282051 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f1f580382e0 msgr2=0x7f1f5803a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:55.252 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.698+0000 7f1f75183700 1 --2- 172.21.15.96:0/1955282051 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f1f580382e0 0x7f1f5803a7a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1f64006fd0 tx=0x7f1f64006e40 comp rx=0 tx=0).stop 2024-02-19T18:54:55.252 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.698+0000 7f1f75183700 1 -- 172.21.15.96:0/1955282051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f70106f20 msgr2=0x7f1f70106880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:55.252 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.698+0000 7f1f75183700 1 --2- 172.21.15.96:0/1955282051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f70106f20 0x7f1f70106880 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800d010 tx=0x7f1f68004430 comp rx=0 tx=0).stop 2024-02-19T18:54:55.252 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.699+0000 7f1f75183700 1 -- 172.21.15.96:0/1955282051 shutdown_connections 2024-02-19T18:54:55.252 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.699+0000 7f1f75183700 1 --2- 172.21.15.96:0/1955282051 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f1f580382e0 0x7f1f5803a7a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:55.252 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.699+0000 7f1f75183700 1 --2- 172.21.15.96:0/1955282051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f70106f20 0x7f1f70106880 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:55.253 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.699+0000 7f1f75183700 1 -- 172.21.15.96:0/1955282051 >> 172.21.15.96:0/1955282051 conn(0x7f1f701008d0 msgr2=0x7f1f70101640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:55.253 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.699+0000 7f1f75183700 1 -- 172.21.15.96:0/1955282051 shutdown_connections 2024-02-19T18:54:55.253 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:54.699+0000 7f1f75183700 1 -- 172.21.15.96:0/1955282051 wait complete. 2024-02-19T18:54:55.253 INFO:teuthology.orchestra.run.smithi096.stdout:Enabling cephadm module... 2024-02-19T18:54:55.474 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:55 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/1955282051' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-19T18:54:56.637 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:56 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/2367000083' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-19T18:54:56.920 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.642+0000 7f9e067ef700 1 Processor -- start 2024-02-19T18:54:56.920 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.642+0000 7f9e067ef700 1 -- start start 2024-02-19T18:54:56.920 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.642+0000 7f9e067ef700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e00106420 0x7f9e00106840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:56.920 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.642+0000 7f9e067ef700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e00106e10 con 0x7f9e00106420 2024-02-19T18:54:56.920 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.642+0000 7f9dfffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e00106420 0x7f9e00106840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:56.920 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.642+0000 7f9dfffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e00106420 0x7f9e00106840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58592/0 (socket says 172.21.15.96:58592) 2024-02-19T18:54:56.920 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.642+0000 7f9dfffff700 1 -- 172.21.15.96:0/2685957531 learned_addr learned my addr 172.21.15.96:0/2685957531 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:54:56.921 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.643+0000 7f9dfffff700 1 -- 172.21.15.96:0/2685957531 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e00107620 con 0x7f9e00106420 2024-02-19T18:54:56.921 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.643+0000 7f9dfffff700 1 --2- 172.21.15.96:0/2685957531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e00106420 0x7f9e00106840 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9df40098a0 tx=0x7f9df4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741c52330e419b16 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:56.921 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.643+0000 7f9dfeffd700 1 -- 172.21.15.96:0/2685957531 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9df4004180 con 0x7f9e00106420 2024-02-19T18:54:56.921 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.643+0000 7f9dfeffd700 1 -- 172.21.15.96:0/2685957531 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9df40042e0 con 0x7f9e00106420 2024-02-19T18:54:56.921 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.643+0000 7f9dfeffd700 1 -- 172.21.15.96:0/2685957531 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9df4011a50 con 0x7f9e00106420 2024-02-19T18:54:56.921 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.643+0000 7f9e067ef700 1 -- 172.21.15.96:0/2685957531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e00106420 msgr2=0x7f9e00106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:56.921 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.643+0000 7f9e067ef700 1 --2- 172.21.15.96:0/2685957531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e00106420 0x7f9e00106840 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9df40098a0 tx=0x7f9df4009bb0 comp rx=0 tx=0).stop 2024-02-19T18:54:56.921 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.643+0000 7f9e067ef700 1 -- 172.21.15.96:0/2685957531 shutdown_connections 2024-02-19T18:54:56.921 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.643+0000 7f9e067ef700 1 --2- 172.21.15.96:0/2685957531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e00106420 0x7f9e00106840 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:56.921 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.643+0000 7f9e067ef700 1 -- 172.21.15.96:0/2685957531 >> 172.21.15.96:0/2685957531 conn(0x7f9e00101a00 msgr2=0x7f9e00103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:56.921 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.643+0000 7f9e067ef700 1 -- 172.21.15.96:0/2685957531 shutdown_connections 2024-02-19T18:54:56.921 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.643+0000 7f9e067ef700 1 -- 172.21.15.96:0/2685957531 wait complete. 2024-02-19T18:54:56.921 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.644+0000 7f9e067ef700 1 Processor -- start 2024-02-19T18:54:56.921 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.644+0000 7f9e067ef700 1 -- start start 2024-02-19T18:54:56.922 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.644+0000 7f9e067ef700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e00106420 0x7f9e0007bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:56.922 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.644+0000 7f9e067ef700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0007c1a0 con 0x7f9e00106420 2024-02-19T18:54:56.922 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.644+0000 7f9dfffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e00106420 0x7f9e0007bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:56.922 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.644+0000 7f9dfffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e00106420 0x7f9e0007bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58598/0 (socket says 172.21.15.96:58598) 2024-02-19T18:54:56.922 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.644+0000 7f9dfffff700 1 -- 172.21.15.96:0/2367000083 learned_addr learned my addr 172.21.15.96:0/2367000083 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:54:56.922 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.645+0000 7f9dfffff700 1 -- 172.21.15.96:0/2367000083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df4009550 con 0x7f9e00106420 2024-02-19T18:54:56.922 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.645+0000 7f9dfffff700 1 --2- 172.21.15.96:0/2367000083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e00106420 0x7f9e0007bc60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9df4006af0 tx=0x7f9df4011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:56.922 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.645+0000 7f9dfd7fa700 1 -- 172.21.15.96:0/2367000083 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9df4003b90 con 0x7f9e00106420 2024-02-19T18:54:56.922 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.645+0000 7f9e067ef700 1 -- 172.21.15.96:0/2367000083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0007a2b0 con 0x7f9e00106420 2024-02-19T18:54:56.922 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.645+0000 7f9dfd7fa700 1 -- 172.21.15.96:0/2367000083 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9df401a8a0 con 0x7f9e00106420 2024-02-19T18:54:56.922 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.645+0000 7f9dfd7fa700 1 -- 172.21.15.96:0/2367000083 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9df4019880 con 0x7f9e00106420 2024-02-19T18:54:56.922 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.645+0000 7f9e067ef700 1 -- 172.21.15.96:0/2367000083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e0007a750 con 0x7f9e00106420 2024-02-19T18:54:56.922 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.646+0000 7f9dfd7fa700 1 -- 172.21.15.96:0/2367000083 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 4) v1 ==== 45272+0+0 (secure 0 0 0) 0x7f9df4019b40 con 0x7f9e00106420 2024-02-19T18:54:56.922 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.646+0000 7f9dfd7fa700 1 --2- 172.21.15.96:0/2367000083 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f9de8038290 0x7f9de803a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:56.923 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.646+0000 7f9dfd7fa700 1 -- 172.21.15.96:0/2367000083 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9df404c6a0 con 0x7f9e00106420 2024-02-19T18:54:56.923 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.646+0000 7f9dff7fe700 1 --2- 172.21.15.96:0/2367000083 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f9de8038290 0x7f9de803a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:56.923 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.646+0000 7f9e067ef700 1 -- 172.21.15.96:0/2367000083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e000623c0 con 0x7f9e00106420 2024-02-19T18:54:56.923 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.646+0000 7f9dff7fe700 1 --2- 172.21.15.96:0/2367000083 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f9de8038290 0x7f9de803a750 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9df0006fd0 tx=0x7f9df0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:56.923 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.651+0000 7f9dfd7fa700 1 -- 172.21.15.96:0/2367000083 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9df402c3a0 con 0x7f9e00106420 2024-02-19T18:54:56.923 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:55.894+0000 7f9e067ef700 1 -- 172.21.15.96:0/2367000083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f9e0007b140 con 0x7f9e00106420 2024-02-19T18:54:56.923 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:56.311+0000 7f9dfd7fa700 1 -- 172.21.15.96:0/2367000083 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 5) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f9df4016d40 con 0x7f9e00106420 2024-02-19T18:54:56.923 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:56.312+0000 7f9dfd7fa700 1 -- 172.21.15.96:0/2367000083 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f9df402dce0 con 0x7f9e00106420 2024-02-19T18:54:56.923 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:56.315+0000 7f9e067ef700 1 -- 172.21.15.96:0/2367000083 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f9de8038290 msgr2=0x7f9de803a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:56.923 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:56.315+0000 7f9e067ef700 1 --2- 172.21.15.96:0/2367000083 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f9de8038290 0x7f9de803a750 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9df0006fd0 tx=0x7f9df0006e40 comp rx=0 tx=0).stop 2024-02-19T18:54:56.923 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:56.315+0000 7f9e067ef700 1 -- 172.21.15.96:0/2367000083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e00106420 msgr2=0x7f9e0007bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:56.923 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:56.315+0000 7f9e067ef700 1 --2- 172.21.15.96:0/2367000083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e00106420 0x7f9e0007bc60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9df4006af0 tx=0x7f9df4011a90 comp rx=0 tx=0).stop 2024-02-19T18:54:56.923 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:56.315+0000 7f9e067ef700 1 -- 172.21.15.96:0/2367000083 shutdown_connections 2024-02-19T18:54:56.923 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:56.315+0000 7f9e067ef700 1 --2- 172.21.15.96:0/2367000083 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f9de8038290 0x7f9de803a750 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:56.924 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:56.315+0000 7f9e067ef700 1 --2- 172.21.15.96:0/2367000083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e00106420 0x7f9e0007bc60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:56.924 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:56.315+0000 7f9e067ef700 1 -- 172.21.15.96:0/2367000083 >> 172.21.15.96:0/2367000083 conn(0x7f9e00101a00 msgr2=0x7f9e001027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:56.924 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:56.315+0000 7f9e067ef700 1 -- 172.21.15.96:0/2367000083 shutdown_connections 2024-02-19T18:54:56.924 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:56.315+0000 7f9e067ef700 1 -- 172.21.15.96:0/2367000083 wait complete. 2024-02-19T18:54:57.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:57 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/2367000083' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-19T18:54:57.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:57 smithi096 ceph-mon[29216]: mgrmap e5: smithi096.zsjdff(active, since 6s) 2024-02-19T18:54:58.202 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout { 2024-02-19T18:54:58.202 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-02-19T18:54:58.202 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-19T18:54:58.202 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "active_name": "smithi096.zsjdff", 2024-02-19T18:54:58.202 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-19T18:54:58.202 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout } 2024-02-19T18:54:58.202 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.348+0000 7f6808350700 1 Processor -- start 2024-02-19T18:54:58.202 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.348+0000 7f6808350700 1 -- start start 2024-02-19T18:54:58.202 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.348+0000 7f6808350700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6800106ef0 0x7f68001092e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:58.202 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.348+0000 7f6808350700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6800074640 con 0x7f6800106ef0 2024-02-19T18:54:58.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.349+0000 7f68060ec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6800106ef0 0x7f68001092e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:58.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.349+0000 7f68060ec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6800106ef0 0x7f68001092e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58622/0 (socket says 172.21.15.96:58622) 2024-02-19T18:54:58.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.349+0000 7f68060ec700 1 -- 172.21.15.96:0/3896949448 learned_addr learned my addr 172.21.15.96:0/3896949448 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:54:58.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.349+0000 7f68060ec700 1 -- 172.21.15.96:0/3896949448 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6800109820 con 0x7f6800106ef0 2024-02-19T18:54:58.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.349+0000 7f68060ec700 1 --2- 172.21.15.96:0/3896949448 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6800106ef0 0x7f68001092e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f67f00098a0 tx=0x7f67f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f593b16b9416c server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:58.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.349+0000 7f68050ea700 1 -- 172.21.15.96:0/3896949448 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f67f0004180 con 0x7f6800106ef0 2024-02-19T18:54:58.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.349+0000 7f68050ea700 1 -- 172.21.15.96:0/3896949448 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f67f00042e0 con 0x7f6800106ef0 2024-02-19T18:54:58.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.349+0000 7f68050ea700 1 -- 172.21.15.96:0/3896949448 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f67f0011a50 con 0x7f6800106ef0 2024-02-19T18:54:58.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.350+0000 7f6808350700 1 -- 172.21.15.96:0/3896949448 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6800106ef0 msgr2=0x7f68001092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:58.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.350+0000 7f6808350700 1 --2- 172.21.15.96:0/3896949448 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6800106ef0 0x7f68001092e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f67f00098a0 tx=0x7f67f0009bb0 comp rx=0 tx=0).stop 2024-02-19T18:54:58.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.350+0000 7f6808350700 1 -- 172.21.15.96:0/3896949448 shutdown_connections 2024-02-19T18:54:58.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.350+0000 7f6808350700 1 --2- 172.21.15.96:0/3896949448 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6800106ef0 0x7f68001092e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:58.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.350+0000 7f6808350700 1 -- 172.21.15.96:0/3896949448 >> 172.21.15.96:0/3896949448 conn(0x7f68001008c0 msgr2=0x7f6800102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:58.203 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.350+0000 7f6808350700 1 -- 172.21.15.96:0/3896949448 shutdown_connections 2024-02-19T18:54:58.204 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.350+0000 7f6808350700 1 -- 172.21.15.96:0/3896949448 wait complete. 2024-02-19T18:54:58.204 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.351+0000 7f6808350700 1 Processor -- start 2024-02-19T18:54:58.204 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.351+0000 7f6808350700 1 -- start start 2024-02-19T18:54:58.204 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.351+0000 7f6808350700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6800106ef0 0x7f680019a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:58.204 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.351+0000 7f6808350700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680019a660 con 0x7f6800106ef0 2024-02-19T18:54:58.204 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.351+0000 7f68060ec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6800106ef0 0x7f680019a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:54:58.204 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.351+0000 7f68060ec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6800106ef0 0x7f680019a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58628/0 (socket says 172.21.15.96:58628) 2024-02-19T18:54:58.204 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.351+0000 7f68060ec700 1 -- 172.21.15.96:0/3767393352 learned_addr learned my addr 172.21.15.96:0/3767393352 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:54:58.204 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.352+0000 7f68060ec700 1 -- 172.21.15.96:0/3767393352 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f0009550 con 0x7f6800106ef0 2024-02-19T18:54:58.204 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.352+0000 7f68060ec700 1 --2- 172.21.15.96:0/3767393352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6800106ef0 0x7f680019a120 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f67f0003f80 tx=0x7f67f0011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:54:58.204 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.352+0000 7f67f77fe700 1 -- 172.21.15.96:0/3767393352 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f67f0003a80 con 0x7f6800106ef0 2024-02-19T18:54:58.204 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.352+0000 7f67f77fe700 1 -- 172.21.15.96:0/3767393352 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f67f0003be0 con 0x7f6800106ef0 2024-02-19T18:54:58.204 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.352+0000 7f6808350700 1 -- 172.21.15.96:0/3767393352 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680019a860 con 0x7f6800106ef0 2024-02-19T18:54:58.205 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.352+0000 7f67f77fe700 1 -- 172.21.15.96:0/3767393352 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f67f0019820 con 0x7f6800106ef0 2024-02-19T18:54:58.205 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.352+0000 7f6808350700 1 -- 172.21.15.96:0/3767393352 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680019ad00 con 0x7f6800106ef0 2024-02-19T18:54:58.205 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.353+0000 7f67f77fe700 1 -- 172.21.15.96:0/3767393352 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f67f0019aa0 con 0x7f6800106ef0 2024-02-19T18:54:58.205 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.353+0000 7f6808350700 1 -- 172.21.15.96:0/3767393352 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f680010a570 con 0x7f6800106ef0 2024-02-19T18:54:58.205 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.353+0000 7f67f77fe700 1 --2- 172.21.15.96:0/3767393352 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f67ec0382d0 0x7f67ec03a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:54:58.205 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.353+0000 7f68058eb700 1 -- 172.21.15.96:0/3767393352 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f67ec0382d0 msgr2=0x7f67ec03a790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/1286321532 2024-02-19T18:54:58.205 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.353+0000 7f67f77fe700 1 -- 172.21.15.96:0/3767393352 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f67f004c560 con 0x7f6800106ef0 2024-02-19T18:54:58.205 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.353+0000 7f68058eb700 1 --2- 172.21.15.96:0/3767393352 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f67ec0382d0 0x7f67ec03a790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T18:54:58.205 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.358+0000 7f67f77fe700 1 -- 172.21.15.96:0/3767393352 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f67f002b750 con 0x7f6800106ef0 2024-02-19T18:54:58.205 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.554+0000 7f68058eb700 1 -- 172.21.15.96:0/3767393352 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f67ec0382d0 msgr2=0x7f67ec03a790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/1286321532 2024-02-19T18:54:58.205 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.554+0000 7f68058eb700 1 --2- 172.21.15.96:0/3767393352 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f67ec0382d0 0x7f67ec03a790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-19T18:54:58.205 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.612+0000 7f6808350700 1 -- 172.21.15.96:0/3767393352 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f680019dae0 con 0x7f6800106ef0 2024-02-19T18:54:58.205 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.613+0000 7f67f77fe700 1 -- 172.21.15.96:0/3767393352 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f67f00172b0 con 0x7f6800106ef0 2024-02-19T18:54:58.205 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.615+0000 7f6808350700 1 -- 172.21.15.96:0/3767393352 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f67ec0382d0 msgr2=0x7f67ec03a790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T18:54:58.206 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.615+0000 7f6808350700 1 --2- 172.21.15.96:0/3767393352 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f67ec0382d0 0x7f67ec03a790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:58.206 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.615+0000 7f6808350700 1 -- 172.21.15.96:0/3767393352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6800106ef0 msgr2=0x7f680019a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:54:58.206 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.615+0000 7f6808350700 1 --2- 172.21.15.96:0/3767393352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6800106ef0 0x7f680019a120 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f67f0003f80 tx=0x7f67f0011ab0 comp rx=0 tx=0).stop 2024-02-19T18:54:58.206 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.615+0000 7f6808350700 1 -- 172.21.15.96:0/3767393352 shutdown_connections 2024-02-19T18:54:58.206 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.615+0000 7f6808350700 1 --2- 172.21.15.96:0/3767393352 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f67ec0382d0 0x7f67ec03a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:58.206 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.615+0000 7f6808350700 1 --2- 172.21.15.96:0/3767393352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6800106ef0 0x7f680019a120 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:54:58.206 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.615+0000 7f6808350700 1 -- 172.21.15.96:0/3767393352 >> 172.21.15.96:0/3767393352 conn(0x7f68001008c0 msgr2=0x7f6800101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:54:58.206 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.615+0000 7f6808350700 1 -- 172.21.15.96:0/3767393352 shutdown_connections 2024-02-19T18:54:58.206 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:57.615+0000 7f6808350700 1 -- 172.21.15.96:0/3767393352 wait complete. 2024-02-19T18:54:58.206 INFO:teuthology.orchestra.run.smithi096.stdout:Waiting for the mgr to restart... 2024-02-19T18:54:58.206 INFO:teuthology.orchestra.run.smithi096.stdout:Waiting for mgr epoch 5... 2024-02-19T18:54:58.451 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:54:58 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/3767393352' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-19T18:55:03.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:03 smithi096 ceph-mon[29216]: Active manager daemon smithi096.zsjdff restarted 2024-02-19T18:55:03.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:03 smithi096 ceph-mon[29216]: Activating manager daemon smithi096.zsjdff 2024-02-19T18:55:03.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:03 smithi096 ceph-mon[29216]: osdmap e2: 0 total, 0 up, 0 in 2024-02-19T18:55:03.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:03 smithi096 ceph-mon[29216]: mgrmap e6: smithi096.zsjdff(active, starting, since 0.00343532s) 2024-02-19T18:55:03.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:03 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2024-02-19T18:55:03.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:03 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr metadata", "who": "smithi096.zsjdff", "id": "smithi096.zsjdff"}]: dispatch 2024-02-19T18:55:03.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:03 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T18:55:03.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:03 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T18:55:03.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:03 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T18:55:03.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:03 smithi096 ceph-mon[29216]: Manager daemon smithi096.zsjdff is now available 2024-02-19T18:55:03.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:03 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:03.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:03 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:03.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:03 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:55:03.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:03 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:55:03.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:03 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:55:04.391 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:04 smithi096 ceph-mon[29216]: Found migration_current of "None". Setting to last migration. 2024-02-19T18:55:04.391 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:04 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.zsjdff/mirror_snapshot_schedule"}]: dispatch 2024-02-19T18:55:04.391 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:04 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.zsjdff/trash_purge_schedule"}]: dispatch 2024-02-19T18:55:04.391 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:04 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:04.391 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:04 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:04.391 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:04 smithi096 ceph-mon[29216]: mgrmap e7: smithi096.zsjdff(active, since 1.00558s) 2024-02-19T18:55:04.391 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:04 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:55:04.626 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout { 2024-02-19T18:55:04.626 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-02-19T18:55:04.626 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-19T18:55:04.626 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout } 2024-02-19T18:55:04.626 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.621+0000 7f7b5bf9b700 1 Processor -- start 2024-02-19T18:55:04.626 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.621+0000 7f7b5bf9b700 1 -- start start 2024-02-19T18:55:04.626 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.621+0000 7f7b5bf9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54106f80 0x7f7b54109370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:04.626 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.621+0000 7f7b5bf9b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b54079e00 con 0x7f7b54106f80 2024-02-19T18:55:04.626 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.622+0000 7f7b59d37700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54106f80 0x7f7b54109370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:04.626 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.622+0000 7f7b59d37700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54106f80 0x7f7b54109370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58644/0 (socket says 172.21.15.96:58644) 2024-02-19T18:55:04.626 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.622+0000 7f7b59d37700 1 -- 172.21.15.96:0/2526696859 learned_addr learned my addr 172.21.15.96:0/2526696859 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:04.627 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.622+0000 7f7b59d37700 1 -- 172.21.15.96:0/2526696859 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b54079f40 con 0x7f7b54106f80 2024-02-19T18:55:04.627 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.622+0000 7f7b59d37700 1 --2- 172.21.15.96:0/2526696859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54106f80 0x7f7b54109370 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7b440098a0 tx=0x7f7b44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc2be6e4dc3270 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:04.627 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.622+0000 7f7b58d35700 1 -- 172.21.15.96:0/2526696859 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b44004180 con 0x7f7b54106f80 2024-02-19T18:55:04.627 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.622+0000 7f7b58d35700 1 -- 172.21.15.96:0/2526696859 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7b440042e0 con 0x7f7b54106f80 2024-02-19T18:55:04.627 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.622+0000 7f7b58d35700 1 -- 172.21.15.96:0/2526696859 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b44011a50 con 0x7f7b54106f80 2024-02-19T18:55:04.627 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.623+0000 7f7b5bf9b700 1 -- 172.21.15.96:0/2526696859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54106f80 msgr2=0x7f7b54109370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:04.627 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.623+0000 7f7b5bf9b700 1 --2- 172.21.15.96:0/2526696859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54106f80 0x7f7b54109370 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7b440098a0 tx=0x7f7b44009bb0 comp rx=0 tx=0).stop 2024-02-19T18:55:04.627 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.623+0000 7f7b5bf9b700 1 -- 172.21.15.96:0/2526696859 shutdown_connections 2024-02-19T18:55:04.627 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.623+0000 7f7b5bf9b700 1 --2- 172.21.15.96:0/2526696859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54106f80 0x7f7b54109370 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:04.627 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.623+0000 7f7b5bf9b700 1 -- 172.21.15.96:0/2526696859 >> 172.21.15.96:0/2526696859 conn(0x7f7b541008d0 msgr2=0x7f7b54102d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:04.627 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.623+0000 7f7b5bf9b700 1 -- 172.21.15.96:0/2526696859 shutdown_connections 2024-02-19T18:55:04.627 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.623+0000 7f7b5bf9b700 1 -- 172.21.15.96:0/2526696859 wait complete. 2024-02-19T18:55:04.627 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.623+0000 7f7b5bf9b700 1 Processor -- start 2024-02-19T18:55:04.627 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.623+0000 7f7b5bf9b700 1 -- start start 2024-02-19T18:55:04.628 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.624+0000 7f7b5bf9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54106f80 0x7f7b5419a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:04.628 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.624+0000 7f7b5bf9b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5419a610 con 0x7f7b54106f80 2024-02-19T18:55:04.628 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.624+0000 7f7b59d37700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54106f80 0x7f7b5419a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:04.628 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.624+0000 7f7b59d37700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54106f80 0x7f7b5419a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58648/0 (socket says 172.21.15.96:58648) 2024-02-19T18:55:04.628 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.624+0000 7f7b59d37700 1 -- 172.21.15.96:0/2189924124 learned_addr learned my addr 172.21.15.96:0/2189924124 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:04.628 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.624+0000 7f7b59d37700 1 -- 172.21.15.96:0/2189924124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b44009550 con 0x7f7b54106f80 2024-02-19T18:55:04.628 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.624+0000 7f7b59d37700 1 --2- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54106f80 0x7f7b5419a0d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7b44003de0 tx=0x7f7b44011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:04.628 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.624+0000 7f7b4affd700 1 -- 172.21.15.96:0/2189924124 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b44003930 con 0x7f7b54106f80 2024-02-19T18:55:04.628 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.624+0000 7f7b4affd700 1 -- 172.21.15.96:0/2189924124 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7b44003a90 con 0x7f7b54106f80 2024-02-19T18:55:04.628 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.624+0000 7f7b5bf9b700 1 -- 172.21.15.96:0/2189924124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b5419a810 con 0x7f7b54106f80 2024-02-19T18:55:04.628 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.624+0000 7f7b5bf9b700 1 -- 172.21.15.96:0/2189924124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b5419acb0 con 0x7f7b54106f80 2024-02-19T18:55:04.628 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.624+0000 7f7b4affd700 1 -- 172.21.15.96:0/2189924124 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7b44019730 con 0x7f7b54106f80 2024-02-19T18:55:04.628 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.625+0000 7f7b4affd700 1 -- 172.21.15.96:0/2189924124 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f7b440199a0 con 0x7f7b54106f80 2024-02-19T18:55:04.628 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.625+0000 7f7b4affd700 1 --2- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f7b40038370 0x7f7b4003a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:04.629 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.625+0000 7f7b4affd700 1 -- 172.21.15.96:0/2189924124 --> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b4003af40 con 0x7f7b40038370 2024-02-19T18:55:04.629 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.625+0000 7f7b4affd700 1 -- 172.21.15.96:0/2189924124 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7b4404c0e0 con 0x7f7b54106f80 2024-02-19T18:55:04.629 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.625+0000 7f7b59536700 1 -- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f7b40038370 msgr2=0x7f7b4003a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/1286321532 2024-02-19T18:55:04.629 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.625+0000 7f7b59536700 1 --2- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f7b40038370 0x7f7b4003a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T18:55:04.629 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.826+0000 7f7b59536700 1 -- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f7b40038370 msgr2=0x7f7b4003a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/1286321532 2024-02-19T18:55:04.629 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:58.826+0000 7f7b59536700 1 --2- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f7b40038370 0x7f7b4003a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-19T18:55:04.629 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:59.227+0000 7f7b59536700 1 -- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f7b40038370 msgr2=0x7f7b4003a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/1286321532 2024-02-19T18:55:04.629 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:54:59.227+0000 7f7b59536700 1 --2- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f7b40038370 0x7f7b4003a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-19T18:55:04.629 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:00.028+0000 7f7b59536700 1 -- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f7b40038370 msgr2=0x7f7b4003a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/1286321532 2024-02-19T18:55:04.629 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:00.028+0000 7f7b59536700 1 --2- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f7b40038370 0x7f7b4003a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-19T18:55:04.629 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:01.629+0000 7f7b59536700 1 -- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f7b40038370 msgr2=0x7f7b4003a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/1286321532 2024-02-19T18:55:04.629 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:01.629+0000 7f7b59536700 1 --2- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f7b40038370 0x7f7b4003a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-19T18:55:04.629 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:03.069+0000 7f7b4affd700 1 -- 172.21.15.96:0/2189924124 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mgrmap(e 6) v1 ==== 45050+0+0 (secure 0 0 0) 0x7f7b4400fd80 con 0x7f7b54106f80 2024-02-19T18:55:04.629 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:03.069+0000 7f7b4affd700 1 -- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f7b40038370 msgr2=0x7f7b4003a830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T18:55:04.629 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:03.069+0000 7f7b4affd700 1 --2- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f7b40038370 0x7f7b4003a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:04.629 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.070+0000 7f7b4affd700 1 -- 172.21.15.96:0/2189924124 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 7) v1 ==== 45177+0+0 (secure 0 0 0) 0x7f7b44025b50 con 0x7f7b54106f80 2024-02-19T18:55:04.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.070+0000 7f7b4affd700 1 --2- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7b4003bc50 0x7f7b4003e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:04.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.070+0000 7f7b4affd700 1 -- 172.21.15.96:0/2189924124 --> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b4003af40 con 0x7f7b4003bc50 2024-02-19T18:55:04.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.071+0000 7f7b59536700 1 --2- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7b4003bc50 0x7f7b4003e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:04.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.071+0000 7f7b59536700 1 --2- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7b4003bc50 0x7f7b4003e040 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7b50003a10 tx=0x7f7b500092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:04.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.072+0000 7f7b4affd700 1 -- 172.21.15.96:0/2189924124 <== mgr.14120 v2:172.21.15.96:6800/3697355606 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f7b4003af40 con 0x7f7b4003bc50 2024-02-19T18:55:04.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.078+0000 7f7b5bf9b700 1 -- 172.21.15.96:0/2189924124 --> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f7b5419b410 con 0x7f7b4003bc50 2024-02-19T18:55:04.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.078+0000 7f7b4affd700 1 -- 172.21.15.96:0/2189924124 <== mgr.14120 v2:172.21.15.96:6800/3697355606 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f7b5419b410 con 0x7f7b4003bc50 2024-02-19T18:55:04.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.078+0000 7f7b5bf9b700 1 -- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7b4003bc50 msgr2=0x7f7b4003e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:04.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.078+0000 7f7b5bf9b700 1 --2- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7b4003bc50 0x7f7b4003e040 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7b50003a10 tx=0x7f7b500092b0 comp rx=0 tx=0).stop 2024-02-19T18:55:04.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.078+0000 7f7b5bf9b700 1 -- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54106f80 msgr2=0x7f7b5419a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:04.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.078+0000 7f7b5bf9b700 1 --2- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54106f80 0x7f7b5419a0d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7b44003de0 tx=0x7f7b44011ab0 comp rx=0 tx=0).stop 2024-02-19T18:55:04.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.078+0000 7f7b5bf9b700 1 -- 172.21.15.96:0/2189924124 shutdown_connections 2024-02-19T18:55:04.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.078+0000 7f7b5bf9b700 1 --2- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7b4003bc50 0x7f7b4003e040 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:04.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.078+0000 7f7b5bf9b700 1 --2- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b54106f80 0x7f7b5419a0d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:04.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.078+0000 7f7b5bf9b700 1 --2- 172.21.15.96:0/2189924124 >> [v2:172.21.15.96:6800/1286321532,v1:172.21.15.96:6801/1286321532] conn(0x7f7b40038370 0x7f7b4003a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:04.630 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.078+0000 7f7b5bf9b700 1 -- 172.21.15.96:0/2189924124 >> 172.21.15.96:0/2189924124 conn(0x7f7b541008d0 msgr2=0x7f7b541016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:04.631 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.078+0000 7f7b5bf9b700 1 -- 172.21.15.96:0/2189924124 shutdown_connections 2024-02-19T18:55:04.631 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.079+0000 7f7b5bf9b700 1 -- 172.21.15.96:0/2189924124 wait complete. 2024-02-19T18:55:04.631 INFO:teuthology.orchestra.run.smithi096.stdout:mgr epoch 5 is available 2024-02-19T18:55:04.631 INFO:teuthology.orchestra.run.smithi096.stdout:Setting orchestrator backend to cephadm... 2024-02-19T18:55:05.231 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:05 smithi096 ceph-mon[29216]: [19/Feb/2024:18:55:03] ENGINE Bus STARTING 2024-02-19T18:55:05.231 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:05 smithi096 ceph-mon[29216]: [19/Feb/2024:18:55:03] ENGINE Serving on http://172.21.15.96:8765 2024-02-19T18:55:05.231 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:05 smithi096 ceph-mon[29216]: [19/Feb/2024:18:55:04] ENGINE Serving on https://172.21.15.96:7150 2024-02-19T18:55:05.231 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:05 smithi096 ceph-mon[29216]: [19/Feb/2024:18:55:04] ENGINE Bus STARTED 2024-02-19T18:55:05.231 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:05 smithi096 ceph-mon[29216]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-19T18:55:05.231 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:05 smithi096 ceph-mon[29216]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-19T18:55:05.823 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.978+0000 7ff76d5e7700 1 Processor -- start 2024-02-19T18:55:05.823 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.978+0000 7ff76d5e7700 1 -- start start 2024-02-19T18:55:05.823 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.979+0000 7ff76d5e7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff768106ef0 0x7ff7681092e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:05.823 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.979+0000 7ff76d5e7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff768074640 con 0x7ff768106ef0 2024-02-19T18:55:05.823 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.979+0000 7ff766ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff768106ef0 0x7ff7681092e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:05.823 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.979+0000 7ff766ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff768106ef0 0x7ff7681092e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57306/0 (socket says 172.21.15.96:57306) 2024-02-19T18:55:05.823 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.979+0000 7ff766ffd700 1 -- 172.21.15.96:0/1076209702 learned_addr learned my addr 172.21.15.96:0/1076209702 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:05.823 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.979+0000 7ff766ffd700 1 -- 172.21.15.96:0/1076209702 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff768109820 con 0x7ff768106ef0 2024-02-19T18:55:05.823 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.979+0000 7ff766ffd700 1 --2- 172.21.15.96:0/1076209702 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff768106ef0 0x7ff7681092e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0098a0 tx=0x7ff75c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7271c7954f4d21 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:05.824 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.979+0000 7ff765ffb700 1 -- 172.21.15.96:0/1076209702 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff75c004180 con 0x7ff768106ef0 2024-02-19T18:55:05.824 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.979+0000 7ff765ffb700 1 -- 172.21.15.96:0/1076209702 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff75c0042e0 con 0x7ff768106ef0 2024-02-19T18:55:05.824 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.979+0000 7ff765ffb700 1 -- 172.21.15.96:0/1076209702 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff75c011a50 con 0x7ff768106ef0 2024-02-19T18:55:05.824 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.980+0000 7ff76d5e7700 1 -- 172.21.15.96:0/1076209702 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff768106ef0 msgr2=0x7ff7681092e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:05.824 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.980+0000 7ff76d5e7700 1 --2- 172.21.15.96:0/1076209702 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff768106ef0 0x7ff7681092e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff75c0098a0 tx=0x7ff75c009bb0 comp rx=0 tx=0).stop 2024-02-19T18:55:05.824 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.980+0000 7ff76d5e7700 1 -- 172.21.15.96:0/1076209702 shutdown_connections 2024-02-19T18:55:05.824 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.980+0000 7ff76d5e7700 1 --2- 172.21.15.96:0/1076209702 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff768106ef0 0x7ff7681092e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:05.824 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.980+0000 7ff76d5e7700 1 -- 172.21.15.96:0/1076209702 >> 172.21.15.96:0/1076209702 conn(0x7ff7681008c0 msgr2=0x7ff768102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:05.824 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.980+0000 7ff76d5e7700 1 -- 172.21.15.96:0/1076209702 shutdown_connections 2024-02-19T18:55:05.824 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.980+0000 7ff76d5e7700 1 -- 172.21.15.96:0/1076209702 wait complete. 2024-02-19T18:55:05.824 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.981+0000 7ff76d5e7700 1 Processor -- start 2024-02-19T18:55:05.825 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.981+0000 7ff76d5e7700 1 -- start start 2024-02-19T18:55:05.825 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.981+0000 7ff76d5e7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff768106ef0 0x7ff768106850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:05.825 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.981+0000 7ff76d5e7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff768106d90 con 0x7ff768106ef0 2024-02-19T18:55:05.825 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.981+0000 7ff766ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff768106ef0 0x7ff768106850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:05.825 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.981+0000 7ff766ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff768106ef0 0x7ff768106850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57308/0 (socket says 172.21.15.96:57308) 2024-02-19T18:55:05.825 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.981+0000 7ff766ffd700 1 -- 172.21.15.96:0/3975215761 learned_addr learned my addr 172.21.15.96:0/3975215761 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:05.825 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.981+0000 7ff766ffd700 1 -- 172.21.15.96:0/3975215761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff75c009550 con 0x7ff768106ef0 2024-02-19T18:55:05.825 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.981+0000 7ff766ffd700 1 --2- 172.21.15.96:0/3975215761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff768106ef0 0x7ff768106850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff75c003f80 tx=0x7ff75c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:05.825 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.981+0000 7ff74ffff700 1 -- 172.21.15.96:0/3975215761 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff75c003a80 con 0x7ff768106ef0 2024-02-19T18:55:05.825 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.982+0000 7ff74ffff700 1 -- 172.21.15.96:0/3975215761 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff75c003be0 con 0x7ff768106ef0 2024-02-19T18:55:05.825 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.982+0000 7ff76d5e7700 1 -- 172.21.15.96:0/3975215761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff768104ea0 con 0x7ff768106ef0 2024-02-19T18:55:05.825 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.982+0000 7ff74ffff700 1 -- 172.21.15.96:0/3975215761 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff75c019820 con 0x7ff768106ef0 2024-02-19T18:55:05.825 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.982+0000 7ff76d5e7700 1 -- 172.21.15.96:0/3975215761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff768105340 con 0x7ff768106ef0 2024-02-19T18:55:05.825 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.982+0000 7ff74ffff700 1 -- 172.21.15.96:0/3975215761 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 7) v1 ==== 45177+0+0 (secure 0 0 0) 0x7ff75c019aa0 con 0x7ff768106ef0 2024-02-19T18:55:05.826 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.982+0000 7ff76d5e7700 1 -- 172.21.15.96:0/3975215761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff76810a570 con 0x7ff768106ef0 2024-02-19T18:55:05.826 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.983+0000 7ff74ffff700 1 --2- 172.21.15.96:0/3975215761 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7ff7500381a0 0x7ff75003a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:05.826 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.983+0000 7ff74ffff700 1 -- 172.21.15.96:0/3975215761 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff75c04c390 con 0x7ff768106ef0 2024-02-19T18:55:05.826 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.983+0000 7ff7667fc700 1 --2- 172.21.15.96:0/3975215761 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7ff7500381a0 0x7ff75003a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:05.826 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.983+0000 7ff7667fc700 1 --2- 172.21.15.96:0/3975215761 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7ff7500381a0 0x7ff75003a660 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff758006fd0 tx=0x7ff758006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:05.826 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:04.987+0000 7ff74ffff700 1 -- 172.21.15.96:0/3975215761 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff75c02b750 con 0x7ff768106ef0 2024-02-19T18:55:05.826 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:05.121+0000 7ff74ffff700 1 -- 172.21.15.96:0/3975215761 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7ff75c019d50 con 0x7ff768106ef0 2024-02-19T18:55:05.826 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:05.192+0000 7ff76d5e7700 1 -- 172.21.15.96:0/3975215761 --> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7ff768102bc0 con 0x7ff7500381a0 2024-02-19T18:55:05.826 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:05.200+0000 7ff74ffff700 1 -- 172.21.15.96:0/3975215761 <== mgr.14120 v2:172.21.15.96:6800/3697355606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff768102bc0 con 0x7ff7500381a0 2024-02-19T18:55:05.826 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:05.202+0000 7ff76d5e7700 1 -- 172.21.15.96:0/3975215761 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7ff7500381a0 msgr2=0x7ff75003a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:05.826 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:05.202+0000 7ff76d5e7700 1 --2- 172.21.15.96:0/3975215761 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7ff7500381a0 0x7ff75003a660 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff758006fd0 tx=0x7ff758006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:05.826 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:05.202+0000 7ff76d5e7700 1 -- 172.21.15.96:0/3975215761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff768106ef0 msgr2=0x7ff768106850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:05.826 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:05.202+0000 7ff76d5e7700 1 --2- 172.21.15.96:0/3975215761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff768106ef0 0x7ff768106850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff75c003f80 tx=0x7ff75c011ab0 comp rx=0 tx=0).stop 2024-02-19T18:55:05.826 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:05.202+0000 7ff76d5e7700 1 -- 172.21.15.96:0/3975215761 shutdown_connections 2024-02-19T18:55:05.826 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:05.202+0000 7ff76d5e7700 1 --2- 172.21.15.96:0/3975215761 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7ff7500381a0 0x7ff75003a660 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:05.827 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:05.202+0000 7ff76d5e7700 1 --2- 172.21.15.96:0/3975215761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff768106ef0 0x7ff768106850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:05.827 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:05.202+0000 7ff76d5e7700 1 -- 172.21.15.96:0/3975215761 >> 172.21.15.96:0/3975215761 conn(0x7ff7681008c0 msgr2=0x7ff768101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:05.827 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:05.202+0000 7ff76d5e7700 1 -- 172.21.15.96:0/3975215761 shutdown_connections 2024-02-19T18:55:05.827 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:05.202+0000 7ff76d5e7700 1 -- 172.21.15.96:0/3975215761 wait complete. 2024-02-19T18:55:06.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:06 smithi096 ceph-mon[29216]: mgrmap e8: smithi096.zsjdff(active, since 2s) 2024-02-19T18:55:06.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:06 smithi096 ceph-mon[29216]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:55:06.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:06 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:06.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:06 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:55:07.111 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout value unchanged 2024-02-19T18:55:07.111 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.304+0000 7f615b2c0700 1 Processor -- start 2024-02-19T18:55:07.111 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.305+0000 7f615b2c0700 1 -- start start 2024-02-19T18:55:07.111 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.305+0000 7f615b2c0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6154106420 0x7f6154106840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:07.111 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.305+0000 7f615b2c0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6154106e10 con 0x7f6154106420 2024-02-19T18:55:07.111 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.305+0000 7f615905c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6154106420 0x7f6154106840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:07.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.305+0000 7f615905c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6154106420 0x7f6154106840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57310/0 (socket says 172.21.15.96:57310) 2024-02-19T18:55:07.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.305+0000 7f615905c700 1 -- 172.21.15.96:0/3964020108 learned_addr learned my addr 172.21.15.96:0/3964020108 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:07.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.305+0000 7f615905c700 1 -- 172.21.15.96:0/3964020108 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6154107620 con 0x7f6154106420 2024-02-19T18:55:07.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.305+0000 7f615905c700 1 --2- 172.21.15.96:0/3964020108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6154106420 0x7f6154106840 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f61440098a0 tx=0x7f6144009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf137b3d33b4e977 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:07.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.305+0000 7f614bfff700 1 -- 172.21.15.96:0/3964020108 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6144004180 con 0x7f6154106420 2024-02-19T18:55:07.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.305+0000 7f614bfff700 1 -- 172.21.15.96:0/3964020108 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f61440042e0 con 0x7f6154106420 2024-02-19T18:55:07.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.305+0000 7f614bfff700 1 -- 172.21.15.96:0/3964020108 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6144011a50 con 0x7f6154106420 2024-02-19T18:55:07.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.306+0000 7f615b2c0700 1 -- 172.21.15.96:0/3964020108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6154106420 msgr2=0x7f6154106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:07.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.306+0000 7f615b2c0700 1 --2- 172.21.15.96:0/3964020108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6154106420 0x7f6154106840 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f61440098a0 tx=0x7f6144009bb0 comp rx=0 tx=0).stop 2024-02-19T18:55:07.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.306+0000 7f615b2c0700 1 -- 172.21.15.96:0/3964020108 shutdown_connections 2024-02-19T18:55:07.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.306+0000 7f615b2c0700 1 --2- 172.21.15.96:0/3964020108 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6154106420 0x7f6154106840 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:07.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.306+0000 7f615b2c0700 1 -- 172.21.15.96:0/3964020108 >> 172.21.15.96:0/3964020108 conn(0x7f6154101a00 msgr2=0x7f6154103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:07.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.306+0000 7f615b2c0700 1 -- 172.21.15.96:0/3964020108 shutdown_connections 2024-02-19T18:55:07.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.306+0000 7f615b2c0700 1 -- 172.21.15.96:0/3964020108 wait complete. 2024-02-19T18:55:07.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.307+0000 7f615b2c0700 1 Processor -- start 2024-02-19T18:55:07.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.307+0000 7f615b2c0700 1 -- start start 2024-02-19T18:55:07.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.307+0000 7f615b2c0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6154106420 0x7f615407bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:07.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.307+0000 7f615b2c0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615407c1a0 con 0x7f6154106420 2024-02-19T18:55:07.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.307+0000 7f615905c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6154106420 0x7f615407bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:07.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.307+0000 7f615905c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6154106420 0x7f615407bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57312/0 (socket says 172.21.15.96:57312) 2024-02-19T18:55:07.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.307+0000 7f615905c700 1 -- 172.21.15.96:0/1869404104 learned_addr learned my addr 172.21.15.96:0/1869404104 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:07.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.307+0000 7f615905c700 1 -- 172.21.15.96:0/1869404104 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6144009550 con 0x7f6154106420 2024-02-19T18:55:07.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.307+0000 7f615905c700 1 --2- 172.21.15.96:0/1869404104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6154106420 0x7f615407bc60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6144006af0 tx=0x7f6144011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:07.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.307+0000 7f614a7fc700 1 -- 172.21.15.96:0/1869404104 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6144003b90 con 0x7f6154106420 2024-02-19T18:55:07.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.307+0000 7f614a7fc700 1 -- 172.21.15.96:0/1869404104 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f614401a8a0 con 0x7f6154106420 2024-02-19T18:55:07.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.307+0000 7f615b2c0700 1 -- 172.21.15.96:0/1869404104 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615407a2b0 con 0x7f6154106420 2024-02-19T18:55:07.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.308+0000 7f614a7fc700 1 -- 172.21.15.96:0/1869404104 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6144019880 con 0x7f6154106420 2024-02-19T18:55:07.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.308+0000 7f615b2c0700 1 -- 172.21.15.96:0/1869404104 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615407a750 con 0x7f6154106420 2024-02-19T18:55:07.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.308+0000 7f614a7fc700 1 -- 172.21.15.96:0/1869404104 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f6144019b10 con 0x7f6154106420 2024-02-19T18:55:07.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.308+0000 7f614a7fc700 1 --2- 172.21.15.96:0/1869404104 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f6140038330 0x7f614003a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:07.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.308+0000 7f615b2c0700 1 -- 172.21.15.96:0/1869404104 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61540623c0 con 0x7f6154106420 2024-02-19T18:55:07.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.309+0000 7f614a7fc700 1 -- 172.21.15.96:0/1869404104 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f614404c670 con 0x7f6154106420 2024-02-19T18:55:07.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.309+0000 7f615885b700 1 --2- 172.21.15.96:0/1869404104 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f6140038330 0x7f614003a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:07.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.309+0000 7f615885b700 1 --2- 172.21.15.96:0/1869404104 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f6140038330 0x7f614003a7f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6150006fd0 tx=0x7f6150006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:07.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.314+0000 7f614a7fc700 1 -- 172.21.15.96:0/1869404104 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f6144029b20 con 0x7f6154106420 2024-02-19T18:55:07.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.504+0000 7f615b2c0700 1 -- 172.21.15.96:0/1869404104 --> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f615410a820 con 0x7f6140038330 2024-02-19T18:55:07.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.504+0000 7f614a7fc700 1 -- 172.21.15.96:0/1869404104 <== mgr.14120 v2:172.21.15.96:6800/3697355606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f615410a820 con 0x7f6140038330 2024-02-19T18:55:07.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.506+0000 7f615b2c0700 1 -- 172.21.15.96:0/1869404104 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f6140038330 msgr2=0x7f614003a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:07.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.506+0000 7f615b2c0700 1 --2- 172.21.15.96:0/1869404104 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f6140038330 0x7f614003a7f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6150006fd0 tx=0x7f6150006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:07.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.506+0000 7f615b2c0700 1 -- 172.21.15.96:0/1869404104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6154106420 msgr2=0x7f615407bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:07.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.506+0000 7f615b2c0700 1 --2- 172.21.15.96:0/1869404104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6154106420 0x7f615407bc60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6144006af0 tx=0x7f6144011a90 comp rx=0 tx=0).stop 2024-02-19T18:55:07.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.506+0000 7f615b2c0700 1 -- 172.21.15.96:0/1869404104 shutdown_connections 2024-02-19T18:55:07.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.506+0000 7f615b2c0700 1 --2- 172.21.15.96:0/1869404104 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f6140038330 0x7f614003a7f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:07.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.506+0000 7f615b2c0700 1 --2- 172.21.15.96:0/1869404104 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6154106420 0x7f615407bc60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:07.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.506+0000 7f615b2c0700 1 -- 172.21.15.96:0/1869404104 >> 172.21.15.96:0/1869404104 conn(0x7f6154101a00 msgr2=0x7f61541027f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:07.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.506+0000 7f615b2c0700 1 -- 172.21.15.96:0/1869404104 shutdown_connections 2024-02-19T18:55:07.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:06.506+0000 7f615b2c0700 1 -- 172.21.15.96:0/1869404104 wait complete. 2024-02-19T18:55:07.115 INFO:teuthology.orchestra.run.smithi096.stdout:Generating ssh key... 2024-02-19T18:55:07.716 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:07 smithi096 ceph-mon[29216]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:55:08.635 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.503+0000 7fa9a9834700 1 Processor -- start 2024-02-19T18:55:08.635 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.503+0000 7fa9a9834700 1 -- start start 2024-02-19T18:55:08.635 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.503+0000 7fa9a9834700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4106420 0x7fa9a4106840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:08.635 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.503+0000 7fa9a9834700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a4106e10 con 0x7fa9a4106420 2024-02-19T18:55:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.503+0000 7fa9a2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4106420 0x7fa9a4106840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.503+0000 7fa9a2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4106420 0x7fa9a4106840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57320/0 (socket says 172.21.15.96:57320) 2024-02-19T18:55:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.503+0000 7fa9a2ffd700 1 -- 172.21.15.96:0/4066345658 learned_addr learned my addr 172.21.15.96:0/4066345658 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.503+0000 7fa9a2ffd700 1 -- 172.21.15.96:0/4066345658 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a4107620 con 0x7fa9a4106420 2024-02-19T18:55:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.504+0000 7fa9a2ffd700 1 --2- 172.21.15.96:0/4066345658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4106420 0x7fa9a4106840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa9940098a0 tx=0x7fa994009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fadaa84e6758a5a4 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.504+0000 7fa9a1ffb700 1 -- 172.21.15.96:0/4066345658 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa994004180 con 0x7fa9a4106420 2024-02-19T18:55:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.504+0000 7fa9a1ffb700 1 -- 172.21.15.96:0/4066345658 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa9940042e0 con 0x7fa9a4106420 2024-02-19T18:55:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.504+0000 7fa9a1ffb700 1 -- 172.21.15.96:0/4066345658 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa994011a50 con 0x7fa9a4106420 2024-02-19T18:55:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.504+0000 7fa9a9834700 1 -- 172.21.15.96:0/4066345658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4106420 msgr2=0x7fa9a4106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.504+0000 7fa9a9834700 1 --2- 172.21.15.96:0/4066345658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4106420 0x7fa9a4106840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa9940098a0 tx=0x7fa994009bb0 comp rx=0 tx=0).stop 2024-02-19T18:55:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.504+0000 7fa9a9834700 1 -- 172.21.15.96:0/4066345658 shutdown_connections 2024-02-19T18:55:08.636 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.504+0000 7fa9a9834700 1 --2- 172.21.15.96:0/4066345658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4106420 0x7fa9a4106840 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:08.637 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.504+0000 7fa9a9834700 1 -- 172.21.15.96:0/4066345658 >> 172.21.15.96:0/4066345658 conn(0x7fa9a4101a00 msgr2=0x7fa9a4103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:08.637 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.504+0000 7fa9a9834700 1 -- 172.21.15.96:0/4066345658 shutdown_connections 2024-02-19T18:55:08.637 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.504+0000 7fa9a9834700 1 -- 172.21.15.96:0/4066345658 wait complete. 2024-02-19T18:55:08.637 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.505+0000 7fa9a9834700 1 Processor -- start 2024-02-19T18:55:08.637 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.505+0000 7fa9a9834700 1 -- start start 2024-02-19T18:55:08.637 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.505+0000 7fa9a9834700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4106420 0x7fa9a419a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:08.637 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.505+0000 7fa9a9834700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a419a5f0 con 0x7fa9a4106420 2024-02-19T18:55:08.637 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.505+0000 7fa9a2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4106420 0x7fa9a419a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:08.637 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.505+0000 7fa9a2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4106420 0x7fa9a419a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57332/0 (socket says 172.21.15.96:57332) 2024-02-19T18:55:08.637 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.505+0000 7fa9a2ffd700 1 -- 172.21.15.96:0/3102170091 learned_addr learned my addr 172.21.15.96:0/3102170091 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:08.637 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.506+0000 7fa9a2ffd700 1 -- 172.21.15.96:0/3102170091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa994009550 con 0x7fa9a4106420 2024-02-19T18:55:08.637 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.506+0000 7fa9a2ffd700 1 --2- 172.21.15.96:0/3102170091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4106420 0x7fa9a419a0b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa994000c00 tx=0x7fa994011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:08.638 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.506+0000 7fa9a8832700 1 -- 172.21.15.96:0/3102170091 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa994003b90 con 0x7fa9a4106420 2024-02-19T18:55:08.638 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.506+0000 7fa9a8832700 1 -- 172.21.15.96:0/3102170091 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa9940248b0 con 0x7fa9a4106420 2024-02-19T18:55:08.638 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.506+0000 7fa9a9834700 1 -- 172.21.15.96:0/3102170091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a419a7f0 con 0x7fa9a4106420 2024-02-19T18:55:08.638 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.506+0000 7fa9a8832700 1 -- 172.21.15.96:0/3102170091 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa99401a8e0 con 0x7fa9a4106420 2024-02-19T18:55:08.638 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.506+0000 7fa9a9834700 1 -- 172.21.15.96:0/3102170091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a419ac90 con 0x7fa9a4106420 2024-02-19T18:55:08.638 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.507+0000 7fa9a8832700 1 -- 172.21.15.96:0/3102170091 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fa99401aba0 con 0x7fa9a4106420 2024-02-19T18:55:08.638 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.507+0000 7fa9a9834700 1 -- 172.21.15.96:0/3102170091 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a40623c0 con 0x7fa9a4106420 2024-02-19T18:55:08.638 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.507+0000 7fa9a8832700 1 --2- 172.21.15.96:0/3102170091 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fa98c038320 0x7fa98c03a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:08.638 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.507+0000 7fa9a8832700 1 -- 172.21.15.96:0/3102170091 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa99404c3e0 con 0x7fa9a4106420 2024-02-19T18:55:08.638 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.507+0000 7fa9a27fc700 1 --2- 172.21.15.96:0/3102170091 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fa98c038320 0x7fa98c03a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:08.638 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.508+0000 7fa9a27fc700 1 --2- 172.21.15.96:0/3102170091 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fa98c038320 0x7fa98c03a7e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa998006fd0 tx=0x7fa998006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:08.638 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.512+0000 7fa9a8832700 1 -- 172.21.15.96:0/3102170091 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa9940233a0 con 0x7fa9a4106420 2024-02-19T18:55:08.639 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.699+0000 7fa9a9834700 1 -- 172.21.15.96:0/3102170091 --> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9a410a820 con 0x7fa98c038320 2024-02-19T18:55:08.639 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.993+0000 7fa9a8832700 1 -- 172.21.15.96:0/3102170091 <== mgr.14120 v2:172.21.15.96:6800/3697355606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa9a410a820 con 0x7fa98c038320 2024-02-19T18:55:08.639 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.995+0000 7fa9a9834700 1 -- 172.21.15.96:0/3102170091 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fa98c038320 msgr2=0x7fa98c03a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:08.639 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.995+0000 7fa9a9834700 1 --2- 172.21.15.96:0/3102170091 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fa98c038320 0x7fa98c03a7e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa998006fd0 tx=0x7fa998006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:08.639 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.995+0000 7fa9a9834700 1 -- 172.21.15.96:0/3102170091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4106420 msgr2=0x7fa9a419a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:08.639 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.995+0000 7fa9a9834700 1 --2- 172.21.15.96:0/3102170091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4106420 0x7fa9a419a0b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa994000c00 tx=0x7fa994011ab0 comp rx=0 tx=0).stop 2024-02-19T18:55:08.639 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.995+0000 7fa9a9834700 1 -- 172.21.15.96:0/3102170091 shutdown_connections 2024-02-19T18:55:08.639 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.995+0000 7fa9a9834700 1 --2- 172.21.15.96:0/3102170091 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fa98c038320 0x7fa98c03a7e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:08.639 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.995+0000 7fa9a9834700 1 --2- 172.21.15.96:0/3102170091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9a4106420 0x7fa9a419a0b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:08.639 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.995+0000 7fa9a9834700 1 -- 172.21.15.96:0/3102170091 >> 172.21.15.96:0/3102170091 conn(0x7fa9a4101a00 msgr2=0x7fa9a41027f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:08.639 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.996+0000 7fa9a9834700 1 -- 172.21.15.96:0/3102170091 shutdown_connections 2024-02-19T18:55:08.639 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:07.996+0000 7fa9a9834700 1 -- 172.21.15.96:0/3102170091 wait complete. 2024-02-19T18:55:09.244 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:08 smithi096 ceph-mon[29216]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:55:09.244 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:08 smithi096 ceph-mon[29216]: Generating ssh key... 2024-02-19T18:55:09.244 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:08 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:09.244 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:08 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:09.808 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu79fsKnGmiNuAedhtHeTxcp8F5t30y+Yqmiag0di9GuPAJKrcNAs8UmH17LVjelr6H3pe1AmIh+Gsf7YcHZN0iaahqfuIjw0j49d9DdlYcuQYwvDu6hdBX87Q6lnBaFsKcFLdwc885tOaNe9c3IALxWVHvhF9PcxYPX8mC9g66rolIHSX3gip0SA/qCc15T4sU8j9iN0oRKHu3Oksiobep1P4NTEmriiViug1BZJR5vbLhgsfdrn4rUEvAHajfEWhOp2tVQiFbbBom4Z8XlF2BRLWEwLwh0kfk39FiR0pUwrb0w327nsiFA3uehSb35fwJZ0L5Sfb/4sN1EMyKacc1BjDEdPHa+o/pV7LRpS4q2sbFMsLCxSkFsfMz/yBT+Czg3AOnIlJ4zBS0SU2WlT40iEWMRh3xLW/+soc3hzaSeczfuk4JlGe4SWdKAoEDEZDMG9KWyRz20Jbl1IuvVL3eUMgqYZXqZPXjWwmi90AHXr8SPncKiJLZa0HL6mF2V8= ceph-06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T18:55:09.809 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.030+0000 7fdd92382700 1 Processor -- start 2024-02-19T18:55:09.809 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.030+0000 7fdd92382700 1 -- start start 2024-02-19T18:55:09.809 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.030+0000 7fdd92382700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd8c106420 0x7fdd8c106840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:09.809 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.030+0000 7fdd92382700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c106e10 con 0x7fdd8c106420 2024-02-19T18:55:09.809 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.031+0000 7fdd8bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd8c106420 0x7fdd8c106840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:09.809 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.031+0000 7fdd8bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd8c106420 0x7fdd8c106840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57340/0 (socket says 172.21.15.96:57340) 2024-02-19T18:55:09.809 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.031+0000 7fdd8bfff700 1 -- 172.21.15.96:0/1910454371 learned_addr learned my addr 172.21.15.96:0/1910454371 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:09.809 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.031+0000 7fdd8bfff700 1 -- 172.21.15.96:0/1910454371 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c107620 con 0x7fdd8c106420 2024-02-19T18:55:09.809 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.031+0000 7fdd8bfff700 1 --2- 172.21.15.96:0/1910454371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd8c106420 0x7fdd8c106840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c0098a0 tx=0x7fdd7c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c5fd2459c5e9a6 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:09.809 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.031+0000 7fdd8affd700 1 -- 172.21.15.96:0/1910454371 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd7c004180 con 0x7fdd8c106420 2024-02-19T18:55:09.809 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.031+0000 7fdd8affd700 1 -- 172.21.15.96:0/1910454371 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdd7c0042e0 con 0x7fdd8c106420 2024-02-19T18:55:09.809 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.031+0000 7fdd8affd700 1 -- 172.21.15.96:0/1910454371 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd7c011a50 con 0x7fdd8c106420 2024-02-19T18:55:09.810 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.032+0000 7fdd92382700 1 -- 172.21.15.96:0/1910454371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd8c106420 msgr2=0x7fdd8c106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:09.810 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.032+0000 7fdd92382700 1 --2- 172.21.15.96:0/1910454371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd8c106420 0x7fdd8c106840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c0098a0 tx=0x7fdd7c009bb0 comp rx=0 tx=0).stop 2024-02-19T18:55:09.810 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.032+0000 7fdd92382700 1 -- 172.21.15.96:0/1910454371 shutdown_connections 2024-02-19T18:55:09.810 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.032+0000 7fdd92382700 1 --2- 172.21.15.96:0/1910454371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd8c106420 0x7fdd8c106840 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:09.810 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.032+0000 7fdd92382700 1 -- 172.21.15.96:0/1910454371 >> 172.21.15.96:0/1910454371 conn(0x7fdd8c101a00 msgr2=0x7fdd8c103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:09.810 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.032+0000 7fdd92382700 1 -- 172.21.15.96:0/1910454371 shutdown_connections 2024-02-19T18:55:09.810 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.032+0000 7fdd92382700 1 -- 172.21.15.96:0/1910454371 wait complete. 2024-02-19T18:55:09.810 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.032+0000 7fdd92382700 1 Processor -- start 2024-02-19T18:55:09.810 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.032+0000 7fdd92382700 1 -- start start 2024-02-19T18:55:09.810 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.033+0000 7fdd92382700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd8c106420 0x7fdd8c19a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:09.810 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.033+0000 7fdd92382700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c19a5f0 con 0x7fdd8c106420 2024-02-19T18:55:09.810 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.033+0000 7fdd8bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd8c106420 0x7fdd8c19a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:09.810 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.033+0000 7fdd8bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd8c106420 0x7fdd8c19a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57350/0 (socket says 172.21.15.96:57350) 2024-02-19T18:55:09.810 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.033+0000 7fdd8bfff700 1 -- 172.21.15.96:0/3672847198 learned_addr learned my addr 172.21.15.96:0/3672847198 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:09.811 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.033+0000 7fdd8bfff700 1 -- 172.21.15.96:0/3672847198 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7c009550 con 0x7fdd8c106420 2024-02-19T18:55:09.811 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.033+0000 7fdd8bfff700 1 --2- 172.21.15.96:0/3672847198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd8c106420 0x7fdd8c19a0b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c000c00 tx=0x7fdd7c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:09.811 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.033+0000 7fdd897fa700 1 -- 172.21.15.96:0/3672847198 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd7c003b90 con 0x7fdd8c106420 2024-02-19T18:55:09.811 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.033+0000 7fdd897fa700 1 -- 172.21.15.96:0/3672847198 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fdd7c0248b0 con 0x7fdd8c106420 2024-02-19T18:55:09.811 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.033+0000 7fdd897fa700 1 -- 172.21.15.96:0/3672847198 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdd7c01a8e0 con 0x7fdd8c106420 2024-02-19T18:55:09.811 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.033+0000 7fdd92382700 1 -- 172.21.15.96:0/3672847198 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c19a7f0 con 0x7fdd8c106420 2024-02-19T18:55:09.811 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.033+0000 7fdd92382700 1 -- 172.21.15.96:0/3672847198 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8c19ac90 con 0x7fdd8c106420 2024-02-19T18:55:09.811 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.034+0000 7fdd897fa700 1 -- 172.21.15.96:0/3672847198 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fdd7c01ab50 con 0x7fdd8c106420 2024-02-19T18:55:09.811 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.034+0000 7fdd897fa700 1 --2- 172.21.15.96:0/3672847198 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fdd74038370 0x7fdd7403a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:09.811 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.034+0000 7fdd897fa700 1 -- 172.21.15.96:0/3672847198 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fdd7c04d310 con 0x7fdd8c106420 2024-02-19T18:55:09.811 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.034+0000 7fdd8b7fe700 1 --2- 172.21.15.96:0/3672847198 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fdd74038370 0x7fdd7403a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:09.811 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.034+0000 7fdd92382700 1 -- 172.21.15.96:0/3672847198 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8c0623c0 con 0x7fdd8c106420 2024-02-19T18:55:09.811 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.035+0000 7fdd8b7fe700 1 --2- 172.21.15.96:0/3672847198 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fdd74038370 0x7fdd7403a830 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdd80006fd0 tx=0x7fdd80006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:09.811 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.039+0000 7fdd897fa700 1 -- 172.21.15.96:0/3672847198 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fdd7c0233a0 con 0x7fdd8c106420 2024-02-19T18:55:09.812 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.227+0000 7fdd92382700 1 -- 172.21.15.96:0/3672847198 --> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd8c102f00 con 0x7fdd74038370 2024-02-19T18:55:09.812 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.227+0000 7fdd897fa700 1 -- 172.21.15.96:0/3672847198 <== mgr.14120 v2:172.21.15.96:6800/3697355606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fdd8c102f00 con 0x7fdd74038370 2024-02-19T18:55:09.812 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.229+0000 7fdd92382700 1 -- 172.21.15.96:0/3672847198 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fdd74038370 msgr2=0x7fdd7403a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:09.812 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.229+0000 7fdd92382700 1 --2- 172.21.15.96:0/3672847198 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fdd74038370 0x7fdd7403a830 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdd80006fd0 tx=0x7fdd80006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:09.812 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.229+0000 7fdd92382700 1 -- 172.21.15.96:0/3672847198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd8c106420 msgr2=0x7fdd8c19a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:09.812 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.229+0000 7fdd92382700 1 --2- 172.21.15.96:0/3672847198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd8c106420 0x7fdd8c19a0b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c000c00 tx=0x7fdd7c011ab0 comp rx=0 tx=0).stop 2024-02-19T18:55:09.812 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.229+0000 7fdd92382700 1 -- 172.21.15.96:0/3672847198 shutdown_connections 2024-02-19T18:55:09.812 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.229+0000 7fdd92382700 1 --2- 172.21.15.96:0/3672847198 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fdd74038370 0x7fdd7403a830 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:09.812 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.229+0000 7fdd92382700 1 --2- 172.21.15.96:0/3672847198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd8c106420 0x7fdd8c19a0b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:09.812 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.229+0000 7fdd92382700 1 -- 172.21.15.96:0/3672847198 >> 172.21.15.96:0/3672847198 conn(0x7fdd8c101a00 msgr2=0x7fdd8c1027f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:09.812 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.230+0000 7fdd92382700 1 -- 172.21.15.96:0/3672847198 shutdown_connections 2024-02-19T18:55:09.812 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:09.230+0000 7fdd92382700 1 -- 172.21.15.96:0/3672847198 wait complete. 2024-02-19T18:55:09.812 INFO:teuthology.orchestra.run.smithi096.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-02-19T18:55:09.812 INFO:teuthology.orchestra.run.smithi096.stdout:Adding key to root@localhost authorized_keys... 2024-02-19T18:55:09.813 INFO:teuthology.orchestra.run.smithi096.stdout:Adding host smithi096... 2024-02-19T18:55:10.186 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:09 smithi096 ceph-mon[29216]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:55:11.575 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:11 smithi096 ceph-mon[29216]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi096", "addr": "172.21.15.96", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:55:11.575 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:11 smithi096 ceph-mon[29216]: Deploying cephadm binary to smithi096 2024-02-19T18:55:13.532 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout Added host 'smithi096' with addr '172.21.15.96' 2024-02-19T18:55:13.532 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.195+0000 7f5c0aa5f700 1 Processor -- start 2024-02-19T18:55:13.532 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.195+0000 7f5c0aa5f700 1 -- start start 2024-02-19T18:55:13.532 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.195+0000 7f5c0aa5f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c04106420 0x7f5c04106840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:13.532 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.195+0000 7f5c0aa5f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c04106e10 con 0x7f5c04106420 2024-02-19T18:55:13.532 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.195+0000 7f5c03fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c04106420 0x7f5c04106840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:13.533 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.196+0000 7f5c03fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c04106420 0x7f5c04106840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57354/0 (socket says 172.21.15.96:57354) 2024-02-19T18:55:13.533 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.196+0000 7f5c03fff700 1 -- 172.21.15.96:0/775262656 learned_addr learned my addr 172.21.15.96:0/775262656 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:13.533 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.196+0000 7f5c03fff700 1 -- 172.21.15.96:0/775262656 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c04107620 con 0x7f5c04106420 2024-02-19T18:55:13.533 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.196+0000 7f5c03fff700 1 --2- 172.21.15.96:0/775262656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c04106420 0x7f5c04106840 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40098a0 tx=0x7f5bf4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ddcd08e408eabfb server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:13.533 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.196+0000 7f5c02ffd700 1 -- 172.21.15.96:0/775262656 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5bf4004180 con 0x7f5c04106420 2024-02-19T18:55:13.533 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.196+0000 7f5c02ffd700 1 -- 172.21.15.96:0/775262656 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5bf40042e0 con 0x7f5c04106420 2024-02-19T18:55:13.533 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.196+0000 7f5c02ffd700 1 -- 172.21.15.96:0/775262656 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5bf4011a50 con 0x7f5c04106420 2024-02-19T18:55:13.533 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.197+0000 7f5c0aa5f700 1 -- 172.21.15.96:0/775262656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c04106420 msgr2=0x7f5c04106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:13.533 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.197+0000 7f5c0aa5f700 1 --2- 172.21.15.96:0/775262656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c04106420 0x7f5c04106840 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40098a0 tx=0x7f5bf4009bb0 comp rx=0 tx=0).stop 2024-02-19T18:55:13.533 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.197+0000 7f5c0aa5f700 1 -- 172.21.15.96:0/775262656 shutdown_connections 2024-02-19T18:55:13.533 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.197+0000 7f5c0aa5f700 1 --2- 172.21.15.96:0/775262656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c04106420 0x7f5c04106840 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:13.533 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.197+0000 7f5c0aa5f700 1 -- 172.21.15.96:0/775262656 >> 172.21.15.96:0/775262656 conn(0x7f5c04101a00 msgr2=0x7f5c04103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:13.533 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.197+0000 7f5c0aa5f700 1 -- 172.21.15.96:0/775262656 shutdown_connections 2024-02-19T18:55:13.533 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.197+0000 7f5c0aa5f700 1 -- 172.21.15.96:0/775262656 wait complete. 2024-02-19T18:55:13.533 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.197+0000 7f5c0aa5f700 1 Processor -- start 2024-02-19T18:55:13.534 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.197+0000 7f5c0aa5f700 1 -- start start 2024-02-19T18:55:13.534 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.198+0000 7f5c0aa5f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c04106420 0x7f5c0407bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:13.534 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.198+0000 7f5c0aa5f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0407c1a0 con 0x7f5c04106420 2024-02-19T18:55:13.534 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.198+0000 7f5c03fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c04106420 0x7f5c0407bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:13.534 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.198+0000 7f5c03fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c04106420 0x7f5c0407bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57366/0 (socket says 172.21.15.96:57366) 2024-02-19T18:55:13.534 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.198+0000 7f5c03fff700 1 -- 172.21.15.96:0/2613599038 learned_addr learned my addr 172.21.15.96:0/2613599038 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:13.534 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.198+0000 7f5c03fff700 1 -- 172.21.15.96:0/2613599038 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf4009550 con 0x7f5c04106420 2024-02-19T18:55:13.534 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.198+0000 7f5c03fff700 1 --2- 172.21.15.96:0/2613599038 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c04106420 0x7f5c0407bc60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4006af0 tx=0x7f5bf4011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:13.534 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.198+0000 7f5c017fa700 1 -- 172.21.15.96:0/2613599038 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5bf4003b90 con 0x7f5c04106420 2024-02-19T18:55:13.534 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.198+0000 7f5c017fa700 1 -- 172.21.15.96:0/2613599038 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5bf401a8a0 con 0x7f5c04106420 2024-02-19T18:55:13.534 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.198+0000 7f5c0aa5f700 1 -- 172.21.15.96:0/2613599038 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0407a2b0 con 0x7f5c04106420 2024-02-19T18:55:13.534 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.198+0000 7f5c017fa700 1 -- 172.21.15.96:0/2613599038 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5bf4019880 con 0x7f5c04106420 2024-02-19T18:55:13.534 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.198+0000 7f5c0aa5f700 1 -- 172.21.15.96:0/2613599038 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0407a750 con 0x7f5c04106420 2024-02-19T18:55:13.534 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.199+0000 7f5c017fa700 1 -- 172.21.15.96:0/2613599038 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f5bf4019af0 con 0x7f5c04106420 2024-02-19T18:55:13.534 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.199+0000 7f5c0aa5f700 1 -- 172.21.15.96:0/2613599038 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c040623c0 con 0x7f5c04106420 2024-02-19T18:55:13.534 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.199+0000 7f5c017fa700 1 --2- 172.21.15.96:0/2613599038 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f5bec038330 0x7f5bec03a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:13.535 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.199+0000 7f5c017fa700 1 -- 172.21.15.96:0/2613599038 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f5bf404c7b0 con 0x7f5c04106420 2024-02-19T18:55:13.535 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.199+0000 7f5c037fe700 1 --2- 172.21.15.96:0/2613599038 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f5bec038330 0x7f5bec03a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:13.535 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.200+0000 7f5c037fe700 1 --2- 172.21.15.96:0/2613599038 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f5bec038330 0x7f5bec03a7f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8006fd0 tx=0x7f5bf8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:13.535 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.204+0000 7f5c017fa700 1 -- 172.21.15.96:0/2613599038 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f5bf4018b80 con 0x7f5c04106420 2024-02-19T18:55:13.535 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:10.394+0000 7f5c0aa5f700 1 -- 172.21.15.96:0/2613599038 --> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi096", "addr": "172.21.15.96", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c0410a820 con 0x7f5bec038330 2024-02-19T18:55:13.535 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.001+0000 7f5c017fa700 1 -- 172.21.15.96:0/2613599038 <== mgr.14120 v2:172.21.15.96:6800/3697355606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f5c0410a820 con 0x7f5bec038330 2024-02-19T18:55:13.535 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.003+0000 7f5c0aa5f700 1 -- 172.21.15.96:0/2613599038 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f5bec038330 msgr2=0x7f5bec03a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:13.535 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.003+0000 7f5c0aa5f700 1 --2- 172.21.15.96:0/2613599038 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f5bec038330 0x7f5bec03a7f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8006fd0 tx=0x7f5bf8006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:13.535 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.003+0000 7f5c0aa5f700 1 -- 172.21.15.96:0/2613599038 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c04106420 msgr2=0x7f5c0407bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:13.535 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.003+0000 7f5c0aa5f700 1 --2- 172.21.15.96:0/2613599038 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c04106420 0x7f5c0407bc60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4006af0 tx=0x7f5bf4011a90 comp rx=0 tx=0).stop 2024-02-19T18:55:13.535 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.003+0000 7f5c0aa5f700 1 -- 172.21.15.96:0/2613599038 shutdown_connections 2024-02-19T18:55:13.535 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.003+0000 7f5c0aa5f700 1 --2- 172.21.15.96:0/2613599038 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f5bec038330 0x7f5bec03a7f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:13.535 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.003+0000 7f5c0aa5f700 1 --2- 172.21.15.96:0/2613599038 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c04106420 0x7f5c0407bc60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:13.535 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.003+0000 7f5c0aa5f700 1 -- 172.21.15.96:0/2613599038 >> 172.21.15.96:0/2613599038 conn(0x7f5c04101a00 msgr2=0x7f5c041027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:13.536 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.003+0000 7f5c0aa5f700 1 -- 172.21.15.96:0/2613599038 shutdown_connections 2024-02-19T18:55:13.536 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.004+0000 7f5c0aa5f700 1 -- 172.21.15.96:0/2613599038 wait complete. 2024-02-19T18:55:13.536 INFO:teuthology.orchestra.run.smithi096.stdout:Deploying mon service with default placement... 2024-02-19T18:55:14.176 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:14 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:14.176 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:14 smithi096 ceph-mon[29216]: Added host smithi096 2024-02-19T18:55:14.176 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:14 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:55:15.283 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:15 smithi096 ceph-mon[29216]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:55:15.283 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:15 smithi096 ceph-mon[29216]: Saving service mon spec with placement count:5 2024-02-19T18:55:15.283 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:15 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:15.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:15 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:15.591 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-02-19T18:55:15.592 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.927+0000 7f482bbd0700 1 Processor -- start 2024-02-19T18:55:15.592 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.927+0000 7f482bbd0700 1 -- start start 2024-02-19T18:55:15.592 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.927+0000 7f482bbd0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4824106f00 0x7f48241092f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:15.592 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.927+0000 7f482bbd0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4824079e60 con 0x7f4824106f00 2024-02-19T18:55:15.592 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.927+0000 7f482996c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4824106f00 0x7f48241092f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:15.592 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.927+0000 7f482996c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4824106f00 0x7f48241092f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48344/0 (socket says 172.21.15.96:48344) 2024-02-19T18:55:15.592 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.927+0000 7f482996c700 1 -- 172.21.15.96:0/2059689474 learned_addr learned my addr 172.21.15.96:0/2059689474 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:15.592 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.928+0000 7f482996c700 1 -- 172.21.15.96:0/2059689474 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4824109830 con 0x7f4824106f00 2024-02-19T18:55:15.592 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.928+0000 7f482996c700 1 --2- 172.21.15.96:0/2059689474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4824106f00 0x7f48241092f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f481c009e80 tx=0x7f481c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9654690ca6618cf server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:15.597 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.928+0000 7f482896a700 1 -- 172.21.15.96:0/2059689474 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f481c00e070 con 0x7f4824106f00 2024-02-19T18:55:15.597 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.928+0000 7f482896a700 1 -- 172.21.15.96:0/2059689474 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f481c003e90 con 0x7f4824106f00 2024-02-19T18:55:15.597 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.928+0000 7f482896a700 1 -- 172.21.15.96:0/2059689474 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f481c004380 con 0x7f4824106f00 2024-02-19T18:55:15.597 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.929+0000 7f482bbd0700 1 -- 172.21.15.96:0/2059689474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4824106f00 msgr2=0x7f48241092f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:15.597 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.929+0000 7f482bbd0700 1 --2- 172.21.15.96:0/2059689474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4824106f00 0x7f48241092f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f481c009e80 tx=0x7f481c00b330 comp rx=0 tx=0).stop 2024-02-19T18:55:15.597 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.929+0000 7f482bbd0700 1 -- 172.21.15.96:0/2059689474 shutdown_connections 2024-02-19T18:55:15.597 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.929+0000 7f482bbd0700 1 --2- 172.21.15.96:0/2059689474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4824106f00 0x7f48241092f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:15.597 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.929+0000 7f482bbd0700 1 -- 172.21.15.96:0/2059689474 >> 172.21.15.96:0/2059689474 conn(0x7f48241008b0 msgr2=0x7f4824102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:15.597 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.929+0000 7f482bbd0700 1 -- 172.21.15.96:0/2059689474 shutdown_connections 2024-02-19T18:55:15.597 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.929+0000 7f482bbd0700 1 -- 172.21.15.96:0/2059689474 wait complete. 2024-02-19T18:55:15.597 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.929+0000 7f482bbd0700 1 Processor -- start 2024-02-19T18:55:15.598 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.929+0000 7f482bbd0700 1 -- start start 2024-02-19T18:55:15.598 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.929+0000 7f482bbd0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4824106f00 0x7f4824106860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:15.598 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.929+0000 7f482bbd0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4824106da0 con 0x7f4824106f00 2024-02-19T18:55:15.598 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.929+0000 7f482996c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4824106f00 0x7f4824106860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:15.598 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.930+0000 7f482996c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4824106f00 0x7f4824106860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48346/0 (socket says 172.21.15.96:48346) 2024-02-19T18:55:15.598 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.930+0000 7f482996c700 1 -- 172.21.15.96:0/3851083549 learned_addr learned my addr 172.21.15.96:0/3851083549 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:15.598 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.930+0000 7f482996c700 1 -- 172.21.15.96:0/3851083549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c009b30 con 0x7f4824106f00 2024-02-19T18:55:15.598 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.930+0000 7f482996c700 1 --2- 172.21.15.96:0/3851083549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4824106f00 0x7f4824106860 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f481c00d010 tx=0x7f481c004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:15.598 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.930+0000 7f481affd700 1 -- 172.21.15.96:0/3851083549 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f481c00e040 con 0x7f4824106f00 2024-02-19T18:55:15.598 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.930+0000 7f481affd700 1 -- 172.21.15.96:0/3851083549 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f481c003c30 con 0x7f4824106f00 2024-02-19T18:55:15.598 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.930+0000 7f481affd700 1 -- 172.21.15.96:0/3851083549 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f481c01b790 con 0x7f4824106f00 2024-02-19T18:55:15.598 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.930+0000 7f482bbd0700 1 -- 172.21.15.96:0/3851083549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4824104eb0 con 0x7f4824106f00 2024-02-19T18:55:15.598 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.930+0000 7f482bbd0700 1 -- 172.21.15.96:0/3851083549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48241053b0 con 0x7f4824106f00 2024-02-19T18:55:15.598 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.931+0000 7f481affd700 1 -- 172.21.15.96:0/3851083549 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f481c019040 con 0x7f4824106f00 2024-02-19T18:55:15.598 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.931+0000 7f481affd700 1 --2- 172.21.15.96:0/3851083549 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f4810038330 0x7f481003a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:15.599 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.931+0000 7f481affd700 1 -- 172.21.15.96:0/3851083549 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f481c04be80 con 0x7f4824106f00 2024-02-19T18:55:15.599 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.931+0000 7f482bbd0700 1 -- 172.21.15.96:0/3851083549 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f482410a550 con 0x7f4824106f00 2024-02-19T18:55:15.599 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.931+0000 7f482916b700 1 --2- 172.21.15.96:0/3851083549 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f4810038330 0x7f481003a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:15.599 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.931+0000 7f482916b700 1 --2- 172.21.15.96:0/3851083549 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f4810038330 0x7f481003a7f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4814006fd0 tx=0x7f4814006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:15.599 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:13.936+0000 7f481affd700 1 -- 172.21.15.96:0/3851083549 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f481c023b60 con 0x7f4824106f00 2024-02-19T18:55:15.599 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:14.140+0000 7f482bbd0700 1 -- 172.21.15.96:0/3851083549 --> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f4824101dc0 con 0x7f4810038330 2024-02-19T18:55:15.599 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:14.145+0000 7f481affd700 1 -- 172.21.15.96:0/3851083549 <== mgr.14120 v2:172.21.15.96:6800/3697355606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f4824101dc0 con 0x7f4810038330 2024-02-19T18:55:15.599 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:14.147+0000 7f482bbd0700 1 -- 172.21.15.96:0/3851083549 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f4810038330 msgr2=0x7f481003a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:15.599 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:14.147+0000 7f482bbd0700 1 --2- 172.21.15.96:0/3851083549 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f4810038330 0x7f481003a7f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4814006fd0 tx=0x7f4814006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:15.599 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:14.147+0000 7f482bbd0700 1 -- 172.21.15.96:0/3851083549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4824106f00 msgr2=0x7f4824106860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:15.599 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:14.147+0000 7f482bbd0700 1 --2- 172.21.15.96:0/3851083549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4824106f00 0x7f4824106860 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f481c00d010 tx=0x7f481c004430 comp rx=0 tx=0).stop 2024-02-19T18:55:15.599 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:14.147+0000 7f482bbd0700 1 -- 172.21.15.96:0/3851083549 shutdown_connections 2024-02-19T18:55:15.599 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:14.147+0000 7f482bbd0700 1 --2- 172.21.15.96:0/3851083549 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f4810038330 0x7f481003a7f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:15.599 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:14.147+0000 7f482bbd0700 1 --2- 172.21.15.96:0/3851083549 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4824106f00 0x7f4824106860 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:15.600 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:14.147+0000 7f482bbd0700 1 -- 172.21.15.96:0/3851083549 >> 172.21.15.96:0/3851083549 conn(0x7f48241008b0 msgr2=0x7f48241016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:15.600 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:14.148+0000 7f482bbd0700 1 -- 172.21.15.96:0/3851083549 shutdown_connections 2024-02-19T18:55:15.600 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:14.148+0000 7f482bbd0700 1 -- 172.21.15.96:0/3851083549 wait complete. 2024-02-19T18:55:15.600 INFO:teuthology.orchestra.run.smithi096.stdout:Deploying mgr service with default placement... 2024-02-19T18:55:16.841 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:16 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:16.841 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:16 smithi096 ceph-mon[29216]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:55:16.841 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:16 smithi096 ceph-mon[29216]: Saving service mgr spec with placement count:2 2024-02-19T18:55:16.841 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:16 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:17.463 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-02-19T18:55:17.463 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.047+0000 7f69e1043700 1 Processor -- start 2024-02-19T18:55:17.463 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.047+0000 7f69e1043700 1 -- start start 2024-02-19T18:55:17.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.047+0000 7f69e1043700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69dc104730 0x7f69dc104b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:17.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.047+0000 7f69e1043700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc105120 con 0x7f69dc104730 2024-02-19T18:55:17.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.047+0000 7f69dad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69dc104730 0x7f69dc104b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:17.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.047+0000 7f69dad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69dc104730 0x7f69dc104b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48356/0 (socket says 172.21.15.96:48356) 2024-02-19T18:55:17.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.047+0000 7f69dad9d700 1 -- 172.21.15.96:0/2082861878 learned_addr learned my addr 172.21.15.96:0/2082861878 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:17.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.048+0000 7f69dad9d700 1 -- 172.21.15.96:0/2082861878 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc1076c0 con 0x7f69dc104730 2024-02-19T18:55:17.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.048+0000 7f69dad9d700 1 --2- 172.21.15.96:0/2082861878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69dc104730 0x7f69dc104b50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f69cc0098a0 tx=0x7f69cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ee452b464857de server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:17.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.048+0000 7f69d9d9b700 1 -- 172.21.15.96:0/2082861878 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69cc004180 con 0x7f69dc104730 2024-02-19T18:55:17.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.048+0000 7f69d9d9b700 1 -- 172.21.15.96:0/2082861878 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f69cc0042e0 con 0x7f69dc104730 2024-02-19T18:55:17.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.048+0000 7f69d9d9b700 1 -- 172.21.15.96:0/2082861878 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69cc011af0 con 0x7f69dc104730 2024-02-19T18:55:17.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.049+0000 7f69e1043700 1 -- 172.21.15.96:0/2082861878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69dc104730 msgr2=0x7f69dc104b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:17.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.049+0000 7f69e1043700 1 --2- 172.21.15.96:0/2082861878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69dc104730 0x7f69dc104b50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f69cc0098a0 tx=0x7f69cc009bb0 comp rx=0 tx=0).stop 2024-02-19T18:55:17.464 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.049+0000 7f69e1043700 1 -- 172.21.15.96:0/2082861878 shutdown_connections 2024-02-19T18:55:17.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.049+0000 7f69e1043700 1 --2- 172.21.15.96:0/2082861878 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69dc104730 0x7f69dc104b50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:17.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.049+0000 7f69e1043700 1 -- 172.21.15.96:0/2082861878 >> 172.21.15.96:0/2082861878 conn(0x7f69dc100040 msgr2=0x7f69dc1024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:17.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.049+0000 7f69e1043700 1 -- 172.21.15.96:0/2082861878 shutdown_connections 2024-02-19T18:55:17.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.049+0000 7f69e1043700 1 -- 172.21.15.96:0/2082861878 wait complete. 2024-02-19T18:55:17.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.050+0000 7f69e1043700 1 Processor -- start 2024-02-19T18:55:17.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.050+0000 7f69e1043700 1 -- start start 2024-02-19T18:55:17.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.050+0000 7f69e1043700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69dc104730 0x7f69dc19a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:17.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.050+0000 7f69e1043700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc19a6f0 con 0x7f69dc104730 2024-02-19T18:55:17.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.050+0000 7f69dad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69dc104730 0x7f69dc19a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:17.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.050+0000 7f69dad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69dc104730 0x7f69dc19a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48358/0 (socket says 172.21.15.96:48358) 2024-02-19T18:55:17.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.050+0000 7f69dad9d700 1 -- 172.21.15.96:0/171502690 learned_addr learned my addr 172.21.15.96:0/171502690 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:17.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.051+0000 7f69dad9d700 1 -- 172.21.15.96:0/171502690 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69cc009550 con 0x7f69dc104730 2024-02-19T18:55:17.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.051+0000 7f69dad9d700 1 --2- 172.21.15.96:0/171502690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69dc104730 0x7f69dc19a1b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f69cc011670 tx=0x7f69cc011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:17.465 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.051+0000 7f69c3fff700 1 -- 172.21.15.96:0/171502690 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69cc0039f0 con 0x7f69dc104730 2024-02-19T18:55:17.466 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.051+0000 7f69e1043700 1 -- 172.21.15.96:0/171502690 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69dc19a8f0 con 0x7f69dc104730 2024-02-19T18:55:17.466 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.051+0000 7f69c3fff700 1 -- 172.21.15.96:0/171502690 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f69cc003b50 con 0x7f69dc104730 2024-02-19T18:55:17.466 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.051+0000 7f69c3fff700 1 -- 172.21.15.96:0/171502690 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f69cc0247c0 con 0x7f69dc104730 2024-02-19T18:55:17.466 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.051+0000 7f69e1043700 1 -- 172.21.15.96:0/171502690 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69dc19ad90 con 0x7f69dc104730 2024-02-19T18:55:17.466 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.052+0000 7f69c3fff700 1 -- 172.21.15.96:0/171502690 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f69cc02d3f0 con 0x7f69dc104730 2024-02-19T18:55:17.466 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.052+0000 7f69e1043700 1 -- 172.21.15.96:0/171502690 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69dc0623c0 con 0x7f69dc104730 2024-02-19T18:55:17.466 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.052+0000 7f69c3fff700 1 --2- 172.21.15.96:0/171502690 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f69c4038370 0x7f69c403a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:17.466 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.052+0000 7f69c3fff700 1 -- 172.21.15.96:0/171502690 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f69cc04c4d0 con 0x7f69dc104730 2024-02-19T18:55:17.466 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.053+0000 7f69da59c700 1 --2- 172.21.15.96:0/171502690 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f69c4038370 0x7f69c403a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:17.466 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.053+0000 7f69da59c700 1 --2- 172.21.15.96:0/171502690 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f69c4038370 0x7f69c403a830 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f69d0006fd0 tx=0x7f69d0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:17.466 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.058+0000 7f69c3fff700 1 -- 172.21.15.96:0/171502690 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f69cc010970 con 0x7f69dc104730 2024-02-19T18:55:17.466 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.276+0000 7f69e1043700 1 -- 172.21.15.96:0/171502690 --> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f69dc1023c0 con 0x7f69c4038370 2024-02-19T18:55:17.466 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.280+0000 7f69c3fff700 1 -- 172.21.15.96:0/171502690 <== mgr.14120 v2:172.21.15.96:6800/3697355606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f69dc1023c0 con 0x7f69c4038370 2024-02-19T18:55:17.466 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.282+0000 7f69e1043700 1 -- 172.21.15.96:0/171502690 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f69c4038370 msgr2=0x7f69c403a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:17.466 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.282+0000 7f69e1043700 1 --2- 172.21.15.96:0/171502690 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f69c4038370 0x7f69c403a830 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f69d0006fd0 tx=0x7f69d0006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:17.467 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.282+0000 7f69e1043700 1 -- 172.21.15.96:0/171502690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69dc104730 msgr2=0x7f69dc19a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:17.467 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.282+0000 7f69e1043700 1 --2- 172.21.15.96:0/171502690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69dc104730 0x7f69dc19a1b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f69cc011670 tx=0x7f69cc011b50 comp rx=0 tx=0).stop 2024-02-19T18:55:17.467 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.282+0000 7f69e1043700 1 -- 172.21.15.96:0/171502690 shutdown_connections 2024-02-19T18:55:17.467 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.282+0000 7f69e1043700 1 --2- 172.21.15.96:0/171502690 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f69c4038370 0x7f69c403a830 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:17.467 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.282+0000 7f69e1043700 1 --2- 172.21.15.96:0/171502690 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69dc104730 0x7f69dc19a1b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:17.467 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.282+0000 7f69e1043700 1 -- 172.21.15.96:0/171502690 >> 172.21.15.96:0/171502690 conn(0x7f69dc100040 msgr2=0x7f69dc1017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:17.467 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.282+0000 7f69e1043700 1 -- 172.21.15.96:0/171502690 shutdown_connections 2024-02-19T18:55:17.467 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:16.282+0000 7f69e1043700 1 -- 172.21.15.96:0/171502690 wait complete. 2024-02-19T18:55:17.467 INFO:teuthology.orchestra.run.smithi096.stdout:Deploying crash service with default placement... 2024-02-19T18:55:18.033 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:17 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:18.033 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:17 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:19.283 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:19 smithi096 ceph-mon[29216]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:55:19.283 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:19 smithi096 ceph-mon[29216]: Saving service crash spec with placement * 2024-02-19T18:55:19.283 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:19 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:19.701 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-02-19T18:55:19.702 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.944+0000 7ff5d7a98700 1 Processor -- start 2024-02-19T18:55:19.702 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.944+0000 7ff5d7a98700 1 -- start start 2024-02-19T18:55:19.702 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.945+0000 7ff5d7a98700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5d0106ee0 0x7ff5d01092d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:19.702 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.945+0000 7ff5d7a98700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d0079e80 con 0x7ff5d0106ee0 2024-02-19T18:55:19.702 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.945+0000 7ff5d5834700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5d0106ee0 0x7ff5d01092d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:19.702 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.945+0000 7ff5d5834700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5d0106ee0 0x7ff5d01092d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48366/0 (socket says 172.21.15.96:48366) 2024-02-19T18:55:19.702 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.945+0000 7ff5d5834700 1 -- 172.21.15.96:0/1973612414 learned_addr learned my addr 172.21.15.96:0/1973612414 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:19.702 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.945+0000 7ff5d5834700 1 -- 172.21.15.96:0/1973612414 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d0109810 con 0x7ff5d0106ee0 2024-02-19T18:55:19.702 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.945+0000 7ff5d5834700 1 --2- 172.21.15.96:0/1973612414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5d0106ee0 0x7ff5d01092d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff5c00098a0 tx=0x7ff5c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd7879fe0b6e325 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:19.702 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.946+0000 7ff5d4832700 1 -- 172.21.15.96:0/1973612414 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5c0004180 con 0x7ff5d0106ee0 2024-02-19T18:55:19.702 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.946+0000 7ff5d4832700 1 -- 172.21.15.96:0/1973612414 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff5c00042e0 con 0x7ff5d0106ee0 2024-02-19T18:55:19.702 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.946+0000 7ff5d4832700 1 -- 172.21.15.96:0/1973612414 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5c0011af0 con 0x7ff5d0106ee0 2024-02-19T18:55:19.703 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.946+0000 7ff5d7a98700 1 -- 172.21.15.96:0/1973612414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5d0106ee0 msgr2=0x7ff5d01092d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:19.703 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.946+0000 7ff5d7a98700 1 --2- 172.21.15.96:0/1973612414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5d0106ee0 0x7ff5d01092d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff5c00098a0 tx=0x7ff5c0009bb0 comp rx=0 tx=0).stop 2024-02-19T18:55:19.703 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.946+0000 7ff5d7a98700 1 -- 172.21.15.96:0/1973612414 shutdown_connections 2024-02-19T18:55:19.703 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.946+0000 7ff5d7a98700 1 --2- 172.21.15.96:0/1973612414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5d0106ee0 0x7ff5d01092d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:19.703 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.946+0000 7ff5d7a98700 1 -- 172.21.15.96:0/1973612414 >> 172.21.15.96:0/1973612414 conn(0x7ff5d01008b0 msgr2=0x7ff5d0102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:19.703 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.946+0000 7ff5d7a98700 1 -- 172.21.15.96:0/1973612414 shutdown_connections 2024-02-19T18:55:19.703 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.946+0000 7ff5d7a98700 1 -- 172.21.15.96:0/1973612414 wait complete. 2024-02-19T18:55:19.703 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.947+0000 7ff5d7a98700 1 Processor -- start 2024-02-19T18:55:19.703 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.947+0000 7ff5d7a98700 1 -- start start 2024-02-19T18:55:19.703 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.947+0000 7ff5d7a98700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5d0106ee0 0x7ff5d0106840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:19.703 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.947+0000 7ff5d7a98700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d0106d80 con 0x7ff5d0106ee0 2024-02-19T18:55:19.703 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.947+0000 7ff5d5834700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5d0106ee0 0x7ff5d0106840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:19.703 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.947+0000 7ff5d5834700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5d0106ee0 0x7ff5d0106840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48376/0 (socket says 172.21.15.96:48376) 2024-02-19T18:55:19.703 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.947+0000 7ff5d5834700 1 -- 172.21.15.96:0/885910202 learned_addr learned my addr 172.21.15.96:0/885910202 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:19.704 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.948+0000 7ff5d5834700 1 -- 172.21.15.96:0/885910202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c0009550 con 0x7ff5d0106ee0 2024-02-19T18:55:19.704 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.948+0000 7ff5d5834700 1 --2- 172.21.15.96:0/885910202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5d0106ee0 0x7ff5d0106840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0011670 tx=0x7ff5c0011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:19.704 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.948+0000 7ff5c6ffd700 1 -- 172.21.15.96:0/885910202 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5c0003a40 con 0x7ff5d0106ee0 2024-02-19T18:55:19.704 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.948+0000 7ff5c6ffd700 1 -- 172.21.15.96:0/885910202 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff5c0003ba0 con 0x7ff5d0106ee0 2024-02-19T18:55:19.704 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.948+0000 7ff5d7a98700 1 -- 172.21.15.96:0/885910202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d0104e90 con 0x7ff5d0106ee0 2024-02-19T18:55:19.704 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.948+0000 7ff5c6ffd700 1 -- 172.21.15.96:0/885910202 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff5c0024790 con 0x7ff5d0106ee0 2024-02-19T18:55:19.704 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.948+0000 7ff5d7a98700 1 -- 172.21.15.96:0/885910202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d0105330 con 0x7ff5d0106ee0 2024-02-19T18:55:19.704 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.949+0000 7ff5c6ffd700 1 -- 172.21.15.96:0/885910202 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7ff5c001a430 con 0x7ff5d0106ee0 2024-02-19T18:55:19.704 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.949+0000 7ff5d7a98700 1 -- 172.21.15.96:0/885910202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d0062430 con 0x7ff5d0106ee0 2024-02-19T18:55:19.704 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.949+0000 7ff5c6ffd700 1 --2- 172.21.15.96:0/885910202 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7ff5bc038320 0x7ff5bc03a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:19.704 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.949+0000 7ff5c6ffd700 1 -- 172.21.15.96:0/885910202 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff5c004c520 con 0x7ff5d0106ee0 2024-02-19T18:55:19.704 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.949+0000 7ff5d5033700 1 --2- 172.21.15.96:0/885910202 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7ff5bc038320 0x7ff5bc03a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:19.704 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.949+0000 7ff5d5033700 1 --2- 172.21.15.96:0/885910202 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7ff5bc038320 0x7ff5bc03a7e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc006fd0 tx=0x7ff5cc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:19.704 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:17.954+0000 7ff5c6ffd700 1 -- 172.21.15.96:0/885910202 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff5d0062430 con 0x7ff5d0106ee0 2024-02-19T18:55:19.704 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:18.165+0000 7ff5d7a98700 1 -- 172.21.15.96:0/885910202 --> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5d00623c0 con 0x7ff5bc038320 2024-02-19T18:55:19.705 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:18.172+0000 7ff5c6ffd700 1 -- 172.21.15.96:0/885910202 <== mgr.14120 v2:172.21.15.96:6800/3697355606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7ff5d00623c0 con 0x7ff5bc038320 2024-02-19T18:55:19.705 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:18.174+0000 7ff5d7a98700 1 -- 172.21.15.96:0/885910202 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7ff5bc038320 msgr2=0x7ff5bc03a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:19.705 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:18.174+0000 7ff5d7a98700 1 --2- 172.21.15.96:0/885910202 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7ff5bc038320 0x7ff5bc03a7e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc006fd0 tx=0x7ff5cc006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:19.705 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:18.174+0000 7ff5d7a98700 1 -- 172.21.15.96:0/885910202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5d0106ee0 msgr2=0x7ff5d0106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:19.705 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:18.174+0000 7ff5d7a98700 1 --2- 172.21.15.96:0/885910202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5d0106ee0 0x7ff5d0106840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0011670 tx=0x7ff5c0011b50 comp rx=0 tx=0).stop 2024-02-19T18:55:19.705 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:18.174+0000 7ff5d7a98700 1 -- 172.21.15.96:0/885910202 shutdown_connections 2024-02-19T18:55:19.705 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:18.174+0000 7ff5d7a98700 1 --2- 172.21.15.96:0/885910202 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7ff5bc038320 0x7ff5bc03a7e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:19.705 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:18.174+0000 7ff5d7a98700 1 --2- 172.21.15.96:0/885910202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff5d0106ee0 0x7ff5d0106840 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:19.705 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:18.174+0000 7ff5d7a98700 1 -- 172.21.15.96:0/885910202 >> 172.21.15.96:0/885910202 conn(0x7ff5d01008b0 msgr2=0x7ff5d01016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:19.705 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:18.174+0000 7ff5d7a98700 1 -- 172.21.15.96:0/885910202 shutdown_connections 2024-02-19T18:55:19.705 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:18.174+0000 7ff5d7a98700 1 -- 172.21.15.96:0/885910202 wait complete. 2024-02-19T18:55:19.705 INFO:teuthology.orchestra.run.smithi096.stdout:Deploying ceph-exporter service with default placement... 2024-02-19T18:55:20.915 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-02-19T18:55:20.915 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.104+0000 7f3a4acd1700 1 Processor -- start 2024-02-19T18:55:20.915 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.104+0000 7f3a4acd1700 1 -- start start 2024-02-19T18:55:20.915 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.104+0000 7f3a4acd1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a44104730 0x7f3a44104b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:20.915 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.104+0000 7f3a4acd1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a44105120 con 0x7f3a44104730 2024-02-19T18:55:20.916 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.104+0000 7f3a48a6d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a44104730 0x7f3a44104b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:20.916 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.104+0000 7f3a48a6d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a44104730 0x7f3a44104b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48382/0 (socket says 172.21.15.96:48382) 2024-02-19T18:55:20.916 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.104+0000 7f3a48a6d700 1 -- 172.21.15.96:0/3705998795 learned_addr learned my addr 172.21.15.96:0/3705998795 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:20.916 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.105+0000 7f3a48a6d700 1 -- 172.21.15.96:0/3705998795 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a441076c0 con 0x7f3a44104730 2024-02-19T18:55:20.916 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.105+0000 7f3a48a6d700 1 --2- 172.21.15.96:0/3705998795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a44104730 0x7f3a44104b50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3a380098a0 tx=0x7f3a38009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d66bc2431fa86de server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:20.916 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.105+0000 7f3a437fe700 1 -- 172.21.15.96:0/3705998795 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a38004180 con 0x7f3a44104730 2024-02-19T18:55:20.916 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.105+0000 7f3a437fe700 1 -- 172.21.15.96:0/3705998795 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3a380042e0 con 0x7f3a44104730 2024-02-19T18:55:20.916 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.105+0000 7f3a437fe700 1 -- 172.21.15.96:0/3705998795 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a38011af0 con 0x7f3a44104730 2024-02-19T18:55:20.916 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.105+0000 7f3a4acd1700 1 -- 172.21.15.96:0/3705998795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a44104730 msgr2=0x7f3a44104b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:20.916 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.105+0000 7f3a4acd1700 1 --2- 172.21.15.96:0/3705998795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a44104730 0x7f3a44104b50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3a380098a0 tx=0x7f3a38009bb0 comp rx=0 tx=0).stop 2024-02-19T18:55:20.916 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.105+0000 7f3a4acd1700 1 -- 172.21.15.96:0/3705998795 shutdown_connections 2024-02-19T18:55:20.916 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.105+0000 7f3a4acd1700 1 --2- 172.21.15.96:0/3705998795 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a44104730 0x7f3a44104b50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:20.916 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.105+0000 7f3a4acd1700 1 -- 172.21.15.96:0/3705998795 >> 172.21.15.96:0/3705998795 conn(0x7f3a44100040 msgr2=0x7f3a441024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:20.916 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.105+0000 7f3a4acd1700 1 -- 172.21.15.96:0/3705998795 shutdown_connections 2024-02-19T18:55:20.917 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.106+0000 7f3a4acd1700 1 -- 172.21.15.96:0/3705998795 wait complete. 2024-02-19T18:55:20.917 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.106+0000 7f3a4acd1700 1 Processor -- start 2024-02-19T18:55:20.917 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.106+0000 7f3a4acd1700 1 -- start start 2024-02-19T18:55:20.917 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.106+0000 7f3a4acd1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a44104730 0x7f3a4419c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:20.917 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.106+0000 7f3a4acd1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4419c8d0 con 0x7f3a44104730 2024-02-19T18:55:20.917 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.106+0000 7f3a48a6d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a44104730 0x7f3a4419c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:20.917 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.106+0000 7f3a48a6d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a44104730 0x7f3a4419c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48394/0 (socket says 172.21.15.96:48394) 2024-02-19T18:55:20.917 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.106+0000 7f3a48a6d700 1 -- 172.21.15.96:0/3184967430 learned_addr learned my addr 172.21.15.96:0/3184967430 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:20.917 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.107+0000 7f3a48a6d700 1 -- 172.21.15.96:0/3184967430 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a38009550 con 0x7f3a44104730 2024-02-19T18:55:20.917 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.107+0000 7f3a48a6d700 1 --2- 172.21.15.96:0/3184967430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a44104730 0x7f3a4419c390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3a38011670 tx=0x7f3a38011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:20.917 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.107+0000 7f3a41ffb700 1 -- 172.21.15.96:0/3184967430 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a380039f0 con 0x7f3a44104730 2024-02-19T18:55:20.917 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.107+0000 7f3a41ffb700 1 -- 172.21.15.96:0/3184967430 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3a38003b50 con 0x7f3a44104730 2024-02-19T18:55:20.917 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.107+0000 7f3a4acd1700 1 -- 172.21.15.96:0/3184967430 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4419cad0 con 0x7f3a44104730 2024-02-19T18:55:20.917 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.107+0000 7f3a41ffb700 1 -- 172.21.15.96:0/3184967430 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a380247c0 con 0x7f3a44104730 2024-02-19T18:55:20.918 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.107+0000 7f3a4acd1700 1 -- 172.21.15.96:0/3184967430 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4419cf70 con 0x7f3a44104730 2024-02-19T18:55:20.918 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.108+0000 7f3a41ffb700 1 -- 172.21.15.96:0/3184967430 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f3a3802d3f0 con 0x7f3a44104730 2024-02-19T18:55:20.918 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.108+0000 7f3a4acd1700 1 -- 172.21.15.96:0/3184967430 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a440623c0 con 0x7f3a44104730 2024-02-19T18:55:20.918 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.108+0000 7f3a41ffb700 1 --2- 172.21.15.96:0/3184967430 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f3a34038370 0x7f3a3403a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:20.918 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.108+0000 7f3a41ffb700 1 -- 172.21.15.96:0/3184967430 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3a3804c4e0 con 0x7f3a44104730 2024-02-19T18:55:20.918 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.108+0000 7f3a43fff700 1 --2- 172.21.15.96:0/3184967430 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f3a34038370 0x7f3a3403a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:20.918 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.109+0000 7f3a43fff700 1 --2- 172.21.15.96:0/3184967430 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f3a34038370 0x7f3a3403a830 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3a30006fd0 tx=0x7f3a30006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:20.918 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.113+0000 7f3a41ffb700 1 -- 172.21.15.96:0/3184967430 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f3a38019410 con 0x7f3a44104730 2024-02-19T18:55:20.918 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.316+0000 7f3a4acd1700 1 -- 172.21.15.96:0/3184967430 --> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a4410a8c0 con 0x7f3a34038370 2024-02-19T18:55:20.918 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.321+0000 7f3a41ffb700 1 -- 172.21.15.96:0/3184967430 <== mgr.14120 v2:172.21.15.96:6800/3697355606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f3a4410a8c0 con 0x7f3a34038370 2024-02-19T18:55:20.918 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.323+0000 7f3a4acd1700 1 -- 172.21.15.96:0/3184967430 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f3a34038370 msgr2=0x7f3a3403a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:20.918 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.323+0000 7f3a4acd1700 1 --2- 172.21.15.96:0/3184967430 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f3a34038370 0x7f3a3403a830 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3a30006fd0 tx=0x7f3a30006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:20.918 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.323+0000 7f3a4acd1700 1 -- 172.21.15.96:0/3184967430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a44104730 msgr2=0x7f3a4419c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:20.918 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.323+0000 7f3a4acd1700 1 --2- 172.21.15.96:0/3184967430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a44104730 0x7f3a4419c390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3a38011670 tx=0x7f3a38011b50 comp rx=0 tx=0).stop 2024-02-19T18:55:20.918 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.323+0000 7f3a4acd1700 1 -- 172.21.15.96:0/3184967430 shutdown_connections 2024-02-19T18:55:20.919 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.323+0000 7f3a4acd1700 1 --2- 172.21.15.96:0/3184967430 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f3a34038370 0x7f3a3403a830 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:20.919 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.323+0000 7f3a4acd1700 1 --2- 172.21.15.96:0/3184967430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a44104730 0x7f3a4419c390 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:20.919 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.323+0000 7f3a4acd1700 1 -- 172.21.15.96:0/3184967430 >> 172.21.15.96:0/3184967430 conn(0x7f3a44100040 msgr2=0x7f3a44101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:20.919 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.323+0000 7f3a4acd1700 1 -- 172.21.15.96:0/3184967430 shutdown_connections 2024-02-19T18:55:20.919 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:20.324+0000 7f3a4acd1700 1 -- 172.21.15.96:0/3184967430 wait complete. 2024-02-19T18:55:20.919 INFO:teuthology.orchestra.run.smithi096.stdout:Deploying prometheus service with default placement... 2024-02-19T18:55:21.495 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:21 smithi096 ceph-mon[29216]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:55:21.496 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:21 smithi096 ceph-mon[29216]: Saving service ceph-exporter spec with placement * 2024-02-19T18:55:21.496 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:21 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:22.046 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-02-19T18:55:22.047 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.267+0000 7fd5398c5700 1 Processor -- start 2024-02-19T18:55:22.047 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.267+0000 7fd5398c5700 1 -- start start 2024-02-19T18:55:22.047 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.267+0000 7fd5398c5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd534106950 0x7fd534106d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:22.047 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.267+0000 7fd5398c5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd534107340 con 0x7fd534106950 2024-02-19T18:55:22.047 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.267+0000 7fd532ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd534106950 0x7fd534106d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:22.047 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.267+0000 7fd532ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd534106950 0x7fd534106d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48404/0 (socket says 172.21.15.96:48404) 2024-02-19T18:55:22.047 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.267+0000 7fd532ffd700 1 -- 172.21.15.96:0/551821822 learned_addr learned my addr 172.21.15.96:0/551821822 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:22.047 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.268+0000 7fd532ffd700 1 -- 172.21.15.96:0/551821822 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd534107480 con 0x7fd534106950 2024-02-19T18:55:22.047 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.268+0000 7fd532ffd700 1 --2- 172.21.15.96:0/551821822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd534106950 0x7fd534106d70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd5240098a0 tx=0x7fd524009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a760c92968ed1b60 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:22.047 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.268+0000 7fd5327fc700 1 -- 172.21.15.96:0/551821822 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd524004180 con 0x7fd534106950 2024-02-19T18:55:22.047 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.268+0000 7fd5327fc700 1 -- 172.21.15.96:0/551821822 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd5240042e0 con 0x7fd534106950 2024-02-19T18:55:22.047 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.268+0000 7fd5327fc700 1 -- 172.21.15.96:0/551821822 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd524011af0 con 0x7fd534106950 2024-02-19T18:55:22.047 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.269+0000 7fd5398c5700 1 -- 172.21.15.96:0/551821822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd534106950 msgr2=0x7fd534106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:22.047 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.269+0000 7fd5398c5700 1 --2- 172.21.15.96:0/551821822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd534106950 0x7fd534106d70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd5240098a0 tx=0x7fd524009bb0 comp rx=0 tx=0).stop 2024-02-19T18:55:22.048 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.269+0000 7fd5398c5700 1 -- 172.21.15.96:0/551821822 shutdown_connections 2024-02-19T18:55:22.048 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.269+0000 7fd5398c5700 1 --2- 172.21.15.96:0/551821822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd534106950 0x7fd534106d70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:22.048 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.269+0000 7fd5398c5700 1 -- 172.21.15.96:0/551821822 >> 172.21.15.96:0/551821822 conn(0x7fd534100040 msgr2=0x7fd5341024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:22.048 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.269+0000 7fd5398c5700 1 -- 172.21.15.96:0/551821822 shutdown_connections 2024-02-19T18:55:22.048 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.269+0000 7fd5398c5700 1 -- 172.21.15.96:0/551821822 wait complete. 2024-02-19T18:55:22.048 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.269+0000 7fd5398c5700 1 Processor -- start 2024-02-19T18:55:22.048 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.269+0000 7fd5398c5700 1 -- start start 2024-02-19T18:55:22.048 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.270+0000 7fd5398c5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd534106950 0x7fd53419c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:22.048 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.270+0000 7fd5398c5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53419c8e0 con 0x7fd534106950 2024-02-19T18:55:22.048 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.270+0000 7fd532ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd534106950 0x7fd53419c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:22.048 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.270+0000 7fd532ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd534106950 0x7fd53419c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48416/0 (socket says 172.21.15.96:48416) 2024-02-19T18:55:22.048 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.270+0000 7fd532ffd700 1 -- 172.21.15.96:0/2304096079 learned_addr learned my addr 172.21.15.96:0/2304096079 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:22.048 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.270+0000 7fd532ffd700 1 -- 172.21.15.96:0/2304096079 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd524009550 con 0x7fd534106950 2024-02-19T18:55:22.048 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.270+0000 7fd532ffd700 1 --2- 172.21.15.96:0/2304096079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd534106950 0x7fd53419c3a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd524011670 tx=0x7fd524011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:22.048 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.270+0000 7fd5388c3700 1 -- 172.21.15.96:0/2304096079 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5240039c0 con 0x7fd534106950 2024-02-19T18:55:22.049 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.270+0000 7fd5388c3700 1 -- 172.21.15.96:0/2304096079 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd524003b20 con 0x7fd534106950 2024-02-19T18:55:22.049 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.270+0000 7fd5398c5700 1 -- 172.21.15.96:0/2304096079 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53419cae0 con 0x7fd534106950 2024-02-19T18:55:22.049 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.270+0000 7fd5388c3700 1 -- 172.21.15.96:0/2304096079 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5240247f0 con 0x7fd534106950 2024-02-19T18:55:22.049 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.270+0000 7fd5398c5700 1 -- 172.21.15.96:0/2304096079 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53419cf80 con 0x7fd534106950 2024-02-19T18:55:22.049 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.271+0000 7fd5398c5700 1 -- 172.21.15.96:0/2304096079 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd534196040 con 0x7fd534106950 2024-02-19T18:55:22.049 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.271+0000 7fd5388c3700 1 -- 172.21.15.96:0/2304096079 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fd52401ac70 con 0x7fd534106950 2024-02-19T18:55:22.049 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.271+0000 7fd5388c3700 1 --2- 172.21.15.96:0/2304096079 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fd520038330 0x7fd52003a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:22.049 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.272+0000 7fd5388c3700 1 -- 172.21.15.96:0/2304096079 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd52404c270 con 0x7fd534106950 2024-02-19T18:55:22.049 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.272+0000 7fd52a7fc700 1 --2- 172.21.15.96:0/2304096079 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fd520038330 0x7fd52003a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:22.049 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.272+0000 7fd52a7fc700 1 --2- 172.21.15.96:0/2304096079 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fd520038330 0x7fd52003a7f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd51c006fd0 tx=0x7fd51c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:22.049 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.276+0000 7fd5388c3700 1 -- 172.21.15.96:0/2304096079 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd524024a60 con 0x7fd534106950 2024-02-19T18:55:22.049 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.477+0000 7fd5398c5700 1 -- 172.21.15.96:0/2304096079 --> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5340611d0 con 0x7fd520038330 2024-02-19T18:55:22.049 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.483+0000 7fd5388c3700 1 -- 172.21.15.96:0/2304096079 <== mgr.14120 v2:172.21.15.96:6800/3697355606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fd5340611d0 con 0x7fd520038330 2024-02-19T18:55:22.049 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.485+0000 7fd5398c5700 1 -- 172.21.15.96:0/2304096079 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fd520038330 msgr2=0x7fd52003a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:22.050 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.485+0000 7fd5398c5700 1 --2- 172.21.15.96:0/2304096079 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fd520038330 0x7fd52003a7f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd51c006fd0 tx=0x7fd51c006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:22.050 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.485+0000 7fd5398c5700 1 -- 172.21.15.96:0/2304096079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd534106950 msgr2=0x7fd53419c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:22.050 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.485+0000 7fd5398c5700 1 --2- 172.21.15.96:0/2304096079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd534106950 0x7fd53419c3a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd524011670 tx=0x7fd524011aa0 comp rx=0 tx=0).stop 2024-02-19T18:55:22.050 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.485+0000 7fd5398c5700 1 -- 172.21.15.96:0/2304096079 shutdown_connections 2024-02-19T18:55:22.050 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.485+0000 7fd5398c5700 1 --2- 172.21.15.96:0/2304096079 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fd520038330 0x7fd52003a7f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:22.050 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.485+0000 7fd5398c5700 1 --2- 172.21.15.96:0/2304096079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd534106950 0x7fd53419c3a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:22.050 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.485+0000 7fd5398c5700 1 -- 172.21.15.96:0/2304096079 >> 172.21.15.96:0/2304096079 conn(0x7fd534100040 msgr2=0x7fd534193180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:22.050 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.485+0000 7fd5398c5700 1 -- 172.21.15.96:0/2304096079 shutdown_connections 2024-02-19T18:55:22.050 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:21.485+0000 7fd5398c5700 1 -- 172.21.15.96:0/2304096079 wait complete. 2024-02-19T18:55:22.050 INFO:teuthology.orchestra.run.smithi096.stdout:Deploying grafana service with default placement... 2024-02-19T18:55:22.711 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:22 smithi096 ceph-mon[29216]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:55:22.711 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:22 smithi096 ceph-mon[29216]: Saving service prometheus spec with placement count:1 2024-02-19T18:55:22.711 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:22 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:23.294 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-02-19T18:55:23.295 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.482+0000 7fdf0700d700 1 Processor -- start 2024-02-19T18:55:23.295 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.482+0000 7fdf0700d700 1 -- start start 2024-02-19T18:55:23.295 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.482+0000 7fdf0700d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf00106910 0x7fdf00106d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:23.295 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.482+0000 7fdf0700d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf00107300 con 0x7fdf00106910 2024-02-19T18:55:23.295 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.482+0000 7fdf04da9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf00106910 0x7fdf00106d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:23.295 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.482+0000 7fdf04da9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf00106910 0x7fdf00106d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48432/0 (socket says 172.21.15.96:48432) 2024-02-19T18:55:23.295 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.483+0000 7fdf04da9700 1 -- 172.21.15.96:0/810449524 learned_addr learned my addr 172.21.15.96:0/810449524 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:23.295 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.483+0000 7fdf04da9700 1 -- 172.21.15.96:0/810449524 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf00105570 con 0x7fdf00106910 2024-02-19T18:55:23.295 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.483+0000 7fdf04da9700 1 --2- 172.21.15.96:0/810449524 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf00106910 0x7fdf00106d30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdef400bb40 tx=0x7fdef400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4336caeb77ae761e server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:23.295 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.484+0000 7fdeff7fe700 1 -- 172.21.15.96:0/810449524 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdef400dc00 con 0x7fdf00106910 2024-02-19T18:55:23.295 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.484+0000 7fdeff7fe700 1 -- 172.21.15.96:0/810449524 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdef40044e0 con 0x7fdf00106910 2024-02-19T18:55:23.295 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.484+0000 7fdeff7fe700 1 -- 172.21.15.96:0/810449524 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdef4010470 con 0x7fdf00106910 2024-02-19T18:55:23.296 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.485+0000 7fdf0700d700 1 -- 172.21.15.96:0/810449524 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf00106910 msgr2=0x7fdf00106d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:23.296 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.485+0000 7fdf0700d700 1 --2- 172.21.15.96:0/810449524 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf00106910 0x7fdf00106d30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdef400bb40 tx=0x7fdef400be50 comp rx=0 tx=0).stop 2024-02-19T18:55:23.296 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.485+0000 7fdf0700d700 1 -- 172.21.15.96:0/810449524 shutdown_connections 2024-02-19T18:55:23.296 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.485+0000 7fdf0700d700 1 --2- 172.21.15.96:0/810449524 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf00106910 0x7fdf00106d30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:23.296 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.485+0000 7fdf0700d700 1 -- 172.21.15.96:0/810449524 >> 172.21.15.96:0/810449524 conn(0x7fdf00100040 msgr2=0x7fdf001024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:23.296 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.485+0000 7fdf0700d700 1 -- 172.21.15.96:0/810449524 shutdown_connections 2024-02-19T18:55:23.296 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.485+0000 7fdf0700d700 1 -- 172.21.15.96:0/810449524 wait complete. 2024-02-19T18:55:23.296 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.485+0000 7fdf0700d700 1 Processor -- start 2024-02-19T18:55:23.296 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.486+0000 7fdf0700d700 1 -- start start 2024-02-19T18:55:23.296 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.486+0000 7fdf0700d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf00106910 0x7fdf0019c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:23.296 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.486+0000 7fdf0700d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0019c8a0 con 0x7fdf00106910 2024-02-19T18:55:23.296 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.486+0000 7fdf04da9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf00106910 0x7fdf0019c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:23.296 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.486+0000 7fdf04da9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf00106910 0x7fdf0019c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48448/0 (socket says 172.21.15.96:48448) 2024-02-19T18:55:23.296 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.486+0000 7fdf04da9700 1 -- 172.21.15.96:0/2038447310 learned_addr learned my addr 172.21.15.96:0/2038447310 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:23.297 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.486+0000 7fdf04da9700 1 -- 172.21.15.96:0/2038447310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef400b7f0 con 0x7fdf00106910 2024-02-19T18:55:23.297 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.486+0000 7fdf04da9700 1 --2- 172.21.15.96:0/2038447310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf00106910 0x7fdf0019c360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdef400b340 tx=0x7fdef4004070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:23.297 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.486+0000 7fdefdffb700 1 -- 172.21.15.96:0/2038447310 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdef400de20 con 0x7fdf00106910 2024-02-19T18:55:23.297 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.486+0000 7fdefdffb700 1 -- 172.21.15.96:0/2038447310 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdef4010be0 con 0x7fdf00106910 2024-02-19T18:55:23.297 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.486+0000 7fdf0700d700 1 -- 172.21.15.96:0/2038447310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0019caa0 con 0x7fdf00106910 2024-02-19T18:55:23.297 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.486+0000 7fdefdffb700 1 -- 172.21.15.96:0/2038447310 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdef4021b90 con 0x7fdf00106910 2024-02-19T18:55:23.297 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.487+0000 7fdf0700d700 1 -- 172.21.15.96:0/2038447310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0019cee0 con 0x7fdf00106910 2024-02-19T18:55:23.297 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.487+0000 7fdefdffb700 1 -- 172.21.15.96:0/2038447310 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fdef40193f0 con 0x7fdf00106910 2024-02-19T18:55:23.297 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.487+0000 7fdefdffb700 1 --2- 172.21.15.96:0/2038447310 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fdef0038320 0x7fdef003a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:23.297 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.487+0000 7fdefdffb700 1 -- 172.21.15.96:0/2038447310 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fdef404d440 con 0x7fdf00106910 2024-02-19T18:55:23.297 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.488+0000 7fdefffff700 1 --2- 172.21.15.96:0/2038447310 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fdef0038320 0x7fdef003a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:23.297 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.488+0000 7fdf0700d700 1 -- 172.21.15.96:0/2038447310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf00191c10 con 0x7fdf00106910 2024-02-19T18:55:23.297 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.488+0000 7fdefffff700 1 --2- 172.21.15.96:0/2038447310 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fdef0038320 0x7fdef003a7e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdeec006fd0 tx=0x7fdeec006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:23.297 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.492+0000 7fdefdffb700 1 -- 172.21.15.96:0/2038447310 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fdef400e360 con 0x7fdf00106910 2024-02-19T18:55:23.297 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.694+0000 7fdf0700d700 1 -- 172.21.15.96:0/2038447310 --> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf000611d0 con 0x7fdef0038320 2024-02-19T18:55:23.297 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.699+0000 7fdefdffb700 1 -- 172.21.15.96:0/2038447310 <== mgr.14120 v2:172.21.15.96:6800/3697355606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fdf000611d0 con 0x7fdef0038320 2024-02-19T18:55:23.298 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.701+0000 7fdf0700d700 1 -- 172.21.15.96:0/2038447310 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fdef0038320 msgr2=0x7fdef003a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:23.298 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.701+0000 7fdf0700d700 1 --2- 172.21.15.96:0/2038447310 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fdef0038320 0x7fdef003a7e0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdeec006fd0 tx=0x7fdeec006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:23.298 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.701+0000 7fdf0700d700 1 -- 172.21.15.96:0/2038447310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf00106910 msgr2=0x7fdf0019c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:23.298 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.701+0000 7fdf0700d700 1 --2- 172.21.15.96:0/2038447310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf00106910 0x7fdf0019c360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdef400b340 tx=0x7fdef4004070 comp rx=0 tx=0).stop 2024-02-19T18:55:23.298 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.702+0000 7fdf0700d700 1 -- 172.21.15.96:0/2038447310 shutdown_connections 2024-02-19T18:55:23.298 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.702+0000 7fdf0700d700 1 --2- 172.21.15.96:0/2038447310 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fdef0038320 0x7fdef003a7e0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:23.298 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.702+0000 7fdf0700d700 1 --2- 172.21.15.96:0/2038447310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf00106910 0x7fdf0019c360 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:23.298 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.702+0000 7fdf0700d700 1 -- 172.21.15.96:0/2038447310 >> 172.21.15.96:0/2038447310 conn(0x7fdf00100040 msgr2=0x7fdf0018ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:23.298 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.702+0000 7fdf0700d700 1 -- 172.21.15.96:0/2038447310 shutdown_connections 2024-02-19T18:55:23.298 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:22.702+0000 7fdf0700d700 1 -- 172.21.15.96:0/2038447310 wait complete. 2024-02-19T18:55:23.298 INFO:teuthology.orchestra.run.smithi096.stdout:Deploying node-exporter service with default placement... 2024-02-19T18:55:23.933 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:23 smithi096 ceph-mon[29216]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:55:23.934 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:23 smithi096 ceph-mon[29216]: Saving service grafana spec with placement count:1 2024-02-19T18:55:23.934 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:23 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:23.934 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:23 smithi096 ceph-mon[29216]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:24.503 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-02-19T18:55:24.503 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.707+0000 7fbabfc0b700 1 Processor -- start 2024-02-19T18:55:24.503 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.707+0000 7fbabfc0b700 1 -- start start 2024-02-19T18:55:24.503 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.708+0000 7fbabfc0b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab8105840 0x7fbab8105c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:24.503 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.708+0000 7fbabfc0b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab8106230 con 0x7fbab8105840 2024-02-19T18:55:24.503 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.708+0000 7fbabd9a7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab8105840 0x7fbab8105c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:24.503 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.708+0000 7fbabd9a7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab8105840 0x7fbab8105c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58694/0 (socket says 172.21.15.96:58694) 2024-02-19T18:55:24.504 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.708+0000 7fbabd9a7700 1 -- 172.21.15.96:0/1426136036 learned_addr learned my addr 172.21.15.96:0/1426136036 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:24.504 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.708+0000 7fbabd9a7700 1 -- 172.21.15.96:0/1426136036 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab8106560 con 0x7fbab8105840 2024-02-19T18:55:24.504 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.708+0000 7fbabd9a7700 1 --2- 172.21.15.96:0/1426136036 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab8105840 0x7fbab8105c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbab40098a0 tx=0x7fbab4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0c18cd8c3114cb server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:24.504 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.708+0000 7fbabc9a5700 1 -- 172.21.15.96:0/1426136036 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbab4004180 con 0x7fbab8105840 2024-02-19T18:55:24.504 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.708+0000 7fbabc9a5700 1 -- 172.21.15.96:0/1426136036 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbab40042e0 con 0x7fbab8105840 2024-02-19T18:55:24.504 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.708+0000 7fbabc9a5700 1 -- 172.21.15.96:0/1426136036 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbab4011af0 con 0x7fbab8105840 2024-02-19T18:55:24.504 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.709+0000 7fbabfc0b700 1 -- 172.21.15.96:0/1426136036 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab8105840 msgr2=0x7fbab8105c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:24.504 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.709+0000 7fbabfc0b700 1 --2- 172.21.15.96:0/1426136036 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab8105840 0x7fbab8105c60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbab40098a0 tx=0x7fbab4009bb0 comp rx=0 tx=0).stop 2024-02-19T18:55:24.504 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.709+0000 7fbabfc0b700 1 -- 172.21.15.96:0/1426136036 shutdown_connections 2024-02-19T18:55:24.504 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.709+0000 7fbabfc0b700 1 --2- 172.21.15.96:0/1426136036 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab8105840 0x7fbab8105c60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:24.504 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.709+0000 7fbabfc0b700 1 -- 172.21.15.96:0/1426136036 >> 172.21.15.96:0/1426136036 conn(0x7fbab8100040 msgr2=0x7fbab81024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:24.504 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.709+0000 7fbabfc0b700 1 -- 172.21.15.96:0/1426136036 shutdown_connections 2024-02-19T18:55:24.504 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.709+0000 7fbabfc0b700 1 -- 172.21.15.96:0/1426136036 wait complete. 2024-02-19T18:55:24.504 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.709+0000 7fbabfc0b700 1 Processor -- start 2024-02-19T18:55:24.505 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.709+0000 7fbabfc0b700 1 -- start start 2024-02-19T18:55:24.505 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.710+0000 7fbabfc0b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab8105840 0x7fbab8199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:24.505 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.710+0000 7fbabfc0b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab8199580 con 0x7fbab8105840 2024-02-19T18:55:24.505 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.710+0000 7fbabd9a7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab8105840 0x7fbab8199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:24.505 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.710+0000 7fbabd9a7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab8105840 0x7fbab8199040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58700/0 (socket says 172.21.15.96:58700) 2024-02-19T18:55:24.505 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.710+0000 7fbabd9a7700 1 -- 172.21.15.96:0/3145026026 learned_addr learned my addr 172.21.15.96:0/3145026026 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:24.505 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.710+0000 7fbabd9a7700 1 -- 172.21.15.96:0/3145026026 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab4009550 con 0x7fbab8105840 2024-02-19T18:55:24.505 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.710+0000 7fbabd9a7700 1 --2- 172.21.15.96:0/3145026026 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab8105840 0x7fbab8199040 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbab4011670 tx=0x7fbab4011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:24.505 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.710+0000 7fbaaeffd700 1 -- 172.21.15.96:0/3145026026 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbab4003a40 con 0x7fbab8105840 2024-02-19T18:55:24.505 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.710+0000 7fbaaeffd700 1 -- 172.21.15.96:0/3145026026 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbab4003ba0 con 0x7fbab8105840 2024-02-19T18:55:24.505 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.710+0000 7fbabfc0b700 1 -- 172.21.15.96:0/3145026026 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab8199780 con 0x7fbab8105840 2024-02-19T18:55:24.505 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.710+0000 7fbaaeffd700 1 -- 172.21.15.96:0/3145026026 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbab4024790 con 0x7fbab8105840 2024-02-19T18:55:24.505 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.711+0000 7fbabfc0b700 1 -- 172.21.15.96:0/3145026026 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab8199c20 con 0x7fbab8105840 2024-02-19T18:55:24.505 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.711+0000 7fbaaeffd700 1 -- 172.21.15.96:0/3145026026 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fbab402d3f0 con 0x7fbab8105840 2024-02-19T18:55:24.506 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.711+0000 7fbaaeffd700 1 --2- 172.21.15.96:0/3145026026 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fbaa4038370 0x7fbaa403a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:24.506 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.711+0000 7fbaaeffd700 1 -- 172.21.15.96:0/3145026026 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbab404c450 con 0x7fbab8105840 2024-02-19T18:55:24.506 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.711+0000 7fbabd1a6700 1 --2- 172.21.15.96:0/3145026026 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fbaa4038370 0x7fbaa403a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:24.506 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.711+0000 7fbabfc0b700 1 -- 172.21.15.96:0/3145026026 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab80623c0 con 0x7fbab8105840 2024-02-19T18:55:24.506 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.712+0000 7fbabd1a6700 1 --2- 172.21.15.96:0/3145026026 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fbaa4038370 0x7fbaa403a830 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8006fd0 tx=0x7fbaa8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:24.506 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.716+0000 7fbaaeffd700 1 -- 172.21.15.96:0/3145026026 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fbab4019460 con 0x7fbab8105840 2024-02-19T18:55:24.506 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.916+0000 7fbabfc0b700 1 -- 172.21.15.96:0/3145026026 --> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fbab8101560 con 0x7fbaa4038370 2024-02-19T18:55:24.506 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.921+0000 7fbaaeffd700 1 -- 172.21.15.96:0/3145026026 <== mgr.14120 v2:172.21.15.96:6800/3697355606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fbab8101560 con 0x7fbaa4038370 2024-02-19T18:55:24.506 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.923+0000 7fbabfc0b700 1 -- 172.21.15.96:0/3145026026 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fbaa4038370 msgr2=0x7fbaa403a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:24.506 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.923+0000 7fbabfc0b700 1 --2- 172.21.15.96:0/3145026026 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fbaa4038370 0x7fbaa403a830 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8006fd0 tx=0x7fbaa8006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:24.506 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.923+0000 7fbabfc0b700 1 -- 172.21.15.96:0/3145026026 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab8105840 msgr2=0x7fbab8199040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:24.506 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.923+0000 7fbabfc0b700 1 --2- 172.21.15.96:0/3145026026 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab8105840 0x7fbab8199040 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbab4011670 tx=0x7fbab4011b50 comp rx=0 tx=0).stop 2024-02-19T18:55:24.506 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.924+0000 7fbabfc0b700 1 -- 172.21.15.96:0/3145026026 shutdown_connections 2024-02-19T18:55:24.506 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.924+0000 7fbabfc0b700 1 --2- 172.21.15.96:0/3145026026 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fbaa4038370 0x7fbaa403a830 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:24.507 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.924+0000 7fbabfc0b700 1 --2- 172.21.15.96:0/3145026026 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab8105840 0x7fbab8199040 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:24.507 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.924+0000 7fbabfc0b700 1 -- 172.21.15.96:0/3145026026 >> 172.21.15.96:0/3145026026 conn(0x7fbab8100040 msgr2=0x7fbab8100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:24.507 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.924+0000 7fbabfc0b700 1 -- 172.21.15.96:0/3145026026 shutdown_connections 2024-02-19T18:55:24.507 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:23.924+0000 7fbabfc0b700 1 -- 172.21.15.96:0/3145026026 wait complete. 2024-02-19T18:55:24.507 INFO:teuthology.orchestra.run.smithi096.stdout:Deploying alertmanager service with default placement... 2024-02-19T18:55:25.033 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:24 smithi096 ceph-mon[29216]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:55:25.033 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:24 smithi096 ceph-mon[29216]: Saving service node-exporter spec with placement * 2024-02-19T18:55:25.033 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:24 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:25.750 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-02-19T18:55:25.750 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.938+0000 7f7f58eaa700 1 Processor -- start 2024-02-19T18:55:25.750 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.938+0000 7f7f58eaa700 1 -- start start 2024-02-19T18:55:25.750 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.938+0000 7f7f58eaa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f54106420 0x7f7f54106840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:25.751 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.938+0000 7f7f58eaa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f54106e10 con 0x7f7f54106420 2024-02-19T18:55:25.751 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.938+0000 7f7f5259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f54106420 0x7f7f54106840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:25.751 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.938+0000 7f7f5259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f54106420 0x7f7f54106840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58714/0 (socket says 172.21.15.96:58714) 2024-02-19T18:55:25.751 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.938+0000 7f7f5259c700 1 -- 172.21.15.96:0/680905086 learned_addr learned my addr 172.21.15.96:0/680905086 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:25.751 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.938+0000 7f7f5259c700 1 -- 172.21.15.96:0/680905086 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f54107620 con 0x7f7f54106420 2024-02-19T18:55:25.751 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.939+0000 7f7f5259c700 1 --2- 172.21.15.96:0/680905086 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f54106420 0x7f7f54106840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7f440098a0 tx=0x7f7f44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5aac555065ae4d1 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:25.751 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.939+0000 7f7f5159a700 1 -- 172.21.15.96:0/680905086 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f44004180 con 0x7f7f54106420 2024-02-19T18:55:25.751 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.939+0000 7f7f5159a700 1 -- 172.21.15.96:0/680905086 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7f440042e0 con 0x7f7f54106420 2024-02-19T18:55:25.751 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.939+0000 7f7f5159a700 1 -- 172.21.15.96:0/680905086 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f44011af0 con 0x7f7f54106420 2024-02-19T18:55:25.751 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.939+0000 7f7f58eaa700 1 -- 172.21.15.96:0/680905086 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f54106420 msgr2=0x7f7f54106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:25.751 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.939+0000 7f7f58eaa700 1 --2- 172.21.15.96:0/680905086 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f54106420 0x7f7f54106840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7f440098a0 tx=0x7f7f44009bb0 comp rx=0 tx=0).stop 2024-02-19T18:55:25.751 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.939+0000 7f7f58eaa700 1 -- 172.21.15.96:0/680905086 shutdown_connections 2024-02-19T18:55:25.751 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.939+0000 7f7f58eaa700 1 --2- 172.21.15.96:0/680905086 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f54106420 0x7f7f54106840 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:25.751 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.939+0000 7f7f58eaa700 1 -- 172.21.15.96:0/680905086 >> 172.21.15.96:0/680905086 conn(0x7f7f54101a00 msgr2=0x7f7f54103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:25.752 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.939+0000 7f7f58eaa700 1 -- 172.21.15.96:0/680905086 shutdown_connections 2024-02-19T18:55:25.752 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.939+0000 7f7f58eaa700 1 -- 172.21.15.96:0/680905086 wait complete. 2024-02-19T18:55:25.752 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.940+0000 7f7f58eaa700 1 Processor -- start 2024-02-19T18:55:25.752 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.940+0000 7f7f58eaa700 1 -- start start 2024-02-19T18:55:25.752 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.940+0000 7f7f58eaa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f54106420 0x7f7f5419a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:25.752 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.940+0000 7f7f58eaa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5419a680 con 0x7f7f54106420 2024-02-19T18:55:25.752 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.940+0000 7f7f5259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f54106420 0x7f7f5419a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:25.752 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.940+0000 7f7f5259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f54106420 0x7f7f5419a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58724/0 (socket says 172.21.15.96:58724) 2024-02-19T18:55:25.752 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.941+0000 7f7f5259c700 1 -- 172.21.15.96:0/1292848627 learned_addr learned my addr 172.21.15.96:0/1292848627 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:25.752 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.941+0000 7f7f5259c700 1 -- 172.21.15.96:0/1292848627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f44009550 con 0x7f7f54106420 2024-02-19T18:55:25.752 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.941+0000 7f7f5259c700 1 --2- 172.21.15.96:0/1292848627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f54106420 0x7f7f5419a140 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7f44000c00 tx=0x7f7f44011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:25.752 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.941+0000 7f7f437fe700 1 -- 172.21.15.96:0/1292848627 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f44003a70 con 0x7f7f54106420 2024-02-19T18:55:25.752 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.941+0000 7f7f437fe700 1 -- 172.21.15.96:0/1292848627 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7f44003bd0 con 0x7f7f54106420 2024-02-19T18:55:25.752 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.941+0000 7f7f58eaa700 1 -- 172.21.15.96:0/1292848627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5419a880 con 0x7f7f54106420 2024-02-19T18:55:25.752 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.941+0000 7f7f437fe700 1 -- 172.21.15.96:0/1292848627 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f440238c0 con 0x7f7f54106420 2024-02-19T18:55:25.753 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.941+0000 7f7f58eaa700 1 -- 172.21.15.96:0/1292848627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f5419ad20 con 0x7f7f54106420 2024-02-19T18:55:25.753 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.942+0000 7f7f437fe700 1 -- 172.21.15.96:0/1292848627 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f7f4401a430 con 0x7f7f54106420 2024-02-19T18:55:25.753 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.942+0000 7f7f58eaa700 1 -- 172.21.15.96:0/1292848627 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f540623c0 con 0x7f7f54106420 2024-02-19T18:55:25.753 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.942+0000 7f7f437fe700 1 --2- 172.21.15.96:0/1292848627 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7f3c038370 0x7f7f3c03a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:25.753 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.942+0000 7f7f437fe700 1 -- 172.21.15.96:0/1292848627 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7f4404c1a0 con 0x7f7f54106420 2024-02-19T18:55:25.753 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.942+0000 7f7f51d9b700 1 --2- 172.21.15.96:0/1292848627 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7f3c038370 0x7f7f3c03a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:25.753 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.943+0000 7f7f51d9b700 1 --2- 172.21.15.96:0/1292848627 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7f3c038370 0x7f7f3c03a830 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7f48006fd0 tx=0x7f7f48006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:25.753 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:24.947+0000 7f7f437fe700 1 -- 172.21.15.96:0/1292848627 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f7f44010560 con 0x7f7f54106420 2024-02-19T18:55:25.753 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:25.147+0000 7f7f58eaa700 1 -- 172.21.15.96:0/1292848627 --> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f5410a820 con 0x7f7f3c038370 2024-02-19T18:55:25.753 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:25.152+0000 7f7f437fe700 1 -- 172.21.15.96:0/1292848627 <== mgr.14120 v2:172.21.15.96:6800/3697355606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f7f5410a820 con 0x7f7f3c038370 2024-02-19T18:55:25.753 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:25.154+0000 7f7f58eaa700 1 -- 172.21.15.96:0/1292848627 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7f3c038370 msgr2=0x7f7f3c03a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:25.753 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:25.154+0000 7f7f58eaa700 1 --2- 172.21.15.96:0/1292848627 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7f3c038370 0x7f7f3c03a830 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7f48006fd0 tx=0x7f7f48006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:25.753 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:25.154+0000 7f7f58eaa700 1 -- 172.21.15.96:0/1292848627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f54106420 msgr2=0x7f7f5419a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:25.753 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:25.154+0000 7f7f58eaa700 1 --2- 172.21.15.96:0/1292848627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f54106420 0x7f7f5419a140 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7f44000c00 tx=0x7f7f44011b50 comp rx=0 tx=0).stop 2024-02-19T18:55:25.753 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:25.154+0000 7f7f58eaa700 1 -- 172.21.15.96:0/1292848627 shutdown_connections 2024-02-19T18:55:25.754 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:25.154+0000 7f7f58eaa700 1 --2- 172.21.15.96:0/1292848627 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7f3c038370 0x7f7f3c03a830 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:25.754 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:25.154+0000 7f7f58eaa700 1 --2- 172.21.15.96:0/1292848627 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f54106420 0x7f7f5419a140 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:25.754 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:25.154+0000 7f7f58eaa700 1 -- 172.21.15.96:0/1292848627 >> 172.21.15.96:0/1292848627 conn(0x7f7f54101a00 msgr2=0x7f7f541030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:25.754 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:25.154+0000 7f7f58eaa700 1 -- 172.21.15.96:0/1292848627 shutdown_connections 2024-02-19T18:55:25.754 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:25.154+0000 7f7f58eaa700 1 -- 172.21.15.96:0/1292848627 wait complete. 2024-02-19T18:55:26.283 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:26 smithi096 ceph-mon[29216]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:26.283 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:26 smithi096 ceph-mon[29216]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:55:26.283 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:26 smithi096 ceph-mon[29216]: Saving service alertmanager spec with placement count:1 2024-02-19T18:55:26.283 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:26 smithi096 ceph-mon[29216]: from='mgr.14120 172.21.15.96:0/1668566517' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:26.931 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.198+0000 7fd465dd3700 1 Processor -- start 2024-02-19T18:55:26.931 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.198+0000 7fd465dd3700 1 -- start start 2024-02-19T18:55:26.931 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.198+0000 7fd465dd3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd460106f00 0x7fd4601092f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:26.931 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.198+0000 7fd465dd3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd460079e60 con 0x7fd460106f00 2024-02-19T18:55:26.931 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.198+0000 7fd45f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd460106f00 0x7fd4601092f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:26.931 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.198+0000 7fd45f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd460106f00 0x7fd4601092f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58726/0 (socket says 172.21.15.96:58726) 2024-02-19T18:55:26.931 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.198+0000 7fd45f7fe700 1 -- 172.21.15.96:0/2823669067 learned_addr learned my addr 172.21.15.96:0/2823669067 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:26.931 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.198+0000 7fd45f7fe700 1 -- 172.21.15.96:0/2823669067 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd460109830 con 0x7fd460106f00 2024-02-19T18:55:26.932 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.199+0000 7fd45f7fe700 1 --2- 172.21.15.96:0/2823669067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd460106f00 0x7fd4601092f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd4500098a0 tx=0x7fd450009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a1935f79224739 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:26.932 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.199+0000 7fd45e7fc700 1 -- 172.21.15.96:0/2823669067 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd450004180 con 0x7fd460106f00 2024-02-19T18:55:26.932 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.199+0000 7fd45e7fc700 1 -- 172.21.15.96:0/2823669067 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd4500042e0 con 0x7fd460106f00 2024-02-19T18:55:26.932 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.199+0000 7fd45e7fc700 1 -- 172.21.15.96:0/2823669067 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd450011af0 con 0x7fd460106f00 2024-02-19T18:55:26.932 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.199+0000 7fd465dd3700 1 -- 172.21.15.96:0/2823669067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd460106f00 msgr2=0x7fd4601092f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:26.932 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.199+0000 7fd465dd3700 1 --2- 172.21.15.96:0/2823669067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd460106f00 0x7fd4601092f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd4500098a0 tx=0x7fd450009bb0 comp rx=0 tx=0).stop 2024-02-19T18:55:26.932 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.199+0000 7fd465dd3700 1 -- 172.21.15.96:0/2823669067 shutdown_connections 2024-02-19T18:55:26.932 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.199+0000 7fd465dd3700 1 --2- 172.21.15.96:0/2823669067 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd460106f00 0x7fd4601092f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:26.932 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.199+0000 7fd465dd3700 1 -- 172.21.15.96:0/2823669067 >> 172.21.15.96:0/2823669067 conn(0x7fd4601008b0 msgr2=0x7fd460102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:26.932 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.199+0000 7fd465dd3700 1 -- 172.21.15.96:0/2823669067 shutdown_connections 2024-02-19T18:55:26.932 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.200+0000 7fd465dd3700 1 -- 172.21.15.96:0/2823669067 wait complete. 2024-02-19T18:55:26.932 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.200+0000 7fd465dd3700 1 Processor -- start 2024-02-19T18:55:26.932 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.200+0000 7fd465dd3700 1 -- start start 2024-02-19T18:55:26.932 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.200+0000 7fd465dd3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd460106f00 0x7fd460106860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:26.933 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.200+0000 7fd465dd3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd460106da0 con 0x7fd460106f00 2024-02-19T18:55:26.933 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.200+0000 7fd45f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd460106f00 0x7fd460106860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:26.933 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.200+0000 7fd45f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd460106f00 0x7fd460106860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58732/0 (socket says 172.21.15.96:58732) 2024-02-19T18:55:26.933 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.200+0000 7fd45f7fe700 1 -- 172.21.15.96:0/258261921 learned_addr learned my addr 172.21.15.96:0/258261921 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:26.933 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.201+0000 7fd45f7fe700 1 -- 172.21.15.96:0/258261921 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd450009550 con 0x7fd460106f00 2024-02-19T18:55:26.933 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.201+0000 7fd45f7fe700 1 --2- 172.21.15.96:0/258261921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd460106f00 0x7fd460106860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd450011670 tx=0x7fd450011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:26.933 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.201+0000 7fd45cff9700 1 -- 172.21.15.96:0/258261921 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd450003a40 con 0x7fd460106f00 2024-02-19T18:55:26.933 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.201+0000 7fd45cff9700 1 -- 172.21.15.96:0/258261921 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd450003ba0 con 0x7fd460106f00 2024-02-19T18:55:26.933 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.201+0000 7fd465dd3700 1 -- 172.21.15.96:0/258261921 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd460104eb0 con 0x7fd460106f00 2024-02-19T18:55:26.933 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.201+0000 7fd45cff9700 1 -- 172.21.15.96:0/258261921 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd450024790 con 0x7fd460106f00 2024-02-19T18:55:26.933 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.201+0000 7fd465dd3700 1 -- 172.21.15.96:0/258261921 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd460105350 con 0x7fd460106f00 2024-02-19T18:55:26.933 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.202+0000 7fd45cff9700 1 -- 172.21.15.96:0/258261921 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fd45002d3f0 con 0x7fd460106f00 2024-02-19T18:55:26.933 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.202+0000 7fd45cff9700 1 --2- 172.21.15.96:0/258261921 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fd448038370 0x7fd44803a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:26.933 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.202+0000 7fd465dd3700 1 -- 172.21.15.96:0/258261921 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4600623c0 con 0x7fd460106f00 2024-02-19T18:55:26.934 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.202+0000 7fd45cff9700 1 -- 172.21.15.96:0/258261921 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd45004c5b0 con 0x7fd460106f00 2024-02-19T18:55:26.934 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.202+0000 7fd45effd700 1 --2- 172.21.15.96:0/258261921 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fd448038370 0x7fd44803a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:26.934 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.203+0000 7fd45effd700 1 --2- 172.21.15.96:0/258261921 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fd448038370 0x7fd44803a830 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd454006fd0 tx=0x7fd454006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:26.934 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.207+0000 7fd45cff9700 1 -- 172.21.15.96:0/258261921 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd450010560 con 0x7fd460106f00 2024-02-19T18:55:26.934 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.396+0000 7fd465dd3700 1 -- 172.21.15.96:0/258261921 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fd460193c50 con 0x7fd460106f00 2024-02-19T18:55:26.934 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.400+0000 7fd45cff9700 1 -- 172.21.15.96:0/258261921 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fd450010380 con 0x7fd460106f00 2024-02-19T18:55:26.934 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.402+0000 7fd465dd3700 1 -- 172.21.15.96:0/258261921 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fd448038370 msgr2=0x7fd44803a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:26.934 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.402+0000 7fd465dd3700 1 --2- 172.21.15.96:0/258261921 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fd448038370 0x7fd44803a830 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd454006fd0 tx=0x7fd454006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:26.934 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.402+0000 7fd465dd3700 1 -- 172.21.15.96:0/258261921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd460106f00 msgr2=0x7fd460106860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:26.934 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.402+0000 7fd465dd3700 1 --2- 172.21.15.96:0/258261921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd460106f00 0x7fd460106860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd450011670 tx=0x7fd450011b50 comp rx=0 tx=0).stop 2024-02-19T18:55:26.934 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.402+0000 7fd465dd3700 1 -- 172.21.15.96:0/258261921 shutdown_connections 2024-02-19T18:55:26.934 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.402+0000 7fd465dd3700 1 --2- 172.21.15.96:0/258261921 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fd448038370 0x7fd44803a830 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:26.934 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.402+0000 7fd465dd3700 1 --2- 172.21.15.96:0/258261921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd460106f00 0x7fd460106860 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:26.934 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.402+0000 7fd465dd3700 1 -- 172.21.15.96:0/258261921 >> 172.21.15.96:0/258261921 conn(0x7fd4601008b0 msgr2=0x7fd460102040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:26.934 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.402+0000 7fd465dd3700 1 -- 172.21.15.96:0/258261921 shutdown_connections 2024-02-19T18:55:26.935 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:26.402+0000 7fd465dd3700 1 -- 172.21.15.96:0/258261921 wait complete. 2024-02-19T18:55:27.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:27 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/258261921' entity='client.admin' 2024-02-19T18:55:27.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:27 smithi096 ceph-mon[29216]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:28.080 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.301+0000 7faf0d5a1700 1 Processor -- start 2024-02-19T18:55:28.080 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.301+0000 7faf0d5a1700 1 -- start start 2024-02-19T18:55:28.080 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.301+0000 7faf0d5a1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf08105330 0x7faf08105750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:28.080 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.301+0000 7faf0d5a1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf08105d20 con 0x7faf08105330 2024-02-19T18:55:28.080 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.301+0000 7faf06ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf08105330 0x7faf08105750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:28.081 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.301+0000 7faf06ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf08105330 0x7faf08105750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58734/0 (socket says 172.21.15.96:58734) 2024-02-19T18:55:28.081 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.301+0000 7faf06ffd700 1 -- 172.21.15.96:0/513143715 learned_addr learned my addr 172.21.15.96:0/513143715 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:28.081 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.301+0000 7faf06ffd700 1 -- 172.21.15.96:0/513143715 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf08106530 con 0x7faf08105330 2024-02-19T18:55:28.081 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.302+0000 7faf06ffd700 1 --2- 172.21.15.96:0/513143715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf08105330 0x7faf08105750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faef80098a0 tx=0x7faef8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adfacf4ea297d7d7 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:28.081 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.302+0000 7faf05ffb700 1 -- 172.21.15.96:0/513143715 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faef8004180 con 0x7faf08105330 2024-02-19T18:55:28.081 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.302+0000 7faf05ffb700 1 -- 172.21.15.96:0/513143715 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faef80042e0 con 0x7faf08105330 2024-02-19T18:55:28.081 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.302+0000 7faf05ffb700 1 -- 172.21.15.96:0/513143715 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faef8011af0 con 0x7faf08105330 2024-02-19T18:55:28.081 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.302+0000 7faf0d5a1700 1 -- 172.21.15.96:0/513143715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf08105330 msgr2=0x7faf08105750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:28.081 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.302+0000 7faf0d5a1700 1 --2- 172.21.15.96:0/513143715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf08105330 0x7faf08105750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faef80098a0 tx=0x7faef8009bb0 comp rx=0 tx=0).stop 2024-02-19T18:55:28.081 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.302+0000 7faf0d5a1700 1 -- 172.21.15.96:0/513143715 shutdown_connections 2024-02-19T18:55:28.081 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.302+0000 7faf0d5a1700 1 --2- 172.21.15.96:0/513143715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf08105330 0x7faf08105750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:28.081 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.302+0000 7faf0d5a1700 1 -- 172.21.15.96:0/513143715 >> 172.21.15.96:0/513143715 conn(0x7faf081008b0 msgr2=0x7faf08102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:28.081 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.302+0000 7faf0d5a1700 1 -- 172.21.15.96:0/513143715 shutdown_connections 2024-02-19T18:55:28.081 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.302+0000 7faf0d5a1700 1 -- 172.21.15.96:0/513143715 wait complete. 2024-02-19T18:55:28.082 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.303+0000 7faf0d5a1700 1 Processor -- start 2024-02-19T18:55:28.082 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.303+0000 7faf0d5a1700 1 -- start start 2024-02-19T18:55:28.082 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.303+0000 7faf0d5a1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf08105330 0x7faf0819c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:28.082 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.303+0000 7faf0d5a1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0819c8f0 con 0x7faf08105330 2024-02-19T18:55:28.082 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.303+0000 7faf06ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf08105330 0x7faf0819c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:28.082 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.303+0000 7faf06ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf08105330 0x7faf0819c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58736/0 (socket says 172.21.15.96:58736) 2024-02-19T18:55:28.082 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.303+0000 7faf06ffd700 1 -- 172.21.15.96:0/3278041014 learned_addr learned my addr 172.21.15.96:0/3278041014 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:28.082 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.304+0000 7faf06ffd700 1 -- 172.21.15.96:0/3278041014 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef8009550 con 0x7faf08105330 2024-02-19T18:55:28.082 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.304+0000 7faf06ffd700 1 --2- 172.21.15.96:0/3278041014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf08105330 0x7faf0819c3b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faef8011670 tx=0x7faef8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:28.082 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.304+0000 7faeeffff700 1 -- 172.21.15.96:0/3278041014 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faef80039c0 con 0x7faf08105330 2024-02-19T18:55:28.082 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.304+0000 7faf0d5a1700 1 -- 172.21.15.96:0/3278041014 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0819caf0 con 0x7faf08105330 2024-02-19T18:55:28.082 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.304+0000 7faeeffff700 1 -- 172.21.15.96:0/3278041014 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faef8003b20 con 0x7faf08105330 2024-02-19T18:55:28.082 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.304+0000 7faeeffff700 1 -- 172.21.15.96:0/3278041014 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faef80247f0 con 0x7faf08105330 2024-02-19T18:55:28.082 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.304+0000 7faf0d5a1700 1 -- 172.21.15.96:0/3278041014 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0819cf90 con 0x7faf08105330 2024-02-19T18:55:28.083 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.305+0000 7faeeffff700 1 -- 172.21.15.96:0/3278041014 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7faef8024ab0 con 0x7faf08105330 2024-02-19T18:55:28.083 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.305+0000 7faeeffff700 1 --2- 172.21.15.96:0/3278041014 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7faef00382e0 0x7faef003a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:28.083 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.305+0000 7faeeffff700 1 -- 172.21.15.96:0/3278041014 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7faef801ac70 con 0x7faf08105330 2024-02-19T18:55:28.083 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.305+0000 7faf067fc700 1 --2- 172.21.15.96:0/3278041014 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7faef00382e0 0x7faef003a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:28.083 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.305+0000 7faf0d5a1700 1 -- 172.21.15.96:0/3278041014 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf080623c0 con 0x7faf08105330 2024-02-19T18:55:28.083 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.305+0000 7faf067fc700 1 --2- 172.21.15.96:0/3278041014 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7faef00382e0 0x7faef003a7a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faefc006fd0 tx=0x7faefc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:28.083 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.310+0000 7faeeffff700 1 -- 172.21.15.96:0/3278041014 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7faef8024d60 con 0x7faf08105330 2024-02-19T18:55:28.083 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.499+0000 7faf0d5a1700 1 -- 172.21.15.96:0/3278041014 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7faf08109730 con 0x7faf08105330 2024-02-19T18:55:28.083 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.505+0000 7faeeffff700 1 -- 172.21.15.96:0/3278041014 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7faef802c350 con 0x7faf08105330 2024-02-19T18:55:28.083 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.507+0000 7faf0d5a1700 1 -- 172.21.15.96:0/3278041014 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7faef00382e0 msgr2=0x7faef003a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:28.083 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.507+0000 7faf0d5a1700 1 --2- 172.21.15.96:0/3278041014 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7faef00382e0 0x7faef003a7a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faefc006fd0 tx=0x7faefc006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:28.083 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.507+0000 7faf0d5a1700 1 -- 172.21.15.96:0/3278041014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf08105330 msgr2=0x7faf0819c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:28.083 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.507+0000 7faf0d5a1700 1 --2- 172.21.15.96:0/3278041014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf08105330 0x7faf0819c3b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faef8011670 tx=0x7faef8011aa0 comp rx=0 tx=0).stop 2024-02-19T18:55:28.083 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.507+0000 7faf0d5a1700 1 -- 172.21.15.96:0/3278041014 shutdown_connections 2024-02-19T18:55:28.084 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.507+0000 7faf0d5a1700 1 --2- 172.21.15.96:0/3278041014 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7faef00382e0 0x7faef003a7a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:28.084 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.507+0000 7faf0d5a1700 1 --2- 172.21.15.96:0/3278041014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf08105330 0x7faf0819c3b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:28.084 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.507+0000 7faf0d5a1700 1 -- 172.21.15.96:0/3278041014 >> 172.21.15.96:0/3278041014 conn(0x7faf081008b0 msgr2=0x7faf080798d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:28.084 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.507+0000 7faf0d5a1700 1 -- 172.21.15.96:0/3278041014 shutdown_connections 2024-02-19T18:55:28.084 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:27.507+0000 7faf0d5a1700 1 -- 172.21.15.96:0/3278041014 wait complete. 2024-02-19T18:55:28.084 INFO:teuthology.orchestra.run.smithi096.stdout:Enabling the dashboard module... 2024-02-19T18:55:28.763 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:28 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/3278041014' entity='client.admin' 2024-02-19T18:55:29.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:29 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/1002871909' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-19T18:55:29.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:29 smithi096 ceph-mon[29216]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:30.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.491+0000 7fd40bd8d700 1 Processor -- start 2024-02-19T18:55:30.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.491+0000 7fd40bd8d700 1 -- start start 2024-02-19T18:55:30.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.491+0000 7fd40bd8d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd404104d20 0x7fd404105140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:30.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.491+0000 7fd40bd8d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd404074600 con 0x7fd404104d20 2024-02-19T18:55:30.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.492+0000 7fd409b29700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd404104d20 0x7fd404105140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:30.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.492+0000 7fd409b29700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd404104d20 0x7fd404105140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58740/0 (socket says 172.21.15.96:58740) 2024-02-19T18:55:30.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.492+0000 7fd409b29700 1 -- 172.21.15.96:0/2697755893 learned_addr learned my addr 172.21.15.96:0/2697755893 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:30.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.492+0000 7fd409b29700 1 -- 172.21.15.96:0/2697755893 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd404105680 con 0x7fd404104d20 2024-02-19T18:55:30.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.492+0000 7fd409b29700 1 --2- 172.21.15.96:0/2697755893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd404104d20 0x7fd404105140 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd4000098a0 tx=0x7fd400009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cbacbb12454daa server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:30.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.492+0000 7fd408b27700 1 -- 172.21.15.96:0/2697755893 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd400004180 con 0x7fd404104d20 2024-02-19T18:55:30.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.492+0000 7fd408b27700 1 -- 172.21.15.96:0/2697755893 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd4000042e0 con 0x7fd404104d20 2024-02-19T18:55:30.112 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.492+0000 7fd408b27700 1 -- 172.21.15.96:0/2697755893 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd400011af0 con 0x7fd404104d20 2024-02-19T18:55:30.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.493+0000 7fd40bd8d700 1 -- 172.21.15.96:0/2697755893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd404104d20 msgr2=0x7fd404105140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:30.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.493+0000 7fd40bd8d700 1 --2- 172.21.15.96:0/2697755893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd404104d20 0x7fd404105140 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd4000098a0 tx=0x7fd400009bb0 comp rx=0 tx=0).stop 2024-02-19T18:55:30.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.493+0000 7fd40bd8d700 1 -- 172.21.15.96:0/2697755893 shutdown_connections 2024-02-19T18:55:30.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.493+0000 7fd40bd8d700 1 --2- 172.21.15.96:0/2697755893 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd404104d20 0x7fd404105140 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:30.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.493+0000 7fd40bd8d700 1 -- 172.21.15.96:0/2697755893 >> 172.21.15.96:0/2697755893 conn(0x7fd4041008c0 msgr2=0x7fd404102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:30.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.493+0000 7fd40bd8d700 1 -- 172.21.15.96:0/2697755893 shutdown_connections 2024-02-19T18:55:30.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.493+0000 7fd40bd8d700 1 -- 172.21.15.96:0/2697755893 wait complete. 2024-02-19T18:55:30.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.493+0000 7fd40bd8d700 1 Processor -- start 2024-02-19T18:55:30.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.493+0000 7fd40bd8d700 1 -- start start 2024-02-19T18:55:30.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.493+0000 7fd40bd8d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd404104d20 0x7fd40419c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:30.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.494+0000 7fd40bd8d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40419c8a0 con 0x7fd404104d20 2024-02-19T18:55:30.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.494+0000 7fd409b29700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd404104d20 0x7fd40419c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:30.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.494+0000 7fd409b29700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd404104d20 0x7fd40419c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58742/0 (socket says 172.21.15.96:58742) 2024-02-19T18:55:30.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.494+0000 7fd409b29700 1 -- 172.21.15.96:0/1002871909 learned_addr learned my addr 172.21.15.96:0/1002871909 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:30.113 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.494+0000 7fd409b29700 1 -- 172.21.15.96:0/1002871909 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd400009550 con 0x7fd404104d20 2024-02-19T18:55:30.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.494+0000 7fd409b29700 1 --2- 172.21.15.96:0/1002871909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd404104d20 0x7fd40419c360 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd400011670 tx=0x7fd400011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:30.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.494+0000 7fd3faffd700 1 -- 172.21.15.96:0/1002871909 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd400003a40 con 0x7fd404104d20 2024-02-19T18:55:30.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.494+0000 7fd3faffd700 1 -- 172.21.15.96:0/1002871909 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd400003ba0 con 0x7fd404104d20 2024-02-19T18:55:30.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.494+0000 7fd40bd8d700 1 -- 172.21.15.96:0/1002871909 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40419caa0 con 0x7fd404104d20 2024-02-19T18:55:30.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.494+0000 7fd3faffd700 1 -- 172.21.15.96:0/1002871909 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd400024820 con 0x7fd404104d20 2024-02-19T18:55:30.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.494+0000 7fd40bd8d700 1 -- 172.21.15.96:0/1002871909 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40419cf40 con 0x7fd404104d20 2024-02-19T18:55:30.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.495+0000 7fd3faffd700 1 -- 172.21.15.96:0/1002871909 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fd40001a430 con 0x7fd404104d20 2024-02-19T18:55:30.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.495+0000 7fd40bd8d700 1 -- 172.21.15.96:0/1002871909 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd404195c10 con 0x7fd404104d20 2024-02-19T18:55:30.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.495+0000 7fd3faffd700 1 --2- 172.21.15.96:0/1002871909 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fd3f0038330 0x7fd3f003a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:30.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.495+0000 7fd3faffd700 1 -- 172.21.15.96:0/1002871909 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd40004c290 con 0x7fd404104d20 2024-02-19T18:55:30.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.495+0000 7fd409328700 1 --2- 172.21.15.96:0/1002871909 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fd3f0038330 0x7fd3f003a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:30.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.496+0000 7fd409328700 1 --2- 172.21.15.96:0/1002871909 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fd3f0038330 0x7fd3f003a7f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4006fd0 tx=0x7fd3f4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:30.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.500+0000 7fd3faffd700 1 -- 172.21.15.96:0/1002871909 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd40001a6e0 con 0x7fd404104d20 2024-02-19T18:55:30.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:28.745+0000 7fd40bd8d700 1 -- 172.21.15.96:0/1002871909 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fd40402cc70 con 0x7fd404104d20 2024-02-19T18:55:30.114 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:29.512+0000 7fd3faffd700 1 -- 172.21.15.96:0/1002871909 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 9) v1 ==== 45296+0+0 (secure 0 0 0) 0x7fd40002d3f0 con 0x7fd404104d20 2024-02-19T18:55:30.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:29.514+0000 7fd3faffd700 1 -- 172.21.15.96:0/1002871909 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fd400019d80 con 0x7fd404104d20 2024-02-19T18:55:30.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:29.516+0000 7fd40bd8d700 1 -- 172.21.15.96:0/1002871909 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fd3f0038330 msgr2=0x7fd3f003a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:30.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:29.516+0000 7fd40bd8d700 1 --2- 172.21.15.96:0/1002871909 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fd3f0038330 0x7fd3f003a7f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4006fd0 tx=0x7fd3f4006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:30.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:29.516+0000 7fd40bd8d700 1 -- 172.21.15.96:0/1002871909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd404104d20 msgr2=0x7fd40419c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:30.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:29.516+0000 7fd40bd8d700 1 --2- 172.21.15.96:0/1002871909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd404104d20 0x7fd40419c360 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd400011670 tx=0x7fd400011aa0 comp rx=0 tx=0).stop 2024-02-19T18:55:30.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:29.516+0000 7fd40bd8d700 1 -- 172.21.15.96:0/1002871909 shutdown_connections 2024-02-19T18:55:30.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:29.516+0000 7fd40bd8d700 1 --2- 172.21.15.96:0/1002871909 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7fd3f0038330 0x7fd3f003a7f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:30.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:29.516+0000 7fd40bd8d700 1 --2- 172.21.15.96:0/1002871909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd404104d20 0x7fd40419c360 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:30.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:29.516+0000 7fd40bd8d700 1 -- 172.21.15.96:0/1002871909 >> 172.21.15.96:0/1002871909 conn(0x7fd4041008c0 msgr2=0x7fd4041908e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:30.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:29.517+0000 7fd40bd8d700 1 -- 172.21.15.96:0/1002871909 shutdown_connections 2024-02-19T18:55:30.115 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:29.517+0000 7fd40bd8d700 1 -- 172.21.15.96:0/1002871909 wait complete. 2024-02-19T18:55:30.747 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:30 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/1002871909' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-19T18:55:30.747 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:30 smithi096 ceph-mon[29216]: mgrmap e9: smithi096.zsjdff(active, since 26s) 2024-02-19T18:55:31.343 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout { 2024-02-19T18:55:31.343 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-02-19T18:55:31.343 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-19T18:55:31.343 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "active_name": "smithi096.zsjdff", 2024-02-19T18:55:31.343 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-19T18:55:31.343 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout } 2024-02-19T18:55:31.343 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.524+0000 7f75357a1700 1 Processor -- start 2024-02-19T18:55:31.343 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.525+0000 7f75357a1700 1 -- start start 2024-02-19T18:55:31.344 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.525+0000 7f75357a1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7530106f00 0x7f75301092f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:31.344 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.525+0000 7f75357a1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7530079e60 con 0x7f7530106f00 2024-02-19T18:55:31.344 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.525+0000 7f752effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7530106f00 0x7f75301092f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:31.344 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.525+0000 7f752effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7530106f00 0x7f75301092f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58764/0 (socket says 172.21.15.96:58764) 2024-02-19T18:55:31.344 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.525+0000 7f752effd700 1 -- 172.21.15.96:0/57922591 learned_addr learned my addr 172.21.15.96:0/57922591 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:31.344 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.525+0000 7f752effd700 1 -- 172.21.15.96:0/57922591 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7530109830 con 0x7f7530106f00 2024-02-19T18:55:31.344 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.525+0000 7f752effd700 1 --2- 172.21.15.96:0/57922591 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7530106f00 0x7f75301092f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f75200098a0 tx=0x7f7520009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625e5f0e39ed5131 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:31.344 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.525+0000 7f752dffb700 1 -- 172.21.15.96:0/57922591 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7520004180 con 0x7f7530106f00 2024-02-19T18:55:31.344 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.525+0000 7f752dffb700 1 -- 172.21.15.96:0/57922591 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f75200042e0 con 0x7f7530106f00 2024-02-19T18:55:31.344 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.525+0000 7f752dffb700 1 -- 172.21.15.96:0/57922591 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7520011af0 con 0x7f7530106f00 2024-02-19T18:55:31.344 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.526+0000 7f75357a1700 1 -- 172.21.15.96:0/57922591 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7530106f00 msgr2=0x7f75301092f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:31.344 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.526+0000 7f75357a1700 1 --2- 172.21.15.96:0/57922591 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7530106f00 0x7f75301092f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f75200098a0 tx=0x7f7520009bb0 comp rx=0 tx=0).stop 2024-02-19T18:55:31.344 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.526+0000 7f75357a1700 1 -- 172.21.15.96:0/57922591 shutdown_connections 2024-02-19T18:55:31.344 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.526+0000 7f75357a1700 1 --2- 172.21.15.96:0/57922591 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7530106f00 0x7f75301092f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:31.345 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.526+0000 7f75357a1700 1 -- 172.21.15.96:0/57922591 >> 172.21.15.96:0/57922591 conn(0x7f75301008b0 msgr2=0x7f7530102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:31.345 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.526+0000 7f75357a1700 1 -- 172.21.15.96:0/57922591 shutdown_connections 2024-02-19T18:55:31.345 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.526+0000 7f75357a1700 1 -- 172.21.15.96:0/57922591 wait complete. 2024-02-19T18:55:31.345 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.527+0000 7f75357a1700 1 Processor -- start 2024-02-19T18:55:31.345 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.527+0000 7f75357a1700 1 -- start start 2024-02-19T18:55:31.345 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.527+0000 7f75357a1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7530106f00 0x7f753019a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:31.345 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.527+0000 7f75357a1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753019a620 con 0x7f7530106f00 2024-02-19T18:55:31.345 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.527+0000 7f752effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7530106f00 0x7f753019a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:31.345 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.527+0000 7f752effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7530106f00 0x7f753019a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58776/0 (socket says 172.21.15.96:58776) 2024-02-19T18:55:31.345 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.527+0000 7f752effd700 1 -- 172.21.15.96:0/503538175 learned_addr learned my addr 172.21.15.96:0/503538175 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:31.345 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.528+0000 7f752effd700 1 -- 172.21.15.96:0/503538175 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7520009550 con 0x7f7530106f00 2024-02-19T18:55:31.345 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.528+0000 7f752effd700 1 --2- 172.21.15.96:0/503538175 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7530106f00 0x7f753019a0e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7520011670 tx=0x7f7520011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:31.345 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.528+0000 7f7517fff700 1 -- 172.21.15.96:0/503538175 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7520003a40 con 0x7f7530106f00 2024-02-19T18:55:31.345 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.528+0000 7f7517fff700 1 -- 172.21.15.96:0/503538175 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7520003ba0 con 0x7f7530106f00 2024-02-19T18:55:31.346 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.528+0000 7f75357a1700 1 -- 172.21.15.96:0/503538175 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753019a820 con 0x7f7530106f00 2024-02-19T18:55:31.346 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.529+0000 7f7517fff700 1 -- 172.21.15.96:0/503538175 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7520024820 con 0x7f7530106f00 2024-02-19T18:55:31.346 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.529+0000 7f75357a1700 1 -- 172.21.15.96:0/503538175 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753019acc0 con 0x7f7530106f00 2024-02-19T18:55:31.346 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.529+0000 7f7517fff700 1 -- 172.21.15.96:0/503538175 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 9) v1 ==== 45296+0+0 (secure 0 0 0) 0x7f7520024a90 con 0x7f7530106f00 2024-02-19T18:55:31.346 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.529+0000 7f7517fff700 1 --2- 172.21.15.96:0/503538175 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7518038380 0x7f751803a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:31.346 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.529+0000 7f7517fff700 1 -- 172.21.15.96:0/503538175 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f752001ac70 con 0x7f7530106f00 2024-02-19T18:55:31.346 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.529+0000 7f752e7fc700 1 -- 172.21.15.96:0/503538175 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7518038380 msgr2=0x7f751803a840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3697355606 2024-02-19T18:55:31.346 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.529+0000 7f752e7fc700 1 --2- 172.21.15.96:0/503538175 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7518038380 0x7f751803a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T18:55:31.346 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.529+0000 7f75357a1700 1 -- 172.21.15.96:0/503538175 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f753010a5c0 con 0x7f7530106f00 2024-02-19T18:55:31.346 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.534+0000 7f7517fff700 1 -- 172.21.15.96:0/503538175 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f7520053060 con 0x7f7530106f00 2024-02-19T18:55:31.346 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.730+0000 7f752e7fc700 1 -- 172.21.15.96:0/503538175 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7518038380 msgr2=0x7f751803a840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3697355606 2024-02-19T18:55:31.346 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.730+0000 7f752e7fc700 1 --2- 172.21.15.96:0/503538175 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7518038380 0x7f751803a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-19T18:55:31.346 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.785+0000 7f75357a1700 1 -- 172.21.15.96:0/503538175 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f753019ddb0 con 0x7f7530106f00 2024-02-19T18:55:31.346 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.785+0000 7f7517fff700 1 -- 172.21.15.96:0/503538175 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f7520023370 con 0x7f7530106f00 2024-02-19T18:55:31.346 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.787+0000 7f75357a1700 1 -- 172.21.15.96:0/503538175 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7518038380 msgr2=0x7f751803a840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T18:55:31.347 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.787+0000 7f75357a1700 1 --2- 172.21.15.96:0/503538175 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7518038380 0x7f751803a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:31.347 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.787+0000 7f75357a1700 1 -- 172.21.15.96:0/503538175 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7530106f00 msgr2=0x7f753019a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:31.347 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.787+0000 7f75357a1700 1 --2- 172.21.15.96:0/503538175 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7530106f00 0x7f753019a0e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7520011670 tx=0x7f7520011aa0 comp rx=0 tx=0).stop 2024-02-19T18:55:31.347 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.787+0000 7f75357a1700 1 -- 172.21.15.96:0/503538175 shutdown_connections 2024-02-19T18:55:31.347 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.787+0000 7f75357a1700 1 --2- 172.21.15.96:0/503538175 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7518038380 0x7f751803a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:31.347 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.787+0000 7f75357a1700 1 --2- 172.21.15.96:0/503538175 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7530106f00 0x7f753019a0e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:31.347 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.787+0000 7f75357a1700 1 -- 172.21.15.96:0/503538175 >> 172.21.15.96:0/503538175 conn(0x7f75301008b0 msgr2=0x7f75301016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:31.347 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.788+0000 7f75357a1700 1 -- 172.21.15.96:0/503538175 shutdown_connections 2024-02-19T18:55:31.347 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:30.788+0000 7f75357a1700 1 -- 172.21.15.96:0/503538175 wait complete. 2024-02-19T18:55:31.347 INFO:teuthology.orchestra.run.smithi096.stdout:Waiting for the mgr to restart... 2024-02-19T18:55:31.347 INFO:teuthology.orchestra.run.smithi096.stdout:Waiting for mgr epoch 9... 2024-02-19T18:55:31.641 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:31 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/503538175' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-19T18:55:36.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:36 smithi096 ceph-mon[29216]: Active manager daemon smithi096.zsjdff restarted 2024-02-19T18:55:36.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:36 smithi096 ceph-mon[29216]: Activating manager daemon smithi096.zsjdff 2024-02-19T18:55:36.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:36 smithi096 ceph-mon[29216]: osdmap e3: 0 total, 0 up, 0 in 2024-02-19T18:55:36.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:36 smithi096 ceph-mon[29216]: mgrmap e10: smithi096.zsjdff(active, starting, since 0.00312876s) 2024-02-19T18:55:36.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:36 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2024-02-19T18:55:36.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:36 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr metadata", "who": "smithi096.zsjdff", "id": "smithi096.zsjdff"}]: dispatch 2024-02-19T18:55:36.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:36 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T18:55:36.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:36 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T18:55:36.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:36 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T18:55:36.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:36 smithi096 ceph-mon[29216]: Manager daemon smithi096.zsjdff is now available 2024-02-19T18:55:37.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:37 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:55:37.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:37 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:55:37.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:37 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.zsjdff/mirror_snapshot_schedule"}]: dispatch 2024-02-19T18:55:37.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:37 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.zsjdff/trash_purge_schedule"}]: dispatch 2024-02-19T18:55:37.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:37 smithi096 ceph-mon[29216]: [19/Feb/2024:18:55:36] ENGINE Bus STARTING 2024-02-19T18:55:37.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:37 smithi096 ceph-mon[29216]: mgrmap e11: smithi096.zsjdff(active, since 1.00571s) 2024-02-19T18:55:37.902 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout { 2024-02-19T18:55:37.902 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-02-19T18:55:37.902 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-19T18:55:37.902 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout } 2024-02-19T18:55:37.902 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.754+0000 7f7a824c6700 1 Processor -- start 2024-02-19T18:55:37.902 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.754+0000 7f7a824c6700 1 -- start start 2024-02-19T18:55:37.902 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.754+0000 7f7a824c6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c106f10 0x7f7a7c109300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:37.902 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.754+0000 7f7a824c6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c074620 con 0x7f7a7c106f10 2024-02-19T18:55:37.902 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.754+0000 7f7a7bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c106f10 0x7f7a7c109300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:37.903 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.754+0000 7f7a7bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c106f10 0x7f7a7c109300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58778/0 (socket says 172.21.15.96:58778) 2024-02-19T18:55:37.903 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.754+0000 7f7a7bfff700 1 -- 172.21.15.96:0/3528182150 learned_addr learned my addr 172.21.15.96:0/3528182150 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:37.903 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.755+0000 7f7a7bfff700 1 -- 172.21.15.96:0/3528182150 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c109840 con 0x7f7a7c106f10 2024-02-19T18:55:37.903 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.755+0000 7f7a7bfff700 1 --2- 172.21.15.96:0/3528182150 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c106f10 0x7f7a7c109300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7a700098a0 tx=0x7f7a70009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f809c541b2c79ba4 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:37.903 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.755+0000 7f7a7affd700 1 -- 172.21.15.96:0/3528182150 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a70004180 con 0x7f7a7c106f10 2024-02-19T18:55:37.903 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.755+0000 7f7a7affd700 1 -- 172.21.15.96:0/3528182150 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7a700042e0 con 0x7f7a7c106f10 2024-02-19T18:55:37.903 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.755+0000 7f7a7affd700 1 -- 172.21.15.96:0/3528182150 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a70011af0 con 0x7f7a7c106f10 2024-02-19T18:55:37.903 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.756+0000 7f7a824c6700 1 -- 172.21.15.96:0/3528182150 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c106f10 msgr2=0x7f7a7c109300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:37.903 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.756+0000 7f7a824c6700 1 --2- 172.21.15.96:0/3528182150 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c106f10 0x7f7a7c109300 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7a700098a0 tx=0x7f7a70009bb0 comp rx=0 tx=0).stop 2024-02-19T18:55:37.903 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.756+0000 7f7a824c6700 1 -- 172.21.15.96:0/3528182150 shutdown_connections 2024-02-19T18:55:37.903 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.756+0000 7f7a824c6700 1 --2- 172.21.15.96:0/3528182150 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c106f10 0x7f7a7c109300 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:37.903 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.756+0000 7f7a824c6700 1 -- 172.21.15.96:0/3528182150 >> 172.21.15.96:0/3528182150 conn(0x7f7a7c1008c0 msgr2=0x7f7a7c102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:37.903 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.756+0000 7f7a824c6700 1 -- 172.21.15.96:0/3528182150 shutdown_connections 2024-02-19T18:55:37.903 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.756+0000 7f7a824c6700 1 -- 172.21.15.96:0/3528182150 wait complete. 2024-02-19T18:55:37.904 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.756+0000 7f7a824c6700 1 Processor -- start 2024-02-19T18:55:37.904 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.756+0000 7f7a824c6700 1 -- start start 2024-02-19T18:55:37.904 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.757+0000 7f7a824c6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c106f10 0x7f7a7c19a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:37.904 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.757+0000 7f7a824c6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c19a690 con 0x7f7a7c106f10 2024-02-19T18:55:37.904 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.757+0000 7f7a7bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c106f10 0x7f7a7c19a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:37.904 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.757+0000 7f7a7bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c106f10 0x7f7a7c19a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58782/0 (socket says 172.21.15.96:58782) 2024-02-19T18:55:37.904 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.757+0000 7f7a7bfff700 1 -- 172.21.15.96:0/362221392 learned_addr learned my addr 172.21.15.96:0/362221392 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:37.904 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.757+0000 7f7a7bfff700 1 -- 172.21.15.96:0/362221392 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a70009550 con 0x7f7a7c106f10 2024-02-19T18:55:37.904 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.757+0000 7f7a7bfff700 1 --2- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c106f10 0x7f7a7c19a150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7a70011670 tx=0x7f7a70011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:37.904 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.757+0000 7f7a797fa700 1 -- 172.21.15.96:0/362221392 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a70003a40 con 0x7f7a7c106f10 2024-02-19T18:55:37.904 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.757+0000 7f7a797fa700 1 -- 172.21.15.96:0/362221392 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7a70003ba0 con 0x7f7a7c106f10 2024-02-19T18:55:37.904 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.757+0000 7f7a824c6700 1 -- 172.21.15.96:0/362221392 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a7c19a890 con 0x7f7a7c106f10 2024-02-19T18:55:37.904 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.757+0000 7f7a824c6700 1 -- 172.21.15.96:0/362221392 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7c19ad30 con 0x7f7a7c106f10 2024-02-19T18:55:37.904 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.757+0000 7f7a797fa700 1 -- 172.21.15.96:0/362221392 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a70024820 con 0x7f7a7c106f10 2024-02-19T18:55:37.905 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.758+0000 7f7a797fa700 1 -- 172.21.15.96:0/362221392 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 9) v1 ==== 45296+0+0 (secure 0 0 0) 0x7f7a70024a90 con 0x7f7a7c106f10 2024-02-19T18:55:37.905 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.758+0000 7f7a797fa700 1 --2- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7a64038380 0x7f7a6403a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:37.905 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.758+0000 7f7a797fa700 1 -- 172.21.15.96:0/362221392 --> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7a6403af50 con 0x7f7a64038380 2024-02-19T18:55:37.905 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.759+0000 7f7a797fa700 1 -- 172.21.15.96:0/362221392 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7a7004c440 con 0x7f7a7c106f10 2024-02-19T18:55:37.905 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.759+0000 7f7a7b7fe700 1 -- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7a64038380 msgr2=0x7f7a6403a840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3697355606 2024-02-19T18:55:37.905 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.759+0000 7f7a7b7fe700 1 --2- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7a64038380 0x7f7a6403a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T18:55:37.905 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.960+0000 7f7a7b7fe700 1 -- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7a64038380 msgr2=0x7f7a6403a840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3697355606 2024-02-19T18:55:37.905 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:31.960+0000 7f7a7b7fe700 1 --2- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7a64038380 0x7f7a6403a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-19T18:55:37.905 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:32.361+0000 7f7a7b7fe700 1 -- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7a64038380 msgr2=0x7f7a6403a840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3697355606 2024-02-19T18:55:37.905 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:32.361+0000 7f7a7b7fe700 1 --2- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7a64038380 0x7f7a6403a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-19T18:55:37.905 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:33.162+0000 7f7a7b7fe700 1 -- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7a64038380 msgr2=0x7f7a6403a840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3697355606 2024-02-19T18:55:37.905 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:33.162+0000 7f7a7b7fe700 1 --2- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7a64038380 0x7f7a6403a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-19T18:55:37.905 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:34.763+0000 7f7a7b7fe700 1 -- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7a64038380 msgr2=0x7f7a6403a840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3697355606 2024-02-19T18:55:37.905 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:34.763+0000 7f7a7b7fe700 1 --2- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7a64038380 0x7f7a6403a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-19T18:55:37.905 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:36.282+0000 7f7a797fa700 1 -- 172.21.15.96:0/362221392 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mgrmap(e 10) v1 ==== 45063+0+0 (secure 0 0 0) 0x7f7a7001ac70 con 0x7f7a7c106f10 2024-02-19T18:55:37.906 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:36.282+0000 7f7a797fa700 1 -- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7a64038380 msgr2=0x7f7a6403a840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T18:55:37.906 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:36.282+0000 7f7a797fa700 1 --2- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7a64038380 0x7f7a6403a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:37.906 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:37.283+0000 7f7a797fa700 1 -- 172.21.15.96:0/362221392 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 11) v1 ==== 45190+0+0 (secure 0 0 0) 0x7f7a7001a750 con 0x7f7a7c106f10 2024-02-19T18:55:37.906 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:37.283+0000 7f7a797fa700 1 --2- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f7a6403be40 0x7f7a6403e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:37.906 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:37.283+0000 7f7a797fa700 1 -- 172.21.15.96:0/362221392 --> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7a6403af50 con 0x7f7a6403be40 2024-02-19T18:55:37.906 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:37.284+0000 7f7a7b7fe700 1 --2- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f7a6403be40 0x7f7a6403e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:37.906 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:37.285+0000 7f7a7b7fe700 1 --2- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f7a6403be40 0x7f7a6403e230 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c003a10 tx=0x7f7a6c009270 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:37.906 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:37.285+0000 7f7a797fa700 1 -- 172.21.15.96:0/362221392 <== mgr.14164 v2:172.21.15.96:6800/3628131135 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f7a6403af50 con 0x7f7a6403be40 2024-02-19T18:55:37.906 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:37.291+0000 7f7a824c6700 1 -- 172.21.15.96:0/362221392 --> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f7a68002630 con 0x7f7a6403be40 2024-02-19T18:55:37.906 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:37.292+0000 7f7a797fa700 1 -- 172.21.15.96:0/362221392 <== mgr.14164 v2:172.21.15.96:6800/3628131135 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f7a68002630 con 0x7f7a6403be40 2024-02-19T18:55:37.906 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:37.292+0000 7f7a824c6700 1 -- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f7a6403be40 msgr2=0x7f7a6403e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:37.906 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:37.292+0000 7f7a824c6700 1 --2- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f7a6403be40 0x7f7a6403e230 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c003a10 tx=0x7f7a6c009270 comp rx=0 tx=0).stop 2024-02-19T18:55:37.906 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:37.292+0000 7f7a824c6700 1 -- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c106f10 msgr2=0x7f7a7c19a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:37.906 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:37.292+0000 7f7a824c6700 1 --2- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c106f10 0x7f7a7c19a150 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7a70011670 tx=0x7f7a70011aa0 comp rx=0 tx=0).stop 2024-02-19T18:55:37.906 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:37.292+0000 7f7a824c6700 1 -- 172.21.15.96:0/362221392 shutdown_connections 2024-02-19T18:55:37.907 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:37.292+0000 7f7a824c6700 1 --2- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f7a6403be40 0x7f7a6403e230 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:37.907 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:37.292+0000 7f7a824c6700 1 --2- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7a7c106f10 0x7f7a7c19a150 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:37.907 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:37.292+0000 7f7a824c6700 1 --2- 172.21.15.96:0/362221392 >> [v2:172.21.15.96:6800/3697355606,v1:172.21.15.96:6801/3697355606] conn(0x7f7a64038380 0x7f7a6403a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:37.907 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:37.292+0000 7f7a824c6700 1 -- 172.21.15.96:0/362221392 >> 172.21.15.96:0/362221392 conn(0x7f7a7c1008c0 msgr2=0x7f7a7c101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:37.907 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:37.292+0000 7f7a824c6700 1 -- 172.21.15.96:0/362221392 shutdown_connections 2024-02-19T18:55:37.907 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:37.292+0000 7f7a824c6700 1 -- 172.21.15.96:0/362221392 wait complete. 2024-02-19T18:55:37.907 INFO:teuthology.orchestra.run.smithi096.stdout:mgr epoch 9 is available 2024-02-19T18:55:37.907 INFO:teuthology.orchestra.run.smithi096.stdout:Generating a dashboard self-signed certificate... 2024-02-19T18:55:38.470 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:38 smithi096 ceph-mon[29216]: [19/Feb/2024:18:55:36] ENGINE Serving on https://172.21.15.96:7150 2024-02-19T18:55:38.471 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:38 smithi096 ceph-mon[29216]: [19/Feb/2024:18:55:36] ENGINE Serving on http://172.21.15.96:8765 2024-02-19T18:55:38.471 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:38 smithi096 ceph-mon[29216]: [19/Feb/2024:18:55:36] ENGINE Bus STARTED 2024-02-19T18:55:38.471 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:38 smithi096 ceph-mon[29216]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-19T18:55:38.471 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:38 smithi096 ceph-mon[29216]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-19T18:55:39.090 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-02-19T18:55:39.090 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.243+0000 7f53b264d700 1 Processor -- start 2024-02-19T18:55:39.090 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.243+0000 7f53b264d700 1 -- start start 2024-02-19T18:55:39.090 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.243+0000 7f53b264d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53ac106420 0x7f53ac106840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:39.090 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.243+0000 7f53b264d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac106e10 con 0x7f53ac106420 2024-02-19T18:55:39.090 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.243+0000 7f53abfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53ac106420 0x7f53ac106840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:39.090 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.243+0000 7f53abfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53ac106420 0x7f53ac106840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52710/0 (socket says 172.21.15.96:52710) 2024-02-19T18:55:39.090 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.243+0000 7f53abfff700 1 -- 172.21.15.96:0/829669154 learned_addr learned my addr 172.21.15.96:0/829669154 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:39.091 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.243+0000 7f53abfff700 1 -- 172.21.15.96:0/829669154 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac107620 con 0x7f53ac106420 2024-02-19T18:55:39.091 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.244+0000 7f53abfff700 1 --2- 172.21.15.96:0/829669154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53ac106420 0x7f53ac106840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f539c0098a0 tx=0x7f539c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f660914522441bcd server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:39.091 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.244+0000 7f53aaffd700 1 -- 172.21.15.96:0/829669154 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f539c004180 con 0x7f53ac106420 2024-02-19T18:55:39.091 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.244+0000 7f53aaffd700 1 -- 172.21.15.96:0/829669154 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f539c0042e0 con 0x7f53ac106420 2024-02-19T18:55:39.091 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.244+0000 7f53aaffd700 1 -- 172.21.15.96:0/829669154 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f539c011af0 con 0x7f53ac106420 2024-02-19T18:55:39.091 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.244+0000 7f53b264d700 1 -- 172.21.15.96:0/829669154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53ac106420 msgr2=0x7f53ac106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:39.091 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.244+0000 7f53b264d700 1 --2- 172.21.15.96:0/829669154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53ac106420 0x7f53ac106840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f539c0098a0 tx=0x7f539c009bb0 comp rx=0 tx=0).stop 2024-02-19T18:55:39.091 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.244+0000 7f53b264d700 1 -- 172.21.15.96:0/829669154 shutdown_connections 2024-02-19T18:55:39.091 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.244+0000 7f53b264d700 1 --2- 172.21.15.96:0/829669154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53ac106420 0x7f53ac106840 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:39.091 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.244+0000 7f53b264d700 1 -- 172.21.15.96:0/829669154 >> 172.21.15.96:0/829669154 conn(0x7f53ac101a00 msgr2=0x7f53ac103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:39.091 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.244+0000 7f53b264d700 1 -- 172.21.15.96:0/829669154 shutdown_connections 2024-02-19T18:55:39.091 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.244+0000 7f53b264d700 1 -- 172.21.15.96:0/829669154 wait complete. 2024-02-19T18:55:39.091 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.245+0000 7f53b264d700 1 Processor -- start 2024-02-19T18:55:39.091 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.245+0000 7f53b264d700 1 -- start start 2024-02-19T18:55:39.092 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.245+0000 7f53b264d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53ac106420 0x7f53ac07bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:39.092 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.245+0000 7f53b264d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53ac07c150 con 0x7f53ac106420 2024-02-19T18:55:39.092 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.245+0000 7f53abfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53ac106420 0x7f53ac07bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:39.092 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.245+0000 7f53abfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53ac106420 0x7f53ac07bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52718/0 (socket says 172.21.15.96:52718) 2024-02-19T18:55:39.092 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.245+0000 7f53abfff700 1 -- 172.21.15.96:0/1289738848 learned_addr learned my addr 172.21.15.96:0/1289738848 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:39.092 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.246+0000 7f53abfff700 1 -- 172.21.15.96:0/1289738848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c009550 con 0x7f53ac106420 2024-02-19T18:55:39.092 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.246+0000 7f53abfff700 1 --2- 172.21.15.96:0/1289738848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53ac106420 0x7f53ac07bc10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f539c006ba0 tx=0x7f539c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:39.092 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.246+0000 7f53a97fa700 1 -- 172.21.15.96:0/1289738848 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f539c003b00 con 0x7f53ac106420 2024-02-19T18:55:39.092 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.246+0000 7f53a97fa700 1 -- 172.21.15.96:0/1289738848 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f539c01a8e0 con 0x7f53ac106420 2024-02-19T18:55:39.092 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.246+0000 7f53b264d700 1 -- 172.21.15.96:0/1289738848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ac07a2b0 con 0x7f53ac106420 2024-02-19T18:55:39.092 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.246+0000 7f53a97fa700 1 -- 172.21.15.96:0/1289738848 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f539c019990 con 0x7f53ac106420 2024-02-19T18:55:39.092 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.246+0000 7f53b264d700 1 -- 172.21.15.96:0/1289738848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ac07a7b0 con 0x7f53ac106420 2024-02-19T18:55:39.092 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.247+0000 7f53a97fa700 1 -- 172.21.15.96:0/1289738848 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 11) v1 ==== 45190+0+0 (secure 0 0 0) 0x7f539c019c50 con 0x7f53ac106420 2024-02-19T18:55:39.092 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.247+0000 7f53b264d700 1 -- 172.21.15.96:0/1289738848 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53ac0623c0 con 0x7f53ac106420 2024-02-19T18:55:39.093 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.247+0000 7f53a97fa700 1 --2- 172.21.15.96:0/1289738848 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f53940381f0 0x7f539403a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:39.093 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.247+0000 7f53a97fa700 1 -- 172.21.15.96:0/1289738848 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f539c04c670 con 0x7f53ac106420 2024-02-19T18:55:39.093 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.247+0000 7f53ab7fe700 1 --2- 172.21.15.96:0/1289738848 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f53940381f0 0x7f539403a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:39.093 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.248+0000 7f53ab7fe700 1 --2- 172.21.15.96:0/1289738848 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f53940381f0 0x7f539403a6b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f53a0006fd0 tx=0x7f53a0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:39.093 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.252+0000 7f53a97fa700 1 -- 172.21.15.96:0/1289738848 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f539c02b700 con 0x7f53ac106420 2024-02-19T18:55:39.093 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.315+0000 7f53a97fa700 1 -- 172.21.15.96:0/1289738848 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mgrmap(e 12) v1 ==== 45296+0+0 (secure 0 0 0) 0x7f539c02c3a0 con 0x7f53ac106420 2024-02-19T18:55:39.093 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.453+0000 7f53b264d700 1 -- 172.21.15.96:0/1289738848 --> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f53ac10a820 con 0x7f53940381f0 2024-02-19T18:55:39.093 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.551+0000 7f53a97fa700 1 -- 172.21.15.96:0/1289738848 <== mgr.14164 v2:172.21.15.96:6800/3628131135 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f53ac10a820 con 0x7f53940381f0 2024-02-19T18:55:39.093 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.553+0000 7f53b264d700 1 -- 172.21.15.96:0/1289738848 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f53940381f0 msgr2=0x7f539403a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:39.093 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.553+0000 7f53b264d700 1 --2- 172.21.15.96:0/1289738848 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f53940381f0 0x7f539403a6b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f53a0006fd0 tx=0x7f53a0006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:39.093 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.553+0000 7f53b264d700 1 -- 172.21.15.96:0/1289738848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53ac106420 msgr2=0x7f53ac07bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:39.093 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.553+0000 7f53b264d700 1 --2- 172.21.15.96:0/1289738848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53ac106420 0x7f53ac07bc10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f539c006ba0 tx=0x7f539c011b50 comp rx=0 tx=0).stop 2024-02-19T18:55:39.093 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.554+0000 7f53b264d700 1 -- 172.21.15.96:0/1289738848 shutdown_connections 2024-02-19T18:55:39.093 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.554+0000 7f53b264d700 1 --2- 172.21.15.96:0/1289738848 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f53940381f0 0x7f539403a6b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:39.093 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.554+0000 7f53b264d700 1 --2- 172.21.15.96:0/1289738848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53ac106420 0x7f53ac07bc10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:39.094 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.554+0000 7f53b264d700 1 -- 172.21.15.96:0/1289738848 >> 172.21.15.96:0/1289738848 conn(0x7f53ac101a00 msgr2=0x7f53ac1030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:39.094 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.554+0000 7f53b264d700 1 -- 172.21.15.96:0/1289738848 shutdown_connections 2024-02-19T18:55:39.094 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:38.554+0000 7f53b264d700 1 -- 172.21.15.96:0/1289738848 wait complete. 2024-02-19T18:55:39.094 INFO:teuthology.orchestra.run.smithi096.stdout:Creating initial admin user... 2024-02-19T18:55:39.460 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:39 smithi096 ceph-mon[29216]: mgrmap e12: smithi096.zsjdff(active, since 2s) 2024-02-19T18:55:39.460 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:39 smithi096 ceph-mon[29216]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:55:39.461 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:39 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:39.461 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:39 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:39.461 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:39 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:40.513 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$OSmmETXjGSgrx1DCqRVSo.nd1hjO2tphI6OTy4AmM3z39nmisdvyW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1708368939, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-19T18:55:40.513 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.474+0000 7efe8a6f9700 1 Processor -- start 2024-02-19T18:55:40.513 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.474+0000 7efe8a6f9700 1 -- start start 2024-02-19T18:55:40.513 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.474+0000 7efe8a6f9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8407bed0 0x7efe8407a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:40.513 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.474+0000 7efe8a6f9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8407a900 con 0x7efe8407bed0 2024-02-19T18:55:40.513 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.474+0000 7efe83fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8407bed0 0x7efe8407a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:40.514 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.475+0000 7efe83fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8407bed0 0x7efe8407a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52722/0 (socket says 172.21.15.96:52722) 2024-02-19T18:55:40.514 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.475+0000 7efe83fff700 1 -- 172.21.15.96:0/3171084735 learned_addr learned my addr 172.21.15.96:0/3171084735 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:40.514 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.475+0000 7efe83fff700 1 -- 172.21.15.96:0/3171084735 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8407aa40 con 0x7efe8407bed0 2024-02-19T18:55:40.514 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.475+0000 7efe83fff700 1 --2- 172.21.15.96:0/3171084735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8407bed0 0x7efe8407a330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efe740098a0 tx=0x7efe74009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e05888fe29145d server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:40.514 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.475+0000 7efe82ffd700 1 -- 172.21.15.96:0/3171084735 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe74004180 con 0x7efe8407bed0 2024-02-19T18:55:40.514 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.475+0000 7efe82ffd700 1 -- 172.21.15.96:0/3171084735 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efe740042e0 con 0x7efe8407bed0 2024-02-19T18:55:40.514 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.475+0000 7efe82ffd700 1 -- 172.21.15.96:0/3171084735 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe74011af0 con 0x7efe8407bed0 2024-02-19T18:55:40.514 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.476+0000 7efe8a6f9700 1 -- 172.21.15.96:0/3171084735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8407bed0 msgr2=0x7efe8407a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:40.514 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.476+0000 7efe8a6f9700 1 --2- 172.21.15.96:0/3171084735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8407bed0 0x7efe8407a330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efe740098a0 tx=0x7efe74009bb0 comp rx=0 tx=0).stop 2024-02-19T18:55:40.514 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.476+0000 7efe8a6f9700 1 -- 172.21.15.96:0/3171084735 shutdown_connections 2024-02-19T18:55:40.514 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.476+0000 7efe8a6f9700 1 --2- 172.21.15.96:0/3171084735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8407bed0 0x7efe8407a330 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:40.514 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.476+0000 7efe8a6f9700 1 -- 172.21.15.96:0/3171084735 >> 172.21.15.96:0/3171084735 conn(0x7efe841019d0 msgr2=0x7efe84103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:40.514 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.476+0000 7efe8a6f9700 1 -- 172.21.15.96:0/3171084735 shutdown_connections 2024-02-19T18:55:40.514 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.476+0000 7efe8a6f9700 1 -- 172.21.15.96:0/3171084735 wait complete. 2024-02-19T18:55:40.515 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.476+0000 7efe8a6f9700 1 Processor -- start 2024-02-19T18:55:40.515 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.477+0000 7efe8a6f9700 1 -- start start 2024-02-19T18:55:40.515 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.477+0000 7efe8a6f9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8407bed0 0x7efe8419c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:40.515 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.477+0000 7efe8a6f9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8419c890 con 0x7efe8407bed0 2024-02-19T18:55:40.515 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.477+0000 7efe83fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8407bed0 0x7efe8419c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:40.515 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.477+0000 7efe83fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8407bed0 0x7efe8419c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52724/0 (socket says 172.21.15.96:52724) 2024-02-19T18:55:40.515 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.477+0000 7efe83fff700 1 -- 172.21.15.96:0/2928726673 learned_addr learned my addr 172.21.15.96:0/2928726673 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:40.515 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.477+0000 7efe83fff700 1 -- 172.21.15.96:0/2928726673 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe74009550 con 0x7efe8407bed0 2024-02-19T18:55:40.515 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.477+0000 7efe83fff700 1 --2- 172.21.15.96:0/2928726673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8407bed0 0x7efe8419c350 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efe74000c00 tx=0x7efe74011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:40.515 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.478+0000 7efe817fa700 1 -- 172.21.15.96:0/2928726673 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe74003a70 con 0x7efe8407bed0 2024-02-19T18:55:40.515 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.478+0000 7efe817fa700 1 -- 172.21.15.96:0/2928726673 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efe74003bd0 con 0x7efe8407bed0 2024-02-19T18:55:40.515 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.478+0000 7efe817fa700 1 -- 172.21.15.96:0/2928726673 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe740238c0 con 0x7efe8407bed0 2024-02-19T18:55:40.515 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.478+0000 7efe8a6f9700 1 -- 172.21.15.96:0/2928726673 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe8419ca90 con 0x7efe8407bed0 2024-02-19T18:55:40.515 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.478+0000 7efe8a6f9700 1 -- 172.21.15.96:0/2928726673 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8419cf30 con 0x7efe8407bed0 2024-02-19T18:55:40.516 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.479+0000 7efe817fa700 1 -- 172.21.15.96:0/2928726673 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 12) v1 ==== 45296+0+0 (secure 0 0 0) 0x7efe74023b80 con 0x7efe8407bed0 2024-02-19T18:55:40.516 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.479+0000 7efe8a6f9700 1 -- 172.21.15.96:0/2928726673 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe8410c7d0 con 0x7efe8407bed0 2024-02-19T18:55:40.516 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.479+0000 7efe817fa700 1 --2- 172.21.15.96:0/2928726673 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7efe6c038370 0x7efe6c03a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:40.516 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.479+0000 7efe817fa700 1 -- 172.21.15.96:0/2928726673 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7efe7404c3f0 con 0x7efe8407bed0 2024-02-19T18:55:40.516 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.479+0000 7efe837fe700 1 --2- 172.21.15.96:0/2928726673 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7efe6c038370 0x7efe6c03a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:40.516 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.479+0000 7efe837fe700 1 --2- 172.21.15.96:0/2928726673 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7efe6c038370 0x7efe6c03a830 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efe78006fd0 tx=0x7efe78006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:40.516 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.484+0000 7efe817fa700 1 -- 172.21.15.96:0/2928726673 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7efe740108e0 con 0x7efe8407bed0 2024-02-19T18:55:40.516 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.699+0000 7efe8a6f9700 1 -- 172.21.15.96:0/2928726673 --> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7efe8419fe30 con 0x7efe6c038370 2024-02-19T18:55:40.516 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.929+0000 7efe817fa700 1 -- 172.21.15.96:0/2928726673 <== mgr.14164 v2:172.21.15.96:6800/3628131135 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7efe8419fe30 con 0x7efe6c038370 2024-02-19T18:55:40.516 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.931+0000 7efe8a6f9700 1 -- 172.21.15.96:0/2928726673 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7efe6c038370 msgr2=0x7efe6c03a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:40.517 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.931+0000 7efe8a6f9700 1 --2- 172.21.15.96:0/2928726673 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7efe6c038370 0x7efe6c03a830 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efe78006fd0 tx=0x7efe78006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:40.517 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.931+0000 7efe8a6f9700 1 -- 172.21.15.96:0/2928726673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8407bed0 msgr2=0x7efe8419c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:40.517 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.931+0000 7efe8a6f9700 1 --2- 172.21.15.96:0/2928726673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8407bed0 0x7efe8419c350 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efe74000c00 tx=0x7efe74011b50 comp rx=0 tx=0).stop 2024-02-19T18:55:40.517 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.932+0000 7efe8a6f9700 1 -- 172.21.15.96:0/2928726673 shutdown_connections 2024-02-19T18:55:40.517 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.932+0000 7efe8a6f9700 1 --2- 172.21.15.96:0/2928726673 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7efe6c038370 0x7efe6c03a830 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:40.517 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.932+0000 7efe8a6f9700 1 --2- 172.21.15.96:0/2928726673 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe8407bed0 0x7efe8419c350 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:40.517 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.932+0000 7efe8a6f9700 1 -- 172.21.15.96:0/2928726673 >> 172.21.15.96:0/2928726673 conn(0x7efe841019d0 msgr2=0x7efe84103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:40.517 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.932+0000 7efe8a6f9700 1 -- 172.21.15.96:0/2928726673 shutdown_connections 2024-02-19T18:55:40.517 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:39.932+0000 7efe8a6f9700 1 -- 172.21.15.96:0/2928726673 wait complete. 2024-02-19T18:55:40.517 INFO:teuthology.orchestra.run.smithi096.stdout:Fetching dashboard port number... 2024-02-19T18:55:41.150 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:40 smithi096 ceph-mon[29216]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:55:41.150 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:40 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:41.150 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:40 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:42.183 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:41 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/448579087' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-19T18:55:42.618 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stdout 8443 2024-02-19T18:55:42.618 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.991+0000 7feefeae8700 1 Processor -- start 2024-02-19T18:55:42.618 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.991+0000 7feefeae8700 1 -- start start 2024-02-19T18:55:42.618 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.991+0000 7feefeae8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef807bed0 0x7feef807a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:42.618 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.991+0000 7feefeae8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef807a900 con 0x7feef807bed0 2024-02-19T18:55:42.619 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.991+0000 7feefc884700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef807bed0 0x7feef807a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:42.619 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.991+0000 7feefc884700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef807bed0 0x7feef807a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52730/0 (socket says 172.21.15.96:52730) 2024-02-19T18:55:42.619 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.991+0000 7feefc884700 1 -- 172.21.15.96:0/1077898969 learned_addr learned my addr 172.21.15.96:0/1077898969 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:42.619 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.991+0000 7feefc884700 1 -- 172.21.15.96:0/1077898969 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef807aa40 con 0x7feef807bed0 2024-02-19T18:55:42.619 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.992+0000 7feefc884700 1 --2- 172.21.15.96:0/1077898969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef807bed0 0x7feef807a330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feeec0098a0 tx=0x7feeec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f17be898377664 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:42.619 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.992+0000 7feef77fe700 1 -- 172.21.15.96:0/1077898969 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feeec004180 con 0x7feef807bed0 2024-02-19T18:55:42.619 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.992+0000 7feef77fe700 1 -- 172.21.15.96:0/1077898969 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7feeec0042e0 con 0x7feef807bed0 2024-02-19T18:55:42.619 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.992+0000 7feef77fe700 1 -- 172.21.15.96:0/1077898969 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feeec011af0 con 0x7feef807bed0 2024-02-19T18:55:42.619 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.992+0000 7feefeae8700 1 -- 172.21.15.96:0/1077898969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef807bed0 msgr2=0x7feef807a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:42.619 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.992+0000 7feefeae8700 1 --2- 172.21.15.96:0/1077898969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef807bed0 0x7feef807a330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feeec0098a0 tx=0x7feeec009bb0 comp rx=0 tx=0).stop 2024-02-19T18:55:42.619 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.992+0000 7feefeae8700 1 -- 172.21.15.96:0/1077898969 shutdown_connections 2024-02-19T18:55:42.619 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.992+0000 7feefeae8700 1 --2- 172.21.15.96:0/1077898969 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef807bed0 0x7feef807a330 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:42.619 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.992+0000 7feefeae8700 1 -- 172.21.15.96:0/1077898969 >> 172.21.15.96:0/1077898969 conn(0x7feef8101a00 msgr2=0x7feef8103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:42.619 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.992+0000 7feefeae8700 1 -- 172.21.15.96:0/1077898969 shutdown_connections 2024-02-19T18:55:42.619 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.992+0000 7feefeae8700 1 -- 172.21.15.96:0/1077898969 wait complete. 2024-02-19T18:55:42.620 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.993+0000 7feefeae8700 1 Processor -- start 2024-02-19T18:55:42.620 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.993+0000 7feefeae8700 1 -- start start 2024-02-19T18:55:42.620 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.993+0000 7feefeae8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef807bed0 0x7feef819c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:42.620 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.993+0000 7feefeae8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef819c810 con 0x7feef807bed0 2024-02-19T18:55:42.620 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.993+0000 7feefc884700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef807bed0 0x7feef819c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:42.620 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.993+0000 7feefc884700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef807bed0 0x7feef819c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52740/0 (socket says 172.21.15.96:52740) 2024-02-19T18:55:42.620 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.993+0000 7feefc884700 1 -- 172.21.15.96:0/448579087 learned_addr learned my addr 172.21.15.96:0/448579087 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:42.620 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.993+0000 7feefc884700 1 -- 172.21.15.96:0/448579087 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec009550 con 0x7feef807bed0 2024-02-19T18:55:42.620 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.994+0000 7feefc884700 1 --2- 172.21.15.96:0/448579087 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef807bed0 0x7feef819c2d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feeec006ba0 tx=0x7feeec011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:42.620 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.994+0000 7feef5ffb700 1 -- 172.21.15.96:0/448579087 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feeec003b00 con 0x7feef807bed0 2024-02-19T18:55:42.620 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.994+0000 7feef5ffb700 1 -- 172.21.15.96:0/448579087 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7feeec01a8e0 con 0x7feef807bed0 2024-02-19T18:55:42.620 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.994+0000 7feef5ffb700 1 -- 172.21.15.96:0/448579087 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feeec019990 con 0x7feef807bed0 2024-02-19T18:55:42.620 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.994+0000 7feefeae8700 1 -- 172.21.15.96:0/448579087 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef819ca10 con 0x7feef807bed0 2024-02-19T18:55:42.620 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.994+0000 7feefeae8700 1 -- 172.21.15.96:0/448579087 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef819ceb0 con 0x7feef807bed0 2024-02-19T18:55:42.620 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.995+0000 7feef5ffb700 1 -- 172.21.15.96:0/448579087 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 12) v1 ==== 45296+0+0 (secure 0 0 0) 0x7feeec019c00 con 0x7feef807bed0 2024-02-19T18:55:42.621 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.995+0000 7feefeae8700 1 -- 172.21.15.96:0/448579087 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef810c7c0 con 0x7feef807bed0 2024-02-19T18:55:42.621 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.995+0000 7feef5ffb700 1 --2- 172.21.15.96:0/448579087 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7feee8038370 0x7feee803a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:42.621 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.995+0000 7feef5ffb700 1 -- 172.21.15.96:0/448579087 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7feeec04c6a0 con 0x7feef807bed0 2024-02-19T18:55:42.621 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.995+0000 7feef7fff700 1 --2- 172.21.15.96:0/448579087 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7feee8038370 0x7feee803a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:42.621 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:40.995+0000 7feef7fff700 1 --2- 172.21.15.96:0/448579087 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7feee8038370 0x7feee803a830 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feee4006fd0 tx=0x7feee4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:42.621 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:41.000+0000 7feef5ffb700 1 -- 172.21.15.96:0/448579087 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7feeec01aa50 con 0x7feef807bed0 2024-02-19T18:55:42.621 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:41.191+0000 7feefeae8700 1 -- 172.21.15.96:0/448579087 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7feef810c9b0 con 0x7feef807bed0 2024-02-19T18:55:42.621 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:41.192+0000 7feef5ffb700 1 -- 172.21.15.96:0/448579087 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7feeec018350 con 0x7feef807bed0 2024-02-19T18:55:42.621 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:41.194+0000 7feefeae8700 1 -- 172.21.15.96:0/448579087 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7feee8038370 msgr2=0x7feee803a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:42.621 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:41.194+0000 7feefeae8700 1 --2- 172.21.15.96:0/448579087 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7feee8038370 0x7feee803a830 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feee4006fd0 tx=0x7feee4006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:42.621 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:41.194+0000 7feefeae8700 1 -- 172.21.15.96:0/448579087 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef807bed0 msgr2=0x7feef819c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:42.621 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:41.194+0000 7feefeae8700 1 --2- 172.21.15.96:0/448579087 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef807bed0 0x7feef819c2d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feeec006ba0 tx=0x7feeec011b50 comp rx=0 tx=0).stop 2024-02-19T18:55:42.621 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:41.194+0000 7feefeae8700 1 -- 172.21.15.96:0/448579087 shutdown_connections 2024-02-19T18:55:42.621 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:41.194+0000 7feefeae8700 1 --2- 172.21.15.96:0/448579087 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7feee8038370 0x7feee803a830 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:42.621 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:41.194+0000 7feefeae8700 1 --2- 172.21.15.96:0/448579087 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feef807bed0 0x7feef819c2d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:42.622 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:41.194+0000 7feefeae8700 1 -- 172.21.15.96:0/448579087 >> 172.21.15.96:0/448579087 conn(0x7feef8101a00 msgr2=0x7feef8102770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:42.622 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:41.194+0000 7feefeae8700 1 -- 172.21.15.96:0/448579087 shutdown_connections 2024-02-19T18:55:42.622 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:41.194+0000 7feefeae8700 1 -- 172.21.15.96:0/448579087 wait complete. 2024-02-19T18:55:42.625 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-19T18:55:42.625 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout disabled 2024-02-19T18:55:42.633 INFO:teuthology.orchestra.run.smithi096.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-19T18:55:42.633 INFO:teuthology.orchestra.run.smithi096.stdout:systemctl: stdout inactive 2024-02-19T18:55:42.633 INFO:teuthology.orchestra.run.smithi096.stdout:firewalld.service is not enabled 2024-02-19T18:55:42.633 INFO:teuthology.orchestra.run.smithi096.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-02-19T18:55:42.635 INFO:teuthology.orchestra.run.smithi096.stdout:Ceph Dashboard is now available at: 2024-02-19T18:55:42.635 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:55:42.635 INFO:teuthology.orchestra.run.smithi096.stdout: URL: https://smithi096.front.sepia.ceph.com:8443/ 2024-02-19T18:55:42.635 INFO:teuthology.orchestra.run.smithi096.stdout: User: admin 2024-02-19T18:55:42.635 INFO:teuthology.orchestra.run.smithi096.stdout: Password: 2a4ucpnt4o 2024-02-19T18:55:42.635 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:55:42.635 INFO:teuthology.orchestra.run.smithi096.stdout:Saving cluster configuration to /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config directory 2024-02-19T18:55:42.636 INFO:teuthology.orchestra.run.smithi096.stdout:Enabling autotune for osd_memory_target 2024-02-19T18:55:43.798 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.024+0000 7ffa01b91700 1 Processor -- start 2024-02-19T18:55:43.798 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.024+0000 7ffa01b91700 1 -- start start 2024-02-19T18:55:43.798 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.024+0000 7ffa01b91700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9fc106430 0x7ff9fc106850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:43.799 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.024+0000 7ffa01b91700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc106e20 con 0x7ff9fc106430 2024-02-19T18:55:43.799 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.025+0000 7ff9fb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9fc106430 0x7ff9fc106850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:43.799 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.025+0000 7ff9fb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9fc106430 0x7ff9fc106850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52754/0 (socket says 172.21.15.96:52754) 2024-02-19T18:55:43.799 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.025+0000 7ff9fb7fe700 1 -- 172.21.15.96:0/362473592 learned_addr learned my addr 172.21.15.96:0/362473592 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:43.799 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.025+0000 7ff9fb7fe700 1 -- 172.21.15.96:0/362473592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9fc107630 con 0x7ff9fc106430 2024-02-19T18:55:43.799 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.025+0000 7ff9fb7fe700 1 --2- 172.21.15.96:0/362473592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9fc106430 0x7ff9fc106850 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0098a0 tx=0x7ff9ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b83b8fc6bbcd2eb1 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:43.799 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.025+0000 7ff9faffd700 1 -- 172.21.15.96:0/362473592 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9ec004180 con 0x7ff9fc106430 2024-02-19T18:55:43.799 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.025+0000 7ff9faffd700 1 -- 172.21.15.96:0/362473592 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff9ec0042e0 con 0x7ff9fc106430 2024-02-19T18:55:43.799 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.025+0000 7ff9faffd700 1 -- 172.21.15.96:0/362473592 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9ec011af0 con 0x7ff9fc106430 2024-02-19T18:55:43.799 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.026+0000 7ffa01b91700 1 -- 172.21.15.96:0/362473592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9fc106430 msgr2=0x7ff9fc106850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:43.799 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.026+0000 7ffa01b91700 1 --2- 172.21.15.96:0/362473592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9fc106430 0x7ff9fc106850 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0098a0 tx=0x7ff9ec009bb0 comp rx=0 tx=0).stop 2024-02-19T18:55:43.799 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.026+0000 7ffa01b91700 1 -- 172.21.15.96:0/362473592 shutdown_connections 2024-02-19T18:55:43.799 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.026+0000 7ffa01b91700 1 --2- 172.21.15.96:0/362473592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9fc106430 0x7ff9fc106850 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:43.799 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.026+0000 7ffa01b91700 1 -- 172.21.15.96:0/362473592 >> 172.21.15.96:0/362473592 conn(0x7ff9fc1019d0 msgr2=0x7ff9fc103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:43.800 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.026+0000 7ffa01b91700 1 -- 172.21.15.96:0/362473592 shutdown_connections 2024-02-19T18:55:43.800 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.026+0000 7ffa01b91700 1 -- 172.21.15.96:0/362473592 wait complete. 2024-02-19T18:55:43.800 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.026+0000 7ffa01b91700 1 Processor -- start 2024-02-19T18:55:43.800 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.026+0000 7ffa01b91700 1 -- start start 2024-02-19T18:55:43.800 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.027+0000 7ffa01b91700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9fc106430 0x7ff9fc19a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:43.800 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.027+0000 7ffa01b91700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9fc19a6d0 con 0x7ff9fc106430 2024-02-19T18:55:43.800 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.027+0000 7ff9fb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9fc106430 0x7ff9fc19a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:43.800 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.027+0000 7ff9fb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9fc106430 0x7ff9fc19a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52756/0 (socket says 172.21.15.96:52756) 2024-02-19T18:55:43.800 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.027+0000 7ff9fb7fe700 1 -- 172.21.15.96:0/1105407975 learned_addr learned my addr 172.21.15.96:0/1105407975 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:43.800 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.027+0000 7ff9fb7fe700 1 -- 172.21.15.96:0/1105407975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec009550 con 0x7ff9fc106430 2024-02-19T18:55:43.800 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.027+0000 7ff9fb7fe700 1 --2- 172.21.15.96:0/1105407975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9fc106430 0x7ff9fc19a190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec000c00 tx=0x7ff9ec011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:43.800 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.027+0000 7ff9f97fa700 1 -- 172.21.15.96:0/1105407975 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9ec003a70 con 0x7ff9fc106430 2024-02-19T18:55:43.800 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.027+0000 7ff9f97fa700 1 -- 172.21.15.96:0/1105407975 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff9ec003bd0 con 0x7ff9fc106430 2024-02-19T18:55:43.800 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.027+0000 7ffa01b91700 1 -- 172.21.15.96:0/1105407975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9fc19a8d0 con 0x7ff9fc106430 2024-02-19T18:55:43.801 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.028+0000 7ff9f97fa700 1 -- 172.21.15.96:0/1105407975 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9ec0238c0 con 0x7ff9fc106430 2024-02-19T18:55:43.801 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.028+0000 7ffa01b91700 1 -- 172.21.15.96:0/1105407975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9fc19ad70 con 0x7ff9fc106430 2024-02-19T18:55:43.801 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.028+0000 7ffa01b91700 1 -- 172.21.15.96:0/1105407975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9fc0623c0 con 0x7ff9fc106430 2024-02-19T18:55:43.801 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.028+0000 7ff9f97fa700 1 -- 172.21.15.96:0/1105407975 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45339+0+0 (secure 0 0 0) 0x7ff9ec01a430 con 0x7ff9fc106430 2024-02-19T18:55:43.801 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.029+0000 7ff9f97fa700 1 --2- 172.21.15.96:0/1105407975 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7ff9e8038460 0x7ff9e803a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:43.801 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.029+0000 7ff9f97fa700 1 -- 172.21.15.96:0/1105407975 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff9ec04c380 con 0x7ff9fc106430 2024-02-19T18:55:43.801 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.029+0000 7ff9f2ffd700 1 --2- 172.21.15.96:0/1105407975 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7ff9e8038460 0x7ff9e803a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:43.801 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.029+0000 7ff9f2ffd700 1 --2- 172.21.15.96:0/1105407975 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7ff9e8038460 0x7ff9e803a920 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4006fd0 tx=0x7ff9e4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:43.801 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.033+0000 7ff9f97fa700 1 -- 172.21.15.96:0/1105407975 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff9ec010560 con 0x7ff9fc106430 2024-02-19T18:55:43.801 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.222+0000 7ffa01b91700 1 -- 172.21.15.96:0/1105407975 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7ff9fc19dc70 con 0x7ff9fc106430 2024-02-19T18:55:43.801 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.223+0000 7ff9f97fa700 1 -- 172.21.15.96:0/1105407975 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7ff9ec010380 con 0x7ff9fc106430 2024-02-19T18:55:43.801 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.225+0000 7ffa01b91700 1 -- 172.21.15.96:0/1105407975 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7ff9e8038460 msgr2=0x7ff9e803a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:43.801 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.225+0000 7ffa01b91700 1 --2- 172.21.15.96:0/1105407975 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7ff9e8038460 0x7ff9e803a920 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4006fd0 tx=0x7ff9e4006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:43.801 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.225+0000 7ffa01b91700 1 -- 172.21.15.96:0/1105407975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9fc106430 msgr2=0x7ff9fc19a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:43.802 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.225+0000 7ffa01b91700 1 --2- 172.21.15.96:0/1105407975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9fc106430 0x7ff9fc19a190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec000c00 tx=0x7ff9ec011b50 comp rx=0 tx=0).stop 2024-02-19T18:55:43.802 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.225+0000 7ffa01b91700 1 -- 172.21.15.96:0/1105407975 shutdown_connections 2024-02-19T18:55:43.802 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.225+0000 7ffa01b91700 1 --2- 172.21.15.96:0/1105407975 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7ff9e8038460 0x7ff9e803a920 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:43.802 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.225+0000 7ffa01b91700 1 --2- 172.21.15.96:0/1105407975 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff9fc106430 0x7ff9fc19a190 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:43.802 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.225+0000 7ffa01b91700 1 -- 172.21.15.96:0/1105407975 >> 172.21.15.96:0/1105407975 conn(0x7ff9fc1019d0 msgr2=0x7ff9fc1030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:43.802 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.225+0000 7ffa01b91700 1 -- 172.21.15.96:0/1105407975 shutdown_connections 2024-02-19T18:55:43.802 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:43.225+0000 7ffa01b91700 1 -- 172.21.15.96:0/1105407975 wait complete. 2024-02-19T18:55:44.068 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:43 smithi096 ceph-mon[29216]: mgrmap e13: smithi096.zsjdff(active, since 6s) 2024-02-19T18:55:45.038 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.153+0000 7f7016ad9700 1 Processor -- start 2024-02-19T18:55:45.038 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.153+0000 7f7016ad9700 1 -- start start 2024-02-19T18:55:45.038 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.153+0000 7f7016ad9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7010106f00 0x7f70101092f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:45.038 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.153+0000 7f7016ad9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7010079e60 con 0x7f7010106f00 2024-02-19T18:55:45.038 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.153+0000 7f7014875700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7010106f00 0x7f70101092f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:45.039 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.153+0000 7f7014875700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7010106f00 0x7f70101092f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39310/0 (socket says 172.21.15.96:39310) 2024-02-19T18:55:45.039 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.153+0000 7f7014875700 1 -- 172.21.15.96:0/3980323643 learned_addr learned my addr 172.21.15.96:0/3980323643 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:45.039 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.153+0000 7f7014875700 1 -- 172.21.15.96:0/3980323643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7010109830 con 0x7f7010106f00 2024-02-19T18:55:45.039 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.153+0000 7f7014875700 1 --2- 172.21.15.96:0/3980323643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7010106f00 0x7f70101092f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f70080098a0 tx=0x7f7008009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0d4e3e16e41d5c server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:45.039 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.154+0000 7f700f7fe700 1 -- 172.21.15.96:0/3980323643 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7008004180 con 0x7f7010106f00 2024-02-19T18:55:45.039 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.154+0000 7f700f7fe700 1 -- 172.21.15.96:0/3980323643 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f70080042e0 con 0x7f7010106f00 2024-02-19T18:55:45.039 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.154+0000 7f700f7fe700 1 -- 172.21.15.96:0/3980323643 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7008011af0 con 0x7f7010106f00 2024-02-19T18:55:45.039 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.154+0000 7f7016ad9700 1 -- 172.21.15.96:0/3980323643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7010106f00 msgr2=0x7f70101092f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:45.039 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.154+0000 7f7016ad9700 1 --2- 172.21.15.96:0/3980323643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7010106f00 0x7f70101092f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f70080098a0 tx=0x7f7008009bb0 comp rx=0 tx=0).stop 2024-02-19T18:55:45.039 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.154+0000 7f7016ad9700 1 -- 172.21.15.96:0/3980323643 shutdown_connections 2024-02-19T18:55:45.039 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.154+0000 7f7016ad9700 1 --2- 172.21.15.96:0/3980323643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7010106f00 0x7f70101092f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:45.039 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.154+0000 7f7016ad9700 1 -- 172.21.15.96:0/3980323643 >> 172.21.15.96:0/3980323643 conn(0x7f70101008b0 msgr2=0x7f7010102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:45.039 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.154+0000 7f7016ad9700 1 -- 172.21.15.96:0/3980323643 shutdown_connections 2024-02-19T18:55:45.039 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.154+0000 7f7016ad9700 1 -- 172.21.15.96:0/3980323643 wait complete. 2024-02-19T18:55:45.040 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.155+0000 7f7016ad9700 1 Processor -- start 2024-02-19T18:55:45.040 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.155+0000 7f7016ad9700 1 -- start start 2024-02-19T18:55:45.040 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.155+0000 7f7016ad9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7010106f00 0x7f7010106860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:45.040 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.155+0000 7f7016ad9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7010106da0 con 0x7f7010106f00 2024-02-19T18:55:45.040 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.155+0000 7f7014875700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7010106f00 0x7f7010106860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:45.040 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.155+0000 7f7014875700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7010106f00 0x7f7010106860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39316/0 (socket says 172.21.15.96:39316) 2024-02-19T18:55:45.040 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.155+0000 7f7014875700 1 -- 172.21.15.96:0/3526725533 learned_addr learned my addr 172.21.15.96:0/3526725533 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:45.040 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.155+0000 7f7014875700 1 -- 172.21.15.96:0/3526725533 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7008009550 con 0x7f7010106f00 2024-02-19T18:55:45.040 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.155+0000 7f7014875700 1 --2- 172.21.15.96:0/3526725533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7010106f00 0x7f7010106860 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7008011670 tx=0x7f7008011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:45.040 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.156+0000 7f700dffb700 1 -- 172.21.15.96:0/3526725533 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7008003a40 con 0x7f7010106f00 2024-02-19T18:55:45.040 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.156+0000 7f700dffb700 1 -- 172.21.15.96:0/3526725533 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7008003ba0 con 0x7f7010106f00 2024-02-19T18:55:45.040 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.156+0000 7f7016ad9700 1 -- 172.21.15.96:0/3526725533 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7010104eb0 con 0x7f7010106f00 2024-02-19T18:55:45.040 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.156+0000 7f700dffb700 1 -- 172.21.15.96:0/3526725533 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7008024820 con 0x7f7010106f00 2024-02-19T18:55:45.040 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.156+0000 7f7016ad9700 1 -- 172.21.15.96:0/3526725533 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7010105350 con 0x7f7010106f00 2024-02-19T18:55:45.040 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.157+0000 7f700dffb700 1 -- 172.21.15.96:0/3526725533 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45339+0+0 (secure 0 0 0) 0x7f700801ac70 con 0x7f7010106f00 2024-02-19T18:55:45.041 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.157+0000 7f7016ad9700 1 -- 172.21.15.96:0/3526725533 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701010a5c0 con 0x7f7010106f00 2024-02-19T18:55:45.041 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.157+0000 7f700dffb700 1 --2- 172.21.15.96:0/3526725533 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f6ffc0383d0 0x7f6ffc03a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:45.041 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.157+0000 7f700dffb700 1 -- 172.21.15.96:0/3526725533 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f700804c510 con 0x7f7010106f00 2024-02-19T18:55:45.041 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.157+0000 7f700ffff700 1 --2- 172.21.15.96:0/3526725533 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f6ffc0383d0 0x7f6ffc03a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:45.041 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.157+0000 7f700ffff700 1 --2- 172.21.15.96:0/3526725533 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f6ffc0383d0 0x7f6ffc03a890 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f700000ad30 tx=0x7f70000093f0 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:45.041 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.162+0000 7f700dffb700 1 -- 172.21.15.96:0/3526725533 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f7008018760 con 0x7f7010106f00 2024-02-19T18:55:45.041 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.456+0000 7f7016ad9700 1 -- 172.21.15.96:0/3526725533 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f701010a7e0 con 0x7f7010106f00 2024-02-19T18:55:45.041 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.459+0000 7f700dffb700 1 -- 172.21.15.96:0/3526725533 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7f70080172b0 con 0x7f7010106f00 2024-02-19T18:55:45.041 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.461+0000 7f7016ad9700 1 -- 172.21.15.96:0/3526725533 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f6ffc0383d0 msgr2=0x7f6ffc03a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:45.041 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.461+0000 7f7016ad9700 1 --2- 172.21.15.96:0/3526725533 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f6ffc0383d0 0x7f6ffc03a890 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f700000ad30 tx=0x7f70000093f0 comp rx=0 tx=0).stop 2024-02-19T18:55:45.041 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.461+0000 7f7016ad9700 1 -- 172.21.15.96:0/3526725533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7010106f00 msgr2=0x7f7010106860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:45.041 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.461+0000 7f7016ad9700 1 --2- 172.21.15.96:0/3526725533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7010106f00 0x7f7010106860 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7008011670 tx=0x7f7008011aa0 comp rx=0 tx=0).stop 2024-02-19T18:55:45.041 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.461+0000 7f7016ad9700 1 -- 172.21.15.96:0/3526725533 shutdown_connections 2024-02-19T18:55:45.041 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.461+0000 7f7016ad9700 1 --2- 172.21.15.96:0/3526725533 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f6ffc0383d0 0x7f6ffc03a890 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:45.042 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.461+0000 7f7016ad9700 1 --2- 172.21.15.96:0/3526725533 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7010106f00 0x7f7010106860 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:45.042 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.461+0000 7f7016ad9700 1 -- 172.21.15.96:0/3526725533 >> 172.21.15.96:0/3526725533 conn(0x7f70101008b0 msgr2=0x7f7010101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:45.042 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.461+0000 7f7016ad9700 1 -- 172.21.15.96:0/3526725533 shutdown_connections 2024-02-19T18:55:45.042 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr 2024-02-19T18:55:44.462+0000 7f7016ad9700 1 -- 172.21.15.96:0/3526725533 wait complete. 2024-02-19T18:55:45.042 INFO:teuthology.orchestra.run.smithi096.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-02-19T18:55:45.042 INFO:teuthology.orchestra.run.smithi096.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-02-19T18:55:45.042 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:55:45.042 INFO:teuthology.orchestra.run.smithi096.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-19T18:55:45.042 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:55:45.042 INFO:teuthology.orchestra.run.smithi096.stdout:Or, if you are only running a single cluster on this host: 2024-02-19T18:55:45.042 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:55:45.042 INFO:teuthology.orchestra.run.smithi096.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-02-19T18:55:45.042 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:55:45.042 INFO:teuthology.orchestra.run.smithi096.stdout:Please consider enabling telemetry to help improve Ceph: 2024-02-19T18:55:45.042 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:55:45.043 INFO:teuthology.orchestra.run.smithi096.stdout: ceph telemetry on 2024-02-19T18:55:45.043 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:55:45.043 INFO:teuthology.orchestra.run.smithi096.stdout:For more information see: 2024-02-19T18:55:45.043 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:55:45.043 INFO:teuthology.orchestra.run.smithi096.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-02-19T18:55:45.043 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:55:45.043 INFO:teuthology.orchestra.run.smithi096.stdout:Bootstrap complete. 2024-02-19T18:55:45.071 INFO:tasks.cephadm:Fetching config... 2024-02-19T18:55:45.071 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-02-19T18:55:45.071 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-19T18:55:45.086 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-19T18:55:45.087 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-02-19T18:55:45.087 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-19T18:55:45.141 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-19T18:55:45.141 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-02-19T18:55:45.141 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/keyring of=/dev/stdout 2024-02-19T18:55:45.209 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-19T18:55:45.209 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-02-19T18:55:45.209 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-19T18:55:45.265 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-19T18:55:45.266 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu79fsKnGmiNuAedhtHeTxcp8F5t30y+Yqmiag0di9GuPAJKrcNAs8UmH17LVjelr6H3pe1AmIh+Gsf7YcHZN0iaahqfuIjw0j49d9DdlYcuQYwvDu6hdBX87Q6lnBaFsKcFLdwc885tOaNe9c3IALxWVHvhF9PcxYPX8mC9g66rolIHSX3gip0SA/qCc15T4sU8j9iN0oRKHu3Oksiobep1P4NTEmriiViug1BZJR5vbLhgsfdrn4rUEvAHajfEWhOp2tVQiFbbBom4Z8XlF2BRLWEwLwh0kfk39FiR0pUwrb0w327nsiFA3uehSb35fwJZ0L5Sfb/4sN1EMyKacc1BjDEdPHa+o/pV7LRpS4q2sbFMsLCxSkFsfMz/yBT+Czg3AOnIlJ4zBS0SU2WlT40iEWMRh3xLW/+soc3hzaSeczfuk4JlGe4SWdKAoEDEZDMG9KWyRz20Jbl1IuvVL3eUMgqYZXqZPXjWwmi90AHXr8SPncKiJLZa0HL6mF2V8= ceph-06580d2c-cf58-11ee-95bb-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-19T18:55:45.344 INFO:teuthology.orchestra.run.smithi096.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu79fsKnGmiNuAedhtHeTxcp8F5t30y+Yqmiag0di9GuPAJKrcNAs8UmH17LVjelr6H3pe1AmIh+Gsf7YcHZN0iaahqfuIjw0j49d9DdlYcuQYwvDu6hdBX87Q6lnBaFsKcFLdwc885tOaNe9c3IALxWVHvhF9PcxYPX8mC9g66rolIHSX3gip0SA/qCc15T4sU8j9iN0oRKHu3Oksiobep1P4NTEmriiViug1BZJR5vbLhgsfdrn4rUEvAHajfEWhOp2tVQiFbbBom4Z8XlF2BRLWEwLwh0kfk39FiR0pUwrb0w327nsiFA3uehSb35fwJZ0L5Sfb/4sN1EMyKacc1BjDEdPHa+o/pV7LRpS4q2sbFMsLCxSkFsfMz/yBT+Czg3AOnIlJ4zBS0SU2WlT40iEWMRh3xLW/+soc3hzaSeczfuk4JlGe4SWdKAoEDEZDMG9KWyRz20Jbl1IuvVL3eUMgqYZXqZPXjWwmi90AHXr8SPncKiJLZa0HL6mF2V8= ceph-06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T18:55:45.358 DEBUG:teuthology.orchestra.run.smithi125:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu79fsKnGmiNuAedhtHeTxcp8F5t30y+Yqmiag0di9GuPAJKrcNAs8UmH17LVjelr6H3pe1AmIh+Gsf7YcHZN0iaahqfuIjw0j49d9DdlYcuQYwvDu6hdBX87Q6lnBaFsKcFLdwc885tOaNe9c3IALxWVHvhF9PcxYPX8mC9g66rolIHSX3gip0SA/qCc15T4sU8j9iN0oRKHu3Oksiobep1P4NTEmriiViug1BZJR5vbLhgsfdrn4rUEvAHajfEWhOp2tVQiFbbBom4Z8XlF2BRLWEwLwh0kfk39FiR0pUwrb0w327nsiFA3uehSb35fwJZ0L5Sfb/4sN1EMyKacc1BjDEdPHa+o/pV7LRpS4q2sbFMsLCxSkFsfMz/yBT+Czg3AOnIlJ4zBS0SU2WlT40iEWMRh3xLW/+soc3hzaSeczfuk4JlGe4SWdKAoEDEZDMG9KWyRz20Jbl1IuvVL3eUMgqYZXqZPXjWwmi90AHXr8SPncKiJLZa0HL6mF2V8= ceph-06580d2c-cf58-11ee-95bb-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-19T18:55:45.404 INFO:teuthology.orchestra.run.smithi125.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu79fsKnGmiNuAedhtHeTxcp8F5t30y+Yqmiag0di9GuPAJKrcNAs8UmH17LVjelr6H3pe1AmIh+Gsf7YcHZN0iaahqfuIjw0j49d9DdlYcuQYwvDu6hdBX87Q6lnBaFsKcFLdwc885tOaNe9c3IALxWVHvhF9PcxYPX8mC9g66rolIHSX3gip0SA/qCc15T4sU8j9iN0oRKHu3Oksiobep1P4NTEmriiViug1BZJR5vbLhgsfdrn4rUEvAHajfEWhOp2tVQiFbbBom4Z8XlF2BRLWEwLwh0kfk39FiR0pUwrb0w327nsiFA3uehSb35fwJZ0L5Sfb/4sN1EMyKacc1BjDEdPHa+o/pV7LRpS4q2sbFMsLCxSkFsfMz/yBT+Czg3AOnIlJ4zBS0SU2WlT40iEWMRh3xLW/+soc3hzaSeczfuk4JlGe4SWdKAoEDEZDMG9KWyRz20Jbl1IuvVL3eUMgqYZXqZPXjWwmi90AHXr8SPncKiJLZa0HL6mF2V8= ceph-06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T18:55:45.419 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-02-19T18:55:45.637 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T18:55:45.758 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:45 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/3526725533' entity='client.admin' 2024-02-19T18:55:48.033 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:47 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:48.033 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:47 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:48.033 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:47 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:55:48.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:47 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:48.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:47 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi096", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T18:55:48.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:47 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi096", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-19T18:55:48.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:47 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:48.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:47 smithi096 ceph-mon[29216]: Deploying daemon ceph-exporter.smithi096 on smithi096 2024-02-19T18:55:48.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.112+0000 7f3e4dd34700 1 -- 172.21.15.96:0/3636460517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e48101310 msgr2=0x7f3e48103700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:48.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.112+0000 7f3e4dd34700 1 --2- 172.21.15.96:0/3636460517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e48101310 0x7f3e48103700 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3e38009910 tx=0x7f3e38009c20 comp rx=0 tx=0).stop 2024-02-19T18:55:48.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.113+0000 7f3e4dd34700 1 -- 172.21.15.96:0/3636460517 shutdown_connections 2024-02-19T18:55:48.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.113+0000 7f3e4dd34700 1 --2- 172.21.15.96:0/3636460517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e48101310 0x7f3e48103700 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:48.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.113+0000 7f3e4dd34700 1 -- 172.21.15.96:0/3636460517 >> 172.21.15.96:0/3636460517 conn(0x7f3e480fad20 msgr2=0x7f3e480fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:48.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.113+0000 7f3e4dd34700 1 -- 172.21.15.96:0/3636460517 shutdown_connections 2024-02-19T18:55:48.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.113+0000 7f3e4dd34700 1 -- 172.21.15.96:0/3636460517 wait complete. 2024-02-19T18:55:48.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.113+0000 7f3e4dd34700 1 Processor -- start 2024-02-19T18:55:48.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.113+0000 7f3e4dd34700 1 -- start start 2024-02-19T18:55:48.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.114+0000 7f3e4dd34700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e48101310 0x7f3e48100c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:48.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.114+0000 7f3e4dd34700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e481011b0 con 0x7f3e48101310 2024-02-19T18:55:48.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.114+0000 7f3e477fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e48101310 0x7f3e48100c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:48.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.114+0000 7f3e477fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e48101310 0x7f3e48100c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39342/0 (socket says 172.21.15.96:39342) 2024-02-19T18:55:48.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.114+0000 7f3e477fe700 1 -- 172.21.15.96:0/661564234 learned_addr learned my addr 172.21.15.96:0/661564234 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:48.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.114+0000 7f3e477fe700 1 -- 172.21.15.96:0/661564234 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e380095f0 con 0x7f3e48101310 2024-02-19T18:55:48.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.114+0000 7f3e477fe700 1 --2- 172.21.15.96:0/661564234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e48101310 0x7f3e48100c70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3e38005b40 tx=0x7f3e38004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:48.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.114+0000 7f3e44ff9700 1 -- 172.21.15.96:0/661564234 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e3801d070 con 0x7f3e48101310 2024-02-19T18:55:48.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.114+0000 7f3e4dd34700 1 -- 172.21.15.96:0/661564234 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e480ff2c0 con 0x7f3e48101310 2024-02-19T18:55:48.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.114+0000 7f3e44ff9700 1 -- 172.21.15.96:0/661564234 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3e3800be10 con 0x7f3e48101310 2024-02-19T18:55:48.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.114+0000 7f3e44ff9700 1 -- 172.21.15.96:0/661564234 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3e3800f460 con 0x7f3e48101310 2024-02-19T18:55:48.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.115+0000 7f3e4dd34700 1 -- 172.21.15.96:0/661564234 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e480ff760 con 0x7f3e48101310 2024-02-19T18:55:48.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.115+0000 7f3e44ff9700 1 -- 172.21.15.96:0/661564234 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45339+0+0 (secure 0 0 0) 0x7f3e3800f6d0 con 0x7f3e48101310 2024-02-19T18:55:48.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.115+0000 7f3e4dd34700 1 -- 172.21.15.96:0/661564234 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e480623c0 con 0x7f3e48101310 2024-02-19T18:55:48.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.116+0000 7f3e44ff9700 1 --2- 172.21.15.96:0/661564234 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f3e300383c0 0x7f3e3003a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:48.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.116+0000 7f3e44ff9700 1 -- 172.21.15.96:0/661564234 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3e3804c4d0 con 0x7f3e48101310 2024-02-19T18:55:48.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.116+0000 7f3e46ffd700 1 --2- 172.21.15.96:0/661564234 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f3e300383c0 0x7f3e3003a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:48.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.116+0000 7f3e46ffd700 1 --2- 172.21.15.96:0/661564234 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f3e300383c0 0x7f3e3003a880 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c006fd0 tx=0x7f3e3c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:48.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.121+0000 7f3e44ff9700 1 -- 172.21.15.96:0/661564234 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f3e3802a360 con 0x7f3e48101310 2024-02-19T18:55:48.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.326+0000 7f3e4dd34700 1 -- 172.21.15.96:0/661564234 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f3e4818f2d0 con 0x7f3e48101310 2024-02-19T18:55:48.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.329+0000 7f3e44ff9700 1 -- 172.21.15.96:0/661564234 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f3e38027030 con 0x7f3e48101310 2024-02-19T18:55:48.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.331+0000 7f3e4dd34700 1 -- 172.21.15.96:0/661564234 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f3e300383c0 msgr2=0x7f3e3003a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:48.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.331+0000 7f3e4dd34700 1 --2- 172.21.15.96:0/661564234 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f3e300383c0 0x7f3e3003a880 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c006fd0 tx=0x7f3e3c006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:48.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.332+0000 7f3e4dd34700 1 -- 172.21.15.96:0/661564234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e48101310 msgr2=0x7f3e48100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:48.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.332+0000 7f3e4dd34700 1 --2- 172.21.15.96:0/661564234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e48101310 0x7f3e48100c70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3e38005b40 tx=0x7f3e38004740 comp rx=0 tx=0).stop 2024-02-19T18:55:48.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.332+0000 7f3e4dd34700 1 -- 172.21.15.96:0/661564234 shutdown_connections 2024-02-19T18:55:48.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.332+0000 7f3e4dd34700 1 --2- 172.21.15.96:0/661564234 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f3e300383c0 0x7f3e3003a880 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:48.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.332+0000 7f3e4dd34700 1 --2- 172.21.15.96:0/661564234 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3e48101310 0x7f3e48100c70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:48.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.332+0000 7f3e4dd34700 1 -- 172.21.15.96:0/661564234 >> 172.21.15.96:0/661564234 conn(0x7f3e480fad20 msgr2=0x7f3e480fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:48.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.332+0000 7f3e4dd34700 1 -- 172.21.15.96:0/661564234 shutdown_connections 2024-02-19T18:55:48.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:48.332+0000 7f3e4dd34700 1 -- 172.21.15.96:0/661564234 wait complete. 2024-02-19T18:55:49.002 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-02-19T18:55:49.002 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-02-19T18:55:49.600 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:49 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/661564234' entity='client.admin' 2024-02-19T18:55:50.102 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T18:55:51.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.974+0000 7f3b6bec7700 1 -- 172.21.15.96:0/897529647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b640fef10 msgr2=0x7f3b640ff330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:51.993 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.974+0000 7f3b6bec7700 1 --2- 172.21.15.96:0/897529647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b640fef10 0x7f3b640ff330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000aa20 tx=0x7f3b6000ad30 comp rx=0 tx=0).stop 2024-02-19T18:55:51.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.974+0000 7f3b6bec7700 1 -- 172.21.15.96:0/897529647 shutdown_connections 2024-02-19T18:55:51.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.974+0000 7f3b6bec7700 1 --2- 172.21.15.96:0/897529647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b640fef10 0x7f3b640ff330 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:51.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.974+0000 7f3b6bec7700 1 -- 172.21.15.96:0/897529647 >> 172.21.15.96:0/897529647 conn(0x7f3b640fa490 msgr2=0x7f3b640fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:51.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.974+0000 7f3b6bec7700 1 -- 172.21.15.96:0/897529647 shutdown_connections 2024-02-19T18:55:51.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.974+0000 7f3b6bec7700 1 -- 172.21.15.96:0/897529647 wait complete. 2024-02-19T18:55:51.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.975+0000 7f3b6bec7700 1 Processor -- start 2024-02-19T18:55:51.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.975+0000 7f3b6bec7700 1 -- start start 2024-02-19T18:55:51.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.975+0000 7f3b6bec7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b640fef10 0x7f3b641937e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:51.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.975+0000 7f3b6bec7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b64193d20 con 0x7f3b640fef10 2024-02-19T18:55:51.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.975+0000 7f3b69c63700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b640fef10 0x7f3b641937e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:51.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.975+0000 7f3b69c63700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b640fef10 0x7f3b641937e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39368/0 (socket says 172.21.15.96:39368) 2024-02-19T18:55:51.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.975+0000 7f3b69c63700 1 -- 172.21.15.96:0/3365960513 learned_addr learned my addr 172.21.15.96:0/3365960513 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:51.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.976+0000 7f3b69c63700 1 -- 172.21.15.96:0/3365960513 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6000a700 con 0x7f3b640fef10 2024-02-19T18:55:51.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.976+0000 7f3b69c63700 1 --2- 172.21.15.96:0/3365960513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b640fef10 0x7f3b641937e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3b60004c20 tx=0x7f3b60004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:51.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.976+0000 7f3b5affd700 1 -- 172.21.15.96:0/3365960513 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b600053f0 con 0x7f3b640fef10 2024-02-19T18:55:51.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.976+0000 7f3b5affd700 1 -- 172.21.15.96:0/3365960513 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3b60005550 con 0x7f3b640fef10 2024-02-19T18:55:51.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.976+0000 7f3b6bec7700 1 -- 172.21.15.96:0/3365960513 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b64193f20 con 0x7f3b640fef10 2024-02-19T18:55:51.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.976+0000 7f3b5affd700 1 -- 172.21.15.96:0/3365960513 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3b6000e760 con 0x7f3b640fef10 2024-02-19T18:55:51.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.976+0000 7f3b6bec7700 1 -- 172.21.15.96:0/3365960513 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b641943c0 con 0x7f3b640fef10 2024-02-19T18:55:51.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.978+0000 7f3b6bec7700 1 -- 172.21.15.96:0/3365960513 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b6418d210 con 0x7f3b640fef10 2024-02-19T18:55:51.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.978+0000 7f3b5affd700 1 -- 172.21.15.96:0/3365960513 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45339+0+0 (secure 0 0 0) 0x7f3b6000e8c0 con 0x7f3b640fef10 2024-02-19T18:55:51.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.978+0000 7f3b5affd700 1 --2- 172.21.15.96:0/3365960513 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f3b50038410 0x7f3b5003a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:51.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.978+0000 7f3b5affd700 1 -- 172.21.15.96:0/3365960513 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3b60012070 con 0x7f3b640fef10 2024-02-19T18:55:51.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.978+0000 7f3b69462700 1 --2- 172.21.15.96:0/3365960513 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f3b50038410 0x7f3b5003a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:51.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.978+0000 7f3b69462700 1 --2- 172.21.15.96:0/3365960513 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f3b50038410 0x7f3b5003a8d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3b54006fd0 tx=0x7f3b54006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:52.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:51.983+0000 7f3b5affd700 1 -- 172.21.15.96:0/3365960513 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f3b600800e0 con 0x7f3b640fef10 2024-02-19T18:55:52.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:52.180+0000 7f3b6bec7700 1 -- 172.21.15.96:0/3365960513 --> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b64061260 con 0x7f3b50038410 2024-02-19T18:55:52.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:52.183+0000 7f3b5affd700 1 -- 172.21.15.96:0/3365960513 <== mgr.14164 v2:172.21.15.96:6800/3628131135 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3b64061260 con 0x7f3b50038410 2024-02-19T18:55:52.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:52.185+0000 7f3b6bec7700 1 -- 172.21.15.96:0/3365960513 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f3b50038410 msgr2=0x7f3b5003a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:52.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:52.185+0000 7f3b6bec7700 1 --2- 172.21.15.96:0/3365960513 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f3b50038410 0x7f3b5003a8d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3b54006fd0 tx=0x7f3b54006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:52.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:52.185+0000 7f3b6bec7700 1 -- 172.21.15.96:0/3365960513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b640fef10 msgr2=0x7f3b641937e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:52.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:52.185+0000 7f3b6bec7700 1 --2- 172.21.15.96:0/3365960513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b640fef10 0x7f3b641937e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3b60004c20 tx=0x7f3b60004f90 comp rx=0 tx=0).stop 2024-02-19T18:55:52.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:52.185+0000 7f3b6bec7700 1 -- 172.21.15.96:0/3365960513 shutdown_connections 2024-02-19T18:55:52.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:52.185+0000 7f3b6bec7700 1 --2- 172.21.15.96:0/3365960513 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f3b50038410 0x7f3b5003a8d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:52.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:52.185+0000 7f3b6bec7700 1 --2- 172.21.15.96:0/3365960513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b640fef10 0x7f3b641937e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:52.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:52.185+0000 7f3b6bec7700 1 -- 172.21.15.96:0/3365960513 >> 172.21.15.96:0/3365960513 conn(0x7f3b640fa490 msgr2=0x7f3b640fb170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:52.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:52.186+0000 7f3b6bec7700 1 -- 172.21.15.96:0/3365960513 shutdown_connections 2024-02-19T18:55:52.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:52.186+0000 7f3b6bec7700 1 -- 172.21.15.96:0/3365960513 wait complete. 2024-02-19T18:55:52.852 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi125 2024-02-19T18:55:52.852 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-02-19T18:55:52.852 DEBUG:teuthology.orchestra.run.smithi125:> dd of=/etc/ceph/ceph.conf 2024-02-19T18:55:52.871 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-02-19T18:55:52.871 DEBUG:teuthology.orchestra.run.smithi125:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-19T18:55:52.929 INFO:tasks.cephadm:Adding host smithi125 to orchestrator... 2024-02-19T18:55:52.929 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph orch host add smithi125 2024-02-19T18:55:53.141 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T18:55:53.263 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:53 smithi096 ceph-mon[29216]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:55:53.263 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:53 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:53.263 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:53 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:53.263 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:53 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:53.263 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:53 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:53.264 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:53 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:53.264 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:53 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi096", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T18:55:53.264 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:53 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi096", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-19T18:55:53.264 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:53 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:55:54.423 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:54 smithi096 ceph-mon[29216]: Deploying daemon crash.smithi096 on smithi096 2024-02-19T18:55:54.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.609+0000 7fd0a4049700 1 -- 172.21.15.96:0/1616216534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd09c101310 msgr2=0x7fd09c103700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:54.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.609+0000 7fd0a4049700 1 --2- 172.21.15.96:0/1616216534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd09c101310 0x7fd09c103700 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009910 tx=0x7fd08c009c20 comp rx=0 tx=0).stop 2024-02-19T18:55:54.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.609+0000 7fd0a4049700 1 -- 172.21.15.96:0/1616216534 shutdown_connections 2024-02-19T18:55:54.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.610+0000 7fd0a4049700 1 --2- 172.21.15.96:0/1616216534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd09c101310 0x7fd09c103700 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:54.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.610+0000 7fd0a4049700 1 -- 172.21.15.96:0/1616216534 >> 172.21.15.96:0/1616216534 conn(0x7fd09c0fad20 msgr2=0x7fd09c0fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:54.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.610+0000 7fd0a4049700 1 -- 172.21.15.96:0/1616216534 shutdown_connections 2024-02-19T18:55:54.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.610+0000 7fd0a4049700 1 -- 172.21.15.96:0/1616216534 wait complete. 2024-02-19T18:55:54.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.610+0000 7fd0a4049700 1 Processor -- start 2024-02-19T18:55:54.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.610+0000 7fd0a4049700 1 -- start start 2024-02-19T18:55:54.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.610+0000 7fd0a4049700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd09c101310 0x7fd09c195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:54.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.610+0000 7fd0a4049700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c195ec0 con 0x7fd09c101310 2024-02-19T18:55:54.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.610+0000 7fd0a1de5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd09c101310 0x7fd09c195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:54.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.610+0000 7fd0a1de5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd09c101310 0x7fd09c195980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53034/0 (socket says 172.21.15.96:53034) 2024-02-19T18:55:54.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.610+0000 7fd0a1de5700 1 -- 172.21.15.96:0/3480582703 learned_addr learned my addr 172.21.15.96:0/3480582703 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:54.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.611+0000 7fd0a1de5700 1 -- 172.21.15.96:0/3480582703 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c0095f0 con 0x7fd09c101310 2024-02-19T18:55:54.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.611+0000 7fd0a1de5700 1 --2- 172.21.15.96:0/3480582703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd09c101310 0x7fd09c195980 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd08c005b40 tx=0x7fd08c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:54.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.611+0000 7fd092ffd700 1 -- 172.21.15.96:0/3480582703 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd08c01d070 con 0x7fd09c101310 2024-02-19T18:55:54.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.611+0000 7fd092ffd700 1 -- 172.21.15.96:0/3480582703 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd08c00be10 con 0x7fd09c101310 2024-02-19T18:55:54.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.611+0000 7fd0a4049700 1 -- 172.21.15.96:0/3480582703 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09c1960c0 con 0x7fd09c101310 2024-02-19T18:55:54.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.611+0000 7fd092ffd700 1 -- 172.21.15.96:0/3480582703 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd08c00f460 con 0x7fd09c101310 2024-02-19T18:55:54.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.611+0000 7fd0a4049700 1 -- 172.21.15.96:0/3480582703 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09c196560 con 0x7fd09c101310 2024-02-19T18:55:54.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.612+0000 7fd092ffd700 1 -- 172.21.15.96:0/3480582703 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45339+0+0 (secure 0 0 0) 0x7fd08c00b960 con 0x7fd09c101310 2024-02-19T18:55:54.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.612+0000 7fd0a4049700 1 -- 172.21.15.96:0/3480582703 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09c18f4a0 con 0x7fd09c101310 2024-02-19T18:55:54.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.612+0000 7fd092ffd700 1 --2- 172.21.15.96:0/3480582703 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fd0880383c0 0x7fd08803a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:54.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.612+0000 7fd092ffd700 1 -- 172.21.15.96:0/3480582703 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd08c04c430 con 0x7fd09c101310 2024-02-19T18:55:54.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.612+0000 7fd0a15e4700 1 --2- 172.21.15.96:0/3480582703 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fd0880383c0 0x7fd08803a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:54.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.613+0000 7fd0a15e4700 1 --2- 172.21.15.96:0/3480582703 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fd0880383c0 0x7fd08803a880 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd098006fd0 tx=0x7fd098006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:54.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.617+0000 7fd092ffd700 1 -- 172.21.15.96:0/3480582703 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd08c02a360 con 0x7fd09c101310 2024-02-19T18:55:54.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:54.820+0000 7fd0a4049700 1 -- 172.21.15.96:0/3480582703 --> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi125", "target": ["mon-mgr", ""]}) v1 -- 0x7fd09c0611d0 con 0x7fd0880383c0 2024-02-19T18:55:56.527 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:56 smithi096 ceph-mon[29216]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi125", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:55:56.527 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:56 smithi096 ceph-mon[29216]: Deploying cephadm binary to smithi125 2024-02-19T18:55:57.449 INFO:teuthology.orchestra.run.smithi096.stdout:Added host 'smithi125' with addr '172.21.15.125' 2024-02-19T18:55:57.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:57.431+0000 7fd092ffd700 1 -- 172.21.15.96:0/3480582703 <== mgr.14164 v2:172.21.15.96:6800/3628131135 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fd09c0611d0 con 0x7fd0880383c0 2024-02-19T18:55:57.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:57.433+0000 7fd0a4049700 1 -- 172.21.15.96:0/3480582703 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fd0880383c0 msgr2=0x7fd08803a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:57.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:57.433+0000 7fd0a4049700 1 --2- 172.21.15.96:0/3480582703 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fd0880383c0 0x7fd08803a880 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd098006fd0 tx=0x7fd098006e40 comp rx=0 tx=0).stop 2024-02-19T18:55:57.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:57.433+0000 7fd0a4049700 1 -- 172.21.15.96:0/3480582703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd09c101310 msgr2=0x7fd09c195980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:57.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:57.433+0000 7fd0a4049700 1 --2- 172.21.15.96:0/3480582703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd09c101310 0x7fd09c195980 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd08c005b40 tx=0x7fd08c004740 comp rx=0 tx=0).stop 2024-02-19T18:55:57.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:57.434+0000 7fd0a4049700 1 -- 172.21.15.96:0/3480582703 shutdown_connections 2024-02-19T18:55:57.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:57.434+0000 7fd0a4049700 1 --2- 172.21.15.96:0/3480582703 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fd0880383c0 0x7fd08803a880 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:57.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:57.434+0000 7fd0a4049700 1 --2- 172.21.15.96:0/3480582703 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd09c101310 0x7fd09c195980 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:57.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:57.434+0000 7fd0a4049700 1 -- 172.21.15.96:0/3480582703 >> 172.21.15.96:0/3480582703 conn(0x7fd09c0fad20 msgr2=0x7fd09c0fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:57.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:57.434+0000 7fd0a4049700 1 -- 172.21.15.96:0/3480582703 shutdown_connections 2024-02-19T18:55:57.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:57.434+0000 7fd0a4049700 1 -- 172.21.15.96:0/3480582703 wait complete. 2024-02-19T18:55:57.605 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:57 smithi096 ceph-mon[29216]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:57.605 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:57 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:57.605 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:57 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:57.605 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:57 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:57.605 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:57 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:57.605 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:57 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:58.065 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph orch host ls --format=json 2024-02-19T18:55:58.280 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T18:55:58.668 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:58 smithi096 ceph-mon[29216]: Deploying daemon node-exporter.smithi096 on smithi096 2024-02-19T18:55:58.668 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:58 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:55:58.668 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:58 smithi096 ceph-mon[29216]: Added host smithi125 2024-02-19T18:55:59.764 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:55:59 smithi096 ceph-mon[29216]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:55:59.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.851+0000 7f1253756700 1 -- 172.21.15.96:0/765481715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f124c0ff100 msgr2=0x7f124c101530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:55:59.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.851+0000 7f1253756700 1 --2- 172.21.15.96:0/765481715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f124c0ff100 0x7f124c101530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1248009910 tx=0x7f1248009c20 comp rx=0 tx=0).stop 2024-02-19T18:55:59.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.851+0000 7f1253756700 1 -- 172.21.15.96:0/765481715 shutdown_connections 2024-02-19T18:55:59.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.851+0000 7f1253756700 1 --2- 172.21.15.96:0/765481715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f124c0ff100 0x7f124c101530 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:55:59.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.851+0000 7f1253756700 1 -- 172.21.15.96:0/765481715 >> 172.21.15.96:0/765481715 conn(0x7f124c0fad20 msgr2=0x7f124c0fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:55:59.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.851+0000 7f1253756700 1 -- 172.21.15.96:0/765481715 shutdown_connections 2024-02-19T18:55:59.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.851+0000 7f1253756700 1 -- 172.21.15.96:0/765481715 wait complete. 2024-02-19T18:55:59.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.852+0000 7f1253756700 1 Processor -- start 2024-02-19T18:55:59.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.852+0000 7f1253756700 1 -- start start 2024-02-19T18:55:59.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.852+0000 7f1253756700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f124c0ff100 0x7f124c19bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:59.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.852+0000 7f1253756700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c19c490 con 0x7f124c0ff100 2024-02-19T18:55:59.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.852+0000 7f12514f2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f124c0ff100 0x7f124c19bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:59.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.852+0000 7f12514f2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f124c0ff100 0x7f124c19bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53058/0 (socket says 172.21.15.96:53058) 2024-02-19T18:55:59.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.852+0000 7f12514f2700 1 -- 172.21.15.96:0/2270560715 learned_addr learned my addr 172.21.15.96:0/2270560715 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:55:59.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.852+0000 7f12514f2700 1 -- 172.21.15.96:0/2270560715 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12480095f0 con 0x7f124c0ff100 2024-02-19T18:55:59.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.852+0000 7f12514f2700 1 --2- 172.21.15.96:0/2270560715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f124c0ff100 0x7f124c19bf50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f12480092e0 tx=0x7f1248009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:59.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.853+0000 7f12427fc700 1 -- 172.21.15.96:0/2270560715 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f124801d070 con 0x7f124c0ff100 2024-02-19T18:55:59.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.853+0000 7f12427fc700 1 -- 172.21.15.96:0/2270560715 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f124800be10 con 0x7f124c0ff100 2024-02-19T18:55:59.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.853+0000 7f1253756700 1 -- 172.21.15.96:0/2270560715 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124c19c690 con 0x7f124c0ff100 2024-02-19T18:55:59.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.853+0000 7f12427fc700 1 -- 172.21.15.96:0/2270560715 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f124800f460 con 0x7f124c0ff100 2024-02-19T18:55:59.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.853+0000 7f1253756700 1 -- 172.21.15.96:0/2270560715 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124c19cb30 con 0x7f124c0ff100 2024-02-19T18:55:59.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.854+0000 7f12427fc700 1 -- 172.21.15.96:0/2270560715 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45339+0+0 (secure 0 0 0) 0x7f124800f6d0 con 0x7f124c0ff100 2024-02-19T18:55:59.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.854+0000 7f12427fc700 1 --2- 172.21.15.96:0/2270560715 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f12380383c0 0x7f123803a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:55:59.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.854+0000 7f12427fc700 1 -- 172.21.15.96:0/2270560715 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f124804c5f0 con 0x7f124c0ff100 2024-02-19T18:55:59.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.854+0000 7f1250cf1700 1 --2- 172.21.15.96:0/2270560715 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f12380383c0 0x7f123803a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:55:59.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.854+0000 7f1253756700 1 -- 172.21.15.96:0/2270560715 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124c1963f0 con 0x7f124c0ff100 2024-02-19T18:55:59.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.854+0000 7f1250cf1700 1 --2- 172.21.15.96:0/2270560715 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f12380383c0 0x7f123803a880 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f123c006fd0 tx=0x7f123c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:55:59.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:55:59.861+0000 7f12427fc700 1 -- 172.21.15.96:0/2270560715 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1248027070 con 0x7f124c0ff100 2024-02-19T18:56:00.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:00.077+0000 7f1253756700 1 -- 172.21.15.96:0/2270560715 --> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f124c0611d0 con 0x7f12380383c0 2024-02-19T18:56:00.096 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:00.079+0000 7f12427fc700 1 -- 172.21.15.96:0/2270560715 <== mgr.14164 v2:172.21.15.96:6800/3628131135 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7f124c0611d0 con 0x7f12380383c0 2024-02-19T18:56:00.097 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T18:56:00.097 INFO:teuthology.orchestra.run.smithi096.stdout:[{"addr": "172.21.15.96", "hostname": "smithi096", "labels": [], "status": ""}, {"addr": "172.21.15.125", "hostname": "smithi125", "labels": [], "status": ""}] 2024-02-19T18:56:00.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:00.081+0000 7f1253756700 1 -- 172.21.15.96:0/2270560715 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f12380383c0 msgr2=0x7f123803a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:00.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:00.081+0000 7f1253756700 1 --2- 172.21.15.96:0/2270560715 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f12380383c0 0x7f123803a880 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f123c006fd0 tx=0x7f123c006e40 comp rx=0 tx=0).stop 2024-02-19T18:56:00.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:00.081+0000 7f1253756700 1 -- 172.21.15.96:0/2270560715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f124c0ff100 msgr2=0x7f124c19bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:00.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:00.081+0000 7f1253756700 1 --2- 172.21.15.96:0/2270560715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f124c0ff100 0x7f124c19bf50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f12480092e0 tx=0x7f1248009e60 comp rx=0 tx=0).stop 2024-02-19T18:56:00.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:00.081+0000 7f1253756700 1 -- 172.21.15.96:0/2270560715 shutdown_connections 2024-02-19T18:56:00.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:00.081+0000 7f1253756700 1 --2- 172.21.15.96:0/2270560715 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f12380383c0 0x7f123803a880 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:00.099 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:00.081+0000 7f1253756700 1 --2- 172.21.15.96:0/2270560715 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f124c0ff100 0x7f124c19bf50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:00.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:00.081+0000 7f1253756700 1 -- 172.21.15.96:0/2270560715 >> 172.21.15.96:0/2270560715 conn(0x7f124c0fad20 msgr2=0x7f124c0fb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:00.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:00.081+0000 7f1253756700 1 -- 172.21.15.96:0/2270560715 shutdown_connections 2024-02-19T18:56:00.100 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:00.081+0000 7f1253756700 1 -- 172.21.15.96:0/2270560715 wait complete. 2024-02-19T18:56:01.051 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-19T18:56:01.052 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph osd crush tunables default 2024-02-19T18:56:01.258 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T18:56:01.667 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:01 smithi096 ceph-mon[29216]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T18:56:01.667 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:01 smithi096 ceph-mon[29216]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:01.667 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:01 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:03.650 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:03 smithi096 ceph-mon[29216]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:03.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.631+0000 7f5e0b75a700 1 -- 172.21.15.96:0/250278799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e040feb50 msgr2=0x7f5e040fef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:03.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.631+0000 7f5e0b75a700 1 --2- 172.21.15.96:0/250278799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e040feb50 0x7f5e040fef70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009910 tx=0x7f5e00009c20 comp rx=0 tx=0).stop 2024-02-19T18:56:03.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.631+0000 7f5e0b75a700 1 -- 172.21.15.96:0/250278799 shutdown_connections 2024-02-19T18:56:03.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.631+0000 7f5e0b75a700 1 --2- 172.21.15.96:0/250278799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e040feb50 0x7f5e040fef70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:03.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.631+0000 7f5e0b75a700 1 -- 172.21.15.96:0/250278799 >> 172.21.15.96:0/250278799 conn(0x7f5e040fa490 msgr2=0x7f5e040fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:03.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.632+0000 7f5e0b75a700 1 -- 172.21.15.96:0/250278799 shutdown_connections 2024-02-19T18:56:03.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.632+0000 7f5e0b75a700 1 -- 172.21.15.96:0/250278799 wait complete. 2024-02-19T18:56:03.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.632+0000 7f5e0b75a700 1 Processor -- start 2024-02-19T18:56:03.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.632+0000 7f5e0b75a700 1 -- start start 2024-02-19T18:56:03.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.632+0000 7f5e0b75a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e040feb50 0x7f5e041959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:03.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.632+0000 7f5e0b75a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e04195ef0 con 0x7f5e040feb50 2024-02-19T18:56:03.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.633+0000 7f5e094f6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e040feb50 0x7f5e041959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:03.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.633+0000 7f5e094f6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e040feb50 0x7f5e041959b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47160/0 (socket says 172.21.15.96:47160) 2024-02-19T18:56:03.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.633+0000 7f5e094f6700 1 -- 172.21.15.96:0/2197625302 learned_addr learned my addr 172.21.15.96:0/2197625302 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:56:03.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.633+0000 7f5e094f6700 1 -- 172.21.15.96:0/2197625302 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e000095f0 con 0x7f5e040feb50 2024-02-19T18:56:03.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.633+0000 7f5e094f6700 1 --2- 172.21.15.96:0/2197625302 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e040feb50 0x7f5e041959b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5e00005b40 tx=0x7f5e00004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:03.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.633+0000 7f5dfa7fc700 1 -- 172.21.15.96:0/2197625302 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5e0001d070 con 0x7f5e040feb50 2024-02-19T18:56:03.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.633+0000 7f5dfa7fc700 1 -- 172.21.15.96:0/2197625302 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5e0000be10 con 0x7f5e040feb50 2024-02-19T18:56:03.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.633+0000 7f5e0b75a700 1 -- 172.21.15.96:0/2197625302 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e041960f0 con 0x7f5e040feb50 2024-02-19T18:56:03.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.633+0000 7f5dfa7fc700 1 -- 172.21.15.96:0/2197625302 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5e0000f460 con 0x7f5e040feb50 2024-02-19T18:56:03.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.633+0000 7f5e0b75a700 1 -- 172.21.15.96:0/2197625302 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e04196590 con 0x7f5e040feb50 2024-02-19T18:56:03.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.634+0000 7f5e0b75a700 1 -- 172.21.15.96:0/2197625302 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0418f4c0 con 0x7f5e040feb50 2024-02-19T18:56:03.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.635+0000 7f5dfa7fc700 1 -- 172.21.15.96:0/2197625302 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45339+0+0 (secure 0 0 0) 0x7f5e000227e0 con 0x7f5e040feb50 2024-02-19T18:56:03.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.635+0000 7f5dfa7fc700 1 --2- 172.21.15.96:0/2197625302 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f5df00383c0 0x7f5df003a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:03.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.635+0000 7f5dfa7fc700 1 -- 172.21.15.96:0/2197625302 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5e0004c960 con 0x7f5e040feb50 2024-02-19T18:56:03.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.635+0000 7f5e08cf5700 1 --2- 172.21.15.96:0/2197625302 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f5df00383c0 0x7f5df003a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:03.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.636+0000 7f5e08cf5700 1 --2- 172.21.15.96:0/2197625302 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f5df00383c0 0x7f5df003a880 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5df4006fd0 tx=0x7f5df4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:03.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.639+0000 7f5dfa7fc700 1 -- 172.21.15.96:0/2197625302 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f5e0002b590 con 0x7f5e040feb50 2024-02-19T18:56:03.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:03.845+0000 7f5e0b75a700 1 -- 172.21.15.96:0/2197625302 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f5e0402cc70 con 0x7f5e040feb50 2024-02-19T18:56:04.538 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:04.520+0000 7f5dfa7fc700 1 -- 172.21.15.96:0/2197625302 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5e00027070 con 0x7f5e040feb50 2024-02-19T18:56:04.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:04.522+0000 7f5e0b75a700 1 -- 172.21.15.96:0/2197625302 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f5df00383c0 msgr2=0x7f5df003a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:04.522+0000 7f5e0b75a700 1 --2- 172.21.15.96:0/2197625302 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f5df00383c0 0x7f5df003a880 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5df4006fd0 tx=0x7f5df4006e40 comp rx=0 tx=0).stop 2024-02-19T18:56:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:04.522+0000 7f5e0b75a700 1 -- 172.21.15.96:0/2197625302 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e040feb50 msgr2=0x7f5e041959b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:04.522+0000 7f5e0b75a700 1 --2- 172.21.15.96:0/2197625302 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e040feb50 0x7f5e041959b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5e00005b40 tx=0x7f5e00004740 comp rx=0 tx=0).stop 2024-02-19T18:56:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:04.522+0000 7f5e0b75a700 1 -- 172.21.15.96:0/2197625302 shutdown_connections 2024-02-19T18:56:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:04.522+0000 7f5e0b75a700 1 --2- 172.21.15.96:0/2197625302 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f5df00383c0 0x7f5df003a880 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:04.522+0000 7f5e0b75a700 1 --2- 172.21.15.96:0/2197625302 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e040feb50 0x7f5e041959b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:04.522+0000 7f5e0b75a700 1 -- 172.21.15.96:0/2197625302 >> 172.21.15.96:0/2197625302 conn(0x7f5e040fa490 msgr2=0x7f5e040fb170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:04.523+0000 7f5e0b75a700 1 -- 172.21.15.96:0/2197625302 shutdown_connections 2024-02-19T18:56:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:56:04.523+0000 7f5e0b75a700 1 -- 172.21.15.96:0/2197625302 wait complete. 2024-02-19T18:56:04.542 INFO:teuthology.orchestra.run.smithi096.stderr:adjusted tunables profile to default 2024-02-19T18:56:04.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:04 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:04.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:04 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:04.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:04 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:04.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:04 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:04.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:04 smithi096 ceph-mon[29216]: Deploying daemon alertmanager.smithi096 on smithi096 2024-02-19T18:56:04.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:04 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/2197625302' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-19T18:56:05.344 INFO:tasks.cephadm:Adding mon.smithi096 on smithi096 2024-02-19T18:56:05.344 INFO:tasks.cephadm:Adding mon.smithi125 on smithi125 2024-02-19T18:56:05.345 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph orch apply mon '2;smithi096:172.21.15.96=smithi096;smithi125:172.21.15.125=smithi125' 2024-02-19T18:56:05.546 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:05.591 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:05.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:05 smithi096 ceph-mon[29216]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:05.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:05 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/2197625302' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-19T18:56:05.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:05 smithi096 ceph-mon[29216]: osdmap e4: 0 total, 0 up, 0 in 2024-02-19T18:56:07.114 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.093+0000 7fb167f50700 1 -- 172.21.15.125:0/1680805024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1601008a0 msgr2=0x7fb160100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:07.114 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.093+0000 7fb167f50700 1 --2- 172.21.15.125:0/1680805024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1601008a0 0x7fb160100cc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb15c009910 tx=0x7fb15c009c20 comp rx=0 tx=0).stop 2024-02-19T18:56:07.114 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.093+0000 7fb167f50700 1 -- 172.21.15.125:0/1680805024 shutdown_connections 2024-02-19T18:56:07.114 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.093+0000 7fb167f50700 1 --2- 172.21.15.125:0/1680805024 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1601008a0 0x7fb160100cc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:07.114 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.093+0000 7fb167f50700 1 -- 172.21.15.125:0/1680805024 >> 172.21.15.125:0/1680805024 conn(0x7fb1600fbe20 msgr2=0x7fb1600fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:07.114 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.093+0000 7fb167f50700 1 -- 172.21.15.125:0/1680805024 shutdown_connections 2024-02-19T18:56:07.114 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.093+0000 7fb167f50700 1 -- 172.21.15.125:0/1680805024 wait complete. 2024-02-19T18:56:07.115 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.094+0000 7fb167f50700 1 Processor -- start 2024-02-19T18:56:07.115 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.094+0000 7fb167f50700 1 -- start start 2024-02-19T18:56:07.115 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.094+0000 7fb167f50700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1601008a0 0x7fb1601959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:07.115 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.094+0000 7fb167f50700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb160195ee0 con 0x7fb1601008a0 2024-02-19T18:56:07.115 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.094+0000 7fb165cec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1601008a0 0x7fb1601959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:07.115 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.094+0000 7fb165cec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1601008a0 0x7fb1601959a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.125:50656/0 (socket says 172.21.15.125:50656) 2024-02-19T18:56:07.115 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.094+0000 7fb165cec700 1 -- 172.21.15.125:0/2566972927 learned_addr learned my addr 172.21.15.125:0/2566972927 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:56:07.115 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.094+0000 7fb165cec700 1 -- 172.21.15.125:0/2566972927 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb15c0095f0 con 0x7fb1601008a0 2024-02-19T18:56:07.116 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.094+0000 7fb165cec700 1 --2- 172.21.15.125:0/2566972927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1601008a0 0x7fb1601959a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb15c005b40 tx=0x7fb15c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:07.116 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.094+0000 7fb156ffd700 1 -- 172.21.15.125:0/2566972927 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb15c01d070 con 0x7fb1601008a0 2024-02-19T18:56:07.116 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.095+0000 7fb156ffd700 1 -- 172.21.15.125:0/2566972927 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb15c00be10 con 0x7fb1601008a0 2024-02-19T18:56:07.116 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.095+0000 7fb167f50700 1 -- 172.21.15.125:0/2566972927 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1601960e0 con 0x7fb1601008a0 2024-02-19T18:56:07.116 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.095+0000 7fb156ffd700 1 -- 172.21.15.125:0/2566972927 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb15c00f460 con 0x7fb1601008a0 2024-02-19T18:56:07.116 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.095+0000 7fb167f50700 1 -- 172.21.15.125:0/2566972927 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb160196580 con 0x7fb1601008a0 2024-02-19T18:56:07.116 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.095+0000 7fb156ffd700 1 -- 172.21.15.125:0/2566972927 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45339+0+0 (secure 0 0 0) 0x7fb15c00f6d0 con 0x7fb1601008a0 2024-02-19T18:56:07.116 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.095+0000 7fb167f50700 1 -- 172.21.15.125:0/2566972927 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb16018f4c0 con 0x7fb1601008a0 2024-02-19T18:56:07.116 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.096+0000 7fb156ffd700 1 --2- 172.21.15.125:0/2566972927 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fb14c0383c0 0x7fb14c03a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:07.116 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.096+0000 7fb156ffd700 1 -- 172.21.15.125:0/2566972927 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb15c04c490 con 0x7fb1601008a0 2024-02-19T18:56:07.117 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.096+0000 7fb1654eb700 1 --2- 172.21.15.125:0/2566972927 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fb14c0383c0 0x7fb14c03a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:07.117 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.096+0000 7fb1654eb700 1 --2- 172.21.15.125:0/2566972927 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fb14c0383c0 0x7fb14c03a880 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb150006fd0 tx=0x7fb150006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:07.118 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.101+0000 7fb156ffd700 1 -- 172.21.15.125:0/2566972927 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fb15c02a360 con 0x7fb1601008a0 2024-02-19T18:56:07.315 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.298+0000 7fb167f50700 1 -- 172.21.15.125:0/2566972927 --> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi096:172.21.15.96=smithi096;smithi125:172.21.15.125=smithi125", "target": ["mon-mgr", ""]}) v1 -- 0x7fb160061340 con 0x7fb14c0383c0 2024-02-19T18:56:07.320 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.304+0000 7fb156ffd700 1 -- 172.21.15.125:0/2566972927 <== mgr.14164 v2:172.21.15.96:6800/3628131135 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fb160061340 con 0x7fb14c0383c0 2024-02-19T18:56:07.321 INFO:teuthology.orchestra.run.smithi125.stdout:Scheduled mon update... 2024-02-19T18:56:07.322 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.305+0000 7fb167f50700 1 -- 172.21.15.125:0/2566972927 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fb14c0383c0 msgr2=0x7fb14c03a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:07.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.305+0000 7fb167f50700 1 --2- 172.21.15.125:0/2566972927 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fb14c0383c0 0x7fb14c03a880 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb150006fd0 tx=0x7fb150006e40 comp rx=0 tx=0).stop 2024-02-19T18:56:07.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.305+0000 7fb167f50700 1 -- 172.21.15.125:0/2566972927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1601008a0 msgr2=0x7fb1601959a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:07.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.305+0000 7fb167f50700 1 --2- 172.21.15.125:0/2566972927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1601008a0 0x7fb1601959a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb15c005b40 tx=0x7fb15c004740 comp rx=0 tx=0).stop 2024-02-19T18:56:07.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.306+0000 7fb167f50700 1 -- 172.21.15.125:0/2566972927 shutdown_connections 2024-02-19T18:56:07.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.306+0000 7fb167f50700 1 --2- 172.21.15.125:0/2566972927 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fb14c0383c0 0x7fb14c03a880 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:07.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.306+0000 7fb167f50700 1 --2- 172.21.15.125:0/2566972927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1601008a0 0x7fb1601959a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:07.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.306+0000 7fb167f50700 1 -- 172.21.15.125:0/2566972927 >> 172.21.15.125:0/2566972927 conn(0x7fb1600fbe20 msgr2=0x7fb1600fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:07.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.306+0000 7fb167f50700 1 -- 172.21.15.125:0/2566972927 shutdown_connections 2024-02-19T18:56:07.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:07.306+0000 7fb167f50700 1 -- 172.21.15.125:0/2566972927 wait complete. 2024-02-19T18:56:07.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:07 smithi096 ceph-mon[29216]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:07.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:07 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:07.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:07 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:07.917 DEBUG:teuthology.orchestra.run.smithi125:mon.smithi125> sudo journalctl -f -n 0 -u ceph-06580d2c-cf58-11ee-95bb-87774f69a715@mon.smithi125.service 2024-02-19T18:56:07.919 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:56:07.920 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:56:08.154 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:08.200 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:08.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:08 smithi096 ceph-mon[29216]: from='client.14197 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi096:172.21.15.96=smithi096;smithi125:172.21.15.125=smithi125", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:56:08.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:08 smithi096 ceph-mon[29216]: Saving service mon spec with placement smithi096:172.21.15.96=smithi096;smithi125:172.21.15.125=smithi125;count:2 2024-02-19T18:56:09.703 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.686+0000 7fc12643b700 1 -- 172.21.15.125:0/4162786522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1200ff780 msgr2=0x7fc1200ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:09.703 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.686+0000 7fc12643b700 1 --2- 172.21.15.125:0/4162786522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1200ff780 0x7fc1200ffba0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc114009910 tx=0x7fc114009c20 comp rx=0 tx=0).stop 2024-02-19T18:56:09.703 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.686+0000 7fc12643b700 1 -- 172.21.15.125:0/4162786522 shutdown_connections 2024-02-19T18:56:09.703 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.686+0000 7fc12643b700 1 --2- 172.21.15.125:0/4162786522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1200ff780 0x7fc1200ffba0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:09.703 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.686+0000 7fc12643b700 1 -- 172.21.15.125:0/4162786522 >> 172.21.15.125:0/4162786522 conn(0x7fc1200fad20 msgr2=0x7fc1200fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:09.704 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.686+0000 7fc12643b700 1 -- 172.21.15.125:0/4162786522 shutdown_connections 2024-02-19T18:56:09.704 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.686+0000 7fc12643b700 1 -- 172.21.15.125:0/4162786522 wait complete. 2024-02-19T18:56:09.706 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.687+0000 7fc12643b700 1 Processor -- start 2024-02-19T18:56:09.706 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.687+0000 7fc12643b700 1 -- start start 2024-02-19T18:56:09.706 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.687+0000 7fc12643b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1200ff780 0x7fc1200fccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:09.706 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.687+0000 7fc12643b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1200fd200 con 0x7fc1200ff780 2024-02-19T18:56:09.706 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.687+0000 7fc11ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1200ff780 0x7fc1200fccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:09.706 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.687+0000 7fc11ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1200ff780 0x7fc1200fccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.125:50684/0 (socket says 172.21.15.125:50684) 2024-02-19T18:56:09.706 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.687+0000 7fc11ffff700 1 -- 172.21.15.125:0/863530189 learned_addr learned my addr 172.21.15.125:0/863530189 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:56:09.706 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.688+0000 7fc11ffff700 1 -- 172.21.15.125:0/863530189 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1140095f0 con 0x7fc1200ff780 2024-02-19T18:56:09.707 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.688+0000 7fc11ffff700 1 --2- 172.21.15.125:0/863530189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1200ff780 0x7fc1200fccc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc114005b40 tx=0x7fc114004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:09.707 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.688+0000 7fc11d7fa700 1 -- 172.21.15.125:0/863530189 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc11401d070 con 0x7fc1200ff780 2024-02-19T18:56:09.707 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.688+0000 7fc11d7fa700 1 -- 172.21.15.125:0/863530189 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc11400be10 con 0x7fc1200ff780 2024-02-19T18:56:09.707 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.688+0000 7fc12643b700 1 -- 172.21.15.125:0/863530189 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1200fb310 con 0x7fc1200ff780 2024-02-19T18:56:09.707 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.688+0000 7fc11d7fa700 1 -- 172.21.15.125:0/863530189 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc11400f460 con 0x7fc1200ff780 2024-02-19T18:56:09.707 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.688+0000 7fc12643b700 1 -- 172.21.15.125:0/863530189 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1200fb7b0 con 0x7fc1200ff780 2024-02-19T18:56:09.707 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.689+0000 7fc12643b700 1 -- 172.21.15.125:0/863530189 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1200623c0 con 0x7fc1200ff780 2024-02-19T18:56:09.707 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.689+0000 7fc11d7fa700 1 -- 172.21.15.125:0/863530189 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45339+0+0 (secure 0 0 0) 0x7fc1140227e0 con 0x7fc1200ff780 2024-02-19T18:56:09.707 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.689+0000 7fc11d7fa700 1 --2- 172.21.15.125:0/863530189 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fc1080383c0 0x7fc10803a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:09.707 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.689+0000 7fc11d7fa700 1 -- 172.21.15.125:0/863530189 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc11404c560 con 0x7fc1200ff780 2024-02-19T18:56:09.707 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.689+0000 7fc11f7fe700 1 --2- 172.21.15.125:0/863530189 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fc1080383c0 0x7fc10803a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:09.708 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.690+0000 7fc11f7fe700 1 --2- 172.21.15.125:0/863530189 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fc1080383c0 0x7fc10803a880 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc110006fd0 tx=0x7fc110006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:09.710 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.694+0000 7fc11d7fa700 1 -- 172.21.15.125:0/863530189 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc11402bba0 con 0x7fc1200ff780 2024-02-19T18:56:09.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:09 smithi096 ceph-mon[29216]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:09.970 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.953+0000 7fc12643b700 1 -- 172.21.15.125:0/863530189 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc12018ed90 con 0x7fc1200ff780 2024-02-19T18:56:09.971 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.954+0000 7fc11d7fa700 1 -- 172.21.15.125:0/863530189 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fc114027020 con 0x7fc1200ff780 2024-02-19T18:56:09.971 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:56:09.971 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":1,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","modified":"2024-02-19T18:54:24.798664Z","created":"2024-02-19T18:54:24.798664Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:56:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.956+0000 7fc12643b700 1 -- 172.21.15.125:0/863530189 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fc1080383c0 msgr2=0x7fc10803a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.956+0000 7fc12643b700 1 --2- 172.21.15.125:0/863530189 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fc1080383c0 0x7fc10803a880 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc110006fd0 tx=0x7fc110006e40 comp rx=0 tx=0).stop 2024-02-19T18:56:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.956+0000 7fc12643b700 1 -- 172.21.15.125:0/863530189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1200ff780 msgr2=0x7fc1200fccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.956+0000 7fc12643b700 1 --2- 172.21.15.125:0/863530189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1200ff780 0x7fc1200fccc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc114005b40 tx=0x7fc114004740 comp rx=0 tx=0).stop 2024-02-19T18:56:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.956+0000 7fc12643b700 1 -- 172.21.15.125:0/863530189 shutdown_connections 2024-02-19T18:56:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.956+0000 7fc12643b700 1 --2- 172.21.15.125:0/863530189 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fc1080383c0 0x7fc10803a880 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.956+0000 7fc12643b700 1 --2- 172.21.15.125:0/863530189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1200ff780 0x7fc1200fccc0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.956+0000 7fc12643b700 1 -- 172.21.15.125:0/863530189 >> 172.21.15.125:0/863530189 conn(0x7fc1200fad20 msgr2=0x7fc120068820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.956+0000 7fc12643b700 1 -- 172.21.15.125:0/863530189 shutdown_connections 2024-02-19T18:56:09.973 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:09.956+0000 7fc12643b700 1 -- 172.21.15.125:0/863530189 wait complete. 2024-02-19T18:56:09.974 INFO:teuthology.orchestra.run.smithi125.stderr:dumped monmap epoch 1 2024-02-19T18:56:10.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:10 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/863530189' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:56:11.596 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:56:11.597 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:56:11.647 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:11 smithi096 ceph-mon[29216]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:11.792 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:11.838 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:13.274 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.256+0000 7f82e6aa7700 1 -- 172.21.15.125:0/407217237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e01013b0 msgr2=0x7f82e01037a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:13.274 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.256+0000 7f82e6aa7700 1 --2- 172.21.15.125:0/407217237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e01013b0 0x7f82e01037a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009910 tx=0x7f82d0009c20 comp rx=0 tx=0).stop 2024-02-19T18:56:13.274 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.256+0000 7f82e6aa7700 1 -- 172.21.15.125:0/407217237 shutdown_connections 2024-02-19T18:56:13.274 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.256+0000 7f82e6aa7700 1 --2- 172.21.15.125:0/407217237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e01013b0 0x7f82e01037a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:13.274 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.256+0000 7f82e6aa7700 1 -- 172.21.15.125:0/407217237 >> 172.21.15.125:0/407217237 conn(0x7f82e00fad20 msgr2=0x7f82e00fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:13.274 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.256+0000 7f82e6aa7700 1 -- 172.21.15.125:0/407217237 shutdown_connections 2024-02-19T18:56:13.274 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.256+0000 7f82e6aa7700 1 -- 172.21.15.125:0/407217237 wait complete. 2024-02-19T18:56:13.274 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.257+0000 7f82e6aa7700 1 Processor -- start 2024-02-19T18:56:13.274 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.257+0000 7f82e6aa7700 1 -- start start 2024-02-19T18:56:13.274 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.257+0000 7f82e6aa7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e01013b0 0x7f82e0197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:13.275 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.257+0000 7f82e6aa7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e01980c0 con 0x7f82e01013b0 2024-02-19T18:56:13.275 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.257+0000 7f82e4843700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e01013b0 0x7f82e0197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:13.275 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.257+0000 7f82e4843700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e01013b0 0x7f82e0197b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.125:50704/0 (socket says 172.21.15.125:50704) 2024-02-19T18:56:13.275 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.257+0000 7f82e4843700 1 -- 172.21.15.125:0/2266766842 learned_addr learned my addr 172.21.15.125:0/2266766842 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:56:13.275 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.257+0000 7f82e4843700 1 -- 172.21.15.125:0/2266766842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d00095f0 con 0x7f82e01013b0 2024-02-19T18:56:13.276 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.257+0000 7f82e4843700 1 --2- 172.21.15.125:0/2266766842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e01013b0 0x7f82e0197b80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f82d0005b40 tx=0x7f82d0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:13.276 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.258+0000 7f82ddffb700 1 -- 172.21.15.125:0/2266766842 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82d001d070 con 0x7f82e01013b0 2024-02-19T18:56:13.276 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.258+0000 7f82ddffb700 1 -- 172.21.15.125:0/2266766842 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f82d000be10 con 0x7f82e01013b0 2024-02-19T18:56:13.276 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.258+0000 7f82e6aa7700 1 -- 172.21.15.125:0/2266766842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e01982c0 con 0x7f82e01013b0 2024-02-19T18:56:13.276 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.258+0000 7f82ddffb700 1 -- 172.21.15.125:0/2266766842 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f82d000f460 con 0x7f82e01013b0 2024-02-19T18:56:13.277 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.258+0000 7f82e6aa7700 1 -- 172.21.15.125:0/2266766842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e0198760 con 0x7f82e01013b0 2024-02-19T18:56:13.277 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.259+0000 7f82ddffb700 1 -- 172.21.15.125:0/2266766842 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45339+0+0 (secure 0 0 0) 0x7f82d000f6d0 con 0x7f82e01013b0 2024-02-19T18:56:13.277 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.259+0000 7f82ddffb700 1 --2- 172.21.15.125:0/2266766842 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f82c80383c0 0x7f82c803a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:13.277 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.259+0000 7f82e6aa7700 1 -- 172.21.15.125:0/2266766842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e01918a0 con 0x7f82e01013b0 2024-02-19T18:56:13.277 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.259+0000 7f82ddffb700 1 -- 172.21.15.125:0/2266766842 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f82d004c520 con 0x7f82e01013b0 2024-02-19T18:56:13.277 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.259+0000 7f82dffff700 1 --2- 172.21.15.125:0/2266766842 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f82c80383c0 0x7f82c803a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:13.277 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.259+0000 7f82dffff700 1 --2- 172.21.15.125:0/2266766842 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f82c80383c0 0x7f82c803a880 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f82d4006fd0 tx=0x7f82d4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:13.280 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.264+0000 7f82ddffb700 1 -- 172.21.15.125:0/2266766842 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f82d0027070 con 0x7f82e01013b0 2024-02-19T18:56:13.547 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.530+0000 7f82e6aa7700 1 -- 172.21.15.125:0/2266766842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f82e002cc70 con 0x7f82e01013b0 2024-02-19T18:56:13.547 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.530+0000 7f82ddffb700 1 -- 172.21.15.125:0/2266766842 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f82d002c440 con 0x7f82e01013b0 2024-02-19T18:56:13.547 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:56:13.548 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":1,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","modified":"2024-02-19T18:54:24.798664Z","created":"2024-02-19T18:54:24.798664Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:56:13.549 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.532+0000 7f82e6aa7700 1 -- 172.21.15.125:0/2266766842 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f82c80383c0 msgr2=0x7f82c803a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:13.549 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.532+0000 7f82e6aa7700 1 --2- 172.21.15.125:0/2266766842 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f82c80383c0 0x7f82c803a880 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f82d4006fd0 tx=0x7f82d4006e40 comp rx=0 tx=0).stop 2024-02-19T18:56:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.532+0000 7f82e6aa7700 1 -- 172.21.15.125:0/2266766842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e01013b0 msgr2=0x7f82e0197b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.532+0000 7f82e6aa7700 1 --2- 172.21.15.125:0/2266766842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e01013b0 0x7f82e0197b80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f82d0005b40 tx=0x7f82d0004740 comp rx=0 tx=0).stop 2024-02-19T18:56:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.532+0000 7f82e6aa7700 1 -- 172.21.15.125:0/2266766842 shutdown_connections 2024-02-19T18:56:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.532+0000 7f82e6aa7700 1 --2- 172.21.15.125:0/2266766842 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f82c80383c0 0x7f82c803a880 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.532+0000 7f82e6aa7700 1 --2- 172.21.15.125:0/2266766842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e01013b0 0x7f82e0197b80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.532+0000 7f82e6aa7700 1 -- 172.21.15.125:0/2266766842 >> 172.21.15.125:0/2266766842 conn(0x7f82e00fad20 msgr2=0x7f82e00fb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.533+0000 7f82e6aa7700 1 -- 172.21.15.125:0/2266766842 shutdown_connections 2024-02-19T18:56:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:13.533+0000 7f82e6aa7700 1 -- 172.21.15.125:0/2266766842 wait complete. 2024-02-19T18:56:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:dumped monmap epoch 1 2024-02-19T18:56:13.612 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:13 smithi096 ceph-mon[29216]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:14.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:14 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/2266766842' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:56:14.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:14 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:14.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:14 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:14.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:14 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:14.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:14 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:14.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:14 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:14.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:14 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:14.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:14 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:14.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:14 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:14.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:14 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-19T18:56:14.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:14 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:15.131 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:56:15.132 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:56:15.331 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:15.377 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:15.727 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:15 smithi096 ceph-mon[29216]: Regenerating cephadm self-signed grafana TLS certificates 2024-02-19T18:56:15.727 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:15 smithi096 ceph-mon[29216]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-19T18:56:15.728 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:15 smithi096 ceph-mon[29216]: Deploying daemon grafana.smithi096 on smithi096 2024-02-19T18:56:15.728 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:15 smithi096 ceph-mon[29216]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:16.871 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.853+0000 7ff314165700 1 -- 172.21.15.125:0/3879137296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff30c074d40 msgr2=0x7ff30c0731a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:16.871 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.853+0000 7ff314165700 1 --2- 172.21.15.125:0/3879137296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff30c074d40 0x7ff30c0731a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff308009910 tx=0x7ff308009c20 comp rx=0 tx=0).stop 2024-02-19T18:56:16.871 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.853+0000 7ff314165700 1 -- 172.21.15.125:0/3879137296 shutdown_connections 2024-02-19T18:56:16.871 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.853+0000 7ff314165700 1 --2- 172.21.15.125:0/3879137296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff30c074d40 0x7ff30c0731a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:16.871 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.853+0000 7ff314165700 1 -- 172.21.15.125:0/3879137296 >> 172.21.15.125:0/3879137296 conn(0x7ff30c0fbe20 msgr2=0x7ff30c0fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:16.871 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.853+0000 7ff314165700 1 -- 172.21.15.125:0/3879137296 shutdown_connections 2024-02-19T18:56:16.871 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.853+0000 7ff314165700 1 -- 172.21.15.125:0/3879137296 wait complete. 2024-02-19T18:56:16.871 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.854+0000 7ff314165700 1 Processor -- start 2024-02-19T18:56:16.871 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.854+0000 7ff314165700 1 -- start start 2024-02-19T18:56:16.871 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.854+0000 7ff314165700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff30c074d40 0x7ff30c197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:16.872 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.854+0000 7ff314165700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30c198100 con 0x7ff30c074d40 2024-02-19T18:56:16.873 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.854+0000 7ff311f01700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff30c074d40 0x7ff30c197bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:16.873 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.854+0000 7ff311f01700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff30c074d40 0x7ff30c197bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.125:41306/0 (socket says 172.21.15.125:41306) 2024-02-19T18:56:16.873 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.854+0000 7ff311f01700 1 -- 172.21.15.125:0/677716019 learned_addr learned my addr 172.21.15.125:0/677716019 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:56:16.874 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.855+0000 7ff311f01700 1 -- 172.21.15.125:0/677716019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3080095f0 con 0x7ff30c074d40 2024-02-19T18:56:16.874 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.855+0000 7ff311f01700 1 --2- 172.21.15.125:0/677716019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff30c074d40 0x7ff30c197bc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff308005b40 tx=0x7ff308004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:16.874 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.855+0000 7ff302ffd700 1 -- 172.21.15.125:0/677716019 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff30801d070 con 0x7ff30c074d40 2024-02-19T18:56:16.874 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.855+0000 7ff314165700 1 -- 172.21.15.125:0/677716019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff30c198300 con 0x7ff30c074d40 2024-02-19T18:56:16.874 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.855+0000 7ff302ffd700 1 -- 172.21.15.125:0/677716019 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff30800be10 con 0x7ff30c074d40 2024-02-19T18:56:16.874 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.855+0000 7ff302ffd700 1 -- 172.21.15.125:0/677716019 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff30800f460 con 0x7ff30c074d40 2024-02-19T18:56:16.874 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.855+0000 7ff314165700 1 -- 172.21.15.125:0/677716019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff30c1987a0 con 0x7ff30c074d40 2024-02-19T18:56:16.874 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.856+0000 7ff314165700 1 -- 172.21.15.125:0/677716019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff30c1916c0 con 0x7ff30c074d40 2024-02-19T18:56:16.874 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.856+0000 7ff302ffd700 1 -- 172.21.15.125:0/677716019 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45339+0+0 (secure 0 0 0) 0x7ff3080227e0 con 0x7ff30c074d40 2024-02-19T18:56:16.874 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.856+0000 7ff302ffd700 1 --2- 172.21.15.125:0/677716019 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7ff2f80383c0 0x7ff2f803a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:16.874 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.856+0000 7ff302ffd700 1 -- 172.21.15.125:0/677716019 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff30804c4c0 con 0x7ff30c074d40 2024-02-19T18:56:16.874 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.857+0000 7ff311700700 1 --2- 172.21.15.125:0/677716019 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7ff2f80383c0 0x7ff2f803a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:16.875 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.857+0000 7ff311700700 1 --2- 172.21.15.125:0/677716019 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7ff2f80383c0 0x7ff2f803a880 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc006fd0 tx=0x7ff2fc006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:16.879 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:16.862+0000 7ff302ffd700 1 -- 172.21.15.125:0/677716019 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff30802bba0 con 0x7ff30c074d40 2024-02-19T18:56:17.142 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:17.125+0000 7ff314165700 1 -- 172.21.15.125:0/677716019 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff30c02cc70 con 0x7ff30c074d40 2024-02-19T18:56:17.143 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:17.126+0000 7ff302ffd700 1 -- 172.21.15.125:0/677716019 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7ff308027020 con 0x7ff30c074d40 2024-02-19T18:56:17.143 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:56:17.143 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":1,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","modified":"2024-02-19T18:54:24.798664Z","created":"2024-02-19T18:54:24.798664Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:56:17.145 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:17.128+0000 7ff314165700 1 -- 172.21.15.125:0/677716019 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7ff2f80383c0 msgr2=0x7ff2f803a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:17.145 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:17.128+0000 7ff314165700 1 --2- 172.21.15.125:0/677716019 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7ff2f80383c0 0x7ff2f803a880 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc006fd0 tx=0x7ff2fc006e40 comp rx=0 tx=0).stop 2024-02-19T18:56:17.145 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:17.128+0000 7ff314165700 1 -- 172.21.15.125:0/677716019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff30c074d40 msgr2=0x7ff30c197bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:17.145 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:17.128+0000 7ff314165700 1 --2- 172.21.15.125:0/677716019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff30c074d40 0x7ff30c197bc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff308005b40 tx=0x7ff308004740 comp rx=0 tx=0).stop 2024-02-19T18:56:17.145 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:17.128+0000 7ff314165700 1 -- 172.21.15.125:0/677716019 shutdown_connections 2024-02-19T18:56:17.145 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:17.128+0000 7ff314165700 1 --2- 172.21.15.125:0/677716019 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7ff2f80383c0 0x7ff2f803a880 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:17.145 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:17.128+0000 7ff314165700 1 --2- 172.21.15.125:0/677716019 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff30c074d40 0x7ff30c197bc0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:17.145 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:17.128+0000 7ff314165700 1 -- 172.21.15.125:0/677716019 >> 172.21.15.125:0/677716019 conn(0x7ff30c0fbe20 msgr2=0x7ff30c0fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:17.145 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:17.128+0000 7ff314165700 1 -- 172.21.15.125:0/677716019 shutdown_connections 2024-02-19T18:56:17.145 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:17.128+0000 7ff314165700 1 -- 172.21.15.125:0/677716019 wait complete. 2024-02-19T18:56:17.146 INFO:teuthology.orchestra.run.smithi125.stderr:dumped monmap epoch 1 2024-02-19T18:56:17.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:17 smithi096 ceph-mon[29216]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:17.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:17 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:17.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:17 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/677716019' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:56:18.721 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:56:18.721 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:56:18.930 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:18.976 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:19.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:19 smithi096 ceph-mon[29216]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:20.322 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.296+0000 7f8a994a4700 1 -- 172.21.15.125:0/206460526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a94101310 msgr2=0x7f8a94103700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:20.322 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.296+0000 7f8a994a4700 1 --2- 172.21.15.125:0/206460526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a94101310 0x7f8a94103700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8a8400b0a0 tx=0x7f8a8400b3b0 comp rx=0 tx=0).stop 2024-02-19T18:56:20.322 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.296+0000 7f8a994a4700 1 -- 172.21.15.125:0/206460526 shutdown_connections 2024-02-19T18:56:20.322 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.296+0000 7f8a994a4700 1 --2- 172.21.15.125:0/206460526 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a94101310 0x7f8a94103700 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:20.322 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.296+0000 7f8a994a4700 1 -- 172.21.15.125:0/206460526 >> 172.21.15.125:0/206460526 conn(0x7f8a940fad20 msgr2=0x7f8a940fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:20.322 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.296+0000 7f8a994a4700 1 -- 172.21.15.125:0/206460526 shutdown_connections 2024-02-19T18:56:20.322 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.296+0000 7f8a994a4700 1 -- 172.21.15.125:0/206460526 wait complete. 2024-02-19T18:56:20.322 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.296+0000 7f8a994a4700 1 Processor -- start 2024-02-19T18:56:20.322 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.297+0000 7f8a994a4700 1 -- start start 2024-02-19T18:56:20.322 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.297+0000 7f8a994a4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a94101310 0x7f8a94195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:20.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.297+0000 7f8a994a4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a94195e50 con 0x7f8a94101310 2024-02-19T18:56:20.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.297+0000 7f8a92ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a94101310 0x7f8a94195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:20.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.297+0000 7f8a92ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a94101310 0x7f8a94195910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.125:41330/0 (socket says 172.21.15.125:41330) 2024-02-19T18:56:20.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.297+0000 7f8a92ffd700 1 -- 172.21.15.125:0/2741860314 learned_addr learned my addr 172.21.15.125:0/2741860314 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:56:20.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.297+0000 7f8a92ffd700 1 -- 172.21.15.125:0/2741860314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a84009d00 con 0x7f8a94101310 2024-02-19T18:56:20.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.297+0000 7f8a92ffd700 1 --2- 172.21.15.125:0/2741860314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a94101310 0x7f8a94195910 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8a84015040 tx=0x7f8a8400bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:20.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.298+0000 7f8a8bfff700 1 -- 172.21.15.125:0/2741860314 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a8400e040 con 0x7f8a94101310 2024-02-19T18:56:20.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.298+0000 7f8a8bfff700 1 -- 172.21.15.125:0/2741860314 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8a8401d930 con 0x7f8a94101310 2024-02-19T18:56:20.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.298+0000 7f8a994a4700 1 -- 172.21.15.125:0/2741860314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a94196050 con 0x7f8a94101310 2024-02-19T18:56:20.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.298+0000 7f8a8bfff700 1 -- 172.21.15.125:0/2741860314 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8a840129d0 con 0x7f8a94101310 2024-02-19T18:56:20.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.298+0000 7f8a994a4700 1 -- 172.21.15.125:0/2741860314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a94196470 con 0x7f8a94101310 2024-02-19T18:56:20.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.298+0000 7f8a8bfff700 1 -- 172.21.15.125:0/2741860314 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45339+0+0 (secure 0 0 0) 0x7f8a84012c90 con 0x7f8a94101310 2024-02-19T18:56:20.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.299+0000 7f8a994a4700 1 -- 172.21.15.125:0/2741860314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a9418f4a0 con 0x7f8a94101310 2024-02-19T18:56:20.323 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.299+0000 7f8a8bfff700 1 --2- 172.21.15.125:0/2741860314 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f8a800383c0 0x7f8a8003a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:20.324 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.299+0000 7f8a8bfff700 1 -- 172.21.15.125:0/2741860314 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8a8404c930 con 0x7f8a94101310 2024-02-19T18:56:20.324 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.299+0000 7f8a927fc700 1 --2- 172.21.15.125:0/2741860314 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f8a800383c0 0x7f8a8003a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:20.324 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.299+0000 7f8a927fc700 1 --2- 172.21.15.125:0/2741860314 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f8a800383c0 0x7f8a8003a880 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c006fd0 tx=0x7f8a7c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:20.324 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.303+0000 7f8a8bfff700 1 -- 172.21.15.125:0/2741860314 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f8a8401c5c0 con 0x7f8a94101310 2024-02-19T18:56:20.586 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.569+0000 7f8a994a4700 1 -- 172.21.15.125:0/2741860314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8a940623c0 con 0x7f8a94101310 2024-02-19T18:56:20.586 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.569+0000 7f8a8bfff700 1 -- 172.21.15.125:0/2741860314 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f8a8401c3e0 con 0x7f8a94101310 2024-02-19T18:56:20.586 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:56:20.586 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":1,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","modified":"2024-02-19T18:54:24.798664Z","created":"2024-02-19T18:54:24.798664Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:56:20.588 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.571+0000 7f8a994a4700 1 -- 172.21.15.125:0/2741860314 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f8a800383c0 msgr2=0x7f8a8003a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:20.588 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.571+0000 7f8a994a4700 1 --2- 172.21.15.125:0/2741860314 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f8a800383c0 0x7f8a8003a880 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c006fd0 tx=0x7f8a7c006e40 comp rx=0 tx=0).stop 2024-02-19T18:56:20.589 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.571+0000 7f8a994a4700 1 -- 172.21.15.125:0/2741860314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a94101310 msgr2=0x7f8a94195910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:20.589 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.571+0000 7f8a994a4700 1 --2- 172.21.15.125:0/2741860314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a94101310 0x7f8a94195910 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8a84015040 tx=0x7f8a8400bb10 comp rx=0 tx=0).stop 2024-02-19T18:56:20.589 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.571+0000 7f8a994a4700 1 -- 172.21.15.125:0/2741860314 shutdown_connections 2024-02-19T18:56:20.589 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.571+0000 7f8a994a4700 1 --2- 172.21.15.125:0/2741860314 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f8a800383c0 0x7f8a8003a880 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:20.589 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.571+0000 7f8a994a4700 1 --2- 172.21.15.125:0/2741860314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8a94101310 0x7f8a94195910 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:20.589 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.571+0000 7f8a994a4700 1 -- 172.21.15.125:0/2741860314 >> 172.21.15.125:0/2741860314 conn(0x7f8a940fad20 msgr2=0x7f8a940fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:20.589 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.571+0000 7f8a994a4700 1 -- 172.21.15.125:0/2741860314 shutdown_connections 2024-02-19T18:56:20.589 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:20.571+0000 7f8a994a4700 1 -- 172.21.15.125:0/2741860314 wait complete. 2024-02-19T18:56:20.589 INFO:teuthology.orchestra.run.smithi125.stderr:dumped monmap epoch 1 2024-02-19T18:56:21.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:21 smithi096 ceph-mon[29216]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:21.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:21 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/2741860314' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:56:22.236 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:56:22.237 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:56:22.446 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:22.492 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:23.730 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:23 smithi096 ceph-mon[29216]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:23.980 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.963+0000 7fe3f3bad700 1 -- 172.21.15.125:0/223241485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3ec0ff780 msgr2=0x7fe3ec0ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:23.980 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.963+0000 7fe3f3bad700 1 --2- 172.21.15.125:0/223241485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3ec0ff780 0x7fe3ec0ffba0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc00b0a0 tx=0x7fe3dc00b3b0 comp rx=0 tx=0).stop 2024-02-19T18:56:23.981 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.963+0000 7fe3f3bad700 1 -- 172.21.15.125:0/223241485 shutdown_connections 2024-02-19T18:56:23.981 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.963+0000 7fe3f3bad700 1 --2- 172.21.15.125:0/223241485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3ec0ff780 0x7fe3ec0ffba0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:23.981 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.963+0000 7fe3f3bad700 1 -- 172.21.15.125:0/223241485 >> 172.21.15.125:0/223241485 conn(0x7fe3ec0fad20 msgr2=0x7fe3ec0fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:23.981 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.963+0000 7fe3f3bad700 1 -- 172.21.15.125:0/223241485 shutdown_connections 2024-02-19T18:56:23.981 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.963+0000 7fe3f3bad700 1 -- 172.21.15.125:0/223241485 wait complete. 2024-02-19T18:56:23.982 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.964+0000 7fe3f3bad700 1 Processor -- start 2024-02-19T18:56:23.983 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.964+0000 7fe3f3bad700 1 -- start start 2024-02-19T18:56:23.983 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.964+0000 7fe3f3bad700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3ec0ff780 0x7fe3ec197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:23.983 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.964+0000 7fe3f3bad700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec1980e0 con 0x7fe3ec0ff780 2024-02-19T18:56:23.983 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.964+0000 7fe3f1949700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3ec0ff780 0x7fe3ec197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:23.983 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.964+0000 7fe3f1949700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3ec0ff780 0x7fe3ec197ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.125:60954/0 (socket says 172.21.15.125:60954) 2024-02-19T18:56:23.983 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.964+0000 7fe3f1949700 1 -- 172.21.15.125:0/3007067201 learned_addr learned my addr 172.21.15.125:0/3007067201 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:56:23.983 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.964+0000 7fe3f1949700 1 -- 172.21.15.125:0/3007067201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc009d00 con 0x7fe3ec0ff780 2024-02-19T18:56:23.983 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.965+0000 7fe3f1949700 1 --2- 172.21.15.125:0/3007067201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3ec0ff780 0x7fe3ec197ba0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009fd0 tx=0x7fe3dc00bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:23.983 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.965+0000 7fe3eaffd700 1 -- 172.21.15.125:0/3007067201 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe3dc00e040 con 0x7fe3ec0ff780 2024-02-19T18:56:23.983 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.965+0000 7fe3eaffd700 1 -- 172.21.15.125:0/3007067201 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe3dc00bdc0 con 0x7fe3ec0ff780 2024-02-19T18:56:23.983 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.965+0000 7fe3f3bad700 1 -- 172.21.15.125:0/3007067201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3ec1982e0 con 0x7fe3ec0ff780 2024-02-19T18:56:23.983 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.965+0000 7fe3eaffd700 1 -- 172.21.15.125:0/3007067201 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe3dc01da40 con 0x7fe3ec0ff780 2024-02-19T18:56:23.984 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.965+0000 7fe3f3bad700 1 -- 172.21.15.125:0/3007067201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3ec198700 con 0x7fe3ec0ff780 2024-02-19T18:56:23.984 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.965+0000 7fe3eaffd700 1 -- 172.21.15.125:0/3007067201 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45339+0+0 (secure 0 0 0) 0x7fe3dc01dc80 con 0x7fe3ec0ff780 2024-02-19T18:56:23.984 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.966+0000 7fe3f3bad700 1 -- 172.21.15.125:0/3007067201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3ec1917b0 con 0x7fe3ec0ff780 2024-02-19T18:56:23.984 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.966+0000 7fe3eaffd700 1 --2- 172.21.15.125:0/3007067201 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fe3d4038460 0x7fe3d403a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:23.984 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.966+0000 7fe3eaffd700 1 -- 172.21.15.125:0/3007067201 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe3dc04c860 con 0x7fe3ec0ff780 2024-02-19T18:56:23.984 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.966+0000 7fe3f1148700 1 --2- 172.21.15.125:0/3007067201 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fe3d4038460 0x7fe3d403a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:23.984 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.966+0000 7fe3f1148700 1 --2- 172.21.15.125:0/3007067201 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fe3d4038460 0x7fe3d403a920 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0006fd0 tx=0x7fe3e0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:23.988 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:23.971+0000 7fe3eaffd700 1 -- 172.21.15.125:0/3007067201 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe3dc01c5c0 con 0x7fe3ec0ff780 2024-02-19T18:56:24.249 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:24.232+0000 7fe3f3bad700 1 -- 172.21.15.125:0/3007067201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe3ec02cc70 con 0x7fe3ec0ff780 2024-02-19T18:56:24.249 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:24.233+0000 7fe3eaffd700 1 -- 172.21.15.125:0/3007067201 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fe3dc02c200 con 0x7fe3ec0ff780 2024-02-19T18:56:24.250 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:56:24.250 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":1,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","modified":"2024-02-19T18:54:24.798664Z","created":"2024-02-19T18:54:24.798664Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:56:24.252 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:24.234+0000 7fe3f3bad700 1 -- 172.21.15.125:0/3007067201 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fe3d4038460 msgr2=0x7fe3d403a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:24.252 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:24.234+0000 7fe3f3bad700 1 --2- 172.21.15.125:0/3007067201 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fe3d4038460 0x7fe3d403a920 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0006fd0 tx=0x7fe3e0006e40 comp rx=0 tx=0).stop 2024-02-19T18:56:24.252 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:24.235+0000 7fe3f3bad700 1 -- 172.21.15.125:0/3007067201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3ec0ff780 msgr2=0x7fe3ec197ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:24.252 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:24.235+0000 7fe3f3bad700 1 --2- 172.21.15.125:0/3007067201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3ec0ff780 0x7fe3ec197ba0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009fd0 tx=0x7fe3dc00bb10 comp rx=0 tx=0).stop 2024-02-19T18:56:24.252 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:24.235+0000 7fe3f3bad700 1 -- 172.21.15.125:0/3007067201 shutdown_connections 2024-02-19T18:56:24.252 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:24.235+0000 7fe3f3bad700 1 --2- 172.21.15.125:0/3007067201 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fe3d4038460 0x7fe3d403a920 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:24.252 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:24.235+0000 7fe3f3bad700 1 --2- 172.21.15.125:0/3007067201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3ec0ff780 0x7fe3ec197ba0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:24.252 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:24.235+0000 7fe3f3bad700 1 -- 172.21.15.125:0/3007067201 >> 172.21.15.125:0/3007067201 conn(0x7fe3ec0fad20 msgr2=0x7fe3ec068820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:24.252 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:24.235+0000 7fe3f3bad700 1 -- 172.21.15.125:0/3007067201 shutdown_connections 2024-02-19T18:56:24.252 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:24.235+0000 7fe3f3bad700 1 -- 172.21.15.125:0/3007067201 wait complete. 2024-02-19T18:56:24.253 INFO:teuthology.orchestra.run.smithi125.stderr:dumped monmap epoch 1 2024-02-19T18:56:24.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:24 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/3007067201' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:56:25.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:25 smithi096 ceph-mon[29216]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:25.831 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:56:25.832 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:56:26.032 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:26.079 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:27.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.479+0000 7f8966c7e700 1 -- 172.21.15.125:0/249919974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8960101370 msgr2=0x7f8960103760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:27.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.479+0000 7f8966c7e700 1 --2- 172.21.15.125:0/249919974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8960101370 0x7f8960103760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f895800b0a0 tx=0x7f895800b3b0 comp rx=0 tx=0).stop 2024-02-19T18:56:27.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.479+0000 7f8966c7e700 1 -- 172.21.15.125:0/249919974 shutdown_connections 2024-02-19T18:56:27.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.479+0000 7f8966c7e700 1 --2- 172.21.15.125:0/249919974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8960101370 0x7f8960103760 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:27.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.479+0000 7f8966c7e700 1 -- 172.21.15.125:0/249919974 >> 172.21.15.125:0/249919974 conn(0x7f89600fad20 msgr2=0x7f89600fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:27.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.479+0000 7f8966c7e700 1 -- 172.21.15.125:0/249919974 shutdown_connections 2024-02-19T18:56:27.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.479+0000 7f8966c7e700 1 -- 172.21.15.125:0/249919974 wait complete. 2024-02-19T18:56:27.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.479+0000 7f8966c7e700 1 Processor -- start 2024-02-19T18:56:27.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.479+0000 7f8966c7e700 1 -- start start 2024-02-19T18:56:27.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.479+0000 7f8966c7e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8960101370 0x7f8960197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:27.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.479+0000 7f8966c7e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8960198070 con 0x7f8960101370 2024-02-19T18:56:27.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.480+0000 7f8964a1a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8960101370 0x7f8960197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:27.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.480+0000 7f8964a1a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8960101370 0x7f8960197b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.125:60978/0 (socket says 172.21.15.125:60978) 2024-02-19T18:56:27.498 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.480+0000 7f8964a1a700 1 -- 172.21.15.125:0/3413068617 learned_addr learned my addr 172.21.15.125:0/3413068617 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:56:27.498 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.480+0000 7f8964a1a700 1 -- 172.21.15.125:0/3413068617 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8958009d00 con 0x7f8960101370 2024-02-19T18:56:27.499 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.480+0000 7f8964a1a700 1 --2- 172.21.15.125:0/3413068617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8960101370 0x7f8960197b30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8958009fd0 tx=0x7f895800bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:27.499 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.480+0000 7f895dffb700 1 -- 172.21.15.125:0/3413068617 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f895800e040 con 0x7f8960101370 2024-02-19T18:56:27.499 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.480+0000 7f895dffb700 1 -- 172.21.15.125:0/3413068617 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f895800bdc0 con 0x7f8960101370 2024-02-19T18:56:27.499 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.480+0000 7f8966c7e700 1 -- 172.21.15.125:0/3413068617 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8960198270 con 0x7f8960101370 2024-02-19T18:56:27.499 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.480+0000 7f895dffb700 1 -- 172.21.15.125:0/3413068617 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f895801da40 con 0x7f8960101370 2024-02-19T18:56:27.499 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.480+0000 7f8966c7e700 1 -- 172.21.15.125:0/3413068617 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8960198690 con 0x7f8960101370 2024-02-19T18:56:27.499 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.481+0000 7f895dffb700 1 -- 172.21.15.125:0/3413068617 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45339+0+0 (secure 0 0 0) 0x7f895801d480 con 0x7f8960101370 2024-02-19T18:56:27.499 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.481+0000 7f8966c7e700 1 -- 172.21.15.125:0/3413068617 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89601918a0 con 0x7f8960101370 2024-02-19T18:56:27.499 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.482+0000 7f895dffb700 1 --2- 172.21.15.125:0/3413068617 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f894c038410 0x7f894c03a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:27.500 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.482+0000 7f895dffb700 1 -- 172.21.15.125:0/3413068617 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f895804c8f0 con 0x7f8960101370 2024-02-19T18:56:27.500 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.482+0000 7f895ffff700 1 --2- 172.21.15.125:0/3413068617 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f894c038410 0x7f894c03a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:27.500 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.482+0000 7f895ffff700 1 --2- 172.21.15.125:0/3413068617 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f894c038410 0x7f894c03a8d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8950006fd0 tx=0x7f8950006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:27.504 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.487+0000 7f895dffb700 1 -- 172.21.15.125:0/3413068617 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f895801c9b0 con 0x7f8960101370 2024-02-19T18:56:27.768 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.751+0000 7f8966c7e700 1 -- 172.21.15.125:0/3413068617 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f89600623c0 con 0x7f8960101370 2024-02-19T18:56:27.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:27 smithi096 ceph-mon[29216]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:27.769 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.752+0000 7f895dffb700 1 -- 172.21.15.125:0/3413068617 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f895801c3e0 con 0x7f8960101370 2024-02-19T18:56:27.769 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:56:27.769 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":1,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","modified":"2024-02-19T18:54:24.798664Z","created":"2024-02-19T18:54:24.798664Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:56:27.771 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.754+0000 7f8966c7e700 1 -- 172.21.15.125:0/3413068617 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f894c038410 msgr2=0x7f894c03a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:27.771 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.754+0000 7f8966c7e700 1 --2- 172.21.15.125:0/3413068617 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f894c038410 0x7f894c03a8d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8950006fd0 tx=0x7f8950006e40 comp rx=0 tx=0).stop 2024-02-19T18:56:27.771 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.754+0000 7f8966c7e700 1 -- 172.21.15.125:0/3413068617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8960101370 msgr2=0x7f8960197b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:27.772 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.754+0000 7f8966c7e700 1 --2- 172.21.15.125:0/3413068617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8960101370 0x7f8960197b30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8958009fd0 tx=0x7f895800bb10 comp rx=0 tx=0).stop 2024-02-19T18:56:27.772 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.754+0000 7f8966c7e700 1 -- 172.21.15.125:0/3413068617 shutdown_connections 2024-02-19T18:56:27.772 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.754+0000 7f8966c7e700 1 --2- 172.21.15.125:0/3413068617 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f894c038410 0x7f894c03a8d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:27.772 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.754+0000 7f8966c7e700 1 --2- 172.21.15.125:0/3413068617 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8960101370 0x7f8960197b30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:27.772 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.754+0000 7f8966c7e700 1 -- 172.21.15.125:0/3413068617 >> 172.21.15.125:0/3413068617 conn(0x7f89600fad20 msgr2=0x7f89600fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:27.772 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.754+0000 7f8966c7e700 1 -- 172.21.15.125:0/3413068617 shutdown_connections 2024-02-19T18:56:27.772 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:27.754+0000 7f8966c7e700 1 -- 172.21.15.125:0/3413068617 wait complete. 2024-02-19T18:56:27.772 INFO:teuthology.orchestra.run.smithi125.stderr:dumped monmap epoch 1 2024-02-19T18:56:28.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:28 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/3413068617' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:56:29.333 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:56:29.333 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:56:29.542 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:29.589 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:29.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:29 smithi096 ceph-mon[29216]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:31.079 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.061+0000 7f4227b36700 1 -- 172.21.15.125:0/4015688665 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42200ff780 msgr2=0x7f42200ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:31.079 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.061+0000 7f4227b36700 1 --2- 172.21.15.125:0/4015688665 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42200ff780 0x7f42200ffba0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4210009910 tx=0x7f4210009c20 comp rx=0 tx=0).stop 2024-02-19T18:56:31.079 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.061+0000 7f4227b36700 1 -- 172.21.15.125:0/4015688665 shutdown_connections 2024-02-19T18:56:31.079 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.061+0000 7f4227b36700 1 --2- 172.21.15.125:0/4015688665 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42200ff780 0x7f42200ffba0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:31.079 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.061+0000 7f4227b36700 1 -- 172.21.15.125:0/4015688665 >> 172.21.15.125:0/4015688665 conn(0x7f42200fad20 msgr2=0x7f42200fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:31.079 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.061+0000 7f4227b36700 1 -- 172.21.15.125:0/4015688665 shutdown_connections 2024-02-19T18:56:31.079 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.061+0000 7f4227b36700 1 -- 172.21.15.125:0/4015688665 wait complete. 2024-02-19T18:56:31.079 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.062+0000 7f4227b36700 1 Processor -- start 2024-02-19T18:56:31.079 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.062+0000 7f4227b36700 1 -- start start 2024-02-19T18:56:31.080 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.062+0000 7f4227b36700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42200ff780 0x7f4220068af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:31.080 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.062+0000 7f4227b36700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42201986f0 con 0x7f42200ff780 2024-02-19T18:56:31.080 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.062+0000 7f42258d2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42200ff780 0x7f4220068af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:31.080 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.062+0000 7f42258d2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42200ff780 0x7f4220068af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.125:60998/0 (socket says 172.21.15.125:60998) 2024-02-19T18:56:31.080 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.062+0000 7f42258d2700 1 -- 172.21.15.125:0/2664188202 learned_addr learned my addr 172.21.15.125:0/2664188202 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:56:31.081 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.062+0000 7f42258d2700 1 -- 172.21.15.125:0/2664188202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42100095f0 con 0x7f42200ff780 2024-02-19T18:56:31.081 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.063+0000 7f42258d2700 1 --2- 172.21.15.125:0/2664188202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42200ff780 0x7f4220068af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4210005b40 tx=0x7f4210004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:31.081 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.063+0000 7f4216ffd700 1 -- 172.21.15.125:0/2664188202 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f421001d070 con 0x7f42200ff780 2024-02-19T18:56:31.081 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.063+0000 7f4216ffd700 1 -- 172.21.15.125:0/2664188202 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f421000be10 con 0x7f42200ff780 2024-02-19T18:56:31.081 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.063+0000 7f4227b36700 1 -- 172.21.15.125:0/2664188202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4220198830 con 0x7f42200ff780 2024-02-19T18:56:31.081 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.063+0000 7f4216ffd700 1 -- 172.21.15.125:0/2664188202 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f421000f460 con 0x7f42200ff780 2024-02-19T18:56:31.082 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.063+0000 7f4227b36700 1 -- 172.21.15.125:0/2664188202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4220198cd0 con 0x7f42200ff780 2024-02-19T18:56:31.082 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.064+0000 7f4216ffd700 1 -- 172.21.15.125:0/2664188202 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45339+0+0 (secure 0 0 0) 0x7f42100227e0 con 0x7f42200ff780 2024-02-19T18:56:31.082 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.064+0000 7f4227b36700 1 -- 172.21.15.125:0/2664188202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422018e3a0 con 0x7f42200ff780 2024-02-19T18:56:31.082 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.064+0000 7f4216ffd700 1 --2- 172.21.15.125:0/2664188202 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f420c038410 0x7f420c03a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:31.082 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.064+0000 7f4216ffd700 1 -- 172.21.15.125:0/2664188202 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f421004c360 con 0x7f42200ff780 2024-02-19T18:56:31.082 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.064+0000 7f42250d1700 1 --2- 172.21.15.125:0/2664188202 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f420c038410 0x7f420c03a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:31.082 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.064+0000 7f42250d1700 1 --2- 172.21.15.125:0/2664188202 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f420c038410 0x7f420c03a8d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f421c006fd0 tx=0x7f421c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:31.090 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.073+0000 7f4216ffd700 1 -- 172.21.15.125:0/2664188202 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f421002ba00 con 0x7f42200ff780 2024-02-19T18:56:31.356 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.339+0000 7f4227b36700 1 -- 172.21.15.125:0/2664188202 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f422002cc70 con 0x7f42200ff780 2024-02-19T18:56:31.357 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.340+0000 7f4216ffd700 1 -- 172.21.15.125:0/2664188202 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f4210027020 con 0x7f42200ff780 2024-02-19T18:56:31.357 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:56:31.357 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":1,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","modified":"2024-02-19T18:54:24.798664Z","created":"2024-02-19T18:54:24.798664Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:56:31.359 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.342+0000 7f4227b36700 1 -- 172.21.15.125:0/2664188202 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f420c038410 msgr2=0x7f420c03a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:31.359 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.342+0000 7f4227b36700 1 --2- 172.21.15.125:0/2664188202 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f420c038410 0x7f420c03a8d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f421c006fd0 tx=0x7f421c006e40 comp rx=0 tx=0).stop 2024-02-19T18:56:31.359 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.342+0000 7f4227b36700 1 -- 172.21.15.125:0/2664188202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42200ff780 msgr2=0x7f4220068af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:31.359 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.342+0000 7f4227b36700 1 --2- 172.21.15.125:0/2664188202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42200ff780 0x7f4220068af0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4210005b40 tx=0x7f4210004740 comp rx=0 tx=0).stop 2024-02-19T18:56:31.359 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.342+0000 7f4227b36700 1 -- 172.21.15.125:0/2664188202 shutdown_connections 2024-02-19T18:56:31.359 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.342+0000 7f4227b36700 1 --2- 172.21.15.125:0/2664188202 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f420c038410 0x7f420c03a8d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:31.360 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.342+0000 7f4227b36700 1 --2- 172.21.15.125:0/2664188202 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42200ff780 0x7f4220068af0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:31.360 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.342+0000 7f4227b36700 1 -- 172.21.15.125:0/2664188202 >> 172.21.15.125:0/2664188202 conn(0x7f42200fad20 msgr2=0x7f42200fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:31.360 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.342+0000 7f4227b36700 1 -- 172.21.15.125:0/2664188202 shutdown_connections 2024-02-19T18:56:31.360 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:31.342+0000 7f4227b36700 1 -- 172.21.15.125:0/2664188202 wait complete. 2024-02-19T18:56:31.360 INFO:teuthology.orchestra.run.smithi125.stderr:dumped monmap epoch 1 2024-02-19T18:56:31.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:31 smithi096 ceph-mon[29216]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:31.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:31 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/2664188202' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:56:32.945 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:56:32.945 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:56:33.158 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:33.204 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:33.276 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:32 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:33.276 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:32 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:33.276 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:32 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:33.276 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:32 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:33.276 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:32 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:33.276 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:32 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:33.276 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:32 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:33.276 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:32 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:33.276 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:32 smithi096 ceph-mon[29216]: Deploying daemon prometheus.smithi096 on smithi096 2024-02-19T18:56:33.276 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:32 smithi096 ceph-mon[29216]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:34.540 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.521+0000 7f87faae1700 1 -- 172.21.15.125:0/2326424891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87f4100d60 msgr2=0x7f87f4101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:34.540 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.521+0000 7f87faae1700 1 --2- 172.21.15.125:0/2326424891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87f4100d60 0x7f87f4101180 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00b0a0 tx=0x7f87ec00b3b0 comp rx=0 tx=0).stop 2024-02-19T18:56:34.541 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.521+0000 7f87faae1700 1 -- 172.21.15.125:0/2326424891 shutdown_connections 2024-02-19T18:56:34.541 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.521+0000 7f87faae1700 1 --2- 172.21.15.125:0/2326424891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87f4100d60 0x7f87f4101180 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:34.541 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.521+0000 7f87faae1700 1 -- 172.21.15.125:0/2326424891 >> 172.21.15.125:0/2326424891 conn(0x7f87f40fa490 msgr2=0x7f87f40fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:34.541 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.521+0000 7f87faae1700 1 -- 172.21.15.125:0/2326424891 shutdown_connections 2024-02-19T18:56:34.541 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.521+0000 7f87faae1700 1 -- 172.21.15.125:0/2326424891 wait complete. 2024-02-19T18:56:34.541 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.522+0000 7f87faae1700 1 Processor -- start 2024-02-19T18:56:34.541 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.522+0000 7f87faae1700 1 -- start start 2024-02-19T18:56:34.541 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.522+0000 7f87faae1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87f4100d60 0x7f87f40fc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:34.541 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.522+0000 7f87faae1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f40fc990 con 0x7f87f4100d60 2024-02-19T18:56:34.541 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.522+0000 7f87f887d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87f4100d60 0x7f87f40fc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:34.541 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.522+0000 7f87f887d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87f4100d60 0x7f87f40fc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.125:50698/0 (socket says 172.21.15.125:50698) 2024-02-19T18:56:34.542 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.522+0000 7f87f887d700 1 -- 172.21.15.125:0/32086654 learned_addr learned my addr 172.21.15.125:0/32086654 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:56:34.542 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.522+0000 7f87f887d700 1 -- 172.21.15.125:0/32086654 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec009d00 con 0x7f87f4100d60 2024-02-19T18:56:34.542 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.523+0000 7f87f887d700 1 --2- 172.21.15.125:0/32086654 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87f4100d60 0x7f87f40fc450 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009fd0 tx=0x7f87ec00bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:34.542 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.523+0000 7f87f1ffb700 1 -- 172.21.15.125:0/32086654 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f87ec00e040 con 0x7f87f4100d60 2024-02-19T18:56:34.542 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.523+0000 7f87f1ffb700 1 -- 172.21.15.125:0/32086654 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f87ec00bdc0 con 0x7f87f4100d60 2024-02-19T18:56:34.542 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.523+0000 7f87faae1700 1 -- 172.21.15.125:0/32086654 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f40faaa0 con 0x7f87f4100d60 2024-02-19T18:56:34.542 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.523+0000 7f87f1ffb700 1 -- 172.21.15.125:0/32086654 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f87ec01da40 con 0x7f87f4100d60 2024-02-19T18:56:34.542 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.523+0000 7f87faae1700 1 -- 172.21.15.125:0/32086654 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f40faec0 con 0x7f87f4100d60 2024-02-19T18:56:34.543 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.524+0000 7f87f1ffb700 1 -- 172.21.15.125:0/32086654 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45339+0+0 (secure 0 0 0) 0x7f87ec01dc80 con 0x7f87f4100d60 2024-02-19T18:56:34.543 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.524+0000 7f87faae1700 1 -- 172.21.15.125:0/32086654 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f40fb8d0 con 0x7f87f4100d60 2024-02-19T18:56:34.543 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.524+0000 7f87f1ffb700 1 --2- 172.21.15.125:0/32086654 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f87e0038410 0x7f87e003a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:34.543 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.524+0000 7f87f1ffb700 1 -- 172.21.15.125:0/32086654 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f87ec04c7e0 con 0x7f87f4100d60 2024-02-19T18:56:34.543 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.524+0000 7f87f3fff700 1 --2- 172.21.15.125:0/32086654 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f87e0038410 0x7f87e003a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:34.543 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.524+0000 7f87f3fff700 1 --2- 172.21.15.125:0/32086654 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f87e0038410 0x7f87e003a8d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f87e4006fd0 tx=0x7f87e4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:34.546 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.529+0000 7f87f1ffb700 1 -- 172.21.15.125:0/32086654 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f87ec01c5c0 con 0x7f87f4100d60 2024-02-19T18:56:34.812 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.794+0000 7f87faae1700 1 -- 172.21.15.125:0/32086654 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f87f418edb0 con 0x7f87f4100d60 2024-02-19T18:56:34.812 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.795+0000 7f87f1ffb700 1 -- 172.21.15.125:0/32086654 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f87ec01c3e0 con 0x7f87f4100d60 2024-02-19T18:56:34.812 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:56:34.812 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":1,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","modified":"2024-02-19T18:54:24.798664Z","created":"2024-02-19T18:54:24.798664Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:56:34.814 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.797+0000 7f87faae1700 1 -- 172.21.15.125:0/32086654 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f87e0038410 msgr2=0x7f87e003a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:34.814 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.797+0000 7f87faae1700 1 --2- 172.21.15.125:0/32086654 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f87e0038410 0x7f87e003a8d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f87e4006fd0 tx=0x7f87e4006e40 comp rx=0 tx=0).stop 2024-02-19T18:56:34.814 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.797+0000 7f87faae1700 1 -- 172.21.15.125:0/32086654 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87f4100d60 msgr2=0x7f87f40fc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:34.814 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.797+0000 7f87faae1700 1 --2- 172.21.15.125:0/32086654 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87f4100d60 0x7f87f40fc450 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009fd0 tx=0x7f87ec00bb10 comp rx=0 tx=0).stop 2024-02-19T18:56:34.814 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.797+0000 7f87faae1700 1 -- 172.21.15.125:0/32086654 shutdown_connections 2024-02-19T18:56:34.814 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.797+0000 7f87faae1700 1 --2- 172.21.15.125:0/32086654 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f87e0038410 0x7f87e003a8d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:34.814 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.797+0000 7f87faae1700 1 --2- 172.21.15.125:0/32086654 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87f4100d60 0x7f87f40fc450 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:34.814 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.797+0000 7f87faae1700 1 -- 172.21.15.125:0/32086654 >> 172.21.15.125:0/32086654 conn(0x7f87f40fa490 msgr2=0x7f87f40ff140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:34.815 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.797+0000 7f87faae1700 1 -- 172.21.15.125:0/32086654 shutdown_connections 2024-02-19T18:56:34.815 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:34.797+0000 7f87faae1700 1 -- 172.21.15.125:0/32086654 wait complete. 2024-02-19T18:56:34.815 INFO:teuthology.orchestra.run.smithi125.stderr:dumped monmap epoch 1 2024-02-19T18:56:35.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:35 smithi096 ceph-mon[29216]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:35.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:35 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/32086654' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:56:36.372 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:56:36.373 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:56:36.574 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:36.622 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:37.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:37 smithi096 ceph-mon[29216]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:37.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:37 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:38.115 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.098+0000 7efe33672700 1 -- 172.21.15.125:0/3320515782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe2c0ff780 msgr2=0x7efe2c0ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:38.115 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.098+0000 7efe33672700 1 --2- 172.21.15.125:0/3320515782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe2c0ff780 0x7efe2c0ffba0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efe2400b0a0 tx=0x7efe2400b3b0 comp rx=0 tx=0).stop 2024-02-19T18:56:38.115 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.098+0000 7efe33672700 1 -- 172.21.15.125:0/3320515782 shutdown_connections 2024-02-19T18:56:38.115 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.098+0000 7efe33672700 1 --2- 172.21.15.125:0/3320515782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe2c0ff780 0x7efe2c0ffba0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:38.115 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.098+0000 7efe33672700 1 -- 172.21.15.125:0/3320515782 >> 172.21.15.125:0/3320515782 conn(0x7efe2c0fad20 msgr2=0x7efe2c0fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:38.116 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.098+0000 7efe33672700 1 -- 172.21.15.125:0/3320515782 shutdown_connections 2024-02-19T18:56:38.116 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.098+0000 7efe33672700 1 -- 172.21.15.125:0/3320515782 wait complete. 2024-02-19T18:56:38.118 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.098+0000 7efe33672700 1 Processor -- start 2024-02-19T18:56:38.118 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.099+0000 7efe33672700 1 -- start start 2024-02-19T18:56:38.118 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.099+0000 7efe33672700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe2c0ff780 0x7efe2c0fccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:38.118 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.099+0000 7efe33672700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c0fd200 con 0x7efe2c0ff780 2024-02-19T18:56:38.118 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.099+0000 7efe3140e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe2c0ff780 0x7efe2c0fccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:38.118 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.099+0000 7efe3140e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe2c0ff780 0x7efe2c0fccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.125:50718/0 (socket says 172.21.15.125:50718) 2024-02-19T18:56:38.118 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.099+0000 7efe3140e700 1 -- 172.21.15.125:0/3230341647 learned_addr learned my addr 172.21.15.125:0/3230341647 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:56:38.118 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.099+0000 7efe3140e700 1 -- 172.21.15.125:0/3230341647 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe24009d00 con 0x7efe2c0ff780 2024-02-19T18:56:38.118 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.099+0000 7efe3140e700 1 --2- 172.21.15.125:0/3230341647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe2c0ff780 0x7efe2c0fccc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efe2400b830 tx=0x7efe2400bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:38.118 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.099+0000 7efe2a7fc700 1 -- 172.21.15.125:0/3230341647 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe2400e040 con 0x7efe2c0ff780 2024-02-19T18:56:38.118 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.099+0000 7efe2a7fc700 1 -- 172.21.15.125:0/3230341647 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efe24012af0 con 0x7efe2c0ff780 2024-02-19T18:56:38.118 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.099+0000 7efe2a7fc700 1 -- 172.21.15.125:0/3230341647 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efe2401d9f0 con 0x7efe2c0ff780 2024-02-19T18:56:38.118 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.099+0000 7efe33672700 1 -- 172.21.15.125:0/3230341647 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2c0fb310 con 0x7efe2c0ff780 2024-02-19T18:56:38.119 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.100+0000 7efe33672700 1 -- 172.21.15.125:0/3230341647 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2c0fb730 con 0x7efe2c0ff780 2024-02-19T18:56:38.119 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.100+0000 7efe2a7fc700 1 -- 172.21.15.125:0/3230341647 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45339+0+0 (secure 0 0 0) 0x7efe24012c60 con 0x7efe2c0ff780 2024-02-19T18:56:38.119 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.100+0000 7efe33672700 1 -- 172.21.15.125:0/3230341647 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2c0fc140 con 0x7efe2c0ff780 2024-02-19T18:56:38.119 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.100+0000 7efe2a7fc700 1 --2- 172.21.15.125:0/3230341647 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7efe140383c0 0x7efe1403a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:38.119 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.101+0000 7efe2a7fc700 1 -- 172.21.15.125:0/3230341647 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7efe2404c990 con 0x7efe2c0ff780 2024-02-19T18:56:38.119 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.101+0000 7efe30c0d700 1 --2- 172.21.15.125:0/3230341647 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7efe140383c0 0x7efe1403a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:38.119 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.101+0000 7efe30c0d700 1 --2- 172.21.15.125:0/3230341647 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7efe140383c0 0x7efe1403a880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efe20006fd0 tx=0x7efe20006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:38.123 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.106+0000 7efe2a7fc700 1 -- 172.21.15.125:0/3230341647 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7efe2401c5c0 con 0x7efe2c0ff780 2024-02-19T18:56:38.386 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.369+0000 7efe33672700 1 -- 172.21.15.125:0/3230341647 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7efe2c18ed90 con 0x7efe2c0ff780 2024-02-19T18:56:38.387 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.370+0000 7efe2a7fc700 1 -- 172.21.15.125:0/3230341647 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7efe2401c3e0 con 0x7efe2c0ff780 2024-02-19T18:56:38.387 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:56:38.387 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":1,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","modified":"2024-02-19T18:54:24.798664Z","created":"2024-02-19T18:54:24.798664Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:56:38.389 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.372+0000 7efe33672700 1 -- 172.21.15.125:0/3230341647 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7efe140383c0 msgr2=0x7efe1403a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:38.389 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.372+0000 7efe33672700 1 --2- 172.21.15.125:0/3230341647 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7efe140383c0 0x7efe1403a880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efe20006fd0 tx=0x7efe20006e40 comp rx=0 tx=0).stop 2024-02-19T18:56:38.389 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.372+0000 7efe33672700 1 -- 172.21.15.125:0/3230341647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe2c0ff780 msgr2=0x7efe2c0fccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:38.389 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.372+0000 7efe33672700 1 --2- 172.21.15.125:0/3230341647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe2c0ff780 0x7efe2c0fccc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efe2400b830 tx=0x7efe2400bd40 comp rx=0 tx=0).stop 2024-02-19T18:56:38.389 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.372+0000 7efe33672700 1 -- 172.21.15.125:0/3230341647 shutdown_connections 2024-02-19T18:56:38.390 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.372+0000 7efe33672700 1 --2- 172.21.15.125:0/3230341647 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7efe140383c0 0x7efe1403a880 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:38.390 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.372+0000 7efe33672700 1 --2- 172.21.15.125:0/3230341647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efe2c0ff780 0x7efe2c0fccc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:38.390 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.372+0000 7efe33672700 1 -- 172.21.15.125:0/3230341647 >> 172.21.15.125:0/3230341647 conn(0x7efe2c0fad20 msgr2=0x7efe2c0690f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:38.390 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.372+0000 7efe33672700 1 -- 172.21.15.125:0/3230341647 shutdown_connections 2024-02-19T18:56:38.390 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:38.372+0000 7efe33672700 1 -- 172.21.15.125:0/3230341647 wait complete. 2024-02-19T18:56:38.390 INFO:teuthology.orchestra.run.smithi125.stderr:dumped monmap epoch 1 2024-02-19T18:56:39.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:39 smithi096 ceph-mon[29216]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:39.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:39 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/3230341647' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:56:39.968 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:56:39.969 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:56:40.171 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:40.216 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:41.670 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.650+0000 7fd4ec29b700 1 -- 172.21.15.125:0/464854270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4e40ff780 msgr2=0x7fd4e40ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:41.671 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.650+0000 7fd4ec29b700 1 --2- 172.21.15.125:0/464854270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4e40ff780 0x7fd4e40ffba0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009910 tx=0x7fd4d4009c20 comp rx=0 tx=0).stop 2024-02-19T18:56:41.671 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.650+0000 7fd4ec29b700 1 -- 172.21.15.125:0/464854270 shutdown_connections 2024-02-19T18:56:41.671 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.650+0000 7fd4ec29b700 1 --2- 172.21.15.125:0/464854270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4e40ff780 0x7fd4e40ffba0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:41.671 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.650+0000 7fd4ec29b700 1 -- 172.21.15.125:0/464854270 >> 172.21.15.125:0/464854270 conn(0x7fd4e40fad20 msgr2=0x7fd4e40fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:41.671 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.650+0000 7fd4ec29b700 1 -- 172.21.15.125:0/464854270 shutdown_connections 2024-02-19T18:56:41.671 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.650+0000 7fd4ec29b700 1 -- 172.21.15.125:0/464854270 wait complete. 2024-02-19T18:56:41.671 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.651+0000 7fd4ec29b700 1 Processor -- start 2024-02-19T18:56:41.671 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.651+0000 7fd4ec29b700 1 -- start start 2024-02-19T18:56:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.651+0000 7fd4ec29b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4e40ff780 0x7fd4e40fccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.651+0000 7fd4ec29b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e40fd200 con 0x7fd4e40ff780 2024-02-19T18:56:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.651+0000 7fd4ea037700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4e40ff780 0x7fd4e40fccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.651+0000 7fd4ea037700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4e40ff780 0x7fd4e40fccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.125:50722/0 (socket says 172.21.15.125:50722) 2024-02-19T18:56:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.651+0000 7fd4ea037700 1 -- 172.21.15.125:0/1410121664 learned_addr learned my addr 172.21.15.125:0/1410121664 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:56:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.651+0000 7fd4ea037700 1 -- 172.21.15.125:0/1410121664 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d40095f0 con 0x7fd4e40ff780 2024-02-19T18:56:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.652+0000 7fd4ea037700 1 --2- 172.21.15.125:0/1410121664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4e40ff780 0x7fd4e40fccc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4005b40 tx=0x7fd4d4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.652+0000 7fd4db7fe700 1 -- 172.21.15.125:0/1410121664 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4d401d070 con 0x7fd4e40ff780 2024-02-19T18:56:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.652+0000 7fd4db7fe700 1 -- 172.21.15.125:0/1410121664 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd4d400be10 con 0x7fd4e40ff780 2024-02-19T18:56:41.672 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.652+0000 7fd4db7fe700 1 -- 172.21.15.125:0/1410121664 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd4d400f460 con 0x7fd4e40ff780 2024-02-19T18:56:41.673 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.652+0000 7fd4ec29b700 1 -- 172.21.15.125:0/1410121664 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e40fb310 con 0x7fd4e40ff780 2024-02-19T18:56:41.673 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.652+0000 7fd4ec29b700 1 -- 172.21.15.125:0/1410121664 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e40fb7b0 con 0x7fd4e40ff780 2024-02-19T18:56:41.673 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.653+0000 7fd4db7fe700 1 -- 172.21.15.125:0/1410121664 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45339+0+0 (secure 0 0 0) 0x7fd4d40227e0 con 0x7fd4e40ff780 2024-02-19T18:56:41.674 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.653+0000 7fd4ec29b700 1 -- 172.21.15.125:0/1410121664 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e40623c0 con 0x7fd4e40ff780 2024-02-19T18:56:41.674 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.653+0000 7fd4db7fe700 1 --2- 172.21.15.125:0/1410121664 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fd4d0038410 0x7fd4d003a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:41.674 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.653+0000 7fd4db7fe700 1 -- 172.21.15.125:0/1410121664 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd4d404c360 con 0x7fd4e40ff780 2024-02-19T18:56:41.674 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.653+0000 7fd4e9836700 1 --2- 172.21.15.125:0/1410121664 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fd4d0038410 0x7fd4d003a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:41.674 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.654+0000 7fd4e9836700 1 --2- 172.21.15.125:0/1410121664 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fd4d0038410 0x7fd4d003a8d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0006fd0 tx=0x7fd4e0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:41.676 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.658+0000 7fd4db7fe700 1 -- 172.21.15.125:0/1410121664 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd4d402ba00 con 0x7fd4e40ff780 2024-02-19T18:56:41.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:41 smithi096 ceph-mon[29216]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:41.942 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.924+0000 7fd4ec29b700 1 -- 172.21.15.125:0/1410121664 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd4e418ed90 con 0x7fd4e40ff780 2024-02-19T18:56:41.942 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.924+0000 7fd4db7fe700 1 -- 172.21.15.125:0/1410121664 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fd4d4027020 con 0x7fd4e40ff780 2024-02-19T18:56:41.943 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:56:41.943 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":1,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","modified":"2024-02-19T18:54:24.798664Z","created":"2024-02-19T18:54:24.798664Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:56:41.945 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.927+0000 7fd4ec29b700 1 -- 172.21.15.125:0/1410121664 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fd4d0038410 msgr2=0x7fd4d003a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:41.945 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.927+0000 7fd4ec29b700 1 --2- 172.21.15.125:0/1410121664 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fd4d0038410 0x7fd4d003a8d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0006fd0 tx=0x7fd4e0006e40 comp rx=0 tx=0).stop 2024-02-19T18:56:41.946 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.927+0000 7fd4ec29b700 1 -- 172.21.15.125:0/1410121664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4e40ff780 msgr2=0x7fd4e40fccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:41.946 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.927+0000 7fd4ec29b700 1 --2- 172.21.15.125:0/1410121664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4e40ff780 0x7fd4e40fccc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4005b40 tx=0x7fd4d4004740 comp rx=0 tx=0).stop 2024-02-19T18:56:41.946 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.927+0000 7fd4ec29b700 1 -- 172.21.15.125:0/1410121664 shutdown_connections 2024-02-19T18:56:41.946 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.927+0000 7fd4ec29b700 1 --2- 172.21.15.125:0/1410121664 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fd4d0038410 0x7fd4d003a8d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:41.946 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.927+0000 7fd4ec29b700 1 --2- 172.21.15.125:0/1410121664 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4e40ff780 0x7fd4e40fccc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:41.946 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.927+0000 7fd4ec29b700 1 -- 172.21.15.125:0/1410121664 >> 172.21.15.125:0/1410121664 conn(0x7fd4e40fad20 msgr2=0x7fd4e4068820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:41.946 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.927+0000 7fd4ec29b700 1 -- 172.21.15.125:0/1410121664 shutdown_connections 2024-02-19T18:56:41.946 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:41.927+0000 7fd4ec29b700 1 -- 172.21.15.125:0/1410121664 wait complete. 2024-02-19T18:56:41.946 INFO:teuthology.orchestra.run.smithi125.stderr:dumped monmap epoch 1 2024-02-19T18:56:42.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:42 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/1410121664' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:56:43.487 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:56:43.487 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:56:43.690 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:43.736 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:43.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:43 smithi096 ceph-mon[29216]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:45.157 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.138+0000 7ff174ea8700 1 -- 172.21.15.125:0/2835600496 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1700ff780 msgr2=0x7ff1700ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:45.157 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.138+0000 7ff174ea8700 1 --2- 172.21.15.125:0/2835600496 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1700ff780 0x7ff1700ffba0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff164009910 tx=0x7ff164009c20 comp rx=0 tx=0).stop 2024-02-19T18:56:45.157 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.138+0000 7ff174ea8700 1 -- 172.21.15.125:0/2835600496 shutdown_connections 2024-02-19T18:56:45.157 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.138+0000 7ff174ea8700 1 --2- 172.21.15.125:0/2835600496 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1700ff780 0x7ff1700ffba0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:45.157 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.138+0000 7ff174ea8700 1 -- 172.21.15.125:0/2835600496 >> 172.21.15.125:0/2835600496 conn(0x7ff1700fad20 msgr2=0x7ff1700fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:45.157 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.138+0000 7ff174ea8700 1 -- 172.21.15.125:0/2835600496 shutdown_connections 2024-02-19T18:56:45.157 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.139+0000 7ff174ea8700 1 -- 172.21.15.125:0/2835600496 wait complete. 2024-02-19T18:56:45.159 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.139+0000 7ff174ea8700 1 Processor -- start 2024-02-19T18:56:45.159 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.139+0000 7ff174ea8700 1 -- start start 2024-02-19T18:56:45.159 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.139+0000 7ff174ea8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1700ff780 0x7ff170195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:45.159 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.139+0000 7ff174ea8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff170195ec0 con 0x7ff1700ff780 2024-02-19T18:56:45.159 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.140+0000 7ff16e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1700ff780 0x7ff170195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:45.159 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.140+0000 7ff16e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1700ff780 0x7ff170195980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.125:46814/0 (socket says 172.21.15.125:46814) 2024-02-19T18:56:45.159 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.140+0000 7ff16e59c700 1 -- 172.21.15.125:0/278442871 learned_addr learned my addr 172.21.15.125:0/278442871 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:56:45.159 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.140+0000 7ff16e59c700 1 -- 172.21.15.125:0/278442871 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1640095f0 con 0x7ff1700ff780 2024-02-19T18:56:45.159 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.140+0000 7ff16e59c700 1 --2- 172.21.15.125:0/278442871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1700ff780 0x7ff170195980 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff164005b40 tx=0x7ff164004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:45.159 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.140+0000 7ff15f7fe700 1 -- 172.21.15.125:0/278442871 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff16401d070 con 0x7ff1700ff780 2024-02-19T18:56:45.159 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.140+0000 7ff15f7fe700 1 -- 172.21.15.125:0/278442871 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff16400be10 con 0x7ff1700ff780 2024-02-19T18:56:45.160 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.140+0000 7ff174ea8700 1 -- 172.21.15.125:0/278442871 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1701960c0 con 0x7ff1700ff780 2024-02-19T18:56:45.160 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.141+0000 7ff15f7fe700 1 -- 172.21.15.125:0/278442871 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff16400f460 con 0x7ff1700ff780 2024-02-19T18:56:45.160 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.141+0000 7ff174ea8700 1 -- 172.21.15.125:0/278442871 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff170196560 con 0x7ff1700ff780 2024-02-19T18:56:45.161 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.141+0000 7ff174ea8700 1 -- 172.21.15.125:0/278442871 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1701055c0 con 0x7ff1700ff780 2024-02-19T18:56:45.161 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.142+0000 7ff15f7fe700 1 -- 172.21.15.125:0/278442871 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45339+0+0 (secure 0 0 0) 0x7ff1640227e0 con 0x7ff1700ff780 2024-02-19T18:56:45.161 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.142+0000 7ff15f7fe700 1 --2- 172.21.15.125:0/278442871 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7ff158038410 0x7ff15803a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:45.161 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.142+0000 7ff15f7fe700 1 -- 172.21.15.125:0/278442871 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff16404c3e0 con 0x7ff1700ff780 2024-02-19T18:56:45.161 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.142+0000 7ff16dd9b700 1 --2- 172.21.15.125:0/278442871 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7ff158038410 0x7ff15803a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:45.161 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.143+0000 7ff16dd9b700 1 --2- 172.21.15.125:0/278442871 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7ff158038410 0x7ff15803a8d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff160006fd0 tx=0x7ff160006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:45.165 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.147+0000 7ff15f7fe700 1 -- 172.21.15.125:0/278442871 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff16402ba00 con 0x7ff1700ff780 2024-02-19T18:56:45.427 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.408+0000 7ff174ea8700 1 -- 172.21.15.125:0/278442871 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff170199340 con 0x7ff1700ff780 2024-02-19T18:56:45.427 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.409+0000 7ff15f7fe700 1 -- 172.21.15.125:0/278442871 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7ff164027020 con 0x7ff1700ff780 2024-02-19T18:56:45.427 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:56:45.428 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":1,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","modified":"2024-02-19T18:54:24.798664Z","created":"2024-02-19T18:54:24.798664Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:56:45.429 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.411+0000 7ff174ea8700 1 -- 172.21.15.125:0/278442871 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7ff158038410 msgr2=0x7ff15803a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:45.430 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.411+0000 7ff174ea8700 1 --2- 172.21.15.125:0/278442871 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7ff158038410 0x7ff15803a8d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff160006fd0 tx=0x7ff160006e40 comp rx=0 tx=0).stop 2024-02-19T18:56:45.430 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.411+0000 7ff174ea8700 1 -- 172.21.15.125:0/278442871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1700ff780 msgr2=0x7ff170195980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:45.430 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.411+0000 7ff174ea8700 1 --2- 172.21.15.125:0/278442871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1700ff780 0x7ff170195980 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff164005b40 tx=0x7ff164004740 comp rx=0 tx=0).stop 2024-02-19T18:56:45.430 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.411+0000 7ff174ea8700 1 -- 172.21.15.125:0/278442871 shutdown_connections 2024-02-19T18:56:45.430 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.411+0000 7ff174ea8700 1 --2- 172.21.15.125:0/278442871 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7ff158038410 0x7ff15803a8d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:45.430 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.411+0000 7ff174ea8700 1 --2- 172.21.15.125:0/278442871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff1700ff780 0x7ff170195980 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:45.430 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.411+0000 7ff174ea8700 1 -- 172.21.15.125:0/278442871 >> 172.21.15.125:0/278442871 conn(0x7ff1700fad20 msgr2=0x7ff1700fb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:45.430 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.411+0000 7ff174ea8700 1 -- 172.21.15.125:0/278442871 shutdown_connections 2024-02-19T18:56:45.430 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:45.411+0000 7ff174ea8700 1 -- 172.21.15.125:0/278442871 wait complete. 2024-02-19T18:56:45.431 INFO:teuthology.orchestra.run.smithi125.stderr:dumped monmap epoch 1 2024-02-19T18:56:45.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:45 smithi096 ceph-mon[29216]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:46.676 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:46 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/278442871' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:56:47.059 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:56:47.059 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:56:47.255 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:47.303 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:47.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:47 smithi096 ceph-mon[29216]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:48.769 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.749+0000 7fa42c777700 1 -- 172.21.15.125:0/3269093945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4240ff780 msgr2=0x7fa4240ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:48.769 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.749+0000 7fa42c777700 1 --2- 172.21.15.125:0/3269093945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4240ff780 0x7fa4240ffba0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00b0a0 tx=0x7fa41c00b3b0 comp rx=0 tx=0).stop 2024-02-19T18:56:48.769 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.749+0000 7fa42c777700 1 -- 172.21.15.125:0/3269093945 shutdown_connections 2024-02-19T18:56:48.769 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.749+0000 7fa42c777700 1 --2- 172.21.15.125:0/3269093945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4240ff780 0x7fa4240ffba0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:48.769 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.749+0000 7fa42c777700 1 -- 172.21.15.125:0/3269093945 >> 172.21.15.125:0/3269093945 conn(0x7fa4240fad00 msgr2=0x7fa4240fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:48.769 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.750+0000 7fa42c777700 1 -- 172.21.15.125:0/3269093945 shutdown_connections 2024-02-19T18:56:48.769 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.750+0000 7fa42c777700 1 -- 172.21.15.125:0/3269093945 wait complete. 2024-02-19T18:56:48.769 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.750+0000 7fa42c777700 1 Processor -- start 2024-02-19T18:56:48.770 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.750+0000 7fa42c777700 1 -- start start 2024-02-19T18:56:48.770 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.750+0000 7fa42c777700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4240ff780 0x7fa4241948d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:48.770 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.750+0000 7fa42c777700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa424194e10 con 0x7fa4240ff780 2024-02-19T18:56:48.770 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.751+0000 7fa42a513700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4240ff780 0x7fa4241948d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:48.770 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.751+0000 7fa42a513700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4240ff780 0x7fa4241948d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.125:46828/0 (socket says 172.21.15.125:46828) 2024-02-19T18:56:48.770 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.751+0000 7fa42a513700 1 -- 172.21.15.125:0/1090646993 learned_addr learned my addr 172.21.15.125:0/1090646993 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:56:48.770 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.751+0000 7fa42a513700 1 -- 172.21.15.125:0/1090646993 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c009d00 con 0x7fa4240ff780 2024-02-19T18:56:48.770 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.751+0000 7fa42a513700 1 --2- 172.21.15.125:0/1090646993 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4240ff780 0x7fa4241948d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00b830 tx=0x7fa41c00bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:48.771 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.751+0000 7fa41b7fe700 1 -- 172.21.15.125:0/1090646993 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa41c00e040 con 0x7fa4240ff780 2024-02-19T18:56:48.771 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.751+0000 7fa41b7fe700 1 -- 172.21.15.125:0/1090646993 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa41c012af0 con 0x7fa4240ff780 2024-02-19T18:56:48.771 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.751+0000 7fa42c777700 1 -- 172.21.15.125:0/1090646993 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa424195010 con 0x7fa4240ff780 2024-02-19T18:56:48.771 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.751+0000 7fa41b7fe700 1 -- 172.21.15.125:0/1090646993 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa41c01d9f0 con 0x7fa4240ff780 2024-02-19T18:56:48.772 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.751+0000 7fa42c777700 1 -- 172.21.15.125:0/1090646993 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa424195430 con 0x7fa4240ff780 2024-02-19T18:56:48.772 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.752+0000 7fa41b7fe700 1 -- 172.21.15.125:0/1090646993 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 13) v1 ==== 45339+0+0 (secure 0 0 0) 0x7fa41c01dcb0 con 0x7fa4240ff780 2024-02-19T18:56:48.772 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.752+0000 7fa42c777700 1 -- 172.21.15.125:0/1090646993 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42418e3a0 con 0x7fa4240ff780 2024-02-19T18:56:48.772 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.752+0000 7fa41b7fe700 1 --2- 172.21.15.125:0/1090646993 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fa4100383c0 0x7fa41003a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:48.772 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.753+0000 7fa41b7fe700 1 -- 172.21.15.125:0/1090646993 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa41c04c8d0 con 0x7fa4240ff780 2024-02-19T18:56:48.772 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.753+0000 7fa429d12700 1 --2- 172.21.15.125:0/1090646993 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fa4100383c0 0x7fa41003a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:48.772 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.753+0000 7fa429d12700 1 --2- 172.21.15.125:0/1090646993 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fa4100383c0 0x7fa41003a880 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa414006fd0 tx=0x7fa414006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:48.776 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:48.758+0000 7fa41b7fe700 1 -- 172.21.15.125:0/1090646993 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa41c01ae20 con 0x7fa4240ff780 2024-02-19T18:56:49.037 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:49.019+0000 7fa42c777700 1 -- 172.21.15.125:0/1090646993 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa4240623c0 con 0x7fa4240ff780 2024-02-19T18:56:49.038 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:49.020+0000 7fa41b7fe700 1 -- 172.21.15.125:0/1090646993 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7fa41c01ac40 con 0x7fa4240ff780 2024-02-19T18:56:49.038 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:56:49.038 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":1,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","modified":"2024-02-19T18:54:24.798664Z","created":"2024-02-19T18:54:24.798664Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:56:49.040 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:49.022+0000 7fa42c777700 1 -- 172.21.15.125:0/1090646993 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fa4100383c0 msgr2=0x7fa41003a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:49.040 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:49.022+0000 7fa42c777700 1 --2- 172.21.15.125:0/1090646993 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fa4100383c0 0x7fa41003a880 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa414006fd0 tx=0x7fa414006e40 comp rx=0 tx=0).stop 2024-02-19T18:56:49.040 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:49.022+0000 7fa42c777700 1 -- 172.21.15.125:0/1090646993 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4240ff780 msgr2=0x7fa4241948d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:49.040 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:49.022+0000 7fa42c777700 1 --2- 172.21.15.125:0/1090646993 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4240ff780 0x7fa4241948d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00b830 tx=0x7fa41c00bd40 comp rx=0 tx=0).stop 2024-02-19T18:56:49.040 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:49.022+0000 7fa42c777700 1 -- 172.21.15.125:0/1090646993 shutdown_connections 2024-02-19T18:56:49.040 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:49.022+0000 7fa42c777700 1 --2- 172.21.15.125:0/1090646993 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7fa4100383c0 0x7fa41003a880 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:49.041 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:49.022+0000 7fa42c777700 1 --2- 172.21.15.125:0/1090646993 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4240ff780 0x7fa4241948d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:49.041 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:49.022+0000 7fa42c777700 1 -- 172.21.15.125:0/1090646993 >> 172.21.15.125:0/1090646993 conn(0x7fa4240fad00 msgr2=0x7fa4240fb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:49.041 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:49.022+0000 7fa42c777700 1 -- 172.21.15.125:0/1090646993 shutdown_connections 2024-02-19T18:56:49.041 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:49.022+0000 7fa42c777700 1 -- 172.21.15.125:0/1090646993 wait complete. 2024-02-19T18:56:49.041 INFO:teuthology.orchestra.run.smithi125.stderr:dumped monmap epoch 1 2024-02-19T18:56:49.764 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:49 smithi096 ceph-mon[29216]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:49.764 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:49 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/1090646993' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:56:50.626 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:56:50.627 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:56:50.830 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:50.874 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:51.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:51 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:51.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:51 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:51.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:51 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:51.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:51 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-19T18:56:51.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:51 smithi096 ceph-mon[29216]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:56:52.255 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.236+0000 7f3ff3f6c700 1 -- 172.21.15.125:0/4026004175 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec1008a0 msgr2=0x7f3fec100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:52.255 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.236+0000 7f3ff3f6c700 1 --2- 172.21.15.125:0/4026004175 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec1008a0 0x7f3fec100cc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400b0a0 tx=0x7f3fe400b3b0 comp rx=0 tx=0).stop 2024-02-19T18:56:52.256 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.236+0000 7f3ff3f6c700 1 -- 172.21.15.125:0/4026004175 shutdown_connections 2024-02-19T18:56:52.256 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.236+0000 7f3ff3f6c700 1 --2- 172.21.15.125:0/4026004175 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec1008a0 0x7f3fec100cc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:52.256 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.236+0000 7f3ff3f6c700 1 -- 172.21.15.125:0/4026004175 >> 172.21.15.125:0/4026004175 conn(0x7f3fec0fbe20 msgr2=0x7f3fec0fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:52.256 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.236+0000 7f3ff3f6c700 1 -- 172.21.15.125:0/4026004175 shutdown_connections 2024-02-19T18:56:52.256 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.236+0000 7f3ff3f6c700 1 -- 172.21.15.125:0/4026004175 wait complete. 2024-02-19T18:56:52.256 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.237+0000 7f3ff3f6c700 1 Processor -- start 2024-02-19T18:56:52.256 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.237+0000 7f3ff3f6c700 1 -- start start 2024-02-19T18:56:52.256 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.237+0000 7f3ff3f6c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec1008a0 0x7f3fec1959f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:52.256 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.237+0000 7f3ff3f6c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec195f30 con 0x7f3fec1008a0 2024-02-19T18:56:52.256 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.237+0000 7f3ff1d08700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec1008a0 0x7f3fec1959f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:52.256 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.237+0000 7f3ff1d08700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec1008a0 0x7f3fec1959f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.125:46846/0 (socket says 172.21.15.125:46846) 2024-02-19T18:56:52.256 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.237+0000 7f3ff1d08700 1 -- 172.21.15.125:0/567300469 learned_addr learned my addr 172.21.15.125:0/567300469 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:56:52.256 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.237+0000 7f3ff1d08700 1 -- 172.21.15.125:0/567300469 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe4009d00 con 0x7f3fec1008a0 2024-02-19T18:56:52.257 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.238+0000 7f3ff1d08700 1 --2- 172.21.15.125:0/567300469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec1008a0 0x7f3fec1959f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400b830 tx=0x7f3fe400bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:52.258 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.238+0000 7f3feaffd700 1 -- 172.21.15.125:0/567300469 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3fe400e040 con 0x7f3fec1008a0 2024-02-19T18:56:52.258 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.238+0000 7f3ff3f6c700 1 -- 172.21.15.125:0/567300469 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fec196130 con 0x7f3fec1008a0 2024-02-19T18:56:52.258 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.238+0000 7f3feaffd700 1 -- 172.21.15.125:0/567300469 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3fe4012af0 con 0x7f3fec1008a0 2024-02-19T18:56:52.258 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.238+0000 7f3feaffd700 1 -- 172.21.15.125:0/567300469 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3fe401d9f0 con 0x7f3fec1008a0 2024-02-19T18:56:52.258 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.238+0000 7f3ff3f6c700 1 -- 172.21.15.125:0/567300469 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fec196550 con 0x7f3fec1008a0 2024-02-19T18:56:52.258 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.239+0000 7f3feaffd700 1 -- 172.21.15.125:0/567300469 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 14) v1 ==== 45353+0+0 (secure 0 0 0) 0x7f3fe401dc60 con 0x7f3fec1008a0 2024-02-19T18:56:52.258 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.239+0000 7f3ff3f6c700 1 -- 172.21.15.125:0/567300469 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fec18f4c0 con 0x7f3fec1008a0 2024-02-19T18:56:52.258 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.239+0000 7f3feaffd700 1 --2- 172.21.15.125:0/567300469 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f3fd4038460 0x7f3fd403a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:52.258 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.239+0000 7f3feaffd700 1 -- 172.21.15.125:0/567300469 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3fe404ca30 con 0x7f3fec1008a0 2024-02-19T18:56:52.258 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.239+0000 7f3ff1507700 1 -- 172.21.15.125:0/567300469 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f3fd4038460 msgr2=0x7f3fd403a920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3628131135 2024-02-19T18:56:52.259 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.239+0000 7f3ff1507700 1 --2- 172.21.15.125:0/567300469 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f3fd4038460 0x7f3fd403a920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T18:56:52.262 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.244+0000 7f3feaffd700 1 -- 172.21.15.125:0/567300469 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f3fe401ab60 con 0x7f3fec1008a0 2024-02-19T18:56:52.427 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:52 smithi096 ceph-mon[29216]: from='mgr.14164 172.21.15.96:0/3014308093' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-19T18:56:52.427 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:52 smithi096 ceph-mon[29216]: mgrmap e14: smithi096.zsjdff(active, since 74s) 2024-02-19T18:56:52.458 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.440+0000 7f3ff1507700 1 -- 172.21.15.125:0/567300469 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f3fd4038460 msgr2=0x7f3fd403a920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3628131135 2024-02-19T18:56:52.458 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.440+0000 7f3ff1507700 1 --2- 172.21.15.125:0/567300469 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f3fd4038460 0x7f3fd403a920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-19T18:56:52.530 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.512+0000 7f3ff3f6c700 1 -- 172.21.15.125:0/567300469 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3fec0623c0 con 0x7f3fec1008a0 2024-02-19T18:56:52.531 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.513+0000 7f3feaffd700 1 -- 172.21.15.125:0/567300469 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f3fe401ab60 con 0x7f3fec1008a0 2024-02-19T18:56:52.531 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:56:52.531 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":1,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","modified":"2024-02-19T18:54:24.798664Z","created":"2024-02-19T18:54:24.798664Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:56:52.533 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.515+0000 7f3ff3f6c700 1 -- 172.21.15.125:0/567300469 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f3fd4038460 msgr2=0x7f3fd403a920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T18:56:52.533 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.515+0000 7f3ff3f6c700 1 --2- 172.21.15.125:0/567300469 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f3fd4038460 0x7f3fd403a920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:52.533 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.515+0000 7f3ff3f6c700 1 -- 172.21.15.125:0/567300469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec1008a0 msgr2=0x7f3fec1959f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:52.533 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.515+0000 7f3ff3f6c700 1 --2- 172.21.15.125:0/567300469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec1008a0 0x7f3fec1959f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400b830 tx=0x7f3fe400bd40 comp rx=0 tx=0).stop 2024-02-19T18:56:52.533 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.515+0000 7f3ff3f6c700 1 -- 172.21.15.125:0/567300469 shutdown_connections 2024-02-19T18:56:52.533 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.515+0000 7f3ff3f6c700 1 --2- 172.21.15.125:0/567300469 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f3fd4038460 0x7f3fd403a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:52.533 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.515+0000 7f3ff3f6c700 1 --2- 172.21.15.125:0/567300469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3fec1008a0 0x7f3fec1959f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:52.533 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.515+0000 7f3ff3f6c700 1 -- 172.21.15.125:0/567300469 >> 172.21.15.125:0/567300469 conn(0x7f3fec0fbe20 msgr2=0x7f3fec0fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:52.534 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.515+0000 7f3ff3f6c700 1 -- 172.21.15.125:0/567300469 shutdown_connections 2024-02-19T18:56:52.534 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:52.515+0000 7f3ff3f6c700 1 -- 172.21.15.125:0/567300469 wait complete. 2024-02-19T18:56:52.534 INFO:teuthology.orchestra.run.smithi125.stderr:dumped monmap epoch 1 2024-02-19T18:56:53.371 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:53 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/567300469' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:56:54.150 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:56:54.150 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:56:54.353 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:54.400 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:55.859 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.841+0000 7f75ccefb700 1 -- 172.21.15.125:0/3632901857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75c8101310 msgr2=0x7f75c8103700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:55.860 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.841+0000 7f75ccefb700 1 --2- 172.21.15.125:0/3632901857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75c8101310 0x7f75c8103700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f75b8009910 tx=0x7f75b8009c20 comp rx=0 tx=0).stop 2024-02-19T18:56:55.860 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.841+0000 7f75ccefb700 1 -- 172.21.15.125:0/3632901857 shutdown_connections 2024-02-19T18:56:55.860 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.841+0000 7f75ccefb700 1 --2- 172.21.15.125:0/3632901857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75c8101310 0x7f75c8103700 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:55.860 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.841+0000 7f75ccefb700 1 -- 172.21.15.125:0/3632901857 >> 172.21.15.125:0/3632901857 conn(0x7f75c80fad20 msgr2=0x7f75c80fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:55.860 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.841+0000 7f75ccefb700 1 -- 172.21.15.125:0/3632901857 shutdown_connections 2024-02-19T18:56:55.860 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.841+0000 7f75ccefb700 1 -- 172.21.15.125:0/3632901857 wait complete. 2024-02-19T18:56:55.861 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.842+0000 7f75ccefb700 1 Processor -- start 2024-02-19T18:56:55.861 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.842+0000 7f75ccefb700 1 -- start start 2024-02-19T18:56:55.861 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.842+0000 7f75ccefb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75c8101310 0x7f75c8195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:55.862 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.842+0000 7f75ccefb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c8195ec0 con 0x7f75c8101310 2024-02-19T18:56:55.862 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.842+0000 7f75c659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75c8101310 0x7f75c8195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:55.862 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.842+0000 7f75c659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75c8101310 0x7f75c8195980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.125:36662/0 (socket says 172.21.15.125:36662) 2024-02-19T18:56:55.862 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.842+0000 7f75c659c700 1 -- 172.21.15.125:0/298496458 learned_addr learned my addr 172.21.15.125:0/298496458 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:56:55.862 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.843+0000 7f75c659c700 1 -- 172.21.15.125:0/298496458 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b80095f0 con 0x7f75c8101310 2024-02-19T18:56:55.862 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.843+0000 7f75c659c700 1 --2- 172.21.15.125:0/298496458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75c8101310 0x7f75c8195980 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f75b8005b40 tx=0x7f75b8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:55.862 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.843+0000 7f75b77fe700 1 -- 172.21.15.125:0/298496458 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75b801d070 con 0x7f75c8101310 2024-02-19T18:56:55.862 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.843+0000 7f75b77fe700 1 -- 172.21.15.125:0/298496458 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f75b800be10 con 0x7f75c8101310 2024-02-19T18:56:55.862 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.843+0000 7f75ccefb700 1 -- 172.21.15.125:0/298496458 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c81960c0 con 0x7f75c8101310 2024-02-19T18:56:55.862 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.843+0000 7f75b77fe700 1 -- 172.21.15.125:0/298496458 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f75b800f460 con 0x7f75c8101310 2024-02-19T18:56:55.862 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.843+0000 7f75ccefb700 1 -- 172.21.15.125:0/298496458 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c8196560 con 0x7f75c8101310 2024-02-19T18:56:55.863 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.844+0000 7f75b77fe700 1 -- 172.21.15.125:0/298496458 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 14) v1 ==== 45353+0+0 (secure 0 0 0) 0x7f75b800f6d0 con 0x7f75c8101310 2024-02-19T18:56:55.863 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.844+0000 7f75ccefb700 1 -- 172.21.15.125:0/298496458 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c818f4a0 con 0x7f75c8101310 2024-02-19T18:56:55.863 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.844+0000 7f75b77fe700 1 --2- 172.21.15.125:0/298496458 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f75b0038410 0x7f75b003a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:55.863 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.844+0000 7f75b77fe700 1 -- 172.21.15.125:0/298496458 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f75b804c5a0 con 0x7f75c8101310 2024-02-19T18:56:55.863 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.844+0000 7f75c5d9b700 1 -- 172.21.15.125:0/298496458 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f75b0038410 msgr2=0x7f75b003a8d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3628131135 2024-02-19T18:56:55.863 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.844+0000 7f75c5d9b700 1 --2- 172.21.15.125:0/298496458 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f75b0038410 0x7f75b003a8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T18:56:55.867 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:55.849+0000 7f75b77fe700 1 -- 172.21.15.125:0/298496458 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f75b802a360 con 0x7f75c8101310 2024-02-19T18:56:56.063 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:56.045+0000 7f75c5d9b700 1 -- 172.21.15.125:0/298496458 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f75b0038410 msgr2=0x7f75b003a8d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.96:6800/3628131135 2024-02-19T18:56:56.063 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:56.045+0000 7f75c5d9b700 1 --2- 172.21.15.125:0/298496458 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f75b0038410 0x7f75b003a8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-19T18:56:56.129 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:56.111+0000 7f75ccefb700 1 -- 172.21.15.125:0/298496458 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f75c802cc70 con 0x7f75c8101310 2024-02-19T18:56:56.129 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:56.111+0000 7f75b77fe700 1 -- 172.21.15.125:0/298496458 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f75b8027030 con 0x7f75c8101310 2024-02-19T18:56:56.130 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:56:56.130 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":1,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","modified":"2024-02-19T18:54:24.798664Z","created":"2024-02-19T18:54:24.798664Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:56:56.131 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:56.113+0000 7f75ccefb700 1 -- 172.21.15.125:0/298496458 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f75b0038410 msgr2=0x7f75b003a8d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T18:56:56.132 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:56.113+0000 7f75ccefb700 1 --2- 172.21.15.125:0/298496458 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f75b0038410 0x7f75b003a8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:56.132 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:56.113+0000 7f75ccefb700 1 -- 172.21.15.125:0/298496458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75c8101310 msgr2=0x7f75c8195980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:56.132 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:56.113+0000 7f75ccefb700 1 --2- 172.21.15.125:0/298496458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75c8101310 0x7f75c8195980 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f75b8005b40 tx=0x7f75b8004740 comp rx=0 tx=0).stop 2024-02-19T18:56:56.132 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:56.113+0000 7f75ccefb700 1 -- 172.21.15.125:0/298496458 shutdown_connections 2024-02-19T18:56:56.132 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:56.113+0000 7f75ccefb700 1 --2- 172.21.15.125:0/298496458 >> [v2:172.21.15.96:6800/3628131135,v1:172.21.15.96:6801/3628131135] conn(0x7f75b0038410 0x7f75b003a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:56.132 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:56.113+0000 7f75ccefb700 1 --2- 172.21.15.125:0/298496458 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75c8101310 0x7f75c8195980 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:56.132 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:56.113+0000 7f75ccefb700 1 -- 172.21.15.125:0/298496458 >> 172.21.15.125:0/298496458 conn(0x7f75c80fad20 msgr2=0x7f75c80fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:56.132 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:56.113+0000 7f75ccefb700 1 -- 172.21.15.125:0/298496458 shutdown_connections 2024-02-19T18:56:56.132 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:56.113+0000 7f75ccefb700 1 -- 172.21.15.125:0/298496458 wait complete. 2024-02-19T18:56:56.133 INFO:teuthology.orchestra.run.smithi125.stderr:dumped monmap epoch 1 2024-02-19T18:56:56.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:56 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/298496458' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:56:57.718 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:56:57.718 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:56:57.918 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:57.965 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:56:58.033 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:57 smithi096 ceph-mon[29216]: Active manager daemon smithi096.zsjdff restarted 2024-02-19T18:56:58.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:57 smithi096 ceph-mon[29216]: Activating manager daemon smithi096.zsjdff 2024-02-19T18:56:58.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:57 smithi096 ceph-mon[29216]: osdmap e5: 0 total, 0 up, 0 in 2024-02-19T18:56:58.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:57 smithi096 ceph-mon[29216]: mgrmap e15: smithi096.zsjdff(active, starting, since 0.00310806s) 2024-02-19T18:56:58.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:57 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2024-02-19T18:56:58.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:57 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr metadata", "who": "smithi096.zsjdff", "id": "smithi096.zsjdff"}]: dispatch 2024-02-19T18:56:58.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:57 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T18:56:58.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:57 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T18:56:58.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:57 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T18:56:58.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:57 smithi096 ceph-mon[29216]: Manager daemon smithi096.zsjdff is now available 2024-02-19T18:56:58.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:57 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:56:58.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:57 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:56:59.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:58 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:59.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:58 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:56:59.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:58 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.zsjdff/mirror_snapshot_schedule"}]: dispatch 2024-02-19T18:56:59.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:58 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.zsjdff/trash_purge_schedule"}]: dispatch 2024-02-19T18:56:59.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:58 smithi096 ceph-mon[29216]: [19/Feb/2024:18:56:58] ENGINE Bus STARTING 2024-02-19T18:56:59.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:58 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:56:59.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:56:58 smithi096 ceph-mon[29216]: mgrmap e16: smithi096.zsjdff(active, since 1.00767s) 2024-02-19T18:56:59.496 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.478+0000 7f35ac659700 1 -- 172.21.15.125:0/3901583078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35a40ff780 msgr2=0x7f35a40ffba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.478+0000 7f35ac659700 1 --2- 172.21.15.125:0/3901583078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35a40ff780 0x7f35a40ffba0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f35a0009910 tx=0x7f35a0009c20 comp rx=0 tx=0).stop 2024-02-19T18:56:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.478+0000 7f35ac659700 1 -- 172.21.15.125:0/3901583078 shutdown_connections 2024-02-19T18:56:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.478+0000 7f35ac659700 1 --2- 172.21.15.125:0/3901583078 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35a40ff780 0x7f35a40ffba0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.478+0000 7f35ac659700 1 -- 172.21.15.125:0/3901583078 >> 172.21.15.125:0/3901583078 conn(0x7f35a40fad20 msgr2=0x7f35a40fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.478+0000 7f35ac659700 1 -- 172.21.15.125:0/3901583078 shutdown_connections 2024-02-19T18:56:59.497 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.478+0000 7f35ac659700 1 -- 172.21.15.125:0/3901583078 wait complete. 2024-02-19T18:56:59.499 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.479+0000 7f35ac659700 1 Processor -- start 2024-02-19T18:56:59.499 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.479+0000 7f35ac659700 1 -- start start 2024-02-19T18:56:59.499 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.479+0000 7f35ac659700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35a40ff780 0x7f35a41948a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:59.499 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.479+0000 7f35ac659700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4194de0 con 0x7f35a40ff780 2024-02-19T18:56:59.499 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.479+0000 7f35aa3f5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35a40ff780 0x7f35a41948a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:59.499 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.479+0000 7f35aa3f5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35a40ff780 0x7f35a41948a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.125:36686/0 (socket says 172.21.15.125:36686) 2024-02-19T18:56:59.499 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.479+0000 7f35aa3f5700 1 -- 172.21.15.125:0/3126872544 learned_addr learned my addr 172.21.15.125:0/3126872544 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:56:59.499 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.480+0000 7f35aa3f5700 1 -- 172.21.15.125:0/3126872544 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a00095f0 con 0x7f35a40ff780 2024-02-19T18:56:59.499 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.480+0000 7f35aa3f5700 1 --2- 172.21.15.125:0/3126872544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35a40ff780 0x7f35a41948a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f35a0005b40 tx=0x7f35a0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:59.499 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.480+0000 7f359b7fe700 1 -- 172.21.15.125:0/3126872544 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35a001d070 con 0x7f35a40ff780 2024-02-19T18:56:59.499 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.480+0000 7f359b7fe700 1 -- 172.21.15.125:0/3126872544 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f35a000be10 con 0x7f35a40ff780 2024-02-19T18:56:59.500 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.480+0000 7f35ac659700 1 -- 172.21.15.125:0/3126872544 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a4194fe0 con 0x7f35a40ff780 2024-02-19T18:56:59.500 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.480+0000 7f359b7fe700 1 -- 172.21.15.125:0/3126872544 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f35a000f460 con 0x7f35a40ff780 2024-02-19T18:56:59.500 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.480+0000 7f35ac659700 1 -- 172.21.15.125:0/3126872544 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a4195480 con 0x7f35a40ff780 2024-02-19T18:56:59.501 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.481+0000 7f359b7fe700 1 -- 172.21.15.125:0/3126872544 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 16) v1 ==== 45204+0+0 (secure 0 0 0) 0x7f35a000f6d0 con 0x7f35a40ff780 2024-02-19T18:56:59.501 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.481+0000 7f35ac659700 1 -- 172.21.15.125:0/3126872544 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a418e3a0 con 0x7f35a40ff780 2024-02-19T18:56:59.501 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.481+0000 7f359b7fe700 1 --2- 172.21.15.125:0/3126872544 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f3590038270 0x7f359003a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:56:59.501 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.481+0000 7f359b7fe700 1 -- 172.21.15.125:0/3126872544 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f35a004c360 con 0x7f35a40ff780 2024-02-19T18:56:59.501 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.482+0000 7f35a9bf4700 1 --2- 172.21.15.125:0/3126872544 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f3590038270 0x7f359003a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:56:59.501 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.482+0000 7f35a9bf4700 1 --2- 172.21.15.125:0/3126872544 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f3590038270 0x7f359003a730 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3594006fd0 tx=0x7f3594006e40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:56:59.504 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.486+0000 7f359b7fe700 1 -- 172.21.15.125:0/3126872544 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f35a002a360 con 0x7f35a40ff780 2024-02-19T18:56:59.781 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.764+0000 7f35ac659700 1 -- 172.21.15.125:0/3126872544 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f35a402cc70 con 0x7f35a40ff780 2024-02-19T18:56:59.782 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.765+0000 7f359b7fe700 1 -- 172.21.15.125:0/3126872544 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f35a0027020 con 0x7f35a40ff780 2024-02-19T18:56:59.782 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:56:59.782 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":1,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","modified":"2024-02-19T18:54:24.798664Z","created":"2024-02-19T18:54:24.798664Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:56:59.784 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.767+0000 7f35ac659700 1 -- 172.21.15.125:0/3126872544 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f3590038270 msgr2=0x7f359003a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:59.784 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.767+0000 7f35ac659700 1 --2- 172.21.15.125:0/3126872544 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f3590038270 0x7f359003a730 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f3594006fd0 tx=0x7f3594006e40 comp rx=0 tx=0).stop 2024-02-19T18:56:59.784 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.767+0000 7f35ac659700 1 -- 172.21.15.125:0/3126872544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35a40ff780 msgr2=0x7f35a41948a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:56:59.785 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.767+0000 7f35ac659700 1 --2- 172.21.15.125:0/3126872544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35a40ff780 0x7f35a41948a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f35a0005b40 tx=0x7f35a0004740 comp rx=0 tx=0).stop 2024-02-19T18:56:59.785 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.767+0000 7f35ac659700 1 -- 172.21.15.125:0/3126872544 shutdown_connections 2024-02-19T18:56:59.785 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.767+0000 7f35ac659700 1 --2- 172.21.15.125:0/3126872544 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f3590038270 0x7f359003a730 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:59.785 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.767+0000 7f35ac659700 1 --2- 172.21.15.125:0/3126872544 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35a40ff780 0x7f35a41948a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:56:59.785 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.767+0000 7f35ac659700 1 -- 172.21.15.125:0/3126872544 >> 172.21.15.125:0/3126872544 conn(0x7f35a40fad20 msgr2=0x7f35a40fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:56:59.785 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.767+0000 7f35ac659700 1 -- 172.21.15.125:0/3126872544 shutdown_connections 2024-02-19T18:56:59.785 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:56:59.767+0000 7f35ac659700 1 -- 172.21.15.125:0/3126872544 wait complete. 2024-02-19T18:56:59.785 INFO:teuthology.orchestra.run.smithi125.stderr:dumped monmap epoch 1 2024-02-19T18:57:00.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:00 smithi096 ceph-mon[29216]: [19/Feb/2024:18:56:58] ENGINE Serving on https://172.21.15.96:7150 2024-02-19T18:57:00.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:00 smithi096 ceph-mon[29216]: [19/Feb/2024:18:56:58] ENGINE Serving on http://172.21.15.96:8765 2024-02-19T18:57:00.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:00 smithi096 ceph-mon[29216]: [19/Feb/2024:18:56:58] ENGINE Bus STARTED 2024-02-19T18:57:00.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:00 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:00.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:00 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/3126872544' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:57:00.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:00 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:01.402 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:01 smithi096 ceph-mon[29216]: mgrmap e17: smithi096.zsjdff(active, since 2s) 2024-02-19T18:57:01.413 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:57:01.413 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:57:01.983 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:57:02.035 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-19T18:57:03.283 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:02 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:03.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:02 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:03.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:02 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:03.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:02 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:03.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:02 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:57:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.168+0000 7f87842cd700 1 -- 172.21.15.125:0/2162351949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f877c0fefe0 msgr2=0x7f877c0ff3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.168+0000 7f87842cd700 1 --2- 172.21.15.125:0/2162351949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f877c0fefe0 0x7f877c0ff3c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8778009910 tx=0x7f8778009c20 comp rx=0 tx=0).stop 2024-02-19T18:57:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.168+0000 7f87842cd700 1 -- 172.21.15.125:0/2162351949 shutdown_connections 2024-02-19T18:57:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.168+0000 7f87842cd700 1 --2- 172.21.15.125:0/2162351949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f877c0fefe0 0x7f877c0ff3c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.168+0000 7f87842cd700 1 -- 172.21.15.125:0/2162351949 >> 172.21.15.125:0/2162351949 conn(0x7f877c075e40 msgr2=0x7f877c076250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:57:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.168+0000 7f87842cd700 1 -- 172.21.15.125:0/2162351949 shutdown_connections 2024-02-19T18:57:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.168+0000 7f87842cd700 1 -- 172.21.15.125:0/2162351949 wait complete. 2024-02-19T18:57:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.169+0000 7f87842cd700 1 Processor -- start 2024-02-19T18:57:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.169+0000 7f87842cd700 1 -- start start 2024-02-19T18:57:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.169+0000 7f87842cd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f877c0fefe0 0x7f877c195cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.169+0000 7f87842cd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c196200 con 0x7f877c0fefe0 2024-02-19T18:57:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.169+0000 7f8782069700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f877c0fefe0 0x7f877c195cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.169+0000 7f8782069700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f877c0fefe0 0x7f877c195cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.125:42936/0 (socket says 172.21.15.125:42936) 2024-02-19T18:57:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.169+0000 7f8782069700 1 -- 172.21.15.125:0/3317279304 learned_addr learned my addr 172.21.15.125:0/3317279304 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:57:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.169+0000 7f8782069700 1 -- 172.21.15.125:0/3317279304 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87780095f0 con 0x7f877c0fefe0 2024-02-19T18:57:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.169+0000 7f8782069700 1 --2- 172.21.15.125:0/3317279304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f877c0fefe0 0x7f877c195cc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8778005b40 tx=0x7f8778004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:57:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.170+0000 7f87737fe700 1 -- 172.21.15.125:0/3317279304 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f877801d070 con 0x7f877c0fefe0 2024-02-19T18:57:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.170+0000 7f87842cd700 1 -- 172.21.15.125:0/3317279304 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877c196400 con 0x7f877c0fefe0 2024-02-19T18:57:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.170+0000 7f87737fe700 1 -- 172.21.15.125:0/3317279304 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f87780044d0 con 0x7f877c0fefe0 2024-02-19T18:57:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.170+0000 7f87842cd700 1 -- 172.21.15.125:0/3317279304 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877c196840 con 0x7f877c0fefe0 2024-02-19T18:57:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.170+0000 7f87737fe700 1 -- 172.21.15.125:0/3317279304 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f87780039a0 con 0x7f877c0fefe0 2024-02-19T18:57:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.170+0000 7f87737fe700 1 -- 172.21.15.125:0/3317279304 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 45396+0+0 (secure 0 0 0) 0x7f8778003b00 con 0x7f877c0fefe0 2024-02-19T18:57:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.170+0000 7f87842cd700 1 -- 172.21.15.125:0/3317279304 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877c0623c0 con 0x7f877c0fefe0 2024-02-19T18:57:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.171+0000 7f87737fe700 1 --2- 172.21.15.125:0/3317279304 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f87680384b0 0x7f876803a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.171+0000 7f87737fe700 1 -- 172.21.15.125:0/3317279304 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f877804c590 con 0x7f877c0fefe0 2024-02-19T18:57:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.171+0000 7f8781868700 1 --2- 172.21.15.125:0/3317279304 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f87680384b0 0x7f876803a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.171+0000 7f8781868700 1 --2- 172.21.15.125:0/3317279304 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f87680384b0 0x7f876803a970 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f876c006fd0 tx=0x7f876c006e40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:57:04.209 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.176+0000 7f87737fe700 1 -- 172.21.15.125:0/3317279304 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f877802a540 con 0x7f877c0fefe0 2024-02-19T18:57:04.473 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.456+0000 7f87842cd700 1 -- 172.21.15.125:0/3317279304 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f877c1089a0 con 0x7f877c0fefe0 2024-02-19T18:57:04.474 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.456+0000 7f87737fe700 1 -- 172.21.15.125:0/3317279304 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f877802a360 con 0x7f877c0fefe0 2024-02-19T18:57:04.474 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:57:04.474 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":1,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","modified":"2024-02-19T18:54:24.798664Z","created":"2024-02-19T18:54:24.798664Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:57:04.476 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.458+0000 7f87842cd700 1 -- 172.21.15.125:0/3317279304 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f87680384b0 msgr2=0x7f876803a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:04.476 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.458+0000 7f87842cd700 1 --2- 172.21.15.125:0/3317279304 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f87680384b0 0x7f876803a970 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f876c006fd0 tx=0x7f876c006e40 comp rx=0 tx=0).stop 2024-02-19T18:57:04.476 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.458+0000 7f87842cd700 1 -- 172.21.15.125:0/3317279304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f877c0fefe0 msgr2=0x7f877c195cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:04.476 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.458+0000 7f87842cd700 1 --2- 172.21.15.125:0/3317279304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f877c0fefe0 0x7f877c195cc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8778005b40 tx=0x7f8778004c80 comp rx=0 tx=0).stop 2024-02-19T18:57:04.476 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.458+0000 7f87842cd700 1 -- 172.21.15.125:0/3317279304 shutdown_connections 2024-02-19T18:57:04.476 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.458+0000 7f87842cd700 1 --2- 172.21.15.125:0/3317279304 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f87680384b0 0x7f876803a970 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:04.476 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.458+0000 7f87842cd700 1 --2- 172.21.15.125:0/3317279304 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f877c0fefe0 0x7f877c195cc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:04.476 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.458+0000 7f87842cd700 1 -- 172.21.15.125:0/3317279304 >> 172.21.15.125:0/3317279304 conn(0x7f877c075e40 msgr2=0x7f877c104d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:57:04.476 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.459+0000 7f87842cd700 1 -- 172.21.15.125:0/3317279304 shutdown_connections 2024-02-19T18:57:04.477 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:04.459+0000 7f87842cd700 1 -- 172.21.15.125:0/3317279304 wait complete. 2024-02-19T18:57:04.477 INFO:teuthology.orchestra.run.smithi125.stderr:dumped monmap epoch 1 2024-02-19T18:57:04.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:04.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:04.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:04.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:04.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd/host:smithi125", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:57:04.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:04.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:57:04.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: Updating smithi096:/etc/ceph/ceph.conf 2024-02-19T18:57:04.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: Updating smithi125:/etc/ceph/ceph.conf 2024-02-19T18:57:04.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: Updating smithi125:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T18:57:04.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: Updating smithi096:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T18:57:04.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: Updating smithi125:/etc/ceph/ceph.client.admin.keyring 2024-02-19T18:57:04.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2024-02-19T18:57:04.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: Updating smithi125:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T18:57:04.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: Updating smithi096:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T18:57:04.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:04.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:04.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:04.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:04.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:04.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi125", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T18:57:04.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi125", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-19T18:57:04.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:04.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:04 smithi096 ceph-mon[29216]: Deploying daemon ceph-exporter.smithi125 on smithi125 2024-02-19T18:57:05.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:05 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/3317279304' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:57:06.082 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:57:06.083 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:57:06.308 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T18:57:08.027 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.007+0000 7f3ef3c79700 1 -- 172.21.15.125:0/1193461430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eec106810 msgr2=0x7f3eec106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:08.027 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.007+0000 7f3ef3c79700 1 --2- 172.21.15.125:0/1193461430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eec106810 0x7f3eec106bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8009910 tx=0x7f3ee8009c20 comp rx=0 tx=0).stop 2024-02-19T18:57:08.027 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.007+0000 7f3ef3c79700 1 -- 172.21.15.125:0/1193461430 shutdown_connections 2024-02-19T18:57:08.027 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.007+0000 7f3ef3c79700 1 --2- 172.21.15.125:0/1193461430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eec106810 0x7f3eec106bf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:08.027 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.007+0000 7f3ef3c79700 1 -- 172.21.15.125:0/1193461430 >> 172.21.15.125:0/1193461430 conn(0x7f3eec0fc320 msgr2=0x7f3eec0fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:57:08.027 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.007+0000 7f3ef3c79700 1 -- 172.21.15.125:0/1193461430 shutdown_connections 2024-02-19T18:57:08.027 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.007+0000 7f3ef3c79700 1 -- 172.21.15.125:0/1193461430 wait complete. 2024-02-19T18:57:08.027 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.008+0000 7f3ef3c79700 1 Processor -- start 2024-02-19T18:57:08.027 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.008+0000 7f3ef3c79700 1 -- start start 2024-02-19T18:57:08.028 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.008+0000 7f3ef3c79700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eec106810 0x7f3eec19bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:08.028 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.008+0000 7f3ef3c79700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec19c010 con 0x7f3eec106810 2024-02-19T18:57:08.028 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.008+0000 7f3ef1a15700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eec106810 0x7f3eec19bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:08.028 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.008+0000 7f3ef1a15700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eec106810 0x7f3eec19bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.125:42950/0 (socket says 172.21.15.125:42950) 2024-02-19T18:57:08.028 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.008+0000 7f3ef1a15700 1 -- 172.21.15.125:0/1203311659 learned_addr learned my addr 172.21.15.125:0/1203311659 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:57:08.028 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.009+0000 7f3ef1a15700 1 -- 172.21.15.125:0/1203311659 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee80095f0 con 0x7f3eec106810 2024-02-19T18:57:08.028 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.009+0000 7f3ef1a15700 1 --2- 172.21.15.125:0/1203311659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eec106810 0x7f3eec19bad0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8005b40 tx=0x7f3ee8004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:57:08.028 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.009+0000 7f3ee2ffd700 1 -- 172.21.15.125:0/1203311659 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ee801d070 con 0x7f3eec106810 2024-02-19T18:57:08.028 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.009+0000 7f3ef3c79700 1 -- 172.21.15.125:0/1203311659 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eec19c210 con 0x7f3eec106810 2024-02-19T18:57:08.028 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.009+0000 7f3ee2ffd700 1 -- 172.21.15.125:0/1203311659 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3ee80044d0 con 0x7f3eec106810 2024-02-19T18:57:08.028 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.009+0000 7f3ef3c79700 1 -- 172.21.15.125:0/1203311659 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eec195b50 con 0x7f3eec106810 2024-02-19T18:57:08.028 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.009+0000 7f3ee2ffd700 1 -- 172.21.15.125:0/1203311659 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ee8003910 con 0x7f3eec106810 2024-02-19T18:57:08.029 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.010+0000 7f3ef3c79700 1 -- 172.21.15.125:0/1203311659 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eec0623c0 con 0x7f3eec106810 2024-02-19T18:57:08.029 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.010+0000 7f3ee2ffd700 1 -- 172.21.15.125:0/1203311659 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 45396+0+0 (secure 0 0 0) 0x7f3ee800b960 con 0x7f3eec106810 2024-02-19T18:57:08.029 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.010+0000 7f3ee2ffd700 1 --2- 172.21.15.125:0/1203311659 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f3ed80384b0 0x7f3ed803a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:08.029 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.010+0000 7f3ee2ffd700 1 -- 172.21.15.125:0/1203311659 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f3ee804c630 con 0x7f3eec106810 2024-02-19T18:57:08.029 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.010+0000 7f3ef1214700 1 --2- 172.21.15.125:0/1203311659 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f3ed80384b0 0x7f3ed803a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:08.029 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.011+0000 7f3ef1214700 1 --2- 172.21.15.125:0/1203311659 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f3ed80384b0 0x7f3ed803a970 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3edc006fd0 tx=0x7f3edc006e40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:57:08.032 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.015+0000 7f3ee2ffd700 1 -- 172.21.15.125:0/1203311659 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f3ee802a540 con 0x7f3eec106810 2024-02-19T18:57:08.313 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.296+0000 7f3ef3c79700 1 -- 172.21.15.125:0/1203311659 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3eec1965d0 con 0x7f3eec106810 2024-02-19T18:57:08.314 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.296+0000 7f3ee2ffd700 1 -- 172.21.15.125:0/1203311659 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f3ee802a360 con 0x7f3eec106810 2024-02-19T18:57:08.314 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:57:08.314 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":1,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","modified":"2024-02-19T18:54:24.798664Z","created":"2024-02-19T18:54:24.798664Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:57:08.316 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.299+0000 7f3ef3c79700 1 -- 172.21.15.125:0/1203311659 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f3ed80384b0 msgr2=0x7f3ed803a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:08.316 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.299+0000 7f3ef3c79700 1 --2- 172.21.15.125:0/1203311659 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f3ed80384b0 0x7f3ed803a970 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3edc006fd0 tx=0x7f3edc006e40 comp rx=0 tx=0).stop 2024-02-19T18:57:08.316 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.299+0000 7f3ef3c79700 1 -- 172.21.15.125:0/1203311659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eec106810 msgr2=0x7f3eec19bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:08.317 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.299+0000 7f3ef3c79700 1 --2- 172.21.15.125:0/1203311659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eec106810 0x7f3eec19bad0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8005b40 tx=0x7f3ee8004c80 comp rx=0 tx=0).stop 2024-02-19T18:57:08.317 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.299+0000 7f3ef3c79700 1 -- 172.21.15.125:0/1203311659 shutdown_connections 2024-02-19T18:57:08.317 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.299+0000 7f3ef3c79700 1 --2- 172.21.15.125:0/1203311659 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f3ed80384b0 0x7f3ed803a970 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:08.317 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.299+0000 7f3ef3c79700 1 --2- 172.21.15.125:0/1203311659 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eec106810 0x7f3eec19bad0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:08.317 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.299+0000 7f3ef3c79700 1 -- 172.21.15.125:0/1203311659 >> 172.21.15.125:0/1203311659 conn(0x7f3eec0fc320 msgr2=0x7f3eec108c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:57:08.317 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.299+0000 7f3ef3c79700 1 -- 172.21.15.125:0/1203311659 shutdown_connections 2024-02-19T18:57:08.317 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:08.299+0000 7f3ef3c79700 1 -- 172.21.15.125:0/1203311659 wait complete. 2024-02-19T18:57:08.317 INFO:teuthology.orchestra.run.smithi125.stderr:dumped monmap epoch 1 2024-02-19T18:57:08.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:08 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/1203311659' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:57:10.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:09 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:10.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:09 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:10.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:09 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:10.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:09 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:10.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:09 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi125", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T18:57:10.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:09 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi125", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-19T18:57:10.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:09 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:10.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:09 smithi096 ceph-mon[29216]: Deploying daemon crash.smithi125 on smithi125 2024-02-19T18:57:10.161 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:57:10.161 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:57:10.373 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T18:57:11.947 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.929+0000 7f722474e700 1 -- 172.21.15.125:0/4140206762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f721c105780 msgr2=0x7f721c105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:11.948 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.929+0000 7f722474e700 1 --2- 172.21.15.125:0/4140206762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f721c105780 0x7f721c105b60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7218009910 tx=0x7f7218009c20 comp rx=0 tx=0).stop 2024-02-19T18:57:11.948 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.929+0000 7f722474e700 1 -- 172.21.15.125:0/4140206762 shutdown_connections 2024-02-19T18:57:11.948 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.929+0000 7f722474e700 1 --2- 172.21.15.125:0/4140206762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f721c105780 0x7f721c105b60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:11.948 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.929+0000 7f722474e700 1 -- 172.21.15.125:0/4140206762 >> 172.21.15.125:0/4140206762 conn(0x7f721c075290 msgr2=0x7f721c0756a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:57:11.948 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.929+0000 7f722474e700 1 -- 172.21.15.125:0/4140206762 shutdown_connections 2024-02-19T18:57:11.948 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.929+0000 7f722474e700 1 -- 172.21.15.125:0/4140206762 wait complete. 2024-02-19T18:57:11.948 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.930+0000 7f722474e700 1 Processor -- start 2024-02-19T18:57:11.948 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.930+0000 7f722474e700 1 -- start start 2024-02-19T18:57:11.948 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.930+0000 7f722474e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f721c105780 0x7f721c0fc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:11.948 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.930+0000 7f722474e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c0fe760 con 0x7f721c105780 2024-02-19T18:57:11.948 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.930+0000 7f72224ea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f721c105780 0x7f721c0fc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:11.948 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.930+0000 7f72224ea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f721c105780 0x7f721c0fc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.125:42980/0 (socket says 172.21.15.125:42980) 2024-02-19T18:57:11.949 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.930+0000 7f72224ea700 1 -- 172.21.15.125:0/2861831117 learned_addr learned my addr 172.21.15.125:0/2861831117 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:57:11.950 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.931+0000 7f72224ea700 1 -- 172.21.15.125:0/2861831117 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72180095f0 con 0x7f721c105780 2024-02-19T18:57:11.950 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.931+0000 7f72224ea700 1 --2- 172.21.15.125:0/2861831117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f721c105780 0x7f721c0fc7e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7218005b40 tx=0x7f7218004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:57:11.950 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.931+0000 7f72137fe700 1 -- 172.21.15.125:0/2861831117 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f721801d070 con 0x7f721c105780 2024-02-19T18:57:11.950 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.931+0000 7f722474e700 1 -- 172.21.15.125:0/2861831117 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721c0fcd20 con 0x7f721c105780 2024-02-19T18:57:11.950 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.931+0000 7f72137fe700 1 -- 172.21.15.125:0/2861831117 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f72180044d0 con 0x7f721c105780 2024-02-19T18:57:11.950 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.931+0000 7f72137fe700 1 -- 172.21.15.125:0/2861831117 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7218003930 con 0x7f721c105780 2024-02-19T18:57:11.950 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.931+0000 7f722474e700 1 -- 172.21.15.125:0/2861831117 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721c0fd1a0 con 0x7f721c105780 2024-02-19T18:57:11.951 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.932+0000 7f72137fe700 1 -- 172.21.15.125:0/2861831117 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 45396+0+0 (secure 0 0 0) 0x7f721800b960 con 0x7f721c105780 2024-02-19T18:57:11.951 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.932+0000 7f722474e700 1 -- 172.21.15.125:0/2861831117 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721c0623c0 con 0x7f721c105780 2024-02-19T18:57:11.951 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.932+0000 7f72137fe700 1 --2- 172.21.15.125:0/2861831117 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f7208038500 0x7f720803a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:11.951 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.932+0000 7f72137fe700 1 -- 172.21.15.125:0/2861831117 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f721804c480 con 0x7f721c105780 2024-02-19T18:57:11.951 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.932+0000 7f7221ce9700 1 --2- 172.21.15.125:0/2861831117 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f7208038500 0x7f720803a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:11.951 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.933+0000 7f7221ce9700 1 --2- 172.21.15.125:0/2861831117 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f7208038500 0x7f720803a9c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f720c006fd0 tx=0x7f720c006e40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:57:11.954 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:11.937+0000 7f72137fe700 1 -- 172.21.15.125:0/2861831117 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f721802a540 con 0x7f721c105780 2024-02-19T18:57:12.223 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:12.205+0000 7f722474e700 1 -- 172.21.15.125:0/2861831117 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f721c0fd590 con 0x7f721c105780 2024-02-19T18:57:12.223 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:12.206+0000 7f72137fe700 1 -- 172.21.15.125:0/2861831117 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f721802a360 con 0x7f721c105780 2024-02-19T18:57:12.224 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:57:12.224 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":1,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","modified":"2024-02-19T18:54:24.798664Z","created":"2024-02-19T18:54:24.798664Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:57:12.226 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:12.208+0000 7f722474e700 1 -- 172.21.15.125:0/2861831117 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f7208038500 msgr2=0x7f720803a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:12.226 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:12.208+0000 7f722474e700 1 --2- 172.21.15.125:0/2861831117 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f7208038500 0x7f720803a9c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f720c006fd0 tx=0x7f720c006e40 comp rx=0 tx=0).stop 2024-02-19T18:57:12.226 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:12.208+0000 7f722474e700 1 -- 172.21.15.125:0/2861831117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f721c105780 msgr2=0x7f721c0fc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:12.226 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:12.208+0000 7f722474e700 1 --2- 172.21.15.125:0/2861831117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f721c105780 0x7f721c0fc7e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7218005b40 tx=0x7f7218004c80 comp rx=0 tx=0).stop 2024-02-19T18:57:12.226 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:12.208+0000 7f722474e700 1 -- 172.21.15.125:0/2861831117 shutdown_connections 2024-02-19T18:57:12.226 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:12.208+0000 7f722474e700 1 --2- 172.21.15.125:0/2861831117 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f7208038500 0x7f720803a9c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:12.226 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:12.208+0000 7f722474e700 1 --2- 172.21.15.125:0/2861831117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f721c105780 0x7f721c0fc7e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:12.226 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:12.208+0000 7f722474e700 1 -- 172.21.15.125:0/2861831117 >> 172.21.15.125:0/2861831117 conn(0x7f721c075290 msgr2=0x7f721c067f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:57:12.226 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:12.208+0000 7f722474e700 1 -- 172.21.15.125:0/2861831117 shutdown_connections 2024-02-19T18:57:12.227 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:12.208+0000 7f722474e700 1 -- 172.21.15.125:0/2861831117 wait complete. 2024-02-19T18:57:12.227 INFO:teuthology.orchestra.run.smithi125.stderr:dumped monmap epoch 1 2024-02-19T18:57:12.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:12 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/2861831117' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:57:13.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:13 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:13.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:13 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:13.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:13 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:13.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:13 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:13.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:13 smithi096 ceph-mon[29216]: Deploying daemon node-exporter.smithi125 on smithi125 2024-02-19T18:57:13.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:13 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:13.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:13 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:57:14.013 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:57:14.014 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:57:14.213 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T18:57:17.266 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.247+0000 7f9fa3e5d700 1 -- 172.21.15.125:0/749713695 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f9c106820 msgr2=0x7f9f9c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:17.266 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.247+0000 7f9fa3e5d700 1 --2- 172.21.15.125:0/749713695 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f9c106820 0x7f9f9c106c00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009910 tx=0x7f9f98009c20 comp rx=0 tx=0).stop 2024-02-19T18:57:17.266 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.247+0000 7f9fa3e5d700 1 -- 172.21.15.125:0/749713695 shutdown_connections 2024-02-19T18:57:17.266 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.247+0000 7f9fa3e5d700 1 --2- 172.21.15.125:0/749713695 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f9c106820 0x7f9f9c106c00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:17.267 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.247+0000 7f9fa3e5d700 1 -- 172.21.15.125:0/749713695 >> 172.21.15.125:0/749713695 conn(0x7f9f9c0fc350 msgr2=0x7f9f9c0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:57:17.267 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.247+0000 7f9fa3e5d700 1 -- 172.21.15.125:0/749713695 shutdown_connections 2024-02-19T18:57:17.267 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.247+0000 7f9fa3e5d700 1 -- 172.21.15.125:0/749713695 wait complete. 2024-02-19T18:57:17.267 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.248+0000 7f9fa3e5d700 1 Processor -- start 2024-02-19T18:57:17.267 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.248+0000 7f9fa3e5d700 1 -- start start 2024-02-19T18:57:17.267 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.248+0000 7f9fa3e5d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f9c106820 0x7f9f9c073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:17.267 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.248+0000 7f9fa3e5d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9c075060 con 0x7f9f9c106820 2024-02-19T18:57:17.267 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.248+0000 7f9fa1bf9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f9c106820 0x7f9f9c073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:17.267 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.248+0000 7f9fa1bf9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f9c106820 0x7f9f9c073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.125:60086/0 (socket says 172.21.15.125:60086) 2024-02-19T18:57:17.267 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.248+0000 7f9fa1bf9700 1 -- 172.21.15.125:0/567055887 learned_addr learned my addr 172.21.15.125:0/567055887 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:57:17.267 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.248+0000 7f9fa1bf9700 1 -- 172.21.15.125:0/567055887 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f980095f0 con 0x7f9f9c106820 2024-02-19T18:57:17.268 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.249+0000 7f9fa1bf9700 1 --2- 172.21.15.125:0/567055887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f9c106820 0x7f9f9c073090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9f98005b40 tx=0x7f9f98004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:57:17.268 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.249+0000 7f9f92ffd700 1 -- 172.21.15.125:0/567055887 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f9801d070 con 0x7f9f9c106820 2024-02-19T18:57:17.268 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.249+0000 7f9fa3e5d700 1 -- 172.21.15.125:0/567055887 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9c073690 con 0x7f9f9c106820 2024-02-19T18:57:17.268 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.249+0000 7f9f92ffd700 1 -- 172.21.15.125:0/567055887 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9f980044d0 con 0x7f9f9c106820 2024-02-19T18:57:17.268 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.249+0000 7f9f92ffd700 1 -- 172.21.15.125:0/567055887 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9f98003910 con 0x7f9f9c106820 2024-02-19T18:57:17.268 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.249+0000 7f9fa3e5d700 1 -- 172.21.15.125:0/567055887 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f9c073b10 con 0x7f9f9c106820 2024-02-19T18:57:17.269 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.250+0000 7f9f92ffd700 1 -- 172.21.15.125:0/567055887 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 45396+0+0 (secure 0 0 0) 0x7f9f98003c10 con 0x7f9f9c106820 2024-02-19T18:57:17.269 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.250+0000 7f9f92ffd700 1 --2- 172.21.15.125:0/567055887 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f9f880384b0 0x7f9f8803a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:17.269 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.250+0000 7f9f92ffd700 1 -- 172.21.15.125:0/567055887 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f9f9804c4b0 con 0x7f9f9c106820 2024-02-19T18:57:17.269 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.250+0000 7f9fa13f8700 1 --2- 172.21.15.125:0/567055887 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f9f880384b0 0x7f9f8803a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:17.269 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.250+0000 7f9fa3e5d700 1 -- 172.21.15.125:0/567055887 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9c104ad0 con 0x7f9f9c106820 2024-02-19T18:57:17.270 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.251+0000 7f9fa13f8700 1 --2- 172.21.15.125:0/567055887 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f9f880384b0 0x7f9f8803a970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c006fd0 tx=0x7f9f8c006e40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:57:17.272 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.255+0000 7f9f92ffd700 1 -- 172.21.15.125:0/567055887 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9f9802a540 con 0x7f9f9c106820 2024-02-19T18:57:17.565 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.548+0000 7f9fa3e5d700 1 -- 172.21.15.125:0/567055887 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9f9c10ac10 con 0x7f9f9c106820 2024-02-19T18:57:17.565 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.548+0000 7f9f92ffd700 1 -- 172.21.15.125:0/567055887 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f9f9802a360 con 0x7f9f9c106820 2024-02-19T18:57:17.566 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:57:17.566 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":1,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","modified":"2024-02-19T18:54:24.798664Z","created":"2024-02-19T18:54:24.798664Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:57:17.568 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.550+0000 7f9fa3e5d700 1 -- 172.21.15.125:0/567055887 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f9f880384b0 msgr2=0x7f9f8803a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:17.568 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.550+0000 7f9fa3e5d700 1 --2- 172.21.15.125:0/567055887 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f9f880384b0 0x7f9f8803a970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c006fd0 tx=0x7f9f8c006e40 comp rx=0 tx=0).stop 2024-02-19T18:57:17.568 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.550+0000 7f9fa3e5d700 1 -- 172.21.15.125:0/567055887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f9c106820 msgr2=0x7f9f9c073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:17.568 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.550+0000 7f9fa3e5d700 1 --2- 172.21.15.125:0/567055887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f9c106820 0x7f9f9c073090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9f98005b40 tx=0x7f9f98004c80 comp rx=0 tx=0).stop 2024-02-19T18:57:17.568 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.550+0000 7f9fa3e5d700 1 -- 172.21.15.125:0/567055887 shutdown_connections 2024-02-19T18:57:17.568 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.550+0000 7f9fa3e5d700 1 --2- 172.21.15.125:0/567055887 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f9f880384b0 0x7f9f8803a970 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:17.568 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.550+0000 7f9fa3e5d700 1 --2- 172.21.15.125:0/567055887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9f9c106820 0x7f9f9c073090 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:17.568 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.550+0000 7f9fa3e5d700 1 -- 172.21.15.125:0/567055887 >> 172.21.15.125:0/567055887 conn(0x7f9f9c0fc350 msgr2=0x7f9f9c108bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:57:17.568 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.550+0000 7f9fa3e5d700 1 -- 172.21.15.125:0/567055887 shutdown_connections 2024-02-19T18:57:17.568 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:17.550+0000 7f9fa3e5d700 1 -- 172.21.15.125:0/567055887 wait complete. 2024-02-19T18:57:17.569 INFO:teuthology.orchestra.run.smithi125.stderr:dumped monmap epoch 1 2024-02-19T18:57:18.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:18 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:18.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:18 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:18.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:18 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:18.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:18 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:18.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:18 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi125.ygdmdu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T18:57:18.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:18 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi125.ygdmdu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-19T18:57:18.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:18 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T18:57:18.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:18 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:18.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:18 smithi096 ceph-mon[29216]: Deploying daemon mgr.smithi125.ygdmdu on smithi125 2024-02-19T18:57:18.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:18 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/567055887' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:57:18.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:18 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:19.154 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:57:19.155 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:57:19.476 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:19 smithi096 ceph-mon[29216]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:19.506 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T18:57:20.857 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.838+0000 7f27d399d700 1 -- 172.21.15.125:0/3458400817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27cc073130 msgr2=0x7f27cc073510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:20.858 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.838+0000 7f27d399d700 1 --2- 172.21.15.125:0/3458400817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27cc073130 0x7f27cc073510 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009910 tx=0x7f27c8009c20 comp rx=0 tx=0).stop 2024-02-19T18:57:20.858 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.838+0000 7f27d399d700 1 -- 172.21.15.125:0/3458400817 shutdown_connections 2024-02-19T18:57:20.858 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.838+0000 7f27d399d700 1 --2- 172.21.15.125:0/3458400817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27cc073130 0x7f27cc073510 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:20.858 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.838+0000 7f27d399d700 1 -- 172.21.15.125:0/3458400817 >> 172.21.15.125:0/3458400817 conn(0x7f27cc0fc350 msgr2=0x7f27cc0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:57:20.858 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.838+0000 7f27d399d700 1 -- 172.21.15.125:0/3458400817 shutdown_connections 2024-02-19T18:57:20.858 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.838+0000 7f27d399d700 1 -- 172.21.15.125:0/3458400817 wait complete. 2024-02-19T18:57:20.858 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.839+0000 7f27d399d700 1 Processor -- start 2024-02-19T18:57:20.858 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.839+0000 7f27d399d700 1 -- start start 2024-02-19T18:57:20.858 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.839+0000 7f27d399d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27cc073130 0x7f27cc19c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:20.858 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.839+0000 7f27d399d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc19c7e0 con 0x7f27cc073130 2024-02-19T18:57:20.858 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.839+0000 7f27d1739700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27cc073130 0x7f27cc19c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:20.859 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.839+0000 7f27d1739700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27cc073130 0x7f27cc19c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.125:60100/0 (socket says 172.21.15.125:60100) 2024-02-19T18:57:20.859 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.839+0000 7f27d1739700 1 -- 172.21.15.125:0/2785699911 learned_addr learned my addr 172.21.15.125:0/2785699911 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:57:20.859 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.840+0000 7f27d1739700 1 -- 172.21.15.125:0/2785699911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c80095f0 con 0x7f27cc073130 2024-02-19T18:57:20.859 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.840+0000 7f27d1739700 1 --2- 172.21.15.125:0/2785699911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27cc073130 0x7f27cc19c2a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f27c8005b40 tx=0x7f27c8004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:57:20.859 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.840+0000 7f27c27fc700 1 -- 172.21.15.125:0/2785699911 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f27c801d070 con 0x7f27cc073130 2024-02-19T18:57:20.859 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.840+0000 7f27d399d700 1 -- 172.21.15.125:0/2785699911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27cc19c9e0 con 0x7f27cc073130 2024-02-19T18:57:20.859 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.840+0000 7f27d399d700 1 -- 172.21.15.125:0/2785699911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27cc19ce60 con 0x7f27cc073130 2024-02-19T18:57:20.859 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.840+0000 7f27c27fc700 1 -- 172.21.15.125:0/2785699911 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f27c80044d0 con 0x7f27cc073130 2024-02-19T18:57:20.859 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.840+0000 7f27c27fc700 1 -- 172.21.15.125:0/2785699911 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f27c8003910 con 0x7f27cc073130 2024-02-19T18:57:20.860 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.841+0000 7f27c27fc700 1 -- 172.21.15.125:0/2785699911 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 45396+0+0 (secure 0 0 0) 0x7f27c800b960 con 0x7f27cc073130 2024-02-19T18:57:20.860 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.841+0000 7f27d399d700 1 -- 172.21.15.125:0/2785699911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27cc0623c0 con 0x7f27cc073130 2024-02-19T18:57:20.860 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.841+0000 7f27c27fc700 1 --2- 172.21.15.125:0/2785699911 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f27b80384b0 0x7f27b803a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:20.860 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.841+0000 7f27c27fc700 1 -- 172.21.15.125:0/2785699911 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f27c804c580 con 0x7f27cc073130 2024-02-19T18:57:20.860 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.841+0000 7f27d0f38700 1 --2- 172.21.15.125:0/2785699911 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f27b80384b0 0x7f27b803a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:20.860 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.842+0000 7f27d0f38700 1 --2- 172.21.15.125:0/2785699911 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f27b80384b0 0x7f27b803a970 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f27bc006fd0 tx=0x7f27bc006e40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:57:20.863 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:20.846+0000 7f27c27fc700 1 -- 172.21.15.125:0/2785699911 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f27c802a540 con 0x7f27cc073130 2024-02-19T18:57:21.145 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:21.127+0000 7f27d399d700 1 -- 172.21.15.125:0/2785699911 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f27cc103900 con 0x7f27cc073130 2024-02-19T18:57:21.146 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:21.128+0000 7f27c27fc700 1 -- 172.21.15.125:0/2785699911 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7f27c802a360 con 0x7f27cc073130 2024-02-19T18:57:21.146 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:57:21.146 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":1,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","modified":"2024-02-19T18:54:24.798664Z","created":"2024-02-19T18:54:24.798664Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:57:21.148 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:21.130+0000 7f27d399d700 1 -- 172.21.15.125:0/2785699911 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f27b80384b0 msgr2=0x7f27b803a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:21.148 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:21.130+0000 7f27d399d700 1 --2- 172.21.15.125:0/2785699911 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f27b80384b0 0x7f27b803a970 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f27bc006fd0 tx=0x7f27bc006e40 comp rx=0 tx=0).stop 2024-02-19T18:57:21.148 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:21.130+0000 7f27d399d700 1 -- 172.21.15.125:0/2785699911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27cc073130 msgr2=0x7f27cc19c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:21.148 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:21.131+0000 7f27d399d700 1 --2- 172.21.15.125:0/2785699911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27cc073130 0x7f27cc19c2a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f27c8005b40 tx=0x7f27c8004c80 comp rx=0 tx=0).stop 2024-02-19T18:57:21.148 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:21.131+0000 7f27d399d700 1 -- 172.21.15.125:0/2785699911 shutdown_connections 2024-02-19T18:57:21.148 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:21.131+0000 7f27d399d700 1 --2- 172.21.15.125:0/2785699911 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f27b80384b0 0x7f27b803a970 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:21.148 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:21.131+0000 7f27d399d700 1 --2- 172.21.15.125:0/2785699911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27cc073130 0x7f27cc19c2a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:21.148 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:21.131+0000 7f27d399d700 1 -- 172.21.15.125:0/2785699911 >> 172.21.15.125:0/2785699911 conn(0x7f27cc0fc350 msgr2=0x7f27cc0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:57:21.149 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:21.131+0000 7f27d399d700 1 -- 172.21.15.125:0/2785699911 shutdown_connections 2024-02-19T18:57:21.149 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:21.131+0000 7f27d399d700 1 -- 172.21.15.125:0/2785699911 wait complete. 2024-02-19T18:57:21.149 INFO:teuthology.orchestra.run.smithi125.stderr:dumped monmap epoch 1 2024-02-19T18:57:21.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:21 smithi096 ceph-mon[29216]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:22.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:22 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/2785699911' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:57:22.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:22 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:22.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:22 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:22.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:22 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:22.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:22 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:22.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:22 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T18:57:22.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:22 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:22.790 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:57:22.790 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:57:23.071 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T18:57:23.533 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:23 smithi096 ceph-mon[29216]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:23.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:23 smithi096 ceph-mon[29216]: Deploying daemon mon.smithi125 on smithi125 2024-02-19T18:57:23.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:23 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:25.198 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:25 smithi125 systemd[1]: Starting Ceph mon.smithi125 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T18:57:25.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:25 smithi096 ceph-mon[29216]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:26.067 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.048+0000 7ff3fdc62700 1 -- 172.21.15.125:0/1637820060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3f8101730 msgr2=0x7ff3f80fed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:26.067 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.048+0000 7ff3fdc62700 1 --2- 172.21.15.125:0/1637820060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3f8101730 0x7ff3f80fed20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009910 tx=0x7ff3e8009c20 comp rx=0 tx=0).stop 2024-02-19T18:57:26.067 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.048+0000 7ff3fdc62700 1 -- 172.21.15.125:0/1637820060 shutdown_connections 2024-02-19T18:57:26.067 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.048+0000 7ff3fdc62700 1 --2- 172.21.15.125:0/1637820060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3f8101730 0x7ff3f80fed20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:26.068 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.048+0000 7ff3fdc62700 1 -- 172.21.15.125:0/1637820060 >> 172.21.15.125:0/1637820060 conn(0x7ff3f8075df0 msgr2=0x7ff3f8076200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:57:26.068 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.048+0000 7ff3fdc62700 1 -- 172.21.15.125:0/1637820060 shutdown_connections 2024-02-19T18:57:26.068 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.048+0000 7ff3fdc62700 1 -- 172.21.15.125:0/1637820060 wait complete. 2024-02-19T18:57:26.068 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.049+0000 7ff3fdc62700 1 Processor -- start 2024-02-19T18:57:26.068 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.049+0000 7ff3fdc62700 1 -- start start 2024-02-19T18:57:26.068 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.050+0000 7ff3fdc62700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3f8101730 0x7ff3f8102110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:26.068 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.050+0000 7ff3fdc62700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f8106100 con 0x7ff3f8101730 2024-02-19T18:57:26.068 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.050+0000 7ff3f77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3f8101730 0x7ff3f8102110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:26.068 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.050+0000 7ff3f77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3f8101730 0x7ff3f8102110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.125:59652/0 (socket says 172.21.15.125:59652) 2024-02-19T18:57:26.068 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.050+0000 7ff3f77fe700 1 -- 172.21.15.125:0/3388161039 learned_addr learned my addr 172.21.15.125:0/3388161039 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:57:26.068 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.050+0000 7ff3f77fe700 1 -- 172.21.15.125:0/3388161039 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e80095f0 con 0x7ff3f8101730 2024-02-19T18:57:26.070 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.050+0000 7ff3f77fe700 1 --2- 172.21.15.125:0/3388161039 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3f8101730 0x7ff3f8102110 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8005b40 tx=0x7ff3e8004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:57:26.070 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.051+0000 7ff3f4ff9700 1 -- 172.21.15.125:0/3388161039 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff3e801d070 con 0x7ff3f8101730 2024-02-19T18:57:26.070 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.051+0000 7ff3f4ff9700 1 -- 172.21.15.125:0/3388161039 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff3e80044d0 con 0x7ff3f8101730 2024-02-19T18:57:26.070 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.051+0000 7ff3fdc62700 1 -- 172.21.15.125:0/3388161039 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f8102650 con 0x7ff3f8101730 2024-02-19T18:57:26.070 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.051+0000 7ff3f4ff9700 1 -- 172.21.15.125:0/3388161039 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff3e8003930 con 0x7ff3f8101730 2024-02-19T18:57:26.070 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.051+0000 7ff3fdc62700 1 -- 172.21.15.125:0/3388161039 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f8102a10 con 0x7ff3f8101730 2024-02-19T18:57:26.070 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.051+0000 7ff3f4ff9700 1 -- 172.21.15.125:0/3388161039 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 17) v1 ==== 45396+0+0 (secure 0 0 0) 0x7ff3e8003c30 con 0x7ff3f8101730 2024-02-19T18:57:26.070 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.052+0000 7ff3f4ff9700 1 --2- 172.21.15.125:0/3388161039 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff3e00384b0 0x7ff3e003a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:26.070 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.052+0000 7ff3f4ff9700 1 -- 172.21.15.125:0/3388161039 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7ff3e804c4d0 con 0x7ff3f8101730 2024-02-19T18:57:26.070 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.052+0000 7ff3f6ffd700 1 --2- 172.21.15.125:0/3388161039 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff3e00384b0 0x7ff3e003a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:26.070 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.052+0000 7ff3f6ffd700 1 --2- 172.21.15.125:0/3388161039 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff3e00384b0 0x7ff3e003a970 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec006fd0 tx=0x7ff3ec006e40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:57:26.070 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.052+0000 7ff3fdc62700 1 -- 172.21.15.125:0/3388161039 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f81062a0 con 0x7ff3f8101730 2024-02-19T18:57:26.075 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.057+0000 7ff3f4ff9700 1 -- 172.21.15.125:0/3388161039 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff3e802a950 con 0x7ff3f8101730 2024-02-19T18:57:26.357 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.339+0000 7ff3fdc62700 1 -- 172.21.15.125:0/3388161039 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff3f810ac10 con 0x7ff3f8101730 2024-02-19T18:57:26.357 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.340+0000 7ff3f4ff9700 1 -- 172.21.15.125:0/3388161039 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+744 (secure 0 0 0) 0x7ff3e802a360 con 0x7ff3f8101730 2024-02-19T18:57:26.357 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:57:26.357 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":1,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","modified":"2024-02-19T18:54:24.798664Z","created":"2024-02-19T18:54:24.798664Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-19T18:57:26.360 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.342+0000 7ff3fdc62700 1 -- 172.21.15.125:0/3388161039 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff3e00384b0 msgr2=0x7ff3e003a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:26.360 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.342+0000 7ff3fdc62700 1 --2- 172.21.15.125:0/3388161039 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff3e00384b0 0x7ff3e003a970 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec006fd0 tx=0x7ff3ec006e40 comp rx=0 tx=0).stop 2024-02-19T18:57:26.360 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.342+0000 7ff3fdc62700 1 -- 172.21.15.125:0/3388161039 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3f8101730 msgr2=0x7ff3f8102110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:26.360 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.342+0000 7ff3fdc62700 1 --2- 172.21.15.125:0/3388161039 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3f8101730 0x7ff3f8102110 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8005b40 tx=0x7ff3e8004c80 comp rx=0 tx=0).stop 2024-02-19T18:57:26.360 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.342+0000 7ff3fdc62700 1 -- 172.21.15.125:0/3388161039 shutdown_connections 2024-02-19T18:57:26.360 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.342+0000 7ff3fdc62700 1 --2- 172.21.15.125:0/3388161039 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff3e00384b0 0x7ff3e003a970 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:26.360 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.342+0000 7ff3fdc62700 1 --2- 172.21.15.125:0/3388161039 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3f8101730 0x7ff3f8102110 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:26.360 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.342+0000 7ff3fdc62700 1 -- 172.21.15.125:0/3388161039 >> 172.21.15.125:0/3388161039 conn(0x7ff3f8075df0 msgr2=0x7ff3f80fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:57:26.360 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.342+0000 7ff3fdc62700 1 -- 172.21.15.125:0/3388161039 shutdown_connections 2024-02-19T18:57:26.360 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:26.343+0000 7ff3fdc62700 1 -- 172.21.15.125:0/3388161039 wait complete. 2024-02-19T18:57:26.361 INFO:teuthology.orchestra.run.smithi125.stderr:dumped monmap epoch 1 2024-02-19T18:57:26.404 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 podman[37513]: 2024-02-19 18:57:26.046114258 +0000 UTC m=+0.019702058 image pull 94eadd990e0a5619d90a7220f97c70d1fe3558d9b0fb9e0c1935661dd49a6d5f quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0 2024-02-19T18:57:26.404 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 podman[37513]: 2024-02-19 18:57:26.156254526 +0000 UTC m=+0.129842310 container create 27b4cad04cc5a08c3095b5cc6c7a83a15f424a924db49a1ab2a67aeda1abc48a (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi125, RELEASE=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-02-19T18:57:26.404 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 podman[37513]: 2024-02-19 18:57:26.331034914 +0000 UTC m=+0.304622707 container init 27b4cad04cc5a08c3095b5cc6c7a83a15f424a924db49a1ab2a67aeda1abc48a (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi125, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.1, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.29.1) 2024-02-19T18:57:26.404 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 podman[37513]: 2024-02-19 18:57:26.334303447 +0000 UTC m=+0.307891231 container start 27b4cad04cc5a08c3095b5cc6c7a83a15f424a924db49a1ab2a67aeda1abc48a (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi125, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.1, ceph=True, io.buildah.version=1.29.1) 2024-02-19T18:57:26.404 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: set uid:gid to 167:167 (ceph:ceph) 2024-02-19T18:57:26.404 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable), process ceph-mon, pid 2 2024-02-19T18:57:26.404 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: pidfile_write: ignore empty --pid-file 2024-02-19T18:57:26.404 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: load: jerasure load: lrc 2024-02-19T18:57:26.404 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: RocksDB version: 7.9.2 2024-02-19T18:57:26.404 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Git sha 0 2024-02-19T18:57:26.405 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Compile date 2023-12-11 22:07:34 2024-02-19T18:57:26.405 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: DB SUMMARY 2024-02-19T18:57:26.405 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: DB Session ID: 6XZ2D2F9PDWA8NZ20CDW 2024-02-19T18:57:26.405 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: CURRENT file: CURRENT 2024-02-19T18:57:26.405 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: IDENTITY file: IDENTITY 2024-02-19T18:57:26.405 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-02-19T18:57:26.405 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi125/store.db dir, Total Num: 0, files: 2024-02-19T18:57:26.405 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi125/store.db: 000004.log size: 511 ; 2024-02-19T18:57:26.405 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.error_if_exists: 0 2024-02-19T18:57:26.405 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.create_if_missing: 0 2024-02-19T18:57:26.406 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.paranoid_checks: 1 2024-02-19T18:57:26.406 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-19T18:57:26.406 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-19T18:57:26.406 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-19T18:57:26.406 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.env: 0x559ac6480720 2024-02-19T18:57:26.406 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.fs: PosixFileSystem 2024-02-19T18:57:26.406 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.info_log: 0x559ac91492e0 2024-02-19T18:57:26.406 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_file_opening_threads: 16 2024-02-19T18:57:26.406 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.statistics: (nil) 2024-02-19T18:57:26.406 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.use_fsync: 0 2024-02-19T18:57:26.406 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_log_file_size: 0 2024-02-19T18:57:26.406 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-19T18:57:26.406 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-19T18:57:26.407 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.keep_log_file_num: 1000 2024-02-19T18:57:26.407 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.recycle_log_file_num: 0 2024-02-19T18:57:26.407 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.allow_fallocate: 1 2024-02-19T18:57:26.407 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.allow_mmap_reads: 0 2024-02-19T18:57:26.407 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.allow_mmap_writes: 0 2024-02-19T18:57:26.407 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.use_direct_reads: 0 2024-02-19T18:57:26.407 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-19T18:57:26.407 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.create_missing_column_families: 0 2024-02-19T18:57:26.407 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.db_log_dir: 2024-02-19T18:57:26.407 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.wal_dir: 2024-02-19T18:57:26.407 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-19T18:57:26.407 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-19T18:57:26.407 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-19T18:57:26.407 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-19T18:57:26.407 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-19T18:57:26.408 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-19T18:57:26.408 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.advise_random_on_open: 1 2024-02-19T18:57:26.408 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.db_write_buffer_size: 0 2024-02-19T18:57:26.408 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.write_buffer_manager: 0x559ac83ba140 2024-02-19T18:57:26.408 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-19T18:57:26.408 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-19T18:57:26.408 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-19T18:57:26.408 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.rate_limiter: (nil) 2024-02-19T18:57:26.408 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-19T18:57:26.408 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.wal_recovery_mode: 2 2024-02-19T18:57:26.408 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.enable_thread_tracking: 0 2024-02-19T18:57:26.408 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.enable_pipelined_write: 0 2024-02-19T18:57:26.408 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.unordered_write: 0 2024-02-19T18:57:26.409 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-19T18:57:26.409 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-19T18:57:26.409 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-19T18:57:26.409 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-19T18:57:26.409 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.row_cache: None 2024-02-19T18:57:26.409 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.wal_filter: None 2024-02-19T18:57:26.409 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-19T18:57:26.409 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.allow_ingest_behind: 0 2024-02-19T18:57:26.409 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.two_write_queues: 0 2024-02-19T18:57:26.409 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.manual_wal_flush: 0 2024-02-19T18:57:26.409 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.wal_compression: 0 2024-02-19T18:57:26.409 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.atomic_flush: 0 2024-02-19T18:57:26.409 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-19T18:57:26.409 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-19T18:57:26.409 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-19T18:57:26.410 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.log_readahead_size: 0 2024-02-19T18:57:26.410 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-19T18:57:26.410 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.best_efforts_recovery: 0 2024-02-19T18:57:26.410 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-19T18:57:26.410 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-19T18:57:26.410 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.allow_data_in_errors: 0 2024-02-19T18:57:26.410 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.db_host_id: __hostname__ 2024-02-19T18:57:26.410 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-19T18:57:26.410 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_background_jobs: 2 2024-02-19T18:57:26.410 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_background_compactions: -1 2024-02-19T18:57:26.410 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_subcompactions: 1 2024-02-19T18:57:26.410 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-19T18:57:26.410 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-19T18:57:26.410 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-19T18:57:26.410 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_total_wal_size: 0 2024-02-19T18:57:26.410 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-19T18:57:26.410 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-19T18:57:26.411 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-19T18:57:26.411 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-19T18:57:26.411 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_open_files: -1 2024-02-19T18:57:26.411 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.bytes_per_sync: 0 2024-02-19T18:57:26.411 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-19T18:57:26.412 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-19T18:57:26.412 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compaction_readahead_size: 0 2024-02-19T18:57:26.412 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_background_flushes: -1 2024-02-19T18:57:26.412 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Compression algorithms supported: 2024-02-19T18:57:26.412 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-19T18:57:26.412 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: kZSTD supported: 0 2024-02-19T18:57:26.412 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: kXpressCompression supported: 0 2024-02-19T18:57:26.413 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: kLZ4HCCompression supported: 1 2024-02-19T18:57:26.413 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: kZlibCompression supported: 1 2024-02-19T18:57:26.413 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: kSnappyCompression supported: 1 2024-02-19T18:57:26.413 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: kLZ4Compression supported: 1 2024-02-19T18:57:26.413 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: kBZip2Compression supported: 0 2024-02-19T18:57:26.413 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-19T18:57:26.413 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-19T18:57:26.413 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi125/store.db/MANIFEST-000005 2024-02-19T18:57:26.413 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-19T18:57:26.413 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-19T18:57:26.413 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.merge_operator: 2024-02-19T18:57:26.413 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compaction_filter: None 2024-02-19T18:57:26.413 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compaction_filter_factory: None 2024-02-19T18:57:26.413 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.sst_partitioner_factory: None 2024-02-19T18:57:26.413 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-19T18:57:26.413 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-19T18:57:26.414 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559ac91493e0) 2024-02-19T18:57:26.414 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: cache_index_and_filter_blocks: 1 2024-02-19T18:57:26.414 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-19T18:57:26.414 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-19T18:57:26.414 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: pin_top_level_index_and_filter: 1 2024-02-19T18:57:26.414 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: index_type: 0 2024-02-19T18:57:26.414 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: data_block_index_type: 0 2024-02-19T18:57:26.414 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: index_shortening: 1 2024-02-19T18:57:26.414 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-19T18:57:26.414 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: checksum: 4 2024-02-19T18:57:26.414 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: no_block_cache: 0 2024-02-19T18:57:26.414 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: block_cache: 0x559ac845b1f0 2024-02-19T18:57:26.414 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: block_cache_name: BinnedLRUCache 2024-02-19T18:57:26.414 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: block_cache_options: 2024-02-19T18:57:26.414 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: capacity : 536870912 2024-02-19T18:57:26.415 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: num_shard_bits : 4 2024-02-19T18:57:26.415 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: strict_capacity_limit : 0 2024-02-19T18:57:26.415 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: high_pri_pool_ratio: 0.000 2024-02-19T18:57:26.415 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: block_cache_compressed: (nil) 2024-02-19T18:57:26.415 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: persistent_cache: (nil) 2024-02-19T18:57:26.415 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: block_size: 4096 2024-02-19T18:57:26.415 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: block_size_deviation: 10 2024-02-19T18:57:26.415 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: block_restart_interval: 16 2024-02-19T18:57:26.415 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: index_block_restart_interval: 1 2024-02-19T18:57:26.415 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: metadata_block_size: 4096 2024-02-19T18:57:26.415 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: partition_filters: 0 2024-02-19T18:57:26.415 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: use_delta_encoding: 1 2024-02-19T18:57:26.415 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: filter_policy: bloomfilter 2024-02-19T18:57:26.415 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: whole_key_filtering: 1 2024-02-19T18:57:26.415 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: verify_compression: 0 2024-02-19T18:57:26.415 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: read_amp_bytes_per_bit: 0 2024-02-19T18:57:26.416 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: format_version: 5 2024-02-19T18:57:26.416 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: enable_index_compression: 1 2024-02-19T18:57:26.416 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: block_align: 0 2024-02-19T18:57:26.416 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: max_auto_readahead_size: 262144 2024-02-19T18:57:26.416 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: prepopulate_block_cache: 0 2024-02-19T18:57:26.416 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: initial_auto_readahead_size: 8192 2024-02-19T18:57:26.416 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: num_file_reads_for_auto_readahead: 2 2024-02-19T18:57:26.416 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.write_buffer_size: 33554432 2024-02-19T18:57:26.416 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_write_buffer_number: 2 2024-02-19T18:57:26.416 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compression: NoCompression 2024-02-19T18:57:26.416 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.bottommost_compression: Disabled 2024-02-19T18:57:26.416 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.prefix_extractor: nullptr 2024-02-19T18:57:26.416 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-19T18:57:26.416 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.num_levels: 7 2024-02-19T18:57:26.417 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-19T18:57:26.417 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-19T18:57:26.417 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-19T18:57:26.417 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-19T18:57:26.417 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-19T18:57:26.417 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-19T18:57:26.417 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-19T18:57:26.417 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-19T18:57:26.417 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-19T18:57:26.417 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-19T18:57:26.417 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-19T18:57:26.417 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-19T18:57:26.417 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-19T18:57:26.417 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compression_opts.level: 32767 2024-02-19T18:57:26.418 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compression_opts.strategy: 0 2024-02-19T18:57:26.418 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-19T18:57:26.418 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-19T18:57:26.418 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-19T18:57:26.418 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-19T18:57:26.418 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compression_opts.enabled: false 2024-02-19T18:57:26.418 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-19T18:57:26.418 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-19T18:57:26.418 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-19T18:57:26.418 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-19T18:57:26.418 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.target_file_size_base: 67108864 2024-02-19T18:57:26.418 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-19T18:57:26.418 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-19T18:57:26.418 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-19T18:57:26.418 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-19T18:57:26.418 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-19T18:57:26.419 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-19T18:57:26.419 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-19T18:57:26.419 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-19T18:57:26.419 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-19T18:57:26.419 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-19T18:57:26.419 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-19T18:57:26.419 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-19T18:57:26.419 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-19T18:57:26.419 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-19T18:57:26.419 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.arena_block_size: 1048576 2024-02-19T18:57:26.419 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-19T18:57:26.419 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-19T18:57:26.419 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.disable_auto_compactions: 0 2024-02-19T18:57:26.419 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-19T18:57:26.419 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-19T18:57:26.419 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-19T18:57:26.420 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-19T18:57:26.420 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-19T18:57:26.420 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-19T18:57:26.420 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-19T18:57:26.420 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-19T18:57:26.420 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-19T18:57:26.420 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-19T18:57:26.420 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.table_properties_collectors: 2024-02-19T18:57:26.420 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.inplace_update_support: 0 2024-02-19T18:57:26.420 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-19T18:57:26.420 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-19T18:57:26.420 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-19T18:57:26.420 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-19T18:57:26.420 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.bloom_locality: 0 2024-02-19T18:57:26.420 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.max_successive_merges: 0 2024-02-19T18:57:26.421 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-19T18:57:26.421 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.paranoid_file_checks: 0 2024-02-19T18:57:26.421 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.force_consistency_checks: 1 2024-02-19T18:57:26.421 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.report_bg_io_stats: 0 2024-02-19T18:57:26.421 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.ttl: 2592000 2024-02-19T18:57:26.421 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-19T18:57:26.421 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-19T18:57:26.421 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-19T18:57:26.421 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.enable_blob_files: false 2024-02-19T18:57:26.421 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.min_blob_size: 0 2024-02-19T18:57:26.421 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.blob_file_size: 268435456 2024-02-19T18:57:26.421 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-19T18:57:26.421 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-19T18:57:26.421 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-19T18:57:26.421 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-19T18:57:26.421 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-19T18:57:26.421 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.blob_file_starting_level: 0 2024-02-19T18:57:26.422 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-19T18:57:26.422 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi125/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-19T18:57:26.422 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-02-19T18:57:26.422 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0f067443-18d0-4e63-876c-a107f7ae45b7 2024-02-19T18:57:26.422 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708369046364415, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-02-19T18:57:26.422 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-02-19T18:57:26.422 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708369046364845, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1708369046, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0f067443-18d0-4e63-876c-a107f7ae45b7", "db_session_id": "6XZ2D2F9PDWA8NZ20CDW", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-02-19T18:57:26.422 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708369046364924, "job": 1, "event": "recovery_finished"} 2024-02-19T18:57:26.422 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-02-19T18:57:26.422 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi125/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-19T18:57:26.422 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559ac84f8000 2024-02-19T18:57:26.422 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: DB pointer 0x559ac84e4000 2024-02-19T18:57:26.422 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-19T18:57:26.422 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-19T18:57:26.423 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: ** DB Stats ** 2024-02-19T18:57:26.423 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T18:57:26.423 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-19T18:57:26.423 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-19T18:57:26.423 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T18:57:26.423 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-19T18:57:26.423 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-19T18:57:26.423 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T18:57:26.423 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: 2024-02-19T18:57:26.423 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: ** Compaction Stats [default] ** 2024-02-19T18:57:26.423 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-19T18:57:26.423 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-19T18:57:26.423 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-02-19T18:57:26.423 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-02-19T18:57:26.424 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-02-19T18:57:26.424 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: 2024-02-19T18:57:26.424 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: ** Compaction Stats [default] ** 2024-02-19T18:57:26.424 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-19T18:57:26.424 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T18:57:26.424 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.7 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-02-19T18:57:26.424 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: 2024-02-19T18:57:26.424 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-19T18:57:26.424 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: 2024-02-19T18:57:26.424 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T18:57:26.424 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-19T18:57:26.424 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-19T18:57:26.424 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-19T18:57:26.424 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-19T18:57:26.424 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-19T18:57:26.425 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T18:57:26.425 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T18:57:26.425 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-19T18:57:26.425 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Block cache BinnedLRUCache@0x559ac845b1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-02-19T18:57:26.425 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-02-19T18:57:26.425 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: 2024-02-19T18:57:26.425 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-19T18:57:26.425 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: mon.smithi125 does not exist in monmap, will attempt to join an existing cluster 2024-02-19T18:57:26.425 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: using public_addr v2:172.21.15.125:0/0 -> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] 2024-02-19T18:57:26.425 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: starting mon.smithi125 rank -1 at public addrs [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] at bind addrs [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi125 fsid 06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T18:57:26.425 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: mon.smithi125@-1(???) e0 preinit fsid 06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T18:57:26.425 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: mon.smithi125@-1(synchronizing).mds e1 new map 2024-02-19T18:57:26.425 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: mon.smithi125@-1(synchronizing).mds e1 print_map 2024-02-19T18:57:26.425 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: e1 2024-02-19T18:57:26.425 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T18:57:26.426 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T18:57:26.426 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: legacy client fscid: -1 2024-02-19T18:57:26.426 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: 2024-02-19T18:57:26.426 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: No filesystems configured 2024-02-19T18:57:26.426 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: mon.smithi125@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-02-19T18:57:26.426 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: mon.smithi125@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-19T18:57:26.426 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: mon.smithi125@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-19T18:57:26.426 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: mon.smithi125@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-19T18:57:26.426 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: mon.smithi125@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-19T18:57:26.426 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: mon.smithi125@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-19T18:57:26.426 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: mon.smithi125@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-02-19T18:57:26.426 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: mon.smithi125@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-19T18:57:26.426 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: mon.smithi125@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T18:57:26.426 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: mon.smithi125@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T18:57:26.427 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: mon.smithi125@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-02-19T18:57:26.427 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='client.? 172.21.15.125:0/2861831117' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:57:26.427 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:26.427 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:26.427 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:26.427 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:26.427 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: Deploying daemon node-exporter.smithi125 on smithi125 2024-02-19T18:57:26.427 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:26.427 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:57:26.427 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:26.427 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:26.427 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:26.427 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:26.427 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi125.ygdmdu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T18:57:26.428 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi125.ygdmdu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-19T18:57:26.428 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T18:57:26.428 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:26.428 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: Deploying daemon mgr.smithi125.ygdmdu on smithi125 2024-02-19T18:57:26.428 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='client.? 172.21.15.125:0/567055887' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:57:26.428 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:26.428 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:26.428 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:26.428 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='client.? 172.21.15.125:0/2785699911' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:57:26.428 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:26.428 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:26.428 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:26.428 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:26.428 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T18:57:26.428 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:26.429 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:26.429 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: Deploying daemon mon.smithi125 on smithi125 2024-02-19T18:57:26.429 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:26.429 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:26.429 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:26.429 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: mon.smithi125@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-02-19T18:57:26.429 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: expand_channel_meta expand map: {default=false} 2024-02-19T18:57:26.429 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: expand_channel_meta from 'false' to 'false' 2024-02-19T18:57:26.429 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: expand_channel_meta expanded map: {default=false} 2024-02-19T18:57:26.429 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: expand_channel_meta expand map: {default=info} 2024-02-19T18:57:26.429 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: expand_channel_meta from 'info' to 'info' 2024-02-19T18:57:26.429 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: expand_channel_meta expanded map: {default=info} 2024-02-19T18:57:26.429 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: expand_channel_meta expand map: {default=daemon} 2024-02-19T18:57:26.429 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: expand_channel_meta from 'daemon' to 'daemon' 2024-02-19T18:57:26.429 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: expand_channel_meta expanded map: {default=daemon} 2024-02-19T18:57:26.430 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: expand_channel_meta expand map: {default=debug} 2024-02-19T18:57:26.430 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: expand_channel_meta from 'debug' to 'debug' 2024-02-19T18:57:26.430 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: expand_channel_meta expanded map: {default=debug} 2024-02-19T18:57:26.430 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 ceph-mon[37556]: mon.smithi125@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete,mon_cluster_log_to_file 2024-02-19T18:57:26.673 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 bash[37513]: 27b4cad04cc5a08c3095b5cc6c7a83a15f424a924db49a1ab2a67aeda1abc48a 2024-02-19T18:57:26.673 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:26 smithi125 systemd[1]: Started Ceph mon.smithi125 for 06580d2c-cf58-11ee-95bb-87774f69a715. 2024-02-19T18:57:26.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:26 smithi096 ceph-mon[29216]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:28.076 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-19T18:57:28.076 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mon dump -f json 2024-02-19T18:57:28.285 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi125/config 2024-02-19T18:57:31.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2024-02-19T18:57:31.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: mon.smithi096 calling monitor election 2024-02-19T18:57:31.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T18:57:31.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T18:57:31.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:31.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:57:31.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T18:57:31.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: mon.smithi125 calling monitor election 2024-02-19T18:57:31.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.125:0/660384503' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi125.ygdmdu/crt"}]: dispatch 2024-02-19T18:57:31.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T18:57:31.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:31.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T18:57:31.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T18:57:31.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: mon.smithi096 is new leader, mons smithi096,smithi125 in quorum (ranks 0,1) 2024-02-19T18:57:31.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: monmap e2: 2 mons at {smithi096=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],smithi125=[v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-19T18:57:31.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: fsmap 2024-02-19T18:57:31.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: osdmap e5: 0 total, 0 up, 0 in 2024-02-19T18:57:31.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: mgrmap e17: smithi096.zsjdff(active, since 33s) 2024-02-19T18:57:31.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: Standby manager daemon smithi125.ygdmdu started 2024-02-19T18:57:31.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.125:0/660384503' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T18:57:31.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: overall HEALTH_OK 2024-02-19T18:57:31.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.125:0/660384503' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi125.ygdmdu/key"}]: dispatch 2024-02-19T18:57:31.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:31.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.125:0/660384503' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T18:57:31.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:31.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:31.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:31.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:31 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:31.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2024-02-19T18:57:31.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: mon.smithi096 calling monitor election 2024-02-19T18:57:31.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T18:57:31.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T18:57:31.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:31.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:57:31.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T18:57:31.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: mon.smithi125 calling monitor election 2024-02-19T18:57:31.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.125:0/660384503' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi125.ygdmdu/crt"}]: dispatch 2024-02-19T18:57:31.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T18:57:31.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:31.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T18:57:31.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T18:57:31.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: mon.smithi096 is new leader, mons smithi096,smithi125 in quorum (ranks 0,1) 2024-02-19T18:57:31.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: monmap e2: 2 mons at {smithi096=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],smithi125=[v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-19T18:57:31.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: fsmap 2024-02-19T18:57:31.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: osdmap e5: 0 total, 0 up, 0 in 2024-02-19T18:57:31.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: mgrmap e17: smithi096.zsjdff(active, since 33s) 2024-02-19T18:57:31.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: Standby manager daemon smithi125.ygdmdu started 2024-02-19T18:57:31.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.125:0/660384503' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T18:57:31.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: overall HEALTH_OK 2024-02-19T18:57:31.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.125:0/660384503' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi125.ygdmdu/key"}]: dispatch 2024-02-19T18:57:31.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:31.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.125:0/660384503' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T18:57:31.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:31.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:31.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:31.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:31 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:32.698 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:32 smithi125 ceph-mon[37556]: mgrmap e18: smithi096.zsjdff(active, since 33s), standbys: smithi125.ygdmdu 2024-02-19T18:57:32.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:32 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr metadata", "who": "smithi125.ygdmdu", "id": "smithi125.ygdmdu"}]: dispatch 2024-02-19T18:57:32.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:32 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:57:32.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:32 smithi125 ceph-mon[37556]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:32.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:32 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T18:57:32.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:32 smithi096 ceph-mon[29216]: mgrmap e18: smithi096.zsjdff(active, since 33s), standbys: smithi125.ygdmdu 2024-02-19T18:57:32.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:32 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr metadata", "who": "smithi125.ygdmdu", "id": "smithi125.ygdmdu"}]: dispatch 2024-02-19T18:57:32.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:32 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:57:32.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:32 smithi096 ceph-mon[29216]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:32.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:32 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T18:57:32.805 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.786+0000 7f070aaf9700 1 -- 172.21.15.125:0/2631709191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06f40057d0 msgr2=0x7f06f4007c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:32.805 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.786+0000 7f070aaf9700 1 --2- 172.21.15.125:0/2631709191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06f40057d0 0x7f06f4007c60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0704076780 tx=0x7f06f800feb0 comp rx=0 tx=0).stop 2024-02-19T18:57:32.805 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.786+0000 7f070aaf9700 1 -- 172.21.15.125:0/2631709191 shutdown_connections 2024-02-19T18:57:32.805 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.786+0000 7f070aaf9700 1 --2- 172.21.15.125:0/2631709191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06f40057d0 0x7f06f4007c60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:32.806 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.786+0000 7f070aaf9700 1 -- 172.21.15.125:0/2631709191 >> 172.21.15.125:0/2631709191 conn(0x7f0704075340 msgr2=0x7f0704075750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:57:32.806 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.786+0000 7f070aaf9700 1 -- 172.21.15.125:0/2631709191 shutdown_connections 2024-02-19T18:57:32.806 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.786+0000 7f070aaf9700 1 -- 172.21.15.125:0/2631709191 wait complete. 2024-02-19T18:57:32.806 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.787+0000 7f070aaf9700 1 Processor -- start 2024-02-19T18:57:32.806 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.787+0000 7f070aaf9700 1 -- start start 2024-02-19T18:57:32.806 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.787+0000 7f070aaf9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06f40057d0 0x7f0704198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:32.806 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.787+0000 7f070aaf9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0704198670 0x7f070419cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:32.806 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.787+0000 7f070aaf9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0704198c90 con 0x7f06f40057d0 2024-02-19T18:57:32.806 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.787+0000 7f070aaf9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0704198e00 con 0x7f0704198670 2024-02-19T18:57:32.806 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.787+0000 7f0703fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0704198670 0x7f070419cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:32.806 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.787+0000 7f0703fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0704198670 0x7f070419cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48318/0 (socket says 172.21.15.125:48318) 2024-02-19T18:57:32.806 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.787+0000 7f0703fff700 1 -- 172.21.15.125:0/1980772934 learned_addr learned my addr 172.21.15.125:0/1980772934 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:57:32.806 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.787+0000 7f0703fff700 1 -- 172.21.15.125:0/1980772934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0704198670 msgr2=0x7f070419cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-19T18:57:32.807 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.787+0000 7f0703fff700 1 -- 172.21.15.125:0/1980772934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0704198670 msgr2=0x7f070419cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-19T18:57:32.807 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.787+0000 7f0703fff700 1 --2- 172.21.15.125:0/1980772934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0704198670 0x7f070419cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T18:57:32.807 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.787+0000 7f0703fff700 1 --2- 172.21.15.125:0/1980772934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0704198670 0x7f070419cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T18:57:32.807 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.787+0000 7f0708895700 1 --2- 172.21.15.125:0/1980772934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06f40057d0 0x7f0704198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:32.807 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.788+0000 7f0708895700 1 -- 172.21.15.125:0/1980772934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0704198670 msgr2=0x7f070419cae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T18:57:32.807 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.788+0000 7f0708895700 1 --2- 172.21.15.125:0/1980772934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0704198670 0x7f070419cae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:32.807 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.788+0000 7f0708895700 1 -- 172.21.15.125:0/1980772934 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f800f900 con 0x7f06f40057d0 2024-02-19T18:57:32.807 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.788+0000 7f0708895700 1 --2- 172.21.15.125:0/1980772934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06f40057d0 0x7f0704198130 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f06f8010010 tx=0x7f06f8004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:57:32.807 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.788+0000 7f0701ffb700 1 -- 172.21.15.125:0/1980772934 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06f8013960 con 0x7f06f40057d0 2024-02-19T18:57:32.807 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.788+0000 7f070aaf9700 1 -- 172.21.15.125:0/1980772934 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f070419d0e0 con 0x7f06f40057d0 2024-02-19T18:57:32.807 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.788+0000 7f0701ffb700 1 -- 172.21.15.125:0/1980772934 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f06f8004030 con 0x7f06f40057d0 2024-02-19T18:57:32.807 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.788+0000 7f0701ffb700 1 -- 172.21.15.125:0/1980772934 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06f8011c50 con 0x7f06f40057d0 2024-02-19T18:57:32.807 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.788+0000 7f070aaf9700 1 -- 172.21.15.125:0/1980772934 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f070419d630 con 0x7f06f40057d0 2024-02-19T18:57:32.808 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.789+0000 7f070aaf9700 1 -- 172.21.15.125:0/1980772934 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07040623c0 con 0x7f06f40057d0 2024-02-19T18:57:32.808 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.790+0000 7f0701ffb700 1 -- 172.21.15.125:0/1980772934 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7f06f80041a0 con 0x7f06f40057d0 2024-02-19T18:57:32.808 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.790+0000 7f0701ffb700 1 --2- 172.21.15.125:0/1980772934 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f06e806c560 0x7f06e806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:32.808 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.790+0000 7f0701ffb700 1 -- 172.21.15.125:0/1980772934 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f06f808d580 con 0x7f06f40057d0 2024-02-19T18:57:32.809 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.790+0000 7f0703fff700 1 --2- 172.21.15.125:0/1980772934 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f06e806c560 0x7f06e806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:32.809 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.791+0000 7f0703fff700 1 --2- 172.21.15.125:0/1980772934 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f06e806c560 0x7f06e806ea20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f06f0009180 tx=0x7f06f0008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:57:32.812 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:32.794+0000 7f0701ffb700 1 -- 172.21.15.125:0/1980772934 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f06f8058e20 con 0x7f06f40057d0 2024-02-19T18:57:33.084 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:33.067+0000 7f070aaf9700 1 -- 172.21.15.125:0/1980772934 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f07041a2d80 con 0x7f06f40057d0 2024-02-19T18:57:33.085 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:33.067+0000 7f0701ffb700 1 -- 172.21.15.125:0/1980772934 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1022 (secure 0 0 0) 0x7f06f8031020 con 0x7f06f40057d0 2024-02-19T18:57:33.085 INFO:teuthology.orchestra.run.smithi125.stdout: 2024-02-19T18:57:33.085 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":2,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","modified":"2024-02-19T18:57:26.391941Z","created":"2024-02-19T18:54:24.798664Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi096","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi125","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:3300","nonce":0},{"type":"v1","addr":"172.21.15.125:6789","nonce":0}]},"addr":"172.21.15.125:6789/0","public_addr":"172.21.15.125:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-02-19T18:57:33.087 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:33.070+0000 7f070aaf9700 1 -- 172.21.15.125:0/1980772934 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f06e806c560 msgr2=0x7f06e806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:33.087 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:33.070+0000 7f070aaf9700 1 --2- 172.21.15.125:0/1980772934 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f06e806c560 0x7f06e806ea20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f06f0009180 tx=0x7f06f0008040 comp rx=0 tx=0).stop 2024-02-19T18:57:33.087 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:33.070+0000 7f070aaf9700 1 -- 172.21.15.125:0/1980772934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06f40057d0 msgr2=0x7f0704198130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:33.087 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:33.070+0000 7f070aaf9700 1 --2- 172.21.15.125:0/1980772934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06f40057d0 0x7f0704198130 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f06f8010010 tx=0x7f06f8004f90 comp rx=0 tx=0).stop 2024-02-19T18:57:33.087 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:33.070+0000 7f070aaf9700 1 -- 172.21.15.125:0/1980772934 shutdown_connections 2024-02-19T18:57:33.088 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:33.070+0000 7f070aaf9700 1 --2- 172.21.15.125:0/1980772934 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f06e806c560 0x7f06e806ea20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:33.088 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:33.070+0000 7f070aaf9700 1 --2- 172.21.15.125:0/1980772934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06f40057d0 0x7f0704198130 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:33.088 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:33.070+0000 7f070aaf9700 1 --2- 172.21.15.125:0/1980772934 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0704198670 0x7f070419cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:33.088 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:33.070+0000 7f070aaf9700 1 -- 172.21.15.125:0/1980772934 >> 172.21.15.125:0/1980772934 conn(0x7f0704075340 msgr2=0x7f070418c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:57:33.088 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:33.070+0000 7f070aaf9700 1 -- 172.21.15.125:0/1980772934 shutdown_connections 2024-02-19T18:57:33.088 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:57:33.070+0000 7f070aaf9700 1 -- 172.21.15.125:0/1980772934 wait complete. 2024-02-19T18:57:33.088 INFO:teuthology.orchestra.run.smithi125.stderr:dumped monmap epoch 2 2024-02-19T18:57:34.048 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:33 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:34.049 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:33 smithi125 ceph-mon[37556]: from='client.? 172.21.15.125:0/1980772934' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:57:34.049 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:33 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:34.049 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:33 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:34.049 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:33 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:34.049 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:33 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:57:34.070 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-19T18:57:34.070 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph config generate-minimal-conf 2024-02-19T18:57:34.098 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:33 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:34.099 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:33 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/1980772934' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-19T18:57:34.099 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:33 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:34.099 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:33 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:34.099 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:33 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:34.099 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:33 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:57:34.290 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T18:57:35.296 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:35 smithi096 ceph-mon[29216]: Updating smithi096:/etc/ceph/ceph.conf 2024-02-19T18:57:35.296 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:35 smithi096 ceph-mon[29216]: Updating smithi125:/etc/ceph/ceph.conf 2024-02-19T18:57:35.296 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:35 smithi096 ceph-mon[29216]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:35.296 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:35 smithi096 ceph-mon[29216]: Updating smithi125:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T18:57:35.296 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:35 smithi096 ceph-mon[29216]: Updating smithi096:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T18:57:35.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:35 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:35.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:35 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:35.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:35 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:35.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:35 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:35.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:35 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:35.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:35 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T18:57:35.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:35 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T18:57:35.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:35 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:35.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:35 smithi125 ceph-mon[37556]: Updating smithi096:/etc/ceph/ceph.conf 2024-02-19T18:57:35.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:35 smithi125 ceph-mon[37556]: Updating smithi125:/etc/ceph/ceph.conf 2024-02-19T18:57:35.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:35 smithi125 ceph-mon[37556]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:35.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:35 smithi125 ceph-mon[37556]: Updating smithi125:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T18:57:35.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:35 smithi125 ceph-mon[37556]: Updating smithi096:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T18:57:35.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:35 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:35.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:35 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:35.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:35 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:35.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:35 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:35.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:35 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:35.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:35 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T18:57:35.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:35 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T18:57:35.450 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:35 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:36.443 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:36 smithi096 ceph-mon[29216]: Reconfiguring mon.smithi096 (unknown last config time)... 2024-02-19T18:57:36.443 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:36 smithi096 ceph-mon[29216]: Reconfiguring daemon mon.smithi096 on smithi096 2024-02-19T18:57:36.448 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:36 smithi125 ceph-mon[37556]: Reconfiguring mon.smithi096 (unknown last config time)... 2024-02-19T18:57:36.448 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:36 smithi125 ceph-mon[37556]: Reconfiguring daemon mon.smithi096 on smithi096 2024-02-19T18:57:36.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.770+0000 7f89875ae700 1 -- 172.21.15.96:0/1875590826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89800ffc20 msgr2=0x7f8980100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:36.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.770+0000 7f89875ae700 1 --2- 172.21.15.96:0/1875590826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89800ffc20 0x7f8980100080 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8970009910 tx=0x7f8970009c20 comp rx=0 tx=0).stop 2024-02-19T18:57:36.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.770+0000 7f89875ae700 1 -- 172.21.15.96:0/1875590826 shutdown_connections 2024-02-19T18:57:36.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.770+0000 7f89875ae700 1 --2- 172.21.15.96:0/1875590826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89800ffc20 0x7f8980100080 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:36.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.770+0000 7f89875ae700 1 --2- 172.21.15.96:0/1875590826 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8980105bd0 0x7f8980105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:36.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.770+0000 7f89875ae700 1 -- 172.21.15.96:0/1875590826 >> 172.21.15.96:0/1875590826 conn(0x7f8980075670 msgr2=0x7f8980075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:57:36.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.771+0000 7f89875ae700 1 -- 172.21.15.96:0/1875590826 shutdown_connections 2024-02-19T18:57:36.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.771+0000 7f89875ae700 1 -- 172.21.15.96:0/1875590826 wait complete. 2024-02-19T18:57:36.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.771+0000 7f89875ae700 1 Processor -- start 2024-02-19T18:57:36.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.771+0000 7f89875ae700 1 -- start start 2024-02-19T18:57:36.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.771+0000 7f89875ae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89800ffc20 0x7f8980195550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:36.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.771+0000 7f89875ae700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8980105bd0 0x7f8980195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:36.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.771+0000 7f89875ae700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8980195fd0 con 0x7f89800ffc20 2024-02-19T18:57:36.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.771+0000 7f89875ae700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8980196140 con 0x7f8980105bd0 2024-02-19T18:57:36.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.772+0000 7f898534a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89800ffc20 0x7f8980195550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:36.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.772+0000 7f898534a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89800ffc20 0x7f8980195550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50668/0 (socket says 172.21.15.96:50668) 2024-02-19T18:57:36.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.772+0000 7f898534a700 1 -- 172.21.15.96:0/2306655063 learned_addr learned my addr 172.21.15.96:0/2306655063 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:57:36.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.772+0000 7f8984b49700 1 --2- 172.21.15.96:0/2306655063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8980105bd0 0x7f8980195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:36.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.772+0000 7f898534a700 1 -- 172.21.15.96:0/2306655063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8980105bd0 msgr2=0x7f8980195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:36.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.772+0000 7f898534a700 1 --2- 172.21.15.96:0/2306655063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8980105bd0 0x7f8980195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:36.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.772+0000 7f898534a700 1 -- 172.21.15.96:0/2306655063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89700095f0 con 0x7f89800ffc20 2024-02-19T18:57:36.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.772+0000 7f898534a700 1 --2- 172.21.15.96:0/2306655063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89800ffc20 0x7f8980195550 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f897c00d900 tx=0x7f897c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:57:36.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.772+0000 7f89767fc700 1 -- 172.21.15.96:0/2306655063 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f897c0041f0 con 0x7f89800ffc20 2024-02-19T18:57:36.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.772+0000 7f89767fc700 1 -- 172.21.15.96:0/2306655063 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f897c004ce0 con 0x7f89800ffc20 2024-02-19T18:57:36.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.772+0000 7f89875ae700 1 -- 172.21.15.96:0/2306655063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89801a2bc0 con 0x7f89800ffc20 2024-02-19T18:57:36.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.772+0000 7f89767fc700 1 -- 172.21.15.96:0/2306655063 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f897c00b750 con 0x7f89800ffc20 2024-02-19T18:57:36.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.772+0000 7f89875ae700 1 -- 172.21.15.96:0/2306655063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89801a2f20 con 0x7f89800ffc20 2024-02-19T18:57:36.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.773+0000 7f89875ae700 1 -- 172.21.15.96:0/2306655063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89801080d0 con 0x7f89800ffc20 2024-02-19T18:57:36.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.774+0000 7f89767fc700 1 -- 172.21.15.96:0/2306655063 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7f897c00b8b0 con 0x7f89800ffc20 2024-02-19T18:57:36.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.774+0000 7f89767fc700 1 --2- 172.21.15.96:0/2306655063 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f896c06c470 0x7f896c06e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:36.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.774+0000 7f89767fc700 1 -- 172.21.15.96:0/2306655063 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f897c08a480 con 0x7f89800ffc20 2024-02-19T18:57:36.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.774+0000 7f8984b49700 1 --2- 172.21.15.96:0/2306655063 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f896c06c470 0x7f896c06e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:36.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.774+0000 7f8984b49700 1 --2- 172.21.15.96:0/2306655063 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f896c06c470 0x7f896c06e930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f89801976b0 tx=0x7f897001a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:57:36.796 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.779+0000 7f89767fc700 1 -- 172.21.15.96:0/2306655063 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f897c055dc0 con 0x7f89800ffc20 2024-02-19T18:57:37.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.983+0000 7f89875ae700 1 -- 172.21.15.96:0/2306655063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f898004f2e0 con 0x7f89800ffc20 2024-02-19T18:57:37.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.983+0000 7f89767fc700 1 -- 172.21.15.96:0/2306655063 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f897c016070 con 0x7f89800ffc20 2024-02-19T18:57:37.001 INFO:teuthology.orchestra.run.smithi096.stdout:# minimal ceph.conf for 06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T18:57:37.001 INFO:teuthology.orchestra.run.smithi096.stdout:[global] 2024-02-19T18:57:37.001 INFO:teuthology.orchestra.run.smithi096.stdout: fsid = 06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T18:57:37.001 INFO:teuthology.orchestra.run.smithi096.stdout: mon_host = [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] 2024-02-19T18:57:37.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.985+0000 7f89875ae700 1 -- 172.21.15.96:0/2306655063 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f896c06c470 msgr2=0x7f896c06e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:37.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.985+0000 7f89875ae700 1 --2- 172.21.15.96:0/2306655063 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f896c06c470 0x7f896c06e930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f89801976b0 tx=0x7f897001a040 comp rx=0 tx=0).stop 2024-02-19T18:57:37.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.985+0000 7f89875ae700 1 -- 172.21.15.96:0/2306655063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89800ffc20 msgr2=0x7f8980195550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:37.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.985+0000 7f89875ae700 1 --2- 172.21.15.96:0/2306655063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89800ffc20 0x7f8980195550 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f897c00d900 tx=0x7f897c00dc10 comp rx=0 tx=0).stop 2024-02-19T18:57:37.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.985+0000 7f89875ae700 1 -- 172.21.15.96:0/2306655063 shutdown_connections 2024-02-19T18:57:37.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.985+0000 7f89875ae700 1 --2- 172.21.15.96:0/2306655063 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f896c06c470 0x7f896c06e930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:37.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.985+0000 7f89875ae700 1 --2- 172.21.15.96:0/2306655063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89800ffc20 0x7f8980195550 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:37.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.985+0000 7f89875ae700 1 --2- 172.21.15.96:0/2306655063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8980105bd0 0x7f8980195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:37.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.985+0000 7f89875ae700 1 -- 172.21.15.96:0/2306655063 >> 172.21.15.96:0/2306655063 conn(0x7f8980075670 msgr2=0x7f89800fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:57:37.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.985+0000 7f89875ae700 1 -- 172.21.15.96:0/2306655063 shutdown_connections 2024-02-19T18:57:37.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:36.985+0000 7f89875ae700 1 -- 172.21.15.96:0/2306655063 wait complete. 2024-02-19T18:57:37.281 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:37 smithi096 ceph-mon[29216]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:37.282 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:37 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:37.282 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:37 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:37.282 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:37 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi096.zsjdff", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T18:57:37.282 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:37 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T18:57:37.282 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:37 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:37.282 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:37 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/2306655063' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:37.448 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:37 smithi125 ceph-mon[37556]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:37.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:37 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:37.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:37 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:37.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:37 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi096.zsjdff", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T18:57:37.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:37 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T18:57:37.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:37 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:37.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:37 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/2306655063' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:38.151 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:38 smithi096 ceph-mon[29216]: Reconfiguring mgr.smithi096.zsjdff (unknown last config time)... 2024-02-19T18:57:38.151 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:38 smithi096 ceph-mon[29216]: Reconfiguring daemon mgr.smithi096.zsjdff on smithi096 2024-02-19T18:57:38.151 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:38 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:38.151 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:38 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:38.152 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:38 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi096", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T18:57:38.152 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:38 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:38.273 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-19T18:57:38.273 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-02-19T18:57:38.273 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.conf 2024-02-19T18:57:38.343 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-02-19T18:57:38.343 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-19T18:57:38.411 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-02-19T18:57:38.411 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/ceph/ceph.conf 2024-02-19T18:57:38.441 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:38 smithi125 ceph-mon[37556]: Reconfiguring mgr.smithi096.zsjdff (unknown last config time)... 2024-02-19T18:57:38.441 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:38 smithi125 ceph-mon[37556]: Reconfiguring daemon mgr.smithi096.zsjdff on smithi096 2024-02-19T18:57:38.441 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:38 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:38.441 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:38 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:38.441 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:38 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi096", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T18:57:38.441 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:38 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:38.446 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-02-19T18:57:38.447 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-19T18:57:38.520 INFO:tasks.cephadm:Deploying OSDs... 2024-02-19T18:57:38.520 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-02-19T18:57:38.520 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/scratch_devs of=/dev/stdout 2024-02-19T18:57:38.536 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-19T18:57:38.536 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_1 2024-02-19T18:57:38.591 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-19T18:57:38.591 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T18:57:38.591 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-02-19T18:57:38.591 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T18:57:38.591 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T18:57:38.591 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-02-19 18:56:49.474844929 +0000 2024-02-19T18:57:38.592 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-02-19 18:48:35.601169021 +0000 2024-02-19T18:57:38.592 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-02-19 18:48:35.601169021 +0000 2024-02-19T18:57:38.592 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2024-02-19 18:48:35.601169021 +0000 2024-02-19T18:57:38.592 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-19T18:57:38.657 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-02-19T18:57:38.657 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-02-19T18:57:38.657 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000204084 s, 2.5 MB/s 2024-02-19T18:57:38.659 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-19T18:57:38.715 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_2 2024-02-19T18:57:38.770 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-19T18:57:38.770 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T18:57:38.771 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-02-19T18:57:38.771 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T18:57:38.771 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T18:57:38.771 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-02-19 18:56:49.475844906 +0000 2024-02-19T18:57:38.771 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-02-19 18:48:35.942161425 +0000 2024-02-19T18:57:38.771 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-02-19 18:48:35.942161425 +0000 2024-02-19T18:57:38.771 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2024-02-19 18:48:35.942161425 +0000 2024-02-19T18:57:38.771 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-19T18:57:38.836 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-02-19T18:57:38.836 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-02-19T18:57:38.836 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000190287 s, 2.7 MB/s 2024-02-19T18:57:38.837 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-19T18:57:38.892 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_3 2024-02-19T18:57:38.946 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-19T18:57:38.946 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T18:57:38.946 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-02-19T18:57:38.947 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T18:57:38.947 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T18:57:38.947 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-02-19 18:56:49.475844906 +0000 2024-02-19T18:57:38.947 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-02-19 18:48:36.298153495 +0000 2024-02-19T18:57:38.947 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-02-19 18:48:36.298153495 +0000 2024-02-19T18:57:38.947 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2024-02-19 18:48:36.298153495 +0000 2024-02-19T18:57:38.947 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-19T18:57:39.012 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-02-19T18:57:39.012 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-02-19T18:57:39.012 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.0001896 s, 2.7 MB/s 2024-02-19T18:57:39.013 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-19T18:57:39.069 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_4 2024-02-19T18:57:39.123 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-19T18:57:39.123 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T18:57:39.123 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-02-19T18:57:39.123 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T18:57:39.123 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T18:57:39.123 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2024-02-19 18:56:49.475844906 +0000 2024-02-19T18:57:39.123 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-02-19 18:48:36.645145765 +0000 2024-02-19T18:57:39.123 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-02-19 18:48:36.645145765 +0000 2024-02-19T18:57:39.123 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2024-02-19 18:48:36.645145765 +0000 2024-02-19T18:57:39.124 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-19T18:57:39.189 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2024-02-19T18:57:39.189 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2024-02-19T18:57:39.189 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000257921 s, 2.0 MB/s 2024-02-19T18:57:39.190 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-19T18:57:39.246 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-02-19T18:57:39.246 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/scratch_devs of=/dev/stdout 2024-02-19T18:57:39.265 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-19T18:57:39.265 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_1 2024-02-19T18:57:39.283 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:39 smithi096 ceph-mon[29216]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:39.283 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:39 smithi096 ceph-mon[29216]: Reconfiguring ceph-exporter.smithi096 (monmap changed)... 2024-02-19T18:57:39.283 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:39 smithi096 ceph-mon[29216]: Reconfiguring daemon ceph-exporter.smithi096 on smithi096 2024-02-19T18:57:39.322 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-19T18:57:39.322 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T18:57:39.322 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-02-19T18:57:39.322 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T18:57:39.322 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T18:57:39.322 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2024-02-19 18:57:24.942235907 +0000 2024-02-19T18:57:39.322 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2024-02-19 18:48:35.607300954 +0000 2024-02-19T18:57:39.322 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2024-02-19 18:48:35.607300954 +0000 2024-02-19T18:57:39.322 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: 2024-02-19 18:48:35.607300954 +0000 2024-02-19T18:57:39.323 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-19T18:57:39.388 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:39 smithi125 ceph-mon[37556]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:39.388 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:39 smithi125 ceph-mon[37556]: Reconfiguring ceph-exporter.smithi096 (monmap changed)... 2024-02-19T18:57:39.388 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:39 smithi125 ceph-mon[37556]: Reconfiguring daemon ceph-exporter.smithi096 on smithi096 2024-02-19T18:57:39.390 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2024-02-19T18:57:39.391 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2024-02-19T18:57:39.391 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000223089 s, 2.3 MB/s 2024-02-19T18:57:39.392 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-19T18:57:39.450 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_2 2024-02-19T18:57:39.507 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-19T18:57:39.507 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T18:57:39.507 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-02-19T18:57:39.507 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T18:57:39.507 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T18:57:39.507 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2024-02-19 18:57:24.943235890 +0000 2024-02-19T18:57:39.507 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2024-02-19 18:48:35.953294856 +0000 2024-02-19T18:57:39.507 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2024-02-19 18:48:35.953294856 +0000 2024-02-19T18:57:39.507 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: 2024-02-19 18:48:35.953294856 +0000 2024-02-19T18:57:39.507 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-19T18:57:39.574 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2024-02-19T18:57:39.575 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2024-02-19T18:57:39.575 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000237869 s, 2.2 MB/s 2024-02-19T18:57:39.576 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-19T18:57:39.632 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_3 2024-02-19T18:57:39.689 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-19T18:57:39.689 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T18:57:39.689 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-02-19T18:57:39.689 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T18:57:39.689 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T18:57:39.689 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2024-02-19 18:57:24.943235890 +0000 2024-02-19T18:57:39.689 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2024-02-19 18:48:36.286288988 +0000 2024-02-19T18:57:39.689 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2024-02-19 18:48:36.286288988 +0000 2024-02-19T18:57:39.689 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: 2024-02-19 18:48:36.286288988 +0000 2024-02-19T18:57:39.689 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-19T18:57:39.755 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2024-02-19T18:57:39.755 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2024-02-19T18:57:39.755 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000225038 s, 2.3 MB/s 2024-02-19T18:57:39.756 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-19T18:57:39.813 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_4 2024-02-19T18:57:39.868 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-19T18:57:39.868 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-19T18:57:39.868 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-02-19T18:57:39.868 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T18:57:39.868 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2024-02-19T18:57:39.868 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2024-02-19 18:57:24.943235890 +0000 2024-02-19T18:57:39.868 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2024-02-19 18:48:36.660282397 +0000 2024-02-19T18:57:39.868 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2024-02-19 18:48:36.660282397 +0000 2024-02-19T18:57:39.868 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: 2024-02-19 18:48:36.660282397 +0000 2024-02-19T18:57:39.868 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-19T18:57:39.933 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2024-02-19T18:57:39.933 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2024-02-19T18:57:39.933 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.00019134 s, 2.7 MB/s 2024-02-19T18:57:39.934 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-19T18:57:39.990 INFO:tasks.cephadm:Deploying osd.0 on smithi096 with /dev/vg_nvme/lv_4... 2024-02-19T18:57:39.990 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-19T18:57:40.524 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T18:57:40.838 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:40 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:40.838 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:40 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:40.839 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:40 smithi096 ceph-mon[29216]: Reconfiguring crash.smithi096 (monmap changed)... 2024-02-19T18:57:40.839 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:40 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi096", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T18:57:40.839 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:40 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:40.839 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:40 smithi096 ceph-mon[29216]: Reconfiguring daemon crash.smithi096 on smithi096 2024-02-19T18:57:40.839 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:40 smithi096 ceph-mon[29216]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:40.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:40 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:40.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:40 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:40.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:40 smithi125 ceph-mon[37556]: Reconfiguring crash.smithi096 (monmap changed)... 2024-02-19T18:57:40.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:40 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi096", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T18:57:40.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:40 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:40.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:40 smithi125 ceph-mon[37556]: Reconfiguring daemon crash.smithi096 on smithi096 2024-02-19T18:57:40.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:40 smithi125 ceph-mon[37556]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:42.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:42 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:42.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:42 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:42.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:42 smithi096 ceph-mon[29216]: Reconfiguring alertmanager.smithi096 (dependencies changed)... 2024-02-19T18:57:42.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:42 smithi096 ceph-mon[29216]: Reconfiguring daemon alertmanager.smithi096 on smithi096 2024-02-19T18:57:42.448 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:42 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:42.448 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:42 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:42.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:42 smithi125 ceph-mon[37556]: Reconfiguring alertmanager.smithi096 (dependencies changed)... 2024-02-19T18:57:42.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:42 smithi125 ceph-mon[37556]: Reconfiguring daemon alertmanager.smithi096 on smithi096 2024-02-19T18:57:43.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:43 smithi096 ceph-mon[29216]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:43.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:43 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:57:43.448 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:43 smithi125 ceph-mon[37556]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:43.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:43 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:57:45.365 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:45 smithi096 ceph-mon[29216]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:45.448 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:45 smithi125 ceph-mon[37556]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:45.489 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-19T18:57:45.489 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-19T18:57:45.489 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10+0 records in 2024-02-19T18:57:45.489 INFO:teuthology.orchestra.run.smithi096.stderr:10+0 records out 2024-02-19T18:57:45.489 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113077 s, 927 MB/s 2024-02-19T18:57:45.489 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping successful for: 2024-02-19T18:57:46.358 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi096:vg_nvme/lv_4 2024-02-19T18:57:46.613 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:46 smithi096 ceph-mon[29216]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:46.639 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:46 smithi125 ceph-mon[37556]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:46.814 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T18:57:48.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.433+0000 7fc5b55bf700 1 -- 172.21.15.96:0/489564953 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5b00ffbc0 msgr2=0x7fc5b00fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:48.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.433+0000 7fc5b55bf700 1 --2- 172.21.15.96:0/489564953 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5b00ffbc0 0x7fc5b00fffe0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0009910 tx=0x7fc5a0009c20 comp rx=0 tx=0).stop 2024-02-19T18:57:48.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.434+0000 7fc5b55bf700 1 -- 172.21.15.96:0/489564953 shutdown_connections 2024-02-19T18:57:48.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.434+0000 7fc5b55bf700 1 --2- 172.21.15.96:0/489564953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5b0100dc0 0x7fc5b0101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:48.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.434+0000 7fc5b55bf700 1 --2- 172.21.15.96:0/489564953 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5b00ffbc0 0x7fc5b00fffe0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:48.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.434+0000 7fc5b55bf700 1 -- 172.21.15.96:0/489564953 >> 172.21.15.96:0/489564953 conn(0x7fc5b00fb160 msgr2=0x7fc5b00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:57:48.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.434+0000 7fc5b55bf700 1 -- 172.21.15.96:0/489564953 shutdown_connections 2024-02-19T18:57:48.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.434+0000 7fc5b55bf700 1 -- 172.21.15.96:0/489564953 wait complete. 2024-02-19T18:57:48.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.434+0000 7fc5b55bf700 1 Processor -- start 2024-02-19T18:57:48.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.434+0000 7fc5b55bf700 1 -- start start 2024-02-19T18:57:48.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.435+0000 7fc5b55bf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5b00ffbc0 0x7fc5b0069990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:48.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.435+0000 7fc5b55bf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5b0100dc0 0x7fc5b019b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:48.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.435+0000 7fc5b55bf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b019bb70 con 0x7fc5b0100dc0 2024-02-19T18:57:48.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.435+0000 7fc5b55bf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b019bce0 con 0x7fc5b00ffbc0 2024-02-19T18:57:48.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.435+0000 7fc5ae7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5b0100dc0 0x7fc5b019b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:48.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.435+0000 7fc5ae7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5b0100dc0 0x7fc5b019b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50034/0 (socket says 172.21.15.96:50034) 2024-02-19T18:57:48.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.435+0000 7fc5ae7fc700 1 -- 172.21.15.96:0/2773165852 learned_addr learned my addr 172.21.15.96:0/2773165852 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:57:48.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.435+0000 7fc5aeffd700 1 --2- 172.21.15.96:0/2773165852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5b00ffbc0 0x7fc5b0069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:48.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.435+0000 7fc5ae7fc700 1 -- 172.21.15.96:0/2773165852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5b00ffbc0 msgr2=0x7fc5b0069990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:57:48.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.435+0000 7fc5ae7fc700 1 --2- 172.21.15.96:0/2773165852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5b00ffbc0 0x7fc5b0069990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:57:48.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.435+0000 7fc5ae7fc700 1 -- 172.21.15.96:0/2773165852 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a00095f0 con 0x7fc5b0100dc0 2024-02-19T18:57:48.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.435+0000 7fc5ae7fc700 1 --2- 172.21.15.96:0/2773165852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5b0100dc0 0x7fc5b019b5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400b4b0 tx=0x7fc5a400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:57:48.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.435+0000 7fc597fff700 1 -- 172.21.15.96:0/2773165852 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5a4011800 con 0x7fc5b0100dc0 2024-02-19T18:57:48.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.435+0000 7fc597fff700 1 -- 172.21.15.96:0/2773165852 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc5a4011e10 con 0x7fc5b0100dc0 2024-02-19T18:57:48.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.435+0000 7fc597fff700 1 -- 172.21.15.96:0/2773165852 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5a400f2e0 con 0x7fc5b0100dc0 2024-02-19T18:57:48.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.435+0000 7fc5b55bf700 1 -- 172.21.15.96:0/2773165852 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b019bfc0 con 0x7fc5b0100dc0 2024-02-19T18:57:48.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.435+0000 7fc5b55bf700 1 -- 172.21.15.96:0/2773165852 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b019c4e0 con 0x7fc5b0100dc0 2024-02-19T18:57:48.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.436+0000 7fc5b55bf700 1 -- 172.21.15.96:0/2773165852 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b018f5b0 con 0x7fc5b0100dc0 2024-02-19T18:57:48.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.437+0000 7fc597fff700 1 -- 172.21.15.96:0/2773165852 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7fc5a4011960 con 0x7fc5b0100dc0 2024-02-19T18:57:48.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.437+0000 7fc597fff700 1 --2- 172.21.15.96:0/2773165852 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fc59806c470 0x7fc59806e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:57:48.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.437+0000 7fc597fff700 1 -- 172.21.15.96:0/2773165852 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fc5a408a330 con 0x7fc5b0100dc0 2024-02-19T18:57:48.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.437+0000 7fc5aeffd700 1 --2- 172.21.15.96:0/2773165852 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fc59806c470 0x7fc59806e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:57:48.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.438+0000 7fc5aeffd700 1 --2- 172.21.15.96:0/2773165852 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fc59806c470 0x7fc59806e930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0006010 tx=0x7fc5a000b540 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:57:48.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.442+0000 7fc597fff700 1 -- 172.21.15.96:0/2773165852 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc5a4059680 con 0x7fc5b0100dc0 2024-02-19T18:57:48.662 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:57:48.645+0000 7fc5b55bf700 1 -- 172.21.15.96:0/2773165852 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5b002cf30 con 0x7fc59806c470 2024-02-19T18:57:48.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:48 smithi125 ceph-mon[37556]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:48.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:48 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T18:57:48.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:48 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T18:57:48.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:48 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:49.245 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:48 smithi096 ceph-mon[29216]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:49.246 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:48 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T18:57:49.246 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:48 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T18:57:49.246 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:48 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:57:50.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:50 smithi096 ceph-mon[29216]: from='client.14262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:57:50.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:50 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:50.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:50 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:50.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:50 smithi096 ceph-mon[29216]: Reconfiguring grafana.smithi096 (dependencies changed)... 2024-02-19T18:57:50.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:50 smithi096 ceph-mon[29216]: Reconfiguring daemon grafana.smithi096 on smithi096 2024-02-19T18:57:50.448 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:50 smithi125 ceph-mon[37556]: from='client.14262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:57:50.448 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:50 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:50.448 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:50 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:50.448 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:50 smithi125 ceph-mon[37556]: Reconfiguring grafana.smithi096 (dependencies changed)... 2024-02-19T18:57:50.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:50 smithi125 ceph-mon[37556]: Reconfiguring daemon grafana.smithi096 on smithi096 2024-02-19T18:57:51.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:51 smithi096 ceph-mon[29216]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:51.448 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:51 smithi125 ceph-mon[37556]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:53.442 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:53 smithi096 ceph-mon[29216]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:53.448 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:53 smithi125 ceph-mon[37556]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:55.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:54 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:55.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:54 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:55.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:54 smithi096 ceph-mon[29216]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:55.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:54 smithi096 ceph-mon[29216]: Reconfiguring prometheus.smithi096 (dependencies changed)... 2024-02-19T18:57:55.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:54 smithi096 ceph-mon[29216]: Reconfiguring daemon prometheus.smithi096 on smithi096 2024-02-19T18:57:55.198 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:54 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:55.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:54 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:57:55.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:54 smithi125 ceph-mon[37556]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:55.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:54 smithi125 ceph-mon[37556]: Reconfiguring prometheus.smithi096 (dependencies changed)... 2024-02-19T18:57:55.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:54 smithi125 ceph-mon[37556]: Reconfiguring daemon prometheus.smithi096 on smithi096 2024-02-19T18:57:56.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:55 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/2747680002' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8d3e948-3736-431e-9ccd-18d3d1af342a"}]: dispatch 2024-02-19T18:57:56.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:55 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/2747680002' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8d3e948-3736-431e-9ccd-18d3d1af342a"}]': finished 2024-02-19T18:57:56.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:55 smithi096 ceph-mon[29216]: osdmap e6: 1 total, 0 up, 1 in 2024-02-19T18:57:56.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:55 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:57:56.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:55 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/231583093' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T18:57:56.146 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:55 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/2747680002' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c8d3e948-3736-431e-9ccd-18d3d1af342a"}]: dispatch 2024-02-19T18:57:56.146 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:55 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/2747680002' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c8d3e948-3736-431e-9ccd-18d3d1af342a"}]': finished 2024-02-19T18:57:56.146 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:55 smithi125 ceph-mon[37556]: osdmap e6: 1 total, 0 up, 1 in 2024-02-19T18:57:56.146 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:55 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:57:56.146 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:55 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/231583093' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T18:57:57.198 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:56 smithi125 ceph-mon[37556]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:57.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:56 smithi096 ceph-mon[29216]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:58.180 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:57 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:57:58.198 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:57 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:57:58.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:57:58 smithi125 ceph-mon[37556]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:57:59.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:57:58 smithi096 ceph-mon[29216]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:58:01.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:00 smithi096 ceph-mon[29216]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:58:01.198 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:00 smithi125 ceph-mon[37556]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:58:03.195 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:02 smithi096 ceph-mon[29216]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:58:03.198 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:02 smithi125 ceph-mon[37556]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:58:05.117 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:04 smithi096 ceph-mon[29216]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:58:05.117 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:04 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:05.117 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:04 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:05.117 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:04 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi125", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T18:58:05.117 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:04 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:05.148 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:04 smithi125 ceph-mon[37556]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:58:05.148 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:04 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:05.148 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:04 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:05.148 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:04 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi125", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T18:58:05.148 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:04 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:06.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:05 smithi096 ceph-mon[29216]: Reconfiguring ceph-exporter.smithi125 (monmap changed)... 2024-02-19T18:58:06.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:05 smithi096 ceph-mon[29216]: Reconfiguring daemon ceph-exporter.smithi125 on smithi125 2024-02-19T18:58:06.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:05 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:06.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:05 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:06.150 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:05 smithi125 ceph-mon[37556]: Reconfiguring ceph-exporter.smithi125 (monmap changed)... 2024-02-19T18:58:06.150 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:05 smithi125 ceph-mon[37556]: Reconfiguring daemon ceph-exporter.smithi125 on smithi125 2024-02-19T18:58:06.150 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:05 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:06.151 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:05 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:07.152 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:06 smithi125 ceph-mon[37556]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:58:07.152 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:06 smithi125 ceph-mon[37556]: Reconfiguring crash.smithi125 (monmap changed)... 2024-02-19T18:58:07.152 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:06 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi125", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T18:58:07.152 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:06 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:07.152 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:06 smithi125 ceph-mon[37556]: Reconfiguring daemon crash.smithi125 on smithi125 2024-02-19T18:58:07.152 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:06 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-19T18:58:07.152 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:06 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:07.152 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:06 smithi125 ceph-mon[37556]: Deploying daemon osd.0 on smithi096 2024-02-19T18:58:07.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:06 smithi096 ceph-mon[29216]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:58:07.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:06 smithi096 ceph-mon[29216]: Reconfiguring crash.smithi125 (monmap changed)... 2024-02-19T18:58:07.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:06 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi125", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T18:58:07.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:06 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:07.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:06 smithi096 ceph-mon[29216]: Reconfiguring daemon crash.smithi125 on smithi125 2024-02-19T18:58:07.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:06 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-19T18:58:07.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:06 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:07.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:06 smithi096 ceph-mon[29216]: Deploying daemon osd.0 on smithi096 2024-02-19T18:58:08.198 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:08 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:08.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:08 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:08.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:08 smithi125 ceph-mon[37556]: Reconfiguring mgr.smithi125.ygdmdu (monmap changed)... 2024-02-19T18:58:08.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:08 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi125.ygdmdu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T18:58:08.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:08 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T18:58:08.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:08 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:08.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:08 smithi125 ceph-mon[37556]: Reconfiguring daemon mgr.smithi125.ygdmdu on smithi125 2024-02-19T18:58:08.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:08 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:08.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:08 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:08.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:08 smithi096 ceph-mon[29216]: Reconfiguring mgr.smithi125.ygdmdu (monmap changed)... 2024-02-19T18:58:08.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:08 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi125.ygdmdu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T18:58:08.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:08 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T18:58:08.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:08 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:08.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:08 smithi096 ceph-mon[29216]: Reconfiguring daemon mgr.smithi125.ygdmdu on smithi125 2024-02-19T18:58:09.275 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:09 smithi096 ceph-mon[29216]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:58:09.275 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:09 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:09.275 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:09 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:09.276 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:09 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T18:58:09.276 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:09 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T18:58:09.276 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:09 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:09.359 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:09 smithi125 ceph-mon[37556]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:58:09.359 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:09 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:09.359 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:09 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:09.359 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:09 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T18:58:09.359 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:09 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T18:58:09.359 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:09 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:10.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:10 smithi096 ceph-mon[29216]: Reconfiguring mon.smithi125 (monmap changed)... 2024-02-19T18:58:10.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:10 smithi096 ceph-mon[29216]: Reconfiguring daemon mon.smithi125 on smithi125 2024-02-19T18:58:10.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:10 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:10.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:10 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:10.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:10 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T18:58:10.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:10 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi096.front.sepia.ceph.com:9093"}]: dispatch 2024-02-19T18:58:10.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:10 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:10.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:10 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T18:58:10.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:10 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi096.front.sepia.ceph.com:3000"}]: dispatch 2024-02-19T18:58:10.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:10 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:10.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:10 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T18:58:10.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:10 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi096.front.sepia.ceph.com:9095"}]: dispatch 2024-02-19T18:58:10.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:10 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:10.348 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:10 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:58:10.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:10 smithi125 ceph-mon[37556]: Reconfiguring mon.smithi125 (monmap changed)... 2024-02-19T18:58:10.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:10 smithi125 ceph-mon[37556]: Reconfiguring daemon mon.smithi125 on smithi125 2024-02-19T18:58:10.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:10 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:10.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:10 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:10.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:10 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T18:58:10.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:10 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi096.front.sepia.ceph.com:9093"}]: dispatch 2024-02-19T18:58:10.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:10 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:10.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:10 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T18:58:10.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:10 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi096.front.sepia.ceph.com:3000"}]: dispatch 2024-02-19T18:58:10.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:10 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:10.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:10 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T18:58:10.450 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:10 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi096.front.sepia.ceph.com:9095"}]: dispatch 2024-02-19T18:58:10.450 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:10 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:10.450 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:10 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:58:11.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:11 smithi125 ceph-mon[37556]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:58:11.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:11 smithi125 ceph-mon[37556]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T18:58:11.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:11 smithi125 ceph-mon[37556]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi096.front.sepia.ceph.com:9093"}]: dispatch 2024-02-19T18:58:11.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:11 smithi125 ceph-mon[37556]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T18:58:11.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:11 smithi125 ceph-mon[37556]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi096.front.sepia.ceph.com:3000"}]: dispatch 2024-02-19T18:58:11.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:11 smithi125 ceph-mon[37556]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T18:58:11.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:11 smithi125 ceph-mon[37556]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi096.front.sepia.ceph.com:9095"}]: dispatch 2024-02-19T18:58:11.530 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:11 smithi096 ceph-mon[29216]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:58:11.530 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:11 smithi096 ceph-mon[29216]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T18:58:11.530 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:11 smithi096 ceph-mon[29216]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi096.front.sepia.ceph.com:9093"}]: dispatch 2024-02-19T18:58:11.530 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:11 smithi096 ceph-mon[29216]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T18:58:11.530 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:11 smithi096 ceph-mon[29216]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi096.front.sepia.ceph.com:3000"}]: dispatch 2024-02-19T18:58:11.530 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:11 smithi096 ceph-mon[29216]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T18:58:11.530 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:11 smithi096 ceph-mon[29216]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi096.front.sepia.ceph.com:9095"}]: dispatch 2024-02-19T18:58:12.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:12 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:12.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:12 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:12.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:12 smithi096 ceph-mon[29216]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:58:12.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:12 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:12.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:12 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:12.698 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:12 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:12.698 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:12 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:12.698 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:12 smithi125 ceph-mon[37556]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:58:12.698 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:12 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:12.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:12 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:13.347 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:13 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:58:13.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:13 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:58:14.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:14 smithi096 ceph-mon[29216]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:58:14.698 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:14 smithi125 ceph-mon[37556]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:58:15.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:15 smithi096 ceph-mon[29216]: from='osd.0 [v2:172.21.15.96:6802/1987555426,v1:172.21.15.96:6803/1987555426]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T18:58:15.600 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:15 smithi125 ceph-mon[37556]: from='osd.0 [v2:172.21.15.96:6802/1987555426,v1:172.21.15.96:6803/1987555426]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T18:58:16.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:15.985+0000 7fc597fff700 1 -- 172.21.15.96:0/2773165852 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc5b002cf30 con 0x7fc59806c470 2024-02-19T18:58:16.004 INFO:teuthology.orchestra.run.smithi096.stdout:Created osd(s) 0 on host 'smithi096' 2024-02-19T18:58:16.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:15.987+0000 7fc5b55bf700 1 -- 172.21.15.96:0/2773165852 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fc59806c470 msgr2=0x7fc59806e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:16.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:15.987+0000 7fc5b55bf700 1 --2- 172.21.15.96:0/2773165852 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fc59806c470 0x7fc59806e930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0006010 tx=0x7fc5a000b540 comp rx=0 tx=0).stop 2024-02-19T18:58:16.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:15.987+0000 7fc5b55bf700 1 -- 172.21.15.96:0/2773165852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5b0100dc0 msgr2=0x7fc5b019b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:16.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:15.987+0000 7fc5b55bf700 1 --2- 172.21.15.96:0/2773165852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5b0100dc0 0x7fc5b019b5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400b4b0 tx=0x7fc5a400b870 comp rx=0 tx=0).stop 2024-02-19T18:58:16.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:15.987+0000 7fc5b55bf700 1 -- 172.21.15.96:0/2773165852 shutdown_connections 2024-02-19T18:58:16.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:15.987+0000 7fc5b55bf700 1 --2- 172.21.15.96:0/2773165852 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fc59806c470 0x7fc59806e930 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:16.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:15.987+0000 7fc5b55bf700 1 --2- 172.21.15.96:0/2773165852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5b00ffbc0 0x7fc5b0069990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:16.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:15.987+0000 7fc5b55bf700 1 --2- 172.21.15.96:0/2773165852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5b0100dc0 0x7fc5b019b5a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:16.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:15.987+0000 7fc5b55bf700 1 -- 172.21.15.96:0/2773165852 >> 172.21.15.96:0/2773165852 conn(0x7fc5b00fb160 msgr2=0x7fc5b01040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:16.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:15.987+0000 7fc5b55bf700 1 -- 172.21.15.96:0/2773165852 shutdown_connections 2024-02-19T18:58:16.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:15.987+0000 7fc5b55bf700 1 -- 172.21.15.96:0/2773165852 wait complete. 2024-02-19T18:58:16.628 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:16 smithi125 ceph-mon[37556]: from='osd.0 [v2:172.21.15.96:6802/1987555426,v1:172.21.15.96:6803/1987555426]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-19T18:58:16.628 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:16 smithi125 ceph-mon[37556]: osdmap e7: 1 total, 0 up, 1 in 2024-02-19T18:58:16.628 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:16 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:58:16.629 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:16 smithi125 ceph-mon[37556]: from='osd.0 [v2:172.21.15.96:6802/1987555426,v1:172.21.15.96:6803/1987555426]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2024-02-19T18:58:16.629 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:16 smithi125 ceph-mon[37556]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:58:16.629 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:16 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:16.629 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:16 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:16.643 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:16 smithi096 ceph-mon[29216]: from='osd.0 [v2:172.21.15.96:6802/1987555426,v1:172.21.15.96:6803/1987555426]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-19T18:58:16.643 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:16 smithi096 ceph-mon[29216]: osdmap e7: 1 total, 0 up, 1 in 2024-02-19T18:58:16.643 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:16 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:58:16.644 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:16 smithi096 ceph-mon[29216]: from='osd.0 [v2:172.21.15.96:6802/1987555426,v1:172.21.15.96:6803/1987555426]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2024-02-19T18:58:16.644 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:16 smithi096 ceph-mon[29216]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:58:16.644 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:16 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:16.644 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:16 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:16.665 DEBUG:teuthology.orchestra.run.smithi096:osd.0> sudo journalctl -f -n 0 -u ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.0.service 2024-02-19T18:58:16.668 INFO:tasks.cephadm:Deploying osd.1 on smithi096 with /dev/vg_nvme/lv_3... 2024-02-19T18:58:16.668 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-19T18:58:17.344 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T18:58:17.580 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:17 smithi096 ceph-mon[29216]: from='osd.0 [v2:172.21.15.96:6802/1987555426,v1:172.21.15.96:6803/1987555426]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2024-02-19T18:58:17.580 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:17 smithi096 ceph-mon[29216]: osdmap e8: 1 total, 0 up, 1 in 2024-02-19T18:58:17.580 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:17 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:58:17.580 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:17 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:58:17.698 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:17 smithi125 ceph-mon[37556]: from='osd.0 [v2:172.21.15.96:6802/1987555426,v1:172.21.15.96:6803/1987555426]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2024-02-19T18:58:17.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:17 smithi125 ceph-mon[37556]: osdmap e8: 1 total, 0 up, 1 in 2024-02-19T18:58:17.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:17 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:58:17.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:17 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:58:18.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:18 smithi096 ceph-mon[29216]: purged_snaps scrub starts 2024-02-19T18:58:18.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:18 smithi096 ceph-mon[29216]: purged_snaps scrub ok 2024-02-19T18:58:18.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:18 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:58:18.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:18 smithi096 ceph-mon[29216]: osd.0 [v2:172.21.15.96:6802/1987555426,v1:172.21.15.96:6803/1987555426] boot 2024-02-19T18:58:18.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:18 smithi096 ceph-mon[29216]: osdmap e9: 1 total, 1 up, 1 in 2024-02-19T18:58:18.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:18 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:58:18.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:18 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:18.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:18 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:18.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:18 smithi096 ceph-mon[29216]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:58:18.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:18 smithi125 ceph-mon[37556]: purged_snaps scrub starts 2024-02-19T18:58:18.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:18 smithi125 ceph-mon[37556]: purged_snaps scrub ok 2024-02-19T18:58:18.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:18 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:58:18.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:18 smithi125 ceph-mon[37556]: osd.0 [v2:172.21.15.96:6802/1987555426,v1:172.21.15.96:6803/1987555426] boot 2024-02-19T18:58:18.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:18 smithi125 ceph-mon[37556]: osdmap e9: 1 total, 1 up, 1 in 2024-02-19T18:58:18.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:18 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T18:58:18.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:18 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:18.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:18 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:18.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:18 smithi125 ceph-mon[37556]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-19T18:58:19.189 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-19T18:58:19.189 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-19T18:58:19.189 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10+0 records in 2024-02-19T18:58:19.189 INFO:teuthology.orchestra.run.smithi096.stderr:10+0 records out 2024-02-19T18:58:19.189 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126383 s, 830 MB/s 2024-02-19T18:58:19.189 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping successful for: 2024-02-19T18:58:19.512 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:19 smithi096 ceph-mon[29216]: osdmap e10: 1 total, 1 up, 1 in 2024-02-19T18:58:19.698 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:19 smithi125 ceph-mon[37556]: osdmap e10: 1 total, 1 up, 1 in 2024-02-19T18:58:20.155 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi096:vg_nvme/lv_3 2024-02-19T18:58:20.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:20 smithi096 ceph-mon[29216]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:20.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:20 smithi125 ceph-mon[37556]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:21.055 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T18:58:22.896 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:22 smithi096 ceph-mon[29216]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:22.896 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:22 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:22.896 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:22 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:22.896 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:22 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:58:22.896 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:22 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:22.896 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:22 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:22.896 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:22 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:58:22.896 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:22 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:22.897 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:22 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:58:23.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.100+0000 7f79f6f13700 1 -- 172.21.15.96:0/1473209022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79f00ffbc0 msgr2=0x7f79f00fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:23.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.100+0000 7f79f6f13700 1 --2- 172.21.15.96:0/1473209022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79f00ffbc0 0x7f79f00fffe0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009910 tx=0x7f79e4009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:23.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.100+0000 7f79f6f13700 1 -- 172.21.15.96:0/1473209022 shutdown_connections 2024-02-19T18:58:23.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.100+0000 7f79f6f13700 1 --2- 172.21.15.96:0/1473209022 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79f0100dc0 0x7f79f0101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:23.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.100+0000 7f79f6f13700 1 --2- 172.21.15.96:0/1473209022 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79f00ffbc0 0x7f79f00fffe0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:23.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.100+0000 7f79f6f13700 1 -- 172.21.15.96:0/1473209022 >> 172.21.15.96:0/1473209022 conn(0x7f79f00fb160 msgr2=0x7f79f00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:23.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.100+0000 7f79f6f13700 1 -- 172.21.15.96:0/1473209022 shutdown_connections 2024-02-19T18:58:23.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.100+0000 7f79f6f13700 1 -- 172.21.15.96:0/1473209022 wait complete. 2024-02-19T18:58:23.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.101+0000 7f79f6f13700 1 Processor -- start 2024-02-19T18:58:23.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.101+0000 7f79f6f13700 1 -- start start 2024-02-19T18:58:23.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.101+0000 7f79f6f13700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79f00ffbc0 0x7f79f00699d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:23.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.101+0000 7f79f6f13700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79f0100dc0 0x7f79f019b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:23.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.101+0000 7f79f6f13700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f019bb00 con 0x7f79f00ffbc0 2024-02-19T18:58:23.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.101+0000 7f79f6f13700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f019bc40 con 0x7f79f0100dc0 2024-02-19T18:58:23.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.101+0000 7f79f4caf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79f00ffbc0 0x7f79f00699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:23.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.101+0000 7f79f4caf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79f00ffbc0 0x7f79f00699d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57902/0 (socket says 172.21.15.96:57902) 2024-02-19T18:58:23.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.101+0000 7f79f4caf700 1 -- 172.21.15.96:0/1978227619 learned_addr learned my addr 172.21.15.96:0/1978227619 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:58:23.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.101+0000 7f79effff700 1 --2- 172.21.15.96:0/1978227619 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79f0100dc0 0x7f79f019b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:23.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.102+0000 7f79f4caf700 1 -- 172.21.15.96:0/1978227619 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79f0100dc0 msgr2=0x7f79f019b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:23.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.102+0000 7f79f4caf700 1 --2- 172.21.15.96:0/1978227619 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79f0100dc0 0x7f79f019b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:23.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.102+0000 7f79f4caf700 1 -- 172.21.15.96:0/1978227619 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e40095f0 con 0x7f79f00ffbc0 2024-02-19T18:58:23.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.102+0000 7f79f4caf700 1 --2- 172.21.15.96:0/1978227619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79f00ffbc0 0x7f79f00699d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f79e400f6c0 tx=0x7f79e400f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:23.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.102+0000 7f79edffb700 1 -- 172.21.15.96:0/1978227619 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79e401d070 con 0x7f79f00ffbc0 2024-02-19T18:58:23.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.102+0000 7f79edffb700 1 -- 172.21.15.96:0/1978227619 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f79e4005dc0 con 0x7f79f00ffbc0 2024-02-19T18:58:23.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.102+0000 7f79f6f13700 1 -- 172.21.15.96:0/1978227619 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f019bec0 con 0x7f79f00ffbc0 2024-02-19T18:58:23.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.102+0000 7f79edffb700 1 -- 172.21.15.96:0/1978227619 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79e4017630 con 0x7f79f00ffbc0 2024-02-19T18:58:23.122 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:22 smithi125 ceph-mon[37556]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:23.122 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:22 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:23.122 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:22 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:23.122 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:22 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:58:23.122 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:22 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:23.123 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:22 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:23.123 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:22 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:58:23.123 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:22 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:23.123 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:22 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:58:23.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.102+0000 7f79f6f13700 1 -- 172.21.15.96:0/1978227619 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f019c330 con 0x7f79f00ffbc0 2024-02-19T18:58:23.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.103+0000 7f79f6f13700 1 -- 172.21.15.96:0/1978227619 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f018f530 con 0x7f79f00ffbc0 2024-02-19T18:58:23.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.104+0000 7f79edffb700 1 -- 172.21.15.96:0/1978227619 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7f79e4003910 con 0x7f79f00ffbc0 2024-02-19T18:58:23.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.104+0000 7f79edffb700 1 --2- 172.21.15.96:0/1978227619 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f79e006c470 0x7f79e006e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:23.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.105+0000 7f79edffb700 1 -- 172.21.15.96:0/1978227619 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7f79e408bdd0 con 0x7f79f00ffbc0 2024-02-19T18:58:23.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.105+0000 7f79effff700 1 --2- 172.21.15.96:0/1978227619 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f79e006c470 0x7f79e006e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:23.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.105+0000 7f79effff700 1 --2- 172.21.15.96:0/1978227619 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f79e006c470 0x7f79e006e930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009c60 tx=0x7f79dc009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:23.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.110+0000 7f79edffb700 1 -- 172.21.15.96:0/1978227619 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f79e405aec0 con 0x7f79f00ffbc0 2024-02-19T18:58:23.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:23.335+0000 7f79f6f13700 1 -- 172.21.15.96:0/1978227619 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f79f00008d0 con 0x7f79e006c470 2024-02-19T18:58:24.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:23 smithi096 ceph-mon[29216]: Detected new or changed devices on smithi096 2024-02-19T18:58:24.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:23 smithi096 ceph-mon[29216]: Adjusting osd_memory_target on smithi096 to 11840M 2024-02-19T18:58:24.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:23 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T18:58:24.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:23 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T18:58:24.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:23 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:24.198 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:23 smithi125 ceph-mon[37556]: Detected new or changed devices on smithi096 2024-02-19T18:58:24.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:23 smithi125 ceph-mon[37556]: Adjusting osd_memory_target on smithi096 to 11840M 2024-02-19T18:58:24.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:23 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T18:58:24.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:23 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T18:58:24.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:23 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:24.980 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:24 smithi096 ceph-mon[29216]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:58:24.980 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:24 smithi096 ceph-mon[29216]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:24.980 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:24 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:24.980 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:24 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:25.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:24 smithi125 ceph-mon[37556]: from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:58:25.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:24 smithi125 ceph-mon[37556]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:25.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:24 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:25.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:24 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:26.667 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:26 smithi096 ceph-mon[29216]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:26.667 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:26 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/3039310597' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "012aa0e0-d3ed-4b27-9e5e-fd667e4523ab"}]: dispatch 2024-02-19T18:58:26.667 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:26 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/3039310597' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "012aa0e0-d3ed-4b27-9e5e-fd667e4523ab"}]': finished 2024-02-19T18:58:26.667 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:26 smithi096 ceph-mon[29216]: osdmap e11: 2 total, 1 up, 2 in 2024-02-19T18:58:26.667 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:26 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:58:26.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:26 smithi125 ceph-mon[37556]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:26.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:26 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/3039310597' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "012aa0e0-d3ed-4b27-9e5e-fd667e4523ab"}]: dispatch 2024-02-19T18:58:26.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:26 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/3039310597' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "012aa0e0-d3ed-4b27-9e5e-fd667e4523ab"}]': finished 2024-02-19T18:58:26.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:26 smithi125 ceph-mon[37556]: osdmap e11: 2 total, 1 up, 2 in 2024-02-19T18:58:26.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:58:27.478 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:27 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/1178949817' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T18:58:27.698 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:27 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/1178949817' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T18:58:28.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:28 smithi096 ceph-mon[29216]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:28.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:28 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:58:28.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:28 smithi125 ceph-mon[37556]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:28.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:28 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:58:29.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:29 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:29.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:29 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:29.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:29 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:29.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:29 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:58:29.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:29 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:29.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:29 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:29.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:29 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:29.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:29 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:29.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:29 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:58:29.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:29 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:30.605 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:30 smithi096 ceph-mon[29216]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:30.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:30 smithi125 ceph-mon[37556]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:33.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:32 smithi125 ceph-mon[37556]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:33.282 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:32 smithi096 ceph-mon[29216]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:34.155 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:33 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-19T18:58:34.155 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:33 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:34.198 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:33 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-19T18:58:34.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:33 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:34.960 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:34 smithi096 ceph-mon[29216]: Deploying daemon osd.1 on smithi096 2024-02-19T18:58:34.960 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:34 smithi096 ceph-mon[29216]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:35.198 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:34 smithi125 ceph-mon[37556]: Deploying daemon osd.1 on smithi096 2024-02-19T18:58:35.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:34 smithi125 ceph-mon[37556]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:36.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:36 smithi125 ceph-mon[37556]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:36.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:36 smithi096 ceph-mon[29216]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:39.129 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:38 smithi096 ceph-mon[29216]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:39.198 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:38 smithi125 ceph-mon[37556]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:40.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:39 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:40.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:39 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:58:40.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:39 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:40.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:39 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:40.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:39 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:58:40.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:39 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:41.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:40 smithi125 ceph-mon[37556]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:41.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:40 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:41.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:40 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:41.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:40 smithi096 ceph-mon[29216]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:41.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:40 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:41.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:40 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:43.068 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:42 smithi096 ceph-mon[29216]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:43.068 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:42 smithi096 ceph-mon[29216]: from='osd.1 [v2:172.21.15.96:6810/3386518204,v1:172.21.15.96:6811/3386518204]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-19T18:58:43.068 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:42 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:58:43.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:43.104+0000 7f79edffb700 1 -- 172.21.15.96:0/1978227619 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f79f00008d0 con 0x7f79e006c470 2024-02-19T18:58:43.122 INFO:teuthology.orchestra.run.smithi096.stdout:Created osd(s) 1 on host 'smithi096' 2024-02-19T18:58:43.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:43.106+0000 7f79f6f13700 1 -- 172.21.15.96:0/1978227619 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f79e006c470 msgr2=0x7f79e006e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:43.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:43.106+0000 7f79f6f13700 1 --2- 172.21.15.96:0/1978227619 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f79e006c470 0x7f79e006e930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009c60 tx=0x7f79dc009260 comp rx=0 tx=0).stop 2024-02-19T18:58:43.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:43.106+0000 7f79f6f13700 1 -- 172.21.15.96:0/1978227619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79f00ffbc0 msgr2=0x7f79f00699d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:43.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:43.106+0000 7f79f6f13700 1 --2- 172.21.15.96:0/1978227619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79f00ffbc0 0x7f79f00699d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f79e400f6c0 tx=0x7f79e400f6f0 comp rx=0 tx=0).stop 2024-02-19T18:58:43.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:43.107+0000 7f79f6f13700 1 -- 172.21.15.96:0/1978227619 shutdown_connections 2024-02-19T18:58:43.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:43.107+0000 7f79f6f13700 1 --2- 172.21.15.96:0/1978227619 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f79e006c470 0x7f79e006e930 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:43.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:43.107+0000 7f79f6f13700 1 --2- 172.21.15.96:0/1978227619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f79f00ffbc0 0x7f79f00699d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:43.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:43.107+0000 7f79f6f13700 1 --2- 172.21.15.96:0/1978227619 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f79f0100dc0 0x7f79f019b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:43.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:43.107+0000 7f79f6f13700 1 -- 172.21.15.96:0/1978227619 >> 172.21.15.96:0/1978227619 conn(0x7f79f00fb160 msgr2=0x7f79f01040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:43.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:43.107+0000 7f79f6f13700 1 -- 172.21.15.96:0/1978227619 shutdown_connections 2024-02-19T18:58:43.125 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:43.107+0000 7f79f6f13700 1 -- 172.21.15.96:0/1978227619 wait complete. 2024-02-19T18:58:43.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:42 smithi125 ceph-mon[37556]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:43.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:42 smithi125 ceph-mon[37556]: from='osd.1 [v2:172.21.15.96:6810/3386518204,v1:172.21.15.96:6811/3386518204]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-19T18:58:43.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:42 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:58:43.728 DEBUG:teuthology.orchestra.run.smithi096:osd.1> sudo journalctl -f -n 0 -u ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.1.service 2024-02-19T18:58:43.730 INFO:tasks.cephadm:Deploying osd.2 on smithi096 with /dev/vg_nvme/lv_2... 2024-02-19T18:58:43.730 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-19T18:58:43.976 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:43 smithi096 ceph-mon[29216]: from='osd.1 [v2:172.21.15.96:6810/3386518204,v1:172.21.15.96:6811/3386518204]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-19T18:58:43.976 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:43 smithi096 ceph-mon[29216]: osdmap e12: 2 total, 1 up, 2 in 2024-02-19T18:58:43.976 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:43 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:58:43.976 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:43 smithi096 ceph-mon[29216]: from='osd.1 [v2:172.21.15.96:6810/3386518204,v1:172.21.15.96:6811/3386518204]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2024-02-19T18:58:43.976 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:43 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:43.977 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:43 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:43.977 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:43 smithi096 ceph-mon[29216]: from='osd.1 [v2:172.21.15.96:6810/3386518204,v1:172.21.15.96:6811/3386518204]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2024-02-19T18:58:43.977 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:43 smithi096 ceph-mon[29216]: osdmap e13: 2 total, 1 up, 2 in 2024-02-19T18:58:43.977 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:43 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:58:43.977 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 18:58:43 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1[55889]: 2024-02-19T18:58:43.895+0000 7fdbb09a3700 -1 osd.1 0 waiting for initial osdmap 2024-02-19T18:58:43.977 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 18:58:43 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1[55889]: 2024-02-19T18:58:43.900+0000 7fdbaaf95700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T18:58:44.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:43 smithi125 ceph-mon[37556]: from='osd.1 [v2:172.21.15.96:6810/3386518204,v1:172.21.15.96:6811/3386518204]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-19T18:58:44.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:43 smithi125 ceph-mon[37556]: osdmap e12: 2 total, 1 up, 2 in 2024-02-19T18:58:44.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:43 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:58:44.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:43 smithi125 ceph-mon[37556]: from='osd.1 [v2:172.21.15.96:6810/3386518204,v1:172.21.15.96:6811/3386518204]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2024-02-19T18:58:44.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:43 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:44.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:43 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:44.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:43 smithi125 ceph-mon[37556]: from='osd.1 [v2:172.21.15.96:6810/3386518204,v1:172.21.15.96:6811/3386518204]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2024-02-19T18:58:44.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:43 smithi125 ceph-mon[37556]: osdmap e13: 2 total, 1 up, 2 in 2024-02-19T18:58:44.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:43 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:58:44.767 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T18:58:45.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:44 smithi125 ceph-mon[37556]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:45.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:44 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:58:45.231 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:44 smithi096 ceph-mon[29216]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:45.231 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:44 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:58:46.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:45 smithi125 ceph-mon[37556]: purged_snaps scrub starts 2024-02-19T18:58:46.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:45 smithi125 ceph-mon[37556]: purged_snaps scrub ok 2024-02-19T18:58:46.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:45 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:58:46.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:45 smithi125 ceph-mon[37556]: osd.1 [v2:172.21.15.96:6810/3386518204,v1:172.21.15.96:6811/3386518204] boot 2024-02-19T18:58:46.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:45 smithi125 ceph-mon[37556]: osdmap e14: 2 total, 2 up, 2 in 2024-02-19T18:58:46.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:45 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:58:46.212 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:45 smithi096 ceph-mon[29216]: purged_snaps scrub starts 2024-02-19T18:58:46.212 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:45 smithi096 ceph-mon[29216]: purged_snaps scrub ok 2024-02-19T18:58:46.212 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:45 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:58:46.212 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:45 smithi096 ceph-mon[29216]: osd.1 [v2:172.21.15.96:6810/3386518204,v1:172.21.15.96:6811/3386518204] boot 2024-02-19T18:58:46.212 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:45 smithi096 ceph-mon[29216]: osdmap e14: 2 total, 2 up, 2 in 2024-02-19T18:58:46.212 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:45 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T18:58:47.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:46 smithi096 ceph-mon[29216]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:47.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:46 smithi096 ceph-mon[29216]: osdmap e15: 2 total, 2 up, 2 in 2024-02-19T18:58:47.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:46 smithi125 ceph-mon[37556]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-19T18:58:47.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:46 smithi125 ceph-mon[37556]: osdmap e15: 2 total, 2 up, 2 in 2024-02-19T18:58:47.552 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-19T18:58:47.552 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-19T18:58:47.552 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10+0 records in 2024-02-19T18:58:47.552 INFO:teuthology.orchestra.run.smithi096.stderr:10+0 records out 2024-02-19T18:58:47.552 INFO:teuthology.orchestra.run.smithi096.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0131581 s, 797 MB/s 2024-02-19T18:58:47.553 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping successful for: 2024-02-19T18:58:48.149 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi096:vg_nvme/lv_2 2024-02-19T18:58:48.404 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:48 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:48.404 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:48 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:48.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:48 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:48.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:48 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:49.233 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T18:58:49.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:49 smithi096 ceph-mon[29216]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:58:49.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:49 smithi125 ceph-mon[37556]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:58:51.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.207+0000 7f8bfe594700 1 -- 172.21.15.96:0/2739346559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bf8100530 msgr2=0x7f8bf8100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:51.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.207+0000 7f8bfe594700 1 --2- 172.21.15.96:0/2739346559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bf8100530 0x7f8bf8100990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8be0009910 tx=0x7f8be0009c20 comp rx=0 tx=0).stop 2024-02-19T18:58:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.207+0000 7f8bfe594700 1 -- 172.21.15.96:0/2739346559 shutdown_connections 2024-02-19T18:58:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.207+0000 7f8bfe594700 1 --2- 172.21.15.96:0/2739346559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bf8100530 0x7f8bf8100990 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.207+0000 7f8bfe594700 1 --2- 172.21.15.96:0/2739346559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bf80ff330 0x7f8bf80ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.207+0000 7f8bfe594700 1 -- 172.21.15.96:0/2739346559 >> 172.21.15.96:0/2739346559 conn(0x7f8bf80fa8b0 msgr2=0x7f8bf80fcd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:58:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.207+0000 7f8bfe594700 1 -- 172.21.15.96:0/2739346559 shutdown_connections 2024-02-19T18:58:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.207+0000 7f8bfe594700 1 -- 172.21.15.96:0/2739346559 wait complete. 2024-02-19T18:58:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.208+0000 7f8bfe594700 1 Processor -- start 2024-02-19T18:58:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.208+0000 7f8bfe594700 1 -- start start 2024-02-19T18:58:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.208+0000 7f8bfe594700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bf80ff330 0x7f8bf81964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.208+0000 7f8bfe594700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bf8100530 0x7f8bf81969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.208+0000 7f8bfe594700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf8197000 con 0x7f8bf80ff330 2024-02-19T18:58:51.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.208+0000 7f8bfe594700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf8197140 con 0x7f8bf8100530 2024-02-19T18:58:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.208+0000 7f8bf7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bf80ff330 0x7f8bf81964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.208+0000 7f8bf7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bf80ff330 0x7f8bf81964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36222/0 (socket says 172.21.15.96:36222) 2024-02-19T18:58:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.208+0000 7f8bf7fff700 1 -- 172.21.15.96:0/1586080084 learned_addr learned my addr 172.21.15.96:0/1586080084 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T18:58:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.209+0000 7f8bf77fe700 1 --2- 172.21.15.96:0/1586080084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bf8100530 0x7f8bf81969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.209+0000 7f8bf7fff700 1 -- 172.21.15.96:0/1586080084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bf8100530 msgr2=0x7f8bf81969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:58:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.209+0000 7f8bf7fff700 1 --2- 172.21.15.96:0/1586080084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bf8100530 0x7f8bf81969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:58:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.209+0000 7f8bf7fff700 1 -- 172.21.15.96:0/1586080084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be00095f0 con 0x7f8bf80ff330 2024-02-19T18:58:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.209+0000 7f8bf77fe700 1 --2- 172.21.15.96:0/1586080084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bf8100530 0x7f8bf81969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T18:58:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.209+0000 7f8bf7fff700 1 --2- 172.21.15.96:0/1586080084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bf80ff330 0x7f8bf81964a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8be800dd70 tx=0x7f8be800a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.209+0000 7f8bf57fa700 1 -- 172.21.15.96:0/1586080084 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8be800ad50 con 0x7f8bf80ff330 2024-02-19T18:58:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.209+0000 7f8bfe594700 1 -- 172.21.15.96:0/1586080084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf819bbf0 con 0x7f8bf80ff330 2024-02-19T18:58:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.209+0000 7f8bf57fa700 1 -- 172.21.15.96:0/1586080084 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8be80044d0 con 0x7f8bf80ff330 2024-02-19T18:58:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.209+0000 7f8bf57fa700 1 -- 172.21.15.96:0/1586080084 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8be800e680 con 0x7f8bf80ff330 2024-02-19T18:58:51.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.209+0000 7f8bfe594700 1 -- 172.21.15.96:0/1586080084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf819c140 con 0x7f8bf80ff330 2024-02-19T18:58:51.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.210+0000 7f8bfe594700 1 -- 172.21.15.96:0/1586080084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf8190420 con 0x7f8bf80ff330 2024-02-19T18:58:51.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.211+0000 7f8bf57fa700 1 -- 172.21.15.96:0/1586080084 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7f8be8003ee0 con 0x7f8bf80ff330 2024-02-19T18:58:51.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.211+0000 7f8bf57fa700 1 --2- 172.21.15.96:0/1586080084 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f8be406c470 0x7f8be406e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:58:51.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.211+0000 7f8bf57fa700 1 -- 172.21.15.96:0/1586080084 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2414+0+0 (secure 0 0 0) 0x7f8be808aa80 con 0x7f8bf80ff330 2024-02-19T18:58:51.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.211+0000 7f8bf77fe700 1 --2- 172.21.15.96:0/1586080084 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f8be406c470 0x7f8be406e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:58:51.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.212+0000 7f8bf77fe700 1 --2- 172.21.15.96:0/1586080084 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f8be406c470 0x7f8be406e930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8be0006010 tx=0x7f8be000b580 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:58:51.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.216+0000 7f8bf57fa700 1 -- 172.21.15.96:0/1586080084 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f8be80599c0 con 0x7f8bf80ff330 2024-02-19T18:58:51.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:58:51.444+0000 7f8bfe594700 1 -- 172.21.15.96:0/1586080084 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f8bf80611d0 con 0x7f8be406c470 2024-02-19T18:58:51.462 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:51 smithi096 ceph-mon[29216]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:58:51.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:51 smithi125 ceph-mon[37556]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:58:52.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:52 smithi096 ceph-mon[29216]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:58:52.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:52 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T18:58:52.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:52 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T18:58:52.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:52 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:52.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:52 smithi096 ceph-mon[29216]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:58:52.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:52 smithi096 ceph-mon[29216]: Detected new or changed devices on smithi096 2024-02-19T18:58:52.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:52 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:52.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:52 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:52.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:52 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:58:52.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:52 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:58:52.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:52 smithi096 ceph-mon[29216]: Adjusting osd_memory_target on smithi096 to 5920M 2024-02-19T18:58:52.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:52 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:52.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:52 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:52.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:52 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:58:52.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:52 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:52.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:52 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:58:52.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:52 smithi125 ceph-mon[37556]: from='client.14298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:58:52.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:52 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T18:58:52.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:52 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T18:58:52.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:52 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:52.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:52 smithi125 ceph-mon[37556]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:58:52.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:52 smithi125 ceph-mon[37556]: Detected new or changed devices on smithi096 2024-02-19T18:58:52.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:52 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:52.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:52 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:52.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:52 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:58:52.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:52 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:58:52.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:52 smithi125 ceph-mon[37556]: Adjusting osd_memory_target on smithi096 to 5920M 2024-02-19T18:58:52.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:52 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:52.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:52 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:52.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:52 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:58:52.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:52 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:52.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:52 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:58:55.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:54 smithi096 ceph-mon[29216]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:58:55.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:54 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:55.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:54 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:55.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:54 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/1646316701' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bf17dab-3c04-4ed0-8edf-45a217a52d0f"}]: dispatch 2024-02-19T18:58:55.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:54 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/1646316701' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3bf17dab-3c04-4ed0-8edf-45a217a52d0f"}]': finished 2024-02-19T18:58:55.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:54 smithi096 ceph-mon[29216]: osdmap e16: 3 total, 2 up, 3 in 2024-02-19T18:58:55.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:54 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T18:58:55.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:54 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/2584568615' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T18:58:55.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:54 smithi125 ceph-mon[37556]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:58:55.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:54 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:55.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:54 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:55.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:54 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/1646316701' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3bf17dab-3c04-4ed0-8edf-45a217a52d0f"}]: dispatch 2024-02-19T18:58:55.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:54 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/1646316701' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3bf17dab-3c04-4ed0-8edf-45a217a52d0f"}]': finished 2024-02-19T18:58:55.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:54 smithi125 ceph-mon[37556]: osdmap e16: 3 total, 2 up, 3 in 2024-02-19T18:58:55.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:54 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T18:58:55.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:54 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/2584568615' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T18:58:56.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:56 smithi096 ceph-mon[29216]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:58:56.698 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:56 smithi125 ceph-mon[37556]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:58:58.667 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:58 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:58.668 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:58 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:58.668 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:58 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:58.668 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:58 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:58:58.668 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:58 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:58.668 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:58 smithi096 ceph-mon[29216]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:58:58.668 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:58:58 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:58:58.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:58 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:58.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:58 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:58.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:58 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:58:58.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:58 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:58:58.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:58 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:58:58.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:58 smithi125 ceph-mon[37556]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:58:58.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:58:58 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:59:01.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:00 smithi096 ceph-mon[29216]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:59:01.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:00 smithi125 ceph-mon[37556]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:59:02.143 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:01 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-19T18:59:02.143 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:01 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:02.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:01 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-19T18:59:02.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:01 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:03.182 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:02 smithi096 ceph-mon[29216]: Deploying daemon osd.2 on smithi096 2024-02-19T18:59:03.182 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:02 smithi096 ceph-mon[29216]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:59:03.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:02 smithi125 ceph-mon[37556]: Deploying daemon osd.2 on smithi096 2024-02-19T18:59:03.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:02 smithi125 ceph-mon[37556]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:59:05.101 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:04 smithi096 ceph-mon[29216]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:59:05.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:04 smithi125 ceph-mon[37556]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:59:06.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:06 smithi125 ceph-mon[37556]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:59:06.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:06 smithi096 ceph-mon[29216]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:59:07.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:07 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:07.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:07 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:07.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:07 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:59:08.020 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:07 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:08.020 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:07 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:08.020 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:07 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:59:08.738 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:08 smithi096 ceph-mon[29216]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:59:08.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:08 smithi125 ceph-mon[37556]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:59:10.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:59:10.505+0000 7f8bf57fa700 1 -- 172.21.15.96:0/1586080084 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f8bf80611d0 con 0x7f8be406c470 2024-02-19T18:59:10.524 INFO:teuthology.orchestra.run.smithi096.stdout:Created osd(s) 2 on host 'smithi096' 2024-02-19T18:59:10.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:59:10.508+0000 7f8bfe594700 1 -- 172.21.15.96:0/1586080084 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f8be406c470 msgr2=0x7f8be406e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:10.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:59:10.508+0000 7f8bfe594700 1 --2- 172.21.15.96:0/1586080084 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f8be406c470 0x7f8be406e930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8be0006010 tx=0x7f8be000b580 comp rx=0 tx=0).stop 2024-02-19T18:59:10.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:59:10.508+0000 7f8bfe594700 1 -- 172.21.15.96:0/1586080084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bf80ff330 msgr2=0x7f8bf81964a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:10.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:59:10.508+0000 7f8bfe594700 1 --2- 172.21.15.96:0/1586080084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bf80ff330 0x7f8bf81964a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8be800dd70 tx=0x7f8be800a530 comp rx=0 tx=0).stop 2024-02-19T18:59:10.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:59:10.509+0000 7f8bfe594700 1 -- 172.21.15.96:0/1586080084 shutdown_connections 2024-02-19T18:59:10.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:59:10.509+0000 7f8bfe594700 1 --2- 172.21.15.96:0/1586080084 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f8be406c470 0x7f8be406e930 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:10.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:59:10.509+0000 7f8bfe594700 1 --2- 172.21.15.96:0/1586080084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8bf80ff330 0x7f8bf81964a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:10.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:59:10.509+0000 7f8bfe594700 1 --2- 172.21.15.96:0/1586080084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8bf8100530 0x7f8bf81969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:10.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:59:10.509+0000 7f8bfe594700 1 -- 172.21.15.96:0/1586080084 >> 172.21.15.96:0/1586080084 conn(0x7f8bf80fa8b0 msgr2=0x7f8bf8103960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:10.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:59:10.509+0000 7f8bfe594700 1 -- 172.21.15.96:0/1586080084 shutdown_connections 2024-02-19T18:59:10.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T18:59:10.509+0000 7f8bfe594700 1 -- 172.21.15.96:0/1586080084 wait complete. 2024-02-19T18:59:11.128 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:10 smithi096 ceph-mon[29216]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:59:11.129 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:10 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:11.129 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:10 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:11.129 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:10 smithi096 ceph-mon[29216]: from='osd.2 [v2:172.21.15.96:6818/3117123037,v1:172.21.15.96:6819/3117123037]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-19T18:59:11.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:10 smithi125 ceph-mon[37556]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:59:11.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:10 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:11.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:10 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:11.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:10 smithi125 ceph-mon[37556]: from='osd.2 [v2:172.21.15.96:6818/3117123037,v1:172.21.15.96:6819/3117123037]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-19T18:59:11.745 DEBUG:teuthology.orchestra.run.smithi096:osd.2> sudo journalctl -f -n 0 -u ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.2.service 2024-02-19T18:59:11.747 INFO:tasks.cephadm:Deploying osd.3 on smithi125 with /dev/vg_nvme/lv_4... 2024-02-19T18:59:11.747 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-19T18:59:11.963 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi125/config 2024-02-19T18:59:12.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:12 smithi125 ceph-mon[37556]: from='osd.2 [v2:172.21.15.96:6818/3117123037,v1:172.21.15.96:6819/3117123037]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-19T18:59:12.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:12 smithi125 ceph-mon[37556]: osdmap e17: 3 total, 2 up, 3 in 2024-02-19T18:59:12.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:12 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T18:59:12.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:12 smithi125 ceph-mon[37556]: from='osd.2 [v2:172.21.15.96:6818/3117123037,v1:172.21.15.96:6819/3117123037]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2024-02-19T18:59:12.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:12 smithi125 ceph-mon[37556]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:59:12.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:12 smithi096 ceph-mon[29216]: from='osd.2 [v2:172.21.15.96:6818/3117123037,v1:172.21.15.96:6819/3117123037]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-19T18:59:12.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:12 smithi096 ceph-mon[29216]: osdmap e17: 3 total, 2 up, 3 in 2024-02-19T18:59:12.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:12 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T18:59:12.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:12 smithi096 ceph-mon[29216]: from='osd.2 [v2:172.21.15.96:6818/3117123037,v1:172.21.15.96:6819/3117123037]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2024-02-19T18:59:12.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:12 smithi096 ceph-mon[29216]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:59:12.785 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 18:59:12 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2[63258]: 2024-02-19T18:59:12.487+0000 7f1f8df8d700 -1 osd.2 0 waiting for initial osdmap 2024-02-19T18:59:12.785 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 18:59:12 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2[63258]: 2024-02-19T18:59:12.492+0000 7f1f8857f700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T18:59:13.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:13 smithi125 ceph-mon[37556]: from='osd.2 [v2:172.21.15.96:6818/3117123037,v1:172.21.15.96:6819/3117123037]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2024-02-19T18:59:13.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:13 smithi125 ceph-mon[37556]: osdmap e18: 3 total, 2 up, 3 in 2024-02-19T18:59:13.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:13 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T18:59:13.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:13 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T18:59:13.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:13 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:59:13.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:13 smithi096 ceph-mon[29216]: from='osd.2 [v2:172.21.15.96:6818/3117123037,v1:172.21.15.96:6819/3117123037]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2024-02-19T18:59:13.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:13 smithi096 ceph-mon[29216]: osdmap e18: 3 total, 2 up, 3 in 2024-02-19T18:59:13.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:13 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T18:59:13.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:13 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T18:59:13.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:13 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:59:13.790 INFO:teuthology.orchestra.run.smithi125.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-19T18:59:13.790 INFO:teuthology.orchestra.run.smithi125.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-19T18:59:13.790 INFO:teuthology.orchestra.run.smithi125.stderr: stderr: 10+0 records in 2024-02-19T18:59:13.791 INFO:teuthology.orchestra.run.smithi125.stderr:10+0 records out 2024-02-19T18:59:13.791 INFO:teuthology.orchestra.run.smithi125.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0123195 s, 851 MB/s 2024-02-19T18:59:13.791 INFO:teuthology.orchestra.run.smithi125.stderr:--> Zapping successful for: 2024-02-19T18:59:14.398 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi125:vg_nvme/lv_4 2024-02-19T18:59:14.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:14 smithi096 ceph-mon[29216]: purged_snaps scrub starts 2024-02-19T18:59:14.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:14 smithi096 ceph-mon[29216]: purged_snaps scrub ok 2024-02-19T18:59:14.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:14 smithi096 ceph-mon[29216]: osd.2 [v2:172.21.15.96:6818/3117123037,v1:172.21.15.96:6819/3117123037] boot 2024-02-19T18:59:14.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:14 smithi096 ceph-mon[29216]: osdmap e19: 3 total, 3 up, 3 in 2024-02-19T18:59:14.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:14 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T18:59:14.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:14 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:14.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:14 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:14.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:14 smithi096 ceph-mon[29216]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:59:14.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:14 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-02-19T18:59:14.615 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi125/config 2024-02-19T18:59:14.689 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:14 smithi125 ceph-mon[37556]: purged_snaps scrub starts 2024-02-19T18:59:14.689 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:14 smithi125 ceph-mon[37556]: purged_snaps scrub ok 2024-02-19T18:59:14.689 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:14 smithi125 ceph-mon[37556]: osd.2 [v2:172.21.15.96:6818/3117123037,v1:172.21.15.96:6819/3117123037] boot 2024-02-19T18:59:14.689 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:14 smithi125 ceph-mon[37556]: osdmap e19: 3 total, 3 up, 3 in 2024-02-19T18:59:14.689 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:14 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T18:59:14.689 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:14 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:14.689 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:14 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:14.689 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:14 smithi125 ceph-mon[37556]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-19T18:59:14.689 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:14 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-02-19T18:59:15.540 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:15 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-02-19T18:59:15.540 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:15 smithi125 ceph-mon[37556]: osdmap e20: 3 total, 3 up, 3 in 2024-02-19T18:59:15.540 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:15 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T18:59:15.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:15 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-02-19T18:59:15.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:15 smithi096 ceph-mon[29216]: osdmap e20: 3 total, 3 up, 3 in 2024-02-19T18:59:15.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:15 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-19T18:59:16.013 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.994+0000 7fee827f4700 1 -- 172.21.15.125:0/3108660038 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee7c100dc0 msgr2=0x7fee7c101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:16.013 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.994+0000 7fee827f4700 1 --2- 172.21.15.125:0/3108660038 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee7c100dc0 0x7fee7c101220 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fee70009910 tx=0x7fee70009c20 comp rx=0 tx=0).stop 2024-02-19T18:59:16.013 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.994+0000 7fee827f4700 1 -- 172.21.15.125:0/3108660038 shutdown_connections 2024-02-19T18:59:16.013 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.994+0000 7fee827f4700 1 --2- 172.21.15.125:0/3108660038 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee7c100dc0 0x7fee7c101220 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:16.013 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.994+0000 7fee827f4700 1 --2- 172.21.15.125:0/3108660038 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee7c0ffbc0 0x7fee7c0fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:16.013 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.994+0000 7fee827f4700 1 -- 172.21.15.125:0/3108660038 >> 172.21.15.125:0/3108660038 conn(0x7fee7c0fb160 msgr2=0x7fee7c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:16.013 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.994+0000 7fee827f4700 1 -- 172.21.15.125:0/3108660038 shutdown_connections 2024-02-19T18:59:16.013 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.994+0000 7fee827f4700 1 -- 172.21.15.125:0/3108660038 wait complete. 2024-02-19T18:59:16.013 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.995+0000 7fee827f4700 1 Processor -- start 2024-02-19T18:59:16.013 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.995+0000 7fee827f4700 1 -- start start 2024-02-19T18:59:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.996+0000 7fee827f4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee7c0ffbc0 0x7fee7c195780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.996+0000 7fee827f4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee7c100dc0 0x7fee7c195cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.996+0000 7fee827f4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c1962e0 con 0x7fee7c0ffbc0 2024-02-19T18:59:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.996+0000 7fee827f4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7c196420 con 0x7fee7c100dc0 2024-02-19T18:59:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.996+0000 7fee7b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee7c100dc0 0x7fee7c195cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.996+0000 7fee7b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee7c100dc0 0x7fee7c195cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34528/0 (socket says 172.21.15.125:34528) 2024-02-19T18:59:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.996+0000 7fee7b7fe700 1 -- 172.21.15.125:0/2735323804 learned_addr learned my addr 172.21.15.125:0/2735323804 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:59:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.996+0000 7fee7bfff700 1 --2- 172.21.15.125:0/2735323804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee7c0ffbc0 0x7fee7c195780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.996+0000 7fee7b7fe700 1 -- 172.21.15.125:0/2735323804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee7c0ffbc0 msgr2=0x7fee7c195780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.996+0000 7fee7b7fe700 1 --2- 172.21.15.125:0/2735323804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee7c0ffbc0 0x7fee7c195780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.996+0000 7fee7b7fe700 1 -- 172.21.15.125:0/2735323804 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee700095f0 con 0x7fee7c100dc0 2024-02-19T18:59:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.996+0000 7fee7b7fe700 1 --2- 172.21.15.125:0/2735323804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee7c100dc0 0x7fee7c195cc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fee7000bd70 tx=0x7fee7000bda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.996+0000 7fee797fa700 1 -- 172.21.15.125:0/2735323804 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee7001d070 con 0x7fee7c100dc0 2024-02-19T18:59:16.015 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.996+0000 7fee797fa700 1 -- 172.21.15.125:0/2735323804 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fee70005940 con 0x7fee7c100dc0 2024-02-19T18:59:16.016 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.996+0000 7fee827f4700 1 -- 172.21.15.125:0/2735323804 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee7c068e10 con 0x7fee7c100dc0 2024-02-19T18:59:16.016 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.996+0000 7fee797fa700 1 -- 172.21.15.125:0/2735323804 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee70021430 con 0x7fee7c100dc0 2024-02-19T18:59:16.016 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.996+0000 7fee827f4700 1 -- 172.21.15.125:0/2735323804 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee7c069300 con 0x7fee7c100dc0 2024-02-19T18:59:16.017 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.997+0000 7fee827f4700 1 -- 172.21.15.125:0/2735323804 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee7c04f2e0 con 0x7fee7c100dc0 2024-02-19T18:59:16.017 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.998+0000 7fee797fa700 1 -- 172.21.15.125:0/2735323804 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 18) v1 ==== 90256+0+0 (secure 0 0 0) 0x7fee7000f860 con 0x7fee7c100dc0 2024-02-19T18:59:16.017 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.998+0000 7fee797fa700 1 --2- 172.21.15.125:0/2735323804 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fee64070860 0x7fee64072d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:16.017 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.998+0000 7fee797fa700 1 -- 172.21.15.125:0/2735323804 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3232+0+0 (secure 0 0 0) 0x7fee7008c160 con 0x7fee7c100dc0 2024-02-19T18:59:16.017 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.998+0000 7fee7bfff700 1 --2- 172.21.15.125:0/2735323804 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fee64070860 0x7fee64072d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:16.017 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:15.999+0000 7fee7bfff700 1 --2- 172.21.15.125:0/2735323804 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fee64070860 0x7fee64072d20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fee7c100c20 tx=0x7fee6c009190 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:16.020 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:16.003+0000 7fee797fa700 1 -- 172.21.15.125:0/2735323804 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fee7005ad70 con 0x7fee7c100dc0 2024-02-19T18:59:16.214 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:16.196+0000 7fee827f4700 1 -- 172.21.15.125:0/2735323804 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fee7c18f2e0 con 0x7fee64070860 2024-02-19T18:59:16.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:16 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-19T18:59:16.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:16 smithi096 ceph-mon[29216]: osdmap e21: 3 total, 3 up, 3 in 2024-02-19T18:59:16.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:16 smithi096 ceph-mon[29216]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:59:16.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:16 smithi096 ceph-mon[29216]: from='client.24135 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:59:16.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:16 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T18:59:16.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:16 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T18:59:16.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:16 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:16.785 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 18:59:16 smithi096 sudo[67593]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-19T18:59:16.785 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 18:59:16 smithi096 sudo[67593]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-19T18:59:16.785 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 18:59:16 smithi096 sudo[67593]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-19T18:59:16.785 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 18:59:16 smithi096 sudo[67593]: pam_unix(sudo:session): session closed for user root 2024-02-19T18:59:16.838 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:16 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-19T18:59:16.838 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:16 smithi125 ceph-mon[37556]: osdmap e21: 3 total, 3 up, 3 in 2024-02-19T18:59:16.838 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:16 smithi125 ceph-mon[37556]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:59:16.838 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:16 smithi125 ceph-mon[37556]: from='client.24135 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:59:16.838 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:16 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T18:59:16.838 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:16 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T18:59:16.838 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:16 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:17.274 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 18:59:16 smithi096 sudo[67694]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-19T18:59:17.275 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 18:59:16 smithi096 sudo[67694]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-19T18:59:17.275 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 18:59:16 smithi096 sudo[67694]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-19T18:59:17.275 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 18:59:16 smithi096 sudo[67694]: pam_unix(sudo:session): session closed for user root 2024-02-19T18:59:17.534 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 18:59:17 smithi096 sudo[67787]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-19T18:59:17.534 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 18:59:17 smithi096 sudo[67787]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-19T18:59:17.534 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 18:59:17 smithi096 sudo[67787]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-19T18:59:17.534 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 18:59:17 smithi096 sudo[67787]: pam_unix(sudo:session): session closed for user root 2024-02-19T18:59:17.544 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:17.526+0000 7fee797fa700 1 -- 172.21.15.125:0/2735323804 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fee700576b0 con 0x7fee7c100dc0 2024-02-19T18:59:17.790 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 18:59:17 smithi096 sudo[67796]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-19T18:59:17.790 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 18:59:17 smithi096 sudo[67796]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-19T18:59:17.790 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 18:59:17 smithi096 sudo[67796]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-19T18:59:17.790 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 18:59:17 smithi096 sudo[67796]: pam_unix(sudo:session): session closed for user root 2024-02-19T18:59:17.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:17 smithi096 ceph-mon[29216]: osdmap e22: 3 total, 3 up, 3 in 2024-02-19T18:59:17.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:17 smithi096 ceph-mon[29216]: Detected new or changed devices on smithi096 2024-02-19T18:59:17.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:17 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:17.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:17 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:17.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:17 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:59:17.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:17 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:59:17.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:17 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:59:17.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:17 smithi096 ceph-mon[29216]: Adjusting osd_memory_target on smithi096 to 3946M 2024-02-19T18:59:17.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:17 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:17.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:17 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:17.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:17 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:59:17.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:17 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:17.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:17 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:59:17.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:17 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:17.838 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:17 smithi125 ceph-mon[37556]: osdmap e22: 3 total, 3 up, 3 in 2024-02-19T18:59:17.838 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:17 smithi125 ceph-mon[37556]: Detected new or changed devices on smithi096 2024-02-19T18:59:17.838 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:17 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:17.838 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:17 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:17.839 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:17 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:59:17.839 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:17 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:59:17.839 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:17 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:59:17.839 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:17 smithi125 ceph-mon[37556]: Adjusting osd_memory_target on smithi096 to 3946M 2024-02-19T18:59:17.839 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:17 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:17.839 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:17 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:17.839 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:17 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:59:17.839 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:17 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:17.839 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:17 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:59:17.839 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:17 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:18.061 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 18:59:17 smithi096 sudo[67812]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-19T18:59:18.062 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 18:59:17 smithi096 sudo[67812]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-19T18:59:18.062 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 18:59:17 smithi096 sudo[67812]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-19T18:59:18.062 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 18:59:17 smithi096 sudo[67812]: pam_unix(sudo:session): session closed for user root 2024-02-19T18:59:18.318 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 18:59:18 smithi096 sudo[67913]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-19T18:59:18.318 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 18:59:18 smithi096 sudo[67913]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-19T18:59:18.318 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 18:59:18 smithi096 sudo[67913]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-19T18:59:18.319 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 18:59:18 smithi096 sudo[67913]: pam_unix(sudo:session): session closed for user root 2024-02-19T18:59:18.577 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:18 smithi096 sudo[67939]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-19T18:59:18.577 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:18 smithi096 sudo[67939]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-19T18:59:18.578 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:18 smithi096 sudo[67939]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-19T18:59:18.578 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:18 smithi096 sudo[67939]: pam_unix(sudo:session): session closed for user root 2024-02-19T18:59:18.888 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:18 smithi096 sudo[67943]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-19T18:59:18.888 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:18 smithi096 sudo[67943]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-19T18:59:18.889 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:18 smithi096 sudo[67943]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-19T18:59:18.889 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:18 smithi096 sudo[67943]: pam_unix(sudo:session): session closed for user root 2024-02-19T18:59:18.889 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:18 smithi096 ceph-mon[29216]: mgrmap e19: smithi096.zsjdff(active, since 2m), standbys: smithi125.ygdmdu 2024-02-19T18:59:18.889 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:18 smithi096 ceph-mon[29216]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-19T18:59:19.084 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:18 smithi125 sudo[41554]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-19T18:59:19.084 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:18 smithi125 sudo[41554]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-19T18:59:19.084 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:18 smithi125 sudo[41554]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-19T18:59:19.084 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:18 smithi125 sudo[41554]: pam_unix(sudo:session): session closed for user root 2024-02-19T18:59:19.429 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:19 smithi125 sudo[41557]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-19T18:59:19.430 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:19 smithi125 sudo[41557]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-19T18:59:19.430 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:19 smithi125 sudo[41557]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-19T18:59:19.430 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:19 smithi125 sudo[41557]: pam_unix(sudo:session): session closed for user root 2024-02-19T18:59:19.430 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:19 smithi125 ceph-mon[37556]: mgrmap e19: smithi096.zsjdff(active, since 2m), standbys: smithi125.ygdmdu 2024-02-19T18:59:19.430 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:19 smithi125 ceph-mon[37556]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-19T18:59:19.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:19 smithi125 ceph-mon[37556]: pgmap v80: 1 pgs: 1 creating+activating; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:59:19.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:19 smithi125 ceph-mon[37556]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-19T18:59:19.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:19 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2024-02-19T18:59:19.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:19 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T18:59:19.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:19 smithi125 ceph-mon[37556]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-19T18:59:19.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:19 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2024-02-19T18:59:19.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:19 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T18:59:19.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:19 smithi125 ceph-mon[37556]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-19T18:59:19.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:19 smithi125 ceph-mon[37556]: from='client.? 172.21.15.125:0/2319506475' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa80c0e4-7d1a-4e41-9455-b576cbcac572"}]: dispatch 2024-02-19T18:59:19.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:19 smithi125 ceph-mon[37556]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa80c0e4-7d1a-4e41-9455-b576cbcac572"}]: dispatch 2024-02-19T18:59:19.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:19 smithi125 ceph-mon[37556]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa80c0e4-7d1a-4e41-9455-b576cbcac572"}]': finished 2024-02-19T18:59:19.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:19 smithi125 ceph-mon[37556]: osdmap e23: 4 total, 3 up, 4 in 2024-02-19T18:59:19.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:19 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T18:59:19.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:19 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:19.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:19 smithi096 ceph-mon[29216]: pgmap v80: 1 pgs: 1 creating+activating; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:59:19.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:19 smithi096 ceph-mon[29216]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-19T18:59:19.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:19 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2024-02-19T18:59:19.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:19 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T18:59:19.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:19 smithi096 ceph-mon[29216]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-19T18:59:19.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:19 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2024-02-19T18:59:19.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:19 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T18:59:19.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:19 smithi096 ceph-mon[29216]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-19T18:59:19.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:19 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/2319506475' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa80c0e4-7d1a-4e41-9455-b576cbcac572"}]: dispatch 2024-02-19T18:59:19.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:19 smithi096 ceph-mon[29216]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa80c0e4-7d1a-4e41-9455-b576cbcac572"}]: dispatch 2024-02-19T18:59:19.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:19 smithi096 ceph-mon[29216]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa80c0e4-7d1a-4e41-9455-b576cbcac572"}]': finished 2024-02-19T18:59:19.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:19 smithi096 ceph-mon[29216]: osdmap e23: 4 total, 3 up, 4 in 2024-02-19T18:59:19.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:19 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T18:59:19.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:19 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:20.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:20 smithi125 ceph-mon[37556]: from='client.? 172.21.15.125:0/325129507' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T18:59:20.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:20 smithi125 ceph-mon[37556]: pgmap v82: 1 pgs: 1 creating+activating; 0 B data, 81 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:59:21.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:20 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/325129507' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T18:59:21.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:20 smithi096 ceph-mon[29216]: pgmap v82: 1 pgs: 1 creating+activating; 0 B data, 81 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:59:22.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:21 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:22.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:21 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:22.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:21 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:22.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:21 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:59:22.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:21 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:22.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:21 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:22.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:21 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:22.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:21 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:22.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:21 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:59:22.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:21 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:23.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:22 smithi125 ceph-mon[37556]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:59:23.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:22 smithi096 ceph-mon[29216]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:59:24.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:24 smithi125 ceph-mon[37556]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:59:25.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:24 smithi096 ceph-mon[29216]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:59:26.621 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:26 smithi125 ceph-mon[37556]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:59:26.621 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-19T18:59:26.621 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:26.621 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:26 smithi125 ceph-mon[37556]: Deploying daemon osd.3 on smithi125 2024-02-19T18:59:26.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:26 smithi096 ceph-mon[29216]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:59:26.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:26 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-19T18:59:26.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:26 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:26.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:26 smithi096 ceph-mon[29216]: Deploying daemon osd.3 on smithi125 2024-02-19T18:59:27.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:27 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:59:28.144 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:27 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:59:29.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:28 smithi096 ceph-mon[29216]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:59:29.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:28 smithi125 ceph-mon[37556]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:59:30.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:30 smithi125 ceph-mon[37556]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:59:31.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:30 smithi096 ceph-mon[29216]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:59:32.256 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:31 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:32.256 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:31 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:32.256 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:31 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:59:32.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:31 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:32.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:31 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:32.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:31 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:59:33.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:32 smithi096 ceph-mon[29216]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:59:33.389 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:32 smithi125 ceph-mon[37556]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:59:33.726 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:33.707+0000 7fee797fa700 1 -- 172.21.15.125:0/2735323804 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fee7c18f2e0 con 0x7fee64070860 2024-02-19T18:59:33.726 INFO:teuthology.orchestra.run.smithi125.stdout:Created osd(s) 3 on host 'smithi125' 2024-02-19T18:59:33.729 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:33.709+0000 7fee827f4700 1 -- 172.21.15.125:0/2735323804 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fee64070860 msgr2=0x7fee64072d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:33.729 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:33.709+0000 7fee827f4700 1 --2- 172.21.15.125:0/2735323804 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fee64070860 0x7fee64072d20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fee7c100c20 tx=0x7fee6c009190 comp rx=0 tx=0).stop 2024-02-19T18:59:33.729 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:33.709+0000 7fee827f4700 1 -- 172.21.15.125:0/2735323804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee7c100dc0 msgr2=0x7fee7c195cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:33.729 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:33.709+0000 7fee827f4700 1 --2- 172.21.15.125:0/2735323804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee7c100dc0 0x7fee7c195cc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fee7000bd70 tx=0x7fee7000bda0 comp rx=0 tx=0).stop 2024-02-19T18:59:33.729 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:33.709+0000 7fee827f4700 1 -- 172.21.15.125:0/2735323804 shutdown_connections 2024-02-19T18:59:33.729 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:33.709+0000 7fee827f4700 1 --2- 172.21.15.125:0/2735323804 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fee64070860 0x7fee64072d20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:33.729 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:33.709+0000 7fee827f4700 1 --2- 172.21.15.125:0/2735323804 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee7c0ffbc0 0x7fee7c195780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:33.729 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:33.709+0000 7fee827f4700 1 --2- 172.21.15.125:0/2735323804 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee7c100dc0 0x7fee7c195cc0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:33.729 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:33.709+0000 7fee827f4700 1 -- 172.21.15.125:0/2735323804 >> 172.21.15.125:0/2735323804 conn(0x7fee7c0fb160 msgr2=0x7fee7c1040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:33.729 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:33.709+0000 7fee827f4700 1 -- 172.21.15.125:0/2735323804 shutdown_connections 2024-02-19T18:59:33.729 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:33.710+0000 7fee827f4700 1 -- 172.21.15.125:0/2735323804 wait complete. 2024-02-19T18:59:34.346 DEBUG:teuthology.orchestra.run.smithi125:osd.3> sudo journalctl -f -n 0 -u ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.3.service 2024-02-19T18:59:34.349 INFO:tasks.cephadm:Deploying osd.4 on smithi125 with /dev/vg_nvme/lv_3... 2024-02-19T18:59:34.349 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-19T18:59:34.679 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi125/config 2024-02-19T18:59:34.980 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:34 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:34.981 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:34 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:34.981 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:34 smithi125 ceph-mon[37556]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:59:34.981 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 18:59:34 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3[43637]: 2024-02-19T18:59:34.870+0000 7f5b89021640 -1 osd.3 0 log_to_monitors true 2024-02-19T18:59:35.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:34 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:35.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:34 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:35.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:34 smithi096 ceph-mon[29216]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:59:35.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:35 smithi125 ceph-mon[37556]: from='osd.3 [v2:172.21.15.125:6800/3311295426,v1:172.21.15.125:6801/3311295426]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-19T18:59:35.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:35 smithi125 ceph-mon[37556]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-19T18:59:36.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:35 smithi096 ceph-mon[29216]: from='osd.3 [v2:172.21.15.125:6800/3311295426,v1:172.21.15.125:6801/3311295426]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-19T18:59:36.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:35 smithi096 ceph-mon[29216]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-19T18:59:36.949 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 18:59:36 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3[43637]: 2024-02-19T18:59:36.714+0000 7f5b7de84700 -1 osd.3 0 waiting for initial osdmap 2024-02-19T18:59:36.949 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 18:59:36 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3[43637]: 2024-02-19T18:59:36.723+0000 7f5b7a47a700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T18:59:36.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:36 smithi125 ceph-mon[37556]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-19T18:59:36.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:36 smithi125 ceph-mon[37556]: osdmap e24: 4 total, 3 up, 4 in 2024-02-19T18:59:36.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:36 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T18:59:36.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:36 smithi125 ceph-mon[37556]: from='osd.3 [v2:172.21.15.125:6800/3311295426,v1:172.21.15.125:6801/3311295426]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2024-02-19T18:59:36.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:36 smithi125 ceph-mon[37556]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2024-02-19T18:59:36.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:36 smithi125 ceph-mon[37556]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:59:36.958 INFO:teuthology.orchestra.run.smithi125.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-19T18:59:36.958 INFO:teuthology.orchestra.run.smithi125.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-19T18:59:36.958 INFO:teuthology.orchestra.run.smithi125.stderr: stderr: 10+0 records in 2024-02-19T18:59:36.958 INFO:teuthology.orchestra.run.smithi125.stderr:10+0 records out 2024-02-19T18:59:36.958 INFO:teuthology.orchestra.run.smithi125.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0134182 s, 781 MB/s 2024-02-19T18:59:36.958 INFO:teuthology.orchestra.run.smithi125.stderr:--> Zapping successful for: 2024-02-19T18:59:37.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:36 smithi096 ceph-mon[29216]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-19T18:59:37.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:36 smithi096 ceph-mon[29216]: osdmap e24: 4 total, 3 up, 4 in 2024-02-19T18:59:37.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:36 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T18:59:37.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:36 smithi096 ceph-mon[29216]: from='osd.3 [v2:172.21.15.125:6800/3311295426,v1:172.21.15.125:6801/3311295426]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2024-02-19T18:59:37.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:36 smithi096 ceph-mon[29216]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2024-02-19T18:59:37.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:36 smithi096 ceph-mon[29216]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-19T18:59:37.464 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi125:vg_nvme/lv_3 2024-02-19T18:59:37.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:37 smithi125 ceph-mon[37556]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]': finished 2024-02-19T18:59:37.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:37 smithi125 ceph-mon[37556]: osdmap e25: 4 total, 3 up, 4 in 2024-02-19T18:59:37.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:37 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T18:59:37.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:37 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:37.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:37 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:38.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:37 smithi096 ceph-mon[29216]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]': finished 2024-02-19T18:59:38.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:37 smithi096 ceph-mon[29216]: osdmap e25: 4 total, 3 up, 4 in 2024-02-19T18:59:38.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:37 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T18:59:38.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:37 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:38.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:37 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:39.002 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:38 smithi125 ceph-mon[37556]: purged_snaps scrub starts 2024-02-19T18:59:39.002 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:38 smithi125 ceph-mon[37556]: purged_snaps scrub ok 2024-02-19T18:59:39.002 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:38 smithi125 ceph-mon[37556]: osd.3 [v2:172.21.15.125:6800/3311295426,v1:172.21.15.125:6801/3311295426] boot 2024-02-19T18:59:39.002 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:38 smithi125 ceph-mon[37556]: osdmap e26: 4 total, 4 up, 4 in 2024-02-19T18:59:39.002 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:38 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T18:59:39.002 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:38 smithi125 ceph-mon[37556]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:59:39.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:38 smithi096 ceph-mon[29216]: purged_snaps scrub starts 2024-02-19T18:59:39.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:38 smithi096 ceph-mon[29216]: purged_snaps scrub ok 2024-02-19T18:59:39.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:38 smithi096 ceph-mon[29216]: osd.3 [v2:172.21.15.125:6800/3311295426,v1:172.21.15.125:6801/3311295426] boot 2024-02-19T18:59:39.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:38 smithi096 ceph-mon[29216]: osdmap e26: 4 total, 4 up, 4 in 2024-02-19T18:59:39.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:38 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T18:59:39.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:38 smithi096 ceph-mon[29216]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:59:39.046 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi125/config 2024-02-19T18:59:39.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:39 smithi125 ceph-mon[37556]: osdmap e27: 4 total, 4 up, 4 in 2024-02-19T18:59:40.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:39 smithi096 ceph-mon[29216]: osdmap e27: 4 total, 4 up, 4 in 2024-02-19T18:59:40.944 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:40 smithi125 ceph-mon[37556]: osdmap e28: 4 total, 4 up, 4 in 2024-02-19T18:59:40.944 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:40 smithi125 ceph-mon[37556]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:59:40.944 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:40 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:40.944 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:40 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:40.944 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:40 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:59:40.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:40 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:40.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:40 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:40.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:40 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:59:40.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:40 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:40.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:40 smithi125 ceph-mon[37556]: osdmap e29: 4 total, 4 up, 4 in 2024-02-19T18:59:40.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:40 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:59:40.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:40 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:40.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:40 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:59:40.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:40 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:41.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:40 smithi096 ceph-mon[29216]: osdmap e28: 4 total, 4 up, 4 in 2024-02-19T18:59:41.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:40 smithi096 ceph-mon[29216]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:59:41.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:40 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:41.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:40 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:41.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:40 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T18:59:41.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:40 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:41.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:40 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:41.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:40 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:59:41.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:40 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:41.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:40 smithi096 ceph-mon[29216]: osdmap e29: 4 total, 4 up, 4 in 2024-02-19T18:59:41.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:40 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:59:41.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:40 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:41.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:40 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T18:59:41.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:40 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:41.149 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.130+0000 7f00320cb700 1 -- 172.21.15.125:0/2107567862 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c100dc0 msgr2=0x7f002c101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:41.149 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.130+0000 7f00320cb700 1 --2- 172.21.15.125:0/2107567862 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c100dc0 0x7f002c101220 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0020009910 tx=0x7f0020009c20 comp rx=0 tx=0).stop 2024-02-19T18:59:41.150 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.130+0000 7f00320cb700 1 -- 172.21.15.125:0/2107567862 shutdown_connections 2024-02-19T18:59:41.150 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.130+0000 7f00320cb700 1 --2- 172.21.15.125:0/2107567862 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c100dc0 0x7f002c101220 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:41.150 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.130+0000 7f00320cb700 1 --2- 172.21.15.125:0/2107567862 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f002c0ffbc0 0x7f002c0fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:41.150 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.130+0000 7f00320cb700 1 -- 172.21.15.125:0/2107567862 >> 172.21.15.125:0/2107567862 conn(0x7f002c0fb160 msgr2=0x7f002c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:41.150 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.130+0000 7f00320cb700 1 -- 172.21.15.125:0/2107567862 shutdown_connections 2024-02-19T18:59:41.150 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.130+0000 7f00320cb700 1 -- 172.21.15.125:0/2107567862 wait complete. 2024-02-19T18:59:41.150 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.131+0000 7f00320cb700 1 Processor -- start 2024-02-19T18:59:41.152 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.131+0000 7f00320cb700 1 -- start start 2024-02-19T18:59:41.152 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.131+0000 7f00320cb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f002c0ffbc0 0x7f002c195780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:41.152 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.131+0000 7f00320cb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c100dc0 0x7f002c195cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:41.152 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.131+0000 7f00320cb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c1962e0 con 0x7f002c0ffbc0 2024-02-19T18:59:41.152 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.131+0000 7f00320cb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c196420 con 0x7f002c100dc0 2024-02-19T18:59:41.152 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.131+0000 7f002affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c100dc0 0x7f002c195cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:41.152 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.131+0000 7f002affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c100dc0 0x7f002c195cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50270/0 (socket says 172.21.15.125:50270) 2024-02-19T18:59:41.152 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.131+0000 7f002affd700 1 -- 172.21.15.125:0/1939600118 learned_addr learned my addr 172.21.15.125:0/1939600118 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T18:59:41.152 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.131+0000 7f002b7fe700 1 --2- 172.21.15.125:0/1939600118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f002c0ffbc0 0x7f002c195780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:41.152 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.132+0000 7f002affd700 1 -- 172.21.15.125:0/1939600118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f002c0ffbc0 msgr2=0x7f002c195780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:41.152 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.132+0000 7f002affd700 1 --2- 172.21.15.125:0/1939600118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f002c0ffbc0 0x7f002c195780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:41.153 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.132+0000 7f002affd700 1 -- 172.21.15.125:0/1939600118 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00200095f0 con 0x7f002c100dc0 2024-02-19T18:59:41.153 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.132+0000 7f002affd700 1 --2- 172.21.15.125:0/1939600118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c100dc0 0x7f002c195cc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0020006010 tx=0x7f002000bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:41.153 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.132+0000 7f0028ff9700 1 -- 172.21.15.125:0/1939600118 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f002001d070 con 0x7f002c100dc0 2024-02-19T18:59:41.153 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.132+0000 7f00320cb700 1 -- 172.21.15.125:0/1939600118 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f002c19ae70 con 0x7f002c100dc0 2024-02-19T18:59:41.153 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.132+0000 7f0028ff9700 1 -- 172.21.15.125:0/1939600118 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f002000f460 con 0x7f002c100dc0 2024-02-19T18:59:41.153 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.132+0000 7f0028ff9700 1 -- 172.21.15.125:0/1939600118 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0020021640 con 0x7f002c100dc0 2024-02-19T18:59:41.153 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.132+0000 7f00320cb700 1 -- 172.21.15.125:0/1939600118 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f002c19b330 con 0x7f002c100dc0 2024-02-19T18:59:41.153 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.133+0000 7f00320cb700 1 -- 172.21.15.125:0/1939600118 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f002c18f5d0 con 0x7f002c100dc0 2024-02-19T18:59:41.154 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.133+0000 7f0028ff9700 1 -- 172.21.15.125:0/1939600118 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f002000fab0 con 0x7f002c100dc0 2024-02-19T18:59:41.154 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.134+0000 7f0028ff9700 1 --2- 172.21.15.125:0/1939600118 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f001406c4e0 0x7f001406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T18:59:41.154 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.134+0000 7f0028ff9700 1 -- 172.21.15.125:0/1939600118 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 3774+0+0 (secure 0 0 0) 0x7f002008c540 con 0x7f002c100dc0 2024-02-19T18:59:41.154 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.134+0000 7f002b7fe700 1 --2- 172.21.15.125:0/1939600118 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f001406c4e0 0x7f001406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T18:59:41.154 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.134+0000 7f002b7fe700 1 --2- 172.21.15.125:0/1939600118 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f001406c4e0 0x7f001406e9a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f002c100c20 tx=0x7f001c009190 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T18:59:41.157 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.138+0000 7f0028ff9700 1 -- 172.21.15.125:0/1939600118 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f002005ae50 con 0x7f002c100dc0 2024-02-19T18:59:41.352 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:41.333+0000 7f00320cb700 1 -- 172.21.15.125:0/1939600118 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f002c02d050 con 0x7f001406c4e0 2024-02-19T18:59:42.018 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:41 smithi125 ceph-mon[37556]: Detected new or changed devices on smithi125 2024-02-19T18:59:42.018 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:41 smithi125 ceph-mon[37556]: Adjusting osd_memory_target on smithi125 to 14912M 2024-02-19T18:59:42.018 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:41 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T18:59:42.018 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:41 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T18:59:42.019 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:41 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:42.019 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:41 smithi125 ceph-mon[37556]: osdmap e30: 4 total, 4 up, 4 in 2024-02-19T18:59:42.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:41 smithi096 ceph-mon[29216]: Detected new or changed devices on smithi125 2024-02-19T18:59:42.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:41 smithi096 ceph-mon[29216]: Adjusting osd_memory_target on smithi125 to 14912M 2024-02-19T18:59:42.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:41 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T18:59:42.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:41 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T18:59:42.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:41 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:42.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:41 smithi096 ceph-mon[29216]: osdmap e30: 4 total, 4 up, 4 in 2024-02-19T18:59:42.999 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:42 smithi125 ceph-mon[37556]: from='client.24159 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:59:43.000 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:42 smithi125 ceph-mon[37556]: pgmap v100: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-19T18:59:43.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:42 smithi096 ceph-mon[29216]: from='client.24159 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T18:59:43.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:42 smithi096 ceph-mon[29216]: pgmap v100: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-19T18:59:44.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:43 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:59:44.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:43 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/252212817' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9363cacc-c727-4282-a50f-e123f625e13e"}]: dispatch 2024-02-19T18:59:44.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:43 smithi096 ceph-mon[29216]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9363cacc-c727-4282-a50f-e123f625e13e"}]: dispatch 2024-02-19T18:59:44.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:43 smithi096 ceph-mon[29216]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9363cacc-c727-4282-a50f-e123f625e13e"}]': finished 2024-02-19T18:59:44.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:43 smithi096 ceph-mon[29216]: osdmap e31: 5 total, 4 up, 5 in 2024-02-19T18:59:44.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:43 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T18:59:44.147 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:43 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:59:44.147 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:43 smithi125 ceph-mon[37556]: from='client.? 172.21.15.125:0/252212817' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9363cacc-c727-4282-a50f-e123f625e13e"}]: dispatch 2024-02-19T18:59:44.147 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:43 smithi125 ceph-mon[37556]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9363cacc-c727-4282-a50f-e123f625e13e"}]: dispatch 2024-02-19T18:59:44.147 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:43 smithi125 ceph-mon[37556]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9363cacc-c727-4282-a50f-e123f625e13e"}]': finished 2024-02-19T18:59:44.147 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:43 smithi125 ceph-mon[37556]: osdmap e31: 5 total, 4 up, 5 in 2024-02-19T18:59:44.147 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:43 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T18:59:45.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:44 smithi096 ceph-mon[29216]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-02-19T18:59:45.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:44 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/3602203129' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T18:59:45.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:44 smithi125 ceph-mon[37556]: pgmap v102: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 142 KiB/s, 0 objects/s recovering 2024-02-19T18:59:45.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:44 smithi125 ceph-mon[37556]: from='client.? 172.21.15.125:0/3602203129' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T18:59:46.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:46 smithi125 ceph-mon[37556]: pgmap v103: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-19T18:59:46.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:46 smithi096 ceph-mon[29216]: pgmap v103: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-19T18:59:48.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:48 smithi125 ceph-mon[37556]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-02-19T18:59:49.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:48 smithi096 ceph-mon[29216]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-02-19T18:59:51.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:50 smithi125 ceph-mon[37556]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:59:51.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:50 smithi096 ceph-mon[29216]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:59:51.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:51 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-19T18:59:51.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:51 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:51.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:51 smithi125 ceph-mon[37556]: Deploying daemon osd.4 on smithi125 2024-02-19T18:59:52.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:51 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-19T18:59:52.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:51 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T18:59:52.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:51 smithi096 ceph-mon[29216]: Deploying daemon osd.4 on smithi125 2024-02-19T18:59:53.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:52 smithi125 ceph-mon[37556]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:59:53.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:52 smithi096 ceph-mon[29216]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:59:55.110 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:54 smithi125 ceph-mon[37556]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:59:55.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:54 smithi096 ceph-mon[29216]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:59:57.263 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:56 smithi125 ceph-mon[37556]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:59:57.264 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:56 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:57.264 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:56 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:57.264 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:56 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:59:57.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:56 smithi096 ceph-mon[29216]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:59:57.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:56 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:57.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:56 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T18:59:57.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:56 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T18:59:58.267 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:57 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:59:58.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:57 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T18:59:59.006 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 18:59:58 smithi125 ceph-mon[37556]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:59:59.063 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:59.044+0000 7f0028ff9700 1 -- 172.21.15.125:0/1939600118 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f002c02d050 con 0x7f001406c4e0 2024-02-19T18:59:59.063 INFO:teuthology.orchestra.run.smithi125.stdout:Created osd(s) 4 on host 'smithi125' 2024-02-19T18:59:59.065 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:59.047+0000 7f00320cb700 1 -- 172.21.15.125:0/1939600118 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f001406c4e0 msgr2=0x7f001406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:59.065 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:59.047+0000 7f00320cb700 1 --2- 172.21.15.125:0/1939600118 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f001406c4e0 0x7f001406e9a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f002c100c20 tx=0x7f001c009190 comp rx=0 tx=0).stop 2024-02-19T18:59:59.065 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:59.047+0000 7f00320cb700 1 -- 172.21.15.125:0/1939600118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c100dc0 msgr2=0x7f002c195cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T18:59:59.065 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:59.047+0000 7f00320cb700 1 --2- 172.21.15.125:0/1939600118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c100dc0 0x7f002c195cc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0020006010 tx=0x7f002000bd70 comp rx=0 tx=0).stop 2024-02-19T18:59:59.065 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:59.047+0000 7f00320cb700 1 -- 172.21.15.125:0/1939600118 shutdown_connections 2024-02-19T18:59:59.065 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:59.047+0000 7f00320cb700 1 --2- 172.21.15.125:0/1939600118 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f001406c4e0 0x7f001406e9a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:59.065 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:59.047+0000 7f00320cb700 1 --2- 172.21.15.125:0/1939600118 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f002c0ffbc0 0x7f002c195780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:59.065 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:59.047+0000 7f00320cb700 1 --2- 172.21.15.125:0/1939600118 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f002c100dc0 0x7f002c195cc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T18:59:59.065 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:59.047+0000 7f00320cb700 1 -- 172.21.15.125:0/1939600118 >> 172.21.15.125:0/1939600118 conn(0x7f002c0fb160 msgr2=0x7f002c1040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T18:59:59.065 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:59.047+0000 7f00320cb700 1 -- 172.21.15.125:0/1939600118 shutdown_connections 2024-02-19T18:59:59.065 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T18:59:59.047+0000 7f00320cb700 1 -- 172.21.15.125:0/1939600118 wait complete. 2024-02-19T18:59:59.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 18:59:58 smithi096 ceph-mon[29216]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T18:59:59.697 DEBUG:teuthology.orchestra.run.smithi125:osd.4> sudo journalctl -f -n 0 -u ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.4.service 2024-02-19T18:59:59.699 INFO:tasks.cephadm:Deploying osd.5 on smithi125 with /dev/vg_nvme/lv_2... 2024-02-19T18:59:59.699 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-19T18:59:59.946 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 18:59:59 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4[50534]: 2024-02-19T18:59:59.866+0000 7fba12470640 -1 osd.4 0 log_to_monitors true 2024-02-19T19:00:00.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:00 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:00.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:00 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:00.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:00 smithi125 ceph-mon[37556]: from='osd.4 [v2:172.21.15.125:6808/1210532750,v1:172.21.15.125:6809/1210532750]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T19:00:00.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:00 smithi125 ceph-mon[37556]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T19:00:00.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:00 smithi125 ceph-mon[37556]: overall HEALTH_OK 2024-02-19T19:00:00.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:00 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:00.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:00 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:00.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:00 smithi096 ceph-mon[29216]: from='osd.4 [v2:172.21.15.125:6808/1210532750,v1:172.21.15.125:6809/1210532750]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T19:00:00.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:00 smithi096 ceph-mon[29216]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T19:00:00.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:00 smithi096 ceph-mon[29216]: overall HEALTH_OK 2024-02-19T19:00:00.356 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi125/config 2024-02-19T19:00:01.441 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:01 smithi125 ceph-mon[37556]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T19:00:01.441 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:01 smithi125 ceph-mon[37556]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-19T19:00:01.441 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:01 smithi125 ceph-mon[37556]: osdmap e32: 5 total, 4 up, 5 in 2024-02-19T19:00:01.442 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:01 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:00:01.442 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:01 smithi125 ceph-mon[37556]: from='osd.4 [v2:172.21.15.125:6808/1210532750,v1:172.21.15.125:6809/1210532750]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2024-02-19T19:00:01.442 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:01 smithi125 ceph-mon[37556]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2024-02-19T19:00:01.442 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:00:01 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4[50534]: 2024-02-19T19:00:01.035+0000 7fba072d3700 -1 osd.4 0 waiting for initial osdmap 2024-02-19T19:00:01.442 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:00:01 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4[50534]: 2024-02-19T19:00:01.041+0000 7fba018c5700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T19:00:01.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:01 smithi096 ceph-mon[29216]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T19:00:01.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:01 smithi096 ceph-mon[29216]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-19T19:00:01.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:01 smithi096 ceph-mon[29216]: osdmap e32: 5 total, 4 up, 5 in 2024-02-19T19:00:01.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:01 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:00:01.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:01 smithi096 ceph-mon[29216]: from='osd.4 [v2:172.21.15.125:6808/1210532750,v1:172.21.15.125:6809/1210532750]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2024-02-19T19:00:01.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:01 smithi096 ceph-mon[29216]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2024-02-19T19:00:02.105 INFO:teuthology.orchestra.run.smithi125.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-19T19:00:02.106 INFO:teuthology.orchestra.run.smithi125.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-19T19:00:02.106 INFO:teuthology.orchestra.run.smithi125.stderr: stderr: 10+0 records in 2024-02-19T19:00:02.106 INFO:teuthology.orchestra.run.smithi125.stderr:10+0 records out 2024-02-19T19:00:02.106 INFO:teuthology.orchestra.run.smithi125.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0144257 s, 727 MB/s 2024-02-19T19:00:02.106 INFO:teuthology.orchestra.run.smithi125.stderr:--> Zapping successful for: 2024-02-19T19:00:02.418 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:02 smithi125 ceph-mon[37556]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]': finished 2024-02-19T19:00:02.418 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:02 smithi125 ceph-mon[37556]: osdmap e33: 5 total, 4 up, 5 in 2024-02-19T19:00:02.418 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:02 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:00:02.418 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:02 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:00:02.418 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:02 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:02.418 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:02 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:02.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:02 smithi096 ceph-mon[29216]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]': finished 2024-02-19T19:00:02.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:02 smithi096 ceph-mon[29216]: osdmap e33: 5 total, 4 up, 5 in 2024-02-19T19:00:02.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:02 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:00:02.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:02 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:00:02.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:02 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:02.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:02 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:02.698 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph orch daemon add osd smithi125:vg_nvme/lv_2 2024-02-19T19:00:03.348 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:03 smithi125 ceph-mon[37556]: purged_snaps scrub starts 2024-02-19T19:00:03.348 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:03 smithi125 ceph-mon[37556]: purged_snaps scrub ok 2024-02-19T19:00:03.348 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:03 smithi125 ceph-mon[37556]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T19:00:03.348 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:03 smithi125 ceph-mon[37556]: osd.4 [v2:172.21.15.125:6808/1210532750,v1:172.21.15.125:6809/1210532750] boot 2024-02-19T19:00:03.348 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:03 smithi125 ceph-mon[37556]: osdmap e34: 5 total, 5 up, 5 in 2024-02-19T19:00:03.348 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:03 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:00:03.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:03 smithi096 ceph-mon[29216]: purged_snaps scrub starts 2024-02-19T19:00:03.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:03 smithi096 ceph-mon[29216]: purged_snaps scrub ok 2024-02-19T19:00:03.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:03 smithi096 ceph-mon[29216]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-19T19:00:03.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:03 smithi096 ceph-mon[29216]: osd.4 [v2:172.21.15.125:6808/1210532750,v1:172.21.15.125:6809/1210532750] boot 2024-02-19T19:00:03.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:03 smithi096 ceph-mon[29216]: osdmap e34: 5 total, 5 up, 5 in 2024-02-19T19:00:03.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:03 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:00:03.641 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi125/config 2024-02-19T19:00:04.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:04 smithi096 ceph-mon[29216]: osdmap e35: 5 total, 5 up, 5 in 2024-02-19T19:00:04.337 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:04 smithi125 ceph-mon[37556]: osdmap e35: 5 total, 5 up, 5 in 2024-02-19T19:00:05.077 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:05 smithi125 ceph-mon[37556]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:05.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:05 smithi096 ceph-mon[29216]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:06.103 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.083+0000 7f87ed4a1700 1 -- 172.21.15.125:0/3651629252 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87e8101eb0 msgr2=0x7f87e8102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:06.104 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.083+0000 7f87ed4a1700 1 --2- 172.21.15.125:0/3651629252 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87e8101eb0 0x7f87e8102310 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f87dc009910 tx=0x7f87dc009c20 comp rx=0 tx=0).stop 2024-02-19T19:00:06.104 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.083+0000 7f87ed4a1700 1 -- 172.21.15.125:0/3651629252 shutdown_connections 2024-02-19T19:00:06.104 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.083+0000 7f87ed4a1700 1 --2- 172.21.15.125:0/3651629252 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87e8101eb0 0x7f87e8102310 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:06.104 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.083+0000 7f87ed4a1700 1 --2- 172.21.15.125:0/3651629252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87e8100cb0 0x7f87e81010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:06.104 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.083+0000 7f87ed4a1700 1 -- 172.21.15.125:0/3651629252 >> 172.21.15.125:0/3651629252 conn(0x7f87e80fc230 msgr2=0x7f87e80fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:06.104 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.083+0000 7f87ed4a1700 1 -- 172.21.15.125:0/3651629252 shutdown_connections 2024-02-19T19:00:06.104 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.083+0000 7f87ed4a1700 1 -- 172.21.15.125:0/3651629252 wait complete. 2024-02-19T19:00:06.104 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.084+0000 7f87ed4a1700 1 Processor -- start 2024-02-19T19:00:06.104 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.084+0000 7f87ed4a1700 1 -- start start 2024-02-19T19:00:06.104 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.084+0000 7f87ed4a1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87e8100cb0 0x7f87e8074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:06.104 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.084+0000 7f87ed4a1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87e8101eb0 0x7f87e8073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:06.105 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.084+0000 7f87ed4a1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e80736c0 con 0x7f87e8100cb0 2024-02-19T19:00:06.105 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.084+0000 7f87ed4a1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e8073800 con 0x7f87e8101eb0 2024-02-19T19:00:06.105 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.084+0000 7f87d7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87e8101eb0 0x7f87e8073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:06.105 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.084+0000 7f87d7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87e8101eb0 0x7f87e8073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39792/0 (socket says 172.21.15.125:39792) 2024-02-19T19:00:06.105 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.084+0000 7f87d7fff700 1 -- 172.21.15.125:0/440300562 learned_addr learned my addr 172.21.15.125:0/440300562 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T19:00:06.105 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.084+0000 7f87e6ffd700 1 --2- 172.21.15.125:0/440300562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87e8100cb0 0x7f87e8074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:06.105 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.084+0000 7f87d7fff700 1 -- 172.21.15.125:0/440300562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87e8100cb0 msgr2=0x7f87e8074b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:06.105 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.084+0000 7f87d7fff700 1 --2- 172.21.15.125:0/440300562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87e8100cb0 0x7f87e8074b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:06.105 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.084+0000 7f87d7fff700 1 -- 172.21.15.125:0/440300562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc0095f0 con 0x7f87e8101eb0 2024-02-19T19:00:06.105 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.084+0000 7f87e6ffd700 1 --2- 172.21.15.125:0/440300562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87e8100cb0 0x7f87e8074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:00:06.105 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.084+0000 7f87d7fff700 1 --2- 172.21.15.125:0/440300562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87e8101eb0 0x7f87e8073180 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f87dc006010 tx=0x7f87dc00be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:06.105 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.084+0000 7f87e4ff9700 1 -- 172.21.15.125:0/440300562 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87dc01d070 con 0x7f87e8101eb0 2024-02-19T19:00:06.105 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.085+0000 7f87ed4a1700 1 -- 172.21.15.125:0/440300562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e8073a80 con 0x7f87e8101eb0 2024-02-19T19:00:06.105 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.085+0000 7f87e4ff9700 1 -- 172.21.15.125:0/440300562 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f87dc00f460 con 0x7f87e8101eb0 2024-02-19T19:00:06.105 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.085+0000 7f87e4ff9700 1 -- 172.21.15.125:0/440300562 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87dc017630 con 0x7f87e8101eb0 2024-02-19T19:00:06.106 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.085+0000 7f87ed4a1700 1 -- 172.21.15.125:0/440300562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e8073f70 con 0x7f87e8101eb0 2024-02-19T19:00:06.106 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.085+0000 7f87ed4a1700 1 -- 172.21.15.125:0/440300562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e8109810 con 0x7f87e8101eb0 2024-02-19T19:00:06.106 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.086+0000 7f87e4ff9700 1 -- 172.21.15.125:0/440300562 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f87dc00f5d0 con 0x7f87e8101eb0 2024-02-19T19:00:06.106 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.086+0000 7f87e4ff9700 1 --2- 172.21.15.125:0/440300562 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f87d006c4e0 0x7f87d006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:06.106 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.086+0000 7f87e4ff9700 1 -- 172.21.15.125:0/440300562 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4206+0+0 (secure 0 0 0) 0x7f87dc08c7b0 con 0x7f87e8101eb0 2024-02-19T19:00:06.106 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.087+0000 7f87e6ffd700 1 --2- 172.21.15.125:0/440300562 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f87d006c4e0 0x7f87d006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:06.107 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.087+0000 7f87e6ffd700 1 --2- 172.21.15.125:0/440300562 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f87d006c4e0 0x7f87d006e9a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f87d8005950 tx=0x7f87d80058e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:06.109 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.091+0000 7f87e4ff9700 1 -- 172.21.15.125:0/440300562 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f87dc05af10 con 0x7f87e8101eb0 2024-02-19T19:00:06.304 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:06.286+0000 7f87ed4a1700 1 -- 172.21.15.125:0/440300562 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f87e8106800 con 0x7f87d006c4e0 2024-02-19T19:00:07.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:06 smithi096 ceph-mon[29216]: Detected new or changed devices on smithi125 2024-02-19T19:00:07.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:06 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:07.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:06 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:07.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:06 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:00:07.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:06 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:00:07.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:06 smithi096 ceph-mon[29216]: Adjusting osd_memory_target on smithi125 to 7456M 2024-02-19T19:00:07.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:06 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:07.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:06 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:00:07.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:06 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:00:07.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:06 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:07.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:06 smithi096 ceph-mon[29216]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:07.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:06 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:00:07.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:06 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:00:07.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:06 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:00:07.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:06 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:07.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:06 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T19:00:07.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:06 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T19:00:07.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:06 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:00:07.043 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:06 smithi125 ceph-mon[37556]: Detected new or changed devices on smithi125 2024-02-19T19:00:07.043 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:06 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:07.043 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:06 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:07.043 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:06 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:00:07.044 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:06 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:00:07.044 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:06 smithi125 ceph-mon[37556]: Adjusting osd_memory_target on smithi125 to 7456M 2024-02-19T19:00:07.044 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:06 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:07.044 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:06 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:00:07.044 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:06 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:00:07.044 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:06 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:07.044 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:06 smithi125 ceph-mon[37556]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:07.044 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:06 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:00:07.044 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:06 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:00:07.044 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:06 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:00:07.044 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:06 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:07.044 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:06 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-19T19:00:07.044 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:06 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-19T19:00:07.044 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:06 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:00:08.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:07 smithi096 ceph-mon[29216]: from='client.24177 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:00:08.067 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:07 smithi125 ceph-mon[37556]: from='client.24177 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi125:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:00:09.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:08 smithi096 ceph-mon[29216]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:09.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:08 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/3617709599' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93d869ce-2537-4913-8373-1db93ffdd67f"}]: dispatch 2024-02-19T19:00:09.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:08 smithi096 ceph-mon[29216]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93d869ce-2537-4913-8373-1db93ffdd67f"}]: dispatch 2024-02-19T19:00:09.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:08 smithi096 ceph-mon[29216]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93d869ce-2537-4913-8373-1db93ffdd67f"}]': finished 2024-02-19T19:00:09.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:08 smithi096 ceph-mon[29216]: osdmap e36: 6 total, 5 up, 6 in 2024-02-19T19:00:09.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:08 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:00:09.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:08 smithi125 ceph-mon[37556]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:09.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:08 smithi125 ceph-mon[37556]: from='client.? 172.21.15.125:0/3617709599' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93d869ce-2537-4913-8373-1db93ffdd67f"}]: dispatch 2024-02-19T19:00:09.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:08 smithi125 ceph-mon[37556]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93d869ce-2537-4913-8373-1db93ffdd67f"}]: dispatch 2024-02-19T19:00:09.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:08 smithi125 ceph-mon[37556]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93d869ce-2537-4913-8373-1db93ffdd67f"}]': finished 2024-02-19T19:00:09.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:08 smithi125 ceph-mon[37556]: osdmap e36: 6 total, 5 up, 6 in 2024-02-19T19:00:09.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:08 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:00:10.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:09 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/56363217' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T19:00:10.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:09 smithi125 ceph-mon[37556]: from='client.? 172.21.15.125:0/56363217' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-19T19:00:11.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:10 smithi096 ceph-mon[29216]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:11.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:10 smithi125 ceph-mon[37556]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:13.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:12 smithi125 ceph-mon[37556]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:13.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:12 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:00:13.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:12 smithi096 ceph-mon[29216]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:13.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:12 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:00:15.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:14 smithi125 ceph-mon[37556]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:15.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:14 smithi096 ceph-mon[29216]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:16.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:16 smithi125 ceph-mon[37556]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:16.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:16 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-19T19:00:16.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:16 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:00:16.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:16 smithi125 ceph-mon[37556]: Deploying daemon osd.5 on smithi125 2024-02-19T19:00:16.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:16 smithi096 ceph-mon[29216]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:16.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:16 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-19T19:00:16.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:16 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:00:16.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:16 smithi096 ceph-mon[29216]: Deploying daemon osd.5 on smithi125 2024-02-19T19:00:19.172 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:18 smithi125 ceph-mon[37556]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:19.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:18 smithi096 ceph-mon[29216]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:21.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:20 smithi125 ceph-mon[37556]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:21.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:20 smithi096 ceph-mon[29216]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:22.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:22 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:22.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:22 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:22.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:22 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:00:22.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:22 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:22.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:22 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:22.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:22 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:00:23.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:23 smithi125 ceph-mon[37556]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:23.534 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:23 smithi096 ceph-mon[29216]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:24.917 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:24.898+0000 7f87e4ff9700 1 -- 172.21.15.125:0/440300562 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f87e8106800 con 0x7f87d006c4e0 2024-02-19T19:00:24.918 INFO:teuthology.orchestra.run.smithi125.stdout:Created osd(s) 5 on host 'smithi125' 2024-02-19T19:00:24.919 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:24.900+0000 7f87ed4a1700 1 -- 172.21.15.125:0/440300562 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f87d006c4e0 msgr2=0x7f87d006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:24.919 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:24.900+0000 7f87ed4a1700 1 --2- 172.21.15.125:0/440300562 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f87d006c4e0 0x7f87d006e9a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f87d8005950 tx=0x7f87d80058e0 comp rx=0 tx=0).stop 2024-02-19T19:00:24.919 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:24.900+0000 7f87ed4a1700 1 -- 172.21.15.125:0/440300562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87e8101eb0 msgr2=0x7f87e8073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:24.919 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:24.900+0000 7f87ed4a1700 1 --2- 172.21.15.125:0/440300562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87e8101eb0 0x7f87e8073180 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f87dc006010 tx=0x7f87dc00be20 comp rx=0 tx=0).stop 2024-02-19T19:00:24.919 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:24.901+0000 7f87ed4a1700 1 -- 172.21.15.125:0/440300562 shutdown_connections 2024-02-19T19:00:24.919 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:24.901+0000 7f87ed4a1700 1 --2- 172.21.15.125:0/440300562 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f87d006c4e0 0x7f87d006e9a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:24.919 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:24.901+0000 7f87ed4a1700 1 --2- 172.21.15.125:0/440300562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87e8100cb0 0x7f87e8074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:24.919 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:24.901+0000 7f87ed4a1700 1 --2- 172.21.15.125:0/440300562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87e8101eb0 0x7f87e8073180 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:24.919 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:24.901+0000 7f87ed4a1700 1 -- 172.21.15.125:0/440300562 >> 172.21.15.125:0/440300562 conn(0x7f87e80fc230 msgr2=0x7f87e81050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:24.919 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:24.901+0000 7f87ed4a1700 1 -- 172.21.15.125:0/440300562 shutdown_connections 2024-02-19T19:00:24.920 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:24.901+0000 7f87ed4a1700 1 -- 172.21.15.125:0/440300562 wait complete. 2024-02-19T19:00:25.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:25 smithi125 ceph-mon[37556]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:25.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:25 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:25.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:25 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:25.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:25 smithi125 ceph-mon[37556]: from='osd.5 [v2:172.21.15.125:6816/2708085722,v1:172.21.15.125:6817/2708085722]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T19:00:25.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:25 smithi125 ceph-mon[37556]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T19:00:25.484 DEBUG:teuthology.orchestra.run.smithi125:osd.5> sudo journalctl -f -n 0 -u ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.5.service 2024-02-19T19:00:25.486 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-02-19T19:00:25.486 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph osd stat -f json 2024-02-19T19:00:25.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:25 smithi096 ceph-mon[29216]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:25.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:25 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:25.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:25 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:25.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:25 smithi096 ceph-mon[29216]: from='osd.5 [v2:172.21.15.125:6816/2708085722,v1:172.21.15.125:6817/2708085722]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T19:00:25.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:25 smithi096 ceph-mon[29216]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T19:00:25.707 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:00:26.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:26.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:26.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:26 smithi125 ceph-mon[37556]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:26.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:26 smithi125 ceph-mon[37556]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-19T19:00:26.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:26 smithi125 ceph-mon[37556]: osdmap e37: 6 total, 5 up, 6 in 2024-02-19T19:00:26.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:00:26.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:26 smithi125 ceph-mon[37556]: from='osd.5 [v2:172.21.15.125:6816/2708085722,v1:172.21.15.125:6817/2708085722]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2024-02-19T19:00:26.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:26 smithi125 ceph-mon[37556]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2024-02-19T19:00:26.950 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:00:26 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[57512]: 2024-02-19T19:00:26.900+0000 7ff2ca80f700 -1 osd.5 0 waiting for initial osdmap 2024-02-19T19:00:26.950 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:00:26 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[57512]: 2024-02-19T19:00:26.908+0000 7ff2c4e01700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T19:00:27.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:26 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:27.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:26 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:27.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:26 smithi096 ceph-mon[29216]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:27.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:26 smithi096 ceph-mon[29216]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-19T19:00:27.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:26 smithi096 ceph-mon[29216]: osdmap e37: 6 total, 5 up, 6 in 2024-02-19T19:00:27.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:26 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:00:27.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:26 smithi096 ceph-mon[29216]: from='osd.5 [v2:172.21.15.125:6816/2708085722,v1:172.21.15.125:6817/2708085722]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2024-02-19T19:00:27.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:26 smithi096 ceph-mon[29216]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2024-02-19T19:00:27.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.358+0000 7f58b86b7700 1 -- 172.21.15.96:0/3595286787 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58b00ffbc0 msgr2=0x7f58b00fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:27.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.358+0000 7f58b86b7700 1 --2- 172.21.15.96:0/3595286787 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58b00ffbc0 0x7f58b00fffe0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f58ac009910 tx=0x7f58ac009c20 comp rx=0 tx=0).stop 2024-02-19T19:00:27.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.358+0000 7f58b86b7700 1 -- 172.21.15.96:0/3595286787 shutdown_connections 2024-02-19T19:00:27.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.358+0000 7f58b86b7700 1 --2- 172.21.15.96:0/3595286787 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58b0100dc0 0x7f58b0101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:27.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.358+0000 7f58b86b7700 1 --2- 172.21.15.96:0/3595286787 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58b00ffbc0 0x7f58b00fffe0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:27.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.358+0000 7f58b86b7700 1 -- 172.21.15.96:0/3595286787 >> 172.21.15.96:0/3595286787 conn(0x7f58b00fb160 msgr2=0x7f58b00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:27.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.358+0000 7f58b86b7700 1 -- 172.21.15.96:0/3595286787 shutdown_connections 2024-02-19T19:00:27.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.358+0000 7f58b86b7700 1 -- 172.21.15.96:0/3595286787 wait complete. 2024-02-19T19:00:27.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.358+0000 7f58b86b7700 1 Processor -- start 2024-02-19T19:00:27.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.358+0000 7f58b86b7700 1 -- start start 2024-02-19T19:00:27.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.359+0000 7f58b86b7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58b00ffbc0 0x7f58b01967f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:27.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.359+0000 7f58b86b7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58b0100dc0 0x7f58b0196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:27.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.359+0000 7f58b86b7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b0197350 con 0x7f58b0100dc0 2024-02-19T19:00:27.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.359+0000 7f58b86b7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b0197490 con 0x7f58b00ffbc0 2024-02-19T19:00:27.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.359+0000 7f58b5c52700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58b0100dc0 0x7f58b0196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:27.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.359+0000 7f58b5c52700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58b0100dc0 0x7f58b0196d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47664/0 (socket says 172.21.15.96:47664) 2024-02-19T19:00:27.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.359+0000 7f58b5c52700 1 -- 172.21.15.96:0/1734876523 learned_addr learned my addr 172.21.15.96:0/1734876523 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:00:27.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.359+0000 7f58b6453700 1 --2- 172.21.15.96:0/1734876523 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58b00ffbc0 0x7f58b01967f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:27.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.359+0000 7f58b5c52700 1 -- 172.21.15.96:0/1734876523 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58b00ffbc0 msgr2=0x7f58b01967f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:27.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.359+0000 7f58b5c52700 1 --2- 172.21.15.96:0/1734876523 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58b00ffbc0 0x7f58b01967f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:27.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.359+0000 7f58b5c52700 1 -- 172.21.15.96:0/1734876523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac0095f0 con 0x7f58b0100dc0 2024-02-19T19:00:27.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.359+0000 7f58b6453700 1 --2- 172.21.15.96:0/1734876523 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58b00ffbc0 0x7f58b01967f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:00:27.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.359+0000 7f58b5c52700 1 --2- 172.21.15.96:0/1734876523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58b0100dc0 0x7f58b0196d30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f58a000d900 tx=0x7f58a000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:27.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.359+0000 7f58a77fe700 1 -- 172.21.15.96:0/1734876523 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58a00041f0 con 0x7f58b0100dc0 2024-02-19T19:00:27.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.359+0000 7f58a77fe700 1 -- 172.21.15.96:0/1734876523 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f58a0004ce0 con 0x7f58b0100dc0 2024-02-19T19:00:27.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.359+0000 7f58b86b7700 1 -- 172.21.15.96:0/1734876523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b019bf40 con 0x7f58b0100dc0 2024-02-19T19:00:27.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.359+0000 7f58a77fe700 1 -- 172.21.15.96:0/1734876523 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58a000b750 con 0x7f58b0100dc0 2024-02-19T19:00:27.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.360+0000 7f58b86b7700 1 -- 172.21.15.96:0/1734876523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b019c460 con 0x7f58b0100dc0 2024-02-19T19:00:27.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.360+0000 7f58b86b7700 1 -- 172.21.15.96:0/1734876523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b0068af0 con 0x7f58b0100dc0 2024-02-19T19:00:27.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.361+0000 7f58a77fe700 1 -- 172.21.15.96:0/1734876523 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f58a0004350 con 0x7f58b0100dc0 2024-02-19T19:00:27.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.361+0000 7f58a77fe700 1 --2- 172.21.15.96:0/1734876523 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f589c06c4e0 0x7f589c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:27.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.361+0000 7f58a77fe700 1 -- 172.21.15.96:0/1734876523 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4358+0+0 (secure 0 0 0) 0x7f58a008b500 con 0x7f58b0100dc0 2024-02-19T19:00:27.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.361+0000 7f58b6453700 1 --2- 172.21.15.96:0/1734876523 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f589c06c4e0 0x7f589c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:27.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.362+0000 7f58b6453700 1 --2- 172.21.15.96:0/1734876523 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f589c06c4e0 0x7f589c06e9a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f58ac006010 tx=0x7f58ac005a90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:27.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.366+0000 7f58a77fe700 1 -- 172.21.15.96:0/1734876523 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f58a0059bc0 con 0x7f58b0100dc0 2024-02-19T19:00:27.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.557+0000 7f58b86b7700 1 -- 172.21.15.96:0/1734876523 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f58b019c680 con 0x7f58b0100dc0 2024-02-19T19:00:27.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.557+0000 7f58a77fe700 1 -- 172.21.15.96:0/1734876523 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7f58a0059750 con 0x7f58b0100dc0 2024-02-19T19:00:27.577 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:00:27.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.559+0000 7f58b86b7700 1 -- 172.21.15.96:0/1734876523 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f589c06c4e0 msgr2=0x7f589c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:27.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.559+0000 7f58b86b7700 1 --2- 172.21.15.96:0/1734876523 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f589c06c4e0 0x7f589c06e9a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f58ac006010 tx=0x7f58ac005a90 comp rx=0 tx=0).stop 2024-02-19T19:00:27.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.559+0000 7f58b86b7700 1 -- 172.21.15.96:0/1734876523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58b0100dc0 msgr2=0x7f58b0196d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:27.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.559+0000 7f58b86b7700 1 --2- 172.21.15.96:0/1734876523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58b0100dc0 0x7f58b0196d30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f58a000d900 tx=0x7f58a000dcc0 comp rx=0 tx=0).stop 2024-02-19T19:00:27.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.559+0000 7f58b86b7700 1 -- 172.21.15.96:0/1734876523 shutdown_connections 2024-02-19T19:00:27.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.559+0000 7f58b86b7700 1 --2- 172.21.15.96:0/1734876523 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f589c06c4e0 0x7f589c06e9a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:27.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.559+0000 7f58b86b7700 1 --2- 172.21.15.96:0/1734876523 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58b00ffbc0 0x7f58b01967f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:27.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.559+0000 7f58b86b7700 1 --2- 172.21.15.96:0/1734876523 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58b0100dc0 0x7f58b0196d30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:27.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.559+0000 7f58b86b7700 1 -- 172.21.15.96:0/1734876523 >> 172.21.15.96:0/1734876523 conn(0x7f58b00fb160 msgr2=0x7f58b0068e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:27.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.559+0000 7f58b86b7700 1 -- 172.21.15.96:0/1734876523 shutdown_connections 2024-02-19T19:00:27.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:27.559+0000 7f58b86b7700 1 -- 172.21.15.96:0/1734876523 wait complete. 2024-02-19T19:00:28.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:27 smithi125 ceph-mon[37556]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]': finished 2024-02-19T19:00:28.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:27 smithi125 ceph-mon[37556]: osdmap e38: 6 total, 5 up, 6 in 2024-02-19T19:00:28.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:27 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:00:28.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:27 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:00:28.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:27 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/1734876523' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-19T19:00:28.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:27 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:00:28.264 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:27 smithi096 ceph-mon[29216]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]': finished 2024-02-19T19:00:28.264 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:27 smithi096 ceph-mon[29216]: osdmap e38: 6 total, 5 up, 6 in 2024-02-19T19:00:28.265 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:27 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:00:28.265 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:27 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:00:28.265 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:27 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/1734876523' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-19T19:00:28.265 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:27 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:00:28.285 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":38,"num_osds":6,"num_up_osds":5,"osd_up_since":1708369202,"num_in_osds":6,"osd_in_since":1708369208,"num_remapped_pgs":0} 2024-02-19T19:00:29.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:28 smithi125 ceph-mon[37556]: purged_snaps scrub starts 2024-02-19T19:00:29.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:28 smithi125 ceph-mon[37556]: purged_snaps scrub ok 2024-02-19T19:00:29.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:28 smithi125 ceph-mon[37556]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:29.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:28 smithi125 ceph-mon[37556]: osd.5 [v2:172.21.15.125:6816/2708085722,v1:172.21.15.125:6817/2708085722] boot 2024-02-19T19:00:29.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:28 smithi125 ceph-mon[37556]: osdmap e39: 6 total, 6 up, 6 in 2024-02-19T19:00:29.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:28 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:00:29.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:28 smithi096 ceph-mon[29216]: purged_snaps scrub starts 2024-02-19T19:00:29.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:28 smithi096 ceph-mon[29216]: purged_snaps scrub ok 2024-02-19T19:00:29.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:28 smithi096 ceph-mon[29216]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-19T19:00:29.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:28 smithi096 ceph-mon[29216]: osd.5 [v2:172.21.15.125:6816/2708085722,v1:172.21.15.125:6817/2708085722] boot 2024-02-19T19:00:29.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:28 smithi096 ceph-mon[29216]: osdmap e39: 6 total, 6 up, 6 in 2024-02-19T19:00:29.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:28 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:00:29.286 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph osd stat -f json 2024-02-19T19:00:29.512 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:00:30.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:29 smithi125 ceph-mon[37556]: osdmap e40: 6 total, 6 up, 6 in 2024-02-19T19:00:30.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:29 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:30.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:29 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:30.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:29 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:00:30.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:29 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:00:30.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:29 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:00:30.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:29 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:30.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:29 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:00:30.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:29 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:00:30.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:29 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:30.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:29 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:00:30.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:29 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:00:30.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:29 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:00:30.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:29 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:30.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:29 smithi096 ceph-mon[29216]: osdmap e40: 6 total, 6 up, 6 in 2024-02-19T19:00:30.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:29 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:30.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:29 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:30.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:29 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:00:30.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:29 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:00:30.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:29 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:00:30.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:29 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:30.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:29 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:00:30.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:29 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:00:30.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:29 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:30.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:29 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:00:30.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:29 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:00:30.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:29 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:00:30.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:29 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:00:31.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:30 smithi125 ceph-mon[37556]: Detected new or changed devices on smithi125 2024-02-19T19:00:31.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:30 smithi125 ceph-mon[37556]: Adjusting osd_memory_target on smithi125 to 4970M 2024-02-19T19:00:31.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:30 smithi125 ceph-mon[37556]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:31.210 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:30 smithi096 ceph-mon[29216]: Detected new or changed devices on smithi125 2024-02-19T19:00:31.210 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:30 smithi096 ceph-mon[29216]: Adjusting osd_memory_target on smithi125 to 4970M 2024-02-19T19:00:31.210 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:30 smithi096 ceph-mon[29216]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:31.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.224+0000 7f8d74b5c700 1 -- 172.21.15.96:0/1300903933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d70100e10 msgr2=0x7f8d70101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:31.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.224+0000 7f8d74b5c700 1 --2- 172.21.15.96:0/1300903933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d70100e10 0x7f8d70101270 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8d60009910 tx=0x7f8d60009c20 comp rx=0 tx=0).stop 2024-02-19T19:00:31.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.224+0000 7f8d74b5c700 1 -- 172.21.15.96:0/1300903933 shutdown_connections 2024-02-19T19:00:31.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.224+0000 7f8d74b5c700 1 --2- 172.21.15.96:0/1300903933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d70100e10 0x7f8d70101270 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:31.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.224+0000 7f8d74b5c700 1 --2- 172.21.15.96:0/1300903933 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d700ffc10 0x7f8d70100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:31.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.224+0000 7f8d74b5c700 1 -- 172.21.15.96:0/1300903933 >> 172.21.15.96:0/1300903933 conn(0x7f8d700fb190 msgr2=0x7f8d700fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:31.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.224+0000 7f8d74b5c700 1 -- 172.21.15.96:0/1300903933 shutdown_connections 2024-02-19T19:00:31.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.224+0000 7f8d74b5c700 1 -- 172.21.15.96:0/1300903933 wait complete. 2024-02-19T19:00:31.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.225+0000 7f8d74b5c700 1 Processor -- start 2024-02-19T19:00:31.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.225+0000 7f8d74b5c700 1 -- start start 2024-02-19T19:00:31.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.225+0000 7f8d74b5c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d700ffc10 0x7f8d70196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:31.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.225+0000 7f8d74b5c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d70100e10 0x7f8d70196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:31.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.225+0000 7f8d74b5c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d70197080 con 0x7f8d700ffc10 2024-02-19T19:00:31.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.225+0000 7f8d74b5c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d701971c0 con 0x7f8d70100e10 2024-02-19T19:00:31.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.225+0000 7f8d6e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d700ffc10 0x7f8d70196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:31.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.225+0000 7f8d6e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d700ffc10 0x7f8d70196520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47670/0 (socket says 172.21.15.96:47670) 2024-02-19T19:00:31.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.225+0000 7f8d6e59c700 1 -- 172.21.15.96:0/2373336839 learned_addr learned my addr 172.21.15.96:0/2373336839 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:00:31.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.225+0000 7f8d6dd9b700 1 --2- 172.21.15.96:0/2373336839 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d70100e10 0x7f8d70196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:31.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.226+0000 7f8d6e59c700 1 -- 172.21.15.96:0/2373336839 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d70100e10 msgr2=0x7f8d70196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:31.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.226+0000 7f8d6e59c700 1 --2- 172.21.15.96:0/2373336839 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d70100e10 0x7f8d70196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:31.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.226+0000 7f8d6e59c700 1 -- 172.21.15.96:0/2373336839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d600095f0 con 0x7f8d700ffc10 2024-02-19T19:00:31.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.226+0000 7f8d6e59c700 1 --2- 172.21.15.96:0/2373336839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d700ffc10 0x7f8d70196520 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800b480 tx=0x7f8d5800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:31.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.226+0000 7f8d677fe700 1 -- 172.21.15.96:0/2373336839 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d580118c0 con 0x7f8d700ffc10 2024-02-19T19:00:31.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.226+0000 7f8d74b5c700 1 -- 172.21.15.96:0/2373336839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7019bc70 con 0x7f8d700ffc10 2024-02-19T19:00:31.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.226+0000 7f8d677fe700 1 -- 172.21.15.96:0/2373336839 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8d58010380 con 0x7f8d700ffc10 2024-02-19T19:00:31.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.226+0000 7f8d677fe700 1 -- 172.21.15.96:0/2373336839 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d5800f4f0 con 0x7f8d700ffc10 2024-02-19T19:00:31.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.226+0000 7f8d74b5c700 1 -- 172.21.15.96:0/2373336839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7019c1c0 con 0x7f8d700ffc10 2024-02-19T19:00:31.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.227+0000 7f8d74b5c700 1 -- 172.21.15.96:0/2373336839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d701087a0 con 0x7f8d700ffc10 2024-02-19T19:00:31.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.228+0000 7f8d677fe700 1 -- 172.21.15.96:0/2373336839 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f8d580104f0 con 0x7f8d700ffc10 2024-02-19T19:00:31.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.228+0000 7f8d677fe700 1 --2- 172.21.15.96:0/2373336839 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f8d5c06c4e0 0x7f8d5c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:31.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.228+0000 7f8d6dd9b700 1 --2- 172.21.15.96:0/2373336839 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f8d5c06c4e0 0x7f8d5c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:31.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.228+0000 7f8d677fe700 1 -- 172.21.15.96:0/2373336839 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f8d5808b110 con 0x7f8d700ffc10 2024-02-19T19:00:31.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.228+0000 7f8d6dd9b700 1 --2- 172.21.15.96:0/2373336839 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f8d5c06c4e0 0x7f8d5c06e9a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8d600059d0 tx=0x7f8d60005920 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:31.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.232+0000 7f8d677fe700 1 -- 172.21.15.96:0/2373336839 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f8d580596c0 con 0x7f8d700ffc10 2024-02-19T19:00:31.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.421+0000 7f8d74b5c700 1 -- 172.21.15.96:0/2373336839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f8d70108990 con 0x7f8d700ffc10 2024-02-19T19:00:31.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.421+0000 7f8d677fe700 1 -- 172.21.15.96:0/2373336839 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7f8d58059250 con 0x7f8d700ffc10 2024-02-19T19:00:31.440 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:00:31.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.423+0000 7f8d74b5c700 1 -- 172.21.15.96:0/2373336839 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f8d5c06c4e0 msgr2=0x7f8d5c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:31.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.423+0000 7f8d74b5c700 1 --2- 172.21.15.96:0/2373336839 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f8d5c06c4e0 0x7f8d5c06e9a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8d600059d0 tx=0x7f8d60005920 comp rx=0 tx=0).stop 2024-02-19T19:00:31.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.423+0000 7f8d74b5c700 1 -- 172.21.15.96:0/2373336839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d700ffc10 msgr2=0x7f8d70196520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:31.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.423+0000 7f8d74b5c700 1 --2- 172.21.15.96:0/2373336839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d700ffc10 0x7f8d70196520 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800b480 tx=0x7f8d5800b840 comp rx=0 tx=0).stop 2024-02-19T19:00:31.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.423+0000 7f8d74b5c700 1 -- 172.21.15.96:0/2373336839 shutdown_connections 2024-02-19T19:00:31.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.423+0000 7f8d74b5c700 1 --2- 172.21.15.96:0/2373336839 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f8d5c06c4e0 0x7f8d5c06e9a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:31.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.423+0000 7f8d74b5c700 1 --2- 172.21.15.96:0/2373336839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8d700ffc10 0x7f8d70196520 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:31.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.423+0000 7f8d74b5c700 1 --2- 172.21.15.96:0/2373336839 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8d70100e10 0x7f8d70196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:31.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.423+0000 7f8d74b5c700 1 -- 172.21.15.96:0/2373336839 >> 172.21.15.96:0/2373336839 conn(0x7f8d700fb190 msgr2=0x7f8d70068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:31.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.423+0000 7f8d74b5c700 1 -- 172.21.15.96:0/2373336839 shutdown_connections 2024-02-19T19:00:31.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:31.423+0000 7f8d74b5c700 1 -- 172.21.15.96:0/2373336839 wait complete. 2024-02-19T19:00:32.092 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:31 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/2373336839' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-19T19:00:32.094 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1708369227,"num_in_osds":6,"osd_in_since":1708369208,"num_remapped_pgs":0} 2024-02-19T19:00:32.094 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph osd dump --format=json 2024-02-19T19:00:32.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:31 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/2373336839' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-19T19:00:32.301 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:00:33.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:32 smithi096 ceph-mon[29216]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:33.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:32 smithi125 ceph-mon[37556]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:33.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.856+0000 7efc854e8700 1 -- 172.21.15.96:0/3225504858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc80102720 msgr2=0x7efc8010ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:33.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.856+0000 7efc854e8700 1 --2- 172.21.15.96:0/3225504858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc80102720 0x7efc8010ac10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efc70009910 tx=0x7efc70009c20 comp rx=0 tx=0).stop 2024-02-19T19:00:33.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.856+0000 7efc854e8700 1 -- 172.21.15.96:0/3225504858 shutdown_connections 2024-02-19T19:00:33.875 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.856+0000 7efc854e8700 1 --2- 172.21.15.96:0/3225504858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc80102720 0x7efc8010ac10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.856+0000 7efc854e8700 1 --2- 172.21.15.96:0/3225504858 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc80101e00 0x7efc801021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.856+0000 7efc854e8700 1 -- 172.21.15.96:0/3225504858 >> 172.21.15.96:0/3225504858 conn(0x7efc800fb650 msgr2=0x7efc800fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.856+0000 7efc854e8700 1 -- 172.21.15.96:0/3225504858 shutdown_connections 2024-02-19T19:00:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.856+0000 7efc854e8700 1 -- 172.21.15.96:0/3225504858 wait complete. 2024-02-19T19:00:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.857+0000 7efc854e8700 1 Processor -- start 2024-02-19T19:00:33.876 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.857+0000 7efc854e8700 1 -- start start 2024-02-19T19:00:33.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.857+0000 7efc854e8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc80101e00 0x7efc8019c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:33.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.857+0000 7efc854e8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc80102720 0x7efc8019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:33.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.857+0000 7efc854e8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8019d1d0 con 0x7efc80101e00 2024-02-19T19:00:33.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.857+0000 7efc854e8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc80196710 con 0x7efc80102720 2024-02-19T19:00:33.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.857+0000 7efc7effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc80101e00 0x7efc8019c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:33.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.857+0000 7efc7effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc80101e00 0x7efc8019c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47672/0 (socket says 172.21.15.96:47672) 2024-02-19T19:00:33.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.857+0000 7efc7effd700 1 -- 172.21.15.96:0/914596799 learned_addr learned my addr 172.21.15.96:0/914596799 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:00:33.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.858+0000 7efc7e7fc700 1 --2- 172.21.15.96:0/914596799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc80102720 0x7efc8019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:33.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.858+0000 7efc7effd700 1 -- 172.21.15.96:0/914596799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc80102720 msgr2=0x7efc8019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:33.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.858+0000 7efc7effd700 1 --2- 172.21.15.96:0/914596799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc80102720 0x7efc8019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:33.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.858+0000 7efc7effd700 1 -- 172.21.15.96:0/914596799 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc700095f0 con 0x7efc80101e00 2024-02-19T19:00:33.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.858+0000 7efc7effd700 1 --2- 172.21.15.96:0/914596799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc80101e00 0x7efc8019c690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efc7400c930 tx=0x7efc7400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:33.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.858+0000 7efc67fff700 1 -- 172.21.15.96:0/914596799 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc74007ad0 con 0x7efc80101e00 2024-02-19T19:00:33.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.858+0000 7efc67fff700 1 -- 172.21.15.96:0/914596799 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efc7400ce80 con 0x7efc80101e00 2024-02-19T19:00:33.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.858+0000 7efc854e8700 1 -- 172.21.15.96:0/914596799 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc801969f0 con 0x7efc80101e00 2024-02-19T19:00:33.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.858+0000 7efc67fff700 1 -- 172.21.15.96:0/914596799 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc74018630 con 0x7efc80101e00 2024-02-19T19:00:33.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.858+0000 7efc854e8700 1 -- 172.21.15.96:0/914596799 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc80196f10 con 0x7efc80101e00 2024-02-19T19:00:33.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.859+0000 7efc854e8700 1 -- 172.21.15.96:0/914596799 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc80108310 con 0x7efc80101e00 2024-02-19T19:00:33.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.860+0000 7efc67fff700 1 -- 172.21.15.96:0/914596799 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7efc74007c30 con 0x7efc80101e00 2024-02-19T19:00:33.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.860+0000 7efc67fff700 1 --2- 172.21.15.96:0/914596799 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7efc6806c4e0 0x7efc6806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:33.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.860+0000 7efc67fff700 1 -- 172.21.15.96:0/914596799 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7efc7408b450 con 0x7efc80101e00 2024-02-19T19:00:33.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.860+0000 7efc7e7fc700 1 --2- 172.21.15.96:0/914596799 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7efc6806c4e0 0x7efc6806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:33.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.860+0000 7efc7e7fc700 1 --2- 172.21.15.96:0/914596799 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7efc6806c4e0 0x7efc6806e9a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efc70006010 tx=0x7efc7001a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:33.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:33.865+0000 7efc67fff700 1 -- 172.21.15.96:0/914596799 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7efc74059a00 con 0x7efc80101e00 2024-02-19T19:00:34.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:34.056+0000 7efc854e8700 1 -- 172.21.15.96:0/914596799 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc80197c50 con 0x7efc80101e00 2024-02-19T19:00:34.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:34.056+0000 7efc67fff700 1 -- 172.21.15.96:0/914596799 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11349 (secure 0 0 0) 0x7efc74059590 con 0x7efc80101e00 2024-02-19T19:00:34.075 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:00:34.075 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":40,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","created":"2024-02-19T18:54:33.002577+0000","modified":"2024-02-19T19:00:28.899441+0000","last_up_change":"2024-02-19T19:00:27.894969+0000","last_in_change":"2024-02-19T19:00:08.695793+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T18:59:14.096877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c8d3e948-3736-431e-9ccd-18d3d1af342a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1987555426},{"type":"v1","addr":"172.21.15.96:6803","nonce":1987555426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1987555426},{"type":"v1","addr":"172.21.15.96:6805","nonce":1987555426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1987555426},{"type":"v1","addr":"172.21.15.96:6809","nonce":1987555426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1987555426},{"type":"v1","addr":"172.21.15.96:6807","nonce":1987555426}]},"public_addr":"172.21.15.96:6803/1987555426","cluster_addr":"172.21.15.96:6805/1987555426","heartbeat_back_addr":"172.21.15.96:6809/1987555426","heartbeat_front_addr":"172.21.15.96:6807/1987555426","state":["exists","up"]},{"osd":1,"uuid":"012aa0e0-d3ed-4b27-9e5e-fd667e4523ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3386518204},{"type":"v1","addr":"172.21.15.96:6811","nonce":3386518204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3386518204},{"type":"v1","addr":"172.21.15.96:6813","nonce":3386518204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3386518204},{"type":"v1","addr":"172.21.15.96:6817","nonce":3386518204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3386518204},{"type":"v1","addr":"172.21.15.96:6815","nonce":3386518204}]},"public_addr":"172.21.15.96:6811/3386518204","cluster_addr":"172.21.15.96:6813/3386518204","heartbeat_back_addr":"172.21.15.96:6817/3386518204","heartbeat_front_addr":"172.21.15.96:6815/3386518204","state":["exists","up"]},{"osd":2,"uuid":"3bf17dab-3c04-4ed0-8edf-45a217a52d0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3117123037},{"type":"v1","addr":"172.21.15.96:6819","nonce":3117123037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3117123037},{"type":"v1","addr":"172.21.15.96:6821","nonce":3117123037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3117123037},{"type":"v1","addr":"172.21.15.96:6825","nonce":3117123037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3117123037},{"type":"v1","addr":"172.21.15.96:6823","nonce":3117123037}]},"public_addr":"172.21.15.96:6819/3117123037","cluster_addr":"172.21.15.96:6821/3117123037","heartbeat_back_addr":"172.21.15.96:6825/3117123037","heartbeat_front_addr":"172.21.15.96:6823/3117123037","state":["exists","up"]},{"osd":3,"uuid":"fa80c0e4-7d1a-4e41-9455-b576cbcac572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6801","nonce":3311295426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6803","nonce":3311295426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6807","nonce":3311295426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6805","nonce":3311295426}]},"public_addr":"172.21.15.125:6801/3311295426","cluster_addr":"172.21.15.125:6803/3311295426","heartbeat_back_addr":"172.21.15.125:6807/3311295426","heartbeat_front_addr":"172.21.15.125:6805/3311295426","state":["exists","up"]},{"osd":4,"uuid":"9363cacc-c727-4282-a50f-e123f625e13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6809","nonce":1210532750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6811","nonce":1210532750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6815","nonce":1210532750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6813","nonce":1210532750}]},"public_addr":"172.21.15.125:6809/1210532750","cluster_addr":"172.21.15.125:6811/1210532750","heartbeat_back_addr":"172.21.15.125:6815/1210532750","heartbeat_front_addr":"172.21.15.125:6813/1210532750","state":["exists","up"]},{"osd":5,"uuid":"93d869ce-2537-4913-8373-1db93ffdd67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6817","nonce":2708085722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6819","nonce":2708085722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6823","nonce":2708085722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6821","nonce":2708085722}]},"public_addr":"172.21.15.125:6817/2708085722","cluster_addr":"172.21.15.125:6819/2708085722","heartbeat_back_addr":"172.21.15.125:6823/2708085722","heartbeat_front_addr":"172.21.15.125:6821/2708085722","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:58:16.075448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:58:43.787873+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:59:11.561163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:59:35.893197+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T19:00:00.837738+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T19:00:25.890961+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/3018792068":"2024-02-20T18:56:57.759773+0000","172.21.15.96:6801/3628131135":"2024-02-20T18:56:57.759773+0000","172.21.15.96:6800/3628131135":"2024-02-20T18:56:57.759773+0000","172.21.15.96:6801/3697355606":"2024-02-20T18:55:36.280962+0000","172.21.15.96:0/561831206":"2024-02-20T18:56:57.759773+0000","172.21.15.96:6800/3697355606":"2024-02-20T18:55:36.280962+0000","172.21.15.96:0/4153792828":"2024-02-20T18:56:57.759773+0000","172.21.15.96:0/1844984401":"2024-02-20T18:55:36.280962+0000","172.21.15.96:6801/1286321532":"2024-02-20T18:55:03.067702+0000","172.21.15.96:6800/1286321532":"2024-02-20T18:55:03.067702+0000","172.21.15.96:0/2093229384":"2024-02-20T18:55:36.280962+0000","172.21.15.96:0/2493593498":"2024-02-20T18:55:36.280962+0000","172.21.15.96:0/3563912069":"2024-02-20T18:55:03.067702+0000","172.21.15.96:0/782865038":"2024-02-20T18:55:03.067702+0000","172.21.15.96:0/1543256561":"2024-02-20T18:55:03.067702+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T19:00:34.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:34.058+0000 7efc854e8700 1 -- 172.21.15.96:0/914596799 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7efc6806c4e0 msgr2=0x7efc6806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:34.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:34.058+0000 7efc854e8700 1 --2- 172.21.15.96:0/914596799 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7efc6806c4e0 0x7efc6806e9a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efc70006010 tx=0x7efc7001a040 comp rx=0 tx=0).stop 2024-02-19T19:00:34.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:34.058+0000 7efc854e8700 1 -- 172.21.15.96:0/914596799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc80101e00 msgr2=0x7efc8019c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:34.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:34.058+0000 7efc854e8700 1 --2- 172.21.15.96:0/914596799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc80101e00 0x7efc8019c690 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efc7400c930 tx=0x7efc7400cc40 comp rx=0 tx=0).stop 2024-02-19T19:00:34.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:34.058+0000 7efc854e8700 1 -- 172.21.15.96:0/914596799 shutdown_connections 2024-02-19T19:00:34.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:34.058+0000 7efc854e8700 1 --2- 172.21.15.96:0/914596799 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7efc6806c4e0 0x7efc6806e9a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:34.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:34.058+0000 7efc854e8700 1 --2- 172.21.15.96:0/914596799 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc80101e00 0x7efc8019c690 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:34.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:34.058+0000 7efc854e8700 1 --2- 172.21.15.96:0/914596799 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc80102720 0x7efc8019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:34.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:34.058+0000 7efc854e8700 1 -- 172.21.15.96:0/914596799 >> 172.21.15.96:0/914596799 conn(0x7efc800fb650 msgr2=0x7efc80105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:34.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:34.059+0000 7efc854e8700 1 -- 172.21.15.96:0/914596799 shutdown_connections 2024-02-19T19:00:34.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:34.059+0000 7efc854e8700 1 -- 172.21.15.96:0/914596799 wait complete. 2024-02-19T19:00:34.753 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T18:59:14.096877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T19:00:34.753 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-02-19T19:00:34.962 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:00:35.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:34 smithi096 ceph-mon[29216]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:35.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:34 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/914596799' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T19:00:35.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:34 smithi125 ceph-mon[37556]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:35.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:34 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/914596799' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T19:00:36.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.574+0000 7f2d5f1a5700 1 -- 172.21.15.96:0/2927544907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d58102720 msgr2=0x7f2d5810ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:36.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.574+0000 7f2d5f1a5700 1 --2- 172.21.15.96:0/2927544907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d58102720 0x7f2d5810ac10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2d44009910 tx=0x7f2d44009c20 comp rx=0 tx=0).stop 2024-02-19T19:00:36.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.575+0000 7f2d5f1a5700 1 -- 172.21.15.96:0/2927544907 shutdown_connections 2024-02-19T19:00:36.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.575+0000 7f2d5f1a5700 1 --2- 172.21.15.96:0/2927544907 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d58102720 0x7f2d5810ac10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:36.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.575+0000 7f2d5f1a5700 1 --2- 172.21.15.96:0/2927544907 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d58101e00 0x7f2d581021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:36.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.575+0000 7f2d5f1a5700 1 -- 172.21.15.96:0/2927544907 >> 172.21.15.96:0/2927544907 conn(0x7f2d580fb650 msgr2=0x7f2d580fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:36.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.575+0000 7f2d5f1a5700 1 -- 172.21.15.96:0/2927544907 shutdown_connections 2024-02-19T19:00:36.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.575+0000 7f2d5f1a5700 1 -- 172.21.15.96:0/2927544907 wait complete. 2024-02-19T19:00:36.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.575+0000 7f2d5f1a5700 1 Processor -- start 2024-02-19T19:00:36.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.575+0000 7f2d5f1a5700 1 -- start start 2024-02-19T19:00:36.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.575+0000 7f2d5f1a5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d58101e00 0x7f2d580ffa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:36.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.575+0000 7f2d5f1a5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d58102720 0x7f2d580fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:36.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.575+0000 7f2d5f1a5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d581004e0 con 0x7f2d58101e00 2024-02-19T19:00:36.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.575+0000 7f2d5f1a5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d58100620 con 0x7f2d58102720 2024-02-19T19:00:36.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.575+0000 7f2d5cf41700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d58101e00 0x7f2d580ffa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:36.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.575+0000 7f2d5cf41700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d58101e00 0x7f2d580ffa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47678/0 (socket says 172.21.15.96:47678) 2024-02-19T19:00:36.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.576+0000 7f2d5cf41700 1 -- 172.21.15.96:0/1063657687 learned_addr learned my addr 172.21.15.96:0/1063657687 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:00:36.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.576+0000 7f2d57fff700 1 --2- 172.21.15.96:0/1063657687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d58102720 0x7f2d580fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:36.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.576+0000 7f2d5cf41700 1 -- 172.21.15.96:0/1063657687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d58102720 msgr2=0x7f2d580fffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:36.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.576+0000 7f2d5cf41700 1 --2- 172.21.15.96:0/1063657687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d58102720 0x7f2d580fffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:36.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.576+0000 7f2d5cf41700 1 -- 172.21.15.96:0/1063657687 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d440095f0 con 0x7f2d58101e00 2024-02-19T19:00:36.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.576+0000 7f2d5cf41700 1 --2- 172.21.15.96:0/1063657687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d58101e00 0x7f2d580ffa60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c00c930 tx=0x7f2d4c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:36.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.576+0000 7f2d55ffb700 1 -- 172.21.15.96:0/1063657687 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d4c007ad0 con 0x7f2d58101e00 2024-02-19T19:00:36.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.576+0000 7f2d55ffb700 1 -- 172.21.15.96:0/1063657687 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2d4c00ce80 con 0x7f2d58101e00 2024-02-19T19:00:36.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.576+0000 7f2d5f1a5700 1 -- 172.21.15.96:0/1063657687 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d581a2a90 con 0x7f2d58101e00 2024-02-19T19:00:36.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.576+0000 7f2d55ffb700 1 -- 172.21.15.96:0/1063657687 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d4c018630 con 0x7f2d58101e00 2024-02-19T19:00:36.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.576+0000 7f2d5f1a5700 1 -- 172.21.15.96:0/1063657687 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d581a2df0 con 0x7f2d58101e00 2024-02-19T19:00:36.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.577+0000 7f2d5f1a5700 1 -- 172.21.15.96:0/1063657687 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d58108310 con 0x7f2d58101e00 2024-02-19T19:00:36.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.578+0000 7f2d55ffb700 1 -- 172.21.15.96:0/1063657687 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f2d4c007c30 con 0x7f2d58101e00 2024-02-19T19:00:36.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.578+0000 7f2d55ffb700 1 --2- 172.21.15.96:0/1063657687 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f2d4806c4e0 0x7f2d4806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:36.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.578+0000 7f2d55ffb700 1 -- 172.21.15.96:0/1063657687 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f2d4c08b3d0 con 0x7f2d58101e00 2024-02-19T19:00:36.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.578+0000 7f2d57fff700 1 --2- 172.21.15.96:0/1063657687 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f2d4806c4e0 0x7f2d4806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:36.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.578+0000 7f2d57fff700 1 --2- 172.21.15.96:0/1063657687 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f2d4806c4e0 0x7f2d4806e9a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2d44006010 tx=0x7f2d4401a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:36.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.583+0000 7f2d55ffb700 1 -- 172.21.15.96:0/1063657687 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f2d4c055f70 con 0x7f2d58101e00 2024-02-19T19:00:36.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:36 smithi125 ceph-mon[37556]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:36.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:36 smithi096 ceph-mon[29216]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:36.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.770+0000 7f2d5f1a5700 1 -- 172.21.15.96:0/1063657687 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2d58107cf0 con 0x7f2d58101e00 2024-02-19T19:00:36.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.770+0000 7f2d55ffb700 1 -- 172.21.15.96:0/1063657687 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2d4c059590 con 0x7f2d58101e00 2024-02-19T19:00:36.789 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-02-19T19:00:36.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.773+0000 7f2d5f1a5700 1 -- 172.21.15.96:0/1063657687 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f2d4806c4e0 msgr2=0x7f2d4806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:36.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.773+0000 7f2d5f1a5700 1 --2- 172.21.15.96:0/1063657687 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f2d4806c4e0 0x7f2d4806e9a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2d44006010 tx=0x7f2d4401a040 comp rx=0 tx=0).stop 2024-02-19T19:00:36.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.773+0000 7f2d5f1a5700 1 -- 172.21.15.96:0/1063657687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d58101e00 msgr2=0x7f2d580ffa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:36.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.773+0000 7f2d5f1a5700 1 --2- 172.21.15.96:0/1063657687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d58101e00 0x7f2d580ffa60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c00c930 tx=0x7f2d4c00cc40 comp rx=0 tx=0).stop 2024-02-19T19:00:36.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.773+0000 7f2d5f1a5700 1 -- 172.21.15.96:0/1063657687 shutdown_connections 2024-02-19T19:00:36.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.773+0000 7f2d5f1a5700 1 --2- 172.21.15.96:0/1063657687 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f2d4806c4e0 0x7f2d4806e9a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:36.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.773+0000 7f2d5f1a5700 1 --2- 172.21.15.96:0/1063657687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2d58101e00 0x7f2d580ffa60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:36.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.773+0000 7f2d5f1a5700 1 --2- 172.21.15.96:0/1063657687 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2d58102720 0x7f2d580fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:36.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.773+0000 7f2d5f1a5700 1 -- 172.21.15.96:0/1063657687 >> 172.21.15.96:0/1063657687 conn(0x7f2d580fb650 msgr2=0x7f2d58105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:36.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.773+0000 7f2d5f1a5700 1 -- 172.21.15.96:0/1063657687 shutdown_connections 2024-02-19T19:00:36.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:36.773+0000 7f2d5f1a5700 1 -- 172.21.15.96:0/1063657687 wait complete. 2024-02-19T19:00:37.403 INFO:tasks.cephadm:Setting up client nodes... 2024-02-19T19:00:37.403 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-19T19:00:37.609 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:00:37.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:37 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/1063657687' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-19T19:00:37.731 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:37 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/1063657687' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-19T19:00:38.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:38 smithi125 ceph-mon[37556]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:38.710 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:38 smithi096 ceph-mon[29216]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:39.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.243+0000 7fa00d96c700 1 -- 172.21.15.96:0/2852240933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa008100dc0 msgr2=0x7fa008101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:39.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.243+0000 7fa00d96c700 1 --2- 172.21.15.96:0/2852240933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa008100dc0 0x7fa008101220 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009910 tx=0x7f9ffc009c20 comp rx=0 tx=0).stop 2024-02-19T19:00:39.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.243+0000 7fa00d96c700 1 -- 172.21.15.96:0/2852240933 shutdown_connections 2024-02-19T19:00:39.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.243+0000 7fa00d96c700 1 --2- 172.21.15.96:0/2852240933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa008100dc0 0x7fa008101220 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:39.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.243+0000 7fa00d96c700 1 --2- 172.21.15.96:0/2852240933 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0080ffbc0 0x7fa0080fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:39.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.243+0000 7fa00d96c700 1 -- 172.21.15.96:0/2852240933 >> 172.21.15.96:0/2852240933 conn(0x7fa0080fb160 msgr2=0x7fa0080fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:39.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.243+0000 7fa00d96c700 1 -- 172.21.15.96:0/2852240933 shutdown_connections 2024-02-19T19:00:39.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.243+0000 7fa00d96c700 1 -- 172.21.15.96:0/2852240933 wait complete. 2024-02-19T19:00:39.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.244+0000 7fa00d96c700 1 Processor -- start 2024-02-19T19:00:39.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.244+0000 7fa00d96c700 1 -- start start 2024-02-19T19:00:39.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.244+0000 7fa00d96c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0080ffbc0 0x7fa0080699d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:39.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.244+0000 7fa00d96c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa008100dc0 0x7fa00819b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:39.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.244+0000 7fa00d96c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00819bb80 con 0x7fa0080ffbc0 2024-02-19T19:00:39.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.244+0000 7fa00d96c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00819bcc0 con 0x7fa008100dc0 2024-02-19T19:00:39.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.244+0000 7fa006ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0080ffbc0 0x7fa0080699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:39.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.244+0000 7fa006ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0080ffbc0 0x7fa0080699d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47688/0 (socket says 172.21.15.96:47688) 2024-02-19T19:00:39.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.244+0000 7fa006ffd700 1 -- 172.21.15.96:0/3535008349 learned_addr learned my addr 172.21.15.96:0/3535008349 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:00:39.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.244+0000 7fa0067fc700 1 --2- 172.21.15.96:0/3535008349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa008100dc0 0x7fa00819b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:39.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.245+0000 7fa006ffd700 1 -- 172.21.15.96:0/3535008349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa008100dc0 msgr2=0x7fa00819b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:39.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.245+0000 7fa006ffd700 1 --2- 172.21.15.96:0/3535008349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa008100dc0 0x7fa00819b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:39.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.245+0000 7fa006ffd700 1 -- 172.21.15.96:0/3535008349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ffc0095f0 con 0x7fa0080ffbc0 2024-02-19T19:00:39.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.245+0000 7fa0067fc700 1 --2- 172.21.15.96:0/3535008349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa008100dc0 0x7fa00819b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:00:39.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.245+0000 7fa006ffd700 1 --2- 172.21.15.96:0/3535008349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0080ffbc0 0x7fa0080699d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800b480 tx=0x7f9ff800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:39.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.245+0000 7fa00c96a700 1 -- 172.21.15.96:0/3535008349 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ff80118c0 con 0x7fa0080ffbc0 2024-02-19T19:00:39.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.245+0000 7fa00c96a700 1 -- 172.21.15.96:0/3535008349 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9ff8010380 con 0x7fa0080ffbc0 2024-02-19T19:00:39.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.245+0000 7fa00d96c700 1 -- 172.21.15.96:0/3535008349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00819bfa0 con 0x7fa0080ffbc0 2024-02-19T19:00:39.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.245+0000 7fa00c96a700 1 -- 172.21.15.96:0/3535008349 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ff800f4f0 con 0x7fa0080ffbc0 2024-02-19T19:00:39.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.245+0000 7fa00d96c700 1 -- 172.21.15.96:0/3535008349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00819c460 con 0x7fa0080ffbc0 2024-02-19T19:00:39.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.246+0000 7fa00d96c700 1 -- 172.21.15.96:0/3535008349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00818f5d0 con 0x7fa0080ffbc0 2024-02-19T19:00:39.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.247+0000 7fa00c96a700 1 -- 172.21.15.96:0/3535008349 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f9ff80104f0 con 0x7fa0080ffbc0 2024-02-19T19:00:39.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.247+0000 7fa00c96a700 1 --2- 172.21.15.96:0/3535008349 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f9ff006c4e0 0x7f9ff006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:39.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.247+0000 7fa00c96a700 1 -- 172.21.15.96:0/3535008349 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f9ff808b110 con 0x7fa0080ffbc0 2024-02-19T19:00:39.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.247+0000 7fa0067fc700 1 --2- 172.21.15.96:0/3535008349 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f9ff006c4e0 0x7f9ff006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:39.266 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.247+0000 7fa0067fc700 1 --2- 172.21.15.96:0/3535008349 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f9ff006c4e0 0x7f9ff006e9a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc006010 tx=0x7f9ffc00b580 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:39.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.251+0000 7fa00c96a700 1 -- 172.21.15.96:0/3535008349 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9ff80596c0 con 0x7fa0080ffbc0 2024-02-19T19:00:39.536 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.518+0000 7fa00d96c700 1 -- 172.21.15.96:0/3535008349 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fa008068af0 con 0x7fa0080ffbc0 2024-02-19T19:00:39.540 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.522+0000 7fa00c96a700 1 -- 172.21.15.96:0/3535008349 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7f9ff8059250 con 0x7fa0080ffbc0 2024-02-19T19:00:39.540 INFO:teuthology.orchestra.run.smithi096.stdout:[client.0] 2024-02-19T19:00:39.540 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBXpdNlmDf3HhAANnD2TrnoaOeJMaOU+EA/Gg== 2024-02-19T19:00:39.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.524+0000 7fa00d96c700 1 -- 172.21.15.96:0/3535008349 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f9ff006c4e0 msgr2=0x7f9ff006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:39.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.524+0000 7fa00d96c700 1 --2- 172.21.15.96:0/3535008349 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f9ff006c4e0 0x7f9ff006e9a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc006010 tx=0x7f9ffc00b580 comp rx=0 tx=0).stop 2024-02-19T19:00:39.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.524+0000 7fa00d96c700 1 -- 172.21.15.96:0/3535008349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0080ffbc0 msgr2=0x7fa0080699d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:39.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.524+0000 7fa00d96c700 1 --2- 172.21.15.96:0/3535008349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0080ffbc0 0x7fa0080699d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800b480 tx=0x7f9ff800b840 comp rx=0 tx=0).stop 2024-02-19T19:00:39.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.524+0000 7fa00d96c700 1 -- 172.21.15.96:0/3535008349 shutdown_connections 2024-02-19T19:00:39.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.524+0000 7fa00d96c700 1 --2- 172.21.15.96:0/3535008349 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f9ff006c4e0 0x7f9ff006e9a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:39.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.524+0000 7fa00d96c700 1 --2- 172.21.15.96:0/3535008349 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0080ffbc0 0x7fa0080699d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:39.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.524+0000 7fa00d96c700 1 --2- 172.21.15.96:0/3535008349 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa008100dc0 0x7fa00819b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:39.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.524+0000 7fa00d96c700 1 -- 172.21.15.96:0/3535008349 >> 172.21.15.96:0/3535008349 conn(0x7fa0080fb160 msgr2=0x7fa0081040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:39.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.524+0000 7fa00d96c700 1 -- 172.21.15.96:0/3535008349 shutdown_connections 2024-02-19T19:00:39.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:39.524+0000 7fa00d96c700 1 -- 172.21.15.96:0/3535008349 wait complete. 2024-02-19T19:00:39.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:39 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/3535008349' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T19:00:39.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:39 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/3535008349' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-19T19:00:39.825 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:39 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/3535008349' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T19:00:39.825 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:39 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/3535008349' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-19T19:00:40.198 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-02-19T19:00:40.198 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-19T19:00:40.198 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-19T19:00:40.239 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-19T19:00:40.457 INFO:teuthology.orchestra.run.smithi125.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi125/config 2024-02-19T19:00:40.826 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:40 smithi125 ceph-mon[37556]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:41.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:40 smithi096 ceph-mon[29216]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:41.948 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.928+0000 7fdfbd54e700 1 -- 172.21.15.125:0/2878943755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfb8100cb0 msgr2=0x7fdfb81010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:41.948 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.928+0000 7fdfbd54e700 1 --2- 172.21.15.125:0/2878943755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfb8100cb0 0x7fdfb81010d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000b0a0 tx=0x7fdfb000b3b0 comp rx=0 tx=0).stop 2024-02-19T19:00:41.948 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.929+0000 7fdfbd54e700 1 -- 172.21.15.125:0/2878943755 shutdown_connections 2024-02-19T19:00:41.949 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.929+0000 7fdfbd54e700 1 --2- 172.21.15.125:0/2878943755 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfb8101eb0 0x7fdfb8102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:41.949 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.929+0000 7fdfbd54e700 1 --2- 172.21.15.125:0/2878943755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfb8100cb0 0x7fdfb81010d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:41.949 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.929+0000 7fdfbd54e700 1 -- 172.21.15.125:0/2878943755 >> 172.21.15.125:0/2878943755 conn(0x7fdfb80fc230 msgr2=0x7fdfb80fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:41.949 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.929+0000 7fdfbd54e700 1 -- 172.21.15.125:0/2878943755 shutdown_connections 2024-02-19T19:00:41.949 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.929+0000 7fdfbd54e700 1 -- 172.21.15.125:0/2878943755 wait complete. 2024-02-19T19:00:41.949 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.929+0000 7fdfbd54e700 1 Processor -- start 2024-02-19T19:00:41.951 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.929+0000 7fdfbd54e700 1 -- start start 2024-02-19T19:00:41.951 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.930+0000 7fdfbd54e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfb8100cb0 0x7fdfb8196590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:41.951 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.930+0000 7fdfbd54e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfb8101eb0 0x7fdfb8196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:41.951 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.930+0000 7fdfbd54e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb81970f0 con 0x7fdfb8100cb0 2024-02-19T19:00:41.951 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.930+0000 7fdfbd54e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb8197230 con 0x7fdfb8101eb0 2024-02-19T19:00:41.951 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.930+0000 7fdfb67fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfb8101eb0 0x7fdfb8196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:41.951 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.930+0000 7fdfb67fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfb8101eb0 0x7fdfb8196ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48684/0 (socket says 172.21.15.125:48684) 2024-02-19T19:00:41.951 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.930+0000 7fdfb67fc700 1 -- 172.21.15.125:0/4013406653 learned_addr learned my addr 172.21.15.125:0/4013406653 (peer_addr_for_me v2:172.21.15.125:0/0) 2024-02-19T19:00:41.951 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.930+0000 7fdfb6ffd700 1 --2- 172.21.15.125:0/4013406653 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfb8100cb0 0x7fdfb8196590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:41.951 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.930+0000 7fdfb67fc700 1 -- 172.21.15.125:0/4013406653 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfb8100cb0 msgr2=0x7fdfb8196590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:41.952 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.930+0000 7fdfb67fc700 1 --2- 172.21.15.125:0/4013406653 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfb8100cb0 0x7fdfb8196590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:41.952 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.930+0000 7fdfb67fc700 1 -- 172.21.15.125:0/4013406653 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb0009d00 con 0x7fdfb8101eb0 2024-02-19T19:00:41.952 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.930+0000 7fdfb67fc700 1 --2- 172.21.15.125:0/4013406653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfb8101eb0 0x7fdfb8196ad0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00d8d0 tx=0x7fdfac00dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:41.952 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.930+0000 7fdf9ffff700 1 -- 172.21.15.125:0/4013406653 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfac009940 con 0x7fdfb8101eb0 2024-02-19T19:00:41.952 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.930+0000 7fdf9ffff700 1 -- 172.21.15.125:0/4013406653 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdfac010460 con 0x7fdfb8101eb0 2024-02-19T19:00:41.952 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.930+0000 7fdfbd54e700 1 -- 172.21.15.125:0/4013406653 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb819bce0 con 0x7fdfb8101eb0 2024-02-19T19:00:41.952 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.930+0000 7fdf9ffff700 1 -- 172.21.15.125:0/4013406653 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfac00f5f0 con 0x7fdfb8101eb0 2024-02-19T19:00:41.952 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.930+0000 7fdfbd54e700 1 -- 172.21.15.125:0/4013406653 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb819c230 con 0x7fdfb8101eb0 2024-02-19T19:00:41.952 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.931+0000 7fdfbd54e700 1 -- 172.21.15.125:0/4013406653 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb8109810 con 0x7fdfb8101eb0 2024-02-19T19:00:41.952 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.932+0000 7fdf9ffff700 1 -- 172.21.15.125:0/4013406653 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fdfac0105d0 con 0x7fdfb8101eb0 2024-02-19T19:00:41.953 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.932+0000 7fdf9ffff700 1 --2- 172.21.15.125:0/4013406653 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fdfa006c4e0 0x7fdfa006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:41.953 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.932+0000 7fdf9ffff700 1 -- 172.21.15.125:0/4013406653 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fdfac08b4e0 con 0x7fdfb8101eb0 2024-02-19T19:00:41.953 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.932+0000 7fdfb6ffd700 1 --2- 172.21.15.125:0/4013406653 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fdfa006c4e0 0x7fdfa006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:41.953 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.933+0000 7fdfb6ffd700 1 --2- 172.21.15.125:0/4013406653 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fdfa006c4e0 0x7fdfa006e9a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0015040 tx=0x7fdfb0000f40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:41.956 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:41.937+0000 7fdf9ffff700 1 -- 172.21.15.125:0/4013406653 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fdfac059a90 con 0x7fdfb8101eb0 2024-02-19T19:00:42.223 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:42.204+0000 7fdfbd54e700 1 -- 172.21.15.125:0/4013406653 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fdfb81099d0 con 0x7fdfb8101eb0 2024-02-19T19:00:42.228 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:42.209+0000 7fdf9ffff700 1 -- 172.21.15.125:0/4013406653 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7fdfac059620 con 0x7fdfb8101eb0 2024-02-19T19:00:42.228 INFO:teuthology.orchestra.run.smithi125.stdout:[client.1] 2024-02-19T19:00:42.228 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQBapdNlXsJVDBAAyiv5zs8u0Itm+vCZr0AJJA== 2024-02-19T19:00:42.230 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:42.211+0000 7fdfbd54e700 1 -- 172.21.15.125:0/4013406653 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fdfa006c4e0 msgr2=0x7fdfa006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:42.230 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:42.211+0000 7fdfbd54e700 1 --2- 172.21.15.125:0/4013406653 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fdfa006c4e0 0x7fdfa006e9a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0015040 tx=0x7fdfb0000f40 comp rx=0 tx=0).stop 2024-02-19T19:00:42.230 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:42.211+0000 7fdfbd54e700 1 -- 172.21.15.125:0/4013406653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfb8101eb0 msgr2=0x7fdfb8196ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:42.230 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:42.211+0000 7fdfbd54e700 1 --2- 172.21.15.125:0/4013406653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfb8101eb0 0x7fdfb8196ad0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00d8d0 tx=0x7fdfac00dc90 comp rx=0 tx=0).stop 2024-02-19T19:00:42.230 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:42.211+0000 7fdfbd54e700 1 -- 172.21.15.125:0/4013406653 shutdown_connections 2024-02-19T19:00:42.230 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:42.211+0000 7fdfbd54e700 1 --2- 172.21.15.125:0/4013406653 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fdfa006c4e0 0x7fdfa006e9a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:42.231 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:42.211+0000 7fdfbd54e700 1 --2- 172.21.15.125:0/4013406653 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfb8100cb0 0x7fdfb8196590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:42.231 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:42.211+0000 7fdfbd54e700 1 --2- 172.21.15.125:0/4013406653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfb8101eb0 0x7fdfb8196ad0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:42.231 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:42.211+0000 7fdfbd54e700 1 -- 172.21.15.125:0/4013406653 >> 172.21.15.125:0/4013406653 conn(0x7fdfb80fc230 msgr2=0x7fdfb81050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:42.231 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:42.211+0000 7fdfbd54e700 1 -- 172.21.15.125:0/4013406653 shutdown_connections 2024-02-19T19:00:42.231 INFO:teuthology.orchestra.run.smithi125.stderr:2024-02-19T19:00:42.211+0000 7fdfbd54e700 1 -- 172.21.15.125:0/4013406653 wait complete. 2024-02-19T19:00:42.825 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-02-19T19:00:42.825 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-19T19:00:42.825 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-19T19:00:42.868 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-19T19:00:42.868 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-19T19:00:42.868 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph mgr dump --format=json 2024-02-19T19:00:43.082 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:00:43.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:42 smithi125 ceph-mon[37556]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:43.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:42 smithi125 ceph-mon[37556]: from='client.? 172.21.15.125:0/4013406653' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T19:00:43.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:42 smithi125 ceph-mon[37556]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T19:00:43.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:42 smithi125 ceph-mon[37556]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-19T19:00:43.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:42 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:00:43.204 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:42 smithi096 ceph-mon[29216]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:43.204 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:42 smithi096 ceph-mon[29216]: from='client.? 172.21.15.125:0/4013406653' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T19:00:43.204 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:42 smithi096 ceph-mon[29216]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-19T19:00:43.204 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:42 smithi096 ceph-mon[29216]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-19T19:00:43.204 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:42 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:00:44.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.475+0000 7f35cb347700 1 -- 172.21.15.96:0/4187547030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35c4100750 msgr2=0x7f35c41047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:44.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.475+0000 7f35cb347700 1 --2- 172.21.15.96:0/4187547030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35c4100750 0x7f35c41047a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f35b4009910 tx=0x7f35b4009c20 comp rx=0 tx=0).stop 2024-02-19T19:00:44.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.475+0000 7f35cb347700 1 -- 172.21.15.96:0/4187547030 shutdown_connections 2024-02-19T19:00:44.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.475+0000 7f35cb347700 1 --2- 172.21.15.96:0/4187547030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35c4100750 0x7f35c41047a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:44.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.475+0000 7f35cb347700 1 --2- 172.21.15.96:0/4187547030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35c40ffda0 0x7f35c4100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:44.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.475+0000 7f35cb347700 1 -- 172.21.15.96:0/4187547030 >> 172.21.15.96:0/4187547030 conn(0x7f35c40fb650 msgr2=0x7f35c40fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:44.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.475+0000 7f35cb347700 1 -- 172.21.15.96:0/4187547030 shutdown_connections 2024-02-19T19:00:44.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.475+0000 7f35cb347700 1 -- 172.21.15.96:0/4187547030 wait complete. 2024-02-19T19:00:44.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.476+0000 7f35cb347700 1 Processor -- start 2024-02-19T19:00:44.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.476+0000 7f35cb347700 1 -- start start 2024-02-19T19:00:44.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.476+0000 7f35cb347700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35c40ffda0 0x7f35c419c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:44.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.476+0000 7f35cb347700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35c4100750 0x7f35c419cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:44.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.476+0000 7f35cb347700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c419d240 con 0x7f35c40ffda0 2024-02-19T19:00:44.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.476+0000 7f35cb347700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c41966f0 con 0x7f35c4100750 2024-02-19T19:00:44.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.476+0000 7f35c90e3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35c40ffda0 0x7f35c419c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:44.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.476+0000 7f35c90e3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35c40ffda0 0x7f35c419c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51576/0 (socket says 172.21.15.96:51576) 2024-02-19T19:00:44.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.476+0000 7f35c90e3700 1 -- 172.21.15.96:0/954548340 learned_addr learned my addr 172.21.15.96:0/954548340 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:00:44.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.476+0000 7f35c88e2700 1 --2- 172.21.15.96:0/954548340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35c4100750 0x7f35c419cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:44.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.476+0000 7f35c90e3700 1 -- 172.21.15.96:0/954548340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35c4100750 msgr2=0x7f35c419cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:44.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.476+0000 7f35c90e3700 1 --2- 172.21.15.96:0/954548340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35c4100750 0x7f35c419cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:44.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.476+0000 7f35c90e3700 1 -- 172.21.15.96:0/954548340 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b40095f0 con 0x7f35c40ffda0 2024-02-19T19:00:44.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.476+0000 7f35c88e2700 1 --2- 172.21.15.96:0/954548340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35c4100750 0x7f35c419cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:00:44.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.476+0000 7f35c90e3700 1 --2- 172.21.15.96:0/954548340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35c40ffda0 0x7f35c419c670 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f35c000d8d0 tx=0x7f35c000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:44.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.476+0000 7f35ba7fc700 1 -- 172.21.15.96:0/954548340 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35c0009940 con 0x7f35c40ffda0 2024-02-19T19:00:44.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.477+0000 7f35cb347700 1 -- 172.21.15.96:0/954548340 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c41969d0 con 0x7f35c40ffda0 2024-02-19T19:00:44.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.477+0000 7f35ba7fc700 1 -- 172.21.15.96:0/954548340 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f35c0010460 con 0x7f35c40ffda0 2024-02-19T19:00:44.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.477+0000 7f35ba7fc700 1 -- 172.21.15.96:0/954548340 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35c000f5f0 con 0x7f35c40ffda0 2024-02-19T19:00:44.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.477+0000 7f35cb347700 1 -- 172.21.15.96:0/954548340 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c4196f20 con 0x7f35c40ffda0 2024-02-19T19:00:44.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.477+0000 7f35cb347700 1 -- 172.21.15.96:0/954548340 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35c404f2e0 con 0x7f35c40ffda0 2024-02-19T19:00:44.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.478+0000 7f35ba7fc700 1 -- 172.21.15.96:0/954548340 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f35c00105d0 con 0x7f35c40ffda0 2024-02-19T19:00:44.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.478+0000 7f35ba7fc700 1 --2- 172.21.15.96:0/954548340 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f35b006c4e0 0x7f35b006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:44.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.478+0000 7f35ba7fc700 1 -- 172.21.15.96:0/954548340 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f35c008b4e0 con 0x7f35c40ffda0 2024-02-19T19:00:44.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.478+0000 7f35c88e2700 1 --2- 172.21.15.96:0/954548340 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f35b006c4e0 0x7f35b006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:44.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.479+0000 7f35c88e2700 1 --2- 172.21.15.96:0/954548340 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f35b006c4e0 0x7f35b006e9a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f35c4197b60 tx=0x7f35b401a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:44.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.483+0000 7f35ba7fc700 1 -- 172.21.15.96:0/954548340 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f35c0059a90 con 0x7f35c40ffda0 2024-02-19T19:00:44.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.724+0000 7f35cb347700 1 -- 172.21.15.96:0/954548340 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f35c4197170 con 0x7f35c40ffda0 2024-02-19T19:00:44.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.727+0000 7f35ba7fc700 1 -- 172.21.15.96:0/954548340 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+173035 (secure 0 0 0) 0x7f35c0059620 con 0x7f35c40ffda0 2024-02-19T19:00:44.748 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:00:44.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.730+0000 7f35cb347700 1 -- 172.21.15.96:0/954548340 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f35b006c4e0 msgr2=0x7f35b006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:44.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.730+0000 7f35cb347700 1 --2- 172.21.15.96:0/954548340 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f35b006c4e0 0x7f35b006e9a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f35c4197b60 tx=0x7f35b401a040 comp rx=0 tx=0).stop 2024-02-19T19:00:44.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.730+0000 7f35cb347700 1 -- 172.21.15.96:0/954548340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35c40ffda0 msgr2=0x7f35c419c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:44.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.730+0000 7f35cb347700 1 --2- 172.21.15.96:0/954548340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35c40ffda0 0x7f35c419c670 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f35c000d8d0 tx=0x7f35c000dc90 comp rx=0 tx=0).stop 2024-02-19T19:00:44.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.730+0000 7f35cb347700 1 -- 172.21.15.96:0/954548340 shutdown_connections 2024-02-19T19:00:44.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.730+0000 7f35cb347700 1 --2- 172.21.15.96:0/954548340 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f35b006c4e0 0x7f35b006e9a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:44.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.730+0000 7f35cb347700 1 --2- 172.21.15.96:0/954548340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35c40ffda0 0x7f35c419c670 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:44.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.730+0000 7f35cb347700 1 --2- 172.21.15.96:0/954548340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35c4100750 0x7f35c419cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:44.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.730+0000 7f35cb347700 1 -- 172.21.15.96:0/954548340 >> 172.21.15.96:0/954548340 conn(0x7f35c40fb650 msgr2=0x7f35c4103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:44.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.730+0000 7f35cb347700 1 -- 172.21.15.96:0/954548340 shutdown_connections 2024-02-19T19:00:44.750 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:44.730+0000 7f35cb347700 1 -- 172.21.15.96:0/954548340 wait complete. 2024-02-19T19:00:45.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:44 smithi096 ceph-mon[29216]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:45.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:44 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/954548340' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-19T19:00:45.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:44 smithi125 ceph-mon[37556]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:45.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:44 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/954548340' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-19T19:00:45.488 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":19,"active_gid":14223,"active_name":"smithi096.zsjdff","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":664869387},{"type":"v1","addr":"172.21.15.96:6801","nonce":664869387}]},"active_addr":"172.21.15.96:6801/664869387","active_change":"2024-02-19T18:56:57.759932+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14248,"name":"smithi125.ygdmdu","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.96:8443/","prometheus":"http://172.21.15.96:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":3107913807}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":1723107272}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":1504142982}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":580326503}]}]} 2024-02-19T19:00:45.492 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-19T19:00:45.493 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-19T19:00:45.493 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph osd dump --format=json 2024-02-19T19:00:45.698 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:00:46.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:46 smithi125 ceph-mon[37556]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:46.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:46 smithi096 ceph-mon[29216]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:47.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.235+0000 7f2581a74700 1 -- 172.21.15.96:0/3414365488 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f257c0ffc20 msgr2=0x7f257c100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:47.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.235+0000 7f2581a74700 1 --2- 172.21.15.96:0/3414365488 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f257c0ffc20 0x7f257c100080 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2564009910 tx=0x7f2564009c20 comp rx=0 tx=0).stop 2024-02-19T19:00:47.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.235+0000 7f2581a74700 1 -- 172.21.15.96:0/3414365488 shutdown_connections 2024-02-19T19:00:47.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.235+0000 7f2581a74700 1 --2- 172.21.15.96:0/3414365488 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f257c0ffc20 0x7f257c100080 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:47.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.235+0000 7f2581a74700 1 --2- 172.21.15.96:0/3414365488 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f257c105bd0 0x7f257c105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:47.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.235+0000 7f2581a74700 1 -- 172.21.15.96:0/3414365488 >> 172.21.15.96:0/3414365488 conn(0x7f257c075670 msgr2=0x7f257c075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:47.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.235+0000 7f2581a74700 1 -- 172.21.15.96:0/3414365488 shutdown_connections 2024-02-19T19:00:47.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.236+0000 7f2581a74700 1 -- 172.21.15.96:0/3414365488 wait complete. 2024-02-19T19:00:47.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.236+0000 7f2581a74700 1 Processor -- start 2024-02-19T19:00:47.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.236+0000 7f2581a74700 1 -- start start 2024-02-19T19:00:47.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.236+0000 7f2581a74700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f257c0ffc20 0x7f257c19c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:47.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.236+0000 7f2581a74700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f257c105bd0 0x7f257c19cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:47.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.236+0000 7f2581a74700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c19d260 con 0x7f257c105bd0 2024-02-19T19:00:47.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.236+0000 7f2581a74700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257c196710 con 0x7f257c0ffc20 2024-02-19T19:00:47.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.237+0000 7f2572ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f257c105bd0 0x7f257c19cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:47.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.237+0000 7f2572ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f257c105bd0 0x7f257c19cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51598/0 (socket says 172.21.15.96:51598) 2024-02-19T19:00:47.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.237+0000 7f2572ffd700 1 -- 172.21.15.96:0/3402855331 learned_addr learned my addr 172.21.15.96:0/3402855331 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:00:47.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.237+0000 7f257b7fe700 1 --2- 172.21.15.96:0/3402855331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f257c0ffc20 0x7f257c19c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:47.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.237+0000 7f2572ffd700 1 -- 172.21.15.96:0/3402855331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f257c0ffc20 msgr2=0x7f257c19c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:47.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.237+0000 7f2572ffd700 1 --2- 172.21.15.96:0/3402855331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f257c0ffc20 0x7f257c19c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:47.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.237+0000 7f2572ffd700 1 -- 172.21.15.96:0/3402855331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25640095f0 con 0x7f257c105bd0 2024-02-19T19:00:47.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.237+0000 7f2572ffd700 1 --2- 172.21.15.96:0/3402855331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f257c105bd0 0x7f257c19cbd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2564006010 tx=0x7f256400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:47.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.237+0000 7f25797fa700 1 -- 172.21.15.96:0/3402855331 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f256401d070 con 0x7f257c105bd0 2024-02-19T19:00:47.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.237+0000 7f2581a74700 1 -- 172.21.15.96:0/3402855331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257c196990 con 0x7f257c105bd0 2024-02-19T19:00:47.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.237+0000 7f25797fa700 1 -- 172.21.15.96:0/3402855331 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2564004fa0 con 0x7f257c105bd0 2024-02-19T19:00:47.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.237+0000 7f25797fa700 1 -- 172.21.15.96:0/3402855331 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f256400f690 con 0x7f257c105bd0 2024-02-19T19:00:47.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.237+0000 7f2581a74700 1 -- 172.21.15.96:0/3402855331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257c196e80 con 0x7f257c105bd0 2024-02-19T19:00:47.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.238+0000 7f2581a74700 1 -- 172.21.15.96:0/3402855331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257c04f2e0 con 0x7f257c105bd0 2024-02-19T19:00:47.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.239+0000 7f25797fa700 1 -- 172.21.15.96:0/3402855331 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f2564022470 con 0x7f257c105bd0 2024-02-19T19:00:47.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.239+0000 7f25797fa700 1 --2- 172.21.15.96:0/3402855331 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f256806c4e0 0x7f256806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:47.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.239+0000 7f25797fa700 1 -- 172.21.15.96:0/3402855331 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f256408cc60 con 0x7f257c105bd0 2024-02-19T19:00:47.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.239+0000 7f257b7fe700 1 --2- 172.21.15.96:0/3402855331 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f256806c4e0 0x7f256806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:47.261 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.239+0000 7f257b7fe700 1 --2- 172.21.15.96:0/3402855331 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f256806c4e0 0x7f256806e9a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f256c009a10 tx=0x7f256c009190 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:47.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.244+0000 7f25797fa700 1 -- 172.21.15.96:0/3402855331 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f256405b330 con 0x7f257c105bd0 2024-02-19T19:00:47.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.432+0000 7f2581a74700 1 -- 172.21.15.96:0/3402855331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f257c197c20 con 0x7f257c105bd0 2024-02-19T19:00:47.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.433+0000 7f25797fa700 1 -- 172.21.15.96:0/3402855331 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11349 (secure 0 0 0) 0x7f2564027090 con 0x7f257c105bd0 2024-02-19T19:00:47.452 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:00:47.452 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":40,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","created":"2024-02-19T18:54:33.002577+0000","modified":"2024-02-19T19:00:28.899441+0000","last_up_change":"2024-02-19T19:00:27.894969+0000","last_in_change":"2024-02-19T19:00:08.695793+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T18:59:14.096877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c8d3e948-3736-431e-9ccd-18d3d1af342a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1987555426},{"type":"v1","addr":"172.21.15.96:6803","nonce":1987555426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1987555426},{"type":"v1","addr":"172.21.15.96:6805","nonce":1987555426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1987555426},{"type":"v1","addr":"172.21.15.96:6809","nonce":1987555426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1987555426},{"type":"v1","addr":"172.21.15.96:6807","nonce":1987555426}]},"public_addr":"172.21.15.96:6803/1987555426","cluster_addr":"172.21.15.96:6805/1987555426","heartbeat_back_addr":"172.21.15.96:6809/1987555426","heartbeat_front_addr":"172.21.15.96:6807/1987555426","state":["exists","up"]},{"osd":1,"uuid":"012aa0e0-d3ed-4b27-9e5e-fd667e4523ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3386518204},{"type":"v1","addr":"172.21.15.96:6811","nonce":3386518204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3386518204},{"type":"v1","addr":"172.21.15.96:6813","nonce":3386518204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3386518204},{"type":"v1","addr":"172.21.15.96:6817","nonce":3386518204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3386518204},{"type":"v1","addr":"172.21.15.96:6815","nonce":3386518204}]},"public_addr":"172.21.15.96:6811/3386518204","cluster_addr":"172.21.15.96:6813/3386518204","heartbeat_back_addr":"172.21.15.96:6817/3386518204","heartbeat_front_addr":"172.21.15.96:6815/3386518204","state":["exists","up"]},{"osd":2,"uuid":"3bf17dab-3c04-4ed0-8edf-45a217a52d0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3117123037},{"type":"v1","addr":"172.21.15.96:6819","nonce":3117123037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3117123037},{"type":"v1","addr":"172.21.15.96:6821","nonce":3117123037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3117123037},{"type":"v1","addr":"172.21.15.96:6825","nonce":3117123037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3117123037},{"type":"v1","addr":"172.21.15.96:6823","nonce":3117123037}]},"public_addr":"172.21.15.96:6819/3117123037","cluster_addr":"172.21.15.96:6821/3117123037","heartbeat_back_addr":"172.21.15.96:6825/3117123037","heartbeat_front_addr":"172.21.15.96:6823/3117123037","state":["exists","up"]},{"osd":3,"uuid":"fa80c0e4-7d1a-4e41-9455-b576cbcac572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6801","nonce":3311295426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6803","nonce":3311295426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6807","nonce":3311295426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6805","nonce":3311295426}]},"public_addr":"172.21.15.125:6801/3311295426","cluster_addr":"172.21.15.125:6803/3311295426","heartbeat_back_addr":"172.21.15.125:6807/3311295426","heartbeat_front_addr":"172.21.15.125:6805/3311295426","state":["exists","up"]},{"osd":4,"uuid":"9363cacc-c727-4282-a50f-e123f625e13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6809","nonce":1210532750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6811","nonce":1210532750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6815","nonce":1210532750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6813","nonce":1210532750}]},"public_addr":"172.21.15.125:6809/1210532750","cluster_addr":"172.21.15.125:6811/1210532750","heartbeat_back_addr":"172.21.15.125:6815/1210532750","heartbeat_front_addr":"172.21.15.125:6813/1210532750","state":["exists","up"]},{"osd":5,"uuid":"93d869ce-2537-4913-8373-1db93ffdd67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6817","nonce":2708085722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6819","nonce":2708085722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6823","nonce":2708085722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6821","nonce":2708085722}]},"public_addr":"172.21.15.125:6817/2708085722","cluster_addr":"172.21.15.125:6819/2708085722","heartbeat_back_addr":"172.21.15.125:6823/2708085722","heartbeat_front_addr":"172.21.15.125:6821/2708085722","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:58:16.075448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:58:43.787873+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:59:11.561163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:59:35.893197+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T19:00:00.837738+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T19:00:25.890961+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/3018792068":"2024-02-20T18:56:57.759773+0000","172.21.15.96:6801/3628131135":"2024-02-20T18:56:57.759773+0000","172.21.15.96:6800/3628131135":"2024-02-20T18:56:57.759773+0000","172.21.15.96:6801/3697355606":"2024-02-20T18:55:36.280962+0000","172.21.15.96:0/561831206":"2024-02-20T18:56:57.759773+0000","172.21.15.96:6800/3697355606":"2024-02-20T18:55:36.280962+0000","172.21.15.96:0/4153792828":"2024-02-20T18:56:57.759773+0000","172.21.15.96:0/1844984401":"2024-02-20T18:55:36.280962+0000","172.21.15.96:6801/1286321532":"2024-02-20T18:55:03.067702+0000","172.21.15.96:6800/1286321532":"2024-02-20T18:55:03.067702+0000","172.21.15.96:0/2093229384":"2024-02-20T18:55:36.280962+0000","172.21.15.96:0/2493593498":"2024-02-20T18:55:36.280962+0000","172.21.15.96:0/3563912069":"2024-02-20T18:55:03.067702+0000","172.21.15.96:0/782865038":"2024-02-20T18:55:03.067702+0000","172.21.15.96:0/1543256561":"2024-02-20T18:55:03.067702+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T19:00:47.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.435+0000 7f2581a74700 1 -- 172.21.15.96:0/3402855331 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f256806c4e0 msgr2=0x7f256806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:47.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.435+0000 7f2581a74700 1 --2- 172.21.15.96:0/3402855331 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f256806c4e0 0x7f256806e9a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f256c009a10 tx=0x7f256c009190 comp rx=0 tx=0).stop 2024-02-19T19:00:47.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.435+0000 7f2581a74700 1 -- 172.21.15.96:0/3402855331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f257c105bd0 msgr2=0x7f257c19cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:47.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.435+0000 7f2581a74700 1 --2- 172.21.15.96:0/3402855331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f257c105bd0 0x7f257c19cbd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2564006010 tx=0x7f256400bd70 comp rx=0 tx=0).stop 2024-02-19T19:00:47.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.435+0000 7f2581a74700 1 -- 172.21.15.96:0/3402855331 shutdown_connections 2024-02-19T19:00:47.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.435+0000 7f2581a74700 1 --2- 172.21.15.96:0/3402855331 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f256806c4e0 0x7f256806e9a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:47.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.435+0000 7f2581a74700 1 --2- 172.21.15.96:0/3402855331 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f257c0ffc20 0x7f257c19c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:47.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.435+0000 7f2581a74700 1 --2- 172.21.15.96:0/3402855331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f257c105bd0 0x7f257c19cbd0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:47.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.435+0000 7f2581a74700 1 -- 172.21.15.96:0/3402855331 >> 172.21.15.96:0/3402855331 conn(0x7f257c075670 msgr2=0x7f257c068620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:47.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.435+0000 7f2581a74700 1 -- 172.21.15.96:0/3402855331 shutdown_connections 2024-02-19T19:00:47.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:47.435+0000 7f2581a74700 1 -- 172.21.15.96:0/3402855331 wait complete. 2024-02-19T19:00:47.739 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:47 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/3402855331' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T19:00:47.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:47 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/3402855331' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T19:00:48.011 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-19T19:00:48.011 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph osd dump --format=json 2024-02-19T19:00:48.217 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:00:48.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:48 smithi096 ceph-mon[29216]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:48.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:48 smithi125 ceph-mon[37556]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:49.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.698+0000 7f97e2149700 1 -- 172.21.15.96:0/485112714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97dc106cd0 msgr2=0x7f97dc1070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:49.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.698+0000 7f97e2149700 1 --2- 172.21.15.96:0/485112714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97dc106cd0 0x7f97dc1070b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f97d400b0a0 tx=0x7f97d400b3b0 comp rx=0 tx=0).stop 2024-02-19T19:00:49.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.698+0000 7f97e2149700 1 -- 172.21.15.96:0/485112714 shutdown_connections 2024-02-19T19:00:49.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.698+0000 7f97e2149700 1 --2- 172.21.15.96:0/485112714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97dc068580 0x7f97dc0689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:49.717 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.698+0000 7f97e2149700 1 --2- 172.21.15.96:0/485112714 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97dc106cd0 0x7f97dc1070b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:49.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.698+0000 7f97e2149700 1 -- 172.21.15.96:0/485112714 >> 172.21.15.96:0/485112714 conn(0x7f97dc075670 msgr2=0x7f97dc075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:49.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.698+0000 7f97e2149700 1 -- 172.21.15.96:0/485112714 shutdown_connections 2024-02-19T19:00:49.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.698+0000 7f97e2149700 1 -- 172.21.15.96:0/485112714 wait complete. 2024-02-19T19:00:49.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.699+0000 7f97e2149700 1 Processor -- start 2024-02-19T19:00:49.718 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.699+0000 7f97e2149700 1 -- start start 2024-02-19T19:00:49.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.699+0000 7f97e2149700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97dc068580 0x7f97dc196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:49.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.699+0000 7f97e2149700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97dc106cd0 0x7f97dc196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:49.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.699+0000 7f97e2149700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc197550 con 0x7f97dc068580 2024-02-19T19:00:49.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.699+0000 7f97e2149700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc19b360 con 0x7f97dc106cd0 2024-02-19T19:00:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.699+0000 7f97db7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97dc068580 0x7f97dc196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.699+0000 7f97db7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97dc068580 0x7f97dc196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51604/0 (socket says 172.21.15.96:51604) 2024-02-19T19:00:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.699+0000 7f97db7fe700 1 -- 172.21.15.96:0/62803321 learned_addr learned my addr 172.21.15.96:0/62803321 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:00:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.700+0000 7f97daffd700 1 --2- 172.21.15.96:0/62803321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97dc106cd0 0x7f97dc196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.700+0000 7f97db7fe700 1 -- 172.21.15.96:0/62803321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97dc106cd0 msgr2=0x7f97dc196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.700+0000 7f97db7fe700 1 --2- 172.21.15.96:0/62803321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97dc106cd0 0x7f97dc196ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.700+0000 7f97db7fe700 1 -- 172.21.15.96:0/62803321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d4009d00 con 0x7f97dc068580 2024-02-19T19:00:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.700+0000 7f97db7fe700 1 --2- 172.21.15.96:0/62803321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97dc068580 0x7f97dc196980 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f97d4000f80 tx=0x7f97d400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.700+0000 7f97d8ff9700 1 -- 172.21.15.96:0/62803321 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97d400e040 con 0x7f97dc068580 2024-02-19T19:00:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.700+0000 7f97e2149700 1 -- 172.21.15.96:0/62803321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97dc19b5e0 con 0x7f97dc068580 2024-02-19T19:00:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.700+0000 7f97d8ff9700 1 -- 172.21.15.96:0/62803321 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f97d40044f0 con 0x7f97dc068580 2024-02-19T19:00:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.700+0000 7f97e2149700 1 -- 172.21.15.96:0/62803321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97dc19bad0 con 0x7f97dc068580 2024-02-19T19:00:49.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.700+0000 7f97d8ff9700 1 -- 172.21.15.96:0/62803321 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97d401d9f0 con 0x7f97dc068580 2024-02-19T19:00:49.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.701+0000 7f97e2149700 1 -- 172.21.15.96:0/62803321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97dc1091f0 con 0x7f97dc068580 2024-02-19T19:00:49.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.701+0000 7f97d8ff9700 1 -- 172.21.15.96:0/62803321 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f97d4004660 con 0x7f97dc068580 2024-02-19T19:00:49.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.702+0000 7f97d8ff9700 1 --2- 172.21.15.96:0/62803321 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f97c406c4e0 0x7f97c406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:49.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.702+0000 7f97daffd700 1 --2- 172.21.15.96:0/62803321 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f97c406c4e0 0x7f97c406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:49.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.702+0000 7f97d8ff9700 1 -- 172.21.15.96:0/62803321 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f97d408cf90 con 0x7f97dc068580 2024-02-19T19:00:49.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.702+0000 7f97daffd700 1 --2- 172.21.15.96:0/62803321 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f97c406c4e0 0x7f97c406e9a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f97d0006fd0 tx=0x7f97d0008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:49.725 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.706+0000 7f97d8ff9700 1 -- 172.21.15.96:0/62803321 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f97d405b540 con 0x7f97dc068580 2024-02-19T19:00:49.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.896+0000 7f97e2149700 1 -- 172.21.15.96:0/62803321 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97dc04f2e0 con 0x7f97dc068580 2024-02-19T19:00:49.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.897+0000 7f97d8ff9700 1 -- 172.21.15.96:0/62803321 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11349 (secure 0 0 0) 0x7f97d405b0d0 con 0x7f97dc068580 2024-02-19T19:00:49.915 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:00:49.916 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":40,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","created":"2024-02-19T18:54:33.002577+0000","modified":"2024-02-19T19:00:28.899441+0000","last_up_change":"2024-02-19T19:00:27.894969+0000","last_in_change":"2024-02-19T19:00:08.695793+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T18:59:14.096877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c8d3e948-3736-431e-9ccd-18d3d1af342a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1987555426},{"type":"v1","addr":"172.21.15.96:6803","nonce":1987555426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1987555426},{"type":"v1","addr":"172.21.15.96:6805","nonce":1987555426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1987555426},{"type":"v1","addr":"172.21.15.96:6809","nonce":1987555426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1987555426},{"type":"v1","addr":"172.21.15.96:6807","nonce":1987555426}]},"public_addr":"172.21.15.96:6803/1987555426","cluster_addr":"172.21.15.96:6805/1987555426","heartbeat_back_addr":"172.21.15.96:6809/1987555426","heartbeat_front_addr":"172.21.15.96:6807/1987555426","state":["exists","up"]},{"osd":1,"uuid":"012aa0e0-d3ed-4b27-9e5e-fd667e4523ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3386518204},{"type":"v1","addr":"172.21.15.96:6811","nonce":3386518204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3386518204},{"type":"v1","addr":"172.21.15.96:6813","nonce":3386518204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3386518204},{"type":"v1","addr":"172.21.15.96:6817","nonce":3386518204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3386518204},{"type":"v1","addr":"172.21.15.96:6815","nonce":3386518204}]},"public_addr":"172.21.15.96:6811/3386518204","cluster_addr":"172.21.15.96:6813/3386518204","heartbeat_back_addr":"172.21.15.96:6817/3386518204","heartbeat_front_addr":"172.21.15.96:6815/3386518204","state":["exists","up"]},{"osd":2,"uuid":"3bf17dab-3c04-4ed0-8edf-45a217a52d0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3117123037},{"type":"v1","addr":"172.21.15.96:6819","nonce":3117123037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3117123037},{"type":"v1","addr":"172.21.15.96:6821","nonce":3117123037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3117123037},{"type":"v1","addr":"172.21.15.96:6825","nonce":3117123037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3117123037},{"type":"v1","addr":"172.21.15.96:6823","nonce":3117123037}]},"public_addr":"172.21.15.96:6819/3117123037","cluster_addr":"172.21.15.96:6821/3117123037","heartbeat_back_addr":"172.21.15.96:6825/3117123037","heartbeat_front_addr":"172.21.15.96:6823/3117123037","state":["exists","up"]},{"osd":3,"uuid":"fa80c0e4-7d1a-4e41-9455-b576cbcac572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6801","nonce":3311295426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6803","nonce":3311295426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6807","nonce":3311295426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6805","nonce":3311295426}]},"public_addr":"172.21.15.125:6801/3311295426","cluster_addr":"172.21.15.125:6803/3311295426","heartbeat_back_addr":"172.21.15.125:6807/3311295426","heartbeat_front_addr":"172.21.15.125:6805/3311295426","state":["exists","up"]},{"osd":4,"uuid":"9363cacc-c727-4282-a50f-e123f625e13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6809","nonce":1210532750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6811","nonce":1210532750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6815","nonce":1210532750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6813","nonce":1210532750}]},"public_addr":"172.21.15.125:6809/1210532750","cluster_addr":"172.21.15.125:6811/1210532750","heartbeat_back_addr":"172.21.15.125:6815/1210532750","heartbeat_front_addr":"172.21.15.125:6813/1210532750","state":["exists","up"]},{"osd":5,"uuid":"93d869ce-2537-4913-8373-1db93ffdd67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6817","nonce":2708085722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6819","nonce":2708085722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6823","nonce":2708085722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6821","nonce":2708085722}]},"public_addr":"172.21.15.125:6817/2708085722","cluster_addr":"172.21.15.125:6819/2708085722","heartbeat_back_addr":"172.21.15.125:6823/2708085722","heartbeat_front_addr":"172.21.15.125:6821/2708085722","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:58:16.075448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:58:43.787873+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:59:11.561163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:59:35.893197+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T19:00:00.837738+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T19:00:25.890961+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/3018792068":"2024-02-20T18:56:57.759773+0000","172.21.15.96:6801/3628131135":"2024-02-20T18:56:57.759773+0000","172.21.15.96:6800/3628131135":"2024-02-20T18:56:57.759773+0000","172.21.15.96:6801/3697355606":"2024-02-20T18:55:36.280962+0000","172.21.15.96:0/561831206":"2024-02-20T18:56:57.759773+0000","172.21.15.96:6800/3697355606":"2024-02-20T18:55:36.280962+0000","172.21.15.96:0/4153792828":"2024-02-20T18:56:57.759773+0000","172.21.15.96:0/1844984401":"2024-02-20T18:55:36.280962+0000","172.21.15.96:6801/1286321532":"2024-02-20T18:55:03.067702+0000","172.21.15.96:6800/1286321532":"2024-02-20T18:55:03.067702+0000","172.21.15.96:0/2093229384":"2024-02-20T18:55:36.280962+0000","172.21.15.96:0/2493593498":"2024-02-20T18:55:36.280962+0000","172.21.15.96:0/3563912069":"2024-02-20T18:55:03.067702+0000","172.21.15.96:0/782865038":"2024-02-20T18:55:03.067702+0000","172.21.15.96:0/1543256561":"2024-02-20T18:55:03.067702+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T19:00:49.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.899+0000 7f97e2149700 1 -- 172.21.15.96:0/62803321 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f97c406c4e0 msgr2=0x7f97c406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:49.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.899+0000 7f97e2149700 1 --2- 172.21.15.96:0/62803321 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f97c406c4e0 0x7f97c406e9a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f97d0006fd0 tx=0x7f97d0008040 comp rx=0 tx=0).stop 2024-02-19T19:00:49.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.899+0000 7f97e2149700 1 -- 172.21.15.96:0/62803321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97dc068580 msgr2=0x7f97dc196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:49.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.899+0000 7f97e2149700 1 --2- 172.21.15.96:0/62803321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97dc068580 0x7f97dc196980 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f97d4000f80 tx=0x7f97d400cdb0 comp rx=0 tx=0).stop 2024-02-19T19:00:49.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.899+0000 7f97e2149700 1 -- 172.21.15.96:0/62803321 shutdown_connections 2024-02-19T19:00:49.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.899+0000 7f97e2149700 1 --2- 172.21.15.96:0/62803321 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f97c406c4e0 0x7f97c406e9a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:49.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.899+0000 7f97e2149700 1 --2- 172.21.15.96:0/62803321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97dc068580 0x7f97dc196980 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:49.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.899+0000 7f97e2149700 1 --2- 172.21.15.96:0/62803321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97dc106cd0 0x7f97dc196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:49.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.899+0000 7f97e2149700 1 -- 172.21.15.96:0/62803321 >> 172.21.15.96:0/62803321 conn(0x7f97dc075670 msgr2=0x7f97dc0fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:49.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.899+0000 7f97e2149700 1 -- 172.21.15.96:0/62803321 shutdown_connections 2024-02-19T19:00:49.918 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:49.899+0000 7f97e2149700 1 -- 172.21.15.96:0/62803321 wait complete. 2024-02-19T19:00:50.637 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-19T19:00:50.637 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-19T19:00:50.637 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-19T19:00:50.638 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-19T19:00:50.638 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-19T19:00:50.639 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-19T19:00:50.958 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:00:51.042 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:00:51.139 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:50 smithi096 ceph-mon[29216]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:51.139 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:50 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/62803321' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T19:00:51.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:50 smithi125 ceph-mon[37556]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:51.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:50 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/62803321' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T19:00:51.876 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:00:51.877 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:00:51.879 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:00:51.880 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:00:53.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:52 smithi096 ceph-mon[29216]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:53.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:52 smithi125 ceph-mon[37556]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:55.031 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:54 smithi096 ceph-mon[29216]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:55.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:54 smithi125 ceph-mon[37556]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:55.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.449+0000 7ff38081f700 1 -- 172.21.15.96:0/1846405394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff37c105bd0 msgr2=0x7ff37c105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:55.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.449+0000 7ff38081f700 1 --2- 172.21.15.96:0/1846405394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff37c105bd0 0x7ff37c105fb0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff36c009910 tx=0x7ff36c009c20 comp rx=0 tx=0).stop 2024-02-19T19:00:55.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.449+0000 7ff38081f700 1 -- 172.21.15.96:0/1846405394 shutdown_connections 2024-02-19T19:00:55.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.449+0000 7ff38081f700 1 --2- 172.21.15.96:0/1846405394 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff37c0ffc20 0x7ff37c100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:55.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.449+0000 7ff38081f700 1 --2- 172.21.15.96:0/1846405394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff37c105bd0 0x7ff37c105fb0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:55.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.449+0000 7ff38081f700 1 -- 172.21.15.96:0/1846405394 >> 172.21.15.96:0/1846405394 conn(0x7ff37c075670 msgr2=0x7ff37c075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:55.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.449+0000 7ff38081f700 1 -- 172.21.15.96:0/1846405394 shutdown_connections 2024-02-19T19:00:55.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.449+0000 7ff38081f700 1 -- 172.21.15.96:0/1846405394 wait complete. 2024-02-19T19:00:55.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.450+0000 7ff38081f700 1 Processor -- start 2024-02-19T19:00:55.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.450+0000 7ff38081f700 1 -- start start 2024-02-19T19:00:55.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.451+0000 7ff38081f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff37c0ffc20 0x7ff37c19b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:55.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.451+0000 7ff38081f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff37c105bd0 0x7ff37c19bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:55.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.451+0000 7ff38081f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c195620 con 0x7ff37c105bd0 2024-02-19T19:00:55.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.451+0000 7ff38081f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c195790 con 0x7ff37c0ffc20 2024-02-19T19:00:55.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.451+0000 7ff379d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff37c105bd0 0x7ff37c19bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:55.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.451+0000 7ff379d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff37c105bd0 0x7ff37c19bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43876/0 (socket says 172.21.15.96:43876) 2024-02-19T19:00:55.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.451+0000 7ff379d9b700 1 -- 172.21.15.96:0/3948735758 learned_addr learned my addr 172.21.15.96:0/3948735758 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:00:55.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.451+0000 7ff37a59c700 1 --2- 172.21.15.96:0/3948735758 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff37c0ffc20 0x7ff37c19b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:55.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.451+0000 7ff379d9b700 1 -- 172.21.15.96:0/3948735758 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff37c0ffc20 msgr2=0x7ff37c19b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:55.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.451+0000 7ff379d9b700 1 --2- 172.21.15.96:0/3948735758 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff37c0ffc20 0x7ff37c19b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:55.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.451+0000 7ff379d9b700 1 -- 172.21.15.96:0/3948735758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c0095f0 con 0x7ff37c105bd0 2024-02-19T19:00:55.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.451+0000 7ff37a59c700 1 --2- 172.21.15.96:0/3948735758 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff37c0ffc20 0x7ff37c19b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:00:55.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.451+0000 7ff379d9b700 1 --2- 172.21.15.96:0/3948735758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff37c105bd0 0x7ff37c19bb70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff37000d960 tx=0x7ff37000dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:55.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.451+0000 7ff36b7fe700 1 -- 172.21.15.96:0/3948735758 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff37000ec20 con 0x7ff37c105bd0 2024-02-19T19:00:55.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.451+0000 7ff38081f700 1 -- 172.21.15.96:0/3948735758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff37c195a10 con 0x7ff37c105bd0 2024-02-19T19:00:55.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.451+0000 7ff38081f700 1 -- 172.21.15.96:0/3948735758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37c195f60 con 0x7ff37c105bd0 2024-02-19T19:00:55.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.451+0000 7ff36b7fe700 1 -- 172.21.15.96:0/3948735758 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff37000ed80 con 0x7ff37c105bd0 2024-02-19T19:00:55.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.451+0000 7ff36b7fe700 1 -- 172.21.15.96:0/3948735758 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff37001f7e0 con 0x7ff37c105bd0 2024-02-19T19:00:55.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.452+0000 7ff38081f700 1 -- 172.21.15.96:0/3948735758 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff35c000ff0 con 0x7ff37c105bd0 2024-02-19T19:00:55.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.453+0000 7ff36b7fe700 1 -- 172.21.15.96:0/3948735758 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7ff37001f940 con 0x7ff37c105bd0 2024-02-19T19:00:55.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.453+0000 7ff36b7fe700 1 --2- 172.21.15.96:0/3948735758 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff36406c4e0 0x7ff36406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:55.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.453+0000 7ff36b7fe700 1 -- 172.21.15.96:0/3948735758 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff37008d5b0 con 0x7ff37c105bd0 2024-02-19T19:00:55.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.453+0000 7ff37a59c700 1 --2- 172.21.15.96:0/3948735758 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff36406c4e0 0x7ff36406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:55.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.453+0000 7ff36b7fe700 1 --2- 172.21.15.96:0/3948735758 >> [v2:172.21.15.96:6810/3386518204,v1:172.21.15.96:6811/3386518204] conn(0x7ff3640721c0 0x7ff3640745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:55.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.453+0000 7ff36b7fe700 1 -- 172.21.15.96:0/3948735758 --> [v2:172.21.15.96:6810/3386518204,v1:172.21.15.96:6811/3386518204] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff364074c90 con 0x7ff3640721c0 2024-02-19T19:00:55.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.453+0000 7ff36b7fe700 1 -- 172.21.15.96:0/3948735758 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff37008da10 con 0x7ff37c105bd0 2024-02-19T19:00:55.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.454+0000 7ff37ad9d700 1 --2- 172.21.15.96:0/3948735758 >> [v2:172.21.15.96:6810/3386518204,v1:172.21.15.96:6811/3386518204] conn(0x7ff3640721c0 0x7ff3640745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:55.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.454+0000 7ff37a59c700 1 --2- 172.21.15.96:0/3948735758 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff36406c4e0 0x7ff36406e9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00b5c0 tx=0x7ff36c01a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:55.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.454+0000 7ff37ad9d700 1 --2- 172.21.15.96:0/3948735758 >> [v2:172.21.15.96:6810/3386518204,v1:172.21.15.96:6811/3386518204] conn(0x7ff3640721c0 0x7ff3640745e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:55.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.455+0000 7ff36b7fe700 1 -- 172.21.15.96:0/3948735758 <== osd.1 v2:172.21.15.96:6810/3386518204 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff364074c90 con 0x7ff3640721c0 2024-02-19T19:00:55.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.471+0000 7ff38081f700 1 -- 172.21.15.96:0/3948735758 --> [v2:172.21.15.96:6810/3386518204,v1:172.21.15.96:6811/3386518204] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff35c002ce0 con 0x7ff3640721c0 2024-02-19T19:00:55.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.471+0000 7ff36b7fe700 1 -- 172.21.15.96:0/3948735758 <== osd.1 v2:172.21.15.96:6810/3386518204 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff35c002ce0 con 0x7ff3640721c0 2024-02-19T19:00:55.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.471+0000 7ff38081f700 1 -- 172.21.15.96:0/3948735758 >> [v2:172.21.15.96:6810/3386518204,v1:172.21.15.96:6811/3386518204] conn(0x7ff3640721c0 msgr2=0x7ff3640745e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:55.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.471+0000 7ff38081f700 1 --2- 172.21.15.96:0/3948735758 >> [v2:172.21.15.96:6810/3386518204,v1:172.21.15.96:6811/3386518204] conn(0x7ff3640721c0 0x7ff3640745e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:55.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.471+0000 7ff38081f700 1 -- 172.21.15.96:0/3948735758 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff36406c4e0 msgr2=0x7ff36406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:55.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.471+0000 7ff38081f700 1 --2- 172.21.15.96:0/3948735758 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff36406c4e0 0x7ff36406e9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00b5c0 tx=0x7ff36c01a040 comp rx=0 tx=0).stop 2024-02-19T19:00:55.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.471+0000 7ff38081f700 1 -- 172.21.15.96:0/3948735758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff37c105bd0 msgr2=0x7ff37c19bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:55.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.471+0000 7ff38081f700 1 --2- 172.21.15.96:0/3948735758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff37c105bd0 0x7ff37c19bb70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff37000d960 tx=0x7ff37000dd20 comp rx=0 tx=0).stop 2024-02-19T19:00:55.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.471+0000 7ff38081f700 1 -- 172.21.15.96:0/3948735758 shutdown_connections 2024-02-19T19:00:55.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.471+0000 7ff38081f700 1 --2- 172.21.15.96:0/3948735758 >> [v2:172.21.15.96:6810/3386518204,v1:172.21.15.96:6811/3386518204] conn(0x7ff3640721c0 0x7ff3640745e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:55.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.471+0000 7ff38081f700 1 --2- 172.21.15.96:0/3948735758 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff36406c4e0 0x7ff36406e9a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:55.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.471+0000 7ff38081f700 1 --2- 172.21.15.96:0/3948735758 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff37c0ffc20 0x7ff37c19b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:55.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.471+0000 7ff38081f700 1 --2- 172.21.15.96:0/3948735758 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff37c105bd0 0x7ff37c19bb70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:55.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.471+0000 7ff38081f700 1 -- 172.21.15.96:0/3948735758 >> 172.21.15.96:0/3948735758 conn(0x7ff37c075670 msgr2=0x7ff37c0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:55.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.472+0000 7ff38081f700 1 -- 172.21.15.96:0/3948735758 shutdown_connections 2024-02-19T19:00:55.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:55.472+0000 7ff38081f700 1 -- 172.21.15.96:0/3948735758 wait complete. 2024-02-19T19:00:56.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:56 smithi096 ceph-mon[29216]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:56.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:56 smithi125 ceph-mon[37556]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:58.141 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:57 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:00:58.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:57 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:00:58.540 INFO:teuthology.orchestra.run.smithi096.stdout:60129542173 2024-02-19T19:00:58.541 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-19T19:00:58.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.715+0000 7f15cb211700 1 -- 172.21.15.96:0/2797306452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15c40ffc20 msgr2=0x7f15c4100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:58.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.715+0000 7f15cb211700 1 --2- 172.21.15.96:0/2797306452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15c40ffc20 0x7f15c4100080 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f15b0009910 tx=0x7f15b0009c20 comp rx=0 tx=0).stop 2024-02-19T19:00:58.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.715+0000 7f15cb211700 1 -- 172.21.15.96:0/2797306452 shutdown_connections 2024-02-19T19:00:58.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.715+0000 7f15cb211700 1 --2- 172.21.15.96:0/2797306452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15c40ffc20 0x7f15c4100080 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:58.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.715+0000 7f15cb211700 1 --2- 172.21.15.96:0/2797306452 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c4105bd0 0x7f15c4105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:58.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.715+0000 7f15cb211700 1 -- 172.21.15.96:0/2797306452 >> 172.21.15.96:0/2797306452 conn(0x7f15c4075670 msgr2=0x7f15c4075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:58.735 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.715+0000 7f15cb211700 1 -- 172.21.15.96:0/2797306452 shutdown_connections 2024-02-19T19:00:58.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.715+0000 7f15cb211700 1 -- 172.21.15.96:0/2797306452 wait complete. 2024-02-19T19:00:58.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.716+0000 7f15cb211700 1 Processor -- start 2024-02-19T19:00:58.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.716+0000 7f15cb211700 1 -- start start 2024-02-19T19:00:58.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.716+0000 7f15cb211700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c40ffc20 0x7f15c419c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:58.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.716+0000 7f15cb211700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15c4105bd0 0x7f15c419cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:58.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.716+0000 7f15cb211700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c419d230 con 0x7f15c4105bd0 2024-02-19T19:00:58.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.716+0000 7f15cb211700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c41966e0 con 0x7f15c40ffc20 2024-02-19T19:00:58.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.716+0000 7f15c3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15c4105bd0 0x7f15c419cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:58.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.716+0000 7f15c3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15c4105bd0 0x7f15c419cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43886/0 (socket says 172.21.15.96:43886) 2024-02-19T19:00:58.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.716+0000 7f15c3fff700 1 -- 172.21.15.96:0/924480137 learned_addr learned my addr 172.21.15.96:0/924480137 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:00:58.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.716+0000 7f15c8fad700 1 --2- 172.21.15.96:0/924480137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c40ffc20 0x7f15c419c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:58.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.716+0000 7f15c3fff700 1 -- 172.21.15.96:0/924480137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c40ffc20 msgr2=0x7f15c419c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:58.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.716+0000 7f15c3fff700 1 --2- 172.21.15.96:0/924480137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c40ffc20 0x7f15c419c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:58.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.716+0000 7f15c3fff700 1 -- 172.21.15.96:0/924480137 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b00095f0 con 0x7f15c4105bd0 2024-02-19T19:00:58.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.717+0000 7f15c3fff700 1 --2- 172.21.15.96:0/924480137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15c4105bd0 0x7f15c419cba0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f15b000fa00 tx=0x7f15b000fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:58.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.717+0000 7f15c1ffb700 1 -- 172.21.15.96:0/924480137 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15b001d070 con 0x7f15c4105bd0 2024-02-19T19:00:58.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.717+0000 7f15c1ffb700 1 -- 172.21.15.96:0/924480137 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f15b000fe90 con 0x7f15c4105bd0 2024-02-19T19:00:58.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.717+0000 7f15cb211700 1 -- 172.21.15.96:0/924480137 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c4196960 con 0x7f15c4105bd0 2024-02-19T19:00:58.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.717+0000 7f15c1ffb700 1 -- 172.21.15.96:0/924480137 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15b0022470 con 0x7f15c4105bd0 2024-02-19T19:00:58.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.717+0000 7f15cb211700 1 -- 172.21.15.96:0/924480137 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c4196e50 con 0x7f15c4105bd0 2024-02-19T19:00:58.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.718+0000 7f15cb211700 1 -- 172.21.15.96:0/924480137 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f15c410cfa0 con 0x7f15c4105bd0 2024-02-19T19:00:58.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.718+0000 7f15c1ffb700 1 -- 172.21.15.96:0/924480137 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f15b0003680 con 0x7f15c4105bd0 2024-02-19T19:00:58.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.719+0000 7f15c1ffb700 1 --2- 172.21.15.96:0/924480137 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f15b406c4e0 0x7f15b406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:58.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.719+0000 7f15c1ffb700 1 -- 172.21.15.96:0/924480137 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f15b008d100 con 0x7f15c4105bd0 2024-02-19T19:00:58.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.719+0000 7f15c8fad700 1 --2- 172.21.15.96:0/924480137 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f15b406c4e0 0x7f15b406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:58.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.719+0000 7f15c1ffb700 1 --2- 172.21.15.96:0/924480137 >> [v2:172.21.15.125:6800/3311295426,v1:172.21.15.125:6801/3311295426] conn(0x7f15b40721c0 0x7f15b40745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:58.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.719+0000 7f15c1ffb700 1 -- 172.21.15.96:0/924480137 --> [v2:172.21.15.125:6800/3311295426,v1:172.21.15.125:6801/3311295426] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15b4074c90 con 0x7f15b40721c0 2024-02-19T19:00:58.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.719+0000 7f15c1ffb700 1 -- 172.21.15.96:0/924480137 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15b008d560 con 0x7f15c4105bd0 2024-02-19T19:00:58.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.719+0000 7f15c97ae700 1 --2- 172.21.15.96:0/924480137 >> [v2:172.21.15.125:6800/3311295426,v1:172.21.15.125:6801/3311295426] conn(0x7f15b40721c0 0x7f15b40745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:58.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.719+0000 7f15c8fad700 1 --2- 172.21.15.96:0/924480137 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f15b406c4e0 0x7f15b406e9a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f15b8009c60 tx=0x7f15b8009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:58.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.720+0000 7f15c97ae700 1 --2- 172.21.15.96:0/924480137 >> [v2:172.21.15.125:6800/3311295426,v1:172.21.15.125:6801/3311295426] conn(0x7f15b40721c0 0x7f15b40745e0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:58.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.721+0000 7f15c1ffb700 1 -- 172.21.15.96:0/924480137 <== osd.3 v2:172.21.15.125:6800/3311295426 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f15b4074c90 con 0x7f15b40721c0 2024-02-19T19:00:58.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.736+0000 7f15cb211700 1 -- 172.21.15.96:0/924480137 --> [v2:172.21.15.125:6800/3311295426,v1:172.21.15.125:6801/3311295426] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f15c404f2e0 con 0x7f15b40721c0 2024-02-19T19:00:58.755 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.737+0000 7f15c1ffb700 1 -- 172.21.15.96:0/924480137 <== osd.3 v2:172.21.15.125:6800/3311295426 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f15c404f2e0 con 0x7f15b40721c0 2024-02-19T19:00:58.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.737+0000 7f15cb211700 1 -- 172.21.15.96:0/924480137 >> [v2:172.21.15.125:6800/3311295426,v1:172.21.15.125:6801/3311295426] conn(0x7f15b40721c0 msgr2=0x7f15b40745e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:58.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.737+0000 7f15cb211700 1 --2- 172.21.15.96:0/924480137 >> [v2:172.21.15.125:6800/3311295426,v1:172.21.15.125:6801/3311295426] conn(0x7f15b40721c0 0x7f15b40745e0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:58.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.737+0000 7f15cb211700 1 -- 172.21.15.96:0/924480137 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f15b406c4e0 msgr2=0x7f15b406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:58.756 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.737+0000 7f15cb211700 1 --2- 172.21.15.96:0/924480137 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f15b406c4e0 0x7f15b406e9a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f15b8009c60 tx=0x7f15b8009260 comp rx=0 tx=0).stop 2024-02-19T19:00:58.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.737+0000 7f15cb211700 1 -- 172.21.15.96:0/924480137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15c4105bd0 msgr2=0x7f15c419cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:58.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.737+0000 7f15cb211700 1 --2- 172.21.15.96:0/924480137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15c4105bd0 0x7f15c419cba0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f15b000fa00 tx=0x7f15b000fa30 comp rx=0 tx=0).stop 2024-02-19T19:00:58.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.737+0000 7f15cb211700 1 -- 172.21.15.96:0/924480137 shutdown_connections 2024-02-19T19:00:58.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.737+0000 7f15cb211700 1 --2- 172.21.15.96:0/924480137 >> [v2:172.21.15.125:6800/3311295426,v1:172.21.15.125:6801/3311295426] conn(0x7f15b40721c0 0x7f15b40745e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:58.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.737+0000 7f15cb211700 1 --2- 172.21.15.96:0/924480137 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f15b406c4e0 0x7f15b406e9a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:58.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.737+0000 7f15cb211700 1 --2- 172.21.15.96:0/924480137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15c40ffc20 0x7f15c419c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:58.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.737+0000 7f15cb211700 1 --2- 172.21.15.96:0/924480137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15c4105bd0 0x7f15c419cba0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:58.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.737+0000 7f15cb211700 1 -- 172.21.15.96:0/924480137 >> 172.21.15.96:0/924480137 conn(0x7f15c4075670 msgr2=0x7f15c40686a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:58.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.737+0000 7f15cb211700 1 -- 172.21.15.96:0/924480137 shutdown_connections 2024-02-19T19:00:58.757 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:58.737+0000 7f15cb211700 1 -- 172.21.15.96:0/924480137 wait complete. 2024-02-19T19:00:59.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:00:58 smithi125 ceph-mon[37556]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:59.216 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:00:58 smithi096 ceph-mon[29216]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:00:59.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.409+0000 7f0a5ff22700 1 -- 172.21.15.96:0/2712764015 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a580739d0 msgr2=0x7f0a5810cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:59.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.409+0000 7f0a5ff22700 1 --2- 172.21.15.96:0/2712764015 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a580739d0 0x7f0a5810cfc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009910 tx=0x7f0a48009c20 comp rx=0 tx=0).stop 2024-02-19T19:00:59.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.410+0000 7f0a5ff22700 1 -- 172.21.15.96:0/2712764015 shutdown_connections 2024-02-19T19:00:59.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.410+0000 7f0a5ff22700 1 --2- 172.21.15.96:0/2712764015 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a580739d0 0x7f0a5810cfc0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:59.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.410+0000 7f0a5ff22700 1 --2- 172.21.15.96:0/2712764015 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a580730b0 0x7f0a58073490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:59.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.410+0000 7f0a5ff22700 1 -- 172.21.15.96:0/2712764015 >> 172.21.15.96:0/2712764015 conn(0x7f0a580fc750 msgr2=0x7f0a580feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:59.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.410+0000 7f0a5ff22700 1 -- 172.21.15.96:0/2712764015 shutdown_connections 2024-02-19T19:00:59.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.410+0000 7f0a5ff22700 1 -- 172.21.15.96:0/2712764015 wait complete. 2024-02-19T19:00:59.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.410+0000 7f0a5ff22700 1 Processor -- start 2024-02-19T19:00:59.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.410+0000 7f0a5ff22700 1 -- start start 2024-02-19T19:00:59.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.410+0000 7f0a5ff22700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a580730b0 0x7f0a5819e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:59.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.410+0000 7f0a5ff22700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a580739d0 0x7f0a5819ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:59.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.410+0000 7f0a5ff22700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5819f3f0 con 0x7f0a580739d0 2024-02-19T19:00:59.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.410+0000 7f0a5ff22700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a581988a0 con 0x7f0a580730b0 2024-02-19T19:00:59.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.411+0000 7f0a5d4bd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a580739d0 0x7f0a5819ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:59.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.411+0000 7f0a5d4bd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a580739d0 0x7f0a5819ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43890/0 (socket says 172.21.15.96:43890) 2024-02-19T19:00:59.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.411+0000 7f0a5d4bd700 1 -- 172.21.15.96:0/1129368283 learned_addr learned my addr 172.21.15.96:0/1129368283 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:00:59.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.411+0000 7f0a5dcbe700 1 --2- 172.21.15.96:0/1129368283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a580730b0 0x7f0a5819e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:59.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.411+0000 7f0a5d4bd700 1 -- 172.21.15.96:0/1129368283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a580730b0 msgr2=0x7f0a5819e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:59.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.411+0000 7f0a5d4bd700 1 --2- 172.21.15.96:0/1129368283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a580730b0 0x7f0a5819e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:59.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.411+0000 7f0a5d4bd700 1 -- 172.21.15.96:0/1129368283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a480095f0 con 0x7f0a580739d0 2024-02-19T19:00:59.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.411+0000 7f0a5dcbe700 1 --2- 172.21.15.96:0/1129368283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a580730b0 0x7f0a5819e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:00:59.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.411+0000 7f0a5d4bd700 1 --2- 172.21.15.96:0/1129368283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a580739d0 0x7f0a5819ed60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0a48006010 tx=0x7f0a4800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:59.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.411+0000 7f0a4effd700 1 -- 172.21.15.96:0/1129368283 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a4801d070 con 0x7f0a580739d0 2024-02-19T19:00:59.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.411+0000 7f0a5ff22700 1 -- 172.21.15.96:0/1129368283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a58198b20 con 0x7f0a580739d0 2024-02-19T19:00:59.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.411+0000 7f0a4effd700 1 -- 172.21.15.96:0/1129368283 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0a48004f50 con 0x7f0a580739d0 2024-02-19T19:00:59.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.411+0000 7f0a4effd700 1 -- 172.21.15.96:0/1129368283 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a48021640 con 0x7f0a580739d0 2024-02-19T19:00:59.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.411+0000 7f0a5ff22700 1 -- 172.21.15.96:0/1129368283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a58199010 con 0x7f0a580739d0 2024-02-19T19:00:59.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.412+0000 7f0a5ff22700 1 -- 172.21.15.96:0/1129368283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0a581102d0 con 0x7f0a580739d0 2024-02-19T19:00:59.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.413+0000 7f0a4effd700 1 -- 172.21.15.96:0/1129368283 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f0a4800f460 con 0x7f0a580739d0 2024-02-19T19:00:59.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.413+0000 7f0a4effd700 1 --2- 172.21.15.96:0/1129368283 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f0a4406c4e0 0x7f0a4406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:59.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.413+0000 7f0a4effd700 1 -- 172.21.15.96:0/1129368283 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f0a4808c740 con 0x7f0a580739d0 2024-02-19T19:00:59.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.413+0000 7f0a5dcbe700 1 --2- 172.21.15.96:0/1129368283 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f0a4406c4e0 0x7f0a4406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:59.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.413+0000 7f0a4effd700 1 --2- 172.21.15.96:0/1129368283 >> [v2:172.21.15.125:6816/2708085722,v1:172.21.15.125:6817/2708085722] conn(0x7f0a440721c0 0x7f0a440745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:00:59.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.413+0000 7f0a4effd700 1 -- 172.21.15.96:0/1129368283 --> [v2:172.21.15.125:6816/2708085722,v1:172.21.15.125:6817/2708085722] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a44074c90 con 0x7f0a440721c0 2024-02-19T19:00:59.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.413+0000 7f0a4effd700 1 -- 172.21.15.96:0/1129368283 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a4808ee10 con 0x7f0a580739d0 2024-02-19T19:00:59.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.413+0000 7f0a5dcbe700 1 --2- 172.21.15.96:0/1129368283 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f0a4406c4e0 0x7f0a4406e9a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0a54005950 tx=0x7f0a540058e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:59.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.414+0000 7f0a5e4bf700 1 --2- 172.21.15.96:0/1129368283 >> [v2:172.21.15.125:6816/2708085722,v1:172.21.15.125:6817/2708085722] conn(0x7f0a440721c0 0x7f0a440745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:00:59.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.414+0000 7f0a5e4bf700 1 --2- 172.21.15.96:0/1129368283 >> [v2:172.21.15.125:6816/2708085722,v1:172.21.15.125:6817/2708085722] conn(0x7f0a440721c0 0x7f0a440745e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:00:59.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.415+0000 7f0a4effd700 1 -- 172.21.15.96:0/1129368283 <== osd.5 v2:172.21.15.125:6816/2708085722 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0a44074c90 con 0x7f0a440721c0 2024-02-19T19:00:59.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.430+0000 7f0a5ff22700 1 -- 172.21.15.96:0/1129368283 --> [v2:172.21.15.125:6816/2708085722,v1:172.21.15.125:6817/2708085722] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0a58199470 con 0x7f0a440721c0 2024-02-19T19:00:59.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.431+0000 7f0a4effd700 1 -- 172.21.15.96:0/1129368283 <== osd.5 v2:172.21.15.125:6816/2708085722 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0a58199470 con 0x7f0a440721c0 2024-02-19T19:00:59.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.431+0000 7f0a5ff22700 1 -- 172.21.15.96:0/1129368283 >> [v2:172.21.15.125:6816/2708085722,v1:172.21.15.125:6817/2708085722] conn(0x7f0a440721c0 msgr2=0x7f0a440745e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:59.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.431+0000 7f0a5ff22700 1 --2- 172.21.15.96:0/1129368283 >> [v2:172.21.15.125:6816/2708085722,v1:172.21.15.125:6817/2708085722] conn(0x7f0a440721c0 0x7f0a440745e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:59.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.431+0000 7f0a5ff22700 1 -- 172.21.15.96:0/1129368283 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f0a4406c4e0 msgr2=0x7f0a4406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:59.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.431+0000 7f0a5ff22700 1 --2- 172.21.15.96:0/1129368283 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f0a4406c4e0 0x7f0a4406e9a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0a54005950 tx=0x7f0a540058e0 comp rx=0 tx=0).stop 2024-02-19T19:00:59.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.431+0000 7f0a5ff22700 1 -- 172.21.15.96:0/1129368283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a580739d0 msgr2=0x7f0a5819ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:00:59.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.431+0000 7f0a5ff22700 1 --2- 172.21.15.96:0/1129368283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a580739d0 0x7f0a5819ed60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0a48006010 tx=0x7f0a4800be20 comp rx=0 tx=0).stop 2024-02-19T19:00:59.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.431+0000 7f0a5ff22700 1 -- 172.21.15.96:0/1129368283 shutdown_connections 2024-02-19T19:00:59.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.431+0000 7f0a5ff22700 1 --2- 172.21.15.96:0/1129368283 >> [v2:172.21.15.125:6816/2708085722,v1:172.21.15.125:6817/2708085722] conn(0x7f0a440721c0 0x7f0a440745e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:59.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.431+0000 7f0a5ff22700 1 --2- 172.21.15.96:0/1129368283 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f0a4406c4e0 0x7f0a4406e9a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:59.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.431+0000 7f0a5ff22700 1 --2- 172.21.15.96:0/1129368283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a580730b0 0x7f0a5819e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:59.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.431+0000 7f0a5ff22700 1 --2- 172.21.15.96:0/1129368283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a580739d0 0x7f0a5819ed60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:00:59.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.431+0000 7f0a5ff22700 1 -- 172.21.15.96:0/1129368283 >> 172.21.15.96:0/1129368283 conn(0x7f0a580fc750 msgr2=0x7f0a58107800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:00:59.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.431+0000 7f0a5ff22700 1 -- 172.21.15.96:0/1129368283 shutdown_connections 2024-02-19T19:00:59.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:00:59.431+0000 7f0a5ff22700 1 -- 172.21.15.96:0/1129368283 wait complete. 2024-02-19T19:01:00.399 INFO:teuthology.orchestra.run.smithi096.stdout:111669149715 2024-02-19T19:01:00.400 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-19T19:01:00.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.581+0000 7fa08a862700 1 -- 172.21.15.96:0/4052008490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa084101e00 msgr2=0x7fa0841021e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:00.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.581+0000 7fa08a862700 1 --2- 172.21.15.96:0/4052008490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa084101e00 0x7fa0841021e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa074009910 tx=0x7fa074009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:00.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.581+0000 7fa08a862700 1 -- 172.21.15.96:0/4052008490 shutdown_connections 2024-02-19T19:01:00.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.581+0000 7fa08a862700 1 --2- 172.21.15.96:0/4052008490 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa084102720 0x7fa08410ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:00.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.581+0000 7fa08a862700 1 --2- 172.21.15.96:0/4052008490 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa084101e00 0x7fa0841021e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:00.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.581+0000 7fa08a862700 1 -- 172.21.15.96:0/4052008490 >> 172.21.15.96:0/4052008490 conn(0x7fa0840fb650 msgr2=0x7fa0840fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:00.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.581+0000 7fa08a862700 1 -- 172.21.15.96:0/4052008490 shutdown_connections 2024-02-19T19:01:00.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.581+0000 7fa08a862700 1 -- 172.21.15.96:0/4052008490 wait complete. 2024-02-19T19:01:00.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.582+0000 7fa08a862700 1 Processor -- start 2024-02-19T19:01:00.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.582+0000 7fa08a862700 1 -- start start 2024-02-19T19:01:00.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.582+0000 7fa08a862700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa084101e00 0x7fa084196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:00.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.582+0000 7fa08a862700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa084102720 0x7fa084196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:00.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.582+0000 7fa08a862700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa084197490 con 0x7fa084101e00 2024-02-19T19:01:00.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.582+0000 7fa08a862700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa084197600 con 0x7fa084102720 2024-02-19T19:01:00.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.582+0000 7fa083fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa084101e00 0x7fa084196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:00.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.582+0000 7fa083fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa084101e00 0x7fa084196950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43898/0 (socket says 172.21.15.96:43898) 2024-02-19T19:01:00.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.582+0000 7fa083fff700 1 -- 172.21.15.96:0/621439346 learned_addr learned my addr 172.21.15.96:0/621439346 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:00.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.582+0000 7fa0837fe700 1 --2- 172.21.15.96:0/621439346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa084102720 0x7fa084196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:00.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.583+0000 7fa083fff700 1 -- 172.21.15.96:0/621439346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa084102720 msgr2=0x7fa084196e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:00.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.583+0000 7fa083fff700 1 --2- 172.21.15.96:0/621439346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa084102720 0x7fa084196e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:00.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.583+0000 7fa083fff700 1 -- 172.21.15.96:0/621439346 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0740095f0 con 0x7fa084101e00 2024-02-19T19:01:00.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.583+0000 7fa083fff700 1 --2- 172.21.15.96:0/621439346 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa084101e00 0x7fa084196950 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa074006010 tx=0x7fa07400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:00.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.583+0000 7fa0817fa700 1 -- 172.21.15.96:0/621439346 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa07401d070 con 0x7fa084101e00 2024-02-19T19:01:00.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.583+0000 7fa08a862700 1 -- 172.21.15.96:0/621439346 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08419b420 con 0x7fa084101e00 2024-02-19T19:01:00.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.583+0000 7fa0817fa700 1 -- 172.21.15.96:0/621439346 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa07400f460 con 0x7fa084101e00 2024-02-19T19:01:00.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.583+0000 7fa0817fa700 1 -- 172.21.15.96:0/621439346 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa074021640 con 0x7fa084101e00 2024-02-19T19:01:00.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.583+0000 7fa08a862700 1 -- 172.21.15.96:0/621439346 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08419b910 con 0x7fa084101e00 2024-02-19T19:01:00.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.584+0000 7fa08a862700 1 -- 172.21.15.96:0/621439346 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa08410e100 con 0x7fa084101e00 2024-02-19T19:01:00.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.585+0000 7fa0817fa700 1 -- 172.21.15.96:0/621439346 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fa07400faf0 con 0x7fa084101e00 2024-02-19T19:01:00.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.585+0000 7fa0817fa700 1 --2- 172.21.15.96:0/621439346 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fa06c0708f0 0x7fa06c072db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:00.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.586+0000 7fa0817fa700 1 -- 172.21.15.96:0/621439346 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa07408d0d0 con 0x7fa084101e00 2024-02-19T19:01:00.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.586+0000 7fa0817fa700 1 --2- 172.21.15.96:0/621439346 >> [v2:172.21.15.96:6818/3117123037,v1:172.21.15.96:6819/3117123037] conn(0x7fa06c0765d0 0x7fa06c0789f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:00.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.586+0000 7fa0817fa700 1 -- 172.21.15.96:0/621439346 --> [v2:172.21.15.96:6818/3117123037,v1:172.21.15.96:6819/3117123037] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa06c0790a0 con 0x7fa06c0765d0 2024-02-19T19:01:00.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.586+0000 7fa0817fa700 1 -- 172.21.15.96:0/621439346 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa07408d530 con 0x7fa084101e00 2024-02-19T19:01:00.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.586+0000 7fa0837fe700 1 --2- 172.21.15.96:0/621439346 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fa06c0708f0 0x7fa06c072db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:00.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.586+0000 7fa088dff700 1 --2- 172.21.15.96:0/621439346 >> [v2:172.21.15.96:6818/3117123037,v1:172.21.15.96:6819/3117123037] conn(0x7fa06c0765d0 0x7fa06c0789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:00.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.586+0000 7fa0837fe700 1 --2- 172.21.15.96:0/621439346 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fa06c0708f0 0x7fa06c072db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa078005ea0 tx=0x7fa078005e30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:00.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.586+0000 7fa088dff700 1 --2- 172.21.15.96:0/621439346 >> [v2:172.21.15.96:6818/3117123037,v1:172.21.15.96:6819/3117123037] conn(0x7fa06c0765d0 0x7fa06c0789f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:00.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.587+0000 7fa0817fa700 1 -- 172.21.15.96:0/621439346 <== osd.2 v2:172.21.15.96:6818/3117123037 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa06c0790a0 con 0x7fa06c0765d0 2024-02-19T19:01:00.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.602+0000 7fa08a862700 1 -- 172.21.15.96:0/621439346 --> [v2:172.21.15.96:6818/3117123037,v1:172.21.15.96:6819/3117123037] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa08404f2e0 con 0x7fa06c0765d0 2024-02-19T19:01:00.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.603+0000 7fa0817fa700 1 -- 172.21.15.96:0/621439346 <== osd.2 v2:172.21.15.96:6818/3117123037 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa08404f2e0 con 0x7fa06c0765d0 2024-02-19T19:01:00.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.603+0000 7fa08a862700 1 -- 172.21.15.96:0/621439346 >> [v2:172.21.15.96:6818/3117123037,v1:172.21.15.96:6819/3117123037] conn(0x7fa06c0765d0 msgr2=0x7fa06c0789f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:00.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.603+0000 7fa08a862700 1 --2- 172.21.15.96:0/621439346 >> [v2:172.21.15.96:6818/3117123037,v1:172.21.15.96:6819/3117123037] conn(0x7fa06c0765d0 0x7fa06c0789f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:00.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.603+0000 7fa08a862700 1 -- 172.21.15.96:0/621439346 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fa06c0708f0 msgr2=0x7fa06c072db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:00.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.603+0000 7fa08a862700 1 --2- 172.21.15.96:0/621439346 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fa06c0708f0 0x7fa06c072db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa078005ea0 tx=0x7fa078005e30 comp rx=0 tx=0).stop 2024-02-19T19:01:00.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.603+0000 7fa08a862700 1 -- 172.21.15.96:0/621439346 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa084101e00 msgr2=0x7fa084196950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:00.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.603+0000 7fa08a862700 1 --2- 172.21.15.96:0/621439346 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa084101e00 0x7fa084196950 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa074006010 tx=0x7fa07400be20 comp rx=0 tx=0).stop 2024-02-19T19:01:00.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.603+0000 7fa08a862700 1 -- 172.21.15.96:0/621439346 shutdown_connections 2024-02-19T19:01:00.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.603+0000 7fa08a862700 1 --2- 172.21.15.96:0/621439346 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fa06c0708f0 0x7fa06c072db0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:00.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.603+0000 7fa08a862700 1 --2- 172.21.15.96:0/621439346 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa084101e00 0x7fa084196950 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:00.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.603+0000 7fa08a862700 1 --2- 172.21.15.96:0/621439346 >> [v2:172.21.15.96:6818/3117123037,v1:172.21.15.96:6819/3117123037] conn(0x7fa06c0765d0 0x7fa06c0789f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:00.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.603+0000 7fa08a862700 1 --2- 172.21.15.96:0/621439346 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa084102720 0x7fa084196e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:00.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.603+0000 7fa08a862700 1 -- 172.21.15.96:0/621439346 >> 172.21.15.96:0/621439346 conn(0x7fa0840fb650 msgr2=0x7fa084105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:00.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.603+0000 7fa08a862700 1 -- 172.21.15.96:0/621439346 shutdown_connections 2024-02-19T19:01:00.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:00.603+0000 7fa08a862700 1 -- 172.21.15.96:0/621439346 wait complete. 2024-02-19T19:01:01.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.143+0000 7f5ab06d5700 1 -- 172.21.15.96:0/750321292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5aa8100750 msgr2=0x7f5aa81047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:01.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.143+0000 7f5ab06d5700 1 --2- 172.21.15.96:0/750321292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5aa8100750 0x7f5aa81047a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009910 tx=0x7f5aa4009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:01.162 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:00 smithi096 ceph-mon[29216]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:01.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.143+0000 7f5ab06d5700 1 -- 172.21.15.96:0/750321292 shutdown_connections 2024-02-19T19:01:01.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.143+0000 7f5ab06d5700 1 --2- 172.21.15.96:0/750321292 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5aa8100750 0x7f5aa81047a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:01.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.143+0000 7f5ab06d5700 1 --2- 172.21.15.96:0/750321292 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5aa80ffda0 0x7f5aa8100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:01.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.143+0000 7f5ab06d5700 1 -- 172.21.15.96:0/750321292 >> 172.21.15.96:0/750321292 conn(0x7f5aa80fb650 msgr2=0x7f5aa80fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:01.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.143+0000 7f5ab06d5700 1 -- 172.21.15.96:0/750321292 shutdown_connections 2024-02-19T19:01:01.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.143+0000 7f5ab06d5700 1 -- 172.21.15.96:0/750321292 wait complete. 2024-02-19T19:01:01.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.144+0000 7f5ab06d5700 1 Processor -- start 2024-02-19T19:01:01.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.144+0000 7f5ab06d5700 1 -- start start 2024-02-19T19:01:01.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.144+0000 7f5ab06d5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5aa80ffda0 0x7f5aa819e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:01.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.144+0000 7f5ab06d5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5aa8100750 0x7f5aa819ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:01.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.144+0000 7f5ab06d5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa819f4c0 con 0x7f5aa8100750 2024-02-19T19:01:01.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.144+0000 7f5ab06d5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa8198970 con 0x7f5aa80ffda0 2024-02-19T19:01:01.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.144+0000 7f5aadc70700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5aa8100750 0x7f5aa819ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:01.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.144+0000 7f5aadc70700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5aa8100750 0x7f5aa819ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43920/0 (socket says 172.21.15.96:43920) 2024-02-19T19:01:01.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.144+0000 7f5aadc70700 1 -- 172.21.15.96:0/969864232 learned_addr learned my addr 172.21.15.96:0/969864232 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:01.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.144+0000 7f5aadc70700 1 -- 172.21.15.96:0/969864232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5aa80ffda0 msgr2=0x7f5aa819e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:01.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.144+0000 7f5aadc70700 1 --2- 172.21.15.96:0/969864232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5aa80ffda0 0x7f5aa819e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:01.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.144+0000 7f5aadc70700 1 -- 172.21.15.96:0/969864232 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa40095f0 con 0x7f5aa8100750 2024-02-19T19:01:01.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.144+0000 7f5aadc70700 1 --2- 172.21.15.96:0/969864232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5aa8100750 0x7f5aa819ee30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400bda0 tx=0x7f5aa400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:01.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.145+0000 7f5a9f7fe700 1 -- 172.21.15.96:0/969864232 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5aa401d070 con 0x7f5aa8100750 2024-02-19T19:01:01.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.145+0000 7f5a9f7fe700 1 -- 172.21.15.96:0/969864232 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5aa4022470 con 0x7f5aa8100750 2024-02-19T19:01:01.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.145+0000 7f5a9f7fe700 1 -- 172.21.15.96:0/969864232 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5aa400f690 con 0x7f5aa8100750 2024-02-19T19:01:01.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.145+0000 7f5ab06d5700 1 -- 172.21.15.96:0/969864232 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa8198bf0 con 0x7f5aa8100750 2024-02-19T19:01:01.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.145+0000 7f5ab06d5700 1 -- 172.21.15.96:0/969864232 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa81990e0 con 0x7f5aa8100750 2024-02-19T19:01:01.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.145+0000 7f5ab06d5700 1 -- 172.21.15.96:0/969864232 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5aa810d040 con 0x7f5aa8100750 2024-02-19T19:01:01.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.146+0000 7f5a9f7fe700 1 -- 172.21.15.96:0/969864232 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f5aa4022b00 con 0x7f5aa8100750 2024-02-19T19:01:01.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.146+0000 7f5a9f7fe700 1 --2- 172.21.15.96:0/969864232 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f5a9406c4e0 0x7f5a9406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:01.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.147+0000 7f5a9f7fe700 1 -- 172.21.15.96:0/969864232 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f5aa408d260 con 0x7f5aa8100750 2024-02-19T19:01:01.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.147+0000 7f5aae471700 1 --2- 172.21.15.96:0/969864232 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f5a9406c4e0 0x7f5a9406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:01.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.147+0000 7f5a9f7fe700 1 --2- 172.21.15.96:0/969864232 >> [v2:172.21.15.96:6802/1987555426,v1:172.21.15.96:6803/1987555426] conn(0x7f5a940721c0 0x7f5a940745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:01.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.147+0000 7f5a9f7fe700 1 -- 172.21.15.96:0/969864232 --> [v2:172.21.15.96:6802/1987555426,v1:172.21.15.96:6803/1987555426] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5a94074c90 con 0x7f5a940721c0 2024-02-19T19:01:01.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.147+0000 7f5a9f7fe700 1 -- 172.21.15.96:0/969864232 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5aa408d6c0 con 0x7f5aa8100750 2024-02-19T19:01:01.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.147+0000 7f5aaec72700 1 --2- 172.21.15.96:0/969864232 >> [v2:172.21.15.96:6802/1987555426,v1:172.21.15.96:6803/1987555426] conn(0x7f5a940721c0 0x7f5a940745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:01.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.147+0000 7f5aae471700 1 --2- 172.21.15.96:0/969864232 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f5a9406c4e0 0x7f5a9406e9a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5a980097b0 tx=0x7f5a98006d20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:01.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.147+0000 7f5aaec72700 1 --2- 172.21.15.96:0/969864232 >> [v2:172.21.15.96:6802/1987555426,v1:172.21.15.96:6803/1987555426] conn(0x7f5a940721c0 0x7f5a940745e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:01.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.148+0000 7f5a9f7fe700 1 -- 172.21.15.96:0/969864232 <== osd.0 v2:172.21.15.96:6802/1987555426 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5a94074c90 con 0x7f5a940721c0 2024-02-19T19:01:01.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.163+0000 7f5ab06d5700 1 -- 172.21.15.96:0/969864232 --> [v2:172.21.15.96:6802/1987555426,v1:172.21.15.96:6803/1987555426] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5aa8199540 con 0x7f5a940721c0 2024-02-19T19:01:01.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.163+0000 7f5a9f7fe700 1 -- 172.21.15.96:0/969864232 <== osd.0 v2:172.21.15.96:6802/1987555426 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5aa8199540 con 0x7f5a940721c0 2024-02-19T19:01:01.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.163+0000 7f5ab06d5700 1 -- 172.21.15.96:0/969864232 >> [v2:172.21.15.96:6802/1987555426,v1:172.21.15.96:6803/1987555426] conn(0x7f5a940721c0 msgr2=0x7f5a940745e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:01.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.163+0000 7f5ab06d5700 1 --2- 172.21.15.96:0/969864232 >> [v2:172.21.15.96:6802/1987555426,v1:172.21.15.96:6803/1987555426] conn(0x7f5a940721c0 0x7f5a940745e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:01.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.164+0000 7f5ab06d5700 1 -- 172.21.15.96:0/969864232 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f5a9406c4e0 msgr2=0x7f5a9406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:01.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.164+0000 7f5ab06d5700 1 --2- 172.21.15.96:0/969864232 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f5a9406c4e0 0x7f5a9406e9a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5a980097b0 tx=0x7f5a98006d20 comp rx=0 tx=0).stop 2024-02-19T19:01:01.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.164+0000 7f5ab06d5700 1 -- 172.21.15.96:0/969864232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5aa8100750 msgr2=0x7f5aa819ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:01.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.164+0000 7f5ab06d5700 1 --2- 172.21.15.96:0/969864232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5aa8100750 0x7f5aa819ee30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400bda0 tx=0x7f5aa400be80 comp rx=0 tx=0).stop 2024-02-19T19:01:01.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.164+0000 7f5ab06d5700 1 -- 172.21.15.96:0/969864232 shutdown_connections 2024-02-19T19:01:01.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.164+0000 7f5ab06d5700 1 --2- 172.21.15.96:0/969864232 >> [v2:172.21.15.96:6802/1987555426,v1:172.21.15.96:6803/1987555426] conn(0x7f5a940721c0 0x7f5a940745e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:01.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.164+0000 7f5ab06d5700 1 --2- 172.21.15.96:0/969864232 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f5a9406c4e0 0x7f5a9406e9a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:01.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.164+0000 7f5ab06d5700 1 --2- 172.21.15.96:0/969864232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5aa80ffda0 0x7f5aa819e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:01.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.164+0000 7f5ab06d5700 1 --2- 172.21.15.96:0/969864232 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5aa8100750 0x7f5aa819ee30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:01.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.164+0000 7f5ab06d5700 1 -- 172.21.15.96:0/969864232 >> 172.21.15.96:0/969864232 conn(0x7f5aa80fb650 msgr2=0x7f5aa8103780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:01.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.164+0000 7f5ab06d5700 1 -- 172.21.15.96:0/969864232 shutdown_connections 2024-02-19T19:01:01.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:01.164+0000 7f5ab06d5700 1 -- 172.21.15.96:0/969864232 wait complete. 2024-02-19T19:01:01.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:00 smithi125 ceph-mon[37556]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:01.670 INFO:teuthology.orchestra.run.smithi096.stdout:81604378648 2024-02-19T19:01:01.670 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-19T19:01:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.201+0000 7fbec2e8c700 1 -- 172.21.15.96:0/2438309497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbebc0ffc20 msgr2=0x7fbebc100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.201+0000 7fbec2e8c700 1 --2- 172.21.15.96:0/2438309497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbebc0ffc20 0x7fbebc100080 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbea8009910 tx=0x7fbea8009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.201+0000 7fbec2e8c700 1 -- 172.21.15.96:0/2438309497 shutdown_connections 2024-02-19T19:01:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.201+0000 7fbec2e8c700 1 --2- 172.21.15.96:0/2438309497 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbebc0ffc20 0x7fbebc100080 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.201+0000 7fbec2e8c700 1 --2- 172.21.15.96:0/2438309497 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbebc105bd0 0x7fbebc105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.201+0000 7fbec2e8c700 1 -- 172.21.15.96:0/2438309497 >> 172.21.15.96:0/2438309497 conn(0x7fbebc075670 msgr2=0x7fbebc075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.201+0000 7fbec2e8c700 1 -- 172.21.15.96:0/2438309497 shutdown_connections 2024-02-19T19:01:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.201+0000 7fbec2e8c700 1 -- 172.21.15.96:0/2438309497 wait complete. 2024-02-19T19:01:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.202+0000 7fbec2e8c700 1 Processor -- start 2024-02-19T19:01:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.202+0000 7fbec2e8c700 1 -- start start 2024-02-19T19:01:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.202+0000 7fbec2e8c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbebc0ffc20 0x7fbebc197780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.202+0000 7fbec2e8c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbebc105bd0 0x7fbebc197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:02.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.202+0000 7fbec2e8c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc198290 con 0x7fbebc0ffc20 2024-02-19T19:01:02.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.202+0000 7fbec2e8c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc1983d0 con 0x7fbebc105bd0 2024-02-19T19:01:02.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.202+0000 7fbec0c28700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbebc0ffc20 0x7fbebc197780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:02.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.202+0000 7fbec0c28700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbebc0ffc20 0x7fbebc197780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43948/0 (socket says 172.21.15.96:43948) 2024-02-19T19:01:02.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.202+0000 7fbec0c28700 1 -- 172.21.15.96:0/1198859529 learned_addr learned my addr 172.21.15.96:0/1198859529 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:02.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.202+0000 7fbebbfff700 1 --2- 172.21.15.96:0/1198859529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbebc105bd0 0x7fbebc197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:02.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.202+0000 7fbec0c28700 1 -- 172.21.15.96:0/1198859529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbebc105bd0 msgr2=0x7fbebc197cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:02.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.202+0000 7fbec0c28700 1 --2- 172.21.15.96:0/1198859529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbebc105bd0 0x7fbebc197cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:02.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.202+0000 7fbec0c28700 1 -- 172.21.15.96:0/1198859529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea80095f0 con 0x7fbebc0ffc20 2024-02-19T19:01:02.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.202+0000 7fbebbfff700 1 --2- 172.21.15.96:0/1198859529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbebc105bd0 0x7fbebc197cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:01:02.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.202+0000 7fbec0c28700 1 --2- 172.21.15.96:0/1198859529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbebc0ffc20 0x7fbebc197780 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000b4b0 tx=0x7fbeb000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:02.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.203+0000 7fbeb9ffb700 1 -- 172.21.15.96:0/1198859529 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbeb0011800 con 0x7fbebc0ffc20 2024-02-19T19:01:02.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.203+0000 7fbec2e8c700 1 -- 172.21.15.96:0/1198859529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbebc1a07f0 con 0x7fbebc0ffc20 2024-02-19T19:01:02.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.203+0000 7fbeb9ffb700 1 -- 172.21.15.96:0/1198859529 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbeb0011e10 con 0x7fbebc0ffc20 2024-02-19T19:01:02.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.203+0000 7fbeb9ffb700 1 -- 172.21.15.96:0/1198859529 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbeb000f2e0 con 0x7fbebc0ffc20 2024-02-19T19:01:02.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.203+0000 7fbec2e8c700 1 -- 172.21.15.96:0/1198859529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbebc1a0c60 con 0x7fbebc0ffc20 2024-02-19T19:01:02.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.204+0000 7fbec2e8c700 1 -- 172.21.15.96:0/1198859529 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbebc10d020 con 0x7fbebc0ffc20 2024-02-19T19:01:02.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.204+0000 7fbeb9ffb700 1 -- 172.21.15.96:0/1198859529 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fbeb0010380 con 0x7fbebc0ffc20 2024-02-19T19:01:02.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.205+0000 7fbeb9ffb700 1 --2- 172.21.15.96:0/1198859529 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fbeac06c4e0 0x7fbeac06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:02.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.205+0000 7fbeb9ffb700 1 -- 172.21.15.96:0/1198859529 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fbeb008b170 con 0x7fbebc0ffc20 2024-02-19T19:01:02.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.205+0000 7fbebbfff700 1 --2- 172.21.15.96:0/1198859529 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fbeac06c4e0 0x7fbeac06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:02.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.205+0000 7fbeb9ffb700 1 --2- 172.21.15.96:0/1198859529 >> [v2:172.21.15.125:6808/1210532750,v1:172.21.15.125:6809/1210532750] conn(0x7fbeac0721c0 0x7fbeac0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:02.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.205+0000 7fbeb9ffb700 1 -- 172.21.15.96:0/1198859529 --> [v2:172.21.15.125:6808/1210532750,v1:172.21.15.125:6809/1210532750] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbeac074c90 con 0x7fbeac0721c0 2024-02-19T19:01:02.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.205+0000 7fbeb9ffb700 1 -- 172.21.15.96:0/1198859529 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbeb008d840 con 0x7fbebc0ffc20 2024-02-19T19:01:02.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.205+0000 7fbebbfff700 1 --2- 172.21.15.96:0/1198859529 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fbeac06c4e0 0x7fbeac06e9a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbea800b5c0 tx=0x7fbea8005480 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:02.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.205+0000 7fbec1429700 1 --2- 172.21.15.96:0/1198859529 >> [v2:172.21.15.125:6808/1210532750,v1:172.21.15.125:6809/1210532750] conn(0x7fbeac0721c0 0x7fbeac0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:02.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.206+0000 7fbec1429700 1 --2- 172.21.15.96:0/1198859529 >> [v2:172.21.15.125:6808/1210532750,v1:172.21.15.125:6809/1210532750] conn(0x7fbeac0721c0 0x7fbeac0745e0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:02.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.206+0000 7fbeb9ffb700 1 -- 172.21.15.96:0/1198859529 <== osd.4 v2:172.21.15.125:6808/1210532750 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbeac074c90 con 0x7fbeac0721c0 2024-02-19T19:01:02.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.221+0000 7fbec2e8c700 1 -- 172.21.15.96:0/1198859529 --> [v2:172.21.15.125:6808/1210532750,v1:172.21.15.125:6809/1210532750] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbebc04f2e0 con 0x7fbeac0721c0 2024-02-19T19:01:02.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.222+0000 7fbeb9ffb700 1 -- 172.21.15.96:0/1198859529 <== osd.4 v2:172.21.15.125:6808/1210532750 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fbebc04f2e0 con 0x7fbeac0721c0 2024-02-19T19:01:02.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.222+0000 7fbec2e8c700 1 -- 172.21.15.96:0/1198859529 >> [v2:172.21.15.125:6808/1210532750,v1:172.21.15.125:6809/1210532750] conn(0x7fbeac0721c0 msgr2=0x7fbeac0745e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:02.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.222+0000 7fbec2e8c700 1 --2- 172.21.15.96:0/1198859529 >> [v2:172.21.15.125:6808/1210532750,v1:172.21.15.125:6809/1210532750] conn(0x7fbeac0721c0 0x7fbeac0745e0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:02.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.223+0000 7fbec2e8c700 1 -- 172.21.15.96:0/1198859529 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fbeac06c4e0 msgr2=0x7fbeac06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:02.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.223+0000 7fbec2e8c700 1 --2- 172.21.15.96:0/1198859529 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fbeac06c4e0 0x7fbeac06e9a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbea800b5c0 tx=0x7fbea8005480 comp rx=0 tx=0).stop 2024-02-19T19:01:02.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.223+0000 7fbec2e8c700 1 -- 172.21.15.96:0/1198859529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbebc0ffc20 msgr2=0x7fbebc197780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:02.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.223+0000 7fbec2e8c700 1 --2- 172.21.15.96:0/1198859529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbebc0ffc20 0x7fbebc197780 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000b4b0 tx=0x7fbeb000b870 comp rx=0 tx=0).stop 2024-02-19T19:01:02.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.223+0000 7fbec2e8c700 1 -- 172.21.15.96:0/1198859529 shutdown_connections 2024-02-19T19:01:02.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.223+0000 7fbec2e8c700 1 --2- 172.21.15.96:0/1198859529 >> [v2:172.21.15.125:6808/1210532750,v1:172.21.15.125:6809/1210532750] conn(0x7fbeac0721c0 0x7fbeac0745e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:02.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.223+0000 7fbec2e8c700 1 --2- 172.21.15.96:0/1198859529 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fbeac06c4e0 0x7fbeac06e9a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:02.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.223+0000 7fbec2e8c700 1 --2- 172.21.15.96:0/1198859529 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbebc0ffc20 0x7fbebc197780 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:02.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.223+0000 7fbec2e8c700 1 --2- 172.21.15.96:0/1198859529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbebc105bd0 0x7fbebc197cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:02.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.223+0000 7fbec2e8c700 1 -- 172.21.15.96:0/1198859529 >> 172.21.15.96:0/1198859529 conn(0x7fbebc075670 msgr2=0x7fbebc0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:02.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.223+0000 7fbec2e8c700 1 -- 172.21.15.96:0/1198859529 shutdown_connections 2024-02-19T19:01:02.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:02.223+0000 7fbec2e8c700 1 -- 172.21.15.96:0/1198859529 wait complete. 2024-02-19T19:01:02.560 INFO:teuthology.orchestra.run.smithi096.stdout:38654705700 2024-02-19T19:01:02.560 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-19T19:01:02.927 INFO:teuthology.orchestra.run.smithi096.stdout:167503724553 2024-02-19T19:01:02.927 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-19T19:01:03.169 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:02 smithi096 ceph-mon[29216]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:03.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:02 smithi125 ceph-mon[37556]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:03.457 INFO:teuthology.orchestra.run.smithi096.stdout:146028888079 2024-02-19T19:01:03.457 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-19T19:01:03.549 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:01:04.686 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:01:05.163 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:04 smithi096 ceph-mon[29216]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:05.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:04 smithi125 ceph-mon[37556]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:05.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.748+0000 7f7f605e2700 1 -- 172.21.15.96:0/3309861634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f580ffda0 msgr2=0x7f7f58100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:05.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.748+0000 7f7f605e2700 1 --2- 172.21.15.96:0/3309861634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f580ffda0 0x7f7f58100180 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7f48009910 tx=0x7f7f48009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:05.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.748+0000 7f7f605e2700 1 -- 172.21.15.96:0/3309861634 shutdown_connections 2024-02-19T19:01:05.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.748+0000 7f7f605e2700 1 --2- 172.21.15.96:0/3309861634 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f58100750 0x7f7f581047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:05.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.748+0000 7f7f605e2700 1 --2- 172.21.15.96:0/3309861634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f580ffda0 0x7f7f58100180 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:05.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.748+0000 7f7f605e2700 1 -- 172.21.15.96:0/3309861634 >> 172.21.15.96:0/3309861634 conn(0x7f7f580fb650 msgr2=0x7f7f580fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:05.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.748+0000 7f7f605e2700 1 -- 172.21.15.96:0/3309861634 shutdown_connections 2024-02-19T19:01:05.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.748+0000 7f7f605e2700 1 -- 172.21.15.96:0/3309861634 wait complete. 2024-02-19T19:01:05.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.749+0000 7f7f605e2700 1 Processor -- start 2024-02-19T19:01:05.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.749+0000 7f7f605e2700 1 -- start start 2024-02-19T19:01:05.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.749+0000 7f7f605e2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f580ffda0 0x7f7f5819b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:05.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.749+0000 7f7f605e2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f58100750 0x7f7f5819ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:05.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.749+0000 7f7f605e2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5819c120 con 0x7f7f580ffda0 2024-02-19T19:01:05.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.749+0000 7f7f605e2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f581955d0 con 0x7f7f58100750 2024-02-19T19:01:05.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.749+0000 7f7f5e37e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f580ffda0 0x7f7f5819b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:05.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.749+0000 7f7f5e37e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f580ffda0 0x7f7f5819b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39712/0 (socket says 172.21.15.96:39712) 2024-02-19T19:01:05.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.749+0000 7f7f5e37e700 1 -- 172.21.15.96:0/622478182 learned_addr learned my addr 172.21.15.96:0/622478182 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:05.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.749+0000 7f7f5db7d700 1 --2- 172.21.15.96:0/622478182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f58100750 0x7f7f5819ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:05.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.750+0000 7f7f5e37e700 1 -- 172.21.15.96:0/622478182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f58100750 msgr2=0x7f7f5819ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:05.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.750+0000 7f7f5e37e700 1 --2- 172.21.15.96:0/622478182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f58100750 0x7f7f5819ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:05.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.750+0000 7f7f5e37e700 1 -- 172.21.15.96:0/622478182 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f480095f0 con 0x7f7f580ffda0 2024-02-19T19:01:05.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.750+0000 7f7f5e37e700 1 --2- 172.21.15.96:0/622478182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f580ffda0 0x7f7f5819b550 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7f48000c00 tx=0x7f7f4800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:05.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.750+0000 7f7f4f7fe700 1 -- 172.21.15.96:0/622478182 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f4801d070 con 0x7f7f580ffda0 2024-02-19T19:01:05.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.750+0000 7f7f4f7fe700 1 -- 172.21.15.96:0/622478182 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7f4800f460 con 0x7f7f580ffda0 2024-02-19T19:01:05.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.750+0000 7f7f605e2700 1 -- 172.21.15.96:0/622478182 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f58195850 con 0x7f7f580ffda0 2024-02-19T19:01:05.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.750+0000 7f7f4f7fe700 1 -- 172.21.15.96:0/622478182 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f48017630 con 0x7f7f580ffda0 2024-02-19T19:01:05.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.750+0000 7f7f605e2700 1 -- 172.21.15.96:0/622478182 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f58195d40 con 0x7f7f580ffda0 2024-02-19T19:01:05.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.751+0000 7f7f605e2700 1 -- 172.21.15.96:0/622478182 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f58108140 con 0x7f7f580ffda0 2024-02-19T19:01:05.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.751+0000 7f7f4f7fe700 1 -- 172.21.15.96:0/622478182 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f7f4800f5d0 con 0x7f7f580ffda0 2024-02-19T19:01:05.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.752+0000 7f7f4f7fe700 1 --2- 172.21.15.96:0/622478182 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f7f4406c4e0 0x7f7f4406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:05.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.752+0000 7f7f4f7fe700 1 -- 172.21.15.96:0/622478182 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f7f4808c950 con 0x7f7f580ffda0 2024-02-19T19:01:05.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.752+0000 7f7f5db7d700 1 --2- 172.21.15.96:0/622478182 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f7f4406c4e0 0x7f7f4406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:05.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.752+0000 7f7f5db7d700 1 --2- 172.21.15.96:0/622478182 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f7f4406c4e0 0x7f7f4406e9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7f58104a20 tx=0x7f7f5400a300 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:05.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.756+0000 7f7f4f7fe700 1 -- 172.21.15.96:0/622478182 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f7f4805af80 con 0x7f7f580ffda0 2024-02-19T19:01:05.815 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:01:05.816 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:01:05.817 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:01:05.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.960+0000 7f7f605e2700 1 -- 172.21.15.96:0/622478182 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7f5804f2e0 con 0x7f7f580ffda0 2024-02-19T19:01:05.979 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.961+0000 7f7f4f7fe700 1 -- 172.21.15.96:0/622478182 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7f4805ab10 con 0x7f7f580ffda0 2024-02-19T19:01:05.980 INFO:teuthology.orchestra.run.smithi096.stdout:81604378648 2024-02-19T19:01:05.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.963+0000 7f7f605e2700 1 -- 172.21.15.96:0/622478182 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f7f4406c4e0 msgr2=0x7f7f4406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:05.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.963+0000 7f7f605e2700 1 --2- 172.21.15.96:0/622478182 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f7f4406c4e0 0x7f7f4406e9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7f58104a20 tx=0x7f7f5400a300 comp rx=0 tx=0).stop 2024-02-19T19:01:05.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.963+0000 7f7f605e2700 1 -- 172.21.15.96:0/622478182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f580ffda0 msgr2=0x7f7f5819b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:05.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.963+0000 7f7f605e2700 1 --2- 172.21.15.96:0/622478182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f580ffda0 0x7f7f5819b550 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7f48000c00 tx=0x7f7f4800bd70 comp rx=0 tx=0).stop 2024-02-19T19:01:05.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.963+0000 7f7f605e2700 1 -- 172.21.15.96:0/622478182 shutdown_connections 2024-02-19T19:01:05.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.963+0000 7f7f605e2700 1 --2- 172.21.15.96:0/622478182 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f7f4406c4e0 0x7f7f4406e9a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:05.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.963+0000 7f7f605e2700 1 --2- 172.21.15.96:0/622478182 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7f580ffda0 0x7f7f5819b550 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:05.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.963+0000 7f7f605e2700 1 --2- 172.21.15.96:0/622478182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7f58100750 0x7f7f5819ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:05.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.963+0000 7f7f605e2700 1 -- 172.21.15.96:0/622478182 >> 172.21.15.96:0/622478182 conn(0x7f7f580fb650 msgr2=0x7f7f580fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:05.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.963+0000 7f7f605e2700 1 -- 172.21.15.96:0/622478182 shutdown_connections 2024-02-19T19:01:05.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:05.963+0000 7f7f605e2700 1 -- 172.21.15.96:0/622478182 wait complete. 2024-02-19T19:01:06.523 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:06 smithi096 ceph-mon[29216]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:06.523 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:06 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/622478182' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-19T19:01:06.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:06 smithi125 ceph-mon[37556]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:06.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:06 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/622478182' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-19T19:01:06.793 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378648 got 81604378648 for osd.2 2024-02-19T19:01:06.793 DEBUG:teuthology.parallel:result is None 2024-02-19T19:01:06.794 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:01:09.034 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:08 smithi096 ceph-mon[29216]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:09.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:08 smithi125 ceph-mon[37556]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:11.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:10 smithi096 ceph-mon[29216]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:11.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:10 smithi125 ceph-mon[37556]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:11.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.235+0000 7f776b46d700 1 -- 172.21.15.96:0/390724911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77640ffc20 msgr2=0x7f7764100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:11.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.235+0000 7f776b46d700 1 --2- 172.21.15.96:0/390724911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77640ffc20 0x7f7764100080 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7754009910 tx=0x7f7754009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:11.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.235+0000 7f776b46d700 1 -- 172.21.15.96:0/390724911 shutdown_connections 2024-02-19T19:01:11.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.235+0000 7f776b46d700 1 --2- 172.21.15.96:0/390724911 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77640ffc20 0x7f7764100080 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:11.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.235+0000 7f776b46d700 1 --2- 172.21.15.96:0/390724911 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7764105bd0 0x7f7764105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:11.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.235+0000 7f776b46d700 1 -- 172.21.15.96:0/390724911 >> 172.21.15.96:0/390724911 conn(0x7f7764075670 msgr2=0x7f7764075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:11.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.235+0000 7f776b46d700 1 -- 172.21.15.96:0/390724911 shutdown_connections 2024-02-19T19:01:11.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.235+0000 7f776b46d700 1 -- 172.21.15.96:0/390724911 wait complete. 2024-02-19T19:01:11.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.236+0000 7f776b46d700 1 Processor -- start 2024-02-19T19:01:11.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.236+0000 7f776b46d700 1 -- start start 2024-02-19T19:01:11.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.236+0000 7f776b46d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77640ffc20 0x7f776419c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:11.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.236+0000 7f776b46d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7764105bd0 0x7f776419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:11.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.236+0000 7f776b46d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776419d210 con 0x7f7764105bd0 2024-02-19T19:01:11.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.236+0000 7f776b46d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77641966c0 con 0x7f77640ffc20 2024-02-19T19:01:11.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.236+0000 7f7768a08700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7764105bd0 0x7f776419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:11.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.236+0000 7f7768a08700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7764105bd0 0x7f776419cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39730/0 (socket says 172.21.15.96:39730) 2024-02-19T19:01:11.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.236+0000 7f7768a08700 1 -- 172.21.15.96:0/951145191 learned_addr learned my addr 172.21.15.96:0/951145191 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:11.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.236+0000 7f7769209700 1 --2- 172.21.15.96:0/951145191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77640ffc20 0x7f776419c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:11.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.236+0000 7f7768a08700 1 -- 172.21.15.96:0/951145191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77640ffc20 msgr2=0x7f776419c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:11.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.236+0000 7f7768a08700 1 --2- 172.21.15.96:0/951145191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77640ffc20 0x7f776419c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:11.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.236+0000 7f7768a08700 1 -- 172.21.15.96:0/951145191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77540095f0 con 0x7f7764105bd0 2024-02-19T19:01:11.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.237+0000 7f7768a08700 1 --2- 172.21.15.96:0/951145191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7764105bd0 0x7f776419cb80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7754006010 tx=0x7f775400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:11.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.237+0000 7f775a7fc700 1 -- 172.21.15.96:0/951145191 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f775401d070 con 0x7f7764105bd0 2024-02-19T19:01:11.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.237+0000 7f775a7fc700 1 -- 172.21.15.96:0/951145191 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7754005dc0 con 0x7f7764105bd0 2024-02-19T19:01:11.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.237+0000 7f775a7fc700 1 -- 172.21.15.96:0/951145191 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7754017400 con 0x7f7764105bd0 2024-02-19T19:01:11.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.237+0000 7f776b46d700 1 -- 172.21.15.96:0/951145191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7764196940 con 0x7f7764105bd0 2024-02-19T19:01:11.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.237+0000 7f776b46d700 1 -- 172.21.15.96:0/951145191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7764196de0 con 0x7f7764105bd0 2024-02-19T19:01:11.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.238+0000 7f776b46d700 1 -- 172.21.15.96:0/951145191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f776404f2e0 con 0x7f7764105bd0 2024-02-19T19:01:11.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.238+0000 7f775a7fc700 1 -- 172.21.15.96:0/951145191 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f775400f460 con 0x7f7764105bd0 2024-02-19T19:01:11.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.239+0000 7f775a7fc700 1 --2- 172.21.15.96:0/951145191 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f775006c4e0 0x7f775006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:11.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.239+0000 7f775a7fc700 1 -- 172.21.15.96:0/951145191 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f775408c920 con 0x7f7764105bd0 2024-02-19T19:01:11.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.239+0000 7f7769209700 1 --2- 172.21.15.96:0/951145191 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f775006c4e0 0x7f775006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:11.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.239+0000 7f7769209700 1 --2- 172.21.15.96:0/951145191 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f775006c4e0 0x7f775006e9a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7760005950 tx=0x7f776000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:11.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.243+0000 7f775a7fc700 1 -- 172.21.15.96:0/951145191 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f775405af90 con 0x7f7764105bd0 2024-02-19T19:01:11.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.434+0000 7f776b46d700 1 -- 172.21.15.96:0/951145191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f7764197bd0 con 0x7f7764105bd0 2024-02-19T19:01:11.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.434+0000 7f775a7fc700 1 -- 172.21.15.96:0/951145191 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f775405ab20 con 0x7f7764105bd0 2024-02-19T19:01:11.454 INFO:teuthology.orchestra.run.smithi096.stdout:111669149717 2024-02-19T19:01:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.436+0000 7f776b46d700 1 -- 172.21.15.96:0/951145191 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f775006c4e0 msgr2=0x7f775006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.436+0000 7f776b46d700 1 --2- 172.21.15.96:0/951145191 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f775006c4e0 0x7f775006e9a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7760005950 tx=0x7f776000b410 comp rx=0 tx=0).stop 2024-02-19T19:01:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.436+0000 7f776b46d700 1 -- 172.21.15.96:0/951145191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7764105bd0 msgr2=0x7f776419cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.436+0000 7f776b46d700 1 --2- 172.21.15.96:0/951145191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7764105bd0 0x7f776419cb80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7754006010 tx=0x7f775400bd70 comp rx=0 tx=0).stop 2024-02-19T19:01:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.436+0000 7f776b46d700 1 -- 172.21.15.96:0/951145191 shutdown_connections 2024-02-19T19:01:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.436+0000 7f776b46d700 1 --2- 172.21.15.96:0/951145191 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f775006c4e0 0x7f775006e9a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.436+0000 7f776b46d700 1 --2- 172.21.15.96:0/951145191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77640ffc20 0x7f776419c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.436+0000 7f776b46d700 1 --2- 172.21.15.96:0/951145191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7764105bd0 0x7f776419cb80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:11.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.436+0000 7f776b46d700 1 -- 172.21.15.96:0/951145191 >> 172.21.15.96:0/951145191 conn(0x7f7764075670 msgr2=0x7f7764068660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:11.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.436+0000 7f776b46d700 1 -- 172.21.15.96:0/951145191 shutdown_connections 2024-02-19T19:01:11.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.436+0000 7f776b46d700 1 -- 172.21.15.96:0/951145191 wait complete. 2024-02-19T19:01:11.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.838+0000 7f56477bd700 1 -- 172.21.15.96:0/3301289575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5640100750 msgr2=0x7f56401047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:11.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.838+0000 7f56477bd700 1 --2- 172.21.15.96:0/3301289575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5640100750 0x7f56401047a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f563c009910 tx=0x7f563c009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:11.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.838+0000 7f56477bd700 1 -- 172.21.15.96:0/3301289575 shutdown_connections 2024-02-19T19:01:11.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.838+0000 7f56477bd700 1 --2- 172.21.15.96:0/3301289575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5640100750 0x7f56401047a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:11.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.838+0000 7f56477bd700 1 --2- 172.21.15.96:0/3301289575 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56400ffda0 0x7f5640100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:11.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.838+0000 7f56477bd700 1 -- 172.21.15.96:0/3301289575 >> 172.21.15.96:0/3301289575 conn(0x7f56400fb650 msgr2=0x7f56400fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:11.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.838+0000 7f56477bd700 1 -- 172.21.15.96:0/3301289575 shutdown_connections 2024-02-19T19:01:11.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.838+0000 7f56477bd700 1 -- 172.21.15.96:0/3301289575 wait complete. 2024-02-19T19:01:11.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.839+0000 7f56477bd700 1 Processor -- start 2024-02-19T19:01:11.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.839+0000 7f56477bd700 1 -- start start 2024-02-19T19:01:11.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.839+0000 7f56477bd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56400ffda0 0x7f564019e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:11.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.839+0000 7f56477bd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5640100750 0x7f564019edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:11.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.839+0000 7f56477bd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564019f450 con 0x7f5640100750 2024-02-19T19:01:11.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.839+0000 7f56477bd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5640198900 con 0x7f56400ffda0 2024-02-19T19:01:11.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.839+0000 7f5644d58700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5640100750 0x7f564019edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:11.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.839+0000 7f5644d58700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5640100750 0x7f564019edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39750/0 (socket says 172.21.15.96:39750) 2024-02-19T19:01:11.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.839+0000 7f5644d58700 1 -- 172.21.15.96:0/4149232040 learned_addr learned my addr 172.21.15.96:0/4149232040 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:11.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.839+0000 7f5645559700 1 --2- 172.21.15.96:0/4149232040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56400ffda0 0x7f564019e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:11.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.839+0000 7f5644d58700 1 -- 172.21.15.96:0/4149232040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56400ffda0 msgr2=0x7f564019e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:11.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.839+0000 7f5644d58700 1 --2- 172.21.15.96:0/4149232040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56400ffda0 0x7f564019e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:11.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.839+0000 7f5644d58700 1 -- 172.21.15.96:0/4149232040 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563c0095f0 con 0x7f5640100750 2024-02-19T19:01:11.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.839+0000 7f5644d58700 1 --2- 172.21.15.96:0/4149232040 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5640100750 0x7f564019edc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f563c00bd70 tx=0x7f563c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:11.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.839+0000 7f56367fc700 1 -- 172.21.15.96:0/4149232040 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f563c01d070 con 0x7f5640100750 2024-02-19T19:01:11.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.839+0000 7f56367fc700 1 -- 172.21.15.96:0/4149232040 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f563c00f460 con 0x7f5640100750 2024-02-19T19:01:11.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.839+0000 7f56367fc700 1 -- 172.21.15.96:0/4149232040 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f563c017630 con 0x7f5640100750 2024-02-19T19:01:11.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.839+0000 7f56477bd700 1 -- 172.21.15.96:0/4149232040 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5640198b80 con 0x7f5640100750 2024-02-19T19:01:11.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.840+0000 7f56477bd700 1 -- 172.21.15.96:0/4149232040 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5640199020 con 0x7f5640100750 2024-02-19T19:01:11.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.840+0000 7f56477bd700 1 -- 172.21.15.96:0/4149232040 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564004f2e0 con 0x7f5640100750 2024-02-19T19:01:11.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.841+0000 7f56367fc700 1 -- 172.21.15.96:0/4149232040 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f563c00f5d0 con 0x7f5640100750 2024-02-19T19:01:11.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.841+0000 7f56367fc700 1 --2- 172.21.15.96:0/4149232040 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f562c06c4e0 0x7f562c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:11.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.841+0000 7f56367fc700 1 -- 172.21.15.96:0/4149232040 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f563c08ca10 con 0x7f5640100750 2024-02-19T19:01:11.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.841+0000 7f5645559700 1 --2- 172.21.15.96:0/4149232040 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f562c06c4e0 0x7f562c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:11.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.842+0000 7f5645559700 1 --2- 172.21.15.96:0/4149232040 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f562c06c4e0 0x7f562c06e9a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5630005950 tx=0x7f56300058e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:11.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:11.846+0000 7f56367fc700 1 -- 172.21.15.96:0/4149232040 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f563c05b080 con 0x7f5640100750 2024-02-19T19:01:12.009 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:11 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/951145191' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-19T19:01:12.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.032+0000 7f6274221700 1 -- 172.21.15.96:0/1554291198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f626c101de0 msgr2=0x7f626c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:12.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.032+0000 7f6274221700 1 --2- 172.21.15.96:0/1554291198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f626c101de0 0x7f626c1021c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6264009910 tx=0x7f6264009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:12.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.032+0000 7f6274221700 1 -- 172.21.15.96:0/1554291198 shutdown_connections 2024-02-19T19:01:12.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.032+0000 7f6274221700 1 --2- 172.21.15.96:0/1554291198 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f626c102700 0x7f626c10abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:12.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.032+0000 7f6274221700 1 --2- 172.21.15.96:0/1554291198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f626c101de0 0x7f626c1021c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:12.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.032+0000 7f6274221700 1 -- 172.21.15.96:0/1554291198 >> 172.21.15.96:0/1554291198 conn(0x7f626c0fb610 msgr2=0x7f626c0fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:12.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.032+0000 7f6274221700 1 -- 172.21.15.96:0/1554291198 shutdown_connections 2024-02-19T19:01:12.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.032+0000 7f6274221700 1 -- 172.21.15.96:0/1554291198 wait complete. 2024-02-19T19:01:12.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.032+0000 7f6274221700 1 Processor -- start 2024-02-19T19:01:12.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.032+0000 7f6274221700 1 -- start start 2024-02-19T19:01:12.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.033+0000 7f6274221700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f626c101de0 0x7f626c19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:12.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.033+0000 7f6274221700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f626c102700 0x7f626c19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:12.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.033+0000 7f6274221700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c19d1b0 con 0x7f626c101de0 2024-02-19T19:01:12.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.033+0000 7f6274221700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c1966f0 con 0x7f626c102700 2024-02-19T19:01:12.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.033+0000 7f6271fbd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f626c101de0 0x7f626c19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:12.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.033+0000 7f6271fbd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f626c101de0 0x7f626c19c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:39776/0 (socket says 172.21.15.96:39776) 2024-02-19T19:01:12.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.033+0000 7f6271fbd700 1 -- 172.21.15.96:0/344578633 learned_addr learned my addr 172.21.15.96:0/344578633 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:12.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.033+0000 7f62717bc700 1 --2- 172.21.15.96:0/344578633 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f626c102700 0x7f626c19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:12.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.033+0000 7f6271fbd700 1 -- 172.21.15.96:0/344578633 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f626c102700 msgr2=0x7f626c19cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:12.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.033+0000 7f6271fbd700 1 --2- 172.21.15.96:0/344578633 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f626c102700 0x7f626c19cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:12.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.033+0000 7f6271fbd700 1 -- 172.21.15.96:0/344578633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62640095f0 con 0x7f626c101de0 2024-02-19T19:01:12.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.033+0000 7f6271fbd700 1 --2- 172.21.15.96:0/344578633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f626c101de0 0x7f626c19c670 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6264006010 tx=0x7f626400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:12.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.033+0000 7f626affd700 1 -- 172.21.15.96:0/344578633 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f626401d070 con 0x7f626c101de0 2024-02-19T19:01:12.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.033+0000 7f626affd700 1 -- 172.21.15.96:0/344578633 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f626400f460 con 0x7f626c101de0 2024-02-19T19:01:12.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.033+0000 7f626affd700 1 -- 172.21.15.96:0/344578633 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6264021640 con 0x7f626c101de0 2024-02-19T19:01:12.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.033+0000 7f6274221700 1 -- 172.21.15.96:0/344578633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626c196970 con 0x7f626c101de0 2024-02-19T19:01:12.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.033+0000 7f6274221700 1 -- 172.21.15.96:0/344578633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626c196e60 con 0x7f626c101de0 2024-02-19T19:01:12.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.034+0000 7f6274221700 1 -- 172.21.15.96:0/344578633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626c1082f0 con 0x7f626c101de0 2024-02-19T19:01:12.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.035+0000 7f626affd700 1 -- 172.21.15.96:0/344578633 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f626400faf0 con 0x7f626c101de0 2024-02-19T19:01:12.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.036+0000 7f626affd700 1 --2- 172.21.15.96:0/344578633 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f625406c4e0 0x7f625406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:12.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.036+0000 7f62717bc700 1 --2- 172.21.15.96:0/344578633 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f625406c4e0 0x7f625406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:12.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.036+0000 7f626affd700 1 -- 172.21.15.96:0/344578633 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f626408c6e0 con 0x7f626c101de0 2024-02-19T19:01:12.056 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.036+0000 7f62717bc700 1 --2- 172.21.15.96:0/344578633 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f625406c4e0 0x7f625406e9a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6260005ea0 tx=0x7f6260005e30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:12.060 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.040+0000 7f626affd700 1 -- 172.21.15.96:0/344578633 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f626405ad10 con 0x7f626c101de0 2024-02-19T19:01:12.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.047+0000 7f56477bd700 1 -- 172.21.15.96:0/4149232040 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5640199290 con 0x7f5640100750 2024-02-19T19:01:12.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.048+0000 7f56367fc700 1 -- 172.21.15.96:0/4149232040 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f563c05ac10 con 0x7f5640100750 2024-02-19T19:01:12.067 INFO:teuthology.orchestra.run.smithi096.stdout:167503724555 2024-02-19T19:01:12.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.050+0000 7f56477bd700 1 -- 172.21.15.96:0/4149232040 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f562c06c4e0 msgr2=0x7f562c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:12.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.050+0000 7f56477bd700 1 --2- 172.21.15.96:0/4149232040 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f562c06c4e0 0x7f562c06e9a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5630005950 tx=0x7f56300058e0 comp rx=0 tx=0).stop 2024-02-19T19:01:12.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.050+0000 7f56477bd700 1 -- 172.21.15.96:0/4149232040 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5640100750 msgr2=0x7f564019edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:12.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.050+0000 7f56477bd700 1 --2- 172.21.15.96:0/4149232040 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5640100750 0x7f564019edc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f563c00bd70 tx=0x7f563c00be50 comp rx=0 tx=0).stop 2024-02-19T19:01:12.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.050+0000 7f56477bd700 1 -- 172.21.15.96:0/4149232040 shutdown_connections 2024-02-19T19:01:12.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.050+0000 7f56477bd700 1 --2- 172.21.15.96:0/4149232040 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f562c06c4e0 0x7f562c06e9a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:12.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.050+0000 7f56477bd700 1 --2- 172.21.15.96:0/4149232040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56400ffda0 0x7f564019e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:12.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.050+0000 7f56477bd700 1 --2- 172.21.15.96:0/4149232040 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5640100750 0x7f564019edc0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:12.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.050+0000 7f56477bd700 1 -- 172.21.15.96:0/4149232040 >> 172.21.15.96:0/4149232040 conn(0x7f56400fb650 msgr2=0x7f5640103780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:12.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.050+0000 7f56477bd700 1 -- 172.21.15.96:0/4149232040 shutdown_connections 2024-02-19T19:01:12.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.050+0000 7f56477bd700 1 -- 172.21.15.96:0/4149232040 wait complete. 2024-02-19T19:01:12.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:11 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/951145191' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-19T19:01:12.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.242+0000 7f6274221700 1 -- 172.21.15.96:0/344578633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f626c04f2e0 con 0x7f626c101de0 2024-02-19T19:01:12.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.242+0000 7f626affd700 1 -- 172.21.15.96:0/344578633 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f626405a8a0 con 0x7f626c101de0 2024-02-19T19:01:12.262 INFO:teuthology.orchestra.run.smithi096.stdout:60129542177 2024-02-19T19:01:12.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.244+0000 7f6274221700 1 -- 172.21.15.96:0/344578633 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f625406c4e0 msgr2=0x7f625406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:12.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.244+0000 7f6274221700 1 --2- 172.21.15.96:0/344578633 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f625406c4e0 0x7f625406e9a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6260005ea0 tx=0x7f6260005e30 comp rx=0 tx=0).stop 2024-02-19T19:01:12.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.244+0000 7f6274221700 1 -- 172.21.15.96:0/344578633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f626c101de0 msgr2=0x7f626c19c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:12.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.244+0000 7f6274221700 1 --2- 172.21.15.96:0/344578633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f626c101de0 0x7f626c19c670 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6264006010 tx=0x7f626400be20 comp rx=0 tx=0).stop 2024-02-19T19:01:12.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.244+0000 7f6274221700 1 -- 172.21.15.96:0/344578633 shutdown_connections 2024-02-19T19:01:12.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.244+0000 7f6274221700 1 --2- 172.21.15.96:0/344578633 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f625406c4e0 0x7f625406e9a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:12.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.244+0000 7f6274221700 1 --2- 172.21.15.96:0/344578633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f626c101de0 0x7f626c19c670 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:12.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.244+0000 7f6274221700 1 --2- 172.21.15.96:0/344578633 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f626c102700 0x7f626c19cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:12.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.244+0000 7f6274221700 1 -- 172.21.15.96:0/344578633 >> 172.21.15.96:0/344578633 conn(0x7f626c0fb610 msgr2=0x7f626c105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:12.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.244+0000 7f6274221700 1 -- 172.21.15.96:0/344578633 shutdown_connections 2024-02-19T19:01:12.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:12.244+0000 7f6274221700 1 -- 172.21.15.96:0/344578633 wait complete. 2024-02-19T19:01:12.492 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149715 got 111669149717 for osd.3 2024-02-19T19:01:12.492 DEBUG:teuthology.parallel:result is None 2024-02-19T19:01:13.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:12 smithi096 ceph-mon[29216]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:13.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:12 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/4149232040' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-19T19:01:13.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:12 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/344578633' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-19T19:01:13.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:12 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:01:13.064 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542173 got 60129542177 for osd.1 2024-02-19T19:01:13.064 DEBUG:teuthology.parallel:result is None 2024-02-19T19:01:13.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:12 smithi125 ceph-mon[37556]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:13.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:12 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/4149232040' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-19T19:01:13.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:12 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/344578633' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-19T19:01:13.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:12 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:01:13.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.457+0000 7fd5a2db7700 1 -- 172.21.15.96:0/2036073203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd59c100750 msgr2=0x7fd59c1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:13.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.457+0000 7fd5a2db7700 1 --2- 172.21.15.96:0/2036073203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd59c100750 0x7fd59c1047a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd58c009910 tx=0x7fd58c009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:13.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.457+0000 7fd5a2db7700 1 -- 172.21.15.96:0/2036073203 shutdown_connections 2024-02-19T19:01:13.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.457+0000 7fd5a2db7700 1 --2- 172.21.15.96:0/2036073203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd59c100750 0x7fd59c1047a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:13.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.457+0000 7fd5a2db7700 1 --2- 172.21.15.96:0/2036073203 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd59c0ffda0 0x7fd59c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:13.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.457+0000 7fd5a2db7700 1 -- 172.21.15.96:0/2036073203 >> 172.21.15.96:0/2036073203 conn(0x7fd59c0fb650 msgr2=0x7fd59c0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:13.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.457+0000 7fd5a2db7700 1 -- 172.21.15.96:0/2036073203 shutdown_connections 2024-02-19T19:01:13.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.457+0000 7fd5a2db7700 1 -- 172.21.15.96:0/2036073203 wait complete. 2024-02-19T19:01:13.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.457+0000 7fd5a2db7700 1 Processor -- start 2024-02-19T19:01:13.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.457+0000 7fd5a2db7700 1 -- start start 2024-02-19T19:01:13.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.457+0000 7fd5a2db7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd59c0ffda0 0x7fd59c1977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:13.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.457+0000 7fd5a2db7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd59c100750 0x7fd59c197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:13.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.457+0000 7fd5a2db7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c198340 con 0x7fd59c0ffda0 2024-02-19T19:01:13.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.457+0000 7fd5a2db7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd59c1984b0 con 0x7fd59c100750 2024-02-19T19:01:13.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.458+0000 7fd5a0b53700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd59c0ffda0 0x7fd59c1977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:13.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.458+0000 7fd5a0b53700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd59c0ffda0 0x7fd59c1977e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37148/0 (socket says 172.21.15.96:37148) 2024-02-19T19:01:13.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.458+0000 7fd5a0b53700 1 -- 172.21.15.96:0/3085744129 learned_addr learned my addr 172.21.15.96:0/3085744129 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:13.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.458+0000 7fd59bfff700 1 --2- 172.21.15.96:0/3085744129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd59c100750 0x7fd59c197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:13.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.458+0000 7fd5a0b53700 1 -- 172.21.15.96:0/3085744129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd59c100750 msgr2=0x7fd59c197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:13.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.458+0000 7fd5a0b53700 1 --2- 172.21.15.96:0/3085744129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd59c100750 0x7fd59c197d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:13.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.458+0000 7fd5a0b53700 1 -- 172.21.15.96:0/3085744129 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd58c0095f0 con 0x7fd59c0ffda0 2024-02-19T19:01:13.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.458+0000 7fd5a0b53700 1 --2- 172.21.15.96:0/3085744129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd59c0ffda0 0x7fd59c1977e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd59400ba50 tx=0x7fd59400bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:13.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.458+0000 7fd599ffb700 1 -- 172.21.15.96:0/3085744129 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd59400c900 con 0x7fd59c0ffda0 2024-02-19T19:01:13.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.458+0000 7fd599ffb700 1 -- 172.21.15.96:0/3085744129 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd594014440 con 0x7fd59c0ffda0 2024-02-19T19:01:13.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.458+0000 7fd5a2db7700 1 -- 172.21.15.96:0/3085744129 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd59c1a0850 con 0x7fd59c0ffda0 2024-02-19T19:01:13.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.458+0000 7fd599ffb700 1 -- 172.21.15.96:0/3085744129 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5940075a0 con 0x7fd59c0ffda0 2024-02-19T19:01:13.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.459+0000 7fd5a2db7700 1 -- 172.21.15.96:0/3085744129 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd59c1a0d10 con 0x7fd59c0ffda0 2024-02-19T19:01:13.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.459+0000 7fd5a2db7700 1 -- 172.21.15.96:0/3085744129 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59c1080f0 con 0x7fd59c0ffda0 2024-02-19T19:01:13.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.460+0000 7fd599ffb700 1 -- 172.21.15.96:0/3085744129 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fd5940145b0 con 0x7fd59c0ffda0 2024-02-19T19:01:13.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.460+0000 7fd599ffb700 1 --2- 172.21.15.96:0/3085744129 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd58806c4e0 0x7fd58806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:13.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.460+0000 7fd599ffb700 1 -- 172.21.15.96:0/3085744129 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd594006e40 con 0x7fd59c0ffda0 2024-02-19T19:01:13.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.460+0000 7fd59bfff700 1 --2- 172.21.15.96:0/3085744129 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd58806c4e0 0x7fd58806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:13.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.460+0000 7fd59bfff700 1 --2- 172.21.15.96:0/3085744129 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd58806c4e0 0x7fd58806e9a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd58c009fd0 tx=0x7fd58c01a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:13.484 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.464+0000 7fd599ffb700 1 -- 172.21.15.96:0/3085744129 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd594055740 con 0x7fd59c0ffda0 2024-02-19T19:01:13.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.659+0000 7fd5a2db7700 1 -- 172.21.15.96:0/3085744129 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd59c069520 con 0x7fd59c0ffda0 2024-02-19T19:01:13.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.660+0000 7fd599ffb700 1 -- 172.21.15.96:0/3085744129 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd594019020 con 0x7fd59c0ffda0 2024-02-19T19:01:13.679 INFO:teuthology.orchestra.run.smithi096.stdout:146028888080 2024-02-19T19:01:13.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.662+0000 7fd5a2db7700 1 -- 172.21.15.96:0/3085744129 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd58806c4e0 msgr2=0x7fd58806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:13.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.662+0000 7fd5a2db7700 1 --2- 172.21.15.96:0/3085744129 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd58806c4e0 0x7fd58806e9a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd58c009fd0 tx=0x7fd58c01a040 comp rx=0 tx=0).stop 2024-02-19T19:01:13.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.662+0000 7fd5a2db7700 1 -- 172.21.15.96:0/3085744129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd59c0ffda0 msgr2=0x7fd59c1977e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:13.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.662+0000 7fd5a2db7700 1 --2- 172.21.15.96:0/3085744129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd59c0ffda0 0x7fd59c1977e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd59400ba50 tx=0x7fd59400bd60 comp rx=0 tx=0).stop 2024-02-19T19:01:13.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.662+0000 7fd5a2db7700 1 -- 172.21.15.96:0/3085744129 shutdown_connections 2024-02-19T19:01:13.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.662+0000 7fd5a2db7700 1 --2- 172.21.15.96:0/3085744129 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd58806c4e0 0x7fd58806e9a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:13.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.662+0000 7fd5a2db7700 1 --2- 172.21.15.96:0/3085744129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd59c0ffda0 0x7fd59c1977e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:13.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.662+0000 7fd5a2db7700 1 --2- 172.21.15.96:0/3085744129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd59c100750 0x7fd59c197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:13.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.662+0000 7fd5a2db7700 1 -- 172.21.15.96:0/3085744129 >> 172.21.15.96:0/3085744129 conn(0x7fd59c0fb650 msgr2=0x7fd59c0fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:13.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.662+0000 7fd5a2db7700 1 -- 172.21.15.96:0/3085744129 shutdown_connections 2024-02-19T19:01:13.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:13.662+0000 7fd5a2db7700 1 -- 172.21.15.96:0/3085744129 wait complete. 2024-02-19T19:01:14.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:13 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/3085744129' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-19T19:01:14.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:13 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/3085744129' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-19T19:01:14.389 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888079 got 146028888080 for osd.4 2024-02-19T19:01:14.389 DEBUG:teuthology.parallel:result is None 2024-02-19T19:01:14.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.926+0000 7f6c183ee700 1 -- 172.21.15.96:0/3557731038 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c100ffc20 msgr2=0x7f6c10100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:14.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.926+0000 7f6c183ee700 1 --2- 172.21.15.96:0/3557731038 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c100ffc20 0x7f6c10100080 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6c04009910 tx=0x7f6c04009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:14.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.926+0000 7f6c183ee700 1 -- 172.21.15.96:0/3557731038 shutdown_connections 2024-02-19T19:01:14.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.926+0000 7f6c183ee700 1 --2- 172.21.15.96:0/3557731038 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c100ffc20 0x7f6c10100080 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:14.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.926+0000 7f6c183ee700 1 --2- 172.21.15.96:0/3557731038 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c10105bd0 0x7f6c10105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:14.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.926+0000 7f6c183ee700 1 -- 172.21.15.96:0/3557731038 >> 172.21.15.96:0/3557731038 conn(0x7f6c10075670 msgr2=0x7f6c10075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:14.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.926+0000 7f6c183ee700 1 -- 172.21.15.96:0/3557731038 shutdown_connections 2024-02-19T19:01:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.926+0000 7f6c183ee700 1 -- 172.21.15.96:0/3557731038 wait complete. 2024-02-19T19:01:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.926+0000 7f6c183ee700 1 Processor -- start 2024-02-19T19:01:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.927+0000 7f6c183ee700 1 -- start start 2024-02-19T19:01:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.927+0000 7f6c183ee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c100ffc20 0x7f6c1019c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.927+0000 7f6c183ee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c10105bd0 0x7f6c1019cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.927+0000 7f6c183ee700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1019d200 con 0x7f6c100ffc20 2024-02-19T19:01:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.927+0000 7f6c183ee700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c101966b0 con 0x7f6c10105bd0 2024-02-19T19:01:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.927+0000 7f6c1618a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c100ffc20 0x7f6c1019c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.927+0000 7f6c1618a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c100ffc20 0x7f6c1019c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37172/0 (socket says 172.21.15.96:37172) 2024-02-19T19:01:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.927+0000 7f6c1618a700 1 -- 172.21.15.96:0/1525464207 learned_addr learned my addr 172.21.15.96:0/1525464207 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.927+0000 7f6c15989700 1 --2- 172.21.15.96:0/1525464207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c10105bd0 0x7f6c1019cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.927+0000 7f6c1618a700 1 -- 172.21.15.96:0/1525464207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c10105bd0 msgr2=0x7f6c1019cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.927+0000 7f6c1618a700 1 --2- 172.21.15.96:0/1525464207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c10105bd0 0x7f6c1019cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.927+0000 7f6c1618a700 1 -- 172.21.15.96:0/1525464207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c040095f0 con 0x7f6c100ffc20 2024-02-19T19:01:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.927+0000 7f6c15989700 1 --2- 172.21.15.96:0/1525464207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c10105bd0 0x7f6c1019cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:01:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.927+0000 7f6c1618a700 1 --2- 172.21.15.96:0/1525464207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c100ffc20 0x7f6c1019c630 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000ada0 tx=0x7f6c0000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:14.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.927+0000 7f6c0f7fe700 1 -- 172.21.15.96:0/1525464207 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c0000f070 con 0x7f6c100ffc20 2024-02-19T19:01:14.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.928+0000 7f6c0f7fe700 1 -- 172.21.15.96:0/1525464207 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6c00007bf0 con 0x7f6c100ffc20 2024-02-19T19:01:14.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.928+0000 7f6c183ee700 1 -- 172.21.15.96:0/1525464207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c10196990 con 0x7f6c100ffc20 2024-02-19T19:01:14.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.928+0000 7f6c0f7fe700 1 -- 172.21.15.96:0/1525464207 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c00005670 con 0x7f6c100ffc20 2024-02-19T19:01:14.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.928+0000 7f6c183ee700 1 -- 172.21.15.96:0/1525464207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c10196ee0 con 0x7f6c100ffc20 2024-02-19T19:01:14.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.929+0000 7f6c183ee700 1 -- 172.21.15.96:0/1525464207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1004f2e0 con 0x7f6c100ffc20 2024-02-19T19:01:14.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.929+0000 7f6c0f7fe700 1 -- 172.21.15.96:0/1525464207 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f6c000058e0 con 0x7f6c100ffc20 2024-02-19T19:01:14.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.929+0000 7f6c0f7fe700 1 --2- 172.21.15.96:0/1525464207 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f6bf806c4e0 0x7f6bf806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:14.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.930+0000 7f6c15989700 1 --2- 172.21.15.96:0/1525464207 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f6bf806c4e0 0x7f6bf806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:14.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.930+0000 7f6c0f7fe700 1 -- 172.21.15.96:0/1525464207 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f6c0008aef0 con 0x7f6c100ffc20 2024-02-19T19:01:14.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.930+0000 7f6c15989700 1 --2- 172.21.15.96:0/1525464207 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f6bf806c4e0 0x7f6bf806e9a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6c040059d0 tx=0x7f6c0401a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:14.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:14.934+0000 7f6c0f7fe700 1 -- 172.21.15.96:0/1525464207 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f6c000594a0 con 0x7f6c100ffc20 2024-02-19T19:01:15.100 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:14 smithi125 ceph-mon[37556]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:15.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:15.127+0000 7f6c183ee700 1 -- 172.21.15.96:0/1525464207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6c10197130 con 0x7f6c100ffc20 2024-02-19T19:01:15.145 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:14 smithi096 ceph-mon[29216]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:15.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:15.127+0000 7f6c0f7fe700 1 -- 172.21.15.96:0/1525464207 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6c00059030 con 0x7f6c100ffc20 2024-02-19T19:01:15.146 INFO:teuthology.orchestra.run.smithi096.stdout:38654705703 2024-02-19T19:01:15.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:15.128+0000 7f6c183ee700 1 -- 172.21.15.96:0/1525464207 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f6bf806c4e0 msgr2=0x7f6bf806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:15.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:15.128+0000 7f6c183ee700 1 --2- 172.21.15.96:0/1525464207 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f6bf806c4e0 0x7f6bf806e9a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6c040059d0 tx=0x7f6c0401a040 comp rx=0 tx=0).stop 2024-02-19T19:01:15.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:15.128+0000 7f6c183ee700 1 -- 172.21.15.96:0/1525464207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c100ffc20 msgr2=0x7f6c1019c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:15.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:15.128+0000 7f6c183ee700 1 --2- 172.21.15.96:0/1525464207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c100ffc20 0x7f6c1019c630 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6c0000ada0 tx=0x7f6c0000c330 comp rx=0 tx=0).stop 2024-02-19T19:01:15.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:15.128+0000 7f6c183ee700 1 -- 172.21.15.96:0/1525464207 shutdown_connections 2024-02-19T19:01:15.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:15.128+0000 7f6c183ee700 1 --2- 172.21.15.96:0/1525464207 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f6bf806c4e0 0x7f6bf806e9a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:15.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:15.128+0000 7f6c183ee700 1 --2- 172.21.15.96:0/1525464207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c100ffc20 0x7f6c1019c630 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:15.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:15.128+0000 7f6c183ee700 1 --2- 172.21.15.96:0/1525464207 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c10105bd0 0x7f6c1019cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:15.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:15.128+0000 7f6c183ee700 1 -- 172.21.15.96:0/1525464207 >> 172.21.15.96:0/1525464207 conn(0x7f6c10075670 msgr2=0x7f6c10068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:15.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:15.128+0000 7f6c183ee700 1 -- 172.21.15.96:0/1525464207 shutdown_connections 2024-02-19T19:01:15.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:15.128+0000 7f6c183ee700 1 -- 172.21.15.96:0/1525464207 wait complete. 2024-02-19T19:01:15.277 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724553 got 167503724555 for osd.5 2024-02-19T19:01:15.277 DEBUG:teuthology.parallel:result is None 2024-02-19T19:01:15.897 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705700 got 38654705703 for osd.0 2024-02-19T19:01:15.898 DEBUG:teuthology.parallel:result is None 2024-02-19T19:01:15.898 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-19T19:01:15.898 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T19:01:16.105 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:01:16.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:15 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/1525464207' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-19T19:01:16.220 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:15 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/1525464207' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-19T19:01:17.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:16 smithi125 ceph-mon[37556]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:17.269 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:16 smithi096 ceph-mon[29216]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.559+0000 7fd207cc5700 1 -- 172.21.15.96:0/2283570226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd200100ea0 msgr2=0x7fd200101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.559+0000 7fd207cc5700 1 --2- 172.21.15.96:0/2283570226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd200100ea0 0x7fd200101280 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc009910 tx=0x7fd1fc009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.560+0000 7fd207cc5700 1 -- 172.21.15.96:0/2283570226 shutdown_connections 2024-02-19T19:01:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.560+0000 7fd207cc5700 1 --2- 172.21.15.96:0/2283570226 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd200101850 0x7fd2001058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.560+0000 7fd207cc5700 1 --2- 172.21.15.96:0/2283570226 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd200100ea0 0x7fd200101280 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.560+0000 7fd207cc5700 1 -- 172.21.15.96:0/2283570226 >> 172.21.15.96:0/2283570226 conn(0x7fd2000fc750 msgr2=0x7fd2000feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.560+0000 7fd207cc5700 1 -- 172.21.15.96:0/2283570226 shutdown_connections 2024-02-19T19:01:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.560+0000 7fd207cc5700 1 -- 172.21.15.96:0/2283570226 wait complete. 2024-02-19T19:01:17.580 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.560+0000 7fd207cc5700 1 Processor -- start 2024-02-19T19:01:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.560+0000 7fd207cc5700 1 -- start start 2024-02-19T19:01:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.560+0000 7fd207cc5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd200100ea0 0x7fd200073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.560+0000 7fd207cc5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd200101850 0x7fd2000735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.560+0000 7fd207cc5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd200073b10 con 0x7fd200101850 2024-02-19T19:01:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.560+0000 7fd207cc5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd200073c50 con 0x7fd200100ea0 2024-02-19T19:01:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.560+0000 7fd205260700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd200101850 0x7fd2000735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.561+0000 7fd205260700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd200101850 0x7fd2000735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37184/0 (socket says 172.21.15.96:37184) 2024-02-19T19:01:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.561+0000 7fd205260700 1 -- 172.21.15.96:0/3837355970 learned_addr learned my addr 172.21.15.96:0/3837355970 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.561+0000 7fd205a61700 1 --2- 172.21.15.96:0/3837355970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd200100ea0 0x7fd200073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:17.581 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.561+0000 7fd205260700 1 -- 172.21.15.96:0/3837355970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd200100ea0 msgr2=0x7fd200073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:17.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.561+0000 7fd205260700 1 --2- 172.21.15.96:0/3837355970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd200100ea0 0x7fd200073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:17.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.561+0000 7fd205260700 1 -- 172.21.15.96:0/3837355970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1fc0095f0 con 0x7fd200101850 2024-02-19T19:01:17.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.561+0000 7fd205a61700 1 --2- 172.21.15.96:0/3837355970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd200100ea0 0x7fd200073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:01:17.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.561+0000 7fd205260700 1 --2- 172.21.15.96:0/3837355970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd200101850 0x7fd2000735d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd1f000c8f0 tx=0x7fd1f000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:17.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.561+0000 7fd1f6ffd700 1 -- 172.21.15.96:0/3837355970 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1f0007a50 con 0x7fd200101850 2024-02-19T19:01:17.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.561+0000 7fd207cc5700 1 -- 172.21.15.96:0/3837355970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2001a2b10 con 0x7fd200101850 2024-02-19T19:01:17.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.561+0000 7fd1f6ffd700 1 -- 172.21.15.96:0/3837355970 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd1f0007bb0 con 0x7fd200101850 2024-02-19T19:01:17.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.561+0000 7fd1f6ffd700 1 -- 172.21.15.96:0/3837355970 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd1f0018630 con 0x7fd200101850 2024-02-19T19:01:17.582 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.561+0000 7fd207cc5700 1 -- 172.21.15.96:0/3837355970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2001a2f20 con 0x7fd200101850 2024-02-19T19:01:17.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.562+0000 7fd207cc5700 1 -- 172.21.15.96:0/3837355970 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd200109240 con 0x7fd200101850 2024-02-19T19:01:17.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.563+0000 7fd1f6ffd700 1 -- 172.21.15.96:0/3837355970 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fd1f0007d20 con 0x7fd200101850 2024-02-19T19:01:17.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.563+0000 7fd1f6ffd700 1 --2- 172.21.15.96:0/3837355970 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd1ec06c4e0 0x7fd1ec06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:17.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.563+0000 7fd205a61700 1 --2- 172.21.15.96:0/3837355970 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd1ec06c4e0 0x7fd1ec06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:17.583 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.563+0000 7fd1f6ffd700 1 -- 172.21.15.96:0/3837355970 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd1f008b4b0 con 0x7fd200101850 2024-02-19T19:01:17.584 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.564+0000 7fd205a61700 1 --2- 172.21.15.96:0/3837355970 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd1ec06c4e0 0x7fd1ec06e9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00b5c0 tx=0x7fd1fc01a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:17.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.568+0000 7fd1f6ffd700 1 -- 172.21.15.96:0/3837355970 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd1f0055fd0 con 0x7fd200101850 2024-02-19T19:01:17.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.751+0000 7fd207cc5700 1 -- 172.21.15.96:0/3837355970 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2000611d0 con 0x7fd1ec06c4e0 2024-02-19T19:01:17.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.752+0000 7fd1f6ffd700 1 -- 172.21.15.96:0/3837355970 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27967 (secure 0 0 0) 0x7fd2000611d0 con 0x7fd1ec06c4e0 2024-02-19T19:01:17.772 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:01:17.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.754+0000 7fd207cc5700 1 -- 172.21.15.96:0/3837355970 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd1ec06c4e0 msgr2=0x7fd1ec06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:17.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.754+0000 7fd207cc5700 1 --2- 172.21.15.96:0/3837355970 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd1ec06c4e0 0x7fd1ec06e9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00b5c0 tx=0x7fd1fc01a040 comp rx=0 tx=0).stop 2024-02-19T19:01:17.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.754+0000 7fd207cc5700 1 -- 172.21.15.96:0/3837355970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd200101850 msgr2=0x7fd2000735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:17.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.754+0000 7fd207cc5700 1 --2- 172.21.15.96:0/3837355970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd200101850 0x7fd2000735d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd1f000c8f0 tx=0x7fd1f000ccb0 comp rx=0 tx=0).stop 2024-02-19T19:01:17.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.754+0000 7fd207cc5700 1 -- 172.21.15.96:0/3837355970 shutdown_connections 2024-02-19T19:01:17.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.755+0000 7fd207cc5700 1 --2- 172.21.15.96:0/3837355970 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd1ec06c4e0 0x7fd1ec06e9a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:17.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.755+0000 7fd207cc5700 1 --2- 172.21.15.96:0/3837355970 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd200100ea0 0x7fd200073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:17.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.755+0000 7fd207cc5700 1 --2- 172.21.15.96:0/3837355970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd200101850 0x7fd2000735d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:17.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.755+0000 7fd207cc5700 1 -- 172.21.15.96:0/3837355970 >> 172.21.15.96:0/3837355970 conn(0x7fd2000fc750 msgr2=0x7fd2000fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:17.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.755+0000 7fd207cc5700 1 -- 172.21.15.96:0/3837355970 shutdown_connections 2024-02-19T19:01:17.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:17.755+0000 7fd207cc5700 1 -- 172.21.15.96:0/3837355970 wait complete. 2024-02-19T19:01:17.775 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-02-19T19:01:18.370 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-02-19T19:01:15.806642+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165584,"kb_used_data":3872,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305328,"statfs":{"total":575970213888,"available":575800655872,"internally_reserved":0,"allocated":3964928,"data_stored":2608497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002096"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":187,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-19T19:00:27.901357+0000","last_change":"2024-02-19T19:00:02.031631+0000","last_active":"2024-02-19T19:00:27.901357+0000","last_peered":"2024-02-19T19:00:27.901357+0000","last_clean":"2024-02-19T19:00:27.901357+0000","last_became_active":"2024-02-19T19:00:02.031308+0000","last_became_peered":"2024-02-19T19:00:02.031308+0000","last_unstale":"2024-02-19T19:00:27.901357+0000","last_undegraded":"2024-02-19T19:00:27.901357+0000","last_fullsized":"2024-02-19T19:00:27.901357+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T18:59:14.499588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T18:59:14.499588+0000","last_clean_scrub_stamp":"2024-02-19T18:59:14.499588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T19:09:04.824047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724556,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888081,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 19:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.434}]},{"osd":1,"last update":"Mon Feb 19 19:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.35599999999999998}]},{"osd":2,"last update":"Mon Feb 19 19:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.38100000000000001}]},{"osd":3,"last update":"Mon Feb 19 19:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.316},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]}]},{"osd":3,"up_from":26,"seq":111669149718,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 19:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.439}]},{"osd":1,"last update":"Mon Feb 19 19:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.505}]},{"osd":2,"last update":"Mon Feb 19 19:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.41599999999999998}]},{"osd":4,"last update":"Mon Feb 19 19:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.52300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]}]},{"osd":2,"up_from":19,"seq":81604378651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717848,"statfs":{"total":95995035648,"available":95967076352,"internally_reserved":0,"allocated":360448,"data_stored":139008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 19:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.374}]},{"osd":1,"last update":"Mon Feb 19 19:00:14 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.246}]},{"osd":3,"last update":"Mon Feb 19 19:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.503},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.58599999999999997}]},{"osd":4,"last update":"Mon Feb 19 19:01:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.53000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 19:00:51 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34000000000000002,"15min":0.33600000000000002},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.34599999999999997,"15min":0.34200000000000003},"min":{"1min":0.23799999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.51800000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.47199999999999998}]},{"osd":2,"last update":"Mon Feb 19 19:00:18 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.42999999999999999}]},{"osd":3,"last update":"Mon Feb 19 19:00:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.625},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.68000000000000005}]},{"osd":4,"last update":"Mon Feb 19 19:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.64100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542177,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 19:00:49 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.32400000000000001,"15min":0.32000000000000001},"min":{"1min":0.23699999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.32800000000000001,"15min":0.32300000000000001},"min":{"1min":0.245,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.50800000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.49099999999999999}]},{"osd":2,"last update":"Mon Feb 19 19:00:16 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.42599999999999999}]},{"osd":3,"last update":"Mon Feb 19 19:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.59899999999999998}]},{"osd":4,"last update":"Mon Feb 19 19:01:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T19:01:18.372 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph pg dump --format=json 2024-02-19T19:01:18.578 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:01:19.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:18 smithi096 ceph-mon[29216]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T19:01:19.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:18 smithi096 ceph-mon[29216]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:19.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:18 smithi125 ceph-mon[37556]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T19:01:19.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:18 smithi125 ceph-mon[37556]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:20.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.081+0000 7f295f7c3700 1 -- 172.21.15.96:0/3678158491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2958101850 msgr2=0x7f29581058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:20.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.081+0000 7f295f7c3700 1 --2- 172.21.15.96:0/3678158491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2958101850 0x7f29581058a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2948009910 tx=0x7f2948009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:20.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.081+0000 7f295f7c3700 1 -- 172.21.15.96:0/3678158491 shutdown_connections 2024-02-19T19:01:20.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.081+0000 7f295f7c3700 1 --2- 172.21.15.96:0/3678158491 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2958101850 0x7f29581058a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:20.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.081+0000 7f295f7c3700 1 --2- 172.21.15.96:0/3678158491 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2958100ea0 0x7f2958101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:20.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.081+0000 7f295f7c3700 1 -- 172.21.15.96:0/3678158491 >> 172.21.15.96:0/3678158491 conn(0x7f29580fc750 msgr2=0x7f29580feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:20.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.081+0000 7f295f7c3700 1 -- 172.21.15.96:0/3678158491 shutdown_connections 2024-02-19T19:01:20.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.081+0000 7f295f7c3700 1 -- 172.21.15.96:0/3678158491 wait complete. 2024-02-19T19:01:20.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.081+0000 7f295f7c3700 1 Processor -- start 2024-02-19T19:01:20.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.081+0000 7f295f7c3700 1 -- start start 2024-02-19T19:01:20.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.082+0000 7f295f7c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2958100ea0 0x7f2958196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:20.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.082+0000 7f295f7c3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2958101850 0x7f2958196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:20.102 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.082+0000 7f295f7c3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2958197540 con 0x7f2958100ea0 2024-02-19T19:01:20.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.082+0000 7f295f7c3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295819b350 con 0x7f2958101850 2024-02-19T19:01:20.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.082+0000 7f295d55f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2958100ea0 0x7f2958196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:20.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.082+0000 7f295d55f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2958100ea0 0x7f2958196970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37204/0 (socket says 172.21.15.96:37204) 2024-02-19T19:01:20.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.082+0000 7f295d55f700 1 -- 172.21.15.96:0/3503855042 learned_addr learned my addr 172.21.15.96:0/3503855042 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:20.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.082+0000 7f295cd5e700 1 --2- 172.21.15.96:0/3503855042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2958101850 0x7f2958196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:20.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.082+0000 7f295d55f700 1 -- 172.21.15.96:0/3503855042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2958101850 msgr2=0x7f2958196eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:20.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.082+0000 7f295d55f700 1 --2- 172.21.15.96:0/3503855042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2958101850 0x7f2958196eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:20.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.082+0000 7f295d55f700 1 -- 172.21.15.96:0/3503855042 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29480095f0 con 0x7f2958100ea0 2024-02-19T19:01:20.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.082+0000 7f295cd5e700 1 --2- 172.21.15.96:0/3503855042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2958101850 0x7f2958196eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:01:20.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.082+0000 7f295d55f700 1 --2- 172.21.15.96:0/3503855042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2958100ea0 0x7f2958196970 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f295000b4b0 tx=0x7f295000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:20.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.082+0000 7f294e7fc700 1 -- 172.21.15.96:0/3503855042 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2950011800 con 0x7f2958100ea0 2024-02-19T19:01:20.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.082+0000 7f295f7c3700 1 -- 172.21.15.96:0/3503855042 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295819b630 con 0x7f2958100ea0 2024-02-19T19:01:20.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.082+0000 7f294e7fc700 1 -- 172.21.15.96:0/3503855042 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2950011e10 con 0x7f2958100ea0 2024-02-19T19:01:20.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.082+0000 7f294e7fc700 1 -- 172.21.15.96:0/3503855042 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f295000f2e0 con 0x7f2958100ea0 2024-02-19T19:01:20.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.082+0000 7f295f7c3700 1 -- 172.21.15.96:0/3503855042 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295819bb50 con 0x7f2958100ea0 2024-02-19T19:01:20.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.083+0000 7f295f7c3700 1 -- 172.21.15.96:0/3503855042 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29581091d0 con 0x7f2958100ea0 2024-02-19T19:01:20.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.084+0000 7f294e7fc700 1 -- 172.21.15.96:0/3503855042 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f2950010380 con 0x7f2958100ea0 2024-02-19T19:01:20.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.084+0000 7f294e7fc700 1 --2- 172.21.15.96:0/3503855042 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f294406c4e0 0x7f294406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:20.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.084+0000 7f294e7fc700 1 -- 172.21.15.96:0/3503855042 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f295008b170 con 0x7f2958100ea0 2024-02-19T19:01:20.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.084+0000 7f295cd5e700 1 --2- 172.21.15.96:0/3503855042 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f294406c4e0 0x7f294406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:20.104 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.085+0000 7f295cd5e700 1 --2- 172.21.15.96:0/3503855042 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f294406c4e0 0x7f294406e9a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f29581978e0 tx=0x7f294801a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:20.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.089+0000 7f294e7fc700 1 -- 172.21.15.96:0/3503855042 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f2950059720 con 0x7f2958100ea0 2024-02-19T19:01:20.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.274+0000 7f295f7c3700 1 -- 172.21.15.96:0/3503855042 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2958197d40 con 0x7f294406c4e0 2024-02-19T19:01:20.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.276+0000 7f294e7fc700 1 -- 172.21.15.96:0/3503855042 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28006 (secure 0 0 0) 0x7f2958197d40 con 0x7f294406c4e0 2024-02-19T19:01:20.295 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:01:20.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.278+0000 7f295f7c3700 1 -- 172.21.15.96:0/3503855042 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f294406c4e0 msgr2=0x7f294406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:20.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.278+0000 7f295f7c3700 1 --2- 172.21.15.96:0/3503855042 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f294406c4e0 0x7f294406e9a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f29581978e0 tx=0x7f294801a040 comp rx=0 tx=0).stop 2024-02-19T19:01:20.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.278+0000 7f295f7c3700 1 -- 172.21.15.96:0/3503855042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2958100ea0 msgr2=0x7f2958196970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:20.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.278+0000 7f295f7c3700 1 --2- 172.21.15.96:0/3503855042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2958100ea0 0x7f2958196970 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f295000b4b0 tx=0x7f295000b870 comp rx=0 tx=0).stop 2024-02-19T19:01:20.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.278+0000 7f295f7c3700 1 -- 172.21.15.96:0/3503855042 shutdown_connections 2024-02-19T19:01:20.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.278+0000 7f295f7c3700 1 --2- 172.21.15.96:0/3503855042 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f294406c4e0 0x7f294406e9a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:20.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.278+0000 7f295f7c3700 1 --2- 172.21.15.96:0/3503855042 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2958100ea0 0x7f2958196970 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:20.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.278+0000 7f295f7c3700 1 --2- 172.21.15.96:0/3503855042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2958101850 0x7f2958196eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:20.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.278+0000 7f295f7c3700 1 -- 172.21.15.96:0/3503855042 >> 172.21.15.96:0/3503855042 conn(0x7f29580fc750 msgr2=0x7f29580fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:20.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.278+0000 7f295f7c3700 1 -- 172.21.15.96:0/3503855042 shutdown_connections 2024-02-19T19:01:20.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:20.278+0000 7f295f7c3700 1 -- 172.21.15.96:0/3503855042 wait complete. 2024-02-19T19:01:20.298 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-02-19T19:01:20.959 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-02-19T19:01:19.807375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165584,"kb_used_data":3872,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305328,"statfs":{"total":575970213888,"available":575800655872,"internally_reserved":0,"allocated":3964928,"data_stored":2608497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002007"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":187,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-19T19:00:27.901357+0000","last_change":"2024-02-19T19:00:02.031631+0000","last_active":"2024-02-19T19:00:27.901357+0000","last_peered":"2024-02-19T19:00:27.901357+0000","last_clean":"2024-02-19T19:00:27.901357+0000","last_became_active":"2024-02-19T19:00:02.031308+0000","last_became_peered":"2024-02-19T19:00:02.031308+0000","last_unstale":"2024-02-19T19:00:27.901357+0000","last_undegraded":"2024-02-19T19:00:27.901357+0000","last_fullsized":"2024-02-19T19:00:27.901357+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-19T18:59:14.499588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-19T18:59:14.499588+0000","last_clean_scrub_stamp":"2024-02-19T18:59:14.499588+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-20T19:09:04.824047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724557,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]}]},{"osd":4,"up_from":34,"seq":146028888082,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 19:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.55300000000000005}]},{"osd":1,"last update":"Mon Feb 19 19:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.51700000000000002}]},{"osd":2,"last update":"Mon Feb 19 19:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.496},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.52800000000000002}]},{"osd":3,"last update":"Mon Feb 19 19:01:02 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.28899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]}]},{"osd":3,"up_from":26,"seq":111669149719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 19:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.438}]},{"osd":1,"last update":"Mon Feb 19 19:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.374}]},{"osd":2,"last update":"Mon Feb 19 19:00:43 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.42699999999999999}]},{"osd":4,"last update":"Mon Feb 19 19:01:07 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.32500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27304,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717848,"statfs":{"total":95995035648,"available":95967076352,"internally_reserved":0,"allocated":360448,"data_stored":139008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 19:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.35899999999999999,"15min":0.36499999999999999},"min":{"1min":0.249,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.51800000000000002,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.315},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.36499999999999999,"15min":0.372},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.46800000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.27200000000000002}]},{"osd":1,"last update":"Mon Feb 19 19:01:17 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.36299999999999999,"15min":0.37},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.47799999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.38300000000000001,"15min":0.39000000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.47499999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.28799999999999998}]},{"osd":3,"last update":"Mon Feb 19 19:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.64000000000000001}]},{"osd":4,"last update":"Mon Feb 19 19:01:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":19.071999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 19 19:00:51 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.34000000000000002,"15min":0.33600000000000002},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.308},{"interface":"front","average":{"1min":0.37,"5min":0.34599999999999997,"15min":0.34200000000000003},"min":{"1min":0.23799999999999999,"5min":0.214,"15min":0.214},"max":{"1min":0.51800000000000002,"5min":0.54400000000000004,"15min":0.54400000000000004},"last":0.24099999999999999}]},{"osd":2,"last update":"Mon Feb 19 19:00:18 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.374},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.27400000000000002}]},{"osd":3,"last update":"Mon Feb 19 19:00:39 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.45000000000000001}]},{"osd":4,"last update":"Mon Feb 19 19:01:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.41599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 19 19:00:49 2024","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.32400000000000001,"15min":0.32000000000000001},"min":{"1min":0.23699999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.32800000000000001,"15min":0.32300000000000001},"min":{"1min":0.245,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.50800000000000001,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.39400000000000002}]},{"osd":2,"last update":"Mon Feb 19 19:00:16 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"last":0.38},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.35099999999999998}]},{"osd":3,"last update":"Mon Feb 19 19:00:40 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.68200000000000005}]},{"osd":4,"last update":"Mon Feb 19 19:01:03 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-19T19:01:20.960 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-19T19:01:20.960 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-19T19:01:20.961 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-19T19:01:20.961 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph health --format=json 2024-02-19T19:01:21.171 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:01:21.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:20 smithi125 ceph-mon[37556]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:21.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:20 smithi096 ceph-mon[29216]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:22.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:21 smithi125 ceph-mon[37556]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T19:01:22.219 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:21 smithi096 ceph-mon[29216]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-19T19:01:22.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.669+0000 7f6000d6a700 1 -- 172.21.15.96:0/1739208109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ffc105bd0 msgr2=0x7f5ffc105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:22.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.669+0000 7f6000d6a700 1 --2- 172.21.15.96:0/1739208109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ffc105bd0 0x7f5ffc105fb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009910 tx=0x7f5fec009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:22.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.669+0000 7f6000d6a700 1 -- 172.21.15.96:0/1739208109 shutdown_connections 2024-02-19T19:01:22.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.669+0000 7f6000d6a700 1 --2- 172.21.15.96:0/1739208109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ffc0ffc20 0x7f5ffc100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:22.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.669+0000 7f6000d6a700 1 --2- 172.21.15.96:0/1739208109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ffc105bd0 0x7f5ffc105fb0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:22.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.669+0000 7f6000d6a700 1 -- 172.21.15.96:0/1739208109 >> 172.21.15.96:0/1739208109 conn(0x7f5ffc075670 msgr2=0x7f5ffc075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:22.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.669+0000 7f6000d6a700 1 -- 172.21.15.96:0/1739208109 shutdown_connections 2024-02-19T19:01:22.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.669+0000 7f6000d6a700 1 -- 172.21.15.96:0/1739208109 wait complete. 2024-02-19T19:01:22.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.669+0000 7f6000d6a700 1 Processor -- start 2024-02-19T19:01:22.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.670+0000 7f6000d6a700 1 -- start start 2024-02-19T19:01:22.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.670+0000 7f6000d6a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ffc0ffc20 0x7f5ffc1954c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:22.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.670+0000 7f6000d6a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ffc105bd0 0x7f5ffc195a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:22.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.670+0000 7f6000d6a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc069520 con 0x7f5ffc0ffc20 2024-02-19T19:01:22.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.670+0000 7f6000d6a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc195f40 con 0x7f5ffc105bd0 2024-02-19T19:01:22.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.670+0000 7f5ffa59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ffc0ffc20 0x7f5ffc1954c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:22.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.670+0000 7f5ffa59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ffc0ffc20 0x7f5ffc1954c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:37222/0 (socket says 172.21.15.96:37222) 2024-02-19T19:01:22.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.670+0000 7f5ffa59c700 1 -- 172.21.15.96:0/4119885484 learned_addr learned my addr 172.21.15.96:0/4119885484 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:22.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.670+0000 7f5ff1d9b700 1 --2- 172.21.15.96:0/4119885484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ffc105bd0 0x7f5ffc195a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:22.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.670+0000 7f5ffa59c700 1 -- 172.21.15.96:0/4119885484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ffc105bd0 msgr2=0x7f5ffc195a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:22.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.670+0000 7f5ffa59c700 1 --2- 172.21.15.96:0/4119885484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ffc105bd0 0x7f5ffc195a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:22.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.670+0000 7f5ffa59c700 1 -- 172.21.15.96:0/4119885484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec0095f0 con 0x7f5ffc0ffc20 2024-02-19T19:01:22.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.670+0000 7f5ff1d9b700 1 --2- 172.21.15.96:0/4119885484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ffc105bd0 0x7f5ffc195a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:01:22.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.670+0000 7f5ffa59c700 1 --2- 172.21.15.96:0/4119885484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ffc0ffc20 0x7f5ffc1954c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5fec006010 tx=0x7f5fec00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:22.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.671+0000 7f5ff3fff700 1 -- 172.21.15.96:0/4119885484 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fec01d070 con 0x7f5ffc0ffc20 2024-02-19T19:01:22.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.671+0000 7f5ff3fff700 1 -- 172.21.15.96:0/4119885484 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5fec00f460 con 0x7f5ffc0ffc20 2024-02-19T19:01:22.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.671+0000 7f6000d6a700 1 -- 172.21.15.96:0/4119885484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ffc1961c0 con 0x7f5ffc0ffc20 2024-02-19T19:01:22.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.671+0000 7f5ff3fff700 1 -- 172.21.15.96:0/4119885484 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fec021640 con 0x7f5ffc0ffc20 2024-02-19T19:01:22.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.671+0000 7f6000d6a700 1 -- 172.21.15.96:0/4119885484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ffc1a2d00 con 0x7f5ffc0ffc20 2024-02-19T19:01:22.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.672+0000 7f6000d6a700 1 -- 172.21.15.96:0/4119885484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ffc1080f0 con 0x7f5ffc0ffc20 2024-02-19T19:01:22.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.672+0000 7f5ff3fff700 1 -- 172.21.15.96:0/4119885484 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f5fec00faf0 con 0x7f5ffc0ffc20 2024-02-19T19:01:22.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.672+0000 7f5ff3fff700 1 --2- 172.21.15.96:0/4119885484 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f5fe806c4e0 0x7f5fe806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:22.692 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.673+0000 7f5ff3fff700 1 -- 172.21.15.96:0/4119885484 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f5fec08c6d0 con 0x7f5ffc0ffc20 2024-02-19T19:01:22.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.673+0000 7f5ff1d9b700 1 --2- 172.21.15.96:0/4119885484 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f5fe806c4e0 0x7f5fe806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:22.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.673+0000 7f5ff1d9b700 1 --2- 172.21.15.96:0/4119885484 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f5fe806c4e0 0x7f5fe806e9a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4005fd0 tx=0x7f5fe4005e20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:22.695 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.677+0000 7f5ff3fff700 1 -- 172.21.15.96:0/4119885484 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f5fec057270 con 0x7f5ffc0ffc20 2024-02-19T19:01:22.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.910+0000 7f6000d6a700 1 -- 172.21.15.96:0/4119885484 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5ffc04f2e0 con 0x7f5ffc0ffc20 2024-02-19T19:01:22.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.910+0000 7f5ff3fff700 1 -- 172.21.15.96:0/4119885484 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f5fec05a890 con 0x7f5ffc0ffc20 2024-02-19T19:01:22.929 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:01:22.929 INFO:teuthology.orchestra.run.smithi096.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-19T19:01:22.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.912+0000 7f6000d6a700 1 -- 172.21.15.96:0/4119885484 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f5fe806c4e0 msgr2=0x7f5fe806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:22.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.912+0000 7f6000d6a700 1 --2- 172.21.15.96:0/4119885484 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f5fe806c4e0 0x7f5fe806e9a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4005fd0 tx=0x7f5fe4005e20 comp rx=0 tx=0).stop 2024-02-19T19:01:22.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.912+0000 7f6000d6a700 1 -- 172.21.15.96:0/4119885484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ffc0ffc20 msgr2=0x7f5ffc1954c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:22.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.912+0000 7f6000d6a700 1 --2- 172.21.15.96:0/4119885484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ffc0ffc20 0x7f5ffc1954c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5fec006010 tx=0x7f5fec00be20 comp rx=0 tx=0).stop 2024-02-19T19:01:22.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.912+0000 7f6000d6a700 1 -- 172.21.15.96:0/4119885484 shutdown_connections 2024-02-19T19:01:22.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.912+0000 7f6000d6a700 1 --2- 172.21.15.96:0/4119885484 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f5fe806c4e0 0x7f5fe806e9a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:22.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.912+0000 7f6000d6a700 1 --2- 172.21.15.96:0/4119885484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ffc0ffc20 0x7f5ffc1954c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:22.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.912+0000 7f6000d6a700 1 --2- 172.21.15.96:0/4119885484 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5ffc105bd0 0x7f5ffc195a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:22.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.912+0000 7f6000d6a700 1 -- 172.21.15.96:0/4119885484 >> 172.21.15.96:0/4119885484 conn(0x7f5ffc075670 msgr2=0x7f5ffc0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:22.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.912+0000 7f6000d6a700 1 -- 172.21.15.96:0/4119885484 shutdown_connections 2024-02-19T19:01:22.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:22.912+0000 7f6000d6a700 1 -- 172.21.15.96:0/4119885484 wait complete. 2024-02-19T19:01:23.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:22 smithi125 ceph-mon[37556]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:23.276 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:22 smithi096 ceph-mon[29216]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:23.583 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-19T19:01:23.583 INFO:tasks.cephadm:Setup complete, yielding 2024-02-19T19:01:23.584 INFO:teuthology.run_tasks:Running task print... 2024-02-19T19:01:23.593 INFO:teuthology.task.print:**** done end installing v18.2.1 cephadm ... 2024-02-19T19:01:23.593 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-19T19:01:23.614 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi096.front.sepia.ceph.com 2024-02-19T19:01:23.614 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-02-19T19:01:23.822 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:01:24.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:23 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/4119885484' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-19T19:01:24.229 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:23 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/4119885484' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-19T19:01:25.141 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:24 smithi096 ceph-mon[29216]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:25.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:24 smithi125 ceph-mon[37556]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:25.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.328+0000 7f0a2397c700 1 -- 172.21.15.96:0/3382591941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a1c100cb0 msgr2=0x7f0a1c1010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:25.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.328+0000 7f0a2397c700 1 --2- 172.21.15.96:0/3382591941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a1c100cb0 0x7f0a1c1010d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0a18009910 tx=0x7f0a18009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:25.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.328+0000 7f0a2397c700 1 -- 172.21.15.96:0/3382591941 shutdown_connections 2024-02-19T19:01:25.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.328+0000 7f0a2397c700 1 --2- 172.21.15.96:0/3382591941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a1c101eb0 0x7f0a1c102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.328+0000 7f0a2397c700 1 --2- 172.21.15.96:0/3382591941 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a1c100cb0 0x7f0a1c1010d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.328+0000 7f0a2397c700 1 -- 172.21.15.96:0/3382591941 >> 172.21.15.96:0/3382591941 conn(0x7f0a1c0fc230 msgr2=0x7f0a1c0fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:25.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.328+0000 7f0a2397c700 1 -- 172.21.15.96:0/3382591941 shutdown_connections 2024-02-19T19:01:25.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.328+0000 7f0a2397c700 1 -- 172.21.15.96:0/3382591941 wait complete. 2024-02-19T19:01:25.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.329+0000 7f0a2397c700 1 Processor -- start 2024-02-19T19:01:25.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.329+0000 7f0a2397c700 1 -- start start 2024-02-19T19:01:25.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.329+0000 7f0a2397c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a1c100cb0 0x7f0a1c196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:25.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.329+0000 7f0a2397c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a1c101eb0 0x7f0a1c196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:25.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.329+0000 7f0a2397c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c1970c0 con 0x7f0a1c101eb0 2024-02-19T19:01:25.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.329+0000 7f0a2397c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c197200 con 0x7f0a1c100cb0 2024-02-19T19:01:25.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.329+0000 7f0a20f17700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a1c101eb0 0x7f0a1c196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:25.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.329+0000 7f0a20f17700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a1c101eb0 0x7f0a1c196aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53768/0 (socket says 172.21.15.96:53768) 2024-02-19T19:01:25.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.329+0000 7f0a20f17700 1 -- 172.21.15.96:0/310076387 learned_addr learned my addr 172.21.15.96:0/310076387 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:25.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.329+0000 7f0a21718700 1 --2- 172.21.15.96:0/310076387 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a1c100cb0 0x7f0a1c196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:25.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.330+0000 7f0a20f17700 1 -- 172.21.15.96:0/310076387 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a1c100cb0 msgr2=0x7f0a1c196560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:25.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.330+0000 7f0a20f17700 1 --2- 172.21.15.96:0/310076387 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a1c100cb0 0x7f0a1c196560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.330+0000 7f0a20f17700 1 -- 172.21.15.96:0/310076387 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a180095f0 con 0x7f0a1c101eb0 2024-02-19T19:01:25.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.330+0000 7f0a21718700 1 --2- 172.21.15.96:0/310076387 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a1c100cb0 0x7f0a1c196560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:01:25.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.330+0000 7f0a20f17700 1 --2- 172.21.15.96:0/310076387 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a1c101eb0 0x7f0a1c196aa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00b4b0 tx=0x7f0a0c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:25.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.330+0000 7f0a127fc700 1 -- 172.21.15.96:0/310076387 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a0c011800 con 0x7f0a1c101eb0 2024-02-19T19:01:25.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.330+0000 7f0a2397c700 1 -- 172.21.15.96:0/310076387 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1c19bcb0 con 0x7f0a1c101eb0 2024-02-19T19:01:25.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.330+0000 7f0a127fc700 1 -- 172.21.15.96:0/310076387 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0a0c011e10 con 0x7f0a1c101eb0 2024-02-19T19:01:25.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.330+0000 7f0a127fc700 1 -- 172.21.15.96:0/310076387 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a0c00f2e0 con 0x7f0a1c101eb0 2024-02-19T19:01:25.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.330+0000 7f0a2397c700 1 -- 172.21.15.96:0/310076387 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1c19c200 con 0x7f0a1c101eb0 2024-02-19T19:01:25.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.331+0000 7f0a2397c700 1 -- 172.21.15.96:0/310076387 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1c109890 con 0x7f0a1c101eb0 2024-02-19T19:01:25.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.331+0000 7f0a127fc700 1 -- 172.21.15.96:0/310076387 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f0a0c010380 con 0x7f0a1c101eb0 2024-02-19T19:01:25.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.332+0000 7f0a127fc700 1 --2- 172.21.15.96:0/310076387 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f0a0806c4e0 0x7f0a0806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:25.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.332+0000 7f0a127fc700 1 -- 172.21.15.96:0/310076387 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f0a0c08b150 con 0x7f0a1c101eb0 2024-02-19T19:01:25.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.332+0000 7f0a21718700 1 --2- 172.21.15.96:0/310076387 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f0a0806c4e0 0x7f0a0806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:25.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.332+0000 7f0a21718700 1 --2- 172.21.15.96:0/310076387 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f0a0806c4e0 0x7f0a0806e9a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0a18006010 tx=0x7f0a1800b580 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:25.355 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.336+0000 7f0a127fc700 1 -- 172.21.15.96:0/310076387 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f0a0c059700 con 0x7f0a1c101eb0 2024-02-19T19:01:25.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.529+0000 7f0a2397c700 1 -- 172.21.15.96:0/310076387 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f0a1c109a80 con 0x7f0a1c101eb0 2024-02-19T19:01:25.552 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.533+0000 7f0a127fc700 1 -- 172.21.15.96:0/310076387 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f0a0c059290 con 0x7f0a1c101eb0 2024-02-19T19:01:25.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.536+0000 7f0a2397c700 1 -- 172.21.15.96:0/310076387 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f0a0806c4e0 msgr2=0x7f0a0806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:25.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.536+0000 7f0a2397c700 1 --2- 172.21.15.96:0/310076387 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f0a0806c4e0 0x7f0a0806e9a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0a18006010 tx=0x7f0a1800b580 comp rx=0 tx=0).stop 2024-02-19T19:01:25.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.536+0000 7f0a2397c700 1 -- 172.21.15.96:0/310076387 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a1c101eb0 msgr2=0x7f0a1c196aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:25.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.536+0000 7f0a2397c700 1 --2- 172.21.15.96:0/310076387 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a1c101eb0 0x7f0a1c196aa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00b4b0 tx=0x7f0a0c00b870 comp rx=0 tx=0).stop 2024-02-19T19:01:25.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.536+0000 7f0a2397c700 1 -- 172.21.15.96:0/310076387 shutdown_connections 2024-02-19T19:01:25.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.536+0000 7f0a2397c700 1 --2- 172.21.15.96:0/310076387 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f0a0806c4e0 0x7f0a0806e9a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.536+0000 7f0a2397c700 1 --2- 172.21.15.96:0/310076387 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a1c100cb0 0x7f0a1c196560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.536+0000 7f0a2397c700 1 --2- 172.21.15.96:0/310076387 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a1c101eb0 0x7f0a1c196aa0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:25.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.536+0000 7f0a2397c700 1 -- 172.21.15.96:0/310076387 >> 172.21.15.96:0/310076387 conn(0x7f0a1c0fc230 msgr2=0x7f0a1c1050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:25.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.536+0000 7f0a2397c700 1 -- 172.21.15.96:0/310076387 shutdown_connections 2024-02-19T19:01:25.555 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:25.536+0000 7f0a2397c700 1 -- 172.21.15.96:0/310076387 wait complete. 2024-02-19T19:01:26.128 INFO:teuthology.run_tasks:Running task print... 2024-02-19T19:01:26.136 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-02-19T19:01:26.136 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-19T19:01:26.154 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi096.front.sepia.ceph.com 2024-02-19T19:01:26.155 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- bash -c 'ceph orch status' 2024-02-19T19:01:26.360 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:01:26.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:26 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/310076387' entity='client.admin' 2024-02-19T19:01:26.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:01:26.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:01:26.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:01:26.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:26 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:26.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:26 smithi125 ceph-mon[37556]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:26.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:26 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/310076387' entity='client.admin' 2024-02-19T19:01:26.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:26 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:01:26.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:26 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:01:26.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:26 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:01:26.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:26 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:26.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:26 smithi096 ceph-mon[29216]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:27.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.790+0000 7fcb747e7700 1 -- 172.21.15.96:0/799360771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb6c100db0 msgr2=0x7fcb6c101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:27.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.790+0000 7fcb747e7700 1 --2- 172.21.15.96:0/799360771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb6c100db0 0x7fcb6c101210 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009910 tx=0x7fcb5c009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:27.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.790+0000 7fcb747e7700 1 -- 172.21.15.96:0/799360771 shutdown_connections 2024-02-19T19:01:27.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.790+0000 7fcb747e7700 1 --2- 172.21.15.96:0/799360771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb6c100db0 0x7fcb6c101210 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:27.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.790+0000 7fcb747e7700 1 --2- 172.21.15.96:0/799360771 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb6c0ffbb0 0x7fcb6c0fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:27.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.790+0000 7fcb747e7700 1 -- 172.21.15.96:0/799360771 >> 172.21.15.96:0/799360771 conn(0x7fcb6c0fb150 msgr2=0x7fcb6c0fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:27.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.790+0000 7fcb747e7700 1 -- 172.21.15.96:0/799360771 shutdown_connections 2024-02-19T19:01:27.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.790+0000 7fcb747e7700 1 -- 172.21.15.96:0/799360771 wait complete. 2024-02-19T19:01:27.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.790+0000 7fcb747e7700 1 Processor -- start 2024-02-19T19:01:27.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.790+0000 7fcb747e7700 1 -- start start 2024-02-19T19:01:27.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.791+0000 7fcb747e7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb6c0ffbb0 0x7fcb6c195450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:27.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.791+0000 7fcb747e7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb6c100db0 0x7fcb6c195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:27.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.791+0000 7fcb747e7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c195fb0 con 0x7fcb6c100db0 2024-02-19T19:01:27.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.791+0000 7fcb747e7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c1960f0 con 0x7fcb6c0ffbb0 2024-02-19T19:01:27.811 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.791+0000 7fcb71d82700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb6c100db0 0x7fcb6c195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:27.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.791+0000 7fcb71d82700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb6c100db0 0x7fcb6c195990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53782/0 (socket says 172.21.15.96:53782) 2024-02-19T19:01:27.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.791+0000 7fcb71d82700 1 -- 172.21.15.96:0/2359345762 learned_addr learned my addr 172.21.15.96:0/2359345762 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:27.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.791+0000 7fcb72583700 1 --2- 172.21.15.96:0/2359345762 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb6c0ffbb0 0x7fcb6c195450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:27.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.791+0000 7fcb71d82700 1 -- 172.21.15.96:0/2359345762 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb6c0ffbb0 msgr2=0x7fcb6c195450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:27.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.791+0000 7fcb71d82700 1 --2- 172.21.15.96:0/2359345762 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb6c0ffbb0 0x7fcb6c195450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:27.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.791+0000 7fcb71d82700 1 -- 172.21.15.96:0/2359345762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5c0095f0 con 0x7fcb6c100db0 2024-02-19T19:01:27.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.791+0000 7fcb71d82700 1 --2- 172.21.15.96:0/2359345762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb6c100db0 0x7fcb6c195990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00b5c0 tx=0x7fcb5c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:27.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.791+0000 7fcb637fe700 1 -- 172.21.15.96:0/2359345762 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb5c01d070 con 0x7fcb6c100db0 2024-02-19T19:01:27.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.791+0000 7fcb637fe700 1 -- 172.21.15.96:0/2359345762 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcb5c022470 con 0x7fcb6c100db0 2024-02-19T19:01:27.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.791+0000 7fcb747e7700 1 -- 172.21.15.96:0/2359345762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6c19ab40 con 0x7fcb6c100db0 2024-02-19T19:01:27.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.791+0000 7fcb637fe700 1 -- 172.21.15.96:0/2359345762 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb5c00f690 con 0x7fcb6c100db0 2024-02-19T19:01:27.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.792+0000 7fcb747e7700 1 -- 172.21.15.96:0/2359345762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6c19b030 con 0x7fcb6c100db0 2024-02-19T19:01:27.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.792+0000 7fcb747e7700 1 -- 172.21.15.96:0/2359345762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6c1087b0 con 0x7fcb6c100db0 2024-02-19T19:01:27.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.793+0000 7fcb637fe700 1 -- 172.21.15.96:0/2359345762 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fcb5c004b70 con 0x7fcb6c100db0 2024-02-19T19:01:27.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.793+0000 7fcb637fe700 1 --2- 172.21.15.96:0/2359345762 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fcb5806c4e0 0x7fcb5806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:27.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.793+0000 7fcb637fe700 1 -- 172.21.15.96:0/2359345762 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fcb5c08cb70 con 0x7fcb6c100db0 2024-02-19T19:01:27.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.793+0000 7fcb72583700 1 --2- 172.21.15.96:0/2359345762 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fcb5806c4e0 0x7fcb5806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:27.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.794+0000 7fcb72583700 1 --2- 172.21.15.96:0/2359345762 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fcb5806c4e0 0x7fcb5806e9a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c100c10 tx=0x7fcb640072f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:27.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:27.798+0000 7fcb637fe700 1 -- 172.21.15.96:0/2359345762 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fcb5c05b250 con 0x7fcb6c100db0 2024-02-19T19:01:28.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:28.008+0000 7fcb747e7700 1 -- 172.21.15.96:0/2359345762 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb6c105700 con 0x7fcb5806c4e0 2024-02-19T19:01:28.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:28.009+0000 7fcb637fe700 1 -- 172.21.15.96:0/2359345762 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fcb6c105700 con 0x7fcb5806c4e0 2024-02-19T19:01:28.028 INFO:teuthology.orchestra.run.smithi096.stdout:Backend: cephadm 2024-02-19T19:01:28.028 INFO:teuthology.orchestra.run.smithi096.stdout:Available: Yes 2024-02-19T19:01:28.028 INFO:teuthology.orchestra.run.smithi096.stdout:Paused: No 2024-02-19T19:01:28.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:28.011+0000 7fcb747e7700 1 -- 172.21.15.96:0/2359345762 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fcb5806c4e0 msgr2=0x7fcb5806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:28.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:28.011+0000 7fcb747e7700 1 --2- 172.21.15.96:0/2359345762 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fcb5806c4e0 0x7fcb5806e9a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c100c10 tx=0x7fcb640072f0 comp rx=0 tx=0).stop 2024-02-19T19:01:28.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:28.011+0000 7fcb747e7700 1 -- 172.21.15.96:0/2359345762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb6c100db0 msgr2=0x7fcb6c195990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:28.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:28.011+0000 7fcb747e7700 1 --2- 172.21.15.96:0/2359345762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb6c100db0 0x7fcb6c195990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00b5c0 tx=0x7fcb5c00be20 comp rx=0 tx=0).stop 2024-02-19T19:01:28.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:28.011+0000 7fcb747e7700 1 -- 172.21.15.96:0/2359345762 shutdown_connections 2024-02-19T19:01:28.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:28.011+0000 7fcb747e7700 1 --2- 172.21.15.96:0/2359345762 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fcb5806c4e0 0x7fcb5806e9a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:28.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:28.011+0000 7fcb747e7700 1 --2- 172.21.15.96:0/2359345762 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb6c0ffbb0 0x7fcb6c195450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:28.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:28.011+0000 7fcb747e7700 1 --2- 172.21.15.96:0/2359345762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb6c100db0 0x7fcb6c195990 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:28.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:28.011+0000 7fcb747e7700 1 -- 172.21.15.96:0/2359345762 >> 172.21.15.96:0/2359345762 conn(0x7fcb6c0fb150 msgr2=0x7fcb6c103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:28.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:28.012+0000 7fcb747e7700 1 -- 172.21.15.96:0/2359345762 shutdown_connections 2024-02-19T19:01:28.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:28.012+0000 7fcb747e7700 1 -- 172.21.15.96:0/2359345762 wait complete. 2024-02-19T19:01:28.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:27 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:01:28.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:27 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:01:28.618 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- bash -c 'ceph orch ps' 2024-02-19T19:01:28.823 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:01:29.148 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:28 smithi096 ceph-mon[29216]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:29.148 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:28 smithi096 ceph-mon[29216]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:29.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:28 smithi125 ceph-mon[37556]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:29.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:28 smithi125 ceph-mon[37556]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:30.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.335+0000 7f57c6726700 1 -- 172.21.15.96:0/356944075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c0101eb0 msgr2=0x7f57c0102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:30.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.335+0000 7f57c6726700 1 --2- 172.21.15.96:0/356944075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c0101eb0 0x7f57c0102310 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f57b4009910 tx=0x7f57b4009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:30.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.335+0000 7f57c6726700 1 -- 172.21.15.96:0/356944075 shutdown_connections 2024-02-19T19:01:30.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.335+0000 7f57c6726700 1 --2- 172.21.15.96:0/356944075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c0101eb0 0x7f57c0102310 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:30.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.335+0000 7f57c6726700 1 --2- 172.21.15.96:0/356944075 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57c0100cb0 0x7f57c01010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:30.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.335+0000 7f57c6726700 1 -- 172.21.15.96:0/356944075 >> 172.21.15.96:0/356944075 conn(0x7f57c00fc230 msgr2=0x7f57c00fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:30.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.335+0000 7f57c6726700 1 -- 172.21.15.96:0/356944075 shutdown_connections 2024-02-19T19:01:30.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.335+0000 7f57c6726700 1 -- 172.21.15.96:0/356944075 wait complete. 2024-02-19T19:01:30.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.336+0000 7f57c6726700 1 Processor -- start 2024-02-19T19:01:30.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.336+0000 7f57c6726700 1 -- start start 2024-02-19T19:01:30.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.336+0000 7f57c6726700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57c0100cb0 0x7f57c0074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:30.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.336+0000 7f57c6726700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c0101eb0 0x7f57c0073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:30.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.336+0000 7f57c6726700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c00736c0 con 0x7f57c0101eb0 2024-02-19T19:01:30.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.336+0000 7f57c6726700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c0073800 con 0x7f57c0100cb0 2024-02-19T19:01:30.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.336+0000 7f57bf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c0101eb0 0x7f57c0073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:30.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.336+0000 7f57bf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c0101eb0 0x7f57c0073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53814/0 (socket says 172.21.15.96:53814) 2024-02-19T19:01:30.364 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.336+0000 7f57bf7fe700 1 -- 172.21.15.96:0/86710634 learned_addr learned my addr 172.21.15.96:0/86710634 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:30.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.337+0000 7f57bffff700 1 --2- 172.21.15.96:0/86710634 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57c0100cb0 0x7f57c0074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:30.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.337+0000 7f57bf7fe700 1 -- 172.21.15.96:0/86710634 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57c0100cb0 msgr2=0x7f57c0074b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:30.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.337+0000 7f57bf7fe700 1 --2- 172.21.15.96:0/86710634 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57c0100cb0 0x7f57c0074b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:30.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.337+0000 7f57bf7fe700 1 -- 172.21.15.96:0/86710634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b40095f0 con 0x7f57c0101eb0 2024-02-19T19:01:30.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.337+0000 7f57bf7fe700 1 --2- 172.21.15.96:0/86710634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c0101eb0 0x7f57c0073180 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f57b4006010 tx=0x7f57b400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:30.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.337+0000 7f57bd7fa700 1 -- 172.21.15.96:0/86710634 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57b401d070 con 0x7f57c0101eb0 2024-02-19T19:01:30.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.337+0000 7f57c6726700 1 -- 172.21.15.96:0/86710634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c0073a80 con 0x7f57c0101eb0 2024-02-19T19:01:30.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.337+0000 7f57bd7fa700 1 -- 172.21.15.96:0/86710634 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f57b400f460 con 0x7f57c0101eb0 2024-02-19T19:01:30.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.337+0000 7f57bd7fa700 1 -- 172.21.15.96:0/86710634 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57b4021640 con 0x7f57c0101eb0 2024-02-19T19:01:30.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.337+0000 7f57c6726700 1 -- 172.21.15.96:0/86710634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c0073f70 con 0x7f57c0101eb0 2024-02-19T19:01:30.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.338+0000 7f57c6726700 1 -- 172.21.15.96:0/86710634 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c0109810 con 0x7f57c0101eb0 2024-02-19T19:01:30.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.338+0000 7f57bd7fa700 1 -- 172.21.15.96:0/86710634 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f57b400fab0 con 0x7f57c0101eb0 2024-02-19T19:01:30.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.339+0000 7f57bd7fa700 1 --2- 172.21.15.96:0/86710634 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f57a806c4e0 0x7f57a806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:30.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.339+0000 7f57bd7fa700 1 -- 172.21.15.96:0/86710634 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f57b408c8f0 con 0x7f57c0101eb0 2024-02-19T19:01:30.365 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.339+0000 7f57bffff700 1 --2- 172.21.15.96:0/86710634 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f57a806c4e0 0x7f57a806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:30.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.339+0000 7f57bffff700 1 --2- 172.21.15.96:0/86710634 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f57a806c4e0 0x7f57a806e9a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f57b0005fd0 tx=0x7f57b0005dd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:30.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.343+0000 7f57bd7fa700 1 -- 172.21.15.96:0/86710634 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f57b405aea0 con 0x7f57c0101eb0 2024-02-19T19:01:30.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.540+0000 7f57c6726700 1 -- 172.21.15.96:0/86710634 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f57c019e930 con 0x7f57a806c4e0 2024-02-19T19:01:30.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.549+0000 7f57bd7fa700 1 -- 172.21.15.96:0/86710634 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2860 (secure 0 0 0) 0x7f57c019e930 con 0x7f57a806c4e0 2024-02-19T19:01:30.568 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:01:30.568 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3m) 2m ago 5m 26.3M - 0.25.0 c8568f914cd2 5dc55ac32e98 2024-02-19T19:01:30.568 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (5m) 2m ago 5m 7059k - 18.2.1 94eadd990e0a b41bff2e0043 2024-02-19T19:01:30.568 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (4m) 64s ago 4m 6962k - 18.2.1 94eadd990e0a 254ab7e7a040 2024-02-19T19:01:30.568 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (5m) 2m ago 5m 6660k - 18.2.1 94eadd990e0a 9250aadb9d78 2024-02-19T19:01:30.568 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (4m) 64s ago 4m 6665k - 18.2.1 94eadd990e0a b98ace7b5ded 2024-02-19T19:01:30.568 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3m) 2m ago 4m 78.1M - 9.4.7 954c08fa6188 467f574356d5 2024-02-19T19:01:30.568 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:9283,8765,8443 running (6m) 2m ago 6m 482M - 18.2.1 94eadd990e0a b062fd3d5963 2024-02-19T19:01:30.569 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (4m) 64s ago 4m 442M - 18.2.1 94eadd990e0a e6c5e0ac66e7 2024-02-19T19:01:30.569 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (6m) 2m ago 6m 44.3M 2048M 18.2.1 94eadd990e0a 23d5b9626c48 2024-02-19T19:01:30.569 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (4m) 64s ago 4m 42.8M 2048M 18.2.1 94eadd990e0a 27b4cad04cc5 2024-02-19T19:01:30.569 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (5m) 2m ago 5m 15.4M - 1.5.0 0da6a335fe13 97e9e93f8e15 2024-02-19T19:01:30.569 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (4m) 64s ago 4m 15.6M - 1.5.0 0da6a335fe13 fc1d96c078d9 2024-02-19T19:01:30.569 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3m) 2m ago 3m 40.5M 3946M 18.2.1 94eadd990e0a d5bbf07ad0e7 2024-02-19T19:01:30.569 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2m) 2m ago 2m 41.3M 3946M 18.2.1 94eadd990e0a 40329d59be45 2024-02-19T19:01:30.569 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2m) 2m ago 2m 39.0M 3946M 18.2.1 94eadd990e0a 4f1e49db2d41 2024-02-19T19:01:30.569 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (119s) 64s ago 119s 40.1M 4970M 18.2.1 94eadd990e0a 4746b79351fc 2024-02-19T19:01:30.569 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (95s) 64s ago 94s 41.7M 4970M 18.2.1 94eadd990e0a 2b3f0088f6b2 2024-02-19T19:01:30.569 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (69s) 64s ago 69s 10.4M 4970M 18.2.1 94eadd990e0a e5731974b46a 2024-02-19T19:01:30.569 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3m) 2m ago 4m 37.6M - 2.43.0 a07b618ecd1d e00101f00f57 2024-02-19T19:01:30.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.551+0000 7f57c6726700 1 -- 172.21.15.96:0/86710634 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f57a806c4e0 msgr2=0x7f57a806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:30.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.551+0000 7f57c6726700 1 --2- 172.21.15.96:0/86710634 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f57a806c4e0 0x7f57a806e9a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f57b0005fd0 tx=0x7f57b0005dd0 comp rx=0 tx=0).stop 2024-02-19T19:01:30.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.551+0000 7f57c6726700 1 -- 172.21.15.96:0/86710634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c0101eb0 msgr2=0x7f57c0073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:30.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.551+0000 7f57c6726700 1 --2- 172.21.15.96:0/86710634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c0101eb0 0x7f57c0073180 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f57b4006010 tx=0x7f57b400be20 comp rx=0 tx=0).stop 2024-02-19T19:01:30.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.551+0000 7f57c6726700 1 -- 172.21.15.96:0/86710634 shutdown_connections 2024-02-19T19:01:30.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.551+0000 7f57c6726700 1 --2- 172.21.15.96:0/86710634 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f57a806c4e0 0x7f57a806e9a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:30.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.551+0000 7f57c6726700 1 --2- 172.21.15.96:0/86710634 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57c0100cb0 0x7f57c0074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:30.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.551+0000 7f57c6726700 1 --2- 172.21.15.96:0/86710634 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c0101eb0 0x7f57c0073180 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:30.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.551+0000 7f57c6726700 1 -- 172.21.15.96:0/86710634 >> 172.21.15.96:0/86710634 conn(0x7f57c00fc230 msgr2=0x7f57c01050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:30.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.551+0000 7f57c6726700 1 -- 172.21.15.96:0/86710634 shutdown_connections 2024-02-19T19:01:30.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:30.551+0000 7f57c6726700 1 -- 172.21.15.96:0/86710634 wait complete. 2024-02-19T19:01:31.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:30 smithi125 ceph-mon[37556]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:31.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:30 smithi096 ceph-mon[29216]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:31.289 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- bash -c 'ceph orch ls' 2024-02-19T19:01:31.508 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:01:32.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:31 smithi125 ceph-mon[37556]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:32.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:31 smithi096 ceph-mon[29216]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:33.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.018+0000 7f427d17d700 1 -- 172.21.15.96:0/3769323268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4278100cb0 msgr2=0x7f42781010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:33.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.018+0000 7f427d17d700 1 --2- 172.21.15.96:0/3769323268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4278100cb0 0x7f42781010d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f426800b0a0 tx=0x7f426800b3b0 comp rx=0 tx=0).stop 2024-02-19T19:01:33.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.018+0000 7f427d17d700 1 -- 172.21.15.96:0/3769323268 shutdown_connections 2024-02-19T19:01:33.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.018+0000 7f427d17d700 1 --2- 172.21.15.96:0/3769323268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4278101eb0 0x7f4278102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:33.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.018+0000 7f427d17d700 1 --2- 172.21.15.96:0/3769323268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4278100cb0 0x7f42781010d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:33.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.018+0000 7f427d17d700 1 -- 172.21.15.96:0/3769323268 >> 172.21.15.96:0/3769323268 conn(0x7f42780fc230 msgr2=0x7f42780fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:33.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.018+0000 7f427d17d700 1 -- 172.21.15.96:0/3769323268 shutdown_connections 2024-02-19T19:01:33.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.018+0000 7f427d17d700 1 -- 172.21.15.96:0/3769323268 wait complete. 2024-02-19T19:01:33.038 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.019+0000 7f427d17d700 1 Processor -- start 2024-02-19T19:01:33.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.019+0000 7f427d17d700 1 -- start start 2024-02-19T19:01:33.040 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.019+0000 7f427d17d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4278100cb0 0x7f42781965d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.019+0000 7f427d17d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4278101eb0 0x7f4278196b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.019+0000 7f427d17d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4278197130 con 0x7f4278101eb0 2024-02-19T19:01:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.019+0000 7f427d17d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4278197270 con 0x7f4278100cb0 2024-02-19T19:01:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.019+0000 7f427659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4278101eb0 0x7f4278196b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.019+0000 7f427659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4278101eb0 0x7f4278196b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53832/0 (socket says 172.21.15.96:53832) 2024-02-19T19:01:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.019+0000 7f427659c700 1 -- 172.21.15.96:0/2378466167 learned_addr learned my addr 172.21.15.96:0/2378466167 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.020+0000 7f4276d9d700 1 --2- 172.21.15.96:0/2378466167 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4278100cb0 0x7f42781965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.020+0000 7f427659c700 1 -- 172.21.15.96:0/2378466167 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4278100cb0 msgr2=0x7f42781965d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.020+0000 7f427659c700 1 --2- 172.21.15.96:0/2378466167 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4278100cb0 0x7f42781965d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.020+0000 7f427659c700 1 -- 172.21.15.96:0/2378466167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4268009d00 con 0x7f4278101eb0 2024-02-19T19:01:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.020+0000 7f427659c700 1 --2- 172.21.15.96:0/2378466167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4278101eb0 0x7f4278196b10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f426000b4b0 tx=0x7f426000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.020+0000 7f426ffff700 1 -- 172.21.15.96:0/2378466167 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4260011800 con 0x7f4278101eb0 2024-02-19T19:01:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.020+0000 7f427d17d700 1 -- 172.21.15.96:0/2378466167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427819bd20 con 0x7f4278101eb0 2024-02-19T19:01:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.020+0000 7f426ffff700 1 -- 172.21.15.96:0/2378466167 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4260011e10 con 0x7f4278101eb0 2024-02-19T19:01:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.020+0000 7f426ffff700 1 -- 172.21.15.96:0/2378466167 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f426000f2e0 con 0x7f4278101eb0 2024-02-19T19:01:33.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.020+0000 7f427d17d700 1 -- 172.21.15.96:0/2378466167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427819c270 con 0x7f4278101eb0 2024-02-19T19:01:33.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.021+0000 7f427d17d700 1 -- 172.21.15.96:0/2378466167 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4278109890 con 0x7f4278101eb0 2024-02-19T19:01:33.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.021+0000 7f426ffff700 1 -- 172.21.15.96:0/2378466167 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f4260010380 con 0x7f4278101eb0 2024-02-19T19:01:33.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.022+0000 7f426ffff700 1 --2- 172.21.15.96:0/2378466167 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f426406c4e0 0x7f426406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:33.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.022+0000 7f426ffff700 1 -- 172.21.15.96:0/2378466167 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f426008b090 con 0x7f4278101eb0 2024-02-19T19:01:33.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.022+0000 7f4276d9d700 1 --2- 172.21.15.96:0/2378466167 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f426406c4e0 0x7f426406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:33.042 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.022+0000 7f4276d9d700 1 --2- 172.21.15.96:0/2378466167 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f426406c4e0 0x7f426406e9a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4268009fd0 tx=0x7f42680060c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:33.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.026+0000 7f426ffff700 1 -- 172.21.15.96:0/2378466167 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f4260059640 con 0x7f4278101eb0 2024-02-19T19:01:33.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:32 smithi125 ceph-mon[37556]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:33.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.228+0000 7f427d17d700 1 -- 172.21.15.96:0/2378466167 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4278106800 con 0x7f426406c4e0 2024-02-19T19:01:33.247 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:32 smithi096 ceph-mon[29216]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:33.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.232+0000 7f426ffff700 1 -- 172.21.15.96:0/2378466167 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1300 (secure 0 0 0) 0x7f4278106800 con 0x7f426406c4e0 2024-02-19T19:01:33.251 INFO:teuthology.orchestra.run.smithi096.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-02-19T19:01:33.251 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager ?:9093,9094 1/1 2m ago 6m count:1 2024-02-19T19:01:33.251 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter 2/2 2m ago 6m * 2024-02-19T19:01:33.251 INFO:teuthology.orchestra.run.smithi096.stdout:crash 2/2 2m ago 6m * 2024-02-19T19:01:33.251 INFO:teuthology.orchestra.run.smithi096.stdout:grafana ?:3000 1/1 2m ago 6m count:1 2024-02-19T19:01:33.251 INFO:teuthology.orchestra.run.smithi096.stdout:mgr 2/2 2m ago 6m count:2 2024-02-19T19:01:33.252 INFO:teuthology.orchestra.run.smithi096.stdout:mon 2/2 2m ago 5m smithi096:172.21.15.96=smithi096;smithi125:172.21.15.125=smithi125;count:2 2024-02-19T19:01:33.252 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter ?:9100 2/2 2m ago 6m * 2024-02-19T19:01:33.252 INFO:teuthology.orchestra.run.smithi096.stdout:osd 6 2m ago - 2024-02-19T19:01:33.252 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus ?:9095 1/1 2m ago 6m count:1 2024-02-19T19:01:33.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.234+0000 7f427d17d700 1 -- 172.21.15.96:0/2378466167 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f426406c4e0 msgr2=0x7f426406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:33.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.234+0000 7f427d17d700 1 --2- 172.21.15.96:0/2378466167 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f426406c4e0 0x7f426406e9a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4268009fd0 tx=0x7f42680060c0 comp rx=0 tx=0).stop 2024-02-19T19:01:33.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.234+0000 7f427d17d700 1 -- 172.21.15.96:0/2378466167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4278101eb0 msgr2=0x7f4278196b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:33.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.234+0000 7f427d17d700 1 --2- 172.21.15.96:0/2378466167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4278101eb0 0x7f4278196b10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f426000b4b0 tx=0x7f426000b7c0 comp rx=0 tx=0).stop 2024-02-19T19:01:33.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.234+0000 7f427d17d700 1 -- 172.21.15.96:0/2378466167 shutdown_connections 2024-02-19T19:01:33.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.234+0000 7f427d17d700 1 --2- 172.21.15.96:0/2378466167 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f426406c4e0 0x7f426406e9a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:33.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.234+0000 7f427d17d700 1 --2- 172.21.15.96:0/2378466167 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4278100cb0 0x7f42781965d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:33.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.234+0000 7f427d17d700 1 --2- 172.21.15.96:0/2378466167 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4278101eb0 0x7f4278196b10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:33.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.234+0000 7f427d17d700 1 -- 172.21.15.96:0/2378466167 >> 172.21.15.96:0/2378466167 conn(0x7f42780fc230 msgr2=0x7f42781050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:33.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.235+0000 7f427d17d700 1 -- 172.21.15.96:0/2378466167 shutdown_connections 2024-02-19T19:01:33.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:33.235+0000 7f427d17d700 1 -- 172.21.15.96:0/2378466167 wait complete. 2024-02-19T19:01:33.822 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- bash -c 'ceph orch host ls' 2024-02-19T19:01:34.034 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:01:34.148 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:33 smithi096 ceph-mon[29216]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:34.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:33 smithi125 ceph-mon[37556]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:35.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:34 smithi125 ceph-mon[37556]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:35.211 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:34 smithi096 ceph-mon[29216]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:35.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.564+0000 7fd73981e700 1 -- 172.21.15.96:0/2682518779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd734100cb0 msgr2=0x7fd7341010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:35.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.564+0000 7fd73981e700 1 --2- 172.21.15.96:0/2682518779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd734100cb0 0x7fd7341010d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd724009910 tx=0x7fd724009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:35.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.564+0000 7fd73981e700 1 -- 172.21.15.96:0/2682518779 shutdown_connections 2024-02-19T19:01:35.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.564+0000 7fd73981e700 1 --2- 172.21.15.96:0/2682518779 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd734101eb0 0x7fd734102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:35.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.564+0000 7fd73981e700 1 --2- 172.21.15.96:0/2682518779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd734100cb0 0x7fd7341010d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:35.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.564+0000 7fd73981e700 1 -- 172.21.15.96:0/2682518779 >> 172.21.15.96:0/2682518779 conn(0x7fd7340fc230 msgr2=0x7fd7340fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:35.585 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.564+0000 7fd73981e700 1 -- 172.21.15.96:0/2682518779 shutdown_connections 2024-02-19T19:01:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.564+0000 7fd73981e700 1 -- 172.21.15.96:0/2682518779 wait complete. 2024-02-19T19:01:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.565+0000 7fd73981e700 1 Processor -- start 2024-02-19T19:01:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.565+0000 7fd73981e700 1 -- start start 2024-02-19T19:01:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.565+0000 7fd73981e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd734100cb0 0x7fd734074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.565+0000 7fd73981e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd734101eb0 0x7fd734073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.565+0000 7fd73981e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7340736c0 con 0x7fd734101eb0 2024-02-19T19:01:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.565+0000 7fd73981e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd734073800 con 0x7fd734100cb0 2024-02-19T19:01:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.565+0000 7fd7327fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd734101eb0 0x7fd734073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.565+0000 7fd7327fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd734101eb0 0x7fd734073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48064/0 (socket says 172.21.15.96:48064) 2024-02-19T19:01:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.566+0000 7fd7327fc700 1 -- 172.21.15.96:0/2903650647 learned_addr learned my addr 172.21.15.96:0/2903650647 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.566+0000 7fd732ffd700 1 --2- 172.21.15.96:0/2903650647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd734100cb0 0x7fd734074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.566+0000 7fd7327fc700 1 -- 172.21.15.96:0/2903650647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd734100cb0 msgr2=0x7fd734074b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.566+0000 7fd7327fc700 1 --2- 172.21.15.96:0/2903650647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd734100cb0 0x7fd734074b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.566+0000 7fd7327fc700 1 -- 172.21.15.96:0/2903650647 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7240095f0 con 0x7fd734101eb0 2024-02-19T19:01:35.586 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.566+0000 7fd7327fc700 1 --2- 172.21.15.96:0/2903650647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd734101eb0 0x7fd734073180 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd72800b4b0 tx=0x7fd72800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:35.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.566+0000 7fd73881c700 1 -- 172.21.15.96:0/2903650647 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd728011800 con 0x7fd734101eb0 2024-02-19T19:01:35.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.566+0000 7fd73981e700 1 -- 172.21.15.96:0/2903650647 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd734073ae0 con 0x7fd734101eb0 2024-02-19T19:01:35.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.566+0000 7fd73881c700 1 -- 172.21.15.96:0/2903650647 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd728011e10 con 0x7fd734101eb0 2024-02-19T19:01:35.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.566+0000 7fd73881c700 1 -- 172.21.15.96:0/2903650647 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd72800f2e0 con 0x7fd734101eb0 2024-02-19T19:01:35.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.566+0000 7fd73981e700 1 -- 172.21.15.96:0/2903650647 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73419e5c0 con 0x7fd734101eb0 2024-02-19T19:01:35.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.567+0000 7fd73981e700 1 -- 172.21.15.96:0/2903650647 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd734109890 con 0x7fd734101eb0 2024-02-19T19:01:35.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.568+0000 7fd73881c700 1 -- 172.21.15.96:0/2903650647 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fd728010380 con 0x7fd734101eb0 2024-02-19T19:01:35.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.568+0000 7fd73881c700 1 --2- 172.21.15.96:0/2903650647 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd71c06c4e0 0x7fd71c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:35.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.568+0000 7fd73881c700 1 -- 172.21.15.96:0/2903650647 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd72808b090 con 0x7fd734101eb0 2024-02-19T19:01:35.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.568+0000 7fd732ffd700 1 --2- 172.21.15.96:0/2903650647 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd71c06c4e0 0x7fd71c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:35.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.568+0000 7fd732ffd700 1 --2- 172.21.15.96:0/2903650647 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd71c06c4e0 0x7fd71c06e9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd724006010 tx=0x7fd72400b540 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:35.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.573+0000 7fd73881c700 1 -- 172.21.15.96:0/2903650647 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd728059640 con 0x7fd734101eb0 2024-02-19T19:01:35.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.770+0000 7fd73981e700 1 -- 172.21.15.96:0/2903650647 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fd73419eb70 con 0x7fd71c06c4e0 2024-02-19T19:01:35.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.771+0000 7fd73881c700 1 -- 172.21.15.96:0/2903650647 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7fd73419eb70 con 0x7fd71c06c4e0 2024-02-19T19:01:35.790 INFO:teuthology.orchestra.run.smithi096.stdout:HOST ADDR LABELS STATUS 2024-02-19T19:01:35.790 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096 172.21.15.96 2024-02-19T19:01:35.790 INFO:teuthology.orchestra.run.smithi096.stdout:smithi125 172.21.15.125 2024-02-19T19:01:35.790 INFO:teuthology.orchestra.run.smithi096.stdout:2 hosts in cluster 2024-02-19T19:01:35.792 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.773+0000 7fd73981e700 1 -- 172.21.15.96:0/2903650647 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd71c06c4e0 msgr2=0x7fd71c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:35.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.773+0000 7fd73981e700 1 --2- 172.21.15.96:0/2903650647 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd71c06c4e0 0x7fd71c06e9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd724006010 tx=0x7fd72400b540 comp rx=0 tx=0).stop 2024-02-19T19:01:35.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.773+0000 7fd73981e700 1 -- 172.21.15.96:0/2903650647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd734101eb0 msgr2=0x7fd734073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:35.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.773+0000 7fd73981e700 1 --2- 172.21.15.96:0/2903650647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd734101eb0 0x7fd734073180 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd72800b4b0 tx=0x7fd72800b7c0 comp rx=0 tx=0).stop 2024-02-19T19:01:35.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.773+0000 7fd73981e700 1 -- 172.21.15.96:0/2903650647 shutdown_connections 2024-02-19T19:01:35.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.773+0000 7fd73981e700 1 --2- 172.21.15.96:0/2903650647 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd71c06c4e0 0x7fd71c06e9a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:35.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.773+0000 7fd73981e700 1 --2- 172.21.15.96:0/2903650647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd734100cb0 0x7fd734074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:35.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.773+0000 7fd73981e700 1 --2- 172.21.15.96:0/2903650647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd734101eb0 0x7fd734073180 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:35.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.773+0000 7fd73981e700 1 -- 172.21.15.96:0/2903650647 >> 172.21.15.96:0/2903650647 conn(0x7fd7340fc230 msgr2=0x7fd7341050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:35.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.774+0000 7fd73981e700 1 -- 172.21.15.96:0/2903650647 shutdown_connections 2024-02-19T19:01:35.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:35.774+0000 7fd73981e700 1 -- 172.21.15.96:0/2903650647 wait complete. 2024-02-19T19:01:36.399 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- bash -c 'ceph orch device ls' 2024-02-19T19:01:36.604 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:01:36.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:36 smithi125 ceph-mon[37556]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:36.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:36 smithi125 ceph-mon[37556]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:36.725 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:36 smithi096 ceph-mon[29216]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:36.725 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:36 smithi096 ceph-mon[29216]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:38.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.131+0000 7fa31c6dc700 1 -- 172.21.15.96:0/1495617362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa314104080 msgr2=0x7fa314106470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:38.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.131+0000 7fa31c6dc700 1 --2- 172.21.15.96:0/1495617362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa314104080 0x7fa314106470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa304009910 tx=0x7fa304009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:38.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.131+0000 7fa31c6dc700 1 -- 172.21.15.96:0/1495617362 shutdown_connections 2024-02-19T19:01:38.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.131+0000 7fa31c6dc700 1 --2- 172.21.15.96:0/1495617362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa314104080 0x7fa314106470 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:38.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.131+0000 7fa31c6dc700 1 --2- 172.21.15.96:0/1495617362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa314101750 0x7fa314103b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:38.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.131+0000 7fa31c6dc700 1 -- 172.21.15.96:0/1495617362 >> 172.21.15.96:0/1495617362 conn(0x7fa3140fb160 msgr2=0x7fa3140fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:38.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.131+0000 7fa31c6dc700 1 -- 172.21.15.96:0/1495617362 shutdown_connections 2024-02-19T19:01:38.152 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.131+0000 7fa31c6dc700 1 -- 172.21.15.96:0/1495617362 wait complete. 2024-02-19T19:01:38.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.131+0000 7fa31c6dc700 1 Processor -- start 2024-02-19T19:01:38.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.131+0000 7fa31c6dc700 1 -- start start 2024-02-19T19:01:38.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.132+0000 7fa31c6dc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa314101750 0x7fa314196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:38.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.132+0000 7fa31c6dc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa314104080 0x7fa314196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:38.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.132+0000 7fa31c6dc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3141973c0 con 0x7fa314101750 2024-02-19T19:01:38.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.132+0000 7fa31c6dc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa314197500 con 0x7fa314104080 2024-02-19T19:01:38.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.132+0000 7fa31a478700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa314101750 0x7fa314196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:38.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.132+0000 7fa31a478700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa314101750 0x7fa314196860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48088/0 (socket says 172.21.15.96:48088) 2024-02-19T19:01:38.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.132+0000 7fa31a478700 1 -- 172.21.15.96:0/2921470716 learned_addr learned my addr 172.21.15.96:0/2921470716 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:38.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.132+0000 7fa319c77700 1 --2- 172.21.15.96:0/2921470716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa314104080 0x7fa314196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:38.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.132+0000 7fa31a478700 1 -- 172.21.15.96:0/2921470716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa314104080 msgr2=0x7fa314196da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:38.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.132+0000 7fa31a478700 1 --2- 172.21.15.96:0/2921470716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa314104080 0x7fa314196da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:38.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.132+0000 7fa31a478700 1 -- 172.21.15.96:0/2921470716 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3040095f0 con 0x7fa314101750 2024-02-19T19:01:38.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.132+0000 7fa31a478700 1 --2- 172.21.15.96:0/2921470716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa314101750 0x7fa314196860 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa31000b4b0 tx=0x7fa31000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:38.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.132+0000 7fa30b7fe700 1 -- 172.21.15.96:0/2921470716 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa310011800 con 0x7fa314101750 2024-02-19T19:01:38.153 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.132+0000 7fa30b7fe700 1 -- 172.21.15.96:0/2921470716 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa310011e10 con 0x7fa314101750 2024-02-19T19:01:38.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.132+0000 7fa30b7fe700 1 -- 172.21.15.96:0/2921470716 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa31000f2e0 con 0x7fa314101750 2024-02-19T19:01:38.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.132+0000 7fa31c6dc700 1 -- 172.21.15.96:0/2921470716 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa31419bfb0 con 0x7fa314101750 2024-02-19T19:01:38.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.132+0000 7fa31c6dc700 1 -- 172.21.15.96:0/2921470716 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31419c470 con 0x7fa314101750 2024-02-19T19:01:38.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.133+0000 7fa31c6dc700 1 -- 172.21.15.96:0/2921470716 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3141906b0 con 0x7fa314101750 2024-02-19T19:01:38.154 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.134+0000 7fa30b7fe700 1 -- 172.21.15.96:0/2921470716 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fa310010380 con 0x7fa314101750 2024-02-19T19:01:38.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.134+0000 7fa30b7fe700 1 --2- 172.21.15.96:0/2921470716 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fa30006c4e0 0x7fa30006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:38.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.135+0000 7fa319c77700 1 --2- 172.21.15.96:0/2921470716 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fa30006c4e0 0x7fa30006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:38.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.135+0000 7fa30b7fe700 1 -- 172.21.15.96:0/2921470716 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fa31008b130 con 0x7fa314101750 2024-02-19T19:01:38.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.135+0000 7fa319c77700 1 --2- 172.21.15.96:0/2921470716 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fa30006c4e0 0x7fa30006e9a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa304006010 tx=0x7fa30400b540 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:38.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.139+0000 7fa30b7fe700 1 -- 172.21.15.96:0/2921470716 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa3100596e0 con 0x7fa314101750 2024-02-19T19:01:38.358 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.339+0000 7fa31c6dc700 1 -- 172.21.15.96:0/2921470716 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3140611d0 con 0x7fa30006c4e0 2024-02-19T19:01:38.359 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.340+0000 7fa30b7fe700 1 -- 172.21.15.96:0/2921470716 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7fa3140611d0 con 0x7fa30006c4e0 2024-02-19T19:01:38.359 INFO:teuthology.orchestra.run.smithi096.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-02-19T19:01:38.360 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400NH400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-02-19T19:01:38.360 INFO:teuthology.orchestra.run.smithi096.stdout:smithi125 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040123400BGN 372G No 69s ago Has a FileSystem, LVM detected 2024-02-19T19:01:38.361 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.342+0000 7fa31c6dc700 1 -- 172.21.15.96:0/2921470716 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fa30006c4e0 msgr2=0x7fa30006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:38.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.342+0000 7fa31c6dc700 1 --2- 172.21.15.96:0/2921470716 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fa30006c4e0 0x7fa30006e9a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa304006010 tx=0x7fa30400b540 comp rx=0 tx=0).stop 2024-02-19T19:01:38.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.342+0000 7fa31c6dc700 1 -- 172.21.15.96:0/2921470716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa314101750 msgr2=0x7fa314196860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:38.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.342+0000 7fa31c6dc700 1 --2- 172.21.15.96:0/2921470716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa314101750 0x7fa314196860 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa31000b4b0 tx=0x7fa31000b870 comp rx=0 tx=0).stop 2024-02-19T19:01:38.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.342+0000 7fa31c6dc700 1 -- 172.21.15.96:0/2921470716 shutdown_connections 2024-02-19T19:01:38.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.342+0000 7fa31c6dc700 1 --2- 172.21.15.96:0/2921470716 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fa30006c4e0 0x7fa30006e9a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:38.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.342+0000 7fa31c6dc700 1 --2- 172.21.15.96:0/2921470716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa314101750 0x7fa314196860 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:38.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.342+0000 7fa31c6dc700 1 --2- 172.21.15.96:0/2921470716 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa314104080 0x7fa314196da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:38.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.342+0000 7fa31c6dc700 1 -- 172.21.15.96:0/2921470716 >> 172.21.15.96:0/2921470716 conn(0x7fa3140fb160 msgr2=0x7fa3140fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:38.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.343+0000 7fa31c6dc700 1 -- 172.21.15.96:0/2921470716 shutdown_connections 2024-02-19T19:01:38.362 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:38.343+0000 7fa31c6dc700 1 -- 172.21.15.96:0/2921470716 wait complete. 2024-02-19T19:01:38.999 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:38 smithi096 ceph-mon[29216]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:39.021 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-02-19T19:01:39.032 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-19T19:01:39.052 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi096.front.sepia.ceph.com 2024-02-19T19:01:39.053 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-02-19T19:01:39.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:38 smithi125 ceph-mon[37556]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:39.258 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:01:40.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:39 smithi096 ceph-mon[29216]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:40.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:39 smithi125 ceph-mon[37556]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:40.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.745+0000 7f41fd7a9700 1 -- 172.21.15.96:0/1240237625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f81017b0 msgr2=0x7f41f8103ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:40.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.745+0000 7f41fd7a9700 1 --2- 172.21.15.96:0/1240237625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f81017b0 0x7f41f8103ba0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f41e8009910 tx=0x7f41e8009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:40.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.745+0000 7f41fd7a9700 1 -- 172.21.15.96:0/1240237625 shutdown_connections 2024-02-19T19:01:40.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.745+0000 7f41fd7a9700 1 --2- 172.21.15.96:0/1240237625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41f81040e0 0x7f41f81064d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:40.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.745+0000 7f41fd7a9700 1 --2- 172.21.15.96:0/1240237625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f81017b0 0x7f41f8103ba0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:40.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.745+0000 7f41fd7a9700 1 -- 172.21.15.96:0/1240237625 >> 172.21.15.96:0/1240237625 conn(0x7f41f80fb160 msgr2=0x7f41f80fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:40.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.746+0000 7f41fd7a9700 1 -- 172.21.15.96:0/1240237625 shutdown_connections 2024-02-19T19:01:40.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.746+0000 7f41fd7a9700 1 -- 172.21.15.96:0/1240237625 wait complete. 2024-02-19T19:01:40.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.746+0000 7f41fd7a9700 1 Processor -- start 2024-02-19T19:01:40.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.746+0000 7f41fd7a9700 1 -- start start 2024-02-19T19:01:40.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.746+0000 7f41fd7a9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f81017b0 0x7f41f81967a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:40.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.746+0000 7f41fd7a9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41f81040e0 0x7f41f8196ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:40.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.746+0000 7f41fd7a9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f8197300 con 0x7f41f81017b0 2024-02-19T19:01:40.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.746+0000 7f41fd7a9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f8197440 con 0x7f41f81040e0 2024-02-19T19:01:40.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.747+0000 7f41f6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f81017b0 0x7f41f81967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:40.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.747+0000 7f41f6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f81017b0 0x7f41f81967a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48104/0 (socket says 172.21.15.96:48104) 2024-02-19T19:01:40.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.747+0000 7f41f6ffd700 1 -- 172.21.15.96:0/2082440303 learned_addr learned my addr 172.21.15.96:0/2082440303 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:40.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.747+0000 7f41f67fc700 1 --2- 172.21.15.96:0/2082440303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41f81040e0 0x7f41f8196ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:40.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.747+0000 7f41f6ffd700 1 -- 172.21.15.96:0/2082440303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41f81040e0 msgr2=0x7f41f8196ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:40.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.747+0000 7f41f6ffd700 1 --2- 172.21.15.96:0/2082440303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41f81040e0 0x7f41f8196ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:40.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.747+0000 7f41f6ffd700 1 -- 172.21.15.96:0/2082440303 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e80095f0 con 0x7f41f81017b0 2024-02-19T19:01:40.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.747+0000 7f41f6ffd700 1 --2- 172.21.15.96:0/2082440303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f81017b0 0x7f41f81967a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f41e8006010 tx=0x7f41e800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:40.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.747+0000 7f41dffff700 1 -- 172.21.15.96:0/2082440303 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41e801d070 con 0x7f41f81017b0 2024-02-19T19:01:40.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.747+0000 7f41fd7a9700 1 -- 172.21.15.96:0/2082440303 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f819be90 con 0x7f41f81017b0 2024-02-19T19:01:40.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.747+0000 7f41dffff700 1 -- 172.21.15.96:0/2082440303 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f41e800f460 con 0x7f41f81017b0 2024-02-19T19:01:40.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.747+0000 7f41dffff700 1 -- 172.21.15.96:0/2082440303 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f41e8017630 con 0x7f41f81017b0 2024-02-19T19:01:40.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.747+0000 7f41fd7a9700 1 -- 172.21.15.96:0/2082440303 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f819c300 con 0x7f41f81017b0 2024-02-19T19:01:40.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.748+0000 7f41fd7a9700 1 -- 172.21.15.96:0/2082440303 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f8190630 con 0x7f41f81017b0 2024-02-19T19:01:40.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.749+0000 7f41dffff700 1 -- 172.21.15.96:0/2082440303 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f41e800f5d0 con 0x7f41f81017b0 2024-02-19T19:01:40.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.749+0000 7f41dffff700 1 --2- 172.21.15.96:0/2082440303 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f41e006c4e0 0x7f41e006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:40.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.749+0000 7f41f67fc700 1 --2- 172.21.15.96:0/2082440303 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f41e006c4e0 0x7f41e006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:40.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.749+0000 7f41dffff700 1 -- 172.21.15.96:0/2082440303 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f41e808c960 con 0x7f41f81017b0 2024-02-19T19:01:40.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.749+0000 7f41f67fc700 1 --2- 172.21.15.96:0/2082440303 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f41e006c4e0 0x7f41e006e9a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f41ec005950 tx=0x7f41ec0058e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:40.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.753+0000 7f41dffff700 1 -- 172.21.15.96:0/2082440303 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f41e805af10 con 0x7f41f81017b0 2024-02-19T19:01:40.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:40.971+0000 7f41fd7a9700 1 -- 172.21.15.96:0/2082440303 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f41f80611d0 con 0x7f41e006c4e0 2024-02-19T19:01:41.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:40 smithi125 ceph-mon[37556]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:41.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:40 smithi096 ceph-mon[29216]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:42.163 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:41 smithi096 ceph-mon[29216]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:42.163 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:41 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-19T19:01:42.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:41 smithi125 ceph-mon[37556]: from='client.14466 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:01:42.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:41 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-19T19:01:42.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:42.905+0000 7f41dffff700 1 -- 172.21.15.96:0/2082440303 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f41f80611d0 con 0x7f41e006c4e0 2024-02-19T19:01:42.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:42.908+0000 7f41fd7a9700 1 -- 172.21.15.96:0/2082440303 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f41e006c4e0 msgr2=0x7f41e006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:42.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:42.908+0000 7f41fd7a9700 1 --2- 172.21.15.96:0/2082440303 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f41e006c4e0 0x7f41e006e9a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f41ec005950 tx=0x7f41ec0058e0 comp rx=0 tx=0).stop 2024-02-19T19:01:42.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:42.908+0000 7f41fd7a9700 1 -- 172.21.15.96:0/2082440303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f81017b0 msgr2=0x7f41f81967a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:42.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:42.908+0000 7f41fd7a9700 1 --2- 172.21.15.96:0/2082440303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f81017b0 0x7f41f81967a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f41e8006010 tx=0x7f41e800be20 comp rx=0 tx=0).stop 2024-02-19T19:01:42.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:42.908+0000 7f41fd7a9700 1 -- 172.21.15.96:0/2082440303 shutdown_connections 2024-02-19T19:01:42.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:42.908+0000 7f41fd7a9700 1 --2- 172.21.15.96:0/2082440303 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f41e006c4e0 0x7f41e006e9a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:42.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:42.908+0000 7f41fd7a9700 1 --2- 172.21.15.96:0/2082440303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41f81017b0 0x7f41f81967a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:42.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:42.908+0000 7f41fd7a9700 1 --2- 172.21.15.96:0/2082440303 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f41f81040e0 0x7f41f8196ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:42.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:42.908+0000 7f41fd7a9700 1 -- 172.21.15.96:0/2082440303 >> 172.21.15.96:0/2082440303 conn(0x7f41f80fb160 msgr2=0x7f41f80fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:42.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:42.908+0000 7f41fd7a9700 1 -- 172.21.15.96:0/2082440303 shutdown_connections 2024-02-19T19:01:42.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:42.908+0000 7f41fd7a9700 1 -- 172.21.15.96:0/2082440303 wait complete. 2024-02-19T19:01:43.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:42 smithi125 ceph-mon[37556]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:43.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:42 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-19T19:01:43.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:42 smithi125 ceph-mon[37556]: osdmap e41: 6 total, 6 up, 6 in 2024-02-19T19:01:43.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:42 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-19T19:01:43.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:42 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:01:43.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:42 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096[29212]: 2024-02-19T19:01:42.880+0000 7fe84f0f7700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-19T19:01:43.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:42 smithi096 ceph-mon[29216]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:43.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:42 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-19T19:01:43.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:42 smithi096 ceph-mon[29216]: osdmap e41: 6 total, 6 up, 6 in 2024-02-19T19:01:43.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:42 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-19T19:01:43.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:42 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:01:43.636 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-19T19:01:43.860 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:01:44.184 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:43 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-19T19:01:44.185 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:43 smithi096 ceph-mon[29216]: osdmap e42: 6 total, 6 up, 6 in 2024-02-19T19:01:44.185 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:43 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-19T19:01:44.185 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:43 smithi096 ceph-mon[29216]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-19T19:01:44.185 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:43 smithi096 ceph-mon[29216]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-19T19:01:44.185 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:43 smithi096 ceph-mon[29216]: osdmap e43: 6 total, 6 up, 6 in 2024-02-19T19:01:44.185 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:43 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-19T19:01:44.185 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:43 smithi096 ceph-mon[29216]: fsmap cephfs:0 2024-02-19T19:01:44.185 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:43 smithi096 ceph-mon[29216]: Saving service mds.cephfs spec with placement count:4 2024-02-19T19:01:44.185 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:43 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:44.185 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:43 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:01:44.185 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:43 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:01:44.186 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:43 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:01:44.186 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:43 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:44.186 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:43 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.usrmcg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:01:44.186 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:43 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.usrmcg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T19:01:44.186 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:43 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:01:44.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:43 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-19T19:01:44.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:43 smithi125 ceph-mon[37556]: osdmap e42: 6 total, 6 up, 6 in 2024-02-19T19:01:44.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:43 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-19T19:01:44.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:43 smithi125 ceph-mon[37556]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-19T19:01:44.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:43 smithi125 ceph-mon[37556]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-19T19:01:44.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:43 smithi125 ceph-mon[37556]: osdmap e43: 6 total, 6 up, 6 in 2024-02-19T19:01:44.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:43 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-19T19:01:44.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:43 smithi125 ceph-mon[37556]: fsmap cephfs:0 2024-02-19T19:01:44.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:43 smithi125 ceph-mon[37556]: Saving service mds.cephfs spec with placement count:4 2024-02-19T19:01:44.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:43 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:44.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:43 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:01:44.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:43 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:01:44.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:43 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:01:44.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:43 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:44.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:43 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.usrmcg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:01:44.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:43 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.usrmcg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T19:01:44.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:43 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:01:45.190 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:44 smithi096 ceph-mon[29216]: pgmap v174: 65 pgs: 18 creating+peering, 43 unknown, 4 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:45.190 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:44 smithi096 ceph-mon[29216]: Deploying daemon mds.cephfs.smithi096.usrmcg on smithi096 2024-02-19T19:01:45.190 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:44 smithi096 ceph-mon[29216]: osdmap e44: 6 total, 6 up, 6 in 2024-02-19T19:01:45.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:44 smithi125 ceph-mon[37556]: pgmap v174: 65 pgs: 18 creating+peering, 43 unknown, 4 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:45.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:44 smithi125 ceph-mon[37556]: Deploying daemon mds.cephfs.smithi096.usrmcg on smithi096 2024-02-19T19:01:45.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:44 smithi125 ceph-mon[37556]: osdmap e44: 6 total, 6 up, 6 in 2024-02-19T19:01:45.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.356+0000 7f615e021700 1 -- 172.21.15.96:0/2229874837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6158073770 msgr2=0x7f6158073bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:45.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.356+0000 7f615e021700 1 --2- 172.21.15.96:0/2229874837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6158073770 0x7f6158073bf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f614c009910 tx=0x7f614c009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:45.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.356+0000 7f615e021700 1 -- 172.21.15.96:0/2229874837 shutdown_connections 2024-02-19T19:01:45.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.356+0000 7f615e021700 1 --2- 172.21.15.96:0/2229874837 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6158073770 0x7f6158073bf0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:45.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.356+0000 7f615e021700 1 --2- 172.21.15.96:0/2229874837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6158074d40 0x7f61580731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:45.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.356+0000 7f615e021700 1 -- 172.21.15.96:0/2229874837 >> 172.21.15.96:0/2229874837 conn(0x7f61580fc230 msgr2=0x7f61580fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:45.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.356+0000 7f615e021700 1 -- 172.21.15.96:0/2229874837 shutdown_connections 2024-02-19T19:01:45.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.356+0000 7f615e021700 1 -- 172.21.15.96:0/2229874837 wait complete. 2024-02-19T19:01:45.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.356+0000 7f615e021700 1 Processor -- start 2024-02-19T19:01:45.376 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.357+0000 7f615e021700 1 -- start start 2024-02-19T19:01:45.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.357+0000 7f615e021700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6158073770 0x7f61581986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:45.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.357+0000 7f615e021700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6158074d40 0x7f6158198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:45.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.357+0000 7f615e021700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6158199200 con 0x7f6158074d40 2024-02-19T19:01:45.377 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.357+0000 7f615e021700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6158199340 con 0x7f6158073770 2024-02-19T19:01:45.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.357+0000 7f6156ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6158074d40 0x7f6158198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:45.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.357+0000 7f6156ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6158074d40 0x7f6158198be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43212/0 (socket says 172.21.15.96:43212) 2024-02-19T19:01:45.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.357+0000 7f6156ffd700 1 -- 172.21.15.96:0/2048764870 learned_addr learned my addr 172.21.15.96:0/2048764870 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:45.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.357+0000 7f6156ffd700 1 -- 172.21.15.96:0/2048764870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6158073770 msgr2=0x7f61581986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:45.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.357+0000 7f61577fe700 1 --2- 172.21.15.96:0/2048764870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6158073770 0x7f61581986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:45.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.357+0000 7f6156ffd700 1 --2- 172.21.15.96:0/2048764870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6158073770 0x7f61581986a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:45.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.357+0000 7f6156ffd700 1 -- 172.21.15.96:0/2048764870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c0095f0 con 0x7f6158074d40 2024-02-19T19:01:45.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.357+0000 7f6156ffd700 1 --2- 172.21.15.96:0/2048764870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6158074d40 0x7f6158198be0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f614c006010 tx=0x7f614c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:45.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.357+0000 7f6154ff9700 1 -- 172.21.15.96:0/2048764870 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f614c01d070 con 0x7f6158074d40 2024-02-19T19:01:45.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.358+0000 7f615e021700 1 -- 172.21.15.96:0/2048764870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615819dd90 con 0x7f6158074d40 2024-02-19T19:01:45.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.358+0000 7f6154ff9700 1 -- 172.21.15.96:0/2048764870 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f614c00f460 con 0x7f6158074d40 2024-02-19T19:01:45.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.358+0000 7f6154ff9700 1 -- 172.21.15.96:0/2048764870 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f614c021640 con 0x7f6158074d40 2024-02-19T19:01:45.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.358+0000 7f615e021700 1 -- 172.21.15.96:0/2048764870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615819e280 con 0x7f6158074d40 2024-02-19T19:01:45.378 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.359+0000 7f615e021700 1 -- 172.21.15.96:0/2048764870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615810ba00 con 0x7f6158074d40 2024-02-19T19:01:45.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.359+0000 7f6154ff9700 1 -- 172.21.15.96:0/2048764870 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f614c00fab0 con 0x7f6158074d40 2024-02-19T19:01:45.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.359+0000 7f6154ff9700 1 --2- 172.21.15.96:0/2048764870 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f614006c4e0 0x7f614006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:45.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.359+0000 7f6154ff9700 1 -- 172.21.15.96:0/2048764870 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f614c08cc40 con 0x7f6158074d40 2024-02-19T19:01:45.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.359+0000 7f61577fe700 1 --2- 172.21.15.96:0/2048764870 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f614006c4e0 0x7f614006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:45.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.360+0000 7f61577fe700 1 --2- 172.21.15.96:0/2048764870 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f614006c4e0 0x7f614006e9a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6148005950 tx=0x7f6148005cf0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:45.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.364+0000 7f6154ff9700 1 -- 172.21.15.96:0/2048764870 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f614c05aeb0 con 0x7f6158074d40 2024-02-19T19:01:45.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.609+0000 7f615e021700 1 -- 172.21.15.96:0/2048764870 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f615819e950 con 0x7f6158074d40 2024-02-19T19:01:45.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.610+0000 7f6154ff9700 1 -- 172.21.15.96:0/2048764870 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1093 (secure 0 0 0) 0x7f614c05aa40 con 0x7f6158074d40 2024-02-19T19:01:45.629 INFO:teuthology.orchestra.run.smithi096.stdout:e2 2024-02-19T19:01:45.629 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:01:45.629 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:01:45.629 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2024-02-19T19:01:45.629 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:01:45.630 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:01:45.630 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2024-02-19T19:01:45.630 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 2 2024-02-19T19:01:45.630 INFO:teuthology.orchestra.run.smithi096.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-19T19:01:45.630 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-02-19T19:01:42.881136+0000 2024-02-19T19:01:45.630 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2024-02-19T19:01:42.881197+0000 2024-02-19T19:01:45.630 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2024-02-19T19:01:45.630 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2024-02-19T19:01:45.630 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2024-02-19T19:01:45.630 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2024-02-19T19:01:45.630 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2024-02-19T19:01:45.630 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2024-02-19T19:01:45.630 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2024-02-19T19:01:45.630 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 0 2024-02-19T19:01:45.630 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:01:45.630 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 1 2024-02-19T19:01:45.631 INFO:teuthology.orchestra.run.smithi096.stdout:in 2024-02-19T19:01:45.631 INFO:teuthology.orchestra.run.smithi096.stdout:up {} 2024-02-19T19:01:45.631 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2024-02-19T19:01:45.631 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2024-02-19T19:01:45.631 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2024-02-19T19:01:45.631 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2024-02-19T19:01:45.631 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2024-02-19T19:01:45.631 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data disabled 2024-02-19T19:01:45.631 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2024-02-19T19:01:45.631 INFO:teuthology.orchestra.run.smithi096.stdout:bal_rank_mask -1 2024-02-19T19:01:45.631 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 0 2024-02-19T19:01:45.631 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:01:45.631 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:01:45.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.612+0000 7f615e021700 1 -- 172.21.15.96:0/2048764870 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f614006c4e0 msgr2=0x7f614006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:45.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.612+0000 7f615e021700 1 --2- 172.21.15.96:0/2048764870 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f614006c4e0 0x7f614006e9a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6148005950 tx=0x7f6148005cf0 comp rx=0 tx=0).stop 2024-02-19T19:01:45.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.612+0000 7f615e021700 1 -- 172.21.15.96:0/2048764870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6158074d40 msgr2=0x7f6158198be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:45.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.612+0000 7f615e021700 1 --2- 172.21.15.96:0/2048764870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6158074d40 0x7f6158198be0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f614c006010 tx=0x7f614c00be20 comp rx=0 tx=0).stop 2024-02-19T19:01:45.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.612+0000 7f615e021700 1 -- 172.21.15.96:0/2048764870 shutdown_connections 2024-02-19T19:01:45.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.612+0000 7f615e021700 1 --2- 172.21.15.96:0/2048764870 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f614006c4e0 0x7f614006e9a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:45.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.612+0000 7f615e021700 1 --2- 172.21.15.96:0/2048764870 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6158073770 0x7f61581986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:45.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.612+0000 7f615e021700 1 --2- 172.21.15.96:0/2048764870 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6158074d40 0x7f6158198be0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:45.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.612+0000 7f615e021700 1 -- 172.21.15.96:0/2048764870 >> 172.21.15.96:0/2048764870 conn(0x7f61580fc230 msgr2=0x7f6158106b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:45.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.612+0000 7f615e021700 1 -- 172.21.15.96:0/2048764870 shutdown_connections 2024-02-19T19:01:45.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:45.612+0000 7f615e021700 1 -- 172.21.15.96:0/2048764870 wait complete. 2024-02-19T19:01:45.633 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 2 2024-02-19T19:01:46.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:45 smithi125 ceph-mon[37556]: osdmap e45: 6 total, 6 up, 6 in 2024-02-19T19:01:46.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:45 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/2048764870' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:01:46.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:45 smithi096 ceph-mon[29216]: osdmap e45: 6 total, 6 up, 6 in 2024-02-19T19:01:46.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:45 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/2048764870' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:01:47.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:46 smithi096 ceph-mon[29216]: pgmap v177: 65 pgs: 6 creating+activating, 18 creating+peering, 21 unknown, 20 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:47.177 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-19T19:01:47.188 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi096.front.sepia.ceph.com 2024-02-19T19:01:47.188 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-02-19T19:01:47.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:46 smithi125 ceph-mon[37556]: pgmap v177: 65 pgs: 6 creating+activating, 18 creating+peering, 21 unknown, 20 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:47.855 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:01:49.030 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:48 smithi096 ceph-mon[29216]: pgmap v178: 65 pgs: 6 creating+activating, 6 creating+peering, 53 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:49.030 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:48 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:49.030 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:48 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:49.030 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:48 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:49.030 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:48 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi125.srnlol", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:01:49.030 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:48 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi125.srnlol", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T19:01:49.030 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:48 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:01:49.030 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:48 smithi096 ceph-mon[29216]: Deploying daemon mds.cephfs.smithi125.srnlol on smithi125 2024-02-19T19:01:49.030 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:48 smithi096 ceph-mon[29216]: mds.? [v2:172.21.15.96:6826/3917487208,v1:172.21.15.96:6827/3917487208] up:boot 2024-02-19T19:01:49.031 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:48 smithi096 ceph-mon[29216]: daemon mds.cephfs.smithi096.usrmcg assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-19T19:01:49.031 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:48 smithi096 ceph-mon[29216]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-19T19:01:49.031 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:48 smithi096 ceph-mon[29216]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-19T19:01:49.031 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:48 smithi096 ceph-mon[29216]: Cluster is now healthy 2024-02-19T19:01:49.031 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:48 smithi096 ceph-mon[29216]: fsmap cephfs:0 1 up:standby 2024-02-19T19:01:49.031 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:48 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.usrmcg"}]: dispatch 2024-02-19T19:01:49.031 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:48 smithi096 ceph-mon[29216]: fsmap cephfs:1 {0=cephfs.smithi096.usrmcg=up:creating} 2024-02-19T19:01:49.031 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:48 smithi096 ceph-mon[29216]: daemon mds.cephfs.smithi096.usrmcg is now active in filesystem cephfs as rank 0 2024-02-19T19:01:49.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:48 smithi125 ceph-mon[37556]: pgmap v178: 65 pgs: 6 creating+activating, 6 creating+peering, 53 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:01:49.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:48 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:49.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:48 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:49.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:48 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:49.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:48 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi125.srnlol", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:01:49.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:48 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi125.srnlol", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T19:01:49.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:48 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:01:49.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:48 smithi125 ceph-mon[37556]: Deploying daemon mds.cephfs.smithi125.srnlol on smithi125 2024-02-19T19:01:49.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:48 smithi125 ceph-mon[37556]: mds.? [v2:172.21.15.96:6826/3917487208,v1:172.21.15.96:6827/3917487208] up:boot 2024-02-19T19:01:49.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:48 smithi125 ceph-mon[37556]: daemon mds.cephfs.smithi096.usrmcg assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-19T19:01:49.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:48 smithi125 ceph-mon[37556]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-19T19:01:49.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:48 smithi125 ceph-mon[37556]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-19T19:01:49.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:48 smithi125 ceph-mon[37556]: Cluster is now healthy 2024-02-19T19:01:49.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:48 smithi125 ceph-mon[37556]: fsmap cephfs:0 1 up:standby 2024-02-19T19:01:49.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:48 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.usrmcg"}]: dispatch 2024-02-19T19:01:49.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:48 smithi125 ceph-mon[37556]: fsmap cephfs:1 {0=cephfs.smithi096.usrmcg=up:creating} 2024-02-19T19:01:49.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:48 smithi125 ceph-mon[37556]: daemon mds.cephfs.smithi096.usrmcg is now active in filesystem cephfs as rank 0 2024-02-19T19:01:49.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.493+0000 7fd292e33700 1 -- 172.21.15.96:0/1343171824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd28c0ffbc0 msgr2=0x7fd28c0fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:49.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.493+0000 7fd292e33700 1 --2- 172.21.15.96:0/1343171824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd28c0ffbc0 0x7fd28c0fffe0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd288009910 tx=0x7fd288009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:49.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.493+0000 7fd292e33700 1 -- 172.21.15.96:0/1343171824 shutdown_connections 2024-02-19T19:01:49.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.493+0000 7fd292e33700 1 --2- 172.21.15.96:0/1343171824 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd28c100dc0 0x7fd28c101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:49.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.493+0000 7fd292e33700 1 --2- 172.21.15.96:0/1343171824 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd28c0ffbc0 0x7fd28c0fffe0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:49.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.493+0000 7fd292e33700 1 -- 172.21.15.96:0/1343171824 >> 172.21.15.96:0/1343171824 conn(0x7fd28c0fb160 msgr2=0x7fd28c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:49.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.493+0000 7fd292e33700 1 -- 172.21.15.96:0/1343171824 shutdown_connections 2024-02-19T19:01:49.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.493+0000 7fd292e33700 1 -- 172.21.15.96:0/1343171824 wait complete. 2024-02-19T19:01:49.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.494+0000 7fd292e33700 1 Processor -- start 2024-02-19T19:01:49.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.494+0000 7fd292e33700 1 -- start start 2024-02-19T19:01:49.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.494+0000 7fd292e33700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd28c0ffbc0 0x7fd28c196810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:49.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.494+0000 7fd292e33700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd28c100dc0 0x7fd28c196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:49.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.494+0000 7fd292e33700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c197370 con 0x7fd28c100dc0 2024-02-19T19:01:49.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.494+0000 7fd292e33700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd28c1974b0 con 0x7fd28c0ffbc0 2024-02-19T19:01:49.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.494+0000 7fd283fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd28c100dc0 0x7fd28c196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:49.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.494+0000 7fd283fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd28c100dc0 0x7fd28c196d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43272/0 (socket says 172.21.15.96:43272) 2024-02-19T19:01:49.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.494+0000 7fd283fff700 1 -- 172.21.15.96:0/1224053871 learned_addr learned my addr 172.21.15.96:0/1224053871 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:49.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.494+0000 7fd290bcf700 1 --2- 172.21.15.96:0/1224053871 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd28c0ffbc0 0x7fd28c196810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:49.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.494+0000 7fd283fff700 1 -- 172.21.15.96:0/1224053871 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd28c0ffbc0 msgr2=0x7fd28c196810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:49.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.494+0000 7fd283fff700 1 --2- 172.21.15.96:0/1224053871 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd28c0ffbc0 0x7fd28c196810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:49.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.494+0000 7fd283fff700 1 -- 172.21.15.96:0/1224053871 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2880095f0 con 0x7fd28c100dc0 2024-02-19T19:01:49.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.494+0000 7fd283fff700 1 --2- 172.21.15.96:0/1224053871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd28c100dc0 0x7fd28c196d50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00d900 tx=0x7fd27c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:49.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.494+0000 7fd281ffb700 1 -- 172.21.15.96:0/1224053871 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd27c004a00 con 0x7fd28c100dc0 2024-02-19T19:01:49.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.495+0000 7fd281ffb700 1 -- 172.21.15.96:0/1224053871 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd27c0054d0 con 0x7fd28c100dc0 2024-02-19T19:01:49.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.495+0000 7fd292e33700 1 -- 172.21.15.96:0/1224053871 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd28c19bf60 con 0x7fd28c100dc0 2024-02-19T19:01:49.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.495+0000 7fd281ffb700 1 -- 172.21.15.96:0/1224053871 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd27c009d00 con 0x7fd28c100dc0 2024-02-19T19:01:49.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.495+0000 7fd292e33700 1 -- 172.21.15.96:0/1224053871 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd28c19c480 con 0x7fd28c100dc0 2024-02-19T19:01:49.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.496+0000 7fd292e33700 1 -- 172.21.15.96:0/1224053871 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28c068af0 con 0x7fd28c100dc0 2024-02-19T19:01:49.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.496+0000 7fd281ffb700 1 -- 172.21.15.96:0/1224053871 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fd27c005020 con 0x7fd28c100dc0 2024-02-19T19:01:49.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.496+0000 7fd281ffb700 1 --2- 172.21.15.96:0/1224053871 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd27406c4e0 0x7fd27406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:49.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.497+0000 7fd281ffb700 1 -- 172.21.15.96:0/1224053871 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fd27c08b730 con 0x7fd28c100dc0 2024-02-19T19:01:49.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.497+0000 7fd290bcf700 1 --2- 172.21.15.96:0/1224053871 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd27406c4e0 0x7fd27406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:49.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.497+0000 7fd290bcf700 1 --2- 172.21.15.96:0/1224053871 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd27406c4e0 0x7fd27406e9a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd288006010 tx=0x7fd28800b540 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:49.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.501+0000 7fd281ffb700 1 -- 172.21.15.96:0/1224053871 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd27c0599a0 con 0x7fd28c100dc0 2024-02-19T19:01:49.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.740+0000 7fd292e33700 1 -- 172.21.15.96:0/1224053871 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fd28c19c6a0 con 0x7fd28c100dc0 2024-02-19T19:01:49.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.917+0000 7fd281ffb700 1 -- 172.21.15.96:0/1224053871 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7fd27c08b020 con 0x7fd28c100dc0 2024-02-19T19:01:49.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.919+0000 7fd292e33700 1 -- 172.21.15.96:0/1224053871 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd27406c4e0 msgr2=0x7fd27406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:49.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.919+0000 7fd292e33700 1 --2- 172.21.15.96:0/1224053871 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd27406c4e0 0x7fd27406e9a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd288006010 tx=0x7fd28800b540 comp rx=0 tx=0).stop 2024-02-19T19:01:49.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.919+0000 7fd292e33700 1 -- 172.21.15.96:0/1224053871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd28c100dc0 msgr2=0x7fd28c196d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:49.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.919+0000 7fd292e33700 1 --2- 172.21.15.96:0/1224053871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd28c100dc0 0x7fd28c196d50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00d900 tx=0x7fd27c00dc10 comp rx=0 tx=0).stop 2024-02-19T19:01:49.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.919+0000 7fd292e33700 1 -- 172.21.15.96:0/1224053871 shutdown_connections 2024-02-19T19:01:49.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.919+0000 7fd292e33700 1 --2- 172.21.15.96:0/1224053871 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd27406c4e0 0x7fd27406e9a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:49.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.919+0000 7fd292e33700 1 --2- 172.21.15.96:0/1224053871 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd28c0ffbc0 0x7fd28c196810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:49.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.919+0000 7fd292e33700 1 --2- 172.21.15.96:0/1224053871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd28c100dc0 0x7fd28c196d50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:49.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.919+0000 7fd292e33700 1 -- 172.21.15.96:0/1224053871 >> 172.21.15.96:0/1224053871 conn(0x7fd28c0fb160 msgr2=0x7fd28c068e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:49.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.919+0000 7fd292e33700 1 -- 172.21.15.96:0/1224053871 shutdown_connections 2024-02-19T19:01:49.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:49.919+0000 7fd292e33700 1 -- 172.21.15.96:0/1224053871 wait complete. 2024-02-19T19:01:50.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:49 smithi096 ceph-mon[29216]: mds.? [v2:172.21.15.96:6826/3917487208,v1:172.21.15.96:6827/3917487208] up:active 2024-02-19T19:01:50.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:49 smithi096 ceph-mon[29216]: fsmap cephfs:1 {0=cephfs.smithi096.usrmcg=up:active} 2024-02-19T19:01:50.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:49 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/1224053871' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-19T19:01:50.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:49 smithi125 ceph-mon[37556]: mds.? [v2:172.21.15.96:6826/3917487208,v1:172.21.15.96:6827/3917487208] up:active 2024-02-19T19:01:50.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:49 smithi125 ceph-mon[37556]: fsmap cephfs:1 {0=cephfs.smithi096.usrmcg=up:active} 2024-02-19T19:01:50.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:49 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/1224053871' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-02-19T19:01:50.511 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-19T19:01:50.521 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi096.front.sepia.ceph.com 2024-02-19T19:01:50.521 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-02-19T19:01:50.750 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:01:51.008 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:50 smithi096 ceph-mon[29216]: pgmap v179: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-02-19T19:01:51.008 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:50 smithi096 ceph-mon[29216]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-19T19:01:51.008 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:50 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/1224053871' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-19T19:01:51.008 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:50 smithi096 ceph-mon[29216]: fsmap cephfs:1 {0=cephfs.smithi096.usrmcg=up:active} 2024-02-19T19:01:51.008 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:50 smithi096 ceph-mon[29216]: daemon mds.cephfs.smithi125.srnlol assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-19T19:01:51.008 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:50 smithi096 ceph-mon[29216]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-19T19:01:51.008 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:50 smithi096 ceph-mon[29216]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-19T19:01:51.008 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:50 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:51.008 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:50 smithi096 ceph-mon[29216]: mds.? [v2:172.21.15.125:6824/3084054986,v1:172.21.15.125:6825/3084054986] up:boot 2024-02-19T19:01:51.008 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:50 smithi096 ceph-mon[29216]: fsmap cephfs:2 {0=cephfs.smithi096.usrmcg=up:active,1=cephfs.smithi125.srnlol=up:creating} 2024-02-19T19:01:51.009 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:50 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.srnlol"}]: dispatch 2024-02-19T19:01:51.009 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:50 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:51.009 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:50 smithi096 ceph-mon[29216]: daemon mds.cephfs.smithi125.srnlol is now active in filesystem cephfs as rank 1 2024-02-19T19:01:51.009 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:50 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:51.009 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:50 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.pccmys", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:01:51.009 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:50 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.pccmys", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T19:01:51.009 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:50 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:01:51.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:50 smithi125 ceph-mon[37556]: pgmap v179: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-02-19T19:01:51.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:50 smithi125 ceph-mon[37556]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-19T19:01:51.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:50 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/1224053871' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-02-19T19:01:51.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:50 smithi125 ceph-mon[37556]: fsmap cephfs:1 {0=cephfs.smithi096.usrmcg=up:active} 2024-02-19T19:01:51.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:50 smithi125 ceph-mon[37556]: daemon mds.cephfs.smithi125.srnlol assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-02-19T19:01:51.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:50 smithi125 ceph-mon[37556]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-19T19:01:51.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:50 smithi125 ceph-mon[37556]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-19T19:01:51.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:50 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:51.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:50 smithi125 ceph-mon[37556]: mds.? [v2:172.21.15.125:6824/3084054986,v1:172.21.15.125:6825/3084054986] up:boot 2024-02-19T19:01:51.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:50 smithi125 ceph-mon[37556]: fsmap cephfs:2 {0=cephfs.smithi096.usrmcg=up:active,1=cephfs.smithi125.srnlol=up:creating} 2024-02-19T19:01:51.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:50 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.srnlol"}]: dispatch 2024-02-19T19:01:51.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:50 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:51.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:50 smithi125 ceph-mon[37556]: daemon mds.cephfs.smithi125.srnlol is now active in filesystem cephfs as rank 1 2024-02-19T19:01:51.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:50 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:51.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:50 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.pccmys", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:01:51.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:50 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.pccmys", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T19:01:51.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:50 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:01:52.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:51 smithi125 ceph-mon[37556]: Deploying daemon mds.cephfs.smithi096.pccmys on smithi096 2024-02-19T19:01:52.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:51 smithi125 ceph-mon[37556]: mds.? [v2:172.21.15.125:6824/3084054986,v1:172.21.15.125:6825/3084054986] up:active 2024-02-19T19:01:52.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:51 smithi125 ceph-mon[37556]: fsmap cephfs:2 {0=cephfs.smithi096.usrmcg=up:active,1=cephfs.smithi125.srnlol=up:active} 2024-02-19T19:01:52.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:51 smithi096 ceph-mon[29216]: Deploying daemon mds.cephfs.smithi096.pccmys on smithi096 2024-02-19T19:01:52.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:51 smithi096 ceph-mon[29216]: mds.? [v2:172.21.15.125:6824/3084054986,v1:172.21.15.125:6825/3084054986] up:active 2024-02-19T19:01:52.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:51 smithi096 ceph-mon[29216]: fsmap cephfs:2 {0=cephfs.smithi096.usrmcg=up:active,1=cephfs.smithi125.srnlol=up:active} 2024-02-19T19:01:53.074 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:52 smithi096 ceph-mon[29216]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 4 op/s 2024-02-19T19:01:53.199 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:52 smithi125 ceph-mon[37556]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 4 op/s 2024-02-19T19:01:53.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.448+0000 7fe349510700 1 -- 172.21.15.96:0/1759273718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe344100cb0 msgr2=0x7fe3441010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:53.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.448+0000 7fe349510700 1 --2- 172.21.15.96:0/1759273718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe344100cb0 0x7fe3441010d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe334009910 tx=0x7fe334009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:53.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.448+0000 7fe349510700 1 -- 172.21.15.96:0/1759273718 shutdown_connections 2024-02-19T19:01:53.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.448+0000 7fe349510700 1 --2- 172.21.15.96:0/1759273718 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe344101eb0 0x7fe344102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:53.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.448+0000 7fe349510700 1 --2- 172.21.15.96:0/1759273718 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe344100cb0 0x7fe3441010d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:53.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.448+0000 7fe349510700 1 -- 172.21.15.96:0/1759273718 >> 172.21.15.96:0/1759273718 conn(0x7fe3440fc230 msgr2=0x7fe3440fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:53.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.448+0000 7fe349510700 1 -- 172.21.15.96:0/1759273718 shutdown_connections 2024-02-19T19:01:53.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.448+0000 7fe349510700 1 -- 172.21.15.96:0/1759273718 wait complete. 2024-02-19T19:01:53.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.449+0000 7fe349510700 1 Processor -- start 2024-02-19T19:01:53.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.449+0000 7fe349510700 1 -- start start 2024-02-19T19:01:53.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.449+0000 7fe349510700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe344100cb0 0x7fe3441964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:53.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.449+0000 7fe349510700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe344101eb0 0x7fe344196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:53.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.449+0000 7fe349510700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe344197050 con 0x7fe344100cb0 2024-02-19T19:01:53.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.449+0000 7fe349510700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe344197190 con 0x7fe344101eb0 2024-02-19T19:01:53.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.449+0000 7fe342ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe344100cb0 0x7fe3441964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:53.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.449+0000 7fe342ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe344100cb0 0x7fe3441964f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52404/0 (socket says 172.21.15.96:52404) 2024-02-19T19:01:53.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.449+0000 7fe342ffd700 1 -- 172.21.15.96:0/4262781017 learned_addr learned my addr 172.21.15.96:0/4262781017 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:53.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.450+0000 7fe3427fc700 1 --2- 172.21.15.96:0/4262781017 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe344101eb0 0x7fe344196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:53.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.450+0000 7fe342ffd700 1 -- 172.21.15.96:0/4262781017 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe344101eb0 msgr2=0x7fe344196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:53.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.450+0000 7fe342ffd700 1 --2- 172.21.15.96:0/4262781017 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe344101eb0 0x7fe344196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:53.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.450+0000 7fe342ffd700 1 -- 172.21.15.96:0/4262781017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3340095f0 con 0x7fe344100cb0 2024-02-19T19:01:53.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.450+0000 7fe342ffd700 1 --2- 172.21.15.96:0/4262781017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe344100cb0 0x7fe3441964f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe33400bda0 tx=0x7fe33400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:53.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.450+0000 7fe32bfff700 1 -- 172.21.15.96:0/4262781017 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe33401d070 con 0x7fe344100cb0 2024-02-19T19:01:53.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.450+0000 7fe349510700 1 -- 172.21.15.96:0/4262781017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe34419bbe0 con 0x7fe344100cb0 2024-02-19T19:01:53.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.450+0000 7fe32bfff700 1 -- 172.21.15.96:0/4262781017 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe334022470 con 0x7fe344100cb0 2024-02-19T19:01:53.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.450+0000 7fe349510700 1 -- 172.21.15.96:0/4262781017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe34419c0d0 con 0x7fe344100cb0 2024-02-19T19:01:53.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.450+0000 7fe32bfff700 1 -- 172.21.15.96:0/4262781017 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe33400f650 con 0x7fe344100cb0 2024-02-19T19:01:53.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.452+0000 7fe32bfff700 1 -- 172.21.15.96:0/4262781017 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fe334004af0 con 0x7fe344100cb0 2024-02-19T19:01:53.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.452+0000 7fe349510700 1 -- 172.21.15.96:0/4262781017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe344109810 con 0x7fe344100cb0 2024-02-19T19:01:53.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.452+0000 7fe32bfff700 1 --2- 172.21.15.96:0/4262781017 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fe32c06c4e0 0x7fe32c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:53.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.452+0000 7fe32bfff700 1 -- 172.21.15.96:0/4262781017 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7fe33408ce00 con 0x7fe344100cb0 2024-02-19T19:01:53.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.452+0000 7fe3427fc700 1 --2- 172.21.15.96:0/4262781017 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fe32c06c4e0 0x7fe32c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:53.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.453+0000 7fe3427fc700 1 --2- 172.21.15.96:0/4262781017 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fe32c06c4e0 0x7fe32c06e9a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe338005950 tx=0x7fe33800a300 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:53.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.457+0000 7fe32bfff700 1 -- 172.21.15.96:0/4262781017 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe33405b120 con 0x7fe344100cb0 2024-02-19T19:01:53.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.701+0000 7fe349510700 1 -- 172.21.15.96:0/4262781017 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fe344109a00 con 0x7fe344100cb0 2024-02-19T19:01:53.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.930+0000 7fe32bfff700 1 -- 172.21.15.96:0/4262781017 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v9) v1 ==== 121+0+0 (secure 0 0 0) 0x7fe344109a00 con 0x7fe344100cb0 2024-02-19T19:01:53.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.933+0000 7fe349510700 1 -- 172.21.15.96:0/4262781017 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fe32c06c4e0 msgr2=0x7fe32c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:53.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.933+0000 7fe349510700 1 --2- 172.21.15.96:0/4262781017 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fe32c06c4e0 0x7fe32c06e9a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe338005950 tx=0x7fe33800a300 comp rx=0 tx=0).stop 2024-02-19T19:01:53.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.933+0000 7fe349510700 1 -- 172.21.15.96:0/4262781017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe344100cb0 msgr2=0x7fe3441964f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:53.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.933+0000 7fe349510700 1 --2- 172.21.15.96:0/4262781017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe344100cb0 0x7fe3441964f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe33400bda0 tx=0x7fe33400bdd0 comp rx=0 tx=0).stop 2024-02-19T19:01:53.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.933+0000 7fe349510700 1 -- 172.21.15.96:0/4262781017 shutdown_connections 2024-02-19T19:01:53.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.933+0000 7fe349510700 1 --2- 172.21.15.96:0/4262781017 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fe32c06c4e0 0x7fe32c06e9a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:53.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.933+0000 7fe349510700 1 --2- 172.21.15.96:0/4262781017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe344100cb0 0x7fe3441964f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:53.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.933+0000 7fe349510700 1 --2- 172.21.15.96:0/4262781017 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe344101eb0 0x7fe344196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:53.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.933+0000 7fe349510700 1 -- 172.21.15.96:0/4262781017 >> 172.21.15.96:0/4262781017 conn(0x7fe3440fc230 msgr2=0x7fe3441050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:53.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.933+0000 7fe349510700 1 -- 172.21.15.96:0/4262781017 shutdown_connections 2024-02-19T19:01:53.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:53.933+0000 7fe349510700 1 -- 172.21.15.96:0/4262781017 wait complete. 2024-02-19T19:01:54.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:53 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/4262781017' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-02-19T19:01:54.254 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:53 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/4262781017' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-02-19T19:01:54.540 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-19T19:01:54.549 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi096.front.sepia.ceph.com 2024-02-19T19:01:54.550 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-02-19T19:01:54.757 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:01:55.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:54 smithi096 ceph-mon[29216]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s wr, 7 op/s 2024-02-19T19:01:55.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:54 smithi096 ceph-mon[29216]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-19T19:01:55.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:54 smithi096 ceph-mon[29216]: Cluster is now healthy 2024-02-19T19:01:55.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:54 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/4262781017' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-02-19T19:01:55.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:54 smithi096 ceph-mon[29216]: mds.? [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] up:boot 2024-02-19T19:01:55.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:54 smithi096 ceph-mon[29216]: fsmap cephfs:2 {0=cephfs.smithi096.usrmcg=up:active,1=cephfs.smithi125.srnlol=up:active} 1 up:standby 2024-02-19T19:01:55.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:54 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pccmys"}]: dispatch 2024-02-19T19:01:55.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:54 smithi096 ceph-mon[29216]: fsmap cephfs:2 {0=cephfs.smithi096.usrmcg=up:active,1=cephfs.smithi125.srnlol=up:active} 1 up:standby-replay 2024-02-19T19:01:55.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:54 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:55.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:54 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:55.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:54 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:55.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:54 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi125.pwyuga", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:01:55.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:54 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi125.pwyuga", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T19:01:55.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:54 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:01:55.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:54 smithi096 ceph-mon[29216]: Deploying daemon mds.cephfs.smithi125.pwyuga on smithi125 2024-02-19T19:01:55.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:54 smithi125 ceph-mon[37556]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s wr, 7 op/s 2024-02-19T19:01:55.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:54 smithi125 ceph-mon[37556]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-19T19:01:55.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:54 smithi125 ceph-mon[37556]: Cluster is now healthy 2024-02-19T19:01:55.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:54 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/4262781017' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-02-19T19:01:55.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:54 smithi125 ceph-mon[37556]: mds.? [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] up:boot 2024-02-19T19:01:55.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:54 smithi125 ceph-mon[37556]: fsmap cephfs:2 {0=cephfs.smithi096.usrmcg=up:active,1=cephfs.smithi125.srnlol=up:active} 1 up:standby 2024-02-19T19:01:55.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:54 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pccmys"}]: dispatch 2024-02-19T19:01:55.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:54 smithi125 ceph-mon[37556]: fsmap cephfs:2 {0=cephfs.smithi096.usrmcg=up:active,1=cephfs.smithi125.srnlol=up:active} 1 up:standby-replay 2024-02-19T19:01:55.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:54 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:55.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:54 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:55.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:54 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:55.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:54 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi125.pwyuga", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:01:55.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:54 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi125.pwyuga", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-19T19:01:55.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:54 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:01:55.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:54 smithi125 ceph-mon[37556]: Deploying daemon mds.cephfs.smithi125.pwyuga on smithi125 2024-02-19T19:01:56.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.247+0000 7f484d8a2700 1 -- 172.21.15.96:0/1253623030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48481017f0 msgr2=0x7f4848103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:56.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.247+0000 7f484d8a2700 1 --2- 172.21.15.96:0/1253623030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48481017f0 0x7f4848103be0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4838009910 tx=0x7f4838009c20 comp rx=0 tx=0).stop 2024-02-19T19:01:56.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.247+0000 7f484d8a2700 1 -- 172.21.15.96:0/1253623030 shutdown_connections 2024-02-19T19:01:56.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.247+0000 7f484d8a2700 1 --2- 172.21.15.96:0/1253623030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4848104120 0x7f4848106510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:56.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.247+0000 7f484d8a2700 1 --2- 172.21.15.96:0/1253623030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48481017f0 0x7f4848103be0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:56.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.247+0000 7f484d8a2700 1 -- 172.21.15.96:0/1253623030 >> 172.21.15.96:0/1253623030 conn(0x7f48480fb160 msgr2=0x7f48480fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:56.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.247+0000 7f484d8a2700 1 -- 172.21.15.96:0/1253623030 shutdown_connections 2024-02-19T19:01:56.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.247+0000 7f484d8a2700 1 -- 172.21.15.96:0/1253623030 wait complete. 2024-02-19T19:01:56.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.248+0000 7f484d8a2700 1 Processor -- start 2024-02-19T19:01:56.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.248+0000 7f484d8a2700 1 -- start start 2024-02-19T19:01:56.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.248+0000 7f484d8a2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48481017f0 0x7f4848198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:56.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.248+0000 7f484d8a2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4848104120 0x7f4848198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:56.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.248+0000 7f484d8a2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48481995c0 con 0x7f4848104120 2024-02-19T19:01:56.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.248+0000 7f484d8a2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4848199700 con 0x7f48481017f0 2024-02-19T19:01:56.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.248+0000 7f48467fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4848104120 0x7f4848198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:56.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.248+0000 7f48467fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4848104120 0x7f4848198fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52436/0 (socket says 172.21.15.96:52436) 2024-02-19T19:01:56.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.248+0000 7f48467fc700 1 -- 172.21.15.96:0/4210424898 learned_addr learned my addr 172.21.15.96:0/4210424898 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:01:56.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.249+0000 7f4846ffd700 1 --2- 172.21.15.96:0/4210424898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48481017f0 0x7f4848198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:56.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.249+0000 7f48467fc700 1 -- 172.21.15.96:0/4210424898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48481017f0 msgr2=0x7f4848198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:56.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.249+0000 7f48467fc700 1 --2- 172.21.15.96:0/4210424898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48481017f0 0x7f4848198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:56.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.249+0000 7f48467fc700 1 -- 172.21.15.96:0/4210424898 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48380095f0 con 0x7f4848104120 2024-02-19T19:01:56.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.249+0000 7f48467fc700 1 --2- 172.21.15.96:0/4210424898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4848104120 0x7f4848198fa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f483c00b4b0 tx=0x7f483c00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:56.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.249+0000 7f484c8a0700 1 -- 172.21.15.96:0/4210424898 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f483c011800 con 0x7f4848104120 2024-02-19T19:01:56.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.249+0000 7f484d8a2700 1 -- 172.21.15.96:0/4210424898 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484819e1b0 con 0x7f4848104120 2024-02-19T19:01:56.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.249+0000 7f484c8a0700 1 -- 172.21.15.96:0/4210424898 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f483c011e10 con 0x7f4848104120 2024-02-19T19:01:56.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.249+0000 7f484c8a0700 1 -- 172.21.15.96:0/4210424898 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f483c00f2e0 con 0x7f4848104120 2024-02-19T19:01:56.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.249+0000 7f484d8a2700 1 -- 172.21.15.96:0/4210424898 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484819e700 con 0x7f4848104120 2024-02-19T19:01:56.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.250+0000 7f484d8a2700 1 -- 172.21.15.96:0/4210424898 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48480fcd30 con 0x7f4848104120 2024-02-19T19:01:56.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.251+0000 7f484c8a0700 1 -- 172.21.15.96:0/4210424898 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f483c010380 con 0x7f4848104120 2024-02-19T19:01:56.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.251+0000 7f484c8a0700 1 --2- 172.21.15.96:0/4210424898 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f483006c4e0 0x7f483006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:01:56.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.251+0000 7f484c8a0700 1 -- 172.21.15.96:0/4210424898 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f483c08b3d0 con 0x7f4848104120 2024-02-19T19:01:56.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.251+0000 7f4846ffd700 1 --2- 172.21.15.96:0/4210424898 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f483006c4e0 0x7f483006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:01:56.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.251+0000 7f4846ffd700 1 --2- 172.21.15.96:0/4210424898 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f483006c4e0 0x7f483006e9a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4838006010 tx=0x7f483800b540 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:01:56.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.256+0000 7f484c8a0700 1 -- 172.21.15.96:0/4210424898 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f483c059640 con 0x7f4848104120 2024-02-19T19:01:56.504 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:56 smithi125 ceph-mon[37556]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s wr, 7 op/s 2024-02-19T19:01:56.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:56.486+0000 7f484d8a2700 1 -- 172.21.15.96:0/4210424898 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f484802cf60 con 0x7f4848104120 2024-02-19T19:01:56.506 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:56 smithi096 ceph-mon[29216]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s wr, 7 op/s 2024-02-19T19:01:57.410 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:57.390+0000 7f484c8a0700 1 -- 172.21.15.96:0/4210424898 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v11) v1 ==== 168+0+0 (secure 0 0 0) 0x7f483c0591d0 con 0x7f4848104120 2024-02-19T19:01:57.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:57.392+0000 7f484d8a2700 1 -- 172.21.15.96:0/4210424898 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f483006c4e0 msgr2=0x7f483006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:57.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:57.392+0000 7f484d8a2700 1 --2- 172.21.15.96:0/4210424898 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f483006c4e0 0x7f483006e9a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4838006010 tx=0x7f483800b540 comp rx=0 tx=0).stop 2024-02-19T19:01:57.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:57.392+0000 7f484d8a2700 1 -- 172.21.15.96:0/4210424898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4848104120 msgr2=0x7f4848198fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:01:57.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:57.392+0000 7f484d8a2700 1 --2- 172.21.15.96:0/4210424898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4848104120 0x7f4848198fa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f483c00b4b0 tx=0x7f483c00b7c0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:57.393+0000 7f484d8a2700 1 -- 172.21.15.96:0/4210424898 shutdown_connections 2024-02-19T19:01:57.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:57.393+0000 7f484d8a2700 1 --2- 172.21.15.96:0/4210424898 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f483006c4e0 0x7f483006e9a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:57.393+0000 7f484d8a2700 1 --2- 172.21.15.96:0/4210424898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f48481017f0 0x7f4848198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:57.393+0000 7f484d8a2700 1 --2- 172.21.15.96:0/4210424898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4848104120 0x7f4848198fa0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:01:57.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:57.393+0000 7f484d8a2700 1 -- 172.21.15.96:0/4210424898 >> 172.21.15.96:0/4210424898 conn(0x7f48480fb160 msgr2=0x7f4848104df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:01:57.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:57.393+0000 7f484d8a2700 1 -- 172.21.15.96:0/4210424898 shutdown_connections 2024-02-19T19:01:57.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:01:57.393+0000 7f484d8a2700 1 -- 172.21.15.96:0/4210424898 wait complete. 2024-02-19T19:01:57.414 INFO:teuthology.orchestra.run.smithi096.stderr:inline data enabled 2024-02-19T19:01:57.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:57 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/4210424898' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T19:01:57.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:57 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:57.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:57 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:57.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:57 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:57.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:57 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:57.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:57 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:57.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:57 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:01:57.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:57 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/4210424898' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-19T19:01:57.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:57 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:57.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:57 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:57.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:57 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:57.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:57 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:57.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:57 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:57.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:57 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:01:58.232 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-19T19:01:58.242 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi096.front.sepia.ceph.com 2024-02-19T19:01:58.242 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-19T19:01:58.471 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:01:58.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:58 smithi096 ceph-mon[29216]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-02-19T19:01:58.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:58 smithi096 ceph-mon[29216]: mds.? [v2:172.21.15.125:6826/3098247423,v1:172.21.15.125:6827/3098247423] up:boot 2024-02-19T19:01:58.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:58 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/4210424898' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-02-19T19:01:58.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:58 smithi096 ceph-mon[29216]: fsmap cephfs:2 {0=cephfs.smithi096.usrmcg=up:active,1=cephfs.smithi125.srnlol=up:active} 1 up:standby-replay 1 up:standby 2024-02-19T19:01:58.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:58 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.pwyuga"}]: dispatch 2024-02-19T19:01:58.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:58 smithi096 ceph-mon[29216]: fsmap cephfs:2 {0=cephfs.smithi096.usrmcg=up:active,1=cephfs.smithi125.srnlol=up:active} 2 up:standby-replay 2024-02-19T19:01:58.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:58 smithi096 ceph-mon[29216]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 2.2 KiB/s wr, 8 op/s 2024-02-19T19:01:58.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:58 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:58.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:58 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:01:58.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:58 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:58.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:58 smithi125 ceph-mon[37556]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-02-19T19:01:58.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:58 smithi125 ceph-mon[37556]: mds.? [v2:172.21.15.125:6826/3098247423,v1:172.21.15.125:6827/3098247423] up:boot 2024-02-19T19:01:58.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:58 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/4210424898' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-02-19T19:01:58.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:58 smithi125 ceph-mon[37556]: fsmap cephfs:2 {0=cephfs.smithi096.usrmcg=up:active,1=cephfs.smithi125.srnlol=up:active} 1 up:standby-replay 1 up:standby 2024-02-19T19:01:58.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:58 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.pwyuga"}]: dispatch 2024-02-19T19:01:58.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:58 smithi125 ceph-mon[37556]: fsmap cephfs:2 {0=cephfs.smithi096.usrmcg=up:active,1=cephfs.smithi125.srnlol=up:active} 2 up:standby-replay 2024-02-19T19:01:58.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:58 smithi125 ceph-mon[37556]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 2.2 KiB/s wr, 8 op/s 2024-02-19T19:01:58.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:58 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:58.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:58 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:01:58.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:58 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:59.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:59 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:59.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:59 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:01:59.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:59 smithi125 ceph-mon[37556]: mds.? [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] up:standby-replay 2024-02-19T19:01:59.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:59 smithi125 ceph-mon[37556]: mds.? [v2:172.21.15.125:6824/3084054986,v1:172.21.15.125:6825/3084054986] up:active 2024-02-19T19:01:59.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:59 smithi125 ceph-mon[37556]: Dropping low affinity active daemon mds.cephfs.smithi096.usrmcg in favor of higher affinity standby. 2024-02-19T19:01:59.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:59 smithi125 ceph-mon[37556]: Replacing daemon mds.cephfs.smithi096.usrmcg as rank 0 with standby daemon mds.cephfs.smithi096.pccmys 2024-02-19T19:01:59.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:59 smithi125 ceph-mon[37556]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-19T19:01:59.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:59 smithi125 ceph-mon[37556]: fsmap cephfs:2 {0=cephfs.smithi096.usrmcg=up:active,1=cephfs.smithi125.srnlol=up:active} 2 up:standby-replay 2024-02-19T19:01:59.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:59 smithi125 ceph-mon[37556]: osdmap e46: 6 total, 6 up, 6 in 2024-02-19T19:01:59.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:01:59 smithi125 ceph-mon[37556]: fsmap cephfs:2/2 {0=cephfs.smithi096.pccmys=up:replay,1=cephfs.smithi125.srnlol=up:active} 1 up:standby-replay 2024-02-19T19:02:00.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:59 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:02:00.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:59 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:02:00.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:59 smithi096 ceph-mon[29216]: mds.? [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] up:standby-replay 2024-02-19T19:02:00.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:59 smithi096 ceph-mon[29216]: mds.? [v2:172.21.15.125:6824/3084054986,v1:172.21.15.125:6825/3084054986] up:active 2024-02-19T19:02:00.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:59 smithi096 ceph-mon[29216]: Dropping low affinity active daemon mds.cephfs.smithi096.usrmcg in favor of higher affinity standby. 2024-02-19T19:02:00.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:59 smithi096 ceph-mon[29216]: Replacing daemon mds.cephfs.smithi096.usrmcg as rank 0 with standby daemon mds.cephfs.smithi096.pccmys 2024-02-19T19:02:00.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:59 smithi096 ceph-mon[29216]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-19T19:02:00.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:59 smithi096 ceph-mon[29216]: fsmap cephfs:2 {0=cephfs.smithi096.usrmcg=up:active,1=cephfs.smithi125.srnlol=up:active} 2 up:standby-replay 2024-02-19T19:02:00.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:59 smithi096 ceph-mon[29216]: osdmap e46: 6 total, 6 up, 6 in 2024-02-19T19:02:00.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:01:59 smithi096 ceph-mon[29216]: fsmap cephfs:2/2 {0=cephfs.smithi096.pccmys=up:replay,1=cephfs.smithi125.srnlol=up:active} 1 up:standby-replay 2024-02-19T19:02:01.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:00 smithi096 ceph-mon[29216]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-02-19T19:02:01.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:00 smithi096 ceph-mon[29216]: mds.? [v2:172.21.15.96:6826/413113741,v1:172.21.15.96:6827/413113741] up:boot 2024-02-19T19:02:01.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:00 smithi096 ceph-mon[29216]: mds.? [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] up:resolve 2024-02-19T19:02:01.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:00 smithi096 ceph-mon[29216]: fsmap cephfs:2/2 {0=cephfs.smithi096.pccmys=up:resolve,1=cephfs.smithi125.srnlol=up:active} 1 up:standby-replay 1 up:standby 2024-02-19T19:02:01.052 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:00 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.usrmcg"}]: dispatch 2024-02-19T19:02:01.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:00 smithi125 ceph-mon[37556]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 1.8 KiB/s wr, 8 op/s 2024-02-19T19:02:01.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:00 smithi125 ceph-mon[37556]: mds.? [v2:172.21.15.96:6826/413113741,v1:172.21.15.96:6827/413113741] up:boot 2024-02-19T19:02:01.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:00 smithi125 ceph-mon[37556]: mds.? [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] up:resolve 2024-02-19T19:02:01.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:00 smithi125 ceph-mon[37556]: fsmap cephfs:2/2 {0=cephfs.smithi096.pccmys=up:resolve,1=cephfs.smithi125.srnlol=up:active} 1 up:standby-replay 1 up:standby 2024-02-19T19:02:01.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:00 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.usrmcg"}]: dispatch 2024-02-19T19:02:01.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.520+0000 7f930a763700 1 -- 172.21.15.96:0/3882851555 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93040ffba0 msgr2=0x7f93040fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:01.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.520+0000 7f930a763700 1 --2- 172.21.15.96:0/3882851555 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93040ffba0 0x7f93040fffc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009910 tx=0x7f92f4009c20 comp rx=0 tx=0).stop 2024-02-19T19:02:01.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.520+0000 7f930a763700 1 -- 172.21.15.96:0/3882851555 shutdown_connections 2024-02-19T19:02:01.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.520+0000 7f930a763700 1 --2- 172.21.15.96:0/3882851555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9304100da0 0x7f9304101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:01.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.520+0000 7f930a763700 1 --2- 172.21.15.96:0/3882851555 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93040ffba0 0x7f93040fffc0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:01.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.520+0000 7f930a763700 1 -- 172.21.15.96:0/3882851555 >> 172.21.15.96:0/3882851555 conn(0x7f93040fb120 msgr2=0x7f93040fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:01.541 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.520+0000 7f930a763700 1 -- 172.21.15.96:0/3882851555 shutdown_connections 2024-02-19T19:02:01.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.520+0000 7f930a763700 1 -- 172.21.15.96:0/3882851555 wait complete. 2024-02-19T19:02:01.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.521+0000 7f930a763700 1 Processor -- start 2024-02-19T19:02:01.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.521+0000 7f930a763700 1 -- start start 2024-02-19T19:02:01.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.521+0000 7f930a763700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93040ffba0 0x7f9304069990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:01.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.521+0000 7f930a763700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9304100da0 0x7f930419b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:01.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.521+0000 7f930a763700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930419b800 con 0x7f93040ffba0 2024-02-19T19:02:01.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.521+0000 7f930a763700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930419b940 con 0x7f9304100da0 2024-02-19T19:02:01.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.521+0000 7f9303fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93040ffba0 0x7f9304069990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:01.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.521+0000 7f9303fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93040ffba0 0x7f9304069990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52462/0 (socket says 172.21.15.96:52462) 2024-02-19T19:02:01.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.521+0000 7f9303fff700 1 -- 172.21.15.96:0/2322851083 learned_addr learned my addr 172.21.15.96:0/2322851083 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:02:01.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.521+0000 7f93037fe700 1 --2- 172.21.15.96:0/2322851083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9304100da0 0x7f930419b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:01.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.522+0000 7f9303fff700 1 -- 172.21.15.96:0/2322851083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9304100da0 msgr2=0x7f930419b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:01.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.522+0000 7f9303fff700 1 --2- 172.21.15.96:0/2322851083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9304100da0 0x7f930419b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:01.542 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.522+0000 7f9303fff700 1 -- 172.21.15.96:0/2322851083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f40095f0 con 0x7f93040ffba0 2024-02-19T19:02:01.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.522+0000 7f9303fff700 1 --2- 172.21.15.96:0/2322851083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93040ffba0 0x7f9304069990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f92f400bda0 tx=0x7f92f400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:01.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.522+0000 7f93017fa700 1 -- 172.21.15.96:0/2322851083 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92f401d070 con 0x7f93040ffba0 2024-02-19T19:02:01.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.522+0000 7f93017fa700 1 -- 172.21.15.96:0/2322851083 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f92f4022470 con 0x7f93040ffba0 2024-02-19T19:02:01.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.522+0000 7f930a763700 1 -- 172.21.15.96:0/2322851083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930419bbc0 con 0x7f93040ffba0 2024-02-19T19:02:01.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.522+0000 7f93017fa700 1 -- 172.21.15.96:0/2322851083 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92f400f670 con 0x7f93040ffba0 2024-02-19T19:02:01.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.522+0000 7f930a763700 1 -- 172.21.15.96:0/2322851083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930419c0b0 con 0x7f93040ffba0 2024-02-19T19:02:01.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.523+0000 7f930a763700 1 -- 172.21.15.96:0/2322851083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9304108700 con 0x7f93040ffba0 2024-02-19T19:02:01.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.524+0000 7f93017fa700 1 -- 172.21.15.96:0/2322851083 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f92f4004af0 con 0x7f93040ffba0 2024-02-19T19:02:01.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.524+0000 7f93017fa700 1 --2- 172.21.15.96:0/2322851083 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f92ec06c4e0 0x7f92ec06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:01.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.524+0000 7f93017fa700 1 -- 172.21.15.96:0/2322851083 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f92f408cd80 con 0x7f93040ffba0 2024-02-19T19:02:01.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.524+0000 7f93037fe700 1 --2- 172.21.15.96:0/2322851083 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f92ec06c4e0 0x7f92ec06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:01.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.524+0000 7f93037fe700 1 --2- 172.21.15.96:0/2322851083 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f92ec06c4e0 0x7f92ec06e9a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9304069f10 tx=0x7f92f800a300 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:01.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.528+0000 7f93017fa700 1 -- 172.21.15.96:0/2322851083 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f92f405b0c0 con 0x7f93040ffba0 2024-02-19T19:02:01.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.771+0000 7f930a763700 1 -- 172.21.15.96:0/2322851083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f930419cbc0 con 0x7f93040ffba0 2024-02-19T19:02:01.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.772+0000 7f93017fa700 1 -- 172.21.15.96:0/2322851083 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1864 (secure 0 0 0) 0x7f92f4027760 con 0x7f93040ffba0 2024-02-19T19:02:01.791 INFO:teuthology.orchestra.run.smithi096.stdout:e16 2024-02-19T19:02:01.791 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:02:01.791 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:02:01.791 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2024-02-19T19:02:01.791 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:02:01.791 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:02:01.791 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2024-02-19T19:02:01.791 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 16 2024-02-19T19:02:01.791 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-19T19:02:01.791 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-02-19T19:01:42.881136+0000 2024-02-19T19:02:01.791 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2024-02-19T19:02:00.853810+0000 2024-02-19T19:02:01.792 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2024-02-19T19:02:01.792 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2024-02-19T19:02:01.792 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2024-02-19T19:02:01.792 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2024-02-19T19:02:01.792 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2024-02-19T19:02:01.792 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2024-02-19T19:02:01.792 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2024-02-19T19:02:01.792 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 46 2024-02-19T19:02:01.792 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:02:01.792 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2024-02-19T19:02:01.792 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2024-02-19T19:02:01.792 INFO:teuthology.orchestra.run.smithi096.stdout:up {0=14490,1=24267} 2024-02-19T19:02:01.792 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2024-02-19T19:02:01.793 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2024-02-19T19:02:01.793 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2024-02-19T19:02:01.793 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2024-02-19T19:02:01.793 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2024-02-19T19:02:01.793 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data enabled 2024-02-19T19:02:01.793 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2024-02-19T19:02:01.793 INFO:teuthology.orchestra.run.smithi096.stdout:bal_rank_mask -1 2024-02-19T19:02:01.793 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2024-02-19T19:02:01.793 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pccmys{0:14490} state up:reconnect seq 4 join_fscid=1 addr [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:02:01.793 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.srnlol{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.125:6824/3084054986,v1:172.21.15.125:6825/3084054986] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:02:01.793 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.pwyuga{1:24275} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.125:6826/3098247423,v1:172.21.15.125:6827/3098247423] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:02:01.793 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:02:01.793 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:02:01.793 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2024-02-19T19:02:01.793 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:02:01.794 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.usrmcg{-1:14502} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/413113741,v1:172.21.15.96:6827/413113741] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:02:01.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.774+0000 7f930a763700 1 -- 172.21.15.96:0/2322851083 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f92ec06c4e0 msgr2=0x7f92ec06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:01.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.774+0000 7f930a763700 1 --2- 172.21.15.96:0/2322851083 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f92ec06c4e0 0x7f92ec06e9a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9304069f10 tx=0x7f92f800a300 comp rx=0 tx=0).stop 2024-02-19T19:02:01.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.774+0000 7f930a763700 1 -- 172.21.15.96:0/2322851083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93040ffba0 msgr2=0x7f9304069990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:01.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.774+0000 7f930a763700 1 --2- 172.21.15.96:0/2322851083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93040ffba0 0x7f9304069990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f92f400bda0 tx=0x7f92f400bdd0 comp rx=0 tx=0).stop 2024-02-19T19:02:01.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.774+0000 7f930a763700 1 -- 172.21.15.96:0/2322851083 shutdown_connections 2024-02-19T19:02:01.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.774+0000 7f930a763700 1 --2- 172.21.15.96:0/2322851083 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f92ec06c4e0 0x7f92ec06e9a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:01.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.774+0000 7f930a763700 1 --2- 172.21.15.96:0/2322851083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93040ffba0 0x7f9304069990 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:01.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.774+0000 7f930a763700 1 --2- 172.21.15.96:0/2322851083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9304100da0 0x7f930419b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:01.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.774+0000 7f930a763700 1 -- 172.21.15.96:0/2322851083 >> 172.21.15.96:0/2322851083 conn(0x7f93040fb120 msgr2=0x7f9304103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:01.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.774+0000 7f930a763700 1 -- 172.21.15.96:0/2322851083 shutdown_connections 2024-02-19T19:02:01.795 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:01.774+0000 7f930a763700 1 -- 172.21.15.96:0/2322851083 wait complete. 2024-02-19T19:02:01.795 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 16 2024-02-19T19:02:02.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:01 smithi096 ceph-mon[29216]: mds.? [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] up:reconnect 2024-02-19T19:02:02.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:01 smithi096 ceph-mon[29216]: mds.? [v2:172.21.15.125:6826/3098247423,v1:172.21.15.125:6827/3098247423] up:standby-replay 2024-02-19T19:02:02.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:01 smithi096 ceph-mon[29216]: fsmap cephfs:2/2 {0=cephfs.smithi096.pccmys=up:reconnect,1=cephfs.smithi125.srnlol=up:active} 1 up:standby-replay 1 up:standby 2024-02-19T19:02:02.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:01 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/2322851083' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:02:02.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:01 smithi125 ceph-mon[37556]: mds.? [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] up:reconnect 2024-02-19T19:02:02.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:01 smithi125 ceph-mon[37556]: mds.? [v2:172.21.15.125:6826/3098247423,v1:172.21.15.125:6827/3098247423] up:standby-replay 2024-02-19T19:02:02.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:01 smithi125 ceph-mon[37556]: fsmap cephfs:2/2 {0=cephfs.smithi096.pccmys=up:reconnect,1=cephfs.smithi125.srnlol=up:active} 1 up:standby-replay 1 up:standby 2024-02-19T19:02:02.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:01 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/2322851083' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:02:02.349 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-02-19T19:02:02.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:02 smithi125 ceph-mon[37556]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-02-19T19:02:02.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:02 smithi125 ceph-mon[37556]: mds.? [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] up:rejoin 2024-02-19T19:02:02.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:02 smithi125 ceph-mon[37556]: fsmap cephfs:2/2 {0=cephfs.smithi096.pccmys=up:rejoin,1=cephfs.smithi125.srnlol=up:active} 1 up:standby-replay 1 up:standby 2024-02-19T19:02:02.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:02 smithi125 ceph-mon[37556]: daemon mds.cephfs.smithi096.pccmys is now active in filesystem cephfs as rank 0 2024-02-19T19:02:03.073 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:02:03.190 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:02 smithi096 ceph-mon[29216]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-02-19T19:02:03.190 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:02 smithi096 ceph-mon[29216]: mds.? [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] up:rejoin 2024-02-19T19:02:03.190 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:02 smithi096 ceph-mon[29216]: fsmap cephfs:2/2 {0=cephfs.smithi096.pccmys=up:rejoin,1=cephfs.smithi125.srnlol=up:active} 1 up:standby-replay 1 up:standby 2024-02-19T19:02:03.190 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:02 smithi096 ceph-mon[29216]: daemon mds.cephfs.smithi096.pccmys is now active in filesystem cephfs as rank 0 2024-02-19T19:02:04.193 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:03 smithi096 ceph-mon[29216]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-19T19:02:04.193 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:03 smithi096 ceph-mon[29216]: mds.? [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] up:active 2024-02-19T19:02:04.193 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:03 smithi096 ceph-mon[29216]: fsmap cephfs:2 {0=cephfs.smithi096.pccmys=up:active,1=cephfs.smithi125.srnlol=up:active} 1 up:standby-replay 1 up:standby 2024-02-19T19:02:04.193 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:03 smithi096 ceph-mon[29216]: fsmap cephfs:2 {0=cephfs.smithi096.pccmys=up:active,1=cephfs.smithi125.srnlol=up:active} 2 up:standby-replay 2024-02-19T19:02:04.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:03 smithi125 ceph-mon[37556]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-19T19:02:04.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:03 smithi125 ceph-mon[37556]: mds.? [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] up:active 2024-02-19T19:02:04.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:03 smithi125 ceph-mon[37556]: fsmap cephfs:2 {0=cephfs.smithi096.pccmys=up:active,1=cephfs.smithi125.srnlol=up:active} 1 up:standby-replay 1 up:standby 2024-02-19T19:02:04.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:03 smithi125 ceph-mon[37556]: fsmap cephfs:2 {0=cephfs.smithi096.pccmys=up:active,1=cephfs.smithi125.srnlol=up:active} 2 up:standby-replay 2024-02-19T19:02:04.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.626+0000 7f4d0d254700 1 -- 172.21.15.96:0/2190434763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d080ffc10 msgr2=0x7f4d08100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:04.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.626+0000 7f4d0d254700 1 --2- 172.21.15.96:0/2190434763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d080ffc10 0x7f4d08100030 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8009910 tx=0x7f4cf8009c20 comp rx=0 tx=0).stop 2024-02-19T19:02:04.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.626+0000 7f4d0d254700 1 -- 172.21.15.96:0/2190434763 shutdown_connections 2024-02-19T19:02:04.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.626+0000 7f4d0d254700 1 --2- 172.21.15.96:0/2190434763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d08100e10 0x7f4d08101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:04.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.626+0000 7f4d0d254700 1 --2- 172.21.15.96:0/2190434763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d080ffc10 0x7f4d08100030 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:04.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.626+0000 7f4d0d254700 1 -- 172.21.15.96:0/2190434763 >> 172.21.15.96:0/2190434763 conn(0x7f4d080fb190 msgr2=0x7f4d080fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:04.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.626+0000 7f4d0d254700 1 -- 172.21.15.96:0/2190434763 shutdown_connections 2024-02-19T19:02:04.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.626+0000 7f4d0d254700 1 -- 172.21.15.96:0/2190434763 wait complete. 2024-02-19T19:02:04.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.627+0000 7f4d0d254700 1 Processor -- start 2024-02-19T19:02:04.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.627+0000 7f4d0d254700 1 -- start start 2024-02-19T19:02:04.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.627+0000 7f4d0d254700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d080ffc10 0x7f4d08103ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:04.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.627+0000 7f4d0d254700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d08100e10 0x7f4d081021f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:04.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.627+0000 7f4d0d254700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d08102730 con 0x7f4d080ffc10 2024-02-19T19:02:04.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.627+0000 7f4d0d254700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d08102870 con 0x7f4d08100e10 2024-02-19T19:02:04.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.627+0000 7f4d06d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d080ffc10 0x7f4d08103ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:04.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.628+0000 7f4d06d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d080ffc10 0x7f4d08103ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35418/0 (socket says 172.21.15.96:35418) 2024-02-19T19:02:04.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.628+0000 7f4d06d9d700 1 -- 172.21.15.96:0/3290283626 learned_addr learned my addr 172.21.15.96:0/3290283626 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:02:04.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.628+0000 7f4d0659c700 1 --2- 172.21.15.96:0/3290283626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d08100e10 0x7f4d081021f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:04.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.628+0000 7f4d06d9d700 1 -- 172.21.15.96:0/3290283626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d08100e10 msgr2=0x7f4d081021f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:04.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.628+0000 7f4d06d9d700 1 --2- 172.21.15.96:0/3290283626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d08100e10 0x7f4d081021f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:04.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.628+0000 7f4d06d9d700 1 -- 172.21.15.96:0/3290283626 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf80095f0 con 0x7f4d080ffc10 2024-02-19T19:02:04.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.628+0000 7f4d06d9d700 1 --2- 172.21.15.96:0/3290283626 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d080ffc10 0x7f4d08103ba0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800bda0 tx=0x7f4cf800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:04.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.628+0000 7f4ceffff700 1 -- 172.21.15.96:0/3290283626 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cf801d070 con 0x7f4d080ffc10 2024-02-19T19:02:04.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.628+0000 7f4d0d254700 1 -- 172.21.15.96:0/3290283626 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d08102af0 con 0x7f4d080ffc10 2024-02-19T19:02:04.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.628+0000 7f4ceffff700 1 -- 172.21.15.96:0/3290283626 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4cf800f460 con 0x7f4d080ffc10 2024-02-19T19:02:04.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.628+0000 7f4ceffff700 1 -- 172.21.15.96:0/3290283626 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4cf8021620 con 0x7f4d080ffc10 2024-02-19T19:02:04.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.628+0000 7f4d0d254700 1 -- 172.21.15.96:0/3290283626 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d08102fe0 con 0x7f4d080ffc10 2024-02-19T19:02:04.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.629+0000 7f4d0d254700 1 -- 172.21.15.96:0/3290283626 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d08108700 con 0x7f4d080ffc10 2024-02-19T19:02:04.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.630+0000 7f4ceffff700 1 -- 172.21.15.96:0/3290283626 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f4cf8003a60 con 0x7f4d080ffc10 2024-02-19T19:02:04.649 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.631+0000 7f4ceffff700 1 --2- 172.21.15.96:0/3290283626 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f4cf006c4e0 0x7f4cf006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:04.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.631+0000 7f4ceffff700 1 -- 172.21.15.96:0/3290283626 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f4cf808ca50 con 0x7f4d080ffc10 2024-02-19T19:02:04.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.631+0000 7f4d0659c700 1 --2- 172.21.15.96:0/3290283626 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f4cf006c4e0 0x7f4cf006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:04.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.631+0000 7f4d0659c700 1 --2- 172.21.15.96:0/3290283626 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f4cf006c4e0 0x7f4cf006e9a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc005950 tx=0x7f4cfc00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:04.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.636+0000 7f4ceffff700 1 -- 172.21.15.96:0/3290283626 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f4cf805ace0 con 0x7f4d080ffc10 2024-02-19T19:02:04.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.892+0000 7f4d0d254700 1 -- 172.21.15.96:0/3290283626 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d08108920 con 0x7f4d080ffc10 2024-02-19T19:02:04.911 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.892+0000 7f4ceffff700 1 -- 172.21.15.96:0/3290283626 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4773 (secure 0 0 0) 0x7f4cf805a870 con 0x7f4d080ffc10 2024-02-19T19:02:04.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.894+0000 7f4d0d254700 1 -- 172.21.15.96:0/3290283626 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f4cf006c4e0 msgr2=0x7f4cf006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:04.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.894+0000 7f4d0d254700 1 --2- 172.21.15.96:0/3290283626 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f4cf006c4e0 0x7f4cf006e9a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc005950 tx=0x7f4cfc00b410 comp rx=0 tx=0).stop 2024-02-19T19:02:04.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.894+0000 7f4d0d254700 1 -- 172.21.15.96:0/3290283626 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d080ffc10 msgr2=0x7f4d08103ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:04.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.894+0000 7f4d0d254700 1 --2- 172.21.15.96:0/3290283626 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d080ffc10 0x7f4d08103ba0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800bda0 tx=0x7f4cf800bdd0 comp rx=0 tx=0).stop 2024-02-19T19:02:04.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.895+0000 7f4d0d254700 1 -- 172.21.15.96:0/3290283626 shutdown_connections 2024-02-19T19:02:04.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.895+0000 7f4d0d254700 1 --2- 172.21.15.96:0/3290283626 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f4cf006c4e0 0x7f4cf006e9a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:04.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.895+0000 7f4d0d254700 1 --2- 172.21.15.96:0/3290283626 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d080ffc10 0x7f4d08103ba0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:04.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.895+0000 7f4d0d254700 1 --2- 172.21.15.96:0/3290283626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4d08100e10 0x7f4d081021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:04.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.895+0000 7f4d0d254700 1 -- 172.21.15.96:0/3290283626 >> 172.21.15.96:0/3290283626 conn(0x7f4d080fb190 msgr2=0x7f4d08068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:04.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.895+0000 7f4d0d254700 1 -- 172.21.15.96:0/3290283626 shutdown_connections 2024-02-19T19:02:04.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:04.895+0000 7f4d0d254700 1 -- 172.21.15.96:0/3290283626 wait complete. 2024-02-19T19:02:04.914 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 19 2024-02-19T19:02:04.924 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:02:05.450 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:05 smithi125 ceph-mon[37556]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.8 KiB/s rd, 716 B/s wr, 5 op/s 2024-02-19T19:02:05.450 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:05 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:02:05.450 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:05 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:02:05.450 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:05 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:02:05.450 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:05 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:02:05.450 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:05 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:02:05.450 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:05 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:02:05.450 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:05 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/3290283626' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-19T19:02:05.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:05 smithi096 ceph-mon[29216]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.8 KiB/s rd, 716 B/s wr, 5 op/s 2024-02-19T19:02:05.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:05 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:02:05.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:05 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:02:05.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:05 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:02:05.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:05 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:02:05.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:05 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:02:05.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:05 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:02:05.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:05 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/3290283626' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-19T19:02:05.701 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-02-19T19:02:06.102 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:02:06.492 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:06 smithi096 ceph-mon[29216]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-02-19T19:02:06.492 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:06 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:02:06.492 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:06 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:02:06.699 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:06 smithi125 ceph-mon[37556]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-02-19T19:02:06.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:06 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:02:06.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:06 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:02:09.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.979+0000 7f4be3a59700 1 -- 172.21.15.96:0/3325699295 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bdc101eb0 msgr2=0x7f4bdc102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:09.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.979+0000 7f4be3a59700 1 --2- 172.21.15.96:0/3325699295 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bdc101eb0 0x7f4bdc102310 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc009910 tx=0x7f4bcc009c20 comp rx=0 tx=0).stop 2024-02-19T19:02:09.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.979+0000 7f4be3a59700 1 -- 172.21.15.96:0/3325699295 shutdown_connections 2024-02-19T19:02:09.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.979+0000 7f4be3a59700 1 --2- 172.21.15.96:0/3325699295 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bdc101eb0 0x7f4bdc102310 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:09.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.979+0000 7f4be3a59700 1 --2- 172.21.15.96:0/3325699295 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bdc100cb0 0x7f4bdc1010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:09.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.979+0000 7f4be3a59700 1 -- 172.21.15.96:0/3325699295 >> 172.21.15.96:0/3325699295 conn(0x7f4bdc0fc230 msgr2=0x7f4bdc0fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:09.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.979+0000 7f4be3a59700 1 -- 172.21.15.96:0/3325699295 shutdown_connections 2024-02-19T19:02:09.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.979+0000 7f4be3a59700 1 -- 172.21.15.96:0/3325699295 wait complete. 2024-02-19T19:02:09.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.979+0000 7f4be3a59700 1 Processor -- start 2024-02-19T19:02:09.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.979+0000 7f4be3a59700 1 -- start start 2024-02-19T19:02:09.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.979+0000 7f4be3a59700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bdc100cb0 0x7f4bdc1964b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:09.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.979+0000 7f4be3a59700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bdc101eb0 0x7f4bdc1969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:09.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.979+0000 7f4be3a59700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc197010 con 0x7f4bdc101eb0 2024-02-19T19:02:09.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.979+0000 7f4be3a59700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bdc197150 con 0x7f4bdc100cb0 2024-02-19T19:02:09.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.979+0000 7f4be0ff4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bdc101eb0 0x7f4bdc1969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:09.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.980+0000 7f4be0ff4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bdc101eb0 0x7f4bdc1969f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35448/0 (socket says 172.21.15.96:35448) 2024-02-19T19:02:09.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.980+0000 7f4be0ff4700 1 -- 172.21.15.96:0/595770558 learned_addr learned my addr 172.21.15.96:0/595770558 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:02:09.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.980+0000 7f4be17f5700 1 --2- 172.21.15.96:0/595770558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bdc100cb0 0x7f4bdc1964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:09.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.980+0000 7f4be0ff4700 1 -- 172.21.15.96:0/595770558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bdc100cb0 msgr2=0x7f4bdc1964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:09.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.980+0000 7f4be0ff4700 1 --2- 172.21.15.96:0/595770558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bdc100cb0 0x7f4bdc1964b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:09.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.980+0000 7f4be0ff4700 1 -- 172.21.15.96:0/595770558 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc0095f0 con 0x7f4bdc101eb0 2024-02-19T19:02:09.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.980+0000 7f4be17f5700 1 --2- 172.21.15.96:0/595770558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bdc100cb0 0x7f4bdc1964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:02:09.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.980+0000 7f4be0ff4700 1 --2- 172.21.15.96:0/595770558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bdc101eb0 0x7f4bdc1969f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc006010 tx=0x7f4bcc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:09.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.980+0000 7f4bd27fc700 1 -- 172.21.15.96:0/595770558 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bcc01d070 con 0x7f4bdc101eb0 2024-02-19T19:02:09.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.980+0000 7f4bd27fc700 1 -- 172.21.15.96:0/595770558 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4bcc00f460 con 0x7f4bdc101eb0 2024-02-19T19:02:09.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.980+0000 7f4be3a59700 1 -- 172.21.15.96:0/595770558 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bdc19bba0 con 0x7f4bdc101eb0 2024-02-19T19:02:09.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.980+0000 7f4bd27fc700 1 -- 172.21.15.96:0/595770558 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bcc017630 con 0x7f4bdc101eb0 2024-02-19T19:02:09.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.980+0000 7f4be3a59700 1 -- 172.21.15.96:0/595770558 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bdc19c090 con 0x7f4bdc101eb0 2024-02-19T19:02:09.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.981+0000 7f4be3a59700 1 -- 172.21.15.96:0/595770558 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bdc109810 con 0x7f4bdc101eb0 2024-02-19T19:02:09.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.981+0000 7f4bd27fc700 1 -- 172.21.15.96:0/595770558 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f4bcc003a60 con 0x7f4bdc101eb0 2024-02-19T19:02:09.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.982+0000 7f4bd27fc700 1 --2- 172.21.15.96:0/595770558 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f4bc806c4e0 0x7f4bc806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:09.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.982+0000 7f4bd27fc700 1 -- 172.21.15.96:0/595770558 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f4bcc08ccb0 con 0x7f4bdc101eb0 2024-02-19T19:02:09.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.982+0000 7f4be17f5700 1 --2- 172.21.15.96:0/595770558 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f4bc806c4e0 0x7f4bc806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:09.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.982+0000 7f4be17f5700 1 --2- 172.21.15.96:0/595770558 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f4bc806c4e0 0x7f4bc806e9a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8005fd0 tx=0x7f4bd8005f00 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:09.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:08.986+0000 7f4bd27fc700 1 -- 172.21.15.96:0/595770558 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f4bcc05aff0 con 0x7f4bdc101eb0 2024-02-19T19:02:09.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:08 smithi125 ceph-mon[37556]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 10 KiB/s rd, 0 B/s wr, 11 op/s 2024-02-19T19:02:09.249 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:08 smithi096 ceph-mon[29216]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 10 KiB/s rd, 0 B/s wr, 11 op/s 2024-02-19T19:02:09.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:09.267+0000 7f4be3a59700 1 -- 172.21.15.96:0/595770558 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f4bdc19c6f0 con 0x7f4bdc101eb0 2024-02-19T19:02:09.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:09.267+0000 7f4bd27fc700 1 -- 172.21.15.96:0/595770558 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v19) v1 ==== 78+0+83 (secure 0 0 0) 0x7f4bcc05ab80 con 0x7f4bdc101eb0 2024-02-19T19:02:09.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:09.269+0000 7f4be3a59700 1 -- 172.21.15.96:0/595770558 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f4bc806c4e0 msgr2=0x7f4bc806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:09.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:09.269+0000 7f4be3a59700 1 --2- 172.21.15.96:0/595770558 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f4bc806c4e0 0x7f4bc806e9a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4bd8005fd0 tx=0x7f4bd8005f00 comp rx=0 tx=0).stop 2024-02-19T19:02:09.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:09.269+0000 7f4be3a59700 1 -- 172.21.15.96:0/595770558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bdc101eb0 msgr2=0x7f4bdc1969f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:09.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:09.269+0000 7f4be3a59700 1 --2- 172.21.15.96:0/595770558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bdc101eb0 0x7f4bdc1969f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc006010 tx=0x7f4bcc00be20 comp rx=0 tx=0).stop 2024-02-19T19:02:09.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:09.269+0000 7f4be3a59700 1 -- 172.21.15.96:0/595770558 shutdown_connections 2024-02-19T19:02:09.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:09.269+0000 7f4be3a59700 1 --2- 172.21.15.96:0/595770558 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f4bc806c4e0 0x7f4bc806e9a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:09.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:09.269+0000 7f4be3a59700 1 --2- 172.21.15.96:0/595770558 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bdc100cb0 0x7f4bdc1964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:09.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:09.269+0000 7f4be3a59700 1 --2- 172.21.15.96:0/595770558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4bdc101eb0 0x7f4bdc1969f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:09.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:09.269+0000 7f4be3a59700 1 -- 172.21.15.96:0/595770558 >> 172.21.15.96:0/595770558 conn(0x7f4bdc0fc230 msgr2=0x7f4bdc1050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:09.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:09.270+0000 7f4be3a59700 1 -- 172.21.15.96:0/595770558 shutdown_connections 2024-02-19T19:02:09.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:09.270+0000 7f4be3a59700 1 -- 172.21.15.96:0/595770558 wait complete. 2024-02-19T19:02:09.299 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:02:09.953 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:09 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/595770558' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-19T19:02:09.975 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-02-19T19:02:09.988 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T19:02:10.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.085+0000 7ff61b514640 1 -- 172.21.15.96:0/3083709641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6140fefc0 msgr2=0x7ff6140ff3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:10.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.085+0000 7ff61b514640 1 --2- 172.21.15.96:0/3083709641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6140fefc0 0x7ff6140ff3e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff604009880 tx=0x7ff60402bce0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.085+0000 7ff61b514640 1 -- 172.21.15.96:0/3083709641 shutdown_connections 2024-02-19T19:02:10.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.085+0000 7ff61b514640 1 --2- 172.21.15.96:0/3083709641 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6141001b0 0x7ff614100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.085+0000 7ff61b514640 1 --2- 172.21.15.96:0/3083709641 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6140fefc0 0x7ff6140ff3e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.085+0000 7ff61b514640 1 -- 172.21.15.96:0/3083709641 >> 172.21.15.96:0/3083709641 conn(0x7ff6140fa530 msgr2=0x7ff6140fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:10.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.085+0000 7ff61b514640 1 -- 172.21.15.96:0/3083709641 shutdown_connections 2024-02-19T19:02:10.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.085+0000 7ff61b514640 1 -- 172.21.15.96:0/3083709641 wait complete. 2024-02-19T19:02:10.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.086+0000 7ff61b514640 1 Processor -- start 2024-02-19T19:02:10.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.086+0000 7ff61b514640 1 -- start start 2024-02-19T19:02:10.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.086+0000 7ff61b514640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6140fefc0 0x7ff6141958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:10.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.086+0000 7ff61b514640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6141001b0 0x7ff614195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:10.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.086+0000 7ff61b514640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6141963b0 con 0x7ff6141001b0 2024-02-19T19:02:10.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.086+0000 7ff61b514640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff614196520 con 0x7ff6140fefc0 2024-02-19T19:02:10.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.086+0000 7ff618aaf640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6141001b0 0x7ff614195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:10.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.086+0000 7ff618aaf640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6141001b0 0x7ff614195de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35464/0 (socket says 172.21.15.96:35464) 2024-02-19T19:02:10.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.086+0000 7ff618aaf640 1 -- 172.21.15.96:0/3863092602 learned_addr learned my addr 172.21.15.96:0/3863092602 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:02:10.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.086+0000 7ff6192b0640 1 --2- 172.21.15.96:0/3863092602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6140fefc0 0x7ff6141958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:10.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.086+0000 7ff618aaf640 1 -- 172.21.15.96:0/3863092602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6140fefc0 msgr2=0x7ff6141958a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:10.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.086+0000 7ff618aaf640 1 --2- 172.21.15.96:0/3863092602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6140fefc0 0x7ff6141958a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.086+0000 7ff618aaf640 1 -- 172.21.15.96:0/3863092602 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff604009560 con 0x7ff6141001b0 2024-02-19T19:02:10.107 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.086+0000 7ff618aaf640 1 --2- 172.21.15.96:0/3863092602 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6141001b0 0x7ff614195de0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff61000e970 tx=0x7ff61000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:10.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.086+0000 7ff60a7fc640 1 -- 172.21.15.96:0/3863092602 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff61000cc90 con 0x7ff6141001b0 2024-02-19T19:02:10.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.086+0000 7ff60a7fc640 1 -- 172.21.15.96:0/3863092602 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff61000cdf0 con 0x7ff6141001b0 2024-02-19T19:02:10.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.087+0000 7ff61b514640 1 -- 172.21.15.96:0/3863092602 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff61419afb0 con 0x7ff6141001b0 2024-02-19T19:02:10.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.087+0000 7ff60a7fc640 1 -- 172.21.15.96:0/3863092602 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff610010430 con 0x7ff6141001b0 2024-02-19T19:02:10.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.087+0000 7ff61b514640 1 -- 172.21.15.96:0/3863092602 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61419b4e0 con 0x7ff6141001b0 2024-02-19T19:02:10.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.088+0000 7ff61b514640 1 -- 172.21.15.96:0/3863092602 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff614107bc0 con 0x7ff6141001b0 2024-02-19T19:02:10.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.088+0000 7ff60a7fc640 1 -- 172.21.15.96:0/3863092602 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7ff6100046c0 con 0x7ff6141001b0 2024-02-19T19:02:10.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.088+0000 7ff60a7fc640 1 --2- 172.21.15.96:0/3863092602 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff60006c560 0x7ff60006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:10.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.089+0000 7ff60a7fc640 1 -- 172.21.15.96:0/3863092602 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff610014070 con 0x7ff6141001b0 2024-02-19T19:02:10.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.089+0000 7ff6192b0640 1 --2- 172.21.15.96:0/3863092602 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff60006c560 0x7ff60006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:10.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.089+0000 7ff6192b0640 1 --2- 172.21.15.96:0/3863092602 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff60006c560 0x7ff60006ea20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff604000c00 tx=0x7ff604005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:10.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.093+0000 7ff60a7fc640 1 -- 172.21.15.96:0/3863092602 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff6100564c0 con 0x7ff6141001b0 2024-02-19T19:02:10.172 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:09 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/595770558' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-19T19:02:10.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.275+0000 7ff61b514640 1 -- 172.21.15.96:0/3863092602 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff614107dd0 con 0x7ff6141001b0 2024-02-19T19:02:10.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.276+0000 7ff60a7fc640 1 -- 172.21.15.96:0/3863092602 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+15152 (secure 0 0 0) 0x7ff610059ae0 con 0x7ff6141001b0 2024-02-19T19:02:10.295 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:02:10.295 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":46,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","created":"2024-02-19T18:54:33.002577+0000","modified":"2024-02-19T19:01:58.847329+0000","last_up_change":"2024-02-19T19:00:27.894969+0000","last_in_change":"2024-02-19T19:00:08.695793+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T18:59:14.096877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-19T19:01:41.207788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-19T19:01:42.116300+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c8d3e948-3736-431e-9ccd-18d3d1af342a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1987555426},{"type":"v1","addr":"172.21.15.96:6803","nonce":1987555426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1987555426},{"type":"v1","addr":"172.21.15.96:6805","nonce":1987555426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":1987555426},{"type":"v1","addr":"172.21.15.96:6809","nonce":1987555426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1987555426},{"type":"v1","addr":"172.21.15.96:6807","nonce":1987555426}]},"public_addr":"172.21.15.96:6803/1987555426","cluster_addr":"172.21.15.96:6805/1987555426","heartbeat_back_addr":"172.21.15.96:6809/1987555426","heartbeat_front_addr":"172.21.15.96:6807/1987555426","state":["exists","up"]},{"osd":1,"uuid":"012aa0e0-d3ed-4b27-9e5e-fd667e4523ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3386518204},{"type":"v1","addr":"172.21.15.96:6811","nonce":3386518204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3386518204},{"type":"v1","addr":"172.21.15.96:6813","nonce":3386518204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3386518204},{"type":"v1","addr":"172.21.15.96:6817","nonce":3386518204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3386518204},{"type":"v1","addr":"172.21.15.96:6815","nonce":3386518204}]},"public_addr":"172.21.15.96:6811/3386518204","cluster_addr":"172.21.15.96:6813/3386518204","heartbeat_back_addr":"172.21.15.96:6817/3386518204","heartbeat_front_addr":"172.21.15.96:6815/3386518204","state":["exists","up"]},{"osd":2,"uuid":"3bf17dab-3c04-4ed0-8edf-45a217a52d0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3117123037},{"type":"v1","addr":"172.21.15.96:6819","nonce":3117123037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3117123037},{"type":"v1","addr":"172.21.15.96:6821","nonce":3117123037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3117123037},{"type":"v1","addr":"172.21.15.96:6825","nonce":3117123037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3117123037},{"type":"v1","addr":"172.21.15.96:6823","nonce":3117123037}]},"public_addr":"172.21.15.96:6819/3117123037","cluster_addr":"172.21.15.96:6821/3117123037","heartbeat_back_addr":"172.21.15.96:6825/3117123037","heartbeat_front_addr":"172.21.15.96:6823/3117123037","state":["exists","up"]},{"osd":3,"uuid":"fa80c0e4-7d1a-4e41-9455-b576cbcac572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6801","nonce":3311295426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6803","nonce":3311295426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6807","nonce":3311295426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6805","nonce":3311295426}]},"public_addr":"172.21.15.125:6801/3311295426","cluster_addr":"172.21.15.125:6803/3311295426","heartbeat_back_addr":"172.21.15.125:6807/3311295426","heartbeat_front_addr":"172.21.15.125:6805/3311295426","state":["exists","up"]},{"osd":4,"uuid":"9363cacc-c727-4282-a50f-e123f625e13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6809","nonce":1210532750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6811","nonce":1210532750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6815","nonce":1210532750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6813","nonce":1210532750}]},"public_addr":"172.21.15.125:6809/1210532750","cluster_addr":"172.21.15.125:6811/1210532750","heartbeat_back_addr":"172.21.15.125:6815/1210532750","heartbeat_front_addr":"172.21.15.125:6813/1210532750","state":["exists","up"]},{"osd":5,"uuid":"93d869ce-2537-4913-8373-1db93ffdd67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6817","nonce":2708085722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6819","nonce":2708085722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6823","nonce":2708085722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6821","nonce":2708085722}]},"public_addr":"172.21.15.125:6817/2708085722","cluster_addr":"172.21.15.125:6819/2708085722","heartbeat_back_addr":"172.21.15.125:6823/2708085722","heartbeat_front_addr":"172.21.15.125:6821/2708085722","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:58:16.075448+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:58:43.787873+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:59:11.561163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:59:35.893197+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T19:00:00.837738+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T19:00:25.890961+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:6827/3917487208":"2024-02-20T19:01:58.847298+0000","172.21.15.96:0/1543256561":"2024-02-20T18:55:03.067702+0000","172.21.15.96:0/782865038":"2024-02-20T18:55:03.067702+0000","172.21.15.96:0/2493593498":"2024-02-20T18:55:36.280962+0000","172.21.15.96:0/2093229384":"2024-02-20T18:55:36.280962+0000","172.21.15.96:6800/1286321532":"2024-02-20T18:55:03.067702+0000","172.21.15.96:6801/1286321532":"2024-02-20T18:55:03.067702+0000","172.21.15.96:0/1844984401":"2024-02-20T18:55:36.280962+0000","172.21.15.96:0/4153792828":"2024-02-20T18:56:57.759773+0000","172.21.15.96:6800/3697355606":"2024-02-20T18:55:36.280962+0000","172.21.15.96:0/561831206":"2024-02-20T18:56:57.759773+0000","172.21.15.96:6801/3697355606":"2024-02-20T18:55:36.280962+0000","172.21.15.96:6800/3628131135":"2024-02-20T18:56:57.759773+0000","172.21.15.96:0/3563912069":"2024-02-20T18:55:03.067702+0000","172.21.15.96:6801/3628131135":"2024-02-20T18:56:57.759773+0000","172.21.15.96:6826/3917487208":"2024-02-20T19:01:58.847298+0000","172.21.15.96:0/3018792068":"2024-02-20T18:56:57.759773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T19:02:10.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.278+0000 7ff61b514640 1 -- 172.21.15.96:0/3863092602 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff60006c560 msgr2=0x7ff60006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:10.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.278+0000 7ff61b514640 1 --2- 172.21.15.96:0/3863092602 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff60006c560 0x7ff60006ea20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff604000c00 tx=0x7ff604005fd0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.278+0000 7ff61b514640 1 -- 172.21.15.96:0/3863092602 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6141001b0 msgr2=0x7ff614195de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:10.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.278+0000 7ff61b514640 1 --2- 172.21.15.96:0/3863092602 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6141001b0 0x7ff614195de0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff61000e970 tx=0x7ff61000ed70 comp rx=0 tx=0).stop 2024-02-19T19:02:10.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.278+0000 7ff61b514640 1 -- 172.21.15.96:0/3863092602 shutdown_connections 2024-02-19T19:02:10.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.278+0000 7ff61b514640 1 --2- 172.21.15.96:0/3863092602 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff60006c560 0x7ff60006ea20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.278+0000 7ff61b514640 1 --2- 172.21.15.96:0/3863092602 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6141001b0 0x7ff614195de0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.278+0000 7ff61b514640 1 --2- 172.21.15.96:0/3863092602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6140fefc0 0x7ff6141958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.278+0000 7ff61b514640 1 -- 172.21.15.96:0/3863092602 >> 172.21.15.96:0/3863092602 conn(0x7ff6140fa530 msgr2=0x7ff6140683b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:10.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.279+0000 7ff61b514640 1 -- 172.21.15.96:0/3863092602 shutdown_connections 2024-02-19T19:02:10.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.279+0000 7ff61b514640 1 -- 172.21.15.96:0/3863092602 wait complete. 2024-02-19T19:02:10.312 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T18:59:14.096877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-19T19:01:41.207788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-19T19:01:42.116300+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T19:02:10.312 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T19:02:10.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.402+0000 7ff01c8c4640 1 -- 172.21.15.96:0/2511925619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff018103440 msgr2=0x7ff018105830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:10.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.402+0000 7ff01c8c4640 1 --2- 172.21.15.96:0/2511925619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff018103440 0x7ff018105830 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff00c0098b0 tx=0x7ff00c02bcd0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.402+0000 7ff01c8c4640 1 -- 172.21.15.96:0/2511925619 shutdown_connections 2024-02-19T19:02:10.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.402+0000 7ff01c8c4640 1 --2- 172.21.15.96:0/2511925619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff018103440 0x7ff018105830 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.402+0000 7ff01c8c4640 1 --2- 172.21.15.96:0/2511925619 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff018100b10 0x7ff018102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.402+0000 7ff01c8c4640 1 -- 172.21.15.96:0/2511925619 >> 172.21.15.96:0/2511925619 conn(0x7ff0180fa4e0 msgr2=0x7ff0180fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:10.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.402+0000 7ff01c8c4640 1 -- 172.21.15.96:0/2511925619 shutdown_connections 2024-02-19T19:02:10.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.402+0000 7ff01c8c4640 1 -- 172.21.15.96:0/2511925619 wait complete. 2024-02-19T19:02:10.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.403+0000 7ff01c8c4640 1 Processor -- start 2024-02-19T19:02:10.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.403+0000 7ff01c8c4640 1 -- start start 2024-02-19T19:02:10.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.403+0000 7ff01c8c4640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff018100b10 0x7ff0181959c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:10.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.403+0000 7ff01c8c4640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff018103440 0x7ff018195f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:10.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.403+0000 7ff01c8c4640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff018196440 con 0x7ff018103440 2024-02-19T19:02:10.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.403+0000 7ff01c8c4640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0181965b0 con 0x7ff018100b10 2024-02-19T19:02:10.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.403+0000 7ff015d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff018103440 0x7ff018195f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:10.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.403+0000 7ff015d9b640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff018103440 0x7ff018195f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35490/0 (socket says 172.21.15.96:35490) 2024-02-19T19:02:10.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.403+0000 7ff015d9b640 1 -- 172.21.15.96:0/2878430069 learned_addr learned my addr 172.21.15.96:0/2878430069 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:02:10.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.403+0000 7ff01659c640 1 --2- 172.21.15.96:0/2878430069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff018100b10 0x7ff0181959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:10.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.403+0000 7ff015d9b640 1 -- 172.21.15.96:0/2878430069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff018100b10 msgr2=0x7ff0181959c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:10.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.403+0000 7ff015d9b640 1 --2- 172.21.15.96:0/2878430069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff018100b10 0x7ff0181959c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.403+0000 7ff015d9b640 1 -- 172.21.15.96:0/2878430069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00c009560 con 0x7ff018103440 2024-02-19T19:02:10.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.403+0000 7ff01659c640 1 --2- 172.21.15.96:0/2878430069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff018100b10 0x7ff0181959c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:02:10.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.403+0000 7ff015d9b640 1 --2- 172.21.15.96:0/2878430069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff018103440 0x7ff018195f00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff00c009880 tx=0x7ff00c004f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:10.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.404+0000 7ff0077fe640 1 -- 172.21.15.96:0/2878430069 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff00c005000 con 0x7ff018103440 2024-02-19T19:02:10.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.404+0000 7ff0077fe640 1 -- 172.21.15.96:0/2878430069 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff00c005610 con 0x7ff018103440 2024-02-19T19:02:10.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.404+0000 7ff01c8c4640 1 -- 172.21.15.96:0/2878430069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01819b020 con 0x7ff018103440 2024-02-19T19:02:10.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.404+0000 7ff0077fe640 1 -- 172.21.15.96:0/2878430069 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff00c034670 con 0x7ff018103440 2024-02-19T19:02:10.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.404+0000 7ff01c8c4640 1 -- 172.21.15.96:0/2878430069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01819b4f0 con 0x7ff018103440 2024-02-19T19:02:10.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.405+0000 7ff01c8c4640 1 -- 172.21.15.96:0/2878430069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01818f9f0 con 0x7ff018103440 2024-02-19T19:02:10.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.405+0000 7ff0077fe640 1 -- 172.21.15.96:0/2878430069 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7ff00c0038b0 con 0x7ff018103440 2024-02-19T19:02:10.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.405+0000 7ff0077fe640 1 --2- 172.21.15.96:0/2878430069 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff00006c450 0x7ff00006e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:10.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.406+0000 7ff0077fe640 1 -- 172.21.15.96:0/2878430069 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff00c0adde0 con 0x7ff018103440 2024-02-19T19:02:10.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.406+0000 7ff01659c640 1 --2- 172.21.15.96:0/2878430069 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff00006c450 0x7ff00006e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:10.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.406+0000 7ff01659c640 1 --2- 172.21.15.96:0/2878430069 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff00006c450 0x7ff00006e910 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff008007e70 tx=0x7ff008007850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:10.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.410+0000 7ff0077fe640 1 -- 172.21.15.96:0/2878430069 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff00c078560 con 0x7ff018103440 2024-02-19T19:02:10.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.592+0000 7ff01c8c4640 1 -- 172.21.15.96:0/2878430069 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff01802c4f0 con 0x7ff018103440 2024-02-19T19:02:10.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.592+0000 7ff0077fe640 1 -- 172.21.15.96:0/2878430069 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff00c07bb80 con 0x7ff018103440 2024-02-19T19:02:10.611 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-02-19T19:02:10.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.594+0000 7ff01c8c4640 1 -- 172.21.15.96:0/2878430069 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff00006c450 msgr2=0x7ff00006e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:10.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.594+0000 7ff01c8c4640 1 --2- 172.21.15.96:0/2878430069 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff00006c450 0x7ff00006e910 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff008007e70 tx=0x7ff008007850 comp rx=0 tx=0).stop 2024-02-19T19:02:10.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.594+0000 7ff01c8c4640 1 -- 172.21.15.96:0/2878430069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff018103440 msgr2=0x7ff018195f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:10.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.594+0000 7ff01c8c4640 1 --2- 172.21.15.96:0/2878430069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff018103440 0x7ff018195f00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff00c009880 tx=0x7ff00c004f00 comp rx=0 tx=0).stop 2024-02-19T19:02:10.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.594+0000 7ff01c8c4640 1 -- 172.21.15.96:0/2878430069 shutdown_connections 2024-02-19T19:02:10.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.594+0000 7ff01c8c4640 1 --2- 172.21.15.96:0/2878430069 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff00006c450 0x7ff00006e910 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.613 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.594+0000 7ff01c8c4640 1 --2- 172.21.15.96:0/2878430069 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff018103440 0x7ff018195f00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.594+0000 7ff01c8c4640 1 --2- 172.21.15.96:0/2878430069 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff018100b10 0x7ff0181959c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.594+0000 7ff01c8c4640 1 -- 172.21.15.96:0/2878430069 >> 172.21.15.96:0/2878430069 conn(0x7ff0180fa4e0 msgr2=0x7ff0180fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:10.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.594+0000 7ff01c8c4640 1 -- 172.21.15.96:0/2878430069 shutdown_connections 2024-02-19T19:02:10.614 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.594+0000 7ff01c8c4640 1 -- 172.21.15.96:0/2878430069 wait complete. 2024-02-19T19:02:10.624 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-19T19:02:10.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.710+0000 7ff41d026640 1 -- 172.21.15.96:0/2864544158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4181012a0 msgr2=0x7ff418101720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:10.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.710+0000 7ff41d026640 1 --2- 172.21.15.96:0/2864544158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4181012a0 0x7ff418101720 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff40c009880 tx=0x7ff40c02bce0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.710+0000 7ff41d026640 1 -- 172.21.15.96:0/2864544158 shutdown_connections 2024-02-19T19:02:10.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.710+0000 7ff41d026640 1 --2- 172.21.15.96:0/2864544158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4181012a0 0x7ff418101720 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.710+0000 7ff41d026640 1 --2- 172.21.15.96:0/2864544158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4181000b0 0x7ff4181004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.710+0000 7ff41d026640 1 -- 172.21.15.96:0/2864544158 >> 172.21.15.96:0/2864544158 conn(0x7ff4180fb620 msgr2=0x7ff4180fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:10.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.710+0000 7ff41d026640 1 -- 172.21.15.96:0/2864544158 shutdown_connections 2024-02-19T19:02:10.729 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.710+0000 7ff41d026640 1 -- 172.21.15.96:0/2864544158 wait complete. 2024-02-19T19:02:10.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.711+0000 7ff41d026640 1 Processor -- start 2024-02-19T19:02:10.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.711+0000 7ff41d026640 1 -- start start 2024-02-19T19:02:10.731 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.711+0000 7ff41d026640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4181000b0 0x7ff418195a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:10.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.711+0000 7ff41d026640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4181012a0 0x7ff418195f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:10.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.711+0000 7ff41d026640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff418196520 con 0x7ff4181000b0 2024-02-19T19:02:10.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.711+0000 7ff41d026640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff418196690 con 0x7ff4181012a0 2024-02-19T19:02:10.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.711+0000 7ff416d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4181000b0 0x7ff418195a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:10.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.711+0000 7ff416d9d640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4181000b0 0x7ff418195a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35516/0 (socket says 172.21.15.96:35516) 2024-02-19T19:02:10.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.711+0000 7ff416d9d640 1 -- 172.21.15.96:0/4109979276 learned_addr learned my addr 172.21.15.96:0/4109979276 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:02:10.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.711+0000 7ff416d9d640 1 -- 172.21.15.96:0/4109979276 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4181012a0 msgr2=0x7ff418195f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:10.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.711+0000 7ff41659c640 1 --2- 172.21.15.96:0/4109979276 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4181012a0 0x7ff418195f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:10.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.711+0000 7ff416d9d640 1 --2- 172.21.15.96:0/4109979276 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4181012a0 0x7ff418195f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.711+0000 7ff416d9d640 1 -- 172.21.15.96:0/4109979276 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c009560 con 0x7ff4181000b0 2024-02-19T19:02:10.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.711+0000 7ff41659c640 1 --2- 172.21.15.96:0/4109979276 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4181012a0 0x7ff418195f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:02:10.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.711+0000 7ff416d9d640 1 --2- 172.21.15.96:0/4109979276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4181000b0 0x7ff418195a10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff41000b9c0 tx=0x7ff41000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:10.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.712+0000 7ff3fffff640 1 -- 172.21.15.96:0/4109979276 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff41000caf0 con 0x7ff4181000b0 2024-02-19T19:02:10.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.712+0000 7ff3fffff640 1 -- 172.21.15.96:0/4109979276 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff41000cc50 con 0x7ff4181000b0 2024-02-19T19:02:10.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.712+0000 7ff41d026640 1 -- 172.21.15.96:0/4109979276 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff41819b120 con 0x7ff4181000b0 2024-02-19T19:02:10.732 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.712+0000 7ff3fffff640 1 -- 172.21.15.96:0/4109979276 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff410012770 con 0x7ff4181000b0 2024-02-19T19:02:10.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.712+0000 7ff41d026640 1 -- 172.21.15.96:0/4109979276 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41819b700 con 0x7ff4181000b0 2024-02-19T19:02:10.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.713+0000 7ff41d026640 1 -- 172.21.15.96:0/4109979276 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff418108ec0 con 0x7ff4181000b0 2024-02-19T19:02:10.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.713+0000 7ff3fffff640 1 -- 172.21.15.96:0/4109979276 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7ff4100129e0 con 0x7ff4181000b0 2024-02-19T19:02:10.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.713+0000 7ff3fffff640 1 --2- 172.21.15.96:0/4109979276 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff40006c450 0x7ff40006e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:10.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.714+0000 7ff3fffff640 1 -- 172.21.15.96:0/4109979276 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff41008b1d0 con 0x7ff4181000b0 2024-02-19T19:02:10.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.714+0000 7ff41659c640 1 --2- 172.21.15.96:0/4109979276 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff40006c450 0x7ff40006e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:10.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.714+0000 7ff41659c640 1 --2- 172.21.15.96:0/4109979276 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff40006c450 0x7ff40006e910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff40c036040 tx=0x7ff40c005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:10.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.718+0000 7ff3fffff640 1 -- 172.21.15.96:0/4109979276 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff410055a00 con 0x7ff4181000b0 2024-02-19T19:02:10.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.891+0000 7ff41d026640 1 -- 172.21.15.96:0/4109979276 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7ff41819b980 con 0x7ff4181000b0 2024-02-19T19:02:10.910 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.891+0000 7ff3fffff640 1 -- 172.21.15.96:0/4109979276 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff410059020 con 0x7ff4181000b0 2024-02-19T19:02:10.910 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-02-19T19:02:10.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.893+0000 7ff41d026640 1 -- 172.21.15.96:0/4109979276 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff40006c450 msgr2=0x7ff40006e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:10.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.893+0000 7ff41d026640 1 --2- 172.21.15.96:0/4109979276 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff40006c450 0x7ff40006e910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff40c036040 tx=0x7ff40c005fd0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.893+0000 7ff41d026640 1 -- 172.21.15.96:0/4109979276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4181000b0 msgr2=0x7ff418195a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:10.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.893+0000 7ff41d026640 1 --2- 172.21.15.96:0/4109979276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4181000b0 0x7ff418195a10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff41000b9c0 tx=0x7ff41000be80 comp rx=0 tx=0).stop 2024-02-19T19:02:10.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.893+0000 7ff41d026640 1 -- 172.21.15.96:0/4109979276 shutdown_connections 2024-02-19T19:02:10.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.893+0000 7ff41d026640 1 --2- 172.21.15.96:0/4109979276 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff40006c450 0x7ff40006e910 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.893+0000 7ff41d026640 1 --2- 172.21.15.96:0/4109979276 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4181012a0 0x7ff418195f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.893+0000 7ff41d026640 1 --2- 172.21.15.96:0/4109979276 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4181000b0 0x7ff418195a10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:10.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.893+0000 7ff41d026640 1 -- 172.21.15.96:0/4109979276 >> 172.21.15.96:0/4109979276 conn(0x7ff4180fb620 msgr2=0x7ff4181044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:10.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.893+0000 7ff41d026640 1 -- 172.21.15.96:0/4109979276 shutdown_connections 2024-02-19T19:02:10.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:10.893+0000 7ff41d026640 1 -- 172.21.15.96:0/4109979276 wait complete. 2024-02-19T19:02:10.923 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-19T19:02:11.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.010+0000 7f1e9b55a640 1 -- 172.21.15.96:0/1388343958 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e94100bb0 msgr2=0x7f1e94102fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:11.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.010+0000 7f1e9b55a640 1 --2- 172.21.15.96:0/1388343958 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e94100bb0 0x7f1e94102fa0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009880 tx=0x7f1e9002bce0 comp rx=0 tx=0).stop 2024-02-19T19:02:11.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.010+0000 7f1e9b55a640 1 -- 172.21.15.96:0/1388343958 shutdown_connections 2024-02-19T19:02:11.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.010+0000 7f1e9b55a640 1 --2- 172.21.15.96:0/1388343958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e941034e0 0x7f1e941058d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:11.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.010+0000 7f1e9b55a640 1 --2- 172.21.15.96:0/1388343958 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e94100bb0 0x7f1e94102fa0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:11.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.010+0000 7f1e9b55a640 1 -- 172.21.15.96:0/1388343958 >> 172.21.15.96:0/1388343958 conn(0x7f1e940fa4e0 msgr2=0x7f1e940fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:11.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.010+0000 7f1e9b55a640 1 -- 172.21.15.96:0/1388343958 shutdown_connections 2024-02-19T19:02:11.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.010+0000 7f1e9b55a640 1 -- 172.21.15.96:0/1388343958 wait complete. 2024-02-19T19:02:11.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.011+0000 7f1e9b55a640 1 Processor -- start 2024-02-19T19:02:11.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.011+0000 7f1e9b55a640 1 -- start start 2024-02-19T19:02:11.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.011+0000 7f1e9b55a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e94100bb0 0x7f1e941959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:11.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.011+0000 7f1e9b55a640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e941034e0 0x7f1e94195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:11.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.011+0000 7f1e9b55a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e941964b0 con 0x7f1e94100bb0 2024-02-19T19:02:11.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.011+0000 7f1e9b55a640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e94196620 con 0x7f1e941034e0 2024-02-19T19:02:11.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.011+0000 7f1e992f6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e94100bb0 0x7f1e941959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:11.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.011+0000 7f1e992f6640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e94100bb0 0x7f1e941959a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35530/0 (socket says 172.21.15.96:35530) 2024-02-19T19:02:11.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.011+0000 7f1e992f6640 1 -- 172.21.15.96:0/193333943 learned_addr learned my addr 172.21.15.96:0/193333943 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:02:11.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.011+0000 7f1e98af5640 1 --2- 172.21.15.96:0/193333943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e941034e0 0x7f1e94195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:11.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.011+0000 7f1e992f6640 1 -- 172.21.15.96:0/193333943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e941034e0 msgr2=0x7f1e94195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:11.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.012+0000 7f1e992f6640 1 --2- 172.21.15.96:0/193333943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e941034e0 0x7f1e94195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:11.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.012+0000 7f1e992f6640 1 -- 172.21.15.96:0/193333943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e90009560 con 0x7f1e94100bb0 2024-02-19T19:02:11.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.012+0000 7f1e992f6640 1 --2- 172.21.15.96:0/193333943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e94100bb0 0x7f1e941959a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009230 tx=0x7f1e90004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:11.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.012+0000 7f1e8a7fc640 1 -- 172.21.15.96:0/193333943 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e90004520 con 0x7f1e94100bb0 2024-02-19T19:02:11.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.012+0000 7f1e8a7fc640 1 -- 172.21.15.96:0/193333943 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1e900054b0 con 0x7f1e94100bb0 2024-02-19T19:02:11.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.012+0000 7f1e9b55a640 1 -- 172.21.15.96:0/193333943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9419b050 con 0x7f1e94100bb0 2024-02-19T19:02:11.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.012+0000 7f1e9b55a640 1 -- 172.21.15.96:0/193333943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9419b550 con 0x7f1e94100bb0 2024-02-19T19:02:11.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.012+0000 7f1e8a7fc640 1 -- 172.21.15.96:0/193333943 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e90034670 con 0x7f1e94100bb0 2024-02-19T19:02:11.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.013+0000 7f1e9b55a640 1 -- 172.21.15.96:0/193333943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e94108df0 con 0x7f1e94100bb0 2024-02-19T19:02:11.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.014+0000 7f1e8a7fc640 1 -- 172.21.15.96:0/193333943 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f1e900038b0 con 0x7f1e94100bb0 2024-02-19T19:02:11.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.014+0000 7f1e8a7fc640 1 --2- 172.21.15.96:0/193333943 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f1e8006c450 0x7f1e8006e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:11.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.014+0000 7f1e8a7fc640 1 -- 172.21.15.96:0/193333943 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f1e900adc60 con 0x7f1e94100bb0 2024-02-19T19:02:11.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.014+0000 7f1e98af5640 1 --2- 172.21.15.96:0/193333943 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f1e8006c450 0x7f1e8006e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:11.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.014+0000 7f1e98af5640 1 --2- 172.21.15.96:0/193333943 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f1e8006c450 0x7f1e8006e910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1e94196eb0 tx=0x7f1e8400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:11.041 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.022+0000 7f1e8a7fc640 1 -- 172.21.15.96:0/193333943 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1e90078510 con 0x7f1e94100bb0 2024-02-19T19:02:11.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:10 smithi125 ceph-mon[37556]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 9.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-19T19:02:11.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:10 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/3863092602' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T19:02:11.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:10 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/2878430069' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-19T19:02:11.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.205+0000 7f1e9b55a640 1 -- 172.21.15.96:0/193333943 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f1e94108f80 con 0x7f1e94100bb0 2024-02-19T19:02:11.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.206+0000 7f1e8a7fc640 1 -- 172.21.15.96:0/193333943 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7f1e94108f80 con 0x7f1e94100bb0 2024-02-19T19:02:11.224 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-02-19T19:02:11.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.207+0000 7f1e9b55a640 1 -- 172.21.15.96:0/193333943 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f1e8006c450 msgr2=0x7f1e8006e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:11.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.207+0000 7f1e9b55a640 1 --2- 172.21.15.96:0/193333943 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f1e8006c450 0x7f1e8006e910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1e94196eb0 tx=0x7f1e8400b390 comp rx=0 tx=0).stop 2024-02-19T19:02:11.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.207+0000 7f1e9b55a640 1 -- 172.21.15.96:0/193333943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e94100bb0 msgr2=0x7f1e941959a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:11.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.207+0000 7f1e9b55a640 1 --2- 172.21.15.96:0/193333943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e94100bb0 0x7f1e941959a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009230 tx=0x7f1e90004e30 comp rx=0 tx=0).stop 2024-02-19T19:02:11.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.208+0000 7f1e9b55a640 1 -- 172.21.15.96:0/193333943 shutdown_connections 2024-02-19T19:02:11.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.208+0000 7f1e9b55a640 1 --2- 172.21.15.96:0/193333943 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f1e8006c450 0x7f1e8006e910 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:11.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.208+0000 7f1e9b55a640 1 --2- 172.21.15.96:0/193333943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1e941034e0 0x7f1e94195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:11.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.208+0000 7f1e9b55a640 1 --2- 172.21.15.96:0/193333943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1e94100bb0 0x7f1e941959a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:11.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.208+0000 7f1e9b55a640 1 -- 172.21.15.96:0/193333943 >> 172.21.15.96:0/193333943 conn(0x7f1e940fa4e0 msgr2=0x7f1e940fc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:11.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.208+0000 7f1e9b55a640 1 -- 172.21.15.96:0/193333943 shutdown_connections 2024-02-19T19:02:11.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.208+0000 7f1e9b55a640 1 -- 172.21.15.96:0/193333943 wait complete. 2024-02-19T19:02:11.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:10 smithi096 ceph-mon[29216]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 9.7 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-19T19:02:11.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:10 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/3863092602' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T19:02:11.237 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:10 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/2878430069' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-19T19:02:11.238 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-19T19:02:11.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.326+0000 7ffac1577640 1 -- 172.21.15.96:0/2587684020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffabc0fefb0 msgr2=0x7ffabc0ff3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:11.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.326+0000 7ffac1577640 1 --2- 172.21.15.96:0/2587684020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffabc0fefb0 0x7ffabc0ff3d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009880 tx=0x7ffaac02bce0 comp rx=0 tx=0).stop 2024-02-19T19:02:11.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.326+0000 7ffac1577640 1 -- 172.21.15.96:0/2587684020 shutdown_connections 2024-02-19T19:02:11.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.326+0000 7ffac1577640 1 --2- 172.21.15.96:0/2587684020 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffabc1001a0 0x7ffabc100620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:11.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.326+0000 7ffac1577640 1 --2- 172.21.15.96:0/2587684020 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffabc0fefb0 0x7ffabc0ff3d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:11.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.326+0000 7ffac1577640 1 -- 172.21.15.96:0/2587684020 >> 172.21.15.96:0/2587684020 conn(0x7ffabc0fa4e0 msgr2=0x7ffabc0fc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:11.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.326+0000 7ffac1577640 1 -- 172.21.15.96:0/2587684020 shutdown_connections 2024-02-19T19:02:11.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.326+0000 7ffac1577640 1 -- 172.21.15.96:0/2587684020 wait complete. 2024-02-19T19:02:11.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.327+0000 7ffac1577640 1 Processor -- start 2024-02-19T19:02:11.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.327+0000 7ffac1577640 1 -- start start 2024-02-19T19:02:11.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.327+0000 7ffac1577640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffabc0fefb0 0x7ffabc1958f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:11.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.327+0000 7ffac1577640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffabc1001a0 0x7ffabc195e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:11.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.327+0000 7ffac1577640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc196400 con 0x7ffabc1001a0 2024-02-19T19:02:11.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.327+0000 7ffac1577640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc196570 con 0x7ffabc0fefb0 2024-02-19T19:02:11.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.327+0000 7ffaba7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffabc1001a0 0x7ffabc195e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:11.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.327+0000 7ffaba7fc640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffabc1001a0 0x7ffabc195e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35534/0 (socket says 172.21.15.96:35534) 2024-02-19T19:02:11.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.327+0000 7ffaba7fc640 1 -- 172.21.15.96:0/343228364 learned_addr learned my addr 172.21.15.96:0/343228364 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:02:11.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.328+0000 7ffabaffd640 1 --2- 172.21.15.96:0/343228364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffabc0fefb0 0x7ffabc1958f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:11.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.328+0000 7ffaba7fc640 1 -- 172.21.15.96:0/343228364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffabc0fefb0 msgr2=0x7ffabc1958f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:11.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.328+0000 7ffaba7fc640 1 --2- 172.21.15.96:0/343228364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffabc0fefb0 0x7ffabc1958f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:11.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.328+0000 7ffaba7fc640 1 -- 172.21.15.96:0/343228364 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac009560 con 0x7ffabc1001a0 2024-02-19T19:02:11.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.328+0000 7ffaba7fc640 1 --2- 172.21.15.96:0/343228364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffabc1001a0 0x7ffabc195e30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffab000e970 tx=0x7ffab000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:11.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.328+0000 7ffaa3fff640 1 -- 172.21.15.96:0/343228364 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffab000cc90 con 0x7ffabc1001a0 2024-02-19T19:02:11.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.328+0000 7ffaa3fff640 1 -- 172.21.15.96:0/343228364 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffab000cdf0 con 0x7ffabc1001a0 2024-02-19T19:02:11.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.328+0000 7ffac1577640 1 -- 172.21.15.96:0/343228364 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffabc19b000 con 0x7ffabc1001a0 2024-02-19T19:02:11.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.328+0000 7ffaa3fff640 1 -- 172.21.15.96:0/343228364 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffab0010430 con 0x7ffabc1001a0 2024-02-19T19:02:11.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.328+0000 7ffac1577640 1 -- 172.21.15.96:0/343228364 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffabc19b530 con 0x7ffabc1001a0 2024-02-19T19:02:11.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.329+0000 7ffac1577640 1 -- 172.21.15.96:0/343228364 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffabc107bb0 con 0x7ffabc1001a0 2024-02-19T19:02:11.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.330+0000 7ffaa3fff640 1 -- 172.21.15.96:0/343228364 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7ffab00046c0 con 0x7ffabc1001a0 2024-02-19T19:02:11.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.330+0000 7ffaa3fff640 1 --2- 172.21.15.96:0/343228364 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ffaa406c510 0x7ffaa406e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:11.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.330+0000 7ffaa3fff640 1 -- 172.21.15.96:0/343228364 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ffab0014070 con 0x7ffabc1001a0 2024-02-19T19:02:11.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.330+0000 7ffabaffd640 1 --2- 172.21.15.96:0/343228364 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ffaa406c510 0x7ffaa406e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:11.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.330+0000 7ffabaffd640 1 --2- 172.21.15.96:0/343228364 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ffaa406c510 0x7ffaa406e9d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffaac000c00 tx=0x7ffaac005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:11.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.334+0000 7ffaa3fff640 1 -- 172.21.15.96:0/343228364 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ffab0056460 con 0x7ffabc1001a0 2024-02-19T19:02:11.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.540+0000 7ffac1577640 1 -- 172.21.15.96:0/343228364 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffabc107dc0 con 0x7ffabc1001a0 2024-02-19T19:02:11.559 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.540+0000 7ffaa3fff640 1 -- 172.21.15.96:0/343228364 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4773 (secure 0 0 0) 0x7ffab0059a80 con 0x7ffabc1001a0 2024-02-19T19:02:11.559 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:02:11.559 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-19T19:01:42.881136+0000","modified":"2024-02-19T19:02:02.873590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14490,"mds_1":24267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14490":{"gid":14490,"name":"cephfs.smithi096.pccmys","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.96:6829/2109698145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":2109698145},{"type":"v1","addr":"172.21.15.96:6829","nonce":2109698145}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14502":{"gid":14502,"name":"cephfs.smithi096.usrmcg","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.96:6827/413113741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":413113741},{"type":"v1","addr":"172.21.15.96:6827","nonce":413113741}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24267":{"gid":24267,"name":"cephfs.smithi125.srnlol","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.125:6825/3084054986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6824","nonce":3084054986},{"type":"v1","addr":"172.21.15.125:6825","nonce":3084054986}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24275":{"gid":24275,"name":"cephfs.smithi125.pwyuga","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.125:6827/3098247423","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":3098247423},{"type":"v1","addr":"172.21.15.125:6827","nonce":3098247423}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-19T19:02:11.560 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 19 2024-02-19T19:02:11.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.542+0000 7ffac1577640 1 -- 172.21.15.96:0/343228364 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ffaa406c510 msgr2=0x7ffaa406e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:11.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.542+0000 7ffac1577640 1 --2- 172.21.15.96:0/343228364 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ffaa406c510 0x7ffaa406e9d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffaac000c00 tx=0x7ffaac005fd0 comp rx=0 tx=0).stop 2024-02-19T19:02:11.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.542+0000 7ffac1577640 1 -- 172.21.15.96:0/343228364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffabc1001a0 msgr2=0x7ffabc195e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:11.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.542+0000 7ffac1577640 1 --2- 172.21.15.96:0/343228364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffabc1001a0 0x7ffabc195e30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffab000e970 tx=0x7ffab000ed70 comp rx=0 tx=0).stop 2024-02-19T19:02:11.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.542+0000 7ffac1577640 1 -- 172.21.15.96:0/343228364 shutdown_connections 2024-02-19T19:02:11.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.542+0000 7ffac1577640 1 --2- 172.21.15.96:0/343228364 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ffaa406c510 0x7ffaa406e9d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:11.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.542+0000 7ffac1577640 1 --2- 172.21.15.96:0/343228364 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffabc1001a0 0x7ffabc195e30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:11.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.542+0000 7ffac1577640 1 --2- 172.21.15.96:0/343228364 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffabc0fefb0 0x7ffabc1958f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:11.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.542+0000 7ffac1577640 1 -- 172.21.15.96:0/343228364 >> 172.21.15.96:0/343228364 conn(0x7ffabc0fa4e0 msgr2=0x7ffabc067350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:11.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.542+0000 7ffac1577640 1 -- 172.21.15.96:0/343228364 shutdown_connections 2024-02-19T19:02:11.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:11.542+0000 7ffac1577640 1 -- 172.21.15.96:0/343228364 wait complete. 2024-02-19T19:02:11.572 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 19, 'max_mds': 2, 'flags': 50} 2024-02-19T19:02:11.572 INFO:teuthology.run_tasks:Running task kclient... 2024-02-19T19:02:11.596 INFO:tasks.kclient:Mounting kernel clients... 2024-02-19T19:02:11.596 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-02-19T19:02:11.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:11.596 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-02-19T19:02:11.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:11.612 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link delete ceph-brx 2024-02-19T19:02:11.681 INFO:teuthology.orchestra.run.smithi096.stderr:Cannot find device "ceph-brx" 2024-02-19T19:02:11.682 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T19:02:11.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:11.682 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2024-02-19T19:02:11.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:11.701 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link delete ceph-brx 2024-02-19T19:02:11.777 INFO:teuthology.orchestra.run.smithi125.stderr:Cannot find device "ceph-brx" 2024-02-19T19:02:11.778 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T19:02:11.778 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-02-19T19:02:11.779 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-19T19:02:11.779 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-19T19:02:11.779 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph fs ls 2024-02-19T19:02:11.984 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:02:12.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:11 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/4109979276' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-19T19:02:12.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:11 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/193333943' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-19T19:02:12.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:11 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:02:12.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:11 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:02:12.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:11 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:02:12.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:11 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:02:12.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:11 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:02:12.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:11 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/343228364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-19T19:02:12.233 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:11 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/4109979276' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-19T19:02:12.233 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:11 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/193333943' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-19T19:02:12.233 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:11 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:02:12.233 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:11 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:02:12.233 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:11 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:02:12.234 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:11 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:02:12.234 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:11 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:02:12.234 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:11 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/343228364' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-19T19:02:13.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:12 smithi125 ceph-mon[37556]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.5 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-19T19:02:13.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:12 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:02:13.224 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:12 smithi096 ceph-mon[29216]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.5 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-19T19:02:13.224 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:12 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:02:13.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.550+0000 7fba97401700 1 -- 172.21.15.96:0/354588102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba90100510 msgr2=0x7fba901049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:13.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.550+0000 7fba97401700 1 --2- 172.21.15.96:0/354588102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba90100510 0x7fba901049e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fba80009910 tx=0x7fba80009c20 comp rx=0 tx=0).stop 2024-02-19T19:02:13.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.550+0000 7fba97401700 1 -- 172.21.15.96:0/354588102 shutdown_connections 2024-02-19T19:02:13.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.550+0000 7fba97401700 1 --2- 172.21.15.96:0/354588102 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba90100510 0x7fba901049e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:13.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.550+0000 7fba97401700 1 --2- 172.21.15.96:0/354588102 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba900ffbf0 0x7fba900fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:13.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.550+0000 7fba97401700 1 -- 172.21.15.96:0/354588102 >> 172.21.15.96:0/354588102 conn(0x7fba900fb650 msgr2=0x7fba900fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:13.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.550+0000 7fba97401700 1 -- 172.21.15.96:0/354588102 shutdown_connections 2024-02-19T19:02:13.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.550+0000 7fba97401700 1 -- 172.21.15.96:0/354588102 wait complete. 2024-02-19T19:02:13.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.550+0000 7fba97401700 1 Processor -- start 2024-02-19T19:02:13.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.551+0000 7fba97401700 1 -- start start 2024-02-19T19:02:13.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.551+0000 7fba97401700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba900ffbf0 0x7fba9019cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:13.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.551+0000 7fba97401700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba90100510 0x7fba9019d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:13.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.551+0000 7fba97401700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9019db50 con 0x7fba90100510 2024-02-19T19:02:13.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.551+0000 7fba97401700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9019dc90 con 0x7fba900ffbf0 2024-02-19T19:02:13.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.551+0000 7fba9499c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba90100510 0x7fba9019d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:13.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.551+0000 7fba9499c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba90100510 0x7fba9019d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50496/0 (socket says 172.21.15.96:50496) 2024-02-19T19:02:13.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.551+0000 7fba9499c700 1 -- 172.21.15.96:0/2797376604 learned_addr learned my addr 172.21.15.96:0/2797376604 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:02:13.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.551+0000 7fba9499c700 1 -- 172.21.15.96:0/2797376604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba900ffbf0 msgr2=0x7fba9019cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:13.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.551+0000 7fba9519d700 1 --2- 172.21.15.96:0/2797376604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba900ffbf0 0x7fba9019cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:13.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.551+0000 7fba9499c700 1 --2- 172.21.15.96:0/2797376604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba900ffbf0 0x7fba9019cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:13.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.551+0000 7fba9499c700 1 -- 172.21.15.96:0/2797376604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba800095f0 con 0x7fba90100510 2024-02-19T19:02:13.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.551+0000 7fba9519d700 1 --2- 172.21.15.96:0/2797376604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba900ffbf0 0x7fba9019cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:02:13.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.551+0000 7fba9499c700 1 --2- 172.21.15.96:0/2797376604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba90100510 0x7fba9019d500 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fba800092e0 tx=0x7fba8000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:13.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.551+0000 7fba867fc700 1 -- 172.21.15.96:0/2797376604 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba8001d070 con 0x7fba90100510 2024-02-19T19:02:13.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.551+0000 7fba97401700 1 -- 172.21.15.96:0/2797376604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba901a1a80 con 0x7fba90100510 2024-02-19T19:02:13.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.551+0000 7fba867fc700 1 -- 172.21.15.96:0/2797376604 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fba80022470 con 0x7fba90100510 2024-02-19T19:02:13.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.552+0000 7fba867fc700 1 -- 172.21.15.96:0/2797376604 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba8000f690 con 0x7fba90100510 2024-02-19T19:02:13.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.552+0000 7fba97401700 1 -- 172.21.15.96:0/2797376604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba901a1f70 con 0x7fba90100510 2024-02-19T19:02:13.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.552+0000 7fba97401700 1 -- 172.21.15.96:0/2797376604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba901020d0 con 0x7fba90100510 2024-02-19T19:02:13.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.553+0000 7fba867fc700 1 -- 172.21.15.96:0/2797376604 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fba800225e0 con 0x7fba90100510 2024-02-19T19:02:13.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.553+0000 7fba867fc700 1 --2- 172.21.15.96:0/2797376604 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fba7c06c4e0 0x7fba7c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:13.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.553+0000 7fba9519d700 1 --2- 172.21.15.96:0/2797376604 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fba7c06c4e0 0x7fba7c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:13.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.553+0000 7fba867fc700 1 -- 172.21.15.96:0/2797376604 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fba8008cdb0 con 0x7fba90100510 2024-02-19T19:02:13.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.554+0000 7fba9519d700 1 --2- 172.21.15.96:0/2797376604 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fba7c06c4e0 0x7fba7c06e9a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fba8c005fd0 tx=0x7fba8c005e20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:13.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.558+0000 7fba867fc700 1 -- 172.21.15.96:0/2797376604 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fba800575e0 con 0x7fba90100510 2024-02-19T19:02:13.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.790+0000 7fba97401700 1 -- 172.21.15.96:0/2797376604 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fba9004f2e0 con 0x7fba90100510 2024-02-19T19:02:13.810 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.791+0000 7fba867fc700 1 -- 172.21.15.96:0/2797376604 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+83 (secure 0 0 0) 0x7fba8005ac00 con 0x7fba90100510 2024-02-19T19:02:13.810 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-19T19:02:13.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.793+0000 7fba97401700 1 -- 172.21.15.96:0/2797376604 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fba7c06c4e0 msgr2=0x7fba7c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:13.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.793+0000 7fba97401700 1 --2- 172.21.15.96:0/2797376604 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fba7c06c4e0 0x7fba7c06e9a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fba8c005fd0 tx=0x7fba8c005e20 comp rx=0 tx=0).stop 2024-02-19T19:02:13.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.793+0000 7fba97401700 1 -- 172.21.15.96:0/2797376604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba90100510 msgr2=0x7fba9019d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:13.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.793+0000 7fba97401700 1 --2- 172.21.15.96:0/2797376604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba90100510 0x7fba9019d500 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fba800092e0 tx=0x7fba8000be20 comp rx=0 tx=0).stop 2024-02-19T19:02:13.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.793+0000 7fba97401700 1 -- 172.21.15.96:0/2797376604 shutdown_connections 2024-02-19T19:02:13.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.793+0000 7fba97401700 1 --2- 172.21.15.96:0/2797376604 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fba7c06c4e0 0x7fba7c06e9a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:13.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.793+0000 7fba97401700 1 --2- 172.21.15.96:0/2797376604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba900ffbf0 0x7fba9019cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:13.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.793+0000 7fba97401700 1 --2- 172.21.15.96:0/2797376604 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba90100510 0x7fba9019d500 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:13.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.793+0000 7fba97401700 1 -- 172.21.15.96:0/2797376604 >> 172.21.15.96:0/2797376604 conn(0x7fba900fb650 msgr2=0x7fba90111060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:13.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.793+0000 7fba97401700 1 -- 172.21.15.96:0/2797376604 shutdown_connections 2024-02-19T19:02:13.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:13.793+0000 7fba97401700 1 -- 172.21.15.96:0/2797376604 wait complete. 2024-02-19T19:02:14.146 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:13 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/2797376604' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-19T19:02:14.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:13 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/2797376604' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-19T19:02:14.368 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-19T19:02:14.368 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-19T19:02:14.368 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi096.front.sepia.ceph.com 2024-02-19T19:02:14.368 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-19T19:02:14.368 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-19T19:02:14.369 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-19T19:02:14.369 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-19T19:02:14.369 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-19T19:02:14.369 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-19T19:02:14.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:14.369 DEBUG:teuthology.orchestra.run.smithi096:> ip addr 2024-02-19T19:02:14.385 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-19T19:02:14.385 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-19T19:02:14.385 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2024-02-19T19:02:14.385 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-02-19T19:02:14.385 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2024-02-19T19:02:14.385 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-02-19T19:02:14.385 INFO:teuthology.orchestra.run.smithi096.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T19:02:14.385 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bc brd ff:ff:ff:ff:ff:ff 2024-02-19T19:02:14.385 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f0 2024-02-19T19:02:14.385 INFO:teuthology.orchestra.run.smithi096.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T19:02:14.385 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bd brd ff:ff:ff:ff:ff:ff 2024-02-19T19:02:14.385 INFO:teuthology.orchestra.run.smithi096.stdout: altname enp7s0f1 2024-02-19T19:02:14.385 INFO:teuthology.orchestra.run.smithi096.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T19:02:14.386 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0c brd ff:ff:ff:ff:ff:ff 2024-02-19T19:02:14.386 INFO:teuthology.orchestra.run.smithi096.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-19T19:02:14.386 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0d brd ff:ff:ff:ff:ff:ff 2024-02-19T19:02:14.386 INFO:teuthology.orchestra.run.smithi096.stdout: inet 172.21.15.96/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-19T19:02:14.386 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft 42078sec preferred_lft 42078sec 2024-02-19T19:02:14.386 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::ec4:7aff:fe8f:cc0d/64 scope link 2024-02-19T19:02:14.386 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2024-02-19T19:02:14.386 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-19T19:02:14.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:14.386 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2024-02-19T19:02:14.387 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-02-19T19:02:14.387 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add name ceph-brx type bridge 2024-02-19T19:02:14.387 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr flush dev ceph-brx 2024-02-19T19:02:14.387 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set ceph-brx up 2024-02-19T19:02:14.387 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-19T19:02:14.387 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-02-19T19:02:14.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:14.569 DEBUG:teuthology.orchestra.run.smithi096:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-19T19:02:14.595 INFO:teuthology.orchestra.run.smithi096.stdout:1 2024-02-19T19:02:14.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:14.597 DEBUG:teuthology.orchestra.run.smithi096:> route 2024-02-19T19:02:14.664 INFO:teuthology.orchestra.run.smithi096.stdout:Kernel IP routing table 2024-02-19T19:02:14.664 INFO:teuthology.orchestra.run.smithi096.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-19T19:02:14.664 INFO:teuthology.orchestra.run.smithi096.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-19T19:02:14.664 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-19T19:02:14.665 INFO:teuthology.orchestra.run.smithi096.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-19T19:02:14.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:14.665 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2024-02-19T19:02:14.665 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-02-19T19:02:14.665 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-19T19:02:14.665 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-19T19:02:14.665 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-19T19:02:14.665 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-02-19T19:02:14.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:14.937 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-02-19T19:02:14.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:14.952 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list-id 2024-02-19T19:02:14.981 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:14 smithi096 ceph-mon[29216]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.4 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-19T19:02:14.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:14.996 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2024-02-19T19:02:14.996 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-02-19T19:02:14.996 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T19:02:14.996 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-19T19:02:14.996 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-02-19T19:02:15.079 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-19T19:02:15.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:15.079 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2024-02-19T19:02:15.079 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-02-19T19:02:15.079 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-19T19:02:15.079 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-19T19:02:15.079 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-19T19:02:15.079 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-19T19:02:15.079 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-19T19:02:15.079 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-02-19T19:02:15.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:14 smithi125 ceph-mon[37556]: pgmap v192: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 8.4 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-19T19:02:15.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:15.222 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2024-02-19T19:02:15.222 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2024-02-19T19:02:15.222 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set brx.0 up 2024-02-19T19:02:15.222 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set dev brx.0 master ceph-brx 2024-02-19T19:02:15.222 DEBUG:teuthology.orchestra.run.smithi096:> ') 2024-02-19T19:02:15.264 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-19T19:02:15.264 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-19T19:02:15.318 INFO:teuthology.orchestra.run.smithi096.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-19T19:02:15.319 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-19T19:02:15.319 DEBUG:teuthology.orchestra.run.smithi096:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-19T19:02:15.373 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-19T19:02:15.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:15.373 DEBUG:teuthology.orchestra.run.smithi096:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-19T19:02:15.462 INFO:teuthology.orchestra.run.smithi096.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-19T19:02:15.462 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-19T19:02:15.462 INFO:teuthology.orchestra.run.smithi096.stdout:invalid new device string format 2024-02-19T19:02:15.568 INFO:teuthology.orchestra.run.smithi096.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-19T19:02:15.568 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-19T19:02:15.568 INFO:teuthology.orchestra.run.smithi096.stdout:invalid new device string format 2024-02-19T19:02:15.569 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: resolved to: "172.21.15.96:3300,172.21.15.125:3300" 2024-02-19T19:02:15.569 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-19T19:02:15.574 INFO:teuthology.orchestra.run.smithi096.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-02-19T19:02:15.574 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-02-19T19:02:15.574 INFO:teuthology.orchestra.run.smithi096.stdout:invalid new device string format 2024-02-19T19:02:15.574 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: resolved to: "172.21.15.96:3300,172.21.15.125:3300" 2024-02-19T19:02:15.574 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-19T19:02:15.574 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: resolved to: "172.21.15.96:6789,172.21.15.125:6789" 2024-02-19T19:02:15.575 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.96:6789,172.21.15.125:6789:/ 2024-02-19T19:02:15.575 INFO:teuthology.orchestra.run.smithi096.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=06580d2c-cf58-11ee-95bb-87774f69a715" will pass to kernel 2024-02-19T19:02:15.576 INFO:teuthology.orchestra.run.smithi096.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-02-19T19:02:15.576 INFO:teuthology.orchestra.run.smithi096.stdout: You just mounted a file system that supports labels which does not 2024-02-19T19:02:15.576 INFO:teuthology.orchestra.run.smithi096.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-19T19:02:15.576 INFO:teuthology.orchestra.run.smithi096.stdout: applications will generate AVC messages and not be allowed access to 2024-02-19T19:02:15.576 INFO:teuthology.orchestra.run.smithi096.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-19T19:02:15.577 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-19T19:02:15.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:15.578 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-19T19:02:15.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:15.605 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-19T19:02:15.666 INFO:teuthology.orchestra.run.smithi096.stdout:client24301 2024-02-19T19:02:15.666 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-02-19T19:02:15.666 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T19:02:15.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:15.722 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-19T19:02:15.783 INFO:teuthology.orchestra.run.smithi096.stdout:client24301 2024-02-19T19:02:15.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:15.783 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-19T19:02:15.843 INFO:teuthology.orchestra.run.smithi096.stdout:client24301 2024-02-19T19:02:15.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:15.843 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/06580d2c-cf58-11ee-95bb-87774f69a715.client24301/status') 2024-02-19T19:02:15.913 INFO:teuthology.orchestra.run.smithi096.stdout:instance: client.24301 (3)172.21.15.96:0/2099652410 2024-02-19T19:02:15.913 INFO:teuthology.orchestra.run.smithi096.stdout:blocklisted: false 2024-02-19T19:02:15.913 INFO:teuthology.orchestra.run.smithi096.stderr:0+1 records in 2024-02-19T19:02:15.914 INFO:teuthology.orchestra.run.smithi096.stderr:0+1 records out 2024-02-19T19:02:15.914 INFO:teuthology.orchestra.run.smithi096.stderr:71 bytes copied, 2.0542e-05 s, 3.5 MB/s 2024-02-19T19:02:15.915 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-02-19T19:02:15.915 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-19T19:02:15.915 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-19T19:02:15.915 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -- ceph fs ls 2024-02-19T19:02:16.162 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:02:16.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:16 smithi096 ceph-mon[29216]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-19T19:02:16.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:16 smithi125 ceph-mon[37556]: pgmap v193: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.6 KiB/s rd, 0 B/s wr, 9 op/s 2024-02-19T19:02:17.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.632+0000 7f21d8f69700 1 -- 172.21.15.96:0/3428887005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d40ff5a0 msgr2=0x7f21d40ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:17.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.632+0000 7f21d8f69700 1 --2- 172.21.15.96:0/3428887005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d40ff5a0 0x7f21d40ff980 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f21cc00b0a0 tx=0x7f21cc00b3b0 comp rx=0 tx=0).stop 2024-02-19T19:02:17.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.632+0000 7f21d8f69700 1 -- 172.21.15.96:0/3428887005 shutdown_connections 2024-02-19T19:02:17.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.632+0000 7f21d8f69700 1 --2- 172.21.15.96:0/3428887005 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21d40fff50 0x7f21d4105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:17.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.632+0000 7f21d8f69700 1 --2- 172.21.15.96:0/3428887005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d40ff5a0 0x7f21d40ff980 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:17.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.632+0000 7f21d8f69700 1 -- 172.21.15.96:0/3428887005 >> 172.21.15.96:0/3428887005 conn(0x7f21d4074e30 msgr2=0x7f21d4075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:17.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.632+0000 7f21d8f69700 1 -- 172.21.15.96:0/3428887005 shutdown_connections 2024-02-19T19:02:17.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.632+0000 7f21d8f69700 1 -- 172.21.15.96:0/3428887005 wait complete. 2024-02-19T19:02:17.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.633+0000 7f21d8f69700 1 Processor -- start 2024-02-19T19:02:17.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.633+0000 7f21d8f69700 1 -- start start 2024-02-19T19:02:17.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.633+0000 7f21d8f69700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21d40ff5a0 0x7f21d419c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.633+0000 7f21d8f69700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d40fff50 0x7f21d419cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.633+0000 7f21d8f69700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d419d1c0 con 0x7f21d40fff50 2024-02-19T19:02:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.633+0000 7f21d8f69700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d4196700 con 0x7f21d40ff5a0 2024-02-19T19:02:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.633+0000 7f21d1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d40fff50 0x7f21d419cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.633+0000 7f21d1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d40fff50 0x7f21d419cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50512/0 (socket says 172.21.15.96:50512) 2024-02-19T19:02:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.633+0000 7f21d1d9b700 1 -- 172.21.15.96:0/1872023706 learned_addr learned my addr 172.21.15.96:0/1872023706 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:02:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.633+0000 7f21d259c700 1 --2- 172.21.15.96:0/1872023706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21d40ff5a0 0x7f21d419c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.633+0000 7f21d1d9b700 1 -- 172.21.15.96:0/1872023706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21d40ff5a0 msgr2=0x7f21d419c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.633+0000 7f21d1d9b700 1 --2- 172.21.15.96:0/1872023706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21d40ff5a0 0x7f21d419c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.633+0000 7f21d1d9b700 1 -- 172.21.15.96:0/1872023706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21cc009d00 con 0x7f21d40fff50 2024-02-19T19:02:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.634+0000 7f21d1d9b700 1 --2- 172.21.15.96:0/1872023706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d40fff50 0x7f21d419cbc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f21c800c960 tx=0x7f21c800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.634+0000 7f21c37fe700 1 -- 172.21.15.96:0/1872023706 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21c8007a70 con 0x7f21d40fff50 2024-02-19T19:02:17.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.634+0000 7f21c37fe700 1 -- 172.21.15.96:0/1872023706 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f21c8007bd0 con 0x7f21d40fff50 2024-02-19T19:02:17.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.634+0000 7f21c37fe700 1 -- 172.21.15.96:0/1872023706 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21c8018630 con 0x7f21d40fff50 2024-02-19T19:02:17.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.634+0000 7f21d8f69700 1 -- 172.21.15.96:0/1872023706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d41969e0 con 0x7f21d40fff50 2024-02-19T19:02:17.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.634+0000 7f21d8f69700 1 -- 172.21.15.96:0/1872023706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d4196ee0 con 0x7f21d40fff50 2024-02-19T19:02:17.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.635+0000 7f21d8f69700 1 -- 172.21.15.96:0/1872023706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d4109270 con 0x7f21d40fff50 2024-02-19T19:02:17.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.635+0000 7f21c37fe700 1 -- 172.21.15.96:0/1872023706 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f21c800f450 con 0x7f21d40fff50 2024-02-19T19:02:17.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.635+0000 7f21c37fe700 1 --2- 172.21.15.96:0/1872023706 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f21bc06c4e0 0x7f21bc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:17.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.636+0000 7f21c37fe700 1 -- 172.21.15.96:0/1872023706 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f21c808b7d0 con 0x7f21d40fff50 2024-02-19T19:02:17.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.636+0000 7f21d259c700 1 --2- 172.21.15.96:0/1872023706 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f21bc06c4e0 0x7f21bc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:17.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.636+0000 7f21d259c700 1 --2- 172.21.15.96:0/1872023706 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f21bc06c4e0 0x7f21bc06e9a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f21cc000f80 tx=0x7f21cc0060c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:17.659 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.640+0000 7f21c37fe700 1 -- 172.21.15.96:0/1872023706 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f21c80599e0 con 0x7f21d40fff50 2024-02-19T19:02:17.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.875+0000 7f21d8f69700 1 -- 172.21.15.96:0/1872023706 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f21d4197cb0 con 0x7f21d40fff50 2024-02-19T19:02:17.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.876+0000 7f21c37fe700 1 -- 172.21.15.96:0/1872023706 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+83 (secure 0 0 0) 0x7f21c8059570 con 0x7f21d40fff50 2024-02-19T19:02:17.895 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-19T19:02:17.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.878+0000 7f21d8f69700 1 -- 172.21.15.96:0/1872023706 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f21bc06c4e0 msgr2=0x7f21bc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:17.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.878+0000 7f21d8f69700 1 --2- 172.21.15.96:0/1872023706 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f21bc06c4e0 0x7f21bc06e9a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f21cc000f80 tx=0x7f21cc0060c0 comp rx=0 tx=0).stop 2024-02-19T19:02:17.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.878+0000 7f21d8f69700 1 -- 172.21.15.96:0/1872023706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d40fff50 msgr2=0x7f21d419cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:17.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.878+0000 7f21d8f69700 1 --2- 172.21.15.96:0/1872023706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d40fff50 0x7f21d419cbc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f21c800c960 tx=0x7f21c800cc70 comp rx=0 tx=0).stop 2024-02-19T19:02:17.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.878+0000 7f21d8f69700 1 -- 172.21.15.96:0/1872023706 shutdown_connections 2024-02-19T19:02:17.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.878+0000 7f21d8f69700 1 --2- 172.21.15.96:0/1872023706 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f21bc06c4e0 0x7f21bc06e9a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:17.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.878+0000 7f21d8f69700 1 --2- 172.21.15.96:0/1872023706 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21d40ff5a0 0x7f21d419c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:17.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.878+0000 7f21d8f69700 1 --2- 172.21.15.96:0/1872023706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21d40fff50 0x7f21d419cbc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:17.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.878+0000 7f21d8f69700 1 -- 172.21.15.96:0/1872023706 >> 172.21.15.96:0/1872023706 conn(0x7f21d4074e30 msgr2=0x7f21d40fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:17.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.878+0000 7f21d8f69700 1 -- 172.21.15.96:0/1872023706 shutdown_connections 2024-02-19T19:02:17.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:17.878+0000 7f21d8f69700 1 -- 172.21.15.96:0/1872023706 wait complete. 2024-02-19T19:02:18.434 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-19T19:02:18.434 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-19T19:02:18.434 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2024-02-19T19:02:18.434 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-19T19:02:18.434 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-19T19:02:18.435 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-19T19:02:18.435 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-19T19:02:18.435 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-19T19:02:18.435 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-19T19:02:18.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:18.435 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2024-02-19T19:02:18.455 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-19T19:02:18.455 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-19T19:02:18.455 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2024-02-19T19:02:18.455 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2024-02-19T19:02:18.455 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2024-02-19T19:02:18.455 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2024-02-19T19:02:18.455 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T19:02:18.456 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2024-02-19T19:02:18.456 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f0 2024-02-19T19:02:18.456 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T19:02:18.456 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2024-02-19T19:02:18.456 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f1 2024-02-19T19:02:18.456 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-19T19:02:18.456 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2024-02-19T19:02:18.456 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-19T19:02:18.456 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2024-02-19T19:02:18.456 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-19T19:02:18.456 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42032sec preferred_lft 42032sec 2024-02-19T19:02:18.457 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::ec4:7aff:fe8f:d739/64 scope link 2024-02-19T19:02:18.457 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2024-02-19T19:02:18.457 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-19T19:02:18.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:18.457 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2024-02-19T19:02:18.457 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2024-02-19T19:02:18.457 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link add name ceph-brx type bridge 2024-02-19T19:02:18.457 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip addr flush dev ceph-brx 2024-02-19T19:02:18.457 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set ceph-brx up 2024-02-19T19:02:18.457 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-19T19:02:18.457 DEBUG:teuthology.orchestra.run.smithi125:> ') 2024-02-19T19:02:18.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:18.633 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-19T19:02:18.660 INFO:teuthology.orchestra.run.smithi125.stdout:1 2024-02-19T19:02:18.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:18.662 DEBUG:teuthology.orchestra.run.smithi125:> route 2024-02-19T19:02:18.726 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2024-02-19T19:02:18.726 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-19T19:02:18.726 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-19T19:02:18.726 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-19T19:02:18.726 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-19T19:02:18.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:18.726 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2024-02-19T19:02:18.726 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2024-02-19T19:02:18.727 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-19T19:02:18.727 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-19T19:02:18.727 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-19T19:02:18.727 DEBUG:teuthology.orchestra.run.smithi125:> ') 2024-02-19T19:02:19.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:19.019 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2024-02-19T19:02:19.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:19.033 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list-id 2024-02-19T19:02:19.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:19.088 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2024-02-19T19:02:19.088 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2024-02-19T19:02:19.088 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-19T19:02:19.088 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-02-19T19:02:19.088 DEBUG:teuthology.orchestra.run.smithi125:> ') 2024-02-19T19:02:19.154 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:18 smithi125 ceph-mon[37556]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 7 op/s 2024-02-19T19:02:19.154 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:18 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/1872023706' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-19T19:02:19.172 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-02-19T19:02:19.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:19.172 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2024-02-19T19:02:19.172 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2024-02-19T19:02:19.172 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-02-19T19:02:19.172 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-19T19:02:19.172 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-02-19T19:02:19.173 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-02-19T19:02:19.173 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-02-19T19:02:19.173 DEBUG:teuthology.orchestra.run.smithi125:> ') 2024-02-19T19:02:19.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:18 smithi096 ceph-mon[29216]: pgmap v194: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 5.2 KiB/s rd, 170 B/s wr, 7 op/s 2024-02-19T19:02:19.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:18 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/1872023706' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-19T19:02:19.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:19.306 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2024-02-19T19:02:19.306 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2024-02-19T19:02:19.306 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.0 up 2024-02-19T19:02:19.306 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set dev brx.0 master ceph-brx 2024-02-19T19:02:19.306 DEBUG:teuthology.orchestra.run.smithi125:> ') 2024-02-19T19:02:19.347 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-19T19:02:19.347 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-19T19:02:19.402 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-19T19:02:19.402 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-19T19:02:19.402 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-19T19:02:19.457 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-02-19T19:02:19.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:19.457 DEBUG:teuthology.orchestra.run.smithi125:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-19T19:02:19.585 INFO:teuthology.orchestra.run.smithi125.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-19T19:02:19.585 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-19T19:02:19.585 INFO:teuthology.orchestra.run.smithi125.stdout:invalid new device string format 2024-02-19T19:02:19.695 INFO:teuthology.orchestra.run.smithi125.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-19T19:02:19.695 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-19T19:02:19.695 INFO:teuthology.orchestra.run.smithi125.stdout:invalid new device string format 2024-02-19T19:02:19.695 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: resolved to: "172.21.15.96:3300,172.21.15.125:3300" 2024-02-19T19:02:19.695 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-19T19:02:19.704 INFO:teuthology.orchestra.run.smithi125.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-02-19T19:02:19.704 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-02-19T19:02:19.704 INFO:teuthology.orchestra.run.smithi125.stdout:invalid new device string format 2024-02-19T19:02:19.705 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: resolved to: "172.21.15.96:3300,172.21.15.125:3300" 2024-02-19T19:02:19.705 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: switching to using v1 address with old syntax 2024-02-19T19:02:19.705 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: resolved to: "172.21.15.96:6789,172.21.15.125:6789" 2024-02-19T19:02:19.705 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.96:6789,172.21.15.125:6789:/ 2024-02-19T19:02:19.705 INFO:teuthology.orchestra.run.smithi125.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=06580d2c-cf58-11ee-95bb-87774f69a715" will pass to kernel 2024-02-19T19:02:19.705 INFO:teuthology.orchestra.run.smithi125.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-02-19T19:02:19.705 INFO:teuthology.orchestra.run.smithi125.stdout: You just mounted a file system that supports labels which does not 2024-02-19T19:02:19.705 INFO:teuthology.orchestra.run.smithi125.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-02-19T19:02:19.705 INFO:teuthology.orchestra.run.smithi125.stdout: applications will generate AVC messages and not be allowed access to 2024-02-19T19:02:19.706 INFO:teuthology.orchestra.run.smithi125.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-02-19T19:02:19.707 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-02-19T19:02:19.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:19.707 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-19T19:02:19.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:19.734 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-19T19:02:19.789 INFO:teuthology.orchestra.run.smithi125.stdout:client14544 2024-02-19T19:02:19.790 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-02-19T19:02:19.790 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T19:02:19.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:19.846 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-19T19:02:19.901 INFO:teuthology.orchestra.run.smithi125.stdout:client14544 2024-02-19T19:02:19.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:19.901 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-02-19T19:02:19.957 INFO:teuthology.orchestra.run.smithi125.stdout:client14544 2024-02-19T19:02:19.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:02:19.958 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/06580d2c-cf58-11ee-95bb-87774f69a715.client14544/status') 2024-02-19T19:02:20.023 INFO:teuthology.orchestra.run.smithi125.stdout:instance: client.14544 (3)172.21.15.125:0/3171729396 2024-02-19T19:02:20.024 INFO:teuthology.orchestra.run.smithi125.stdout:blocklisted: false 2024-02-19T19:02:20.024 INFO:teuthology.orchestra.run.smithi125.stderr:0+1 records in 2024-02-19T19:02:20.024 INFO:teuthology.orchestra.run.smithi125.stderr:0+1 records out 2024-02-19T19:02:20.024 INFO:teuthology.orchestra.run.smithi125.stderr:72 bytes copied, 2.1227e-05 s, 3.4 MB/s 2024-02-19T19:02:20.025 INFO:teuthology.run_tasks:Running task print... 2024-02-19T19:02:20.036 INFO:teuthology.task.print:**** done client 2024-02-19T19:02:20.036 INFO:teuthology.run_tasks:Running task parallel... 2024-02-19T19:02:20.047 INFO:teuthology.task.parallel:starting parallel... 2024-02-19T19:02:20.047 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-19T19:02:20.047 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-19T19:02:20.048 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi096.front.sepia.ceph.com 2024-02-19T19:02:20.048 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-19T19:02:20.048 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-19T19:02:20.048 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-02-19T19:02:20.051 INFO:tasks.workunit:Pulling workunits from ref 1ce7ea8877c709fa862eac608550374bd96e166e 2024-02-19T19:02:20.052 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-19T19:02:20.052 INFO:tasks.workunit:timeout=3h 2024-02-19T19:02:20.052 INFO:tasks.workunit:cleanup=True 2024-02-19T19:02:20.052 DEBUG:teuthology.orchestra.run.smithi096:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-19T19:02:20.071 INFO:teuthology.orchestra.run.smithi096.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-02-19T19:02:20.071 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-02-19T19:02:20.071 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 94h/148d Inode: 1 Links: 2 2024-02-19T19:02:20.071 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T19:02:20.071 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-02-19T19:02:20.072 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-19T19:02:20.072 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2024-02-19 19:01:47.912656064 +0000 2024-02-19T19:02:20.072 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2024-02-19 19:02:15.584456961 +0000 2024-02-19T19:02:20.072 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: 2024-02-19 19:01:47.912656064 +0000 2024-02-19T19:02:20.072 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-02-19T19:02:20.072 DEBUG:teuthology.orchestra.run.smithi096:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-02-19T19:02:20.145 DEBUG:teuthology.orchestra.run.smithi125:> stat -- /home/ubuntu/cephtest/mnt.1 2024-02-19T19:02:20.161 INFO:teuthology.orchestra.run.smithi125.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-02-19T19:02:20.161 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-02-19T19:02:20.161 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 7eh/126d Inode: 1 Links: 3 2024-02-19T19:02:20.161 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-19T19:02:20.161 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-02-19T19:02:20.161 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-19T19:02:20.161 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2024-02-19 19:02:20.120353153 +0000 2024-02-19T19:02:20.161 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2024-02-19 19:02:20.120353153 +0000 2024-02-19T19:02:20.161 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: 2024-02-19 19:01:47.912656064 +0000 2024-02-19T19:02:20.161 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-02-19T19:02:20.162 DEBUG:teuthology.orchestra.run.smithi125:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-02-19T19:02:20.234 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/batrick/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1ce7ea8877c709fa862eac608550374bd96e166e 2024-02-19T19:02:20.234 DEBUG:teuthology.orchestra.run.smithi125:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/batrick/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 1ce7ea8877c709fa862eac608550374bd96e166e 2024-02-19T19:02:20.251 INFO:tasks.workunit.client.0.smithi096.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-19T19:02:20.283 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:02:20.290 INFO:tasks.workunit.client.1.smithi125.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-02-19T19:02:21.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:20 smithi125 ceph-mon[37556]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-19T19:02:21.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:20 smithi096 ceph-mon[29216]: pgmap v195: 65 pgs: 65 active+clean; 580 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-19T19:02:21.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.904+0000 7f1374602700 1 -- 172.21.15.96:0/957290131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f136c0ffbb0 msgr2=0x7f136c0fffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:21.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.904+0000 7f1374602700 1 --2- 172.21.15.96:0/957290131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f136c0ffbb0 0x7f136c0fffd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f1364009910 tx=0x7f1364009c20 comp rx=0 tx=0).stop 2024-02-19T19:02:21.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.904+0000 7f1374602700 1 -- 172.21.15.96:0/957290131 shutdown_connections 2024-02-19T19:02:21.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.904+0000 7f1374602700 1 --2- 172.21.15.96:0/957290131 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f136c100db0 0x7f136c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:21.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.904+0000 7f1374602700 1 --2- 172.21.15.96:0/957290131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f136c0ffbb0 0x7f136c0fffd0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:21.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.904+0000 7f1374602700 1 -- 172.21.15.96:0/957290131 >> 172.21.15.96:0/957290131 conn(0x7f136c0fb150 msgr2=0x7f136c0fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:21.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.904+0000 7f1374602700 1 -- 172.21.15.96:0/957290131 shutdown_connections 2024-02-19T19:02:21.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.904+0000 7f1374602700 1 -- 172.21.15.96:0/957290131 wait complete. 2024-02-19T19:02:21.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.904+0000 7f1374602700 1 Processor -- start 2024-02-19T19:02:21.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.905+0000 7f1374602700 1 -- start start 2024-02-19T19:02:21.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.905+0000 7f1374602700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f136c0ffbb0 0x7f136c196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:21.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.905+0000 7f1374602700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f136c100db0 0x7f136c196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:21.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.905+0000 7f1374602700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c1970c0 con 0x7f136c100db0 2024-02-19T19:02:21.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.905+0000 7f1374602700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c197200 con 0x7f136c0ffbb0 2024-02-19T19:02:21.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.905+0000 7f1371b9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f136c100db0 0x7f136c196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:21.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.905+0000 7f1371b9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f136c100db0 0x7f136c196aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50530/0 (socket says 172.21.15.96:50530) 2024-02-19T19:02:21.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.905+0000 7f1371b9d700 1 -- 172.21.15.96:0/1643754668 learned_addr learned my addr 172.21.15.96:0/1643754668 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:02:21.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.905+0000 7f137239e700 1 --2- 172.21.15.96:0/1643754668 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f136c0ffbb0 0x7f136c196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:21.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.905+0000 7f1371b9d700 1 -- 172.21.15.96:0/1643754668 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f136c0ffbb0 msgr2=0x7f136c196560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:21.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.905+0000 7f1371b9d700 1 --2- 172.21.15.96:0/1643754668 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f136c0ffbb0 0x7f136c196560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:21.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.905+0000 7f1371b9d700 1 -- 172.21.15.96:0/1643754668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13640095f0 con 0x7f136c100db0 2024-02-19T19:02:21.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.905+0000 7f1371b9d700 1 --2- 172.21.15.96:0/1643754668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f136c100db0 0x7f136c196aa0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f136000b4b0 tx=0x7f136000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:21.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.905+0000 7f136b7fe700 1 -- 172.21.15.96:0/1643754668 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1360011800 con 0x7f136c100db0 2024-02-19T19:02:21.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.905+0000 7f1374602700 1 -- 172.21.15.96:0/1643754668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136c19bcb0 con 0x7f136c100db0 2024-02-19T19:02:21.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.905+0000 7f136b7fe700 1 -- 172.21.15.96:0/1643754668 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1360011e10 con 0x7f136c100db0 2024-02-19T19:02:21.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.905+0000 7f136b7fe700 1 -- 172.21.15.96:0/1643754668 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f136000f2e0 con 0x7f136c100db0 2024-02-19T19:02:21.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.905+0000 7f1374602700 1 -- 172.21.15.96:0/1643754668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136c19c200 con 0x7f136c100db0 2024-02-19T19:02:21.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.907+0000 7f1374602700 1 -- 172.21.15.96:0/1643754668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136c108790 con 0x7f136c100db0 2024-02-19T19:02:21.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.907+0000 7f136b7fe700 1 -- 172.21.15.96:0/1643754668 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f1360010380 con 0x7f136c100db0 2024-02-19T19:02:21.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.907+0000 7f136b7fe700 1 --2- 172.21.15.96:0/1643754668 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f135406c4e0 0x7f135406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:21.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.907+0000 7f136b7fe700 1 -- 172.21.15.96:0/1643754668 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f136008b400 con 0x7f136c100db0 2024-02-19T19:02:21.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.907+0000 7f137239e700 1 --2- 172.21.15.96:0/1643754668 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f135406c4e0 0x7f135406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:21.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.908+0000 7f137239e700 1 --2- 172.21.15.96:0/1643754668 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f135406c4e0 0x7f135406e9a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1364006010 tx=0x7f136400b580 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:21.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:21.912+0000 7f136b7fe700 1 -- 172.21.15.96:0/1643754668 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1360059690 con 0x7f136c100db0 2024-02-19T19:02:22.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:22.102+0000 7f1374602700 1 -- 172.21.15.96:0/1643754668 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f136c108980 con 0x7f136c100db0 2024-02-19T19:02:22.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:22.102+0000 7f136b7fe700 1 -- 172.21.15.96:0/1643754668 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f1360059220 con 0x7f136c100db0 2024-02-19T19:02:22.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:22.104+0000 7f1374602700 1 -- 172.21.15.96:0/1643754668 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f135406c4e0 msgr2=0x7f135406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:22.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:22.104+0000 7f1374602700 1 --2- 172.21.15.96:0/1643754668 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f135406c4e0 0x7f135406e9a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1364006010 tx=0x7f136400b580 comp rx=0 tx=0).stop 2024-02-19T19:02:22.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:22.104+0000 7f1374602700 1 -- 172.21.15.96:0/1643754668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f136c100db0 msgr2=0x7f136c196aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:22.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:22.104+0000 7f1374602700 1 --2- 172.21.15.96:0/1643754668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f136c100db0 0x7f136c196aa0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f136000b4b0 tx=0x7f136000b870 comp rx=0 tx=0).stop 2024-02-19T19:02:22.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:22.104+0000 7f1374602700 1 -- 172.21.15.96:0/1643754668 shutdown_connections 2024-02-19T19:02:22.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:22.104+0000 7f1374602700 1 --2- 172.21.15.96:0/1643754668 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f135406c4e0 0x7f135406e9a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:22.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:22.104+0000 7f1374602700 1 --2- 172.21.15.96:0/1643754668 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f136c0ffbb0 0x7f136c196560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:22.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:22.104+0000 7f1374602700 1 --2- 172.21.15.96:0/1643754668 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f136c100db0 0x7f136c196aa0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:22.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:22.104+0000 7f1374602700 1 -- 172.21.15.96:0/1643754668 >> 172.21.15.96:0/1643754668 conn(0x7f136c0fb150 msgr2=0x7f136c068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:22.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:22.104+0000 7f1374602700 1 -- 172.21.15.96:0/1643754668 shutdown_connections 2024-02-19T19:02:22.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:22.104+0000 7f1374602700 1 -- 172.21.15.96:0/1643754668 wait complete. 2024-02-19T19:02:22.731 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-19T19:02:22.984 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:02:23.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:22 smithi096 ceph-mon[29216]: pgmap v196: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-02-19T19:02:23.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:22 smithi125 ceph-mon[37556]: pgmap v196: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-02-19T19:02:24.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.685+0000 7ff4d5eae700 1 -- 172.21.15.96:0/725040693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4d0101750 msgr2=0x7ff4d0103b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:24.706 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.685+0000 7ff4d5eae700 1 --2- 172.21.15.96:0/725040693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4d0101750 0x7ff4d0103b40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff4c0009910 tx=0x7ff4c0009c20 comp rx=0 tx=0).stop 2024-02-19T19:02:24.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.685+0000 7ff4d5eae700 1 -- 172.21.15.96:0/725040693 shutdown_connections 2024-02-19T19:02:24.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.685+0000 7ff4d5eae700 1 --2- 172.21.15.96:0/725040693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4d0104080 0x7ff4d0106470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:24.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.685+0000 7ff4d5eae700 1 --2- 172.21.15.96:0/725040693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4d0101750 0x7ff4d0103b40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:24.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.685+0000 7ff4d5eae700 1 -- 172.21.15.96:0/725040693 >> 172.21.15.96:0/725040693 conn(0x7ff4d00fb160 msgr2=0x7ff4d00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:24.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.685+0000 7ff4d5eae700 1 -- 172.21.15.96:0/725040693 shutdown_connections 2024-02-19T19:02:24.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.685+0000 7ff4d5eae700 1 -- 172.21.15.96:0/725040693 wait complete. 2024-02-19T19:02:24.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.686+0000 7ff4d5eae700 1 Processor -- start 2024-02-19T19:02:24.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.686+0000 7ff4d5eae700 1 -- start start 2024-02-19T19:02:24.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.686+0000 7ff4d5eae700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4d0101750 0x7ff4d0196820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:24.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.687+0000 7ff4d5eae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4d0104080 0x7ff4d0196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:24.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.687+0000 7ff4d5eae700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d0197380 con 0x7ff4d0104080 2024-02-19T19:02:24.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.687+0000 7ff4d5eae700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d01974c0 con 0x7ff4d0101750 2024-02-19T19:02:24.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.687+0000 7ff4ceffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4d0104080 0x7ff4d0196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:24.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.687+0000 7ff4ceffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4d0104080 0x7ff4d0196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50532/0 (socket says 172.21.15.96:50532) 2024-02-19T19:02:24.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.687+0000 7ff4ceffd700 1 -- 172.21.15.96:0/3994965260 learned_addr learned my addr 172.21.15.96:0/3994965260 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:02:24.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.687+0000 7ff4cf7fe700 1 --2- 172.21.15.96:0/3994965260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4d0101750 0x7ff4d0196820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:24.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.687+0000 7ff4ceffd700 1 -- 172.21.15.96:0/3994965260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4d0101750 msgr2=0x7ff4d0196820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:24.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.687+0000 7ff4ceffd700 1 --2- 172.21.15.96:0/3994965260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4d0101750 0x7ff4d0196820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:24.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.687+0000 7ff4ceffd700 1 -- 172.21.15.96:0/3994965260 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c00095f0 con 0x7ff4d0104080 2024-02-19T19:02:24.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.687+0000 7ff4ceffd700 1 --2- 172.21.15.96:0/3994965260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4d0104080 0x7ff4d0196d60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400b4b0 tx=0x7ff4c400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:24.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.687+0000 7ff4ccff9700 1 -- 172.21.15.96:0/3994965260 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4c4011800 con 0x7ff4d0104080 2024-02-19T19:02:24.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.687+0000 7ff4ccff9700 1 -- 172.21.15.96:0/3994965260 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff4c4011e10 con 0x7ff4d0104080 2024-02-19T19:02:24.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.687+0000 7ff4d5eae700 1 -- 172.21.15.96:0/3994965260 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d019bf70 con 0x7ff4d0104080 2024-02-19T19:02:24.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.687+0000 7ff4ccff9700 1 -- 172.21.15.96:0/3994965260 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4c400f2e0 con 0x7ff4d0104080 2024-02-19T19:02:24.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.687+0000 7ff4d5eae700 1 -- 172.21.15.96:0/3994965260 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d019c490 con 0x7ff4d0104080 2024-02-19T19:02:24.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.688+0000 7ff4d5eae700 1 -- 172.21.15.96:0/3994965260 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d01906b0 con 0x7ff4d0104080 2024-02-19T19:02:24.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.689+0000 7ff4ccff9700 1 -- 172.21.15.96:0/3994965260 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7ff4c4010380 con 0x7ff4d0104080 2024-02-19T19:02:24.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.689+0000 7ff4ccff9700 1 --2- 172.21.15.96:0/3994965260 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff4b806c4e0 0x7ff4b806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:24.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.689+0000 7ff4ccff9700 1 -- 172.21.15.96:0/3994965260 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff4c408b4d0 con 0x7ff4d0104080 2024-02-19T19:02:24.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.689+0000 7ff4cf7fe700 1 --2- 172.21.15.96:0/3994965260 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff4b806c4e0 0x7ff4b806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:24.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.690+0000 7ff4cf7fe700 1 --2- 172.21.15.96:0/3994965260 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff4b806c4e0 0x7ff4b806e9a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000b5c0 tx=0x7ff4c0005960 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:24.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.694+0000 7ff4ccff9700 1 -- 172.21.15.96:0/3994965260 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff4c40596e0 con 0x7ff4d0104080 2024-02-19T19:02:24.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.894+0000 7ff4d5eae700 1 -- 172.21.15.96:0/3994965260 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7ff4d0068af0 con 0x7ff4d0104080 2024-02-19T19:02:24.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.894+0000 7ff4ccff9700 1 -- 172.21.15.96:0/3994965260 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7ff4c4059270 con 0x7ff4d0104080 2024-02-19T19:02:24.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.896+0000 7ff4d5eae700 1 -- 172.21.15.96:0/3994965260 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff4b806c4e0 msgr2=0x7ff4b806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:24.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.896+0000 7ff4d5eae700 1 --2- 172.21.15.96:0/3994965260 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff4b806c4e0 0x7ff4b806e9a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000b5c0 tx=0x7ff4c0005960 comp rx=0 tx=0).stop 2024-02-19T19:02:24.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.896+0000 7ff4d5eae700 1 -- 172.21.15.96:0/3994965260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4d0104080 msgr2=0x7ff4d0196d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:24.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.896+0000 7ff4d5eae700 1 --2- 172.21.15.96:0/3994965260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4d0104080 0x7ff4d0196d60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400b4b0 tx=0x7ff4c400b870 comp rx=0 tx=0).stop 2024-02-19T19:02:24.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.896+0000 7ff4d5eae700 1 -- 172.21.15.96:0/3994965260 shutdown_connections 2024-02-19T19:02:24.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.896+0000 7ff4d5eae700 1 --2- 172.21.15.96:0/3994965260 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff4b806c4e0 0x7ff4b806e9a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:24.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.896+0000 7ff4d5eae700 1 --2- 172.21.15.96:0/3994965260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4d0101750 0x7ff4d0196820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:24.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.896+0000 7ff4d5eae700 1 --2- 172.21.15.96:0/3994965260 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4d0104080 0x7ff4d0196d60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:24.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.896+0000 7ff4d5eae700 1 -- 172.21.15.96:0/3994965260 >> 172.21.15.96:0/3994965260 conn(0x7ff4d00fb160 msgr2=0x7ff4d00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:24.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.896+0000 7ff4d5eae700 1 -- 172.21.15.96:0/3994965260 shutdown_connections 2024-02-19T19:02:24.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:24.896+0000 7ff4d5eae700 1 -- 172.21.15.96:0/3994965260 wait complete. 2024-02-19T19:02:25.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:24 smithi125 ceph-mon[37556]: pgmap v197: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 5 op/s 2024-02-19T19:02:25.274 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:24 smithi096 ceph-mon[29216]: pgmap v197: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 5 op/s 2024-02-19T19:02:25.587 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-19T19:02:25.799 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:02:26.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:26 smithi096 ceph-mon[29216]: pgmap v198: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-02-19T19:02:26.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:26 smithi125 ceph-mon[37556]: pgmap v198: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-02-19T19:02:27.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.407+0000 7ff3f921e700 1 -- 172.21.15.96:0/1880154662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3f4100cb0 msgr2=0x7ff3f41010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:27.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.407+0000 7ff3f921e700 1 --2- 172.21.15.96:0/1880154662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3f4100cb0 0x7ff3f41010d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4009910 tx=0x7ff3e4009c20 comp rx=0 tx=0).stop 2024-02-19T19:02:27.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.407+0000 7ff3f921e700 1 -- 172.21.15.96:0/1880154662 shutdown_connections 2024-02-19T19:02:27.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.407+0000 7ff3f921e700 1 --2- 172.21.15.96:0/1880154662 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3f4101eb0 0x7ff3f4102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:27.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.407+0000 7ff3f921e700 1 --2- 172.21.15.96:0/1880154662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3f4100cb0 0x7ff3f41010d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:27.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.407+0000 7ff3f921e700 1 -- 172.21.15.96:0/1880154662 >> 172.21.15.96:0/1880154662 conn(0x7ff3f40fc230 msgr2=0x7ff3f40fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:27.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.407+0000 7ff3f921e700 1 -- 172.21.15.96:0/1880154662 shutdown_connections 2024-02-19T19:02:27.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.407+0000 7ff3f921e700 1 -- 172.21.15.96:0/1880154662 wait complete. 2024-02-19T19:02:27.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.408+0000 7ff3f921e700 1 Processor -- start 2024-02-19T19:02:27.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.408+0000 7ff3f921e700 1 -- start start 2024-02-19T19:02:27.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.408+0000 7ff3f921e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3f4100cb0 0x7ff3f41964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:27.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.408+0000 7ff3f921e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3f4101eb0 0x7ff3f4196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:27.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.408+0000 7ff3f921e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f4197020 con 0x7ff3f4100cb0 2024-02-19T19:02:27.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.408+0000 7ff3f921e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f4197160 con 0x7ff3f4101eb0 2024-02-19T19:02:27.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.408+0000 7ff3f2d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3f4100cb0 0x7ff3f41964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:27.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.408+0000 7ff3f2d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3f4100cb0 0x7ff3f41964c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50550/0 (socket says 172.21.15.96:50550) 2024-02-19T19:02:27.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.408+0000 7ff3f2d9d700 1 -- 172.21.15.96:0/3486164534 learned_addr learned my addr 172.21.15.96:0/3486164534 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:02:27.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.408+0000 7ff3f259c700 1 --2- 172.21.15.96:0/3486164534 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3f4101eb0 0x7ff3f4196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:27.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.409+0000 7ff3f2d9d700 1 -- 172.21.15.96:0/3486164534 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3f4101eb0 msgr2=0x7ff3f4196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:27.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.409+0000 7ff3f2d9d700 1 --2- 172.21.15.96:0/3486164534 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3f4101eb0 0x7ff3f4196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:27.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.409+0000 7ff3f2d9d700 1 -- 172.21.15.96:0/3486164534 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e40095f0 con 0x7ff3f4100cb0 2024-02-19T19:02:27.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.409+0000 7ff3f259c700 1 --2- 172.21.15.96:0/3486164534 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3f4101eb0 0x7ff3f4196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:02:27.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.409+0000 7ff3f2d9d700 1 --2- 172.21.15.96:0/3486164534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3f4100cb0 0x7ff3f41964c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400bda0 tx=0x7ff3e400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:27.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.409+0000 7ff3dbfff700 1 -- 172.21.15.96:0/3486164534 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3e401d070 con 0x7ff3f4100cb0 2024-02-19T19:02:27.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.409+0000 7ff3dbfff700 1 -- 172.21.15.96:0/3486164534 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff3e400f460 con 0x7ff3f4100cb0 2024-02-19T19:02:27.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.409+0000 7ff3f921e700 1 -- 172.21.15.96:0/3486164534 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f419bbb0 con 0x7ff3f4100cb0 2024-02-19T19:02:27.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.409+0000 7ff3dbfff700 1 -- 172.21.15.96:0/3486164534 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3e4021640 con 0x7ff3f4100cb0 2024-02-19T19:02:27.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.410+0000 7ff3f921e700 1 -- 172.21.15.96:0/3486164534 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f419c0a0 con 0x7ff3f4100cb0 2024-02-19T19:02:27.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.410+0000 7ff3f921e700 1 -- 172.21.15.96:0/3486164534 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f4109810 con 0x7ff3f4100cb0 2024-02-19T19:02:27.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.410+0000 7ff3dbfff700 1 -- 172.21.15.96:0/3486164534 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7ff3e4003a60 con 0x7ff3f4100cb0 2024-02-19T19:02:27.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.411+0000 7ff3dbfff700 1 --2- 172.21.15.96:0/3486164534 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff3dc06c4e0 0x7ff3dc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:27.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.411+0000 7ff3dbfff700 1 -- 172.21.15.96:0/3486164534 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff3e408cad0 con 0x7ff3f4100cb0 2024-02-19T19:02:27.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.411+0000 7ff3f259c700 1 --2- 172.21.15.96:0/3486164534 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff3dc06c4e0 0x7ff3dc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:27.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.411+0000 7ff3f259c700 1 --2- 172.21.15.96:0/3486164534 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff3dc06c4e0 0x7ff3dc06e9a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8005950 tx=0x7ff3e80058e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:27.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.415+0000 7ff3dbfff700 1 -- 172.21.15.96:0/3486164534 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff3e405ace0 con 0x7ff3f4100cb0 2024-02-19T19:02:27.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.611+0000 7ff3f921e700 1 -- 172.21.15.96:0/3486164534 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7ff3f419c800 con 0x7ff3f4100cb0 2024-02-19T19:02:27.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.611+0000 7ff3dbfff700 1 -- 172.21.15.96:0/3486164534 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7ff3e405a870 con 0x7ff3f4100cb0 2024-02-19T19:02:27.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.613+0000 7ff3f921e700 1 -- 172.21.15.96:0/3486164534 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff3dc06c4e0 msgr2=0x7ff3dc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:27.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.613+0000 7ff3f921e700 1 --2- 172.21.15.96:0/3486164534 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff3dc06c4e0 0x7ff3dc06e9a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8005950 tx=0x7ff3e80058e0 comp rx=0 tx=0).stop 2024-02-19T19:02:27.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.613+0000 7ff3f921e700 1 -- 172.21.15.96:0/3486164534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3f4100cb0 msgr2=0x7ff3f41964c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:27.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.613+0000 7ff3f921e700 1 --2- 172.21.15.96:0/3486164534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3f4100cb0 0x7ff3f41964c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400bda0 tx=0x7ff3e400be80 comp rx=0 tx=0).stop 2024-02-19T19:02:27.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.613+0000 7ff3f921e700 1 -- 172.21.15.96:0/3486164534 shutdown_connections 2024-02-19T19:02:27.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.613+0000 7ff3f921e700 1 --2- 172.21.15.96:0/3486164534 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7ff3dc06c4e0 0x7ff3dc06e9a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:27.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.613+0000 7ff3f921e700 1 --2- 172.21.15.96:0/3486164534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff3f4100cb0 0x7ff3f41964c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:27.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.613+0000 7ff3f921e700 1 --2- 172.21.15.96:0/3486164534 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3f4101eb0 0x7ff3f4196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:27.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.613+0000 7ff3f921e700 1 -- 172.21.15.96:0/3486164534 >> 172.21.15.96:0/3486164534 conn(0x7ff3f40fc230 msgr2=0x7ff3f41050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:27.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.614+0000 7ff3f921e700 1 -- 172.21.15.96:0/3486164534 shutdown_connections 2024-02-19T19:02:27.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:27.614+0000 7ff3f921e700 1 -- 172.21.15.96:0/3486164534 wait complete. 2024-02-19T19:02:28.199 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:27 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:02:28.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:27 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:02:28.220 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-02-19T19:02:28.434 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:02:28.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:28 smithi125 ceph-mon[37556]: pgmap v199: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-02-19T19:02:29.265 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:28 smithi096 ceph-mon[29216]: pgmap v199: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-02-19T19:02:30.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.997+0000 7fae10372700 1 -- 172.21.15.96:0/3083851151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae08104170 msgr2=0x7fae08106560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:30.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.997+0000 7fae10372700 1 --2- 172.21.15.96:0/3083851151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae08104170 0x7fae08106560 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fae04009910 tx=0x7fae04009c20 comp rx=0 tx=0).stop 2024-02-19T19:02:30.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.997+0000 7fae10372700 1 -- 172.21.15.96:0/3083851151 shutdown_connections 2024-02-19T19:02:30.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.997+0000 7fae10372700 1 --2- 172.21.15.96:0/3083851151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae08104170 0x7fae08106560 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:30.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.997+0000 7fae10372700 1 --2- 172.21.15.96:0/3083851151 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae08101840 0x7fae08103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.997+0000 7fae10372700 1 -- 172.21.15.96:0/3083851151 >> 172.21.15.96:0/3083851151 conn(0x7fae080fb190 msgr2=0x7fae080fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.997+0000 7fae10372700 1 -- 172.21.15.96:0/3083851151 shutdown_connections 2024-02-19T19:02:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.997+0000 7fae10372700 1 -- 172.21.15.96:0/3083851151 wait complete. 2024-02-19T19:02:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.998+0000 7fae10372700 1 Processor -- start 2024-02-19T19:02:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.998+0000 7fae10372700 1 -- start start 2024-02-19T19:02:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.998+0000 7fae10372700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae08101840 0x7fae081011a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.998+0000 7fae10372700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae08104170 0x7fae080ff7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.998+0000 7fae10372700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0819a140 con 0x7fae08104170 2024-02-19T19:02:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.998+0000 7fae10372700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0819a280 con 0x7fae08101840 2024-02-19T19:02:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.998+0000 7fae0d90d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae08104170 0x7fae080ff7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.998+0000 7fae0d90d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae08104170 0x7fae080ff7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50568/0 (socket says 172.21.15.96:50568) 2024-02-19T19:02:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.998+0000 7fae0d90d700 1 -- 172.21.15.96:0/89482256 learned_addr learned my addr 172.21.15.96:0/89482256 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:02:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.999+0000 7fae0e10e700 1 --2- 172.21.15.96:0/89482256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae08101840 0x7fae081011a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.999+0000 7fae0d90d700 1 -- 172.21.15.96:0/89482256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae08101840 msgr2=0x7fae081011a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:30.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.999+0000 7fae0d90d700 1 --2- 172.21.15.96:0/89482256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae08101840 0x7fae081011a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:30.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.999+0000 7fae0d90d700 1 -- 172.21.15.96:0/89482256 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae040095f0 con 0x7fae08104170 2024-02-19T19:02:30.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.999+0000 7fae0e10e700 1 --2- 172.21.15.96:0/89482256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae08101840 0x7fae081011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:02:30.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.999+0000 7fae0d90d700 1 --2- 172.21.15.96:0/89482256 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae08104170 0x7fae080ff7f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fae04006010 tx=0x7fae0400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:30.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.999+0000 7fadfb7fe700 1 -- 172.21.15.96:0/89482256 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae0401d070 con 0x7fae08104170 2024-02-19T19:02:30.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.999+0000 7fadfb7fe700 1 -- 172.21.15.96:0/89482256 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fae0400f460 con 0x7fae08104170 2024-02-19T19:02:30.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.999+0000 7fae10372700 1 -- 172.21.15.96:0/89482256 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae080ffd30 con 0x7fae08104170 2024-02-19T19:02:30.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.999+0000 7fadfb7fe700 1 -- 172.21.15.96:0/89482256 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae04021640 con 0x7fae08104170 2024-02-19T19:02:30.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:29.999+0000 7fae10372700 1 -- 172.21.15.96:0/89482256 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae081001f0 con 0x7fae08104170 2024-02-19T19:02:30.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:30.000+0000 7fae10372700 1 -- 172.21.15.96:0/89482256 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae081906a0 con 0x7fae08104170 2024-02-19T19:02:30.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:30.000+0000 7fadfb7fe700 1 -- 172.21.15.96:0/89482256 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fae0400fab0 con 0x7fae08104170 2024-02-19T19:02:30.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:30.001+0000 7fadfb7fe700 1 --2- 172.21.15.96:0/89482256 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fadf406c4e0 0x7fadf406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:02:30.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:30.001+0000 7fadfb7fe700 1 -- 172.21.15.96:0/89482256 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fae0408cd10 con 0x7fae08104170 2024-02-19T19:02:30.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:30.001+0000 7fae0e10e700 1 --2- 172.21.15.96:0/89482256 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fadf406c4e0 0x7fadf406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:02:30.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:30.001+0000 7fae0e10e700 1 --2- 172.21.15.96:0/89482256 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fadf406c4e0 0x7fadf406e9a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fadfc007900 tx=0x7fadfc008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:02:30.024 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:30.005+0000 7fadfb7fe700 1 -- 172.21.15.96:0/89482256 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fae0405b040 con 0x7fae08104170 2024-02-19T19:02:30.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:30.223+0000 7fae10372700 1 -- 172.21.15.96:0/89482256 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fae0802cde0 con 0x7fadf406c4e0 2024-02-19T19:02:31.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:30 smithi125 ceph-mon[37556]: pgmap v200: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 4 op/s 2024-02-19T19:02:31.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:30 smithi125 ceph-mon[37556]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:02:31.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:30 smithi096 ceph-mon[29216]: pgmap v200: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 4 op/s 2024-02-19T19:02:31.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:30 smithi096 ceph-mon[29216]: from='client.14560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:02:33.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:32 smithi125 ceph-mon[37556]: pgmap v201: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-02-19T19:02:33.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:32 smithi096 ceph-mon[29216]: pgmap v201: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-02-19T19:02:35.196 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:34 smithi096 ceph-mon[29216]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s rd, 853 B/s wr, 4 op/s 2024-02-19T19:02:35.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:34 smithi125 ceph-mon[37556]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s rd, 853 B/s wr, 4 op/s 2024-02-19T19:02:36.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:36 smithi125 ceph-mon[37556]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-19T19:02:36.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:36 smithi096 ceph-mon[29216]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-19T19:02:39.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:38 smithi125 ceph-mon[37556]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2024-02-19T19:02:39.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:38 smithi096 ceph-mon[29216]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2024-02-19T19:02:41.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:40 smithi125 ceph-mon[37556]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:02:41.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:40 smithi096 ceph-mon[29216]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:02:43.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:42 smithi125 ceph-mon[37556]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:02:43.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:42 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:02:43.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:42 smithi096 ceph-mon[29216]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:02:43.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:42 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:02:45.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:44 smithi125 ceph-mon[37556]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:02:45.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:44 smithi096 ceph-mon[29216]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:02:46.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:46 smithi125 ceph-mon[37556]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:02:46.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:46 smithi096 ceph-mon[29216]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:02:49.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:48 smithi125 ceph-mon[37556]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:02:49.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:48 smithi096 ceph-mon[29216]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:02:51.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:50 smithi125 ceph-mon[37556]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:02:51.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:50 smithi096 ceph-mon[29216]: pgmap v210: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:02:53.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:52 smithi125 ceph-mon[37556]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:02:53.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:52 smithi096 ceph-mon[29216]: pgmap v211: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:02:55.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:54 smithi125 ceph-mon[37556]: pgmap v212: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:02:55.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:54 smithi096 ceph-mon[29216]: pgmap v212: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:02:56.599 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:56 smithi096 ceph-mon[29216]: pgmap v213: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:02:56.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:56 smithi125 ceph-mon[37556]: pgmap v213: 65 pgs: 65 active+clean; 586 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:02:57.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:57.579+0000 7fadfb7fe700 1 -- 172.21.15.96:0/89482256 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fae0802cde0 con 0x7fadf406c4e0 2024-02-19T19:02:57.599 INFO:teuthology.orchestra.run.smithi096.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T19:02:57.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:57.581+0000 7fae10372700 1 -- 172.21.15.96:0/89482256 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fadf406c4e0 msgr2=0x7fadf406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:57.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:57.581+0000 7fae10372700 1 --2- 172.21.15.96:0/89482256 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fadf406c4e0 0x7fadf406e9a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fadfc007900 tx=0x7fadfc008040 comp rx=0 tx=0).stop 2024-02-19T19:02:57.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:57.581+0000 7fae10372700 1 -- 172.21.15.96:0/89482256 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae08104170 msgr2=0x7fae080ff7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:02:57.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:57.581+0000 7fae10372700 1 --2- 172.21.15.96:0/89482256 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae08104170 0x7fae080ff7f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fae04006010 tx=0x7fae0400be20 comp rx=0 tx=0).stop 2024-02-19T19:02:57.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:57.581+0000 7fae10372700 1 -- 172.21.15.96:0/89482256 shutdown_connections 2024-02-19T19:02:57.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:57.581+0000 7fae10372700 1 --2- 172.21.15.96:0/89482256 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fadf406c4e0 0x7fadf406e9a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:57.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:57.581+0000 7fae10372700 1 --2- 172.21.15.96:0/89482256 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fae08101840 0x7fae081011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:57.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:57.581+0000 7fae10372700 1 --2- 172.21.15.96:0/89482256 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fae08104170 0x7fae080ff7f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:02:57.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:57.581+0000 7fae10372700 1 -- 172.21.15.96:0/89482256 >> 172.21.15.96:0/89482256 conn(0x7fae080fb190 msgr2=0x7fae080fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:02:57.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:57.581+0000 7fae10372700 1 -- 172.21.15.96:0/89482256 shutdown_connections 2024-02-19T19:02:57.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:02:57.581+0000 7fae10372700 1 -- 172.21.15.96:0/89482256 wait complete. 2024-02-19T19:02:58.378 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-02-19T19:02:58.614 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:02:58.738 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:58 smithi096 ceph-mon[29216]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T19:02:58.738 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:58 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:02:58.738 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:58 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:02:58.738 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:58 smithi096 ceph-mon[29216]: pgmap v214: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-19T19:02:58.738 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:58 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:02:58.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:58 smithi125 ceph-mon[37556]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T19:02:58.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:58 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:02:58.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:58 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:02:58.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:58 smithi125 ceph-mon[37556]: pgmap v214: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-19T19:02:58.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:58 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:02:59.932 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:59 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:02:59.932 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:59 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:02:59.933 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:59 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:02:59.933 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:02:59 smithi096 ceph-mon[29216]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T19:02:59.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:59 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:02:59.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:59 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:02:59.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:59 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:02:59.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:02:59 smithi125 ceph-mon[37556]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T19:03:00.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.445+0000 7f7ae6e74700 1 -- 172.21.15.96:0/2092729898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ae0100e10 msgr2=0x7f7ae0101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:00.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.445+0000 7f7ae6e74700 1 --2- 172.21.15.96:0/2092729898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ae0100e10 0x7f7ae0101270 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009910 tx=0x7f7acc009c20 comp rx=0 tx=0).stop 2024-02-19T19:03:00.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.445+0000 7f7ae6e74700 1 -- 172.21.15.96:0/2092729898 shutdown_connections 2024-02-19T19:03:00.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.445+0000 7f7ae6e74700 1 --2- 172.21.15.96:0/2092729898 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ae0100e10 0x7f7ae0101270 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:00.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.445+0000 7f7ae6e74700 1 --2- 172.21.15.96:0/2092729898 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae00ffc10 0x7f7ae0100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:00.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.445+0000 7f7ae6e74700 1 -- 172.21.15.96:0/2092729898 >> 172.21.15.96:0/2092729898 conn(0x7f7ae00fb190 msgr2=0x7f7ae00fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:00.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.445+0000 7f7ae6e74700 1 -- 172.21.15.96:0/2092729898 shutdown_connections 2024-02-19T19:03:00.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.445+0000 7f7ae6e74700 1 -- 172.21.15.96:0/2092729898 wait complete. 2024-02-19T19:03:00.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.446+0000 7f7ae6e74700 1 Processor -- start 2024-02-19T19:03:00.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.446+0000 7f7ae6e74700 1 -- start start 2024-02-19T19:03:00.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.446+0000 7f7ae6e74700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae00ffc10 0x7f7ae0196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:00.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.446+0000 7f7ae6e74700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ae0100e10 0x7f7ae0196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:00.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.446+0000 7f7ae6e74700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae0197080 con 0x7f7ae0100e10 2024-02-19T19:03:00.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.446+0000 7f7ae6e74700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae01971c0 con 0x7f7ae00ffc10 2024-02-19T19:03:00.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.446+0000 7f7adffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ae0100e10 0x7f7ae0196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:00.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.446+0000 7f7adffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ae0100e10 0x7f7ae0196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55604/0 (socket says 172.21.15.96:55604) 2024-02-19T19:03:00.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.446+0000 7f7adffff700 1 -- 172.21.15.96:0/892928258 learned_addr learned my addr 172.21.15.96:0/892928258 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:03:00.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.446+0000 7f7ae4c10700 1 --2- 172.21.15.96:0/892928258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae00ffc10 0x7f7ae0196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:00.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.446+0000 7f7adffff700 1 -- 172.21.15.96:0/892928258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae00ffc10 msgr2=0x7f7ae0196520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:00.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.446+0000 7f7adffff700 1 --2- 172.21.15.96:0/892928258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae00ffc10 0x7f7ae0196520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:00.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.446+0000 7f7adffff700 1 -- 172.21.15.96:0/892928258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc0095f0 con 0x7f7ae0100e10 2024-02-19T19:03:00.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.446+0000 7f7adffff700 1 --2- 172.21.15.96:0/892928258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ae0100e10 0x7f7ae0196a60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7acc006010 tx=0x7f7acc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:00.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.447+0000 7f7addffb700 1 -- 172.21.15.96:0/892928258 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7acc01d070 con 0x7f7ae0100e10 2024-02-19T19:03:00.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.447+0000 7f7addffb700 1 -- 172.21.15.96:0/892928258 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7acc00f460 con 0x7f7ae0100e10 2024-02-19T19:03:00.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.447+0000 7f7ae6e74700 1 -- 172.21.15.96:0/892928258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae019bc10 con 0x7f7ae0100e10 2024-02-19T19:03:00.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.447+0000 7f7addffb700 1 -- 172.21.15.96:0/892928258 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7acc021640 con 0x7f7ae0100e10 2024-02-19T19:03:00.468 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.447+0000 7f7ae6e74700 1 -- 172.21.15.96:0/892928258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae019c100 con 0x7f7ae0100e10 2024-02-19T19:03:00.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.448+0000 7f7ae6e74700 1 -- 172.21.15.96:0/892928258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae01087a0 con 0x7f7ae0100e10 2024-02-19T19:03:00.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.448+0000 7f7addffb700 1 -- 172.21.15.96:0/892928258 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f7acc00fab0 con 0x7f7ae0100e10 2024-02-19T19:03:00.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.449+0000 7f7addffb700 1 --2- 172.21.15.96:0/892928258 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f7ad006c4e0 0x7f7ad006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:00.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.449+0000 7f7addffb700 1 -- 172.21.15.96:0/892928258 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f7acc08cca0 con 0x7f7ae0100e10 2024-02-19T19:03:00.469 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.449+0000 7f7ae4c10700 1 --2- 172.21.15.96:0/892928258 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f7ad006c4e0 0x7f7ad006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:00.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.449+0000 7f7ae4c10700 1 --2- 172.21.15.96:0/892928258 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f7ad006c4e0 0x7f7ad006e9a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4006fd0 tx=0x7f7ad4008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:00.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.454+0000 7f7addffb700 1 -- 172.21.15.96:0/892928258 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f7acc091070 con 0x7f7ae0100e10 2024-02-19T19:03:00.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.690+0000 7f7ae6e74700 1 -- 172.21.15.96:0/892928258 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ae0068c90 con 0x7f7ad006c4e0 2024-02-19T19:03:00.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.691+0000 7f7addffb700 1 -- 172.21.15.96:0/892928258 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f7ae0068c90 con 0x7f7ad006c4e0 2024-02-19T19:03:00.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.693+0000 7f7ae6e74700 1 -- 172.21.15.96:0/892928258 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f7ad006c4e0 msgr2=0x7f7ad006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:00.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.693+0000 7f7ae6e74700 1 --2- 172.21.15.96:0/892928258 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f7ad006c4e0 0x7f7ad006e9a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4006fd0 tx=0x7f7ad4008040 comp rx=0 tx=0).stop 2024-02-19T19:03:00.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.693+0000 7f7ae6e74700 1 -- 172.21.15.96:0/892928258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ae0100e10 msgr2=0x7f7ae0196a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:00.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.693+0000 7f7ae6e74700 1 --2- 172.21.15.96:0/892928258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ae0100e10 0x7f7ae0196a60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7acc006010 tx=0x7f7acc00be20 comp rx=0 tx=0).stop 2024-02-19T19:03:00.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.693+0000 7f7ae6e74700 1 -- 172.21.15.96:0/892928258 shutdown_connections 2024-02-19T19:03:00.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.693+0000 7f7ae6e74700 1 --2- 172.21.15.96:0/892928258 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f7ad006c4e0 0x7f7ad006e9a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:00.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.693+0000 7f7ae6e74700 1 --2- 172.21.15.96:0/892928258 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ae00ffc10 0x7f7ae0196520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:00.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.693+0000 7f7ae6e74700 1 --2- 172.21.15.96:0/892928258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ae0100e10 0x7f7ae0196a60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:00.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.693+0000 7f7ae6e74700 1 -- 172.21.15.96:0/892928258 >> 172.21.15.96:0/892928258 conn(0x7f7ae00fb190 msgr2=0x7f7ae0068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:00.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.694+0000 7f7ae6e74700 1 -- 172.21.15.96:0/892928258 shutdown_connections 2024-02-19T19:03:00.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.694+0000 7f7ae6e74700 1 -- 172.21.15.96:0/892928258 wait complete. 2024-02-19T19:03:00.724 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:03:00.798 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:00 smithi096 ceph-mon[29216]: pgmap v215: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-19T19:03:00.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.805+0000 7f184e01f700 1 -- 172.21.15.96:0/1783308579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1848101840 msgr2=0x7f1848103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:00.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.805+0000 7f184e01f700 1 --2- 172.21.15.96:0/1783308579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1848101840 0x7f1848103c30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1838009910 tx=0x7f1838009c20 comp rx=0 tx=0).stop 2024-02-19T19:03:00.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.805+0000 7f184e01f700 1 -- 172.21.15.96:0/1783308579 shutdown_connections 2024-02-19T19:03:00.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.805+0000 7f184e01f700 1 --2- 172.21.15.96:0/1783308579 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1848104170 0x7f1848106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:00.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.805+0000 7f184e01f700 1 --2- 172.21.15.96:0/1783308579 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1848101840 0x7f1848103c30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:00.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.805+0000 7f184e01f700 1 -- 172.21.15.96:0/1783308579 >> 172.21.15.96:0/1783308579 conn(0x7f18480fb190 msgr2=0x7f18480fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:00.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.805+0000 7f184e01f700 1 -- 172.21.15.96:0/1783308579 shutdown_connections 2024-02-19T19:03:00.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.806+0000 7f184e01f700 1 -- 172.21.15.96:0/1783308579 wait complete. 2024-02-19T19:03:00.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.806+0000 7f184e01f700 1 Processor -- start 2024-02-19T19:03:00.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.806+0000 7f184e01f700 1 -- start start 2024-02-19T19:03:00.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.806+0000 7f184e01f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1848101840 0x7f1848196500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:00.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.806+0000 7f184e01f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1848104170 0x7f1848196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:00.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.806+0000 7f184e01f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1848197060 con 0x7f1848101840 2024-02-19T19:03:00.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.806+0000 7f184e01f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18481971a0 con 0x7f1848104170 2024-02-19T19:03:00.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.807+0000 7f18477fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1848101840 0x7f1848196500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:00.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.807+0000 7f18477fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1848101840 0x7f1848196500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55628/0 (socket says 172.21.15.96:55628) 2024-02-19T19:03:00.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.807+0000 7f18477fe700 1 -- 172.21.15.96:0/4074315978 learned_addr learned my addr 172.21.15.96:0/4074315978 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:03:00.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.807+0000 7f1846ffd700 1 --2- 172.21.15.96:0/4074315978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1848104170 0x7f1848196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:00.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.807+0000 7f18477fe700 1 -- 172.21.15.96:0/4074315978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1848104170 msgr2=0x7f1848196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:00.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.807+0000 7f18477fe700 1 --2- 172.21.15.96:0/4074315978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1848104170 0x7f1848196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:00.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.807+0000 7f18477fe700 1 -- 172.21.15.96:0/4074315978 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18380095f0 con 0x7f1848101840 2024-02-19T19:03:00.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.807+0000 7f18477fe700 1 --2- 172.21.15.96:0/4074315978 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1848101840 0x7f1848196500 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1838006010 tx=0x7f183800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:00.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.807+0000 7f1844ff9700 1 -- 172.21.15.96:0/4074315978 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f183801d070 con 0x7f1848101840 2024-02-19T19:03:00.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.807+0000 7f184e01f700 1 -- 172.21.15.96:0/4074315978 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f184819bbf0 con 0x7f1848101840 2024-02-19T19:03:00.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.807+0000 7f1844ff9700 1 -- 172.21.15.96:0/4074315978 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f183800f460 con 0x7f1848101840 2024-02-19T19:03:00.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.807+0000 7f1844ff9700 1 -- 172.21.15.96:0/4074315978 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1838021640 con 0x7f1848101840 2024-02-19T19:03:00.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.808+0000 7f184e01f700 1 -- 172.21.15.96:0/4074315978 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18480ff630 con 0x7f1848101840 2024-02-19T19:03:00.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.809+0000 7f184e01f700 1 -- 172.21.15.96:0/4074315978 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18481906a0 con 0x7f1848101840 2024-02-19T19:03:00.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.810+0000 7f1844ff9700 1 -- 172.21.15.96:0/4074315978 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f183800fab0 con 0x7f1848101840 2024-02-19T19:03:00.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.810+0000 7f1844ff9700 1 --2- 172.21.15.96:0/4074315978 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f183006c4e0 0x7f183006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:00.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.810+0000 7f1844ff9700 1 -- 172.21.15.96:0/4074315978 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f183808cc50 con 0x7f1848101840 2024-02-19T19:03:00.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.810+0000 7f1846ffd700 1 --2- 172.21.15.96:0/4074315978 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f183006c4e0 0x7f183006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:00.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.811+0000 7f1846ffd700 1 --2- 172.21.15.96:0/4074315978 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f183006c4e0 0x7f183006e9a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f183c009a10 tx=0x7f183c009190 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:00.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:00.815+0000 7f1844ff9700 1 -- 172.21.15.96:0/4074315978 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f183805ae60 con 0x7f1848101840 2024-02-19T19:03:00.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:00 smithi125 ceph-mon[37556]: pgmap v215: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-19T19:03:01.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.042+0000 7f184e01f700 1 -- 172.21.15.96:0/4074315978 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f18480611d0 con 0x7f183006c4e0 2024-02-19T19:03:01.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.044+0000 7f1844ff9700 1 -- 172.21.15.96:0/4074315978 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f18480611d0 con 0x7f183006c4e0 2024-02-19T19:03:01.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.046+0000 7f184e01f700 1 -- 172.21.15.96:0/4074315978 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f183006c4e0 msgr2=0x7f183006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:01.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.046+0000 7f184e01f700 1 --2- 172.21.15.96:0/4074315978 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f183006c4e0 0x7f183006e9a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f183c009a10 tx=0x7f183c009190 comp rx=0 tx=0).stop 2024-02-19T19:03:01.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.046+0000 7f184e01f700 1 -- 172.21.15.96:0/4074315978 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1848101840 msgr2=0x7f1848196500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:01.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.046+0000 7f184e01f700 1 --2- 172.21.15.96:0/4074315978 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1848101840 0x7f1848196500 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1838006010 tx=0x7f183800bd70 comp rx=0 tx=0).stop 2024-02-19T19:03:01.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.046+0000 7f184e01f700 1 -- 172.21.15.96:0/4074315978 shutdown_connections 2024-02-19T19:03:01.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.046+0000 7f184e01f700 1 --2- 172.21.15.96:0/4074315978 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f183006c4e0 0x7f183006e9a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.046+0000 7f184e01f700 1 --2- 172.21.15.96:0/4074315978 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1848101840 0x7f1848196500 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.046+0000 7f184e01f700 1 --2- 172.21.15.96:0/4074315978 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1848104170 0x7f1848196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.046+0000 7f184e01f700 1 -- 172.21.15.96:0/4074315978 >> 172.21.15.96:0/4074315978 conn(0x7f18480fb190 msgr2=0x7f18480fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:01.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.046+0000 7f184e01f700 1 -- 172.21.15.96:0/4074315978 shutdown_connections 2024-02-19T19:03:01.066 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.046+0000 7f184e01f700 1 -- 172.21.15.96:0/4074315978 wait complete. 2024-02-19T19:03:01.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.159+0000 7f6f45eb1700 1 -- 172.21.15.96:0/3051092183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f400ff530 msgr2=0x7f6f40101960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:01.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.159+0000 7f6f45eb1700 1 --2- 172.21.15.96:0/3051092183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f400ff530 0x7f6f40101960 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009910 tx=0x7f6f38009c20 comp rx=0 tx=0).stop 2024-02-19T19:03:01.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.159+0000 7f6f45eb1700 1 -- 172.21.15.96:0/3051092183 shutdown_connections 2024-02-19T19:03:01.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.159+0000 7f6f45eb1700 1 --2- 172.21.15.96:0/3051092183 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f40101ea0 0x7f6f40104330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.159+0000 7f6f45eb1700 1 --2- 172.21.15.96:0/3051092183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f400ff530 0x7f6f40101960 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.159+0000 7f6f45eb1700 1 -- 172.21.15.96:0/3051092183 >> 172.21.15.96:0/3051092183 conn(0x7f6f400fb150 msgr2=0x7f6f400fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:01.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.159+0000 7f6f45eb1700 1 -- 172.21.15.96:0/3051092183 shutdown_connections 2024-02-19T19:03:01.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.159+0000 7f6f45eb1700 1 -- 172.21.15.96:0/3051092183 wait complete. 2024-02-19T19:03:01.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.160+0000 7f6f45eb1700 1 Processor -- start 2024-02-19T19:03:01.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.160+0000 7f6f45eb1700 1 -- start start 2024-02-19T19:03:01.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.160+0000 7f6f45eb1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f400ff530 0x7f6f4019caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:01.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.160+0000 7f6f45eb1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f40101ea0 0x7f6f4019cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:01.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.160+0000 7f6f45eb1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4019d600 con 0x7f6f40101ea0 2024-02-19T19:03:01.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.160+0000 7f6f45eb1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4019d740 con 0x7f6f400ff530 2024-02-19T19:03:01.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.160+0000 7f6f3effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f40101ea0 0x7f6f4019cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:01.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.160+0000 7f6f3effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f40101ea0 0x7f6f4019cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55644/0 (socket says 172.21.15.96:55644) 2024-02-19T19:03:01.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.160+0000 7f6f3effd700 1 -- 172.21.15.96:0/1497663678 learned_addr learned my addr 172.21.15.96:0/1497663678 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:03:01.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.161+0000 7f6f3f7fe700 1 --2- 172.21.15.96:0/1497663678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f400ff530 0x7f6f4019caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:01.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.161+0000 7f6f3effd700 1 -- 172.21.15.96:0/1497663678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f400ff530 msgr2=0x7f6f4019caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:01.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.161+0000 7f6f3effd700 1 --2- 172.21.15.96:0/1497663678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f400ff530 0x7f6f4019caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.161+0000 7f6f3effd700 1 -- 172.21.15.96:0/1497663678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f380095f0 con 0x7f6f40101ea0 2024-02-19T19:03:01.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.161+0000 7f6f3effd700 1 --2- 172.21.15.96:0/1497663678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f40101ea0 0x7f6f4019cfe0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400e920 tx=0x7f6f3400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:01.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.161+0000 7f6f3cff9700 1 -- 172.21.15.96:0/1497663678 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f3400c9d0 con 0x7f6f40101ea0 2024-02-19T19:03:01.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.161+0000 7f6f3cff9700 1 -- 172.21.15.96:0/1497663678 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6f34010430 con 0x7f6f40101ea0 2024-02-19T19:03:01.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.161+0000 7f6f45eb1700 1 -- 172.21.15.96:0/1497663678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f401a21f0 con 0x7f6f40101ea0 2024-02-19T19:03:01.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.161+0000 7f6f3cff9700 1 -- 172.21.15.96:0/1497663678 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f34018650 con 0x7f6f40101ea0 2024-02-19T19:03:01.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.161+0000 7f6f45eb1700 1 -- 172.21.15.96:0/1497663678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f401a2740 con 0x7f6f40101ea0 2024-02-19T19:03:01.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.162+0000 7f6f45eb1700 1 -- 172.21.15.96:0/1497663678 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f40196c10 con 0x7f6f40101ea0 2024-02-19T19:03:01.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.163+0000 7f6f3cff9700 1 -- 172.21.15.96:0/1497663678 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f6f340105a0 con 0x7f6f40101ea0 2024-02-19T19:03:01.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.163+0000 7f6f3cff9700 1 --2- 172.21.15.96:0/1497663678 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f6f2806c4e0 0x7f6f2806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:01.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.163+0000 7f6f3cff9700 1 -- 172.21.15.96:0/1497663678 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f6f34014070 con 0x7f6f40101ea0 2024-02-19T19:03:01.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.163+0000 7f6f3f7fe700 1 --2- 172.21.15.96:0/1497663678 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f6f2806c4e0 0x7f6f2806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:01.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.164+0000 7f6f3f7fe700 1 --2- 172.21.15.96:0/1497663678 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f6f2806c4e0 0x7f6f2806e9a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009fd0 tx=0x7f6f38005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:01.187 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.168+0000 7f6f3cff9700 1 -- 172.21.15.96:0/1497663678 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f6f340520e0 con 0x7f6f40101ea0 2024-02-19T19:03:01.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.378+0000 7f6f45eb1700 1 -- 172.21.15.96:0/1497663678 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f400611d0 con 0x7f6f2806c4e0 2024-02-19T19:03:01.408 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.389+0000 7f6f3cff9700 1 -- 172.21.15.96:0/1497663678 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7f6f400611d0 con 0x7f6f2806c4e0 2024-02-19T19:03:01.408 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:03:01.409 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (5m) 50s ago 6m 25.2M - 0.25.0 c8568f914cd2 5dc55ac32e98 2024-02-19T19:03:01.409 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (7m) 50s ago 7m 7516k - 18.2.1 94eadd990e0a b41bff2e0043 2024-02-19T19:03:01.409 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (5m) 55s ago 5m 7314k - 18.2.1 94eadd990e0a 254ab7e7a040 2024-02-19T19:03:01.409 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (7m) 50s ago 7m 6660k - 18.2.1 94eadd990e0a 9250aadb9d78 2024-02-19T19:03:01.409 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (5m) 55s ago 5m 6665k - 18.2.1 94eadd990e0a b98ace7b5ded 2024-02-19T19:03:01.409 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (5m) 50s ago 6m 86.1M - 9.4.7 954c08fa6188 467f574356d5 2024-02-19T19:03:01.409 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (67s) 50s ago 67s 15.6M - 18.2.1 94eadd990e0a 0a61d9cd40d1 2024-02-19T19:03:01.409 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (74s) 50s ago 73s 11.7M - 18.2.1 94eadd990e0a 58db3e7a7d75 2024-02-19T19:03:01.409 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (65s) 55s ago 64s 16.8M - 18.2.1 94eadd990e0a 211d64de8a63 2024-02-19T19:03:01.409 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (71s) 55s ago 71s 16.0M - 18.2.1 94eadd990e0a 2a04b5a8eaf4 2024-02-19T19:03:01.409 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:9283,8765,8443 running (8m) 50s ago 8m 489M - 18.2.1 94eadd990e0a b062fd3d5963 2024-02-19T19:03:01.409 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (5m) 55s ago 5m 443M - 18.2.1 94eadd990e0a e6c5e0ac66e7 2024-02-19T19:03:01.409 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (8m) 50s ago 8m 46.3M 2048M 18.2.1 94eadd990e0a 23d5b9626c48 2024-02-19T19:03:01.409 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (5m) 55s ago 5m 38.1M 2048M 18.2.1 94eadd990e0a 27b4cad04cc5 2024-02-19T19:03:01.409 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (6m) 50s ago 6m 15.2M - 1.5.0 0da6a335fe13 97e9e93f8e15 2024-02-19T19:03:01.409 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (5m) 55s ago 5m 16.2M - 1.5.0 0da6a335fe13 fc1d96c078d9 2024-02-19T19:03:01.410 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4m) 50s ago 4m 48.7M 3946M 18.2.1 94eadd990e0a d5bbf07ad0e7 2024-02-19T19:03:01.410 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4m) 50s ago 4m 47.8M 3946M 18.2.1 94eadd990e0a 40329d59be45 2024-02-19T19:03:01.410 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3m) 50s ago 3m 46.0M 3946M 18.2.1 94eadd990e0a 4f1e49db2d41 2024-02-19T19:03:01.410 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (3m) 55s ago 3m 46.5M 4970M 18.2.1 94eadd990e0a 4746b79351fc 2024-02-19T19:03:01.410 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (3m) 55s ago 3m 46.7M 4970M 18.2.1 94eadd990e0a 2b3f0088f6b2 2024-02-19T19:03:01.410 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (2m) 55s ago 2m 43.4M 4970M 18.2.1 94eadd990e0a e5731974b46a 2024-02-19T19:03:01.410 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4m) 50s ago 6m 56.8M - 2.43.0 a07b618ecd1d e00101f00f57 2024-02-19T19:03:01.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.391+0000 7f6f45eb1700 1 -- 172.21.15.96:0/1497663678 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f6f2806c4e0 msgr2=0x7f6f2806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:01.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.391+0000 7f6f45eb1700 1 --2- 172.21.15.96:0/1497663678 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f6f2806c4e0 0x7f6f2806e9a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6f38009fd0 tx=0x7f6f38005fd0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.391+0000 7f6f45eb1700 1 -- 172.21.15.96:0/1497663678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f40101ea0 msgr2=0x7f6f4019cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:01.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.391+0000 7f6f45eb1700 1 --2- 172.21.15.96:0/1497663678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f40101ea0 0x7f6f4019cfe0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400e920 tx=0x7f6f3400ec30 comp rx=0 tx=0).stop 2024-02-19T19:03:01.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.391+0000 7f6f45eb1700 1 -- 172.21.15.96:0/1497663678 shutdown_connections 2024-02-19T19:03:01.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.391+0000 7f6f45eb1700 1 --2- 172.21.15.96:0/1497663678 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f6f2806c4e0 0x7f6f2806e9a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.391+0000 7f6f45eb1700 1 --2- 172.21.15.96:0/1497663678 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f400ff530 0x7f6f4019caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.391+0000 7f6f45eb1700 1 --2- 172.21.15.96:0/1497663678 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f40101ea0 0x7f6f4019cfe0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.391+0000 7f6f45eb1700 1 -- 172.21.15.96:0/1497663678 >> 172.21.15.96:0/1497663678 conn(0x7f6f400fb150 msgr2=0x7f6f400fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:01.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.391+0000 7f6f45eb1700 1 -- 172.21.15.96:0/1497663678 shutdown_connections 2024-02-19T19:03:01.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.391+0000 7f6f45eb1700 1 -- 172.21.15.96:0/1497663678 wait complete. 2024-02-19T19:03:01.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.498+0000 7faeb1d8e700 1 -- 172.21.15.96:0/381606800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faeac0ffc10 msgr2=0x7faeac100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:01.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.498+0000 7faeb1d8e700 1 --2- 172.21.15.96:0/381606800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faeac0ffc10 0x7faeac100030 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009910 tx=0x7fae9c009c20 comp rx=0 tx=0).stop 2024-02-19T19:03:01.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.498+0000 7faeb1d8e700 1 -- 172.21.15.96:0/381606800 shutdown_connections 2024-02-19T19:03:01.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.498+0000 7faeb1d8e700 1 --2- 172.21.15.96:0/381606800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeac100e10 0x7faeac101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.498+0000 7faeb1d8e700 1 --2- 172.21.15.96:0/381606800 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faeac0ffc10 0x7faeac100030 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.498+0000 7faeb1d8e700 1 -- 172.21.15.96:0/381606800 >> 172.21.15.96:0/381606800 conn(0x7faeac0fb190 msgr2=0x7faeac0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:01.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.498+0000 7faeb1d8e700 1 -- 172.21.15.96:0/381606800 shutdown_connections 2024-02-19T19:03:01.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.498+0000 7faeb1d8e700 1 -- 172.21.15.96:0/381606800 wait complete. 2024-02-19T19:03:01.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.498+0000 7faeb1d8e700 1 Processor -- start 2024-02-19T19:03:01.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.498+0000 7faeb1d8e700 1 -- start start 2024-02-19T19:03:01.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.499+0000 7faeb1d8e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeac0ffc10 0x7faeac1964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:01.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.499+0000 7faeb1d8e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faeac100e10 0x7faeac196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:01.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.499+0000 7faeb1d8e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac197030 con 0x7faeac100e10 2024-02-19T19:03:01.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.499+0000 7faeb1d8e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac197170 con 0x7faeac0ffc10 2024-02-19T19:03:01.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.499+0000 7faeaaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faeac100e10 0x7faeac196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:01.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.499+0000 7faeaaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faeac100e10 0x7faeac196a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55660/0 (socket says 172.21.15.96:55660) 2024-02-19T19:03:01.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.499+0000 7faeaaffd700 1 -- 172.21.15.96:0/521723471 learned_addr learned my addr 172.21.15.96:0/521723471 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:03:01.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.499+0000 7faeab7fe700 1 --2- 172.21.15.96:0/521723471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeac0ffc10 0x7faeac1964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:01.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.499+0000 7faeaaffd700 1 -- 172.21.15.96:0/521723471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeac0ffc10 msgr2=0x7faeac1964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:01.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.499+0000 7faeaaffd700 1 --2- 172.21.15.96:0/521723471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeac0ffc10 0x7faeac1964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.499+0000 7faeaaffd700 1 -- 172.21.15.96:0/521723471 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae9c0095f0 con 0x7faeac100e10 2024-02-19T19:03:01.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.499+0000 7faeaaffd700 1 --2- 172.21.15.96:0/521723471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faeac100e10 0x7faeac196a10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7faea000e920 tx=0x7faea000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:01.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.499+0000 7faea8ff9700 1 -- 172.21.15.96:0/521723471 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faea000c9d0 con 0x7faeac100e10 2024-02-19T19:03:01.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.499+0000 7faea8ff9700 1 -- 172.21.15.96:0/521723471 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faea0010430 con 0x7faeac100e10 2024-02-19T19:03:01.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.499+0000 7faea8ff9700 1 -- 172.21.15.96:0/521723471 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faea0018650 con 0x7faeac100e10 2024-02-19T19:03:01.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.499+0000 7faeb1d8e700 1 -- 172.21.15.96:0/521723471 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeac19bc20 con 0x7faeac100e10 2024-02-19T19:03:01.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.500+0000 7faeb1d8e700 1 -- 172.21.15.96:0/521723471 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeac19c120 con 0x7faeac100e10 2024-02-19T19:03:01.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.500+0000 7faeb1d8e700 1 -- 172.21.15.96:0/521723471 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeac108700 con 0x7faeac100e10 2024-02-19T19:03:01.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.501+0000 7faea8ff9700 1 -- 172.21.15.96:0/521723471 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7faea00105a0 con 0x7faeac100e10 2024-02-19T19:03:01.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.501+0000 7faea8ff9700 1 --2- 172.21.15.96:0/521723471 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fae9406c4e0 0x7fae9406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:01.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.502+0000 7faea8ff9700 1 -- 172.21.15.96:0/521723471 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7faea0014070 con 0x7faeac100e10 2024-02-19T19:03:01.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.502+0000 7faeab7fe700 1 --2- 172.21.15.96:0/521723471 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fae9406c4e0 0x7fae9406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:01.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.502+0000 7faeab7fe700 1 --2- 172.21.15.96:0/521723471 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fae9406c4e0 0x7fae9406e9a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00b6f0 tx=0x7fae9c005940 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:01.529 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.510+0000 7faea8ff9700 1 -- 172.21.15.96:0/521723471 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7faea00520e0 con 0x7faeac100e10 2024-02-19T19:03:01.721 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:01 smithi096 ceph-mon[29216]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:01.721 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:01 smithi096 ceph-mon[29216]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:01.812 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.793+0000 7faeb1d8e700 1 -- 172.21.15.96:0/521723471 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faeac1088f0 con 0x7faeac100e10 2024-02-19T19:03:01.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.794+0000 7faea8ff9700 1 -- 172.21.15.96:0/521723471 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7faea0059d50 con 0x7faeac100e10 2024-02-19T19:03:01.813 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:03:01.813 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:03:01.813 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-19T19:03:01.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:03:01.813 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:03:01.813 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-19T19:03:01.813 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:03:01.814 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:03:01.814 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-19T19:03:01.814 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:03:01.814 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:03:01.814 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-19T19:03:01.814 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:03:01.814 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:03:01.814 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 14 2024-02-19T19:03:01.814 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:03:01.814 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:03:01.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.796+0000 7faeb1d8e700 1 -- 172.21.15.96:0/521723471 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fae9406c4e0 msgr2=0x7fae9406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:01.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.796+0000 7faeb1d8e700 1 --2- 172.21.15.96:0/521723471 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fae9406c4e0 0x7fae9406e9a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00b6f0 tx=0x7fae9c005940 comp rx=0 tx=0).stop 2024-02-19T19:03:01.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.796+0000 7faeb1d8e700 1 -- 172.21.15.96:0/521723471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faeac100e10 msgr2=0x7faeac196a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:01.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.796+0000 7faeb1d8e700 1 --2- 172.21.15.96:0/521723471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faeac100e10 0x7faeac196a10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7faea000e920 tx=0x7faea000ec30 comp rx=0 tx=0).stop 2024-02-19T19:03:01.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.796+0000 7faeb1d8e700 1 -- 172.21.15.96:0/521723471 shutdown_connections 2024-02-19T19:03:01.815 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.796+0000 7faeb1d8e700 1 --2- 172.21.15.96:0/521723471 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fae9406c4e0 0x7fae9406e9a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.796+0000 7faeb1d8e700 1 --2- 172.21.15.96:0/521723471 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faeac0ffc10 0x7faeac1964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.796+0000 7faeb1d8e700 1 --2- 172.21.15.96:0/521723471 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faeac100e10 0x7faeac196a10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.796+0000 7faeb1d8e700 1 -- 172.21.15.96:0/521723471 >> 172.21.15.96:0/521723471 conn(0x7faeac0fb190 msgr2=0x7faeac068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:01.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.796+0000 7faeb1d8e700 1 -- 172.21.15.96:0/521723471 shutdown_connections 2024-02-19T19:03:01.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.796+0000 7faeb1d8e700 1 -- 172.21.15.96:0/521723471 wait complete. 2024-02-19T19:03:01.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.903+0000 7fa8c2465700 1 -- 172.21.15.96:0/3262202505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8bc101800 msgr2=0x7fa8bc103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:01.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.903+0000 7fa8c2465700 1 --2- 172.21.15.96:0/3262202505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8bc101800 0x7fa8bc103bf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac009910 tx=0x7fa8ac009c20 comp rx=0 tx=0).stop 2024-02-19T19:03:01.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.903+0000 7fa8c2465700 1 -- 172.21.15.96:0/3262202505 shutdown_connections 2024-02-19T19:03:01.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.903+0000 7fa8c2465700 1 --2- 172.21.15.96:0/3262202505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8bc104130 0x7fa8bc106520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.903+0000 7fa8c2465700 1 --2- 172.21.15.96:0/3262202505 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8bc101800 0x7fa8bc103bf0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.903+0000 7fa8c2465700 1 -- 172.21.15.96:0/3262202505 >> 172.21.15.96:0/3262202505 conn(0x7fa8bc0fb190 msgr2=0x7fa8bc0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:01.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.903+0000 7fa8c2465700 1 -- 172.21.15.96:0/3262202505 shutdown_connections 2024-02-19T19:03:01.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.903+0000 7fa8c2465700 1 -- 172.21.15.96:0/3262202505 wait complete. 2024-02-19T19:03:01.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.904+0000 7fa8c2465700 1 Processor -- start 2024-02-19T19:03:01.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.904+0000 7fa8c2465700 1 -- start start 2024-02-19T19:03:01.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.904+0000 7fa8c2465700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8bc101800 0x7fa8bc1964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:01.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.904+0000 7fa8c2465700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8bc104130 0x7fa8bc196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:01.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.904+0000 7fa8c2465700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc197040 con 0x7fa8bc101800 2024-02-19T19:03:01.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.904+0000 7fa8c2465700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc197180 con 0x7fa8bc104130 2024-02-19T19:03:01.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.904+0000 7fa8bbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8bc101800 0x7fa8bc1964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:01.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.904+0000 7fa8bbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8bc101800 0x7fa8bc1964e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55678/0 (socket says 172.21.15.96:55678) 2024-02-19T19:03:01.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.904+0000 7fa8bbfff700 1 -- 172.21.15.96:0/3268233158 learned_addr learned my addr 172.21.15.96:0/3268233158 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:03:01.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.904+0000 7fa8bb7fe700 1 --2- 172.21.15.96:0/3268233158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8bc104130 0x7fa8bc196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:01.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.905+0000 7fa8bbfff700 1 -- 172.21.15.96:0/3268233158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8bc104130 msgr2=0x7fa8bc196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:01.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.905+0000 7fa8bbfff700 1 --2- 172.21.15.96:0/3268233158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8bc104130 0x7fa8bc196a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:01.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.905+0000 7fa8bbfff700 1 -- 172.21.15.96:0/3268233158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac0095f0 con 0x7fa8bc101800 2024-02-19T19:03:01.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.905+0000 7fa8bbfff700 1 --2- 172.21.15.96:0/3268233158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8bc101800 0x7fa8bc1964e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00bd70 tx=0x7fa8ac00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:01.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.905+0000 7fa8b97fa700 1 -- 172.21.15.96:0/3268233158 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8ac01d070 con 0x7fa8bc101800 2024-02-19T19:03:01.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.905+0000 7fa8b97fa700 1 -- 172.21.15.96:0/3268233158 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa8ac005940 con 0x7fa8bc101800 2024-02-19T19:03:01.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.905+0000 7fa8b97fa700 1 -- 172.21.15.96:0/3268233158 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8ac021430 con 0x7fa8bc101800 2024-02-19T19:03:01.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.905+0000 7fa8c2465700 1 -- 172.21.15.96:0/3268233158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8bc19bbd0 con 0x7fa8bc101800 2024-02-19T19:03:01.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.905+0000 7fa8c2465700 1 -- 172.21.15.96:0/3268233158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8bc19c0c0 con 0x7fa8bc101800 2024-02-19T19:03:01.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.906+0000 7fa8c2465700 1 -- 172.21.15.96:0/3268233158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8bc190690 con 0x7fa8bc101800 2024-02-19T19:03:01.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.907+0000 7fa8b97fa700 1 -- 172.21.15.96:0/3268233158 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fa8ac00f860 con 0x7fa8bc101800 2024-02-19T19:03:01.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.907+0000 7fa8b97fa700 1 --2- 172.21.15.96:0/3268233158 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fa8a406c4e0 0x7fa8a406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:01.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.907+0000 7fa8b97fa700 1 -- 172.21.15.96:0/3268233158 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa8ac08cc80 con 0x7fa8bc101800 2024-02-19T19:03:01.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.907+0000 7fa8bb7fe700 1 --2- 172.21.15.96:0/3268233158 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fa8a406c4e0 0x7fa8a406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:01.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.908+0000 7fa8bb7fe700 1 --2- 172.21.15.96:0/3268233158 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fa8a406c4e0 0x7fa8a406e9a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009a10 tx=0x7fa8b0009190 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:01.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:01.912+0000 7fa8b97fa700 1 -- 172.21.15.96:0/3268233158 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa8ac05ae90 con 0x7fa8bc101800 2024-02-19T19:03:01.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:01 smithi125 ceph-mon[37556]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:01.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:01 smithi125 ceph-mon[37556]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:02.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:02.126+0000 7fa8c2465700 1 -- 172.21.15.96:0/3268233158 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8bc0611d0 con 0x7fa8a406c4e0 2024-02-19T19:03:02.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:02.128+0000 7fa8b97fa700 1 -- 172.21.15.96:0/3268233158 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fa8bc0611d0 con 0x7fa8a406c4e0 2024-02-19T19:03:02.147 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:03:02.147 INFO:teuthology.orchestra.run.smithi096.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:03:02.147 INFO:teuthology.orchestra.run.smithi096.stdout: "in_progress": true, 2024-02-19T19:03:02.147 INFO:teuthology.orchestra.run.smithi096.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-19T19:03:02.147 INFO:teuthology.orchestra.run.smithi096.stdout: "services_complete": [], 2024-02-19T19:03:02.147 INFO:teuthology.orchestra.run.smithi096.stdout: "progress": "0/2 daemons upgraded", 2024-02-19T19:03:02.147 INFO:teuthology.orchestra.run.smithi096.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 image on host smithi125", 2024-02-19T19:03:02.147 INFO:teuthology.orchestra.run.smithi096.stdout: "is_paused": false 2024-02-19T19:03:02.147 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:03:02.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:02.130+0000 7fa8c2465700 1 -- 172.21.15.96:0/3268233158 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fa8a406c4e0 msgr2=0x7fa8a406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:02.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:02.130+0000 7fa8c2465700 1 --2- 172.21.15.96:0/3268233158 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fa8a406c4e0 0x7fa8a406e9a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0009a10 tx=0x7fa8b0009190 comp rx=0 tx=0).stop 2024-02-19T19:03:02.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:02.130+0000 7fa8c2465700 1 -- 172.21.15.96:0/3268233158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8bc101800 msgr2=0x7fa8bc1964e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:02.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:02.130+0000 7fa8c2465700 1 --2- 172.21.15.96:0/3268233158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8bc101800 0x7fa8bc1964e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00bd70 tx=0x7fa8ac00bda0 comp rx=0 tx=0).stop 2024-02-19T19:03:02.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:02.130+0000 7fa8c2465700 1 -- 172.21.15.96:0/3268233158 shutdown_connections 2024-02-19T19:03:02.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:02.130+0000 7fa8c2465700 1 --2- 172.21.15.96:0/3268233158 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fa8a406c4e0 0x7fa8a406e9a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:02.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:02.130+0000 7fa8c2465700 1 --2- 172.21.15.96:0/3268233158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa8bc101800 0x7fa8bc1964e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:02.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:02.130+0000 7fa8c2465700 1 --2- 172.21.15.96:0/3268233158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8bc104130 0x7fa8bc196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:02.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:02.130+0000 7fa8c2465700 1 -- 172.21.15.96:0/3268233158 >> 172.21.15.96:0/3268233158 conn(0x7fa8bc0fb190 msgr2=0x7fa8bc0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:02.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:02.130+0000 7fa8c2465700 1 -- 172.21.15.96:0/3268233158 shutdown_connections 2024-02-19T19:03:02.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:02.130+0000 7fa8c2465700 1 -- 172.21.15.96:0/3268233158 wait complete. 2024-02-19T19:03:03.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:02 smithi096 ceph-mon[29216]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:03.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:02 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:03.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:02 smithi096 ceph-mon[29216]: Upgrade: Target is version 19.0.0-1450-gf78a58c0 (unknown) 2024-02-19T19:03:03.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:02 smithi096 ceph-mon[29216]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, digests ['quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526'] 2024-02-19T19:03:03.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:02 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:03:03.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:02 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:03.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:02 smithi096 ceph-mon[29216]: Upgrade: Need to upgrade myself (mgr.smithi096.zsjdff) 2024-02-19T19:03:03.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:02 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/521723471' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:03.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:02 smithi096 ceph-mon[29216]: pgmap v216: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-02-19T19:03:03.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:02 smithi096 ceph-mon[29216]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 on smithi125 2024-02-19T19:03:03.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:02 smithi096 ceph-mon[29216]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:03.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:02 smithi125 ceph-mon[37556]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:03.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:02 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:03.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:02 smithi125 ceph-mon[37556]: Upgrade: Target is version 19.0.0-1450-gf78a58c0 (unknown) 2024-02-19T19:03:03.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:02 smithi125 ceph-mon[37556]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, digests ['quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526'] 2024-02-19T19:03:03.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:02 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:03:03.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:02 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:03.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:02 smithi125 ceph-mon[37556]: Upgrade: Need to upgrade myself (mgr.smithi096.zsjdff) 2024-02-19T19:03:03.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:02 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/521723471' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:03.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:02 smithi125 ceph-mon[37556]: pgmap v216: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-02-19T19:03:03.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:02 smithi125 ceph-mon[37556]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 on smithi125 2024-02-19T19:03:03.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:02 smithi125 ceph-mon[37556]: from='client.14580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:05.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:04 smithi125 ceph-mon[37556]: pgmap v217: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-02-19T19:03:05.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:04 smithi096 ceph-mon[29216]: pgmap v217: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-02-19T19:03:06.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:06 smithi125 ceph-mon[37556]: pgmap v218: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-02-19T19:03:06.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:06 smithi096 ceph-mon[29216]: pgmap v218: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-02-19T19:03:09.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:08 smithi125 ceph-mon[37556]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 682 B/s wr, 5 op/s 2024-02-19T19:03:09.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:08 smithi096 ceph-mon[29216]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 682 B/s wr, 5 op/s 2024-02-19T19:03:11.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:10 smithi125 ceph-mon[37556]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-02-19T19:03:11.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:10 smithi096 ceph-mon[29216]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 170 B/s wr, 4 op/s 2024-02-19T19:03:13.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:12 smithi125 ceph-mon[37556]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-02-19T19:03:13.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:12 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:03:13.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:12 smithi096 ceph-mon[29216]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 4 op/s 2024-02-19T19:03:13.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:12 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:03:15.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:14 smithi125 ceph-mon[37556]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2024-02-19T19:03:15.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:14 smithi096 ceph-mon[29216]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2024-02-19T19:03:16.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:16 smithi125 ceph-mon[37556]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 3 op/s 2024-02-19T19:03:16.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:16 smithi096 ceph-mon[29216]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 3 op/s 2024-02-19T19:03:19.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:18 smithi125 ceph-mon[37556]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2024-02-19T19:03:19.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:18 smithi096 ceph-mon[29216]: pgmap v224: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 85 B/s wr, 4 op/s 2024-02-19T19:03:21.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:20 smithi096 ceph-mon[29216]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:03:21.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:20 smithi125 ceph-mon[37556]: pgmap v225: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:03:23.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:22 smithi125 ceph-mon[37556]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:03:23.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:22 smithi096 ceph-mon[29216]: pgmap v226: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:03:25.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:24 smithi125 ceph-mon[37556]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:03:25.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:24 smithi096 ceph-mon[29216]: pgmap v227: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:03:26.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:26 smithi125 ceph-mon[37556]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:03:26.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:26 smithi096 ceph-mon[29216]: pgmap v228: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:03:28.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:27 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:03:28.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:27 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:03:29.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:28 smithi125 ceph-mon[37556]: pgmap v229: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:03:29.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:28 smithi096 ceph-mon[29216]: pgmap v229: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:03:31.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:30 smithi125 ceph-mon[37556]: pgmap v230: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:03:31.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:30 smithi096 ceph-mon[29216]: pgmap v230: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:03:32.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.249+0000 7f4ecca01700 1 -- 172.21.15.96:0/278709519 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ec80ffbc0 msgr2=0x7f4ec80fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:32.273 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.249+0000 7f4ecca01700 1 --2- 172.21.15.96:0/278709519 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ec80ffbc0 0x7f4ec80fffe0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4ec000b0a0 tx=0x7f4ec000b3b0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.249+0000 7f4ecca01700 1 -- 172.21.15.96:0/278709519 shutdown_connections 2024-02-19T19:03:32.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.249+0000 7f4ecca01700 1 --2- 172.21.15.96:0/278709519 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ec8100dc0 0x7f4ec8101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.249+0000 7f4ecca01700 1 --2- 172.21.15.96:0/278709519 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ec80ffbc0 0x7f4ec80fffe0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.249+0000 7f4ecca01700 1 -- 172.21.15.96:0/278709519 >> 172.21.15.96:0/278709519 conn(0x7f4ec80fb160 msgr2=0x7f4ec80fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:32.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.249+0000 7f4ecca01700 1 -- 172.21.15.96:0/278709519 shutdown_connections 2024-02-19T19:03:32.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.249+0000 7f4ecca01700 1 -- 172.21.15.96:0/278709519 wait complete. 2024-02-19T19:03:32.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.250+0000 7f4ecca01700 1 Processor -- start 2024-02-19T19:03:32.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.250+0000 7f4ecca01700 1 -- start start 2024-02-19T19:03:32.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.250+0000 7f4ecca01700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ec80ffbc0 0x7f4ec8198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:32.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.250+0000 7f4ecca01700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ec8100dc0 0x7f4ec8198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:32.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.250+0000 7f4ecca01700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec81995b0 con 0x7f4ec80ffbc0 2024-02-19T19:03:32.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.250+0000 7f4ecca01700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec81996f0 con 0x7f4ec8100dc0 2024-02-19T19:03:32.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.250+0000 7f4ec659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ec80ffbc0 0x7f4ec8198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.250+0000 7f4ec659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ec80ffbc0 0x7f4ec8198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52786/0 (socket says 172.21.15.96:52786) 2024-02-19T19:03:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.250+0000 7f4ec659c700 1 -- 172.21.15.96:0/744671128 learned_addr learned my addr 172.21.15.96:0/744671128 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:03:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.251+0000 7f4ec5d9b700 1 --2- 172.21.15.96:0/744671128 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ec8100dc0 0x7f4ec8198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.251+0000 7f4ec659c700 1 -- 172.21.15.96:0/744671128 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ec8100dc0 msgr2=0x7f4ec8198f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.251+0000 7f4ec659c700 1 --2- 172.21.15.96:0/744671128 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ec8100dc0 0x7f4ec8198f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.251+0000 7f4ec659c700 1 -- 172.21.15.96:0/744671128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec0009d00 con 0x7f4ec80ffbc0 2024-02-19T19:03:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.251+0000 7f4ec659c700 1 --2- 172.21.15.96:0/744671128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ec80ffbc0 0x7f4ec8198a50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0009fd0 tx=0x7f4ec00096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.251+0000 7f4ebf7fe700 1 -- 172.21.15.96:0/744671128 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ec000e040 con 0x7f4ec80ffbc0 2024-02-19T19:03:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.251+0000 7f4ecca01700 1 -- 172.21.15.96:0/744671128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec819e140 con 0x7f4ec80ffbc0 2024-02-19T19:03:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.251+0000 7f4ebf7fe700 1 -- 172.21.15.96:0/744671128 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4ec0003de0 con 0x7f4ec80ffbc0 2024-02-19T19:03:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.251+0000 7f4ebf7fe700 1 -- 172.21.15.96:0/744671128 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ec001d820 con 0x7f4ec80ffbc0 2024-02-19T19:03:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.251+0000 7f4ecca01700 1 -- 172.21.15.96:0/744671128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec819e630 con 0x7f4ec80ffbc0 2024-02-19T19:03:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.252+0000 7f4ecca01700 1 -- 172.21.15.96:0/744671128 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec8068af0 con 0x7f4ec80ffbc0 2024-02-19T19:03:32.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.253+0000 7f4ebf7fe700 1 -- 172.21.15.96:0/744671128 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f4ec00047f0 con 0x7f4ec80ffbc0 2024-02-19T19:03:32.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.253+0000 7f4ebf7fe700 1 --2- 172.21.15.96:0/744671128 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f4eb406c4e0 0x7f4eb406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:32.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.253+0000 7f4ebf7fe700 1 -- 172.21.15.96:0/744671128 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f4ec008dd40 con 0x7f4ec80ffbc0 2024-02-19T19:03:32.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.254+0000 7f4ec5d9b700 1 --2- 172.21.15.96:0/744671128 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f4eb406c4e0 0x7f4eb406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:32.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.254+0000 7f4ec5d9b700 1 --2- 172.21.15.96:0/744671128 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f4eb406c4e0 0x7f4eb406e9a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0007be0 tx=0x7f4eb00073d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:32.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.257+0000 7f4ebf7fe700 1 -- 172.21.15.96:0/744671128 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f4ec005bfd0 con 0x7f4ec80ffbc0 2024-02-19T19:03:32.490 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.471+0000 7f4ecca01700 1 -- 172.21.15.96:0/744671128 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4ec80695c0 con 0x7f4eb406c4e0 2024-02-19T19:03:32.491 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.472+0000 7f4ebf7fe700 1 -- 172.21.15.96:0/744671128 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f4ec80695c0 con 0x7f4eb406c4e0 2024-02-19T19:03:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.474+0000 7f4ecca01700 1 -- 172.21.15.96:0/744671128 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f4eb406c4e0 msgr2=0x7f4eb406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.474+0000 7f4ecca01700 1 --2- 172.21.15.96:0/744671128 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f4eb406c4e0 0x7f4eb406e9a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0007be0 tx=0x7f4eb00073d0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.474+0000 7f4ecca01700 1 -- 172.21.15.96:0/744671128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ec80ffbc0 msgr2=0x7f4ec8198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.474+0000 7f4ecca01700 1 --2- 172.21.15.96:0/744671128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ec80ffbc0 0x7f4ec8198a50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0009fd0 tx=0x7f4ec00096e0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.474+0000 7f4ecca01700 1 -- 172.21.15.96:0/744671128 shutdown_connections 2024-02-19T19:03:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.474+0000 7f4ecca01700 1 --2- 172.21.15.96:0/744671128 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f4eb406c4e0 0x7f4eb406e9a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.474+0000 7f4ecca01700 1 --2- 172.21.15.96:0/744671128 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4ec80ffbc0 0x7f4ec8198a50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.474+0000 7f4ecca01700 1 --2- 172.21.15.96:0/744671128 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ec8100dc0 0x7f4ec8198f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.474+0000 7f4ecca01700 1 -- 172.21.15.96:0/744671128 >> 172.21.15.96:0/744671128 conn(0x7f4ec80fb160 msgr2=0x7f4ec8068e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:32.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.474+0000 7f4ecca01700 1 -- 172.21.15.96:0/744671128 shutdown_connections 2024-02-19T19:03:32.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.474+0000 7f4ecca01700 1 -- 172.21.15.96:0/744671128 wait complete. 2024-02-19T19:03:32.504 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:03:32.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.581+0000 7fd0aedf2700 1 -- 172.21.15.96:0/115365011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0a8101800 msgr2=0x7fd0a8103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:32.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.581+0000 7fd0aedf2700 1 --2- 172.21.15.96:0/115365011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0a8101800 0x7fd0a8103bf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd090009910 tx=0x7fd090009c20 comp rx=0 tx=0).stop 2024-02-19T19:03:32.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.581+0000 7fd0aedf2700 1 -- 172.21.15.96:0/115365011 shutdown_connections 2024-02-19T19:03:32.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.581+0000 7fd0aedf2700 1 --2- 172.21.15.96:0/115365011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a8104130 0x7fd0a8106520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.581+0000 7fd0aedf2700 1 --2- 172.21.15.96:0/115365011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0a8101800 0x7fd0a8103bf0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.581+0000 7fd0aedf2700 1 -- 172.21.15.96:0/115365011 >> 172.21.15.96:0/115365011 conn(0x7fd0a80fb190 msgr2=0x7fd0a80fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:32.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.581+0000 7fd0aedf2700 1 -- 172.21.15.96:0/115365011 shutdown_connections 2024-02-19T19:03:32.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.581+0000 7fd0aedf2700 1 -- 172.21.15.96:0/115365011 wait complete. 2024-02-19T19:03:32.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.581+0000 7fd0aedf2700 1 Processor -- start 2024-02-19T19:03:32.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.581+0000 7fd0aedf2700 1 -- start start 2024-02-19T19:03:32.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.581+0000 7fd0aedf2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a8101800 0x7fd0a8196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:32.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.582+0000 7fd0aedf2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0a8104130 0x7fd0a81969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:32.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.582+0000 7fd0aedf2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a8196fe0 con 0x7fd0a8104130 2024-02-19T19:03:32.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.582+0000 7fd0aedf2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a8197120 con 0x7fd0a8101800 2024-02-19T19:03:32.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.582+0000 7fd0a7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0a8104130 0x7fd0a81969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:32.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.582+0000 7fd0a7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0a8104130 0x7fd0a81969c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52810/0 (socket says 172.21.15.96:52810) 2024-02-19T19:03:32.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.582+0000 7fd0a7fff700 1 -- 172.21.15.96:0/1135292880 learned_addr learned my addr 172.21.15.96:0/1135292880 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:03:32.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.582+0000 7fd0acb8e700 1 --2- 172.21.15.96:0/1135292880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a8101800 0x7fd0a8196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:32.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.582+0000 7fd0a7fff700 1 -- 172.21.15.96:0/1135292880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a8101800 msgr2=0x7fd0a8196480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:32.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.582+0000 7fd0a7fff700 1 --2- 172.21.15.96:0/1135292880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a8101800 0x7fd0a8196480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.582+0000 7fd0a7fff700 1 -- 172.21.15.96:0/1135292880 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0900095f0 con 0x7fd0a8104130 2024-02-19T19:03:32.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.582+0000 7fd0a7fff700 1 --2- 172.21.15.96:0/1135292880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0a8104130 0x7fd0a81969c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd09800e920 tx=0x7fd09800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:32.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.582+0000 7fd0a5ffb700 1 -- 172.21.15.96:0/1135292880 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd09800c9d0 con 0x7fd0a8104130 2024-02-19T19:03:32.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.582+0000 7fd0a5ffb700 1 -- 172.21.15.96:0/1135292880 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd098010430 con 0x7fd0a8104130 2024-02-19T19:03:32.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.582+0000 7fd0aedf2700 1 -- 172.21.15.96:0/1135292880 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a819bbd0 con 0x7fd0a8104130 2024-02-19T19:03:32.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.582+0000 7fd0a5ffb700 1 -- 172.21.15.96:0/1135292880 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd098018650 con 0x7fd0a8104130 2024-02-19T19:03:32.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.583+0000 7fd0aedf2700 1 -- 172.21.15.96:0/1135292880 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a819c120 con 0x7fd0a8104130 2024-02-19T19:03:32.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.583+0000 7fd0aedf2700 1 -- 172.21.15.96:0/1135292880 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a8190610 con 0x7fd0a8104130 2024-02-19T19:03:32.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.584+0000 7fd0a5ffb700 1 -- 172.21.15.96:0/1135292880 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7fd0980105a0 con 0x7fd0a8104130 2024-02-19T19:03:32.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.584+0000 7fd0a5ffb700 1 --2- 172.21.15.96:0/1135292880 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd09406c4e0 0x7fd09406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:32.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.584+0000 7fd0a5ffb700 1 -- 172.21.15.96:0/1135292880 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd098014070 con 0x7fd0a8104130 2024-02-19T19:03:32.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.584+0000 7fd0acb8e700 1 --2- 172.21.15.96:0/1135292880 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd09406c4e0 0x7fd09406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:32.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.585+0000 7fd0acb8e700 1 --2- 172.21.15.96:0/1135292880 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd09406c4e0 0x7fd09406e9a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd090009fd0 tx=0x7fd090005940 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:32.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.589+0000 7fd0a5ffb700 1 -- 172.21.15.96:0/1135292880 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd0980520e0 con 0x7fd0a8104130 2024-02-19T19:03:32.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.799+0000 7fd0aedf2700 1 -- 172.21.15.96:0/1135292880 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0a80611d0 con 0x7fd09406c4e0 2024-02-19T19:03:32.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.800+0000 7fd0a5ffb700 1 -- 172.21.15.96:0/1135292880 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fd0a80611d0 con 0x7fd09406c4e0 2024-02-19T19:03:32.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.802+0000 7fd0aedf2700 1 -- 172.21.15.96:0/1135292880 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd09406c4e0 msgr2=0x7fd09406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:32.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.802+0000 7fd0aedf2700 1 --2- 172.21.15.96:0/1135292880 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd09406c4e0 0x7fd09406e9a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd090009fd0 tx=0x7fd090005940 comp rx=0 tx=0).stop 2024-02-19T19:03:32.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.802+0000 7fd0aedf2700 1 -- 172.21.15.96:0/1135292880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0a8104130 msgr2=0x7fd0a81969c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:32.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.802+0000 7fd0aedf2700 1 --2- 172.21.15.96:0/1135292880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0a8104130 0x7fd0a81969c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd09800e920 tx=0x7fd09800ec30 comp rx=0 tx=0).stop 2024-02-19T19:03:32.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.802+0000 7fd0aedf2700 1 -- 172.21.15.96:0/1135292880 shutdown_connections 2024-02-19T19:03:32.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.802+0000 7fd0aedf2700 1 --2- 172.21.15.96:0/1135292880 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7fd09406c4e0 0x7fd09406e9a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.802+0000 7fd0aedf2700 1 --2- 172.21.15.96:0/1135292880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a8101800 0x7fd0a8196480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.802+0000 7fd0aedf2700 1 --2- 172.21.15.96:0/1135292880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0a8104130 0x7fd0a81969c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.802+0000 7fd0aedf2700 1 -- 172.21.15.96:0/1135292880 >> 172.21.15.96:0/1135292880 conn(0x7fd0a80fb190 msgr2=0x7fd0a80fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:32.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.802+0000 7fd0aedf2700 1 -- 172.21.15.96:0/1135292880 shutdown_connections 2024-02-19T19:03:32.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.802+0000 7fd0aedf2700 1 -- 172.21.15.96:0/1135292880 wait complete. 2024-02-19T19:03:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.907+0000 7f57cb1f4700 1 -- 172.21.15.96:0/1311371449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c4100cb0 msgr2=0x7f57c41010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.907+0000 7f57cb1f4700 1 --2- 172.21.15.96:0/1311371449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c4100cb0 0x7f57c41010d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009910 tx=0x7f57b8009c20 comp rx=0 tx=0).stop 2024-02-19T19:03:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.907+0000 7f57cb1f4700 1 -- 172.21.15.96:0/1311371449 shutdown_connections 2024-02-19T19:03:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.907+0000 7f57cb1f4700 1 --2- 172.21.15.96:0/1311371449 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57c4101eb0 0x7f57c4102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.907+0000 7f57cb1f4700 1 --2- 172.21.15.96:0/1311371449 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c4100cb0 0x7f57c41010d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.907+0000 7f57cb1f4700 1 -- 172.21.15.96:0/1311371449 >> 172.21.15.96:0/1311371449 conn(0x7f57c40fc230 msgr2=0x7f57c40fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.907+0000 7f57cb1f4700 1 -- 172.21.15.96:0/1311371449 shutdown_connections 2024-02-19T19:03:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.907+0000 7f57cb1f4700 1 -- 172.21.15.96:0/1311371449 wait complete. 2024-02-19T19:03:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.907+0000 7f57cb1f4700 1 Processor -- start 2024-02-19T19:03:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.907+0000 7f57cb1f4700 1 -- start start 2024-02-19T19:03:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.908+0000 7f57cb1f4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c4100cb0 0x7f57c41964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.908+0000 7f57cb1f4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57c4101eb0 0x7f57c4196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.908+0000 7f57cb1f4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c4197050 con 0x7f57c4100cb0 2024-02-19T19:03:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.908+0000 7f57cb1f4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c4197190 con 0x7f57c4101eb0 2024-02-19T19:03:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.908+0000 7f57c8f90700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c4100cb0 0x7f57c41964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.908+0000 7f57c8f90700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c4100cb0 0x7f57c41964f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52834/0 (socket says 172.21.15.96:52834) 2024-02-19T19:03:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.908+0000 7f57c8f90700 1 -- 172.21.15.96:0/1950602217 learned_addr learned my addr 172.21.15.96:0/1950602217 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:03:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.908+0000 7f57c3fff700 1 --2- 172.21.15.96:0/1950602217 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57c4101eb0 0x7f57c4196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.908+0000 7f57c8f90700 1 -- 172.21.15.96:0/1950602217 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57c4101eb0 msgr2=0x7f57c4196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.908+0000 7f57c8f90700 1 --2- 172.21.15.96:0/1950602217 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57c4101eb0 0x7f57c4196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.908+0000 7f57c8f90700 1 -- 172.21.15.96:0/1950602217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b80095f0 con 0x7f57c4100cb0 2024-02-19T19:03:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.908+0000 7f57c8f90700 1 --2- 172.21.15.96:0/1950602217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c4100cb0 0x7f57c41964f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f57b800bda0 tx=0x7f57b800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.908+0000 7f57c1ffb700 1 -- 172.21.15.96:0/1950602217 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57b801d070 con 0x7f57c4100cb0 2024-02-19T19:03:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.908+0000 7f57c1ffb700 1 -- 172.21.15.96:0/1950602217 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f57b800f460 con 0x7f57c4100cb0 2024-02-19T19:03:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.908+0000 7f57cb1f4700 1 -- 172.21.15.96:0/1950602217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c419bbe0 con 0x7f57c4100cb0 2024-02-19T19:03:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.908+0000 7f57c1ffb700 1 -- 172.21.15.96:0/1950602217 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57b8021620 con 0x7f57c4100cb0 2024-02-19T19:03:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.909+0000 7f57cb1f4700 1 -- 172.21.15.96:0/1950602217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c419c0d0 con 0x7f57c4100cb0 2024-02-19T19:03:32.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.909+0000 7f57cb1f4700 1 -- 172.21.15.96:0/1950602217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c4109810 con 0x7f57c4100cb0 2024-02-19T19:03:32.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.910+0000 7f57c1ffb700 1 -- 172.21.15.96:0/1950602217 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f57b800f5d0 con 0x7f57c4100cb0 2024-02-19T19:03:32.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.910+0000 7f57c1ffb700 1 --2- 172.21.15.96:0/1950602217 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f57b406c4e0 0x7f57b406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:32.930 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.910+0000 7f57c1ffb700 1 -- 172.21.15.96:0/1950602217 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f57b808ca00 con 0x7f57c4100cb0 2024-02-19T19:03:32.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.910+0000 7f57c3fff700 1 --2- 172.21.15.96:0/1950602217 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f57b406c4e0 0x7f57b406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:32.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.911+0000 7f57c3fff700 1 --2- 172.21.15.96:0/1950602217 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f57b406c4e0 0x7f57b406e9a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f57b0005950 tx=0x7f57b000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:32.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:32.915+0000 7f57c1ffb700 1 -- 172.21.15.96:0/1950602217 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f57b805ac90 con 0x7f57c4100cb0 2024-02-19T19:03:33.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.115+0000 7f57cb1f4700 1 -- 172.21.15.96:0/1950602217 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f57c4106800 con 0x7f57b406c4e0 2024-02-19T19:03:33.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.125+0000 7f57c1ffb700 1 -- 172.21.15.96:0/1950602217 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3528 (secure 0 0 0) 0x7f57c4106800 con 0x7f57b406c4e0 2024-02-19T19:03:33.145 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:03:33.145 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (5m) 81s ago 7m 25.2M - 0.25.0 c8568f914cd2 5dc55ac32e98 2024-02-19T19:03:33.145 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (7m) 81s ago 7m 7516k - 18.2.1 94eadd990e0a b41bff2e0043 2024-02-19T19:03:33.145 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (6m) 86s ago 6m 7314k - 18.2.1 94eadd990e0a 254ab7e7a040 2024-02-19T19:03:33.145 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (7m) 81s ago 7m 6660k - 18.2.1 94eadd990e0a 9250aadb9d78 2024-02-19T19:03:33.145 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (6m) 86s ago 6m 6665k - 18.2.1 94eadd990e0a b98ace7b5ded 2024-02-19T19:03:33.145 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (5m) 81s ago 7m 86.1M - 9.4.7 954c08fa6188 467f574356d5 2024-02-19T19:03:33.145 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (99s) 81s ago 99s 15.6M - 18.2.1 94eadd990e0a 0a61d9cd40d1 2024-02-19T19:03:33.145 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (105s) 81s ago 105s 11.7M - 18.2.1 94eadd990e0a 58db3e7a7d75 2024-02-19T19:03:33.146 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (96s) 86s ago 96s 16.8M - 18.2.1 94eadd990e0a 211d64de8a63 2024-02-19T19:03:33.146 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (103s) 86s ago 102s 16.0M - 18.2.1 94eadd990e0a 2a04b5a8eaf4 2024-02-19T19:03:33.146 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:9283,8765,8443 running (8m) 81s ago 8m 489M - 18.2.1 94eadd990e0a b062fd3d5963 2024-02-19T19:03:33.146 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (6m) 86s ago 6m 443M - 18.2.1 94eadd990e0a e6c5e0ac66e7 2024-02-19T19:03:33.146 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (8m) 81s ago 9m 46.3M 2048M 18.2.1 94eadd990e0a 23d5b9626c48 2024-02-19T19:03:33.146 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (6m) 86s ago 6m 38.1M 2048M 18.2.1 94eadd990e0a 27b4cad04cc5 2024-02-19T19:03:33.146 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (7m) 81s ago 7m 15.2M - 1.5.0 0da6a335fe13 97e9e93f8e15 2024-02-19T19:03:33.146 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (6m) 86s ago 6m 16.2M - 1.5.0 0da6a335fe13 fc1d96c078d9 2024-02-19T19:03:33.146 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (5m) 81s ago 5m 48.7M 3946M 18.2.1 94eadd990e0a d5bbf07ad0e7 2024-02-19T19:03:33.146 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4m) 81s ago 4m 47.8M 3946M 18.2.1 94eadd990e0a 40329d59be45 2024-02-19T19:03:33.146 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4m) 81s ago 4m 46.0M 3946M 18.2.1 94eadd990e0a 4f1e49db2d41 2024-02-19T19:03:33.146 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (4m) 86s ago 4m 46.5M 4970M 18.2.1 94eadd990e0a 4746b79351fc 2024-02-19T19:03:33.146 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (3m) 86s ago 3m 46.7M 4970M 18.2.1 94eadd990e0a 2b3f0088f6b2 2024-02-19T19:03:33.146 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (3m) 86s ago 3m 43.4M 4970M 18.2.1 94eadd990e0a e5731974b46a 2024-02-19T19:03:33.146 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (5m) 81s ago 6m 56.8M - 2.43.0 a07b618ecd1d e00101f00f57 2024-02-19T19:03:33.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.127+0000 7f57cb1f4700 1 -- 172.21.15.96:0/1950602217 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f57b406c4e0 msgr2=0x7f57b406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:33.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.127+0000 7f57cb1f4700 1 --2- 172.21.15.96:0/1950602217 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f57b406c4e0 0x7f57b406e9a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f57b0005950 tx=0x7f57b000b410 comp rx=0 tx=0).stop 2024-02-19T19:03:33.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.127+0000 7f57cb1f4700 1 -- 172.21.15.96:0/1950602217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c4100cb0 msgr2=0x7f57c41964f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:33.147 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.127+0000 7f57cb1f4700 1 --2- 172.21.15.96:0/1950602217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c4100cb0 0x7f57c41964f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f57b800bda0 tx=0x7f57b800bdd0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.128+0000 7f57cb1f4700 1 -- 172.21.15.96:0/1950602217 shutdown_connections 2024-02-19T19:03:33.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.128+0000 7f57cb1f4700 1 --2- 172.21.15.96:0/1950602217 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f57b406c4e0 0x7f57b406e9a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.128+0000 7f57cb1f4700 1 --2- 172.21.15.96:0/1950602217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f57c4100cb0 0x7f57c41964f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.128+0000 7f57cb1f4700 1 --2- 172.21.15.96:0/1950602217 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57c4101eb0 0x7f57c4196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.128+0000 7f57cb1f4700 1 -- 172.21.15.96:0/1950602217 >> 172.21.15.96:0/1950602217 conn(0x7f57c40fc230 msgr2=0x7f57c41050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:33.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.128+0000 7f57cb1f4700 1 -- 172.21.15.96:0/1950602217 shutdown_connections 2024-02-19T19:03:33.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.128+0000 7f57cb1f4700 1 -- 172.21.15.96:0/1950602217 wait complete. 2024-02-19T19:03:33.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:32 smithi125 ceph-mon[37556]: pgmap v231: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:03:33.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.232+0000 7f736d601700 1 -- 172.21.15.96:0/2559869971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7368101d60 msgr2=0x7f73681021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:33.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.232+0000 7f736d601700 1 --2- 172.21.15.96:0/2559869971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7368101d60 0x7f73681021c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f735c009910 tx=0x7f735c009c20 comp rx=0 tx=0).stop 2024-02-19T19:03:33.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.232+0000 7f736d601700 1 -- 172.21.15.96:0/2559869971 shutdown_connections 2024-02-19T19:03:33.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.232+0000 7f736d601700 1 --2- 172.21.15.96:0/2559869971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7368101d60 0x7f73681021c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.232+0000 7f736d601700 1 --2- 172.21.15.96:0/2559869971 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f73680fed80 0x7f73680ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.232+0000 7f736d601700 1 -- 172.21.15.96:0/2559869971 >> 172.21.15.96:0/2559869971 conn(0x7f73680fa720 msgr2=0x7f73680fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:33.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.232+0000 7f736d601700 1 -- 172.21.15.96:0/2559869971 shutdown_connections 2024-02-19T19:03:33.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.232+0000 7f736d601700 1 -- 172.21.15.96:0/2559869971 wait complete. 2024-02-19T19:03:33.252 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:32 smithi096 ceph-mon[29216]: pgmap v231: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:03:33.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.233+0000 7f736d601700 1 Processor -- start 2024-02-19T19:03:33.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.233+0000 7f736d601700 1 -- start start 2024-02-19T19:03:33.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.233+0000 7f736d601700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73680fed80 0x7f73681016c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:33.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.233+0000 7f736d601700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7368101d60 0x7f73680ffd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:33.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.233+0000 7f736d601700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7368100250 con 0x7f73680fed80 2024-02-19T19:03:33.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.233+0000 7f736d601700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7368100390 con 0x7f7368101d60 2024-02-19T19:03:33.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.233+0000 7f7366ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73680fed80 0x7f73681016c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:33.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.233+0000 7f7366ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73680fed80 0x7f73681016c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52840/0 (socket says 172.21.15.96:52840) 2024-02-19T19:03:33.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.233+0000 7f7366ffd700 1 -- 172.21.15.96:0/1113481584 learned_addr learned my addr 172.21.15.96:0/1113481584 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:03:33.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.233+0000 7f73667fc700 1 --2- 172.21.15.96:0/1113481584 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7368101d60 0x7f73680ffd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:33.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.234+0000 7f7366ffd700 1 -- 172.21.15.96:0/1113481584 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7368101d60 msgr2=0x7f73680ffd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:33.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.234+0000 7f7366ffd700 1 --2- 172.21.15.96:0/1113481584 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7368101d60 0x7f73680ffd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.234+0000 7f7366ffd700 1 -- 172.21.15.96:0/1113481584 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735c0095f0 con 0x7f73680fed80 2024-02-19T19:03:33.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.234+0000 7f73667fc700 1 --2- 172.21.15.96:0/1113481584 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7368101d60 0x7f73680ffd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:03:33.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.234+0000 7f7366ffd700 1 --2- 172.21.15.96:0/1113481584 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73680fed80 0x7f73681016c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7360007e90 tx=0x7f736000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:33.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.234+0000 7f734ffff700 1 -- 172.21.15.96:0/1113481584 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7360017070 con 0x7f73680fed80 2024-02-19T19:03:33.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.234+0000 7f736d601700 1 -- 172.21.15.96:0/1113481584 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7368100670 con 0x7f73680fed80 2024-02-19T19:03:33.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.234+0000 7f734ffff700 1 -- 172.21.15.96:0/1113481584 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f736000f040 con 0x7f73680fed80 2024-02-19T19:03:33.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.234+0000 7f734ffff700 1 -- 172.21.15.96:0/1113481584 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7360004820 con 0x7f73680fed80 2024-02-19T19:03:33.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.234+0000 7f736d601700 1 -- 172.21.15.96:0/1113481584 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f736819e360 con 0x7f73680fed80 2024-02-19T19:03:33.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.235+0000 7f736d601700 1 -- 172.21.15.96:0/1113481584 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7368109620 con 0x7f73680fed80 2024-02-19T19:03:33.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.236+0000 7f734ffff700 1 -- 172.21.15.96:0/1113481584 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f7360003a00 con 0x7f73680fed80 2024-02-19T19:03:33.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.236+0000 7f734ffff700 1 --2- 172.21.15.96:0/1113481584 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f735006c4e0 0x7f735006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:33.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.236+0000 7f73667fc700 1 --2- 172.21.15.96:0/1113481584 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f735006c4e0 0x7f735006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:33.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.236+0000 7f734ffff700 1 -- 172.21.15.96:0/1113481584 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f736008b1a0 con 0x7f73680fed80 2024-02-19T19:03:33.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.237+0000 7f73667fc700 1 --2- 172.21.15.96:0/1113481584 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f735006c4e0 0x7f735006e9a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f735c005090 tx=0x7f735c01a040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:33.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.241+0000 7f734ffff700 1 -- 172.21.15.96:0/1113481584 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f73600593b0 con 0x7f73680fed80 2024-02-19T19:03:33.530 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.511+0000 7f736d601700 1 -- 172.21.15.96:0/1113481584 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f736819e910 con 0x7f73680fed80 2024-02-19T19:03:33.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.512+0000 7f734ffff700 1 -- 172.21.15.96:0/1113481584 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7f7360058f40 con 0x7f73680fed80 2024-02-19T19:03:33.531 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:03:33.531 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:03:33.531 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-19T19:03:33.531 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:03:33.531 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:03:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-19T19:03:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:03:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:03:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-19T19:03:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:03:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:03:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-19T19:03:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:03:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:03:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 14 2024-02-19T19:03:33.532 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:03:33.532 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:03:33.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.514+0000 7f736d601700 1 -- 172.21.15.96:0/1113481584 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f735006c4e0 msgr2=0x7f735006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:33.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.514+0000 7f736d601700 1 --2- 172.21.15.96:0/1113481584 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f735006c4e0 0x7f735006e9a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f735c005090 tx=0x7f735c01a040 comp rx=0 tx=0).stop 2024-02-19T19:03:33.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.514+0000 7f736d601700 1 -- 172.21.15.96:0/1113481584 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73680fed80 msgr2=0x7f73681016c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:33.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.514+0000 7f736d601700 1 --2- 172.21.15.96:0/1113481584 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73680fed80 0x7f73681016c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7360007e90 tx=0x7f736000d3b0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.514+0000 7f736d601700 1 -- 172.21.15.96:0/1113481584 shutdown_connections 2024-02-19T19:03:33.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.514+0000 7f736d601700 1 --2- 172.21.15.96:0/1113481584 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f735006c4e0 0x7f735006e9a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.533 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.514+0000 7f736d601700 1 --2- 172.21.15.96:0/1113481584 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73680fed80 0x7f73681016c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.514+0000 7f736d601700 1 --2- 172.21.15.96:0/1113481584 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7368101d60 0x7f73680ffd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.514+0000 7f736d601700 1 -- 172.21.15.96:0/1113481584 >> 172.21.15.96:0/1113481584 conn(0x7f73680fa720 msgr2=0x7f7368104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:33.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.514+0000 7f736d601700 1 -- 172.21.15.96:0/1113481584 shutdown_connections 2024-02-19T19:03:33.534 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.514+0000 7f736d601700 1 -- 172.21.15.96:0/1113481584 wait complete. 2024-02-19T19:03:33.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.618+0000 7f92fe07d700 1 -- 172.21.15.96:0/952148614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92f8101eb0 msgr2=0x7f92f8102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:33.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.618+0000 7f92fe07d700 1 --2- 172.21.15.96:0/952148614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92f8101eb0 0x7f92f8102310 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f92ec009910 tx=0x7f92ec009c20 comp rx=0 tx=0).stop 2024-02-19T19:03:33.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.619+0000 7f92fe07d700 1 -- 172.21.15.96:0/952148614 shutdown_connections 2024-02-19T19:03:33.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.619+0000 7f92fe07d700 1 --2- 172.21.15.96:0/952148614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92f8101eb0 0x7f92f8102310 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.619+0000 7f92fe07d700 1 --2- 172.21.15.96:0/952148614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92f8100cb0 0x7f92f81010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.619+0000 7f92fe07d700 1 -- 172.21.15.96:0/952148614 >> 172.21.15.96:0/952148614 conn(0x7f92f80fc230 msgr2=0x7f92f80fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:33.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.619+0000 7f92fe07d700 1 -- 172.21.15.96:0/952148614 shutdown_connections 2024-02-19T19:03:33.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.619+0000 7f92fe07d700 1 -- 172.21.15.96:0/952148614 wait complete. 2024-02-19T19:03:33.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.619+0000 7f92fe07d700 1 Processor -- start 2024-02-19T19:03:33.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.620+0000 7f92fe07d700 1 -- start start 2024-02-19T19:03:33.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.620+0000 7f92fe07d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92f8100cb0 0x7f92f8074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:33.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.620+0000 7f92fe07d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92f8101eb0 0x7f92f8073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.620+0000 7f92fe07d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f80736c0 con 0x7f92f8100cb0 2024-02-19T19:03:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.620+0000 7f92fe07d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f8073800 con 0x7f92f8101eb0 2024-02-19T19:03:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.620+0000 7f92f77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92f8100cb0 0x7f92f8074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.620+0000 7f92f77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92f8100cb0 0x7f92f8074b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46134/0 (socket says 172.21.15.96:46134) 2024-02-19T19:03:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.620+0000 7f92f77fe700 1 -- 172.21.15.96:0/3921662185 learned_addr learned my addr 172.21.15.96:0/3921662185 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:03:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.620+0000 7f92f6ffd700 1 --2- 172.21.15.96:0/3921662185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92f8101eb0 0x7f92f8073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.620+0000 7f92f77fe700 1 -- 172.21.15.96:0/3921662185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92f8101eb0 msgr2=0x7f92f8073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.620+0000 7f92f77fe700 1 --2- 172.21.15.96:0/3921662185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92f8101eb0 0x7f92f8073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.620+0000 7f92f77fe700 1 -- 172.21.15.96:0/3921662185 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec0095f0 con 0x7f92f8100cb0 2024-02-19T19:03:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.621+0000 7f92f77fe700 1 --2- 172.21.15.96:0/3921662185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92f8100cb0 0x7f92f8074b30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f92e800d900 tx=0x7f92e800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.621+0000 7f92f4ff9700 1 -- 172.21.15.96:0/3921662185 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92e800b920 con 0x7f92f8100cb0 2024-02-19T19:03:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.621+0000 7f92fe07d700 1 -- 172.21.15.96:0/3921662185 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f8073ae0 con 0x7f92f8100cb0 2024-02-19T19:03:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.621+0000 7f92f4ff9700 1 -- 172.21.15.96:0/3921662185 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f92e8010460 con 0x7f92f8100cb0 2024-02-19T19:03:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.621+0000 7f92f4ff9700 1 -- 172.21.15.96:0/3921662185 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92e800f590 con 0x7f92f8100cb0 2024-02-19T19:03:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.621+0000 7f92fe07d700 1 -- 172.21.15.96:0/3921662185 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f819e510 con 0x7f92f8100cb0 2024-02-19T19:03:33.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.622+0000 7f92fe07d700 1 -- 172.21.15.96:0/3921662185 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f8109810 con 0x7f92f8100cb0 2024-02-19T19:03:33.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.622+0000 7f92f4ff9700 1 -- 172.21.15.96:0/3921662185 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 19) v1 ==== 90312+0+0 (secure 0 0 0) 0x7f92e80105d0 con 0x7f92f8100cb0 2024-02-19T19:03:33.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.623+0000 7f92f4ff9700 1 --2- 172.21.15.96:0/3921662185 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f92e006c4e0 0x7f92e006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:03:33.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.623+0000 7f92f4ff9700 1 -- 172.21.15.96:0/3921662185 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f92e808b480 con 0x7f92f8100cb0 2024-02-19T19:03:33.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.623+0000 7f92f6ffd700 1 --2- 172.21.15.96:0/3921662185 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f92e006c4e0 0x7f92e006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:03:33.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.623+0000 7f92f6ffd700 1 --2- 172.21.15.96:0/3921662185 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f92e006c4e0 0x7f92e006e9a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f92ec00b5c0 tx=0x7f92ec005ee0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:03:33.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.627+0000 7f92f4ff9700 1 -- 172.21.15.96:0/3921662185 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f92e8059690 con 0x7f92f8100cb0 2024-02-19T19:03:33.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.840+0000 7f92fe07d700 1 -- 172.21.15.96:0/3921662185 --> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f92f8106800 con 0x7f92e006c4e0 2024-02-19T19:03:33.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.841+0000 7f92f4ff9700 1 -- 172.21.15.96:0/3921662185 <== mgr.14223 v2:172.21.15.96:6800/664869387 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f92f8106800 con 0x7f92e006c4e0 2024-02-19T19:03:33.861 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:03:33.861 INFO:teuthology.orchestra.run.smithi096.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:03:33.861 INFO:teuthology.orchestra.run.smithi096.stdout: "in_progress": true, 2024-02-19T19:03:33.861 INFO:teuthology.orchestra.run.smithi096.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-19T19:03:33.861 INFO:teuthology.orchestra.run.smithi096.stdout: "services_complete": [], 2024-02-19T19:03:33.861 INFO:teuthology.orchestra.run.smithi096.stdout: "progress": "0/2 daemons upgraded", 2024-02-19T19:03:33.861 INFO:teuthology.orchestra.run.smithi096.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 image on host smithi125", 2024-02-19T19:03:33.861 INFO:teuthology.orchestra.run.smithi096.stdout: "is_paused": false 2024-02-19T19:03:33.861 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:03:33.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.843+0000 7f92fe07d700 1 -- 172.21.15.96:0/3921662185 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f92e006c4e0 msgr2=0x7f92e006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:33.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.843+0000 7f92fe07d700 1 --2- 172.21.15.96:0/3921662185 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f92e006c4e0 0x7f92e006e9a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f92ec00b5c0 tx=0x7f92ec005ee0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.843+0000 7f92fe07d700 1 -- 172.21.15.96:0/3921662185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92f8100cb0 msgr2=0x7f92f8074b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:03:33.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.843+0000 7f92fe07d700 1 --2- 172.21.15.96:0/3921662185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92f8100cb0 0x7f92f8074b30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f92e800d900 tx=0x7f92e800dc10 comp rx=0 tx=0).stop 2024-02-19T19:03:33.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.843+0000 7f92fe07d700 1 -- 172.21.15.96:0/3921662185 shutdown_connections 2024-02-19T19:03:33.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.843+0000 7f92fe07d700 1 --2- 172.21.15.96:0/3921662185 >> [v2:172.21.15.96:6800/664869387,v1:172.21.15.96:6801/664869387] conn(0x7f92e006c4e0 0x7f92e006e9a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.843+0000 7f92fe07d700 1 --2- 172.21.15.96:0/3921662185 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92f8100cb0 0x7f92f8074b30 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.843+0000 7f92fe07d700 1 --2- 172.21.15.96:0/3921662185 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f92f8101eb0 0x7f92f8073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:03:33.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.843+0000 7f92fe07d700 1 -- 172.21.15.96:0/3921662185 >> 172.21.15.96:0/3921662185 conn(0x7f92f80fc230 msgr2=0x7f92f81050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:03:33.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.844+0000 7f92fe07d700 1 -- 172.21.15.96:0/3921662185 shutdown_connections 2024-02-19T19:03:33.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:03:33.844+0000 7f92fe07d700 1 -- 172.21.15.96:0/3921662185 wait complete. 2024-02-19T19:03:34.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:33 smithi125 ceph-mon[37556]: from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:34.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:33 smithi125 ceph-mon[37556]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:34.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:33 smithi125 ceph-mon[37556]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:34.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:33 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/1113481584' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:34.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:33 smithi096 ceph-mon[29216]: from='client.14584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:34.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:33 smithi096 ceph-mon[29216]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:34.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:33 smithi096 ceph-mon[29216]: from='client.14592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:34.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:33 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/1113481584' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:03:35.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:34 smithi125 ceph-mon[37556]: pgmap v232: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:03:35.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:34 smithi125 ceph-mon[37556]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:35.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:34 smithi096 ceph-mon[29216]: pgmap v232: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:03:35.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:34 smithi096 ceph-mon[29216]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:03:36.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:36 smithi125 ceph-mon[37556]: pgmap v233: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:03:36.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:36 smithi096 ceph-mon[29216]: pgmap v233: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:03:39.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:39 smithi125 ceph-mon[37556]: pgmap v234: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:03:39.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:39 smithi125 ceph-mon[37556]: Upgrade: Updating mgr.smithi125.ygdmdu 2024-02-19T19:03:39.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:39 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:39.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:39 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi125.ygdmdu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:03:39.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:39 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T19:03:39.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:39 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:03:39.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:39 smithi125 ceph-mon[37556]: Deploying daemon mgr.smithi125.ygdmdu on smithi125 2024-02-19T19:03:39.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:39 smithi096 ceph-mon[29216]: pgmap v234: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:03:39.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:39 smithi096 ceph-mon[29216]: Upgrade: Updating mgr.smithi125.ygdmdu 2024-02-19T19:03:39.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:39 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:39.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:39 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi125.ygdmdu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:03:39.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:39 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T19:03:39.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:39 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:03:39.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:39 smithi096 ceph-mon[29216]: Deploying daemon mgr.smithi125.ygdmdu on smithi125 2024-02-19T19:03:41.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:41 smithi096 ceph-mon[29216]: pgmap v235: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:03:41.385 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:41 smithi125 ceph-mon[37556]: pgmap v235: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:03:42.943 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:42 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:42.943 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:42 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:42.943 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:42 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:03:42.943 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:42 smithi125 ceph-mon[37556]: pgmap v236: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:03:43.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:42 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:43.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:42 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:43.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:42 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:03:43.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:42 smithi096 ceph-mon[29216]: pgmap v236: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:03:43.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:43 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:03:44.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:43 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:03:45.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:44 smithi096 ceph-mon[29216]: pgmap v237: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:03:45.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:44 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:45.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:44 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:45.160 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:44 smithi125 ceph-mon[37556]: pgmap v237: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:03:45.160 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:44 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:45.160 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:44 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:46.574 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:46 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:46.574 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:46 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:46.574 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:46 smithi125 ceph-mon[37556]: pgmap v238: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:03:46.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:46 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:46.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:46 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:46.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:46 smithi096 ceph-mon[29216]: pgmap v238: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:03:49.131 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:48 smithi125 ceph-mon[37556]: pgmap v239: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:03:49.131 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:48 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:49.131 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:48 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:49.131 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:48 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:03:49.131 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:48 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:03:49.131 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:48 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:49.131 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:48 smithi125 ceph-mon[37556]: Standby manager daemon smithi125.ygdmdu restarted 2024-02-19T19:03:49.131 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:48 smithi125 ceph-mon[37556]: Standby manager daemon smithi125.ygdmdu started 2024-02-19T19:03:49.131 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:48 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi125.ygdmdu/crt"}]: dispatch 2024-02-19T19:03:49.132 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:48 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:03:49.178 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:48 smithi096 ceph-mon[29216]: pgmap v239: 65 pgs: 65 active+clean; 589 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:03:49.178 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:48 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:49.178 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:48 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:49.178 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:48 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:03:49.178 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:48 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:03:49.178 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:48 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' 2024-02-19T19:03:49.178 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:48 smithi096 ceph-mon[29216]: Standby manager daemon smithi125.ygdmdu restarted 2024-02-19T19:03:49.178 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:48 smithi096 ceph-mon[29216]: Standby manager daemon smithi125.ygdmdu started 2024-02-19T19:03:49.178 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:48 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi125.ygdmdu/crt"}]: dispatch 2024-02-19T19:03:49.178 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:48 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:03:50.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi125.ygdmdu/key"}]: dispatch 2024-02-19T19:03:50.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:03:50.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:03:50.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr fail", "who": "smithi096.zsjdff"}]: dispatch 2024-02-19T19:03:50.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: osdmap e47: 6 total, 6 up, 6 in 2024-02-19T19:03:50.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "mgr fail", "who": "smithi096.zsjdff"}]': finished 2024-02-19T19:03:50.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: mgrmap e20: smithi125.ygdmdu(active, starting, since 0.00695048s) 2024-02-19T19:03:50.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2024-02-19T19:03:50.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T19:03:50.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pccmys"}]: dispatch 2024-02-19T19:03:50.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.usrmcg"}]: dispatch 2024-02-19T19:03:50.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.srnlol"}]: dispatch 2024-02-19T19:03:50.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.pwyuga"}]: dispatch 2024-02-19T19:03:50.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mgr metadata", "who": "smithi125.ygdmdu", "id": "smithi125.ygdmdu"}]: dispatch 2024-02-19T19:03:50.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T19:03:50.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T19:03:50.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T19:03:50.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T19:03:50.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:03:50.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:03:50.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T19:03:50.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T19:03:50.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T19:03:50.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: Manager daemon smithi125.ygdmdu is now available 2024-02-19T19:03:50.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:03:50.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:03:50.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:03:50.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi125.ygdmdu/mirror_snapshot_schedule"}]: dispatch 2024-02-19T19:03:50.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi125.ygdmdu/mirror_snapshot_schedule"}]: dispatch 2024-02-19T19:03:50.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi125.ygdmdu/trash_purge_schedule"}]: dispatch 2024-02-19T19:03:50.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi125.ygdmdu/trash_purge_schedule"}]: dispatch 2024-02-19T19:03:50.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: [19/Feb/2024:19:03:49] ENGINE Bus STARTING 2024-02-19T19:03:50.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: Deploying cephadm binary to smithi125 2024-02-19T19:03:50.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: Deploying cephadm binary to smithi096 2024-02-19T19:03:50.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:49 smithi125 ceph-mon[37556]: [19/Feb/2024:19:03:49] ENGINE Serving on http://172.21.15.125:8765 2024-02-19T19:03:50.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi125.ygdmdu/key"}]: dispatch 2024-02-19T19:03:50.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:03:50.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:03:50.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr fail", "who": "smithi096.zsjdff"}]: dispatch 2024-02-19T19:03:50.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: osdmap e47: 6 total, 6 up, 6 in 2024-02-19T19:03:50.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.14223 172.21.15.96:0/1434993699' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "mgr fail", "who": "smithi096.zsjdff"}]': finished 2024-02-19T19:03:50.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: mgrmap e20: smithi125.ygdmdu(active, starting, since 0.00695048s) 2024-02-19T19:03:50.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2024-02-19T19:03:50.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T19:03:50.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pccmys"}]: dispatch 2024-02-19T19:03:50.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.usrmcg"}]: dispatch 2024-02-19T19:03:50.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.srnlol"}]: dispatch 2024-02-19T19:03:50.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.pwyuga"}]: dispatch 2024-02-19T19:03:50.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mgr metadata", "who": "smithi125.ygdmdu", "id": "smithi125.ygdmdu"}]: dispatch 2024-02-19T19:03:50.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T19:03:50.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T19:03:50.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T19:03:50.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T19:03:50.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:03:50.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:03:50.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T19:03:50.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T19:03:50.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T19:03:50.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: Manager daemon smithi125.ygdmdu is now available 2024-02-19T19:03:50.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:03:50.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:03:50.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:03:50.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi125.ygdmdu/mirror_snapshot_schedule"}]: dispatch 2024-02-19T19:03:50.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi125.ygdmdu/mirror_snapshot_schedule"}]: dispatch 2024-02-19T19:03:50.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi125.ygdmdu/trash_purge_schedule"}]: dispatch 2024-02-19T19:03:50.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi125.ygdmdu/trash_purge_schedule"}]: dispatch 2024-02-19T19:03:50.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: [19/Feb/2024:19:03:49] ENGINE Bus STARTING 2024-02-19T19:03:50.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: Deploying cephadm binary to smithi125 2024-02-19T19:03:50.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: Deploying cephadm binary to smithi096 2024-02-19T19:03:50.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:49 smithi096 ceph-mon[29216]: [19/Feb/2024:19:03:49] ENGINE Serving on http://172.21.15.125:8765 2024-02-19T19:03:51.257 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:50 smithi096 ceph-mon[29216]: [19/Feb/2024:19:03:49] ENGINE Serving on https://172.21.15.125:7150 2024-02-19T19:03:51.257 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:50 smithi096 ceph-mon[29216]: [19/Feb/2024:19:03:49] ENGINE Bus STARTED 2024-02-19T19:03:51.257 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:50 smithi096 ceph-mon[29216]: mgrmap e21: smithi125.ygdmdu(active, since 1.00765s) 2024-02-19T19:03:51.257 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:50 smithi096 ceph-mon[29216]: pgmap v3: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:51.268 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:50 smithi125 ceph-mon[37556]: [19/Feb/2024:19:03:49] ENGINE Serving on https://172.21.15.125:7150 2024-02-19T19:03:51.269 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:50 smithi125 ceph-mon[37556]: [19/Feb/2024:19:03:49] ENGINE Bus STARTED 2024-02-19T19:03:51.269 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:50 smithi125 ceph-mon[37556]: mgrmap e21: smithi125.ygdmdu(active, since 1.00765s) 2024-02-19T19:03:51.269 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:50 smithi125 ceph-mon[37556]: pgmap v3: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:52.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:52 smithi125 ceph-mon[37556]: pgmap v4: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:52.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:52 smithi125 ceph-mon[37556]: mgrmap e22: smithi125.ygdmdu(active, since 2s) 2024-02-19T19:03:52.727 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:52 smithi096 ceph-mon[29216]: pgmap v4: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:52.727 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:52 smithi096 ceph-mon[29216]: mgrmap e22: smithi125.ygdmdu(active, since 2s) 2024-02-19T19:03:54.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:54 smithi125 ceph-mon[37556]: pgmap v5: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:54.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:54 smithi125 ceph-mon[37556]: mgrmap e23: smithi125.ygdmdu(active, since 4s) 2024-02-19T19:03:54.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:54 smithi096 ceph-mon[29216]: pgmap v5: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:03:54.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:54 smithi096 ceph-mon[29216]: mgrmap e23: smithi125.ygdmdu(active, since 4s) 2024-02-19T19:03:56.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:56 smithi125 ceph-mon[37556]: pgmap v6: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-02-19T19:03:56.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:56 smithi125 ceph-mon[37556]: Standby manager daemon smithi096.zsjdff started 2024-02-19T19:03:56.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:56 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.96:0/2178085778' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi096.zsjdff/crt"}]: dispatch 2024-02-19T19:03:56.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:56 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.96:0/2178085778' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:03:56.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:56 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.96:0/2178085778' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi096.zsjdff/key"}]: dispatch 2024-02-19T19:03:56.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:56 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.96:0/2178085778' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:03:56.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:56 smithi096 ceph-mon[29216]: pgmap v6: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-02-19T19:03:56.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:56 smithi096 ceph-mon[29216]: Standby manager daemon smithi096.zsjdff started 2024-02-19T19:03:56.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:56 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.96:0/2178085778' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi096.zsjdff/crt"}]: dispatch 2024-02-19T19:03:56.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:56 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.96:0/2178085778' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:03:56.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:56 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.96:0/2178085778' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi096.zsjdff/key"}]: dispatch 2024-02-19T19:03:56.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:56 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.96:0/2178085778' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:03:57.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:57 smithi096 ceph-mon[29216]: mgrmap e24: smithi125.ygdmdu(active, since 7s), standbys: smithi096.zsjdff 2024-02-19T19:03:57.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:57 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mgr metadata", "who": "smithi096.zsjdff", "id": "smithi096.zsjdff"}]: dispatch 2024-02-19T19:03:57.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:57 smithi125 ceph-mon[37556]: mgrmap e24: smithi125.ygdmdu(active, since 7s), standbys: smithi096.zsjdff 2024-02-19T19:03:57.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:57 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mgr metadata", "who": "smithi096.zsjdff", "id": "smithi096.zsjdff"}]: dispatch 2024-02-19T19:03:58.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:58 smithi096 ceph-mon[29216]: pgmap v7: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-02-19T19:03:58.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:58 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:03:58.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:58 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:03:58.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:58 smithi125 ceph-mon[37556]: pgmap v7: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-02-19T19:03:58.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:58 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:03:58.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:58 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:03:59.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:59 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:03:59.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:59 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:03:59.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:59 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:03:59.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:59 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:03:59.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:03:59 smithi125 ceph-mon[37556]: pgmap v8: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-02-19T19:04:00.035 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:59 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:00.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:59 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:00.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:59 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:00.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:59 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:00.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:03:59 smithi096 ceph-mon[29216]: pgmap v8: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-02-19T19:04:01.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:00 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:01.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:00 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:01.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:00 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:01.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:00 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:01.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:00 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:01.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:00 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:01.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:00 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:01.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:00 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:01.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:00 smithi096 ceph-mon[29216]: Adjusting osd_memory_target on smithi096 to 1216M 2024-02-19T19:04:01.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:00 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:01.383 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:00 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:01.383 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:00 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:01.383 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:00 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:01.383 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:00 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:01.383 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:00 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:01.383 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:00 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:01.383 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:00 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:01.383 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:00 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:01.383 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:00 smithi125 ceph-mon[37556]: Adjusting osd_memory_target on smithi096 to 1216M 2024-02-19T19:04:01.383 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:00 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:02.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:02 smithi125 ceph-mon[37556]: pgmap v9: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-19T19:04:02.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:02 smithi096 ceph-mon[29216]: pgmap v9: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-19T19:04:03.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.960+0000 7feb4aabd700 1 -- 172.21.15.96:0/3942211262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb44100dc0 msgr2=0x7feb44101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:03.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.960+0000 7feb4aabd700 1 --2- 172.21.15.96:0/3942211262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb44100dc0 0x7feb44101220 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7feb30009910 tx=0x7feb30009c20 comp rx=0 tx=0).stop 2024-02-19T19:04:03.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.960+0000 7feb4aabd700 1 -- 172.21.15.96:0/3942211262 shutdown_connections 2024-02-19T19:04:03.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.960+0000 7feb4aabd700 1 --2- 172.21.15.96:0/3942211262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb44100dc0 0x7feb44101220 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:03.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.960+0000 7feb4aabd700 1 --2- 172.21.15.96:0/3942211262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb440ffbc0 0x7feb440fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:03.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.960+0000 7feb4aabd700 1 -- 172.21.15.96:0/3942211262 >> 172.21.15.96:0/3942211262 conn(0x7feb440fb160 msgr2=0x7feb440fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:03.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.960+0000 7feb4aabd700 1 -- 172.21.15.96:0/3942211262 shutdown_connections 2024-02-19T19:04:03.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.960+0000 7feb4aabd700 1 -- 172.21.15.96:0/3942211262 wait complete. 2024-02-19T19:04:03.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.960+0000 7feb4aabd700 1 Processor -- start 2024-02-19T19:04:03.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.960+0000 7feb4aabd700 1 -- start start 2024-02-19T19:04:03.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.960+0000 7feb4aabd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb440ffbc0 0x7feb441967d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:03.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.961+0000 7feb4aabd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb44100dc0 0x7feb44196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:03.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.961+0000 7feb4aabd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb44197330 con 0x7feb44100dc0 2024-02-19T19:04:03.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.961+0000 7feb4aabd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb44197470 con 0x7feb440ffbc0 2024-02-19T19:04:03.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.961+0000 7feb43fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb44100dc0 0x7feb44196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:03.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.961+0000 7feb43fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb44100dc0 0x7feb44196d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57650/0 (socket says 172.21.15.96:57650) 2024-02-19T19:04:03.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.961+0000 7feb43fff700 1 -- 172.21.15.96:0/325442064 learned_addr learned my addr 172.21.15.96:0/325442064 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:04:03.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.961+0000 7feb48859700 1 --2- 172.21.15.96:0/325442064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb440ffbc0 0x7feb441967d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:03.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.961+0000 7feb43fff700 1 -- 172.21.15.96:0/325442064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb440ffbc0 msgr2=0x7feb441967d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:03.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.961+0000 7feb43fff700 1 --2- 172.21.15.96:0/325442064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb440ffbc0 0x7feb441967d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:03.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.961+0000 7feb43fff700 1 -- 172.21.15.96:0/325442064 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb300095f0 con 0x7feb44100dc0 2024-02-19T19:04:03.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.961+0000 7feb43fff700 1 --2- 172.21.15.96:0/325442064 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb44100dc0 0x7feb44196d10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7feb30006010 tx=0x7feb3000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:03.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.961+0000 7feb41ffb700 1 -- 172.21.15.96:0/325442064 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb3001d070 con 0x7feb44100dc0 2024-02-19T19:04:03.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.961+0000 7feb41ffb700 1 -- 172.21.15.96:0/325442064 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7feb3000f460 con 0x7feb44100dc0 2024-02-19T19:04:03.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.961+0000 7feb4aabd700 1 -- 172.21.15.96:0/325442064 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb4419bec0 con 0x7feb44100dc0 2024-02-19T19:04:03.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.961+0000 7feb41ffb700 1 -- 172.21.15.96:0/325442064 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb30021640 con 0x7feb44100dc0 2024-02-19T19:04:03.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.962+0000 7feb4aabd700 1 -- 172.21.15.96:0/325442064 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb4419c380 con 0x7feb44100dc0 2024-02-19T19:04:03.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.962+0000 7feb4aabd700 1 -- 172.21.15.96:0/325442064 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb44068af0 con 0x7feb44100dc0 2024-02-19T19:04:03.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.963+0000 7feb41ffb700 1 -- 172.21.15.96:0/325442064 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 24) v1 ==== 90933+0+0 (secure 0 0 0) 0x7feb3000fab0 con 0x7feb44100dc0 2024-02-19T19:04:03.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.964+0000 7feb41ffb700 1 --2- 172.21.15.96:0/325442064 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7feb3406ce40 0x7feb3406f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:03.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.964+0000 7feb41ffb700 1 -- 172.21.15.96:0/325442064 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7feb3008d8a0 con 0x7feb44100dc0 2024-02-19T19:04:03.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.964+0000 7feb48859700 1 --2- 172.21.15.96:0/325442064 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7feb3406ce40 0x7feb3406f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:03.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.964+0000 7feb48859700 1 --2- 172.21.15.96:0/325442064 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7feb3406ce40 0x7feb3406f300 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7feb44100c20 tx=0x7feb3800b410 comp rx=0 tx=0).ready entity=mgr.24347 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:03.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:03.968+0000 7feb41ffb700 1 -- 172.21.15.96:0/325442064 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7feb3005afe0 con 0x7feb44100dc0 2024-02-19T19:04:04.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.181+0000 7feb4aabd700 1 -- 172.21.15.96:0/325442064 --> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7feb44069560 con 0x7feb3406ce40 2024-02-19T19:04:04.203 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.183+0000 7feb41ffb700 1 -- 172.21.15.96:0/325442064 <== mgr.24347 v2:172.21.15.125:6828/1031992411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7feb44069560 con 0x7feb3406ce40 2024-02-19T19:04:04.205 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.185+0000 7feb4aabd700 1 -- 172.21.15.96:0/325442064 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7feb3406ce40 msgr2=0x7feb3406f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:04.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.185+0000 7feb4aabd700 1 --2- 172.21.15.96:0/325442064 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7feb3406ce40 0x7feb3406f300 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7feb44100c20 tx=0x7feb3800b410 comp rx=0 tx=0).stop 2024-02-19T19:04:04.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.185+0000 7feb4aabd700 1 -- 172.21.15.96:0/325442064 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb44100dc0 msgr2=0x7feb44196d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:04.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.185+0000 7feb4aabd700 1 --2- 172.21.15.96:0/325442064 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb44100dc0 0x7feb44196d10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7feb30006010 tx=0x7feb3000bd70 comp rx=0 tx=0).stop 2024-02-19T19:04:04.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.185+0000 7feb4aabd700 1 -- 172.21.15.96:0/325442064 shutdown_connections 2024-02-19T19:04:04.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.185+0000 7feb4aabd700 1 --2- 172.21.15.96:0/325442064 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7feb3406ce40 0x7feb3406f300 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.185+0000 7feb4aabd700 1 --2- 172.21.15.96:0/325442064 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feb440ffbc0 0x7feb441967d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.185+0000 7feb4aabd700 1 --2- 172.21.15.96:0/325442064 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb44100dc0 0x7feb44196d10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.185+0000 7feb4aabd700 1 -- 172.21.15.96:0/325442064 >> 172.21.15.96:0/325442064 conn(0x7feb440fb160 msgr2=0x7feb44068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:04.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.185+0000 7feb4aabd700 1 -- 172.21.15.96:0/325442064 shutdown_connections 2024-02-19T19:04:04.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.185+0000 7feb4aabd700 1 -- 172.21.15.96:0/325442064 wait complete. 2024-02-19T19:04:04.216 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:04:04.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.290+0000 7f2c2bcba700 1 -- 172.21.15.96:0/456180263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c24100da0 msgr2=0x7f2c24101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:04.311 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.290+0000 7f2c2bcba700 1 --2- 172.21.15.96:0/456180263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c24100da0 0x7f2c24101200 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2c14009910 tx=0x7f2c14009c20 comp rx=0 tx=0).stop 2024-02-19T19:04:04.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.290+0000 7f2c2bcba700 1 -- 172.21.15.96:0/456180263 shutdown_connections 2024-02-19T19:04:04.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.290+0000 7f2c2bcba700 1 --2- 172.21.15.96:0/456180263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c24100da0 0x7f2c24101200 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.290+0000 7f2c2bcba700 1 --2- 172.21.15.96:0/456180263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c240ffba0 0x7f2c240fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.290+0000 7f2c2bcba700 1 -- 172.21.15.96:0/456180263 >> 172.21.15.96:0/456180263 conn(0x7f2c240fb120 msgr2=0x7f2c240fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:04.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.290+0000 7f2c2bcba700 1 -- 172.21.15.96:0/456180263 shutdown_connections 2024-02-19T19:04:04.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.290+0000 7f2c2bcba700 1 -- 172.21.15.96:0/456180263 wait complete. 2024-02-19T19:04:04.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.291+0000 7f2c2bcba700 1 Processor -- start 2024-02-19T19:04:04.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.291+0000 7f2c2bcba700 1 -- start start 2024-02-19T19:04:04.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.291+0000 7f2c2bcba700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c240ffba0 0x7f2c241953e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:04.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.291+0000 7f2c2bcba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c24100da0 0x7f2c24195920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:04.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.291+0000 7f2c2bcba700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c24195f40 con 0x7f2c240ffba0 2024-02-19T19:04:04.312 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.291+0000 7f2c2bcba700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c24196080 con 0x7f2c24100da0 2024-02-19T19:04:04.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.291+0000 7f2c29a56700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c240ffba0 0x7f2c241953e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:04.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.291+0000 7f2c29a56700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c240ffba0 0x7f2c241953e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57668/0 (socket says 172.21.15.96:57668) 2024-02-19T19:04:04.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.291+0000 7f2c29a56700 1 -- 172.21.15.96:0/1675597332 learned_addr learned my addr 172.21.15.96:0/1675597332 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:04:04.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.291+0000 7f2c29255700 1 --2- 172.21.15.96:0/1675597332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c24100da0 0x7f2c24195920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:04.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.292+0000 7f2c29a56700 1 -- 172.21.15.96:0/1675597332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c24100da0 msgr2=0x7f2c24195920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:04.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.292+0000 7f2c29a56700 1 --2- 172.21.15.96:0/1675597332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c24100da0 0x7f2c24195920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.292+0000 7f2c29a56700 1 -- 172.21.15.96:0/1675597332 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c140095f0 con 0x7f2c240ffba0 2024-02-19T19:04:04.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.292+0000 7f2c29a56700 1 --2- 172.21.15.96:0/1675597332 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c240ffba0 0x7f2c241953e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2c200098f0 tx=0x7f2c20009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:04.314 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.292+0000 7f2c1affd700 1 -- 172.21.15.96:0/1675597332 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c20012070 con 0x7f2c240ffba0 2024-02-19T19:04:04.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.292+0000 7f2c1affd700 1 -- 172.21.15.96:0/1675597332 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2c200044d0 con 0x7f2c240ffba0 2024-02-19T19:04:04.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.292+0000 7f2c2bcba700 1 -- 172.21.15.96:0/1675597332 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c24068e90 con 0x7f2c240ffba0 2024-02-19T19:04:04.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.292+0000 7f2c1affd700 1 -- 172.21.15.96:0/1675597332 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c20019480 con 0x7f2c240ffba0 2024-02-19T19:04:04.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.292+0000 7f2c2bcba700 1 -- 172.21.15.96:0/1675597332 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c240693e0 con 0x7f2c240ffba0 2024-02-19T19:04:04.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.293+0000 7f2c2bcba700 1 -- 172.21.15.96:0/1675597332 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c24108700 con 0x7f2c240ffba0 2024-02-19T19:04:04.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.293+0000 7f2c1affd700 1 -- 172.21.15.96:0/1675597332 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 24) v1 ==== 90933+0+0 (secure 0 0 0) 0x7f2c20016030 con 0x7f2c240ffba0 2024-02-19T19:04:04.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.294+0000 7f2c1affd700 1 --2- 172.21.15.96:0/1675597332 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7f2c1006ce40 0x7f2c1006f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:04.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.294+0000 7f2c1affd700 1 -- 172.21.15.96:0/1675597332 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f2c2008d980 con 0x7f2c240ffba0 2024-02-19T19:04:04.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.294+0000 7f2c29255700 1 --2- 172.21.15.96:0/1675597332 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7f2c1006ce40 0x7f2c1006f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:04.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.295+0000 7f2c29255700 1 --2- 172.21.15.96:0/1675597332 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7f2c1006ce40 0x7f2c1006f300 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400b5c0 tx=0x7f2c14005ee0 comp rx=0 tx=0).ready entity=mgr.24347 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:04.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.299+0000 7f2c1affd700 1 -- 172.21.15.96:0/1675597332 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f2c2005b0c0 con 0x7f2c240ffba0 2024-02-19T19:04:04.531 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.510+0000 7f2c2bcba700 1 -- 172.21.15.96:0/1675597332 --> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c241056f0 con 0x7f2c1006ce40 2024-02-19T19:04:04.532 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.512+0000 7f2c1affd700 1 -- 172.21.15.96:0/1675597332 <== mgr.24347 v2:172.21.15.125:6828/1031992411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f2c241056f0 con 0x7f2c1006ce40 2024-02-19T19:04:04.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.514+0000 7f2c2bcba700 1 -- 172.21.15.96:0/1675597332 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7f2c1006ce40 msgr2=0x7f2c1006f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:04.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.514+0000 7f2c2bcba700 1 --2- 172.21.15.96:0/1675597332 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7f2c1006ce40 0x7f2c1006f300 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400b5c0 tx=0x7f2c14005ee0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.514+0000 7f2c2bcba700 1 -- 172.21.15.96:0/1675597332 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c240ffba0 msgr2=0x7f2c241953e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:04.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.514+0000 7f2c2bcba700 1 --2- 172.21.15.96:0/1675597332 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c240ffba0 0x7f2c241953e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2c200098f0 tx=0x7f2c20009c00 comp rx=0 tx=0).stop 2024-02-19T19:04:04.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.514+0000 7f2c2bcba700 1 -- 172.21.15.96:0/1675597332 shutdown_connections 2024-02-19T19:04:04.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.514+0000 7f2c2bcba700 1 --2- 172.21.15.96:0/1675597332 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2c240ffba0 0x7f2c241953e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.514+0000 7f2c2bcba700 1 --2- 172.21.15.96:0/1675597332 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7f2c1006ce40 0x7f2c1006f300 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.514+0000 7f2c2bcba700 1 --2- 172.21.15.96:0/1675597332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2c24100da0 0x7f2c24195920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.514+0000 7f2c2bcba700 1 -- 172.21.15.96:0/1675597332 >> 172.21.15.96:0/1675597332 conn(0x7f2c240fb120 msgr2=0x7f2c24103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:04.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.514+0000 7f2c2bcba700 1 -- 172.21.15.96:0/1675597332 shutdown_connections 2024-02-19T19:04:04.535 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.514+0000 7f2c2bcba700 1 -- 172.21.15.96:0/1675597332 wait complete. 2024-02-19T19:04:04.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.619+0000 7f5c3e09e700 1 -- 172.21.15.96:0/1204496916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c38104170 msgr2=0x7f5c38106560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:04.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.619+0000 7f5c3e09e700 1 --2- 172.21.15.96:0/1204496916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c38104170 0x7f5c38106560 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5c20009910 tx=0x7f5c20009c20 comp rx=0 tx=0).stop 2024-02-19T19:04:04.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.619+0000 7f5c3e09e700 1 -- 172.21.15.96:0/1204496916 shutdown_connections 2024-02-19T19:04:04.640 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:04 smithi096 ceph-mon[29216]: pgmap v10: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-02-19T19:04:04.640 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:04 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:04:04.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.619+0000 7f5c3e09e700 1 --2- 172.21.15.96:0/1204496916 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c38104170 0x7f5c38106560 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.619+0000 7f5c3e09e700 1 --2- 172.21.15.96:0/1204496916 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c38101840 0x7f5c38103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.619+0000 7f5c3e09e700 1 -- 172.21.15.96:0/1204496916 >> 172.21.15.96:0/1204496916 conn(0x7f5c380fb190 msgr2=0x7f5c380fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:04.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.619+0000 7f5c3e09e700 1 -- 172.21.15.96:0/1204496916 shutdown_connections 2024-02-19T19:04:04.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.619+0000 7f5c3e09e700 1 -- 172.21.15.96:0/1204496916 wait complete. 2024-02-19T19:04:04.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.620+0000 7f5c3e09e700 1 Processor -- start 2024-02-19T19:04:04.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.620+0000 7f5c3e09e700 1 -- start start 2024-02-19T19:04:04.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.620+0000 7f5c3e09e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c38101840 0x7f5c381011a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:04.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.620+0000 7f5c3e09e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c38104170 0x7f5c380ff7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:04.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.620+0000 7f5c3e09e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c380ffd30 con 0x7f5c38101840 2024-02-19T19:04:04.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.620+0000 7f5c3e09e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c380ffe70 con 0x7f5c38104170 2024-02-19T19:04:04.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.620+0000 7f5c377fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c38101840 0x7f5c381011a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:04.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.620+0000 7f5c377fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c38101840 0x7f5c381011a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57674/0 (socket says 172.21.15.96:57674) 2024-02-19T19:04:04.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.620+0000 7f5c377fe700 1 -- 172.21.15.96:0/1543244818 learned_addr learned my addr 172.21.15.96:0/1543244818 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:04:04.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.620+0000 7f5c36ffd700 1 --2- 172.21.15.96:0/1543244818 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c38104170 0x7f5c380ff7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:04.642 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.621+0000 7f5c377fe700 1 -- 172.21.15.96:0/1543244818 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c38104170 msgr2=0x7f5c380ff7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:04.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.621+0000 7f5c377fe700 1 --2- 172.21.15.96:0/1543244818 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c38104170 0x7f5c380ff7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.621+0000 7f5c377fe700 1 -- 172.21.15.96:0/1543244818 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c200095f0 con 0x7f5c38101840 2024-02-19T19:04:04.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.621+0000 7f5c36ffd700 1 --2- 172.21.15.96:0/1543244818 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c38104170 0x7f5c380ff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:04:04.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.621+0000 7f5c377fe700 1 --2- 172.21.15.96:0/1543244818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c38101840 0x7f5c381011a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000b4b0 tx=0x7f5c3000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:04.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.621+0000 7f5c34ff9700 1 -- 172.21.15.96:0/1543244818 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c30011800 con 0x7f5c38101840 2024-02-19T19:04:04.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.621+0000 7f5c34ff9700 1 -- 172.21.15.96:0/1543244818 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5c30011e10 con 0x7f5c38101840 2024-02-19T19:04:04.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.621+0000 7f5c3e09e700 1 -- 172.21.15.96:0/1543244818 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c38100150 con 0x7f5c38101840 2024-02-19T19:04:04.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.621+0000 7f5c34ff9700 1 -- 172.21.15.96:0/1543244818 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c3000f2e0 con 0x7f5c38101840 2024-02-19T19:04:04.643 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.621+0000 7f5c3e09e700 1 -- 172.21.15.96:0/1543244818 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c3819e550 con 0x7f5c38101840 2024-02-19T19:04:04.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.622+0000 7f5c3e09e700 1 -- 172.21.15.96:0/1543244818 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c381906a0 con 0x7f5c38101840 2024-02-19T19:04:04.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.623+0000 7f5c34ff9700 1 -- 172.21.15.96:0/1543244818 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 24) v1 ==== 90933+0+0 (secure 0 0 0) 0x7f5c30010380 con 0x7f5c38101840 2024-02-19T19:04:04.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.624+0000 7f5c34ff9700 1 --2- 172.21.15.96:0/1543244818 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7f5c2406ce40 0x7f5c2406f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:04.644 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.624+0000 7f5c34ff9700 1 -- 172.21.15.96:0/1543244818 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f5c3008c1a0 con 0x7f5c38101840 2024-02-19T19:04:04.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.624+0000 7f5c36ffd700 1 --2- 172.21.15.96:0/1543244818 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7f5c2406ce40 0x7f5c2406f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:04.645 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.624+0000 7f5c36ffd700 1 --2- 172.21.15.96:0/1543244818 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7f5c2406ce40 0x7f5c2406f300 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5c200059d0 tx=0x7f5c20005920 comp rx=0 tx=0).ready entity=mgr.24347 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:04.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.630+0000 7f5c34ff9700 1 -- 172.21.15.96:0/1543244818 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f5c300599f0 con 0x7f5c38101840 2024-02-19T19:04:04.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:04 smithi125 ceph-mon[37556]: pgmap v10: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-02-19T19:04:04.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:04 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:04:04.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.835+0000 7f5c3e09e700 1 -- 172.21.15.96:0/1543244818 --> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c380611d0 con 0x7f5c2406ce40 2024-02-19T19:04:04.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.847+0000 7f5c34ff9700 1 -- 172.21.15.96:0/1543244818 <== mgr.24347 v2:172.21.15.125:6828/1031992411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f5c380611d0 con 0x7f5c2406ce40 2024-02-19T19:04:04.868 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:04:04.868 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (6m) 5s ago 7m 25.1M - 0.25.0 c8568f914cd2 5dc55ac32e98 2024-02-19T19:04:04.868 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (8m) 5s ago 8m 7708k - 18.2.1 94eadd990e0a b41bff2e0043 2024-02-19T19:04:04.868 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (6m) 7s ago 6m 7596k - 18.2.1 94eadd990e0a 254ab7e7a040 2024-02-19T19:04:04.868 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (8m) 5s ago 8m 6660k - 18.2.1 94eadd990e0a 9250aadb9d78 2024-02-19T19:04:04.868 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (6m) 7s ago 6m 6665k - 18.2.1 94eadd990e0a b98ace7b5ded 2024-02-19T19:04:04.868 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (6m) 5s ago 7m 84.0M - 9.4.7 954c08fa6188 467f574356d5 2024-02-19T19:04:04.868 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (2m) 5s ago 2m 26.1M - 18.2.1 94eadd990e0a 0a61d9cd40d1 2024-02-19T19:04:04.868 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (2m) 5s ago 2m 17.9M - 18.2.1 94eadd990e0a 58db3e7a7d75 2024-02-19T19:04:04.868 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (2m) 7s ago 2m 21.3M - 18.2.1 94eadd990e0a 211d64de8a63 2024-02-19T19:04:04.868 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (2m) 7s ago 2m 20.3M - 18.2.1 94eadd990e0a 2a04b5a8eaf4 2024-02-19T19:04:04.869 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:9283,8765,8443 running (9m) 5s ago 9m 378M - 18.2.1 94eadd990e0a b062fd3d5963 2024-02-19T19:04:04.869 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (23s) 7s ago 6m 493M - 19.0.0-1450-gf78a58c0 f081f847070a f81e955ba64c 2024-02-19T19:04:04.869 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (9m) 5s ago 9m 49.5M 2048M 18.2.1 94eadd990e0a 23d5b9626c48 2024-02-19T19:04:04.869 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (6m) 7s ago 6m 40.9M 2048M 18.2.1 94eadd990e0a 27b4cad04cc5 2024-02-19T19:04:04.869 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (8m) 5s ago 8m 15.0M - 1.5.0 0da6a335fe13 97e9e93f8e15 2024-02-19T19:04:04.869 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (6m) 7s ago 6m 15.2M - 1.5.0 0da6a335fe13 fc1d96c078d9 2024-02-19T19:04:04.869 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (5m) 5s ago 5m 49.0M 1216M 18.2.1 94eadd990e0a d5bbf07ad0e7 2024-02-19T19:04:04.869 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (5m) 5s ago 5m 48.6M 1216M 18.2.1 94eadd990e0a 40329d59be45 2024-02-19T19:04:04.869 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4m) 5s ago 4m 47.6M 1216M 18.2.1 94eadd990e0a 4f1e49db2d41 2024-02-19T19:04:04.869 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (4m) 7s ago 4m 48.4M 4970M 18.2.1 94eadd990e0a 4746b79351fc 2024-02-19T19:04:04.869 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (4m) 7s ago 4m 48.5M 4970M 18.2.1 94eadd990e0a 2b3f0088f6b2 2024-02-19T19:04:04.869 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (3m) 7s ago 3m 45.2M 4970M 18.2.1 94eadd990e0a e5731974b46a 2024-02-19T19:04:04.869 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (6m) 5s ago 7m 61.1M - 2.43.0 a07b618ecd1d e00101f00f57 2024-02-19T19:04:04.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.849+0000 7f5c3e09e700 1 -- 172.21.15.96:0/1543244818 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7f5c2406ce40 msgr2=0x7f5c2406f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:04.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.849+0000 7f5c3e09e700 1 --2- 172.21.15.96:0/1543244818 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7f5c2406ce40 0x7f5c2406f300 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5c200059d0 tx=0x7f5c20005920 comp rx=0 tx=0).stop 2024-02-19T19:04:04.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.849+0000 7f5c3e09e700 1 -- 172.21.15.96:0/1543244818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c38101840 msgr2=0x7f5c381011a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:04.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.849+0000 7f5c3e09e700 1 --2- 172.21.15.96:0/1543244818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c38101840 0x7f5c381011a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000b4b0 tx=0x7f5c3000b870 comp rx=0 tx=0).stop 2024-02-19T19:04:04.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.849+0000 7f5c3e09e700 1 -- 172.21.15.96:0/1543244818 shutdown_connections 2024-02-19T19:04:04.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.849+0000 7f5c3e09e700 1 --2- 172.21.15.96:0/1543244818 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c38101840 0x7f5c381011a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.849+0000 7f5c3e09e700 1 --2- 172.21.15.96:0/1543244818 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7f5c2406ce40 0x7f5c2406f300 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.849+0000 7f5c3e09e700 1 --2- 172.21.15.96:0/1543244818 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c38104170 0x7f5c380ff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.849+0000 7f5c3e09e700 1 -- 172.21.15.96:0/1543244818 >> 172.21.15.96:0/1543244818 conn(0x7f5c380fb190 msgr2=0x7f5c380fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:04.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.849+0000 7f5c3e09e700 1 -- 172.21.15.96:0/1543244818 shutdown_connections 2024-02-19T19:04:04.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.849+0000 7f5c3e09e700 1 -- 172.21.15.96:0/1543244818 wait complete. 2024-02-19T19:04:04.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.952+0000 7fb4fcb10700 1 -- 172.21.15.96:0/3986476702 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4f8100dc0 msgr2=0x7fb4f8101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:04.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.952+0000 7fb4fcb10700 1 --2- 172.21.15.96:0/3986476702 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4f8100dc0 0x7fb4f8101220 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec009910 tx=0x7fb4ec009c20 comp rx=0 tx=0).stop 2024-02-19T19:04:04.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.953+0000 7fb4fcb10700 1 -- 172.21.15.96:0/3986476702 shutdown_connections 2024-02-19T19:04:04.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.953+0000 7fb4fcb10700 1 --2- 172.21.15.96:0/3986476702 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4f8100dc0 0x7fb4f8101220 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.953+0000 7fb4fcb10700 1 --2- 172.21.15.96:0/3986476702 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4f80ffbc0 0x7fb4f80fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.953+0000 7fb4fcb10700 1 -- 172.21.15.96:0/3986476702 >> 172.21.15.96:0/3986476702 conn(0x7fb4f80fb160 msgr2=0x7fb4f80fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:04.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.953+0000 7fb4fcb10700 1 -- 172.21.15.96:0/3986476702 shutdown_connections 2024-02-19T19:04:04.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.953+0000 7fb4fcb10700 1 -- 172.21.15.96:0/3986476702 wait complete. 2024-02-19T19:04:04.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.953+0000 7fb4fcb10700 1 Processor -- start 2024-02-19T19:04:04.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.953+0000 7fb4fcb10700 1 -- start start 2024-02-19T19:04:04.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.954+0000 7fb4fcb10700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4f80ffbc0 0x7fb4f8198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:04.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.954+0000 7fb4fcb10700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4f8100dc0 0x7fb4f8198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:04.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.954+0000 7fb4fcb10700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f81995c0 con 0x7fb4f8100dc0 2024-02-19T19:04:04.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.954+0000 7fb4fcb10700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f8199700 con 0x7fb4f80ffbc0 2024-02-19T19:04:04.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.954+0000 7fb4f5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4f8100dc0 0x7fb4f8198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:04.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.954+0000 7fb4f5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4f8100dc0 0x7fb4f8198fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57702/0 (socket says 172.21.15.96:57702) 2024-02-19T19:04:04.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.954+0000 7fb4f5d9b700 1 -- 172.21.15.96:0/3229007158 learned_addr learned my addr 172.21.15.96:0/3229007158 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:04:04.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.954+0000 7fb4f659c700 1 --2- 172.21.15.96:0/3229007158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4f80ffbc0 0x7fb4f8198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:04.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.954+0000 7fb4f5d9b700 1 -- 172.21.15.96:0/3229007158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4f80ffbc0 msgr2=0x7fb4f8198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:04.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.954+0000 7fb4f5d9b700 1 --2- 172.21.15.96:0/3229007158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4f80ffbc0 0x7fb4f8198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:04.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.954+0000 7fb4f5d9b700 1 -- 172.21.15.96:0/3229007158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec0095f0 con 0x7fb4f8100dc0 2024-02-19T19:04:04.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.954+0000 7fb4f5d9b700 1 --2- 172.21.15.96:0/3229007158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4f8100dc0 0x7fb4f8198fa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec006010 tx=0x7fb4ec00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:04.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.955+0000 7fb4e77fe700 1 -- 172.21.15.96:0/3229007158 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4ec01d070 con 0x7fb4f8100dc0 2024-02-19T19:04:04.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.955+0000 7fb4e77fe700 1 -- 172.21.15.96:0/3229007158 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb4ec00f460 con 0x7fb4f8100dc0 2024-02-19T19:04:04.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.955+0000 7fb4fcb10700 1 -- 172.21.15.96:0/3229007158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f819e150 con 0x7fb4f8100dc0 2024-02-19T19:04:04.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.955+0000 7fb4e77fe700 1 -- 172.21.15.96:0/3229007158 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb4ec021640 con 0x7fb4f8100dc0 2024-02-19T19:04:04.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.955+0000 7fb4fcb10700 1 -- 172.21.15.96:0/3229007158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f819e640 con 0x7fb4f8100dc0 2024-02-19T19:04:04.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.956+0000 7fb4fcb10700 1 -- 172.21.15.96:0/3229007158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f8068af0 con 0x7fb4f8100dc0 2024-02-19T19:04:04.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.956+0000 7fb4e77fe700 1 -- 172.21.15.96:0/3229007158 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 24) v1 ==== 90933+0+0 (secure 0 0 0) 0x7fb4ec00fab0 con 0x7fb4f8100dc0 2024-02-19T19:04:04.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.957+0000 7fb4e77fe700 1 --2- 172.21.15.96:0/3229007158 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7fb4e006ce40 0x7fb4e006f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:04.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.957+0000 7fb4e77fe700 1 -- 172.21.15.96:0/3229007158 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fb4ec08da30 con 0x7fb4f8100dc0 2024-02-19T19:04:04.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.957+0000 7fb4f659c700 1 --2- 172.21.15.96:0/3229007158 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7fb4e006ce40 0x7fb4e006f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:04.978 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.957+0000 7fb4f659c700 1 --2- 172.21.15.96:0/3229007158 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7fb4e006ce40 0x7fb4e006f300 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8100c20 tx=0x7fb4e8009190 comp rx=0 tx=0).ready entity=mgr.24347 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:04.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:04.961+0000 7fb4e77fe700 1 -- 172.21.15.96:0/3229007158 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fb4ec05b170 con 0x7fb4f8100dc0 2024-02-19T19:04:05.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.236+0000 7fb4fcb10700 1 -- 172.21.15.96:0/3229007158 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb4f819ed00 con 0x7fb4f8100dc0 2024-02-19T19:04:05.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.237+0000 7fb4e77fe700 1 -- 172.21.15.96:0/3229007158 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+766 (secure 0 0 0) 0x7fb4ec05ad00 con 0x7fb4f8100dc0 2024-02-19T19:04:05.257 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:04:05.257 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:04:05.257 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-19T19:04:05.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:04:05.258 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:04:05.258 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 1, 2024-02-19T19:04:05.258 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-19T19:04:05.258 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:04:05.258 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:04:05.258 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-19T19:04:05.258 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:04:05.258 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:04:05.258 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-19T19:04:05.258 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:04:05.258 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:04:05.258 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 13, 2024-02-19T19:04:05.258 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-19T19:04:05.258 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:04:05.258 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:04:05.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.239+0000 7fb4fcb10700 1 -- 172.21.15.96:0/3229007158 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7fb4e006ce40 msgr2=0x7fb4e006f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:05.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.239+0000 7fb4fcb10700 1 --2- 172.21.15.96:0/3229007158 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7fb4e006ce40 0x7fb4e006f300 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8100c20 tx=0x7fb4e8009190 comp rx=0 tx=0).stop 2024-02-19T19:04:05.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.239+0000 7fb4fcb10700 1 -- 172.21.15.96:0/3229007158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4f8100dc0 msgr2=0x7fb4f8198fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:05.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.239+0000 7fb4fcb10700 1 --2- 172.21.15.96:0/3229007158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4f8100dc0 0x7fb4f8198fa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec006010 tx=0x7fb4ec00bd70 comp rx=0 tx=0).stop 2024-02-19T19:04:05.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.239+0000 7fb4fcb10700 1 -- 172.21.15.96:0/3229007158 shutdown_connections 2024-02-19T19:04:05.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.239+0000 7fb4fcb10700 1 --2- 172.21.15.96:0/3229007158 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7fb4e006ce40 0x7fb4e006f300 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.239+0000 7fb4fcb10700 1 --2- 172.21.15.96:0/3229007158 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4f80ffbc0 0x7fb4f8198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.239+0000 7fb4fcb10700 1 --2- 172.21.15.96:0/3229007158 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4f8100dc0 0x7fb4f8198fa0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.239+0000 7fb4fcb10700 1 -- 172.21.15.96:0/3229007158 >> 172.21.15.96:0/3229007158 conn(0x7fb4f80fb160 msgr2=0x7fb4f8068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:05.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.239+0000 7fb4fcb10700 1 -- 172.21.15.96:0/3229007158 shutdown_connections 2024-02-19T19:04:05.260 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.239+0000 7fb4fcb10700 1 -- 172.21.15.96:0/3229007158 wait complete. 2024-02-19T19:04:05.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.346+0000 7f421e6ef700 1 -- 172.21.15.96:0/1510476166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42180ffbc0 msgr2=0x7f42180fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:05.366 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.346+0000 7f421e6ef700 1 --2- 172.21.15.96:0/1510476166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42180ffbc0 0x7f42180fffe0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f420c009910 tx=0x7f420c009c20 comp rx=0 tx=0).stop 2024-02-19T19:04:05.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.346+0000 7f421e6ef700 1 -- 172.21.15.96:0/1510476166 shutdown_connections 2024-02-19T19:04:05.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.346+0000 7f421e6ef700 1 --2- 172.21.15.96:0/1510476166 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4218100dc0 0x7f4218101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.346+0000 7f421e6ef700 1 --2- 172.21.15.96:0/1510476166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f42180ffbc0 0x7f42180fffe0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.346+0000 7f421e6ef700 1 -- 172.21.15.96:0/1510476166 >> 172.21.15.96:0/1510476166 conn(0x7f42180fb160 msgr2=0x7f42180fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:05.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.346+0000 7f421e6ef700 1 -- 172.21.15.96:0/1510476166 shutdown_connections 2024-02-19T19:04:05.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.346+0000 7f421e6ef700 1 -- 172.21.15.96:0/1510476166 wait complete. 2024-02-19T19:04:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.346+0000 7f421e6ef700 1 Processor -- start 2024-02-19T19:04:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.346+0000 7f421e6ef700 1 -- start start 2024-02-19T19:04:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.347+0000 7f421e6ef700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42180ffbc0 0x7f4218196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.347+0000 7f421e6ef700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4218100dc0 0x7f4218196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.347+0000 7f421e6ef700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42181973c0 con 0x7f4218100dc0 2024-02-19T19:04:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.347+0000 7f421e6ef700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4218197500 con 0x7f42180ffbc0 2024-02-19T19:04:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.347+0000 7f42177fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4218100dc0 0x7f4218196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.347+0000 7f42177fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4218100dc0 0x7f4218196da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57720/0 (socket says 172.21.15.96:57720) 2024-02-19T19:04:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.347+0000 7f42177fe700 1 -- 172.21.15.96:0/1598304778 learned_addr learned my addr 172.21.15.96:0/1598304778 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:04:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.347+0000 7f4217fff700 1 --2- 172.21.15.96:0/1598304778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42180ffbc0 0x7f4218196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.347+0000 7f42177fe700 1 -- 172.21.15.96:0/1598304778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42180ffbc0 msgr2=0x7f4218196860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.347+0000 7f42177fe700 1 --2- 172.21.15.96:0/1598304778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42180ffbc0 0x7f4218196860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.347+0000 7f42177fe700 1 -- 172.21.15.96:0/1598304778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c0095f0 con 0x7f4218100dc0 2024-02-19T19:04:05.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.347+0000 7f42177fe700 1 --2- 172.21.15.96:0/1598304778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4218100dc0 0x7f4218196da0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f420800b4b0 tx=0x7f420800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:05.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.348+0000 7f42157fa700 1 -- 172.21.15.96:0/1598304778 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4208011800 con 0x7f4218100dc0 2024-02-19T19:04:05.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.348+0000 7f42157fa700 1 -- 172.21.15.96:0/1598304778 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4208011e10 con 0x7f4218100dc0 2024-02-19T19:04:05.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.348+0000 7f421e6ef700 1 -- 172.21.15.96:0/1598304778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f421819bfb0 con 0x7f4218100dc0 2024-02-19T19:04:05.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.348+0000 7f42157fa700 1 -- 172.21.15.96:0/1598304778 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f420800f2e0 con 0x7f4218100dc0 2024-02-19T19:04:05.370 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.348+0000 7f421e6ef700 1 -- 172.21.15.96:0/1598304778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421819c4d0 con 0x7f4218100dc0 2024-02-19T19:04:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.349+0000 7f421e6ef700 1 -- 172.21.15.96:0/1598304778 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4218068af0 con 0x7f4218100dc0 2024-02-19T19:04:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.349+0000 7f42157fa700 1 -- 172.21.15.96:0/1598304778 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 24) v1 ==== 90933+0+0 (secure 0 0 0) 0x7f4208011960 con 0x7f4218100dc0 2024-02-19T19:04:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.349+0000 7f42157fa700 1 --2- 172.21.15.96:0/1598304778 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7f420006ce30 0x7f420006f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.350+0000 7f42157fa700 1 -- 172.21.15.96:0/1598304778 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f420808c120 con 0x7f4218100dc0 2024-02-19T19:04:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.350+0000 7f4217fff700 1 --2- 172.21.15.96:0/1598304778 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7f420006ce30 0x7f420006f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:05.371 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.350+0000 7f4217fff700 1 --2- 172.21.15.96:0/1598304778 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7f420006ce30 0x7f420006f2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f420c006010 tx=0x7f420c00b560 comp rx=0 tx=0).ready entity=mgr.24347 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:05.375 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.354+0000 7f42157fa700 1 -- 172.21.15.96:0/1598304778 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f4208059970 con 0x7f4218100dc0 2024-02-19T19:04:05.535 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:05 smithi096 ceph-mon[29216]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:05.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:05 smithi096 ceph-mon[29216]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:05.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:05 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/3229007158' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:05.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.569+0000 7f421e6ef700 1 -- 172.21.15.96:0/1598304778 --> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4218069580 con 0x7f420006ce30 2024-02-19T19:04:05.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.571+0000 7f42157fa700 1 -- 172.21.15.96:0/1598304778 <== mgr.24347 v2:172.21.15.125:6828/1031992411 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f4218069580 con 0x7f420006ce30 2024-02-19T19:04:05.591 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:04:05.592 INFO:teuthology.orchestra.run.smithi096.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:04:05.592 INFO:teuthology.orchestra.run.smithi096.stdout: "in_progress": true, 2024-02-19T19:04:05.592 INFO:teuthology.orchestra.run.smithi096.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-19T19:04:05.592 INFO:teuthology.orchestra.run.smithi096.stdout: "services_complete": [], 2024-02-19T19:04:05.592 INFO:teuthology.orchestra.run.smithi096.stdout: "progress": "1/2 daemons upgraded", 2024-02-19T19:04:05.592 INFO:teuthology.orchestra.run.smithi096.stdout: "message": "", 2024-02-19T19:04:05.592 INFO:teuthology.orchestra.run.smithi096.stdout: "is_paused": false 2024-02-19T19:04:05.592 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:04:05.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.573+0000 7f421e6ef700 1 -- 172.21.15.96:0/1598304778 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7f420006ce30 msgr2=0x7f420006f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:05.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.573+0000 7f421e6ef700 1 --2- 172.21.15.96:0/1598304778 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7f420006ce30 0x7f420006f2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f420c006010 tx=0x7f420c00b560 comp rx=0 tx=0).stop 2024-02-19T19:04:05.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.573+0000 7f421e6ef700 1 -- 172.21.15.96:0/1598304778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4218100dc0 msgr2=0x7f4218196da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:05.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.573+0000 7f421e6ef700 1 --2- 172.21.15.96:0/1598304778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4218100dc0 0x7f4218196da0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f420800b4b0 tx=0x7f420800b7c0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.573+0000 7f421e6ef700 1 -- 172.21.15.96:0/1598304778 shutdown_connections 2024-02-19T19:04:05.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.573+0000 7f421e6ef700 1 --2- 172.21.15.96:0/1598304778 >> [v2:172.21.15.125:6828/1031992411,v1:172.21.15.125:6829/1031992411] conn(0x7f420006ce30 0x7f420006f2f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.573+0000 7f421e6ef700 1 --2- 172.21.15.96:0/1598304778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42180ffbc0 0x7f4218196860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.573+0000 7f421e6ef700 1 --2- 172.21.15.96:0/1598304778 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4218100dc0 0x7f4218196da0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:05.594 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.573+0000 7f421e6ef700 1 -- 172.21.15.96:0/1598304778 >> 172.21.15.96:0/1598304778 conn(0x7f42180fb160 msgr2=0x7f4218068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:05.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.573+0000 7f421e6ef700 1 -- 172.21.15.96:0/1598304778 shutdown_connections 2024-02-19T19:04:05.595 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:05.573+0000 7f421e6ef700 1 -- 172.21.15.96:0/1598304778 wait complete. 2024-02-19T19:04:05.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:05 smithi125 ceph-mon[37556]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:05.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:05 smithi125 ceph-mon[37556]: from='client.14636 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:05.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:05 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/3229007158' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:06.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:06 smithi125 ceph-mon[37556]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:06.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:06 smithi125 ceph-mon[37556]: pgmap v11: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-02-19T19:04:06.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:06 smithi125 ceph-mon[37556]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:06.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:06 smithi096 ceph-mon[29216]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:06.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:06 smithi096 ceph-mon[29216]: pgmap v11: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-02-19T19:04:06.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:06 smithi096 ceph-mon[29216]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:08.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:07 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:08.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:07 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:08.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:07 smithi096 ceph-mon[29216]: pgmap v12: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-19T19:04:08.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:07 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:08.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:07 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:08.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:07 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:08.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:07 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:08.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:07 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:08.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:07 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:08.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:07 smithi096 ceph-mon[29216]: Adjusting osd_memory_target on smithi125 to 2240M 2024-02-19T19:04:08.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:07 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:08.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:07 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:04:08.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:07 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:04:08.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:07 smithi096 ceph-mon[29216]: Updating smithi096:/etc/ceph/ceph.conf 2024-02-19T19:04:08.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:07 smithi096 ceph-mon[29216]: Updating smithi125:/etc/ceph/ceph.conf 2024-02-19T19:04:08.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:07 smithi096 ceph-mon[29216]: Updating smithi096:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:04:08.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:07 smithi096 ceph-mon[29216]: Updating smithi125:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:04:08.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:07 smithi096 ceph-mon[29216]: Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:04:08.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:07 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:08.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:07 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:08.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:07 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:08.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:07 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:08.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:07 smithi125 ceph-mon[37556]: pgmap v12: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-19T19:04:08.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:07 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:08.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:07 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:08.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:07 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:08.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:07 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:08.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:07 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:08.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:07 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-19T19:04:08.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:07 smithi125 ceph-mon[37556]: Adjusting osd_memory_target on smithi125 to 2240M 2024-02-19T19:04:08.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:07 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:08.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:07 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:04:08.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:07 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:04:08.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:07 smithi125 ceph-mon[37556]: Updating smithi096:/etc/ceph/ceph.conf 2024-02-19T19:04:08.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:07 smithi125 ceph-mon[37556]: Updating smithi125:/etc/ceph/ceph.conf 2024-02-19T19:04:08.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:07 smithi125 ceph-mon[37556]: Updating smithi096:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:04:08.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:07 smithi125 ceph-mon[37556]: Updating smithi125:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:04:08.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:07 smithi125 ceph-mon[37556]: Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:04:08.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:07 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:08.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:07 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:09.639 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:09 smithi096 ceph-mon[29216]: Updating smithi125:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:04:09.639 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:09 smithi096 ceph-mon[29216]: Updating smithi096:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:04:09.639 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:09 smithi096 ceph-mon[29216]: Updating smithi125:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:04:09.639 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:09 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:09.639 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:09 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:09.640 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:09 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:09.640 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:09 smithi096 ceph-mon[29216]: Reconfiguring prometheus.smithi096 (dependencies changed)... 2024-02-19T19:04:09.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:09 smithi125 ceph-mon[37556]: Updating smithi125:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:04:09.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:09 smithi125 ceph-mon[37556]: Updating smithi096:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:04:09.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:09 smithi125 ceph-mon[37556]: Updating smithi125:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:04:09.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:09 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:09.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:09 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:09.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:09 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:09.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:09 smithi125 ceph-mon[37556]: Reconfiguring prometheus.smithi096 (dependencies changed)... 2024-02-19T19:04:10.679 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:10 smithi096 ceph-mon[29216]: Reconfiguring daemon prometheus.smithi096 on smithi096 2024-02-19T19:04:10.680 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:10 smithi096 ceph-mon[29216]: pgmap v13: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:04:10.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:10 smithi125 ceph-mon[37556]: Reconfiguring daemon prometheus.smithi096 on smithi096 2024-02-19T19:04:10.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:10 smithi125 ceph-mon[37556]: pgmap v13: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:04:12.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:12 smithi096 ceph-mon[29216]: pgmap v14: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:04:12.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:12 smithi125 ceph-mon[37556]: pgmap v14: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:04:14.686 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:14 smithi096 ceph-mon[29216]: pgmap v15: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:04:14.687 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:14 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:14.687 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:14 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:14.687 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:14 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:04:14.687 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:14 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:14.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:14 smithi125 ceph-mon[37556]: pgmap v15: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:04:14.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:14 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:14.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:14 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:14.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:14 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:04:14.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:14 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:15.754 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:15 smithi096 ceph-mon[29216]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:04:15.755 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:15 smithi096 ceph-mon[29216]: Upgrade: Need to upgrade myself (mgr.smithi125.ygdmdu) 2024-02-19T19:04:15.755 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:15 smithi096 ceph-mon[29216]: Upgrade: Need to upgrade myself (mgr.smithi125.ygdmdu) 2024-02-19T19:04:15.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:15 smithi125 ceph-mon[37556]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:04:15.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:15 smithi125 ceph-mon[37556]: Upgrade: Need to upgrade myself (mgr.smithi125.ygdmdu) 2024-02-19T19:04:15.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:15 smithi125 ceph-mon[37556]: Upgrade: Need to upgrade myself (mgr.smithi125.ygdmdu) 2024-02-19T19:04:16.566 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:16 smithi096 ceph-mon[29216]: pgmap v16: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:04:16.567 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:16 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:16.567 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:16 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi096.zsjdff", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:04:16.567 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:16 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi096.zsjdff", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:04:16.567 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:16 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T19:04:16.567 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:16 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:04:16.852 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:16 smithi125 ceph-mon[37556]: pgmap v16: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:04:16.852 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:16 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:16.852 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:16 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi096.zsjdff", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:04:16.852 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:16 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi096.zsjdff", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:04:16.852 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:16 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T19:04:16.853 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:16 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:04:17.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:17 smithi096 ceph-mon[29216]: Upgrade: Updating mgr.smithi096.zsjdff 2024-02-19T19:04:17.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:17 smithi096 ceph-mon[29216]: Deploying daemon mgr.smithi096.zsjdff on smithi096 2024-02-19T19:04:17.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:17 smithi125 ceph-mon[37556]: Upgrade: Updating mgr.smithi096.zsjdff 2024-02-19T19:04:17.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:17 smithi125 ceph-mon[37556]: Deploying daemon mgr.smithi096.zsjdff on smithi096 2024-02-19T19:04:18.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:18 smithi096 ceph-mon[29216]: pgmap v17: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:04:18.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:18 smithi125 ceph-mon[37556]: pgmap v17: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:04:19.637 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:19 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:04:19.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:19 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:04:20.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:20 smithi096 ceph-mon[29216]: pgmap v18: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:04:20.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:20 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:20.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:20 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:20.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:20 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:20.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:20 smithi125 ceph-mon[37556]: pgmap v18: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:04:20.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:20 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:20.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:20 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:20.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:20 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:22.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:22 smithi096 ceph-mon[29216]: pgmap v19: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:04:22.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:22 smithi125 ceph-mon[37556]: pgmap v19: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:04:24.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:24 smithi096 ceph-mon[29216]: pgmap v20: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:04:24.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:24 smithi125 ceph-mon[37556]: pgmap v20: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:04:26.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:26 smithi096 ceph-mon[29216]: pgmap v21: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:04:26.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:26 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:26.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:26 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:26.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:26 smithi125 ceph-mon[37556]: pgmap v21: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:04:26.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:26 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:26.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:26 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:27.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:27 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:27.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:27 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:27.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:27 smithi096 ceph-mon[29216]: Standby manager daemon smithi096.zsjdff restarted 2024-02-19T19:04:27.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:27 smithi096 ceph-mon[29216]: Standby manager daemon smithi096.zsjdff started 2024-02-19T19:04:27.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:27 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi096.zsjdff/crt"}]: dispatch 2024-02-19T19:04:27.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:27 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:04:27.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:27 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi096.zsjdff/key"}]: dispatch 2024-02-19T19:04:27.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:27 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:04:27.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:27 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:27.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:27 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:27.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:27 smithi125 ceph-mon[37556]: Standby manager daemon smithi096.zsjdff restarted 2024-02-19T19:04:27.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:27 smithi125 ceph-mon[37556]: Standby manager daemon smithi096.zsjdff started 2024-02-19T19:04:27.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:27 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi096.zsjdff/crt"}]: dispatch 2024-02-19T19:04:27.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:27 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:04:27.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:27 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi096.zsjdff/key"}]: dispatch 2024-02-19T19:04:27.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:27 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:04:28.450 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:28 smithi125 ceph-mon[37556]: pgmap v22: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:04:28.450 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:28 smithi125 ceph-mon[37556]: mgrmap e25: smithi125.ygdmdu(active, since 38s), standbys: smithi096.zsjdff 2024-02-19T19:04:28.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:28 smithi096 ceph-mon[29216]: pgmap v22: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:04:28.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:28 smithi096 ceph-mon[29216]: mgrmap e25: smithi125.ygdmdu(active, since 38s), standbys: smithi096.zsjdff 2024-02-19T19:04:30.616 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: pgmap v23: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:04:30.616 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:30.616 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:30.616 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:04:30.616 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:04:30.616 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:30.616 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:30.616 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mgr fail", "who": "smithi125.ygdmdu"}]: dispatch 2024-02-19T19:04:30.616 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mgr fail", "who": "smithi125.ygdmdu"}]: dispatch 2024-02-19T19:04:30.616 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: osdmap e48: 6 total, 6 up, 6 in 2024-02-19T19:04:30.616 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' cmd='[{"prefix": "mgr fail", "who": "smithi125.ygdmdu"}]': finished 2024-02-19T19:04:30.616 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: mgrmap e26: smithi096.zsjdff(active, starting, since 0.00805319s) 2024-02-19T19:04:30.617 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2024-02-19T19:04:30.617 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T19:04:30.617 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pccmys"}]: dispatch 2024-02-19T19:04:30.617 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.usrmcg"}]: dispatch 2024-02-19T19:04:30.617 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.srnlol"}]: dispatch 2024-02-19T19:04:30.617 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.pwyuga"}]: dispatch 2024-02-19T19:04:30.617 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr metadata", "who": "smithi096.zsjdff", "id": "smithi096.zsjdff"}]: dispatch 2024-02-19T19:04:30.617 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T19:04:30.617 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T19:04:30.617 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T19:04:30.617 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T19:04:30.617 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:04:30.617 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:04:30.617 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T19:04:30.617 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T19:04:30.617 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T19:04:30.618 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: Manager daemon smithi096.zsjdff is now available 2024-02-19T19:04:30.618 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:30.618 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:30.618 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:04:30.618 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.zsjdff/mirror_snapshot_schedule"}]: dispatch 2024-02-19T19:04:30.618 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.zsjdff/trash_purge_schedule"}]: dispatch 2024-02-19T19:04:30.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: pgmap v23: 65 pgs: 65 active+clean; 591 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:04:30.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:30.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:30.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:04:30.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:04:30.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' 2024-02-19T19:04:30.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:30.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.24347 172.21.15.125:0/3541370197' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mgr fail", "who": "smithi125.ygdmdu"}]: dispatch 2024-02-19T19:04:30.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "mgr fail", "who": "smithi125.ygdmdu"}]: dispatch 2024-02-19T19:04:30.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: osdmap e48: 6 total, 6 up, 6 in 2024-02-19T19:04:30.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.24347 ' entity='mgr.smithi125.ygdmdu' cmd='[{"prefix": "mgr fail", "who": "smithi125.ygdmdu"}]': finished 2024-02-19T19:04:30.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: mgrmap e26: smithi096.zsjdff(active, starting, since 0.00805319s) 2024-02-19T19:04:30.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2024-02-19T19:04:30.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T19:04:30.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pccmys"}]: dispatch 2024-02-19T19:04:30.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.usrmcg"}]: dispatch 2024-02-19T19:04:30.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.srnlol"}]: dispatch 2024-02-19T19:04:30.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.pwyuga"}]: dispatch 2024-02-19T19:04:30.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr metadata", "who": "smithi096.zsjdff", "id": "smithi096.zsjdff"}]: dispatch 2024-02-19T19:04:30.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T19:04:30.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T19:04:30.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T19:04:30.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T19:04:30.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:04:30.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:04:30.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T19:04:30.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T19:04:30.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T19:04:30.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: Manager daemon smithi096.zsjdff is now available 2024-02-19T19:04:30.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:30.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:30.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:04:30.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.zsjdff/mirror_snapshot_schedule"}]: dispatch 2024-02-19T19:04:30.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.zsjdff/trash_purge_schedule"}]: dispatch 2024-02-19T19:04:32.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:32 smithi096 ceph-mon[29216]: [19/Feb/2024:19:04:30] ENGINE Bus STARTING 2024-02-19T19:04:32.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:32 smithi096 ceph-mon[29216]: [19/Feb/2024:19:04:30] ENGINE Serving on http://172.21.15.96:8765 2024-02-19T19:04:32.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:32 smithi096 ceph-mon[29216]: mgrmap e27: smithi096.zsjdff(active, since 1.00967s) 2024-02-19T19:04:32.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:32 smithi096 ceph-mon[29216]: [19/Feb/2024:19:04:31] ENGINE Serving on https://172.21.15.96:7150 2024-02-19T19:04:32.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:32 smithi096 ceph-mon[29216]: [19/Feb/2024:19:04:31] ENGINE Bus STARTED 2024-02-19T19:04:32.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:32 smithi096 ceph-mon[29216]: pgmap v3: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:32.318 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:32 smithi125 ceph-mon[37556]: [19/Feb/2024:19:04:30] ENGINE Bus STARTING 2024-02-19T19:04:32.318 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:32 smithi125 ceph-mon[37556]: [19/Feb/2024:19:04:30] ENGINE Serving on http://172.21.15.96:8765 2024-02-19T19:04:32.318 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:32 smithi125 ceph-mon[37556]: mgrmap e27: smithi096.zsjdff(active, since 1.00967s) 2024-02-19T19:04:32.318 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:32 smithi125 ceph-mon[37556]: [19/Feb/2024:19:04:31] ENGINE Serving on https://172.21.15.96:7150 2024-02-19T19:04:32.318 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:32 smithi125 ceph-mon[37556]: [19/Feb/2024:19:04:31] ENGINE Bus STARTED 2024-02-19T19:04:32.318 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:32 smithi125 ceph-mon[37556]: pgmap v3: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:33.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:33 smithi125 ceph-mon[37556]: pgmap v4: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:33.480 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:33 smithi096 ceph-mon[29216]: pgmap v4: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:34.421 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:34 smithi096 ceph-mon[29216]: mgrmap e28: smithi096.zsjdff(active, since 3s) 2024-02-19T19:04:34.421 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:34 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:34.421 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:34 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:34.442 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:34 smithi125 ceph-mon[37556]: mgrmap e28: smithi096.zsjdff(active, since 3s) 2024-02-19T19:04:34.443 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:34 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:34.443 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:34 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:35.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.692+0000 7f6b09524700 1 -- 172.21.15.96:0/537814075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b04101740 msgr2=0x7f6b04103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:35.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.692+0000 7f6b09524700 1 --2- 172.21.15.96:0/537814075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b04101740 0x7f6b04103b30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6af4009910 tx=0x7f6af4009c20 comp rx=0 tx=0).stop 2024-02-19T19:04:35.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.692+0000 7f6b09524700 1 -- 172.21.15.96:0/537814075 shutdown_connections 2024-02-19T19:04:35.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.692+0000 7f6b09524700 1 --2- 172.21.15.96:0/537814075 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b04104070 0x7f6b04106460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:35.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.692+0000 7f6b09524700 1 --2- 172.21.15.96:0/537814075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b04101740 0x7f6b04103b30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:35.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.692+0000 7f6b09524700 1 -- 172.21.15.96:0/537814075 >> 172.21.15.96:0/537814075 conn(0x7f6b040fb150 msgr2=0x7f6b040fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:35.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.692+0000 7f6b09524700 1 -- 172.21.15.96:0/537814075 shutdown_connections 2024-02-19T19:04:35.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.692+0000 7f6b09524700 1 -- 172.21.15.96:0/537814075 wait complete. 2024-02-19T19:04:35.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.693+0000 7f6b09524700 1 Processor -- start 2024-02-19T19:04:35.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.693+0000 7f6b09524700 1 -- start start 2024-02-19T19:04:35.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.693+0000 7f6b09524700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b04101740 0x7f6b041964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:35.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.693+0000 7f6b09524700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b04104070 0x7f6b041969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:35.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.693+0000 7f6b09524700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b04197000 con 0x7f6b04104070 2024-02-19T19:04:35.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.693+0000 7f6b09524700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b04197140 con 0x7f6b04101740 2024-02-19T19:04:35.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.693+0000 7f6afa7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b04104070 0x7f6b041969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:35.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.693+0000 7f6afa7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b04104070 0x7f6b041969e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58578/0 (socket says 172.21.15.96:58578) 2024-02-19T19:04:35.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.693+0000 7f6afa7fc700 1 -- 172.21.15.96:0/2543106084 learned_addr learned my addr 172.21.15.96:0/2543106084 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:04:35.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.693+0000 7f6b02ffd700 1 --2- 172.21.15.96:0/2543106084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b04101740 0x7f6b041964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:35.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.694+0000 7f6afa7fc700 1 -- 172.21.15.96:0/2543106084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b04101740 msgr2=0x7f6b041964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:35.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.694+0000 7f6afa7fc700 1 --2- 172.21.15.96:0/2543106084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b04101740 0x7f6b041964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:35.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.694+0000 7f6afa7fc700 1 -- 172.21.15.96:0/2543106084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af40095f0 con 0x7f6b04104070 2024-02-19T19:04:35.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.694+0000 7f6afa7fc700 1 --2- 172.21.15.96:0/2543106084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b04104070 0x7f6b041969e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00d8d0 tx=0x7f6aec00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:35.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.694+0000 7f6b00ff9700 1 -- 172.21.15.96:0/2543106084 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aec0098a0 con 0x7f6b04104070 2024-02-19T19:04:35.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.694+0000 7f6b00ff9700 1 -- 172.21.15.96:0/2543106084 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6aec010460 con 0x7f6b04104070 2024-02-19T19:04:35.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.694+0000 7f6b00ff9700 1 -- 172.21.15.96:0/2543106084 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aec00f5f0 con 0x7f6b04104070 2024-02-19T19:04:35.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.694+0000 7f6b09524700 1 -- 172.21.15.96:0/2543106084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b0419bbf0 con 0x7f6b04104070 2024-02-19T19:04:35.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.694+0000 7f6b09524700 1 -- 172.21.15.96:0/2543106084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0419c140 con 0x7f6b04104070 2024-02-19T19:04:35.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.695+0000 7f6b00ff9700 1 -- 172.21.15.96:0/2543106084 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 28) v1 ==== 46071+0+0 (secure 0 0 0) 0x7f6aec00f820 con 0x7f6b04104070 2024-02-19T19:04:35.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.695+0000 7f6b09524700 1 -- 172.21.15.96:0/2543106084 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b04190620 con 0x7f6b04104070 2024-02-19T19:04:35.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.695+0000 7f6b00ff9700 1 --2- 172.21.15.96:0/2543106084 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f6af0038eb0 0x7f6af003b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:35.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.695+0000 7f6b00ff9700 1 -- 172.21.15.96:0/2543106084 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f6aec04cfc0 con 0x7f6b04104070 2024-02-19T19:04:35.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.695+0000 7f6b02ffd700 1 --2- 172.21.15.96:0/2543106084 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f6af0038eb0 0x7f6af003b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:35.716 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.695+0000 7f6b02ffd700 1 --2- 172.21.15.96:0/2543106084 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f6af0038eb0 0x7f6af003b370 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6af4006010 tx=0x7f6af400b540 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:35.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.700+0000 7f6b00ff9700 1 -- 172.21.15.96:0/2543106084 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f6aec01ac40 con 0x7f6b04104070 2024-02-19T19:04:35.946 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.926+0000 7f6b09524700 1 -- 172.21.15.96:0/2543106084 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b040611d0 con 0x7f6af0038eb0 2024-02-19T19:04:35.946 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:35 smithi096 ceph-mon[29216]: pgmap v5: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:35.946 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:35 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:35.946 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:35 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:35.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.928+0000 7f6b00ff9700 1 -- 172.21.15.96:0/2543106084 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f6b040611d0 con 0x7f6af0038eb0 2024-02-19T19:04:35.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.930+0000 7f6b09524700 1 -- 172.21.15.96:0/2543106084 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f6af0038eb0 msgr2=0x7f6af003b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:35.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.930+0000 7f6b09524700 1 --2- 172.21.15.96:0/2543106084 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f6af0038eb0 0x7f6af003b370 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6af4006010 tx=0x7f6af400b540 comp rx=0 tx=0).stop 2024-02-19T19:04:35.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.930+0000 7f6b09524700 1 -- 172.21.15.96:0/2543106084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b04104070 msgr2=0x7f6b041969e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:35.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.930+0000 7f6b09524700 1 --2- 172.21.15.96:0/2543106084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b04104070 0x7f6b041969e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00d8d0 tx=0x7f6aec00dbe0 comp rx=0 tx=0).stop 2024-02-19T19:04:35.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.930+0000 7f6b09524700 1 -- 172.21.15.96:0/2543106084 shutdown_connections 2024-02-19T19:04:35.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.930+0000 7f6b09524700 1 --2- 172.21.15.96:0/2543106084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b04101740 0x7f6b041964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:35.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.930+0000 7f6b09524700 1 --2- 172.21.15.96:0/2543106084 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f6af0038eb0 0x7f6af003b370 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:35.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.930+0000 7f6b09524700 1 --2- 172.21.15.96:0/2543106084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b04104070 0x7f6b041969e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:35.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.930+0000 7f6b09524700 1 -- 172.21.15.96:0/2543106084 >> 172.21.15.96:0/2543106084 conn(0x7f6b040fb150 msgr2=0x7f6b040fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:35.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.931+0000 7f6b09524700 1 -- 172.21.15.96:0/2543106084 shutdown_connections 2024-02-19T19:04:35.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:35.931+0000 7f6b09524700 1 -- 172.21.15.96:0/2543106084 wait complete. 2024-02-19T19:04:35.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:35 smithi125 ceph-mon[37556]: pgmap v5: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:35.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:35 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:35.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:35 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:35.961 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:04:36.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.041+0000 7f5282bf0700 1 -- 172.21.15.96:0/4232084638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f527c100e10 msgr2=0x7f527c101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:36.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.041+0000 7f5282bf0700 1 --2- 172.21.15.96:0/4232084638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f527c100e10 0x7f527c101270 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5268009910 tx=0x7f5268009c20 comp rx=0 tx=0).stop 2024-02-19T19:04:36.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.041+0000 7f5282bf0700 1 -- 172.21.15.96:0/4232084638 shutdown_connections 2024-02-19T19:04:36.062 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.041+0000 7f5282bf0700 1 --2- 172.21.15.96:0/4232084638 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f527c100e10 0x7f527c101270 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.041+0000 7f5282bf0700 1 --2- 172.21.15.96:0/4232084638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f527c0ffc10 0x7f527c100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.041+0000 7f5282bf0700 1 -- 172.21.15.96:0/4232084638 >> 172.21.15.96:0/4232084638 conn(0x7f527c0fb190 msgr2=0x7f527c0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.041+0000 7f5282bf0700 1 -- 172.21.15.96:0/4232084638 shutdown_connections 2024-02-19T19:04:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.041+0000 7f5282bf0700 1 -- 172.21.15.96:0/4232084638 wait complete. 2024-02-19T19:04:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.041+0000 7f5282bf0700 1 Processor -- start 2024-02-19T19:04:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.041+0000 7f5282bf0700 1 -- start start 2024-02-19T19:04:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.041+0000 7f5282bf0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f527c0ffc10 0x7f527c196480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.041+0000 7f5282bf0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f527c100e10 0x7f527c1969c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.042+0000 7f5282bf0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c196fe0 con 0x7f527c100e10 2024-02-19T19:04:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.042+0000 7f5282bf0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c197120 con 0x7f527c0ffc10 2024-02-19T19:04:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.042+0000 7f528098c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f527c0ffc10 0x7f527c196480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.042+0000 7f527bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f527c100e10 0x7f527c1969c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.042+0000 7f528098c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f527c0ffc10 0x7f527c196480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.96:35996/0 (socket says 172.21.15.96:35996) 2024-02-19T19:04:36.063 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.042+0000 7f528098c700 1 -- 172.21.15.96:0/2926924453 learned_addr learned my addr 172.21.15.96:0/2926924453 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:04:36.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.042+0000 7f528098c700 1 -- 172.21.15.96:0/2926924453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f527c100e10 msgr2=0x7f527c1969c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:36.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.042+0000 7f528098c700 1 --2- 172.21.15.96:0/2926924453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f527c100e10 0x7f527c1969c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.042+0000 7f528098c700 1 -- 172.21.15.96:0/2926924453 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52680095f0 con 0x7f527c0ffc10 2024-02-19T19:04:36.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.042+0000 7f527bfff700 1 --2- 172.21.15.96:0/2926924453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f527c100e10 0x7f527c1969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:04:36.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.042+0000 7f528098c700 1 --2- 172.21.15.96:0/2926924453 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f527c0ffc10 0x7f527c196480 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f527000e8f0 tx=0x7f527000ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:36.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.042+0000 7f5279ffb700 1 -- 172.21.15.96:0/2926924453 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5270009790 con 0x7f527c0ffc10 2024-02-19T19:04:36.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.042+0000 7f5282bf0700 1 -- 172.21.15.96:0/2926924453 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527c19bbd0 con 0x7f527c0ffc10 2024-02-19T19:04:36.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.042+0000 7f5279ffb700 1 -- 172.21.15.96:0/2926924453 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f527000c810 con 0x7f527c0ffc10 2024-02-19T19:04:36.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.043+0000 7f5279ffb700 1 -- 172.21.15.96:0/2926924453 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5270003d20 con 0x7f527c0ffc10 2024-02-19T19:04:36.064 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.043+0000 7f5282bf0700 1 -- 172.21.15.96:0/2926924453 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527c19c120 con 0x7f527c0ffc10 2024-02-19T19:04:36.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.043+0000 7f5279ffb700 1 -- 172.21.15.96:0/2926924453 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 28) v1 ==== 46071+0+0 (secure 0 0 0) 0x7f5270018450 con 0x7f527c0ffc10 2024-02-19T19:04:36.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.044+0000 7f5282bf0700 1 -- 172.21.15.96:0/2926924453 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f527c108700 con 0x7f527c0ffc10 2024-02-19T19:04:36.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.044+0000 7f5279ffb700 1 --2- 172.21.15.96:0/2926924453 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f526c038eb0 0x7f526c03b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:36.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.044+0000 7f5279ffb700 1 -- 172.21.15.96:0/2926924453 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f5270014070 con 0x7f527c0ffc10 2024-02-19T19:04:36.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.044+0000 7f527bfff700 1 --2- 172.21.15.96:0/2926924453 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f526c038eb0 0x7f526c03b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:36.065 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.044+0000 7f527bfff700 1 --2- 172.21.15.96:0/2926924453 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f526c038eb0 0x7f526c03b370 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5268009fd0 tx=0x7f5268005fd0 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:36.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.049+0000 7f5279ffb700 1 -- 172.21.15.96:0/2926924453 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f527001f340 con 0x7f527c0ffc10 2024-02-19T19:04:36.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.273+0000 7f5282bf0700 1 -- 172.21.15.96:0/2926924453 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f527c068c90 con 0x7f526c038eb0 2024-02-19T19:04:36.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.280+0000 7f5279ffb700 1 -- 172.21.15.96:0/2926924453 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f527c068c90 con 0x7f526c038eb0 2024-02-19T19:04:36.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.283+0000 7f5282bf0700 1 -- 172.21.15.96:0/2926924453 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f526c038eb0 msgr2=0x7f526c03b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:36.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.283+0000 7f5282bf0700 1 --2- 172.21.15.96:0/2926924453 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f526c038eb0 0x7f526c03b370 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5268009fd0 tx=0x7f5268005fd0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.283+0000 7f5282bf0700 1 -- 172.21.15.96:0/2926924453 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f527c0ffc10 msgr2=0x7f527c196480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:36.303 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.283+0000 7f5282bf0700 1 --2- 172.21.15.96:0/2926924453 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f527c0ffc10 0x7f527c196480 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f527000e8f0 tx=0x7f527000ec00 comp rx=0 tx=0).stop 2024-02-19T19:04:36.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.284+0000 7f5282bf0700 1 -- 172.21.15.96:0/2926924453 shutdown_connections 2024-02-19T19:04:36.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.284+0000 7f5282bf0700 1 --2- 172.21.15.96:0/2926924453 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f527c0ffc10 0x7f527c196480 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.284+0000 7f5282bf0700 1 --2- 172.21.15.96:0/2926924453 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f526c038eb0 0x7f526c03b370 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.284+0000 7f5282bf0700 1 --2- 172.21.15.96:0/2926924453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f527c100e10 0x7f527c1969c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.284+0000 7f5282bf0700 1 -- 172.21.15.96:0/2926924453 >> 172.21.15.96:0/2926924453 conn(0x7f527c0fb190 msgr2=0x7f527c068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:36.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.284+0000 7f5282bf0700 1 -- 172.21.15.96:0/2926924453 shutdown_connections 2024-02-19T19:04:36.304 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.284+0000 7f5282bf0700 1 -- 172.21.15.96:0/2926924453 wait complete. 2024-02-19T19:04:36.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.391+0000 7ffabd5f4700 1 -- 172.21.15.96:0/71664731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffab8101eb0 msgr2=0x7ffab8102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:36.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.391+0000 7ffabd5f4700 1 --2- 172.21.15.96:0/71664731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffab8101eb0 0x7ffab8102310 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ffaac009910 tx=0x7ffaac009c20 comp rx=0 tx=0).stop 2024-02-19T19:04:36.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.391+0000 7ffabd5f4700 1 -- 172.21.15.96:0/71664731 shutdown_connections 2024-02-19T19:04:36.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.391+0000 7ffabd5f4700 1 --2- 172.21.15.96:0/71664731 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffab8101eb0 0x7ffab8102310 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.391+0000 7ffabd5f4700 1 --2- 172.21.15.96:0/71664731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffab8100cb0 0x7ffab81010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.391+0000 7ffabd5f4700 1 -- 172.21.15.96:0/71664731 >> 172.21.15.96:0/71664731 conn(0x7ffab80fc230 msgr2=0x7ffab80fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:36.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.391+0000 7ffabd5f4700 1 -- 172.21.15.96:0/71664731 shutdown_connections 2024-02-19T19:04:36.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.392+0000 7ffabd5f4700 1 -- 172.21.15.96:0/71664731 wait complete. 2024-02-19T19:04:36.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.392+0000 7ffabd5f4700 1 Processor -- start 2024-02-19T19:04:36.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.392+0000 7ffabd5f4700 1 -- start start 2024-02-19T19:04:36.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.392+0000 7ffabd5f4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffab8100cb0 0x7ffab81986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:36.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.392+0000 7ffabd5f4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffab8101eb0 0x7ffab8198c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:36.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.392+0000 7ffabd5f4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab8199240 con 0x7ffab8101eb0 2024-02-19T19:04:36.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.392+0000 7ffabd5f4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab8199380 con 0x7ffab8100cb0 2024-02-19T19:04:36.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.393+0000 7ffab67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffab8101eb0 0x7ffab8198c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:36.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.393+0000 7ffab67fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffab8101eb0 0x7ffab8198c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58624/0 (socket says 172.21.15.96:58624) 2024-02-19T19:04:36.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.393+0000 7ffab6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffab8100cb0 0x7ffab81986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:36.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.393+0000 7ffab67fc700 1 -- 172.21.15.96:0/1387413481 learned_addr learned my addr 172.21.15.96:0/1387413481 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:04:36.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.393+0000 7ffab67fc700 1 -- 172.21.15.96:0/1387413481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffab8100cb0 msgr2=0x7ffab81986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:36.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.393+0000 7ffab67fc700 1 --2- 172.21.15.96:0/1387413481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffab8100cb0 0x7ffab81986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.393+0000 7ffab67fc700 1 -- 172.21.15.96:0/1387413481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac0095f0 con 0x7ffab8101eb0 2024-02-19T19:04:36.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.393+0000 7ffab67fc700 1 --2- 172.21.15.96:0/1387413481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffab8101eb0 0x7ffab8198c20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ffaac006010 tx=0x7ffaac00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:36.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.393+0000 7ffa9ffff700 1 -- 172.21.15.96:0/1387413481 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaac01d070 con 0x7ffab8101eb0 2024-02-19T19:04:36.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.393+0000 7ffabd5f4700 1 -- 172.21.15.96:0/1387413481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab819ddd0 con 0x7ffab8101eb0 2024-02-19T19:04:36.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.393+0000 7ffa9ffff700 1 -- 172.21.15.96:0/1387413481 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffaac00f460 con 0x7ffab8101eb0 2024-02-19T19:04:36.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.393+0000 7ffabd5f4700 1 -- 172.21.15.96:0/1387413481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab819e2c0 con 0x7ffab8101eb0 2024-02-19T19:04:36.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.393+0000 7ffa9ffff700 1 -- 172.21.15.96:0/1387413481 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaac021640 con 0x7ffab8101eb0 2024-02-19T19:04:36.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.394+0000 7ffa9ffff700 1 -- 172.21.15.96:0/1387413481 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 28) v1 ==== 46071+0+0 (secure 0 0 0) 0x7ffaac02b440 con 0x7ffab8101eb0 2024-02-19T19:04:36.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.394+0000 7ffabd5f4700 1 -- 172.21.15.96:0/1387413481 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab8105f90 con 0x7ffab8101eb0 2024-02-19T19:04:36.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.394+0000 7ffa9ffff700 1 --2- 172.21.15.96:0/1387413481 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7ffaa0038eb0 0x7ffaa003b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:36.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.395+0000 7ffa9ffff700 1 -- 172.21.15.96:0/1387413481 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ffaac04e260 con 0x7ffab8101eb0 2024-02-19T19:04:36.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.395+0000 7ffab6ffd700 1 --2- 172.21.15.96:0/1387413481 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7ffaa0038eb0 0x7ffaa003b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:36.416 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.395+0000 7ffab6ffd700 1 --2- 172.21.15.96:0/1387413481 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7ffaa0038eb0 0x7ffaa003b370 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ffab8101d10 tx=0x7ffaa800b410 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:36.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.404+0000 7ffa9ffff700 1 -- 172.21.15.96:0/1387413481 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7ffaac029930 con 0x7ffab8101eb0 2024-02-19T19:04:36.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.637+0000 7ffabd5f4700 1 -- 172.21.15.96:0/1387413481 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ffab80611d0 con 0x7ffaa0038eb0 2024-02-19T19:04:36.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.648+0000 7ffa9ffff700 1 -- 172.21.15.96:0/1387413481 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7ffab80611d0 con 0x7ffaa0038eb0 2024-02-19T19:04:36.668 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:04:36.668 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (6m) 0s ago 8m 25.1M - 0.25.0 c8568f914cd2 5dc55ac32e98 2024-02-19T19:04:36.668 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (8m) 0s ago 8m 7772k - 18.2.1 94eadd990e0a b41bff2e0043 2024-02-19T19:04:36.668 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (7m) 3s ago 7m 7671k - 18.2.1 94eadd990e0a 254ab7e7a040 2024-02-19T19:04:36.668 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (8m) 0s ago 8m 6660k - 18.2.1 94eadd990e0a 9250aadb9d78 2024-02-19T19:04:36.668 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (7m) 3s ago 7m 6665k - 18.2.1 94eadd990e0a b98ace7b5ded 2024-02-19T19:04:36.669 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (6m) 0s ago 8m 86.5M - 9.4.7 954c08fa6188 467f574356d5 2024-02-19T19:04:36.669 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (2m) 0s ago 2m 26.3M - 18.2.1 94eadd990e0a 0a61d9cd40d1 2024-02-19T19:04:36.669 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (2m) 0s ago 2m 19.5M - 18.2.1 94eadd990e0a 58db3e7a7d75 2024-02-19T19:04:36.669 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (2m) 3s ago 2m 23.2M - 18.2.1 94eadd990e0a 211d64de8a63 2024-02-19T19:04:36.669 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (2m) 3s ago 2m 21.6M - 18.2.1 94eadd990e0a 2a04b5a8eaf4 2024-02-19T19:04:36.669 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:8443,9283,8765 running (17s) 0s ago 9m 472M - 19.0.0-1450-gf78a58c0 f081f847070a a86fbe94fe3f 2024-02-19T19:04:36.669 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (55s) 3s ago 7m 74.2M - 19.0.0-1450-gf78a58c0 f081f847070a f81e955ba64c 2024-02-19T19:04:36.669 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (9m) 0s ago 10m 51.5M 2048M 18.2.1 94eadd990e0a 23d5b9626c48 2024-02-19T19:04:36.669 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (7m) 3s ago 7m 42.3M 2048M 18.2.1 94eadd990e0a 27b4cad04cc5 2024-02-19T19:04:36.669 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (8m) 0s ago 8m 15.3M - 1.5.0 0da6a335fe13 97e9e93f8e15 2024-02-19T19:04:36.669 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (7m) 3s ago 7m 15.3M - 1.5.0 0da6a335fe13 fc1d96c078d9 2024-02-19T19:04:36.669 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (6m) 0s ago 6m 49.4M 1216M 18.2.1 94eadd990e0a d5bbf07ad0e7 2024-02-19T19:04:36.669 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (5m) 0s ago 5m 48.9M 1216M 18.2.1 94eadd990e0a 40329d59be45 2024-02-19T19:04:36.669 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (5m) 0s ago 5m 48.0M 1216M 18.2.1 94eadd990e0a 4f1e49db2d41 2024-02-19T19:04:36.669 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (5m) 3s ago 5m 49.0M 2240M 18.2.1 94eadd990e0a 4746b79351fc 2024-02-19T19:04:36.669 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (4m) 3s ago 4m 49.2M 2240M 18.2.1 94eadd990e0a 2b3f0088f6b2 2024-02-19T19:04:36.669 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (4m) 3s ago 4m 45.9M 2240M 18.2.1 94eadd990e0a e5731974b46a 2024-02-19T19:04:36.670 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (23s) 0s ago 7m 42.2M - 2.43.0 a07b618ecd1d 2fff69e53ce2 2024-02-19T19:04:36.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.650+0000 7ffabd5f4700 1 -- 172.21.15.96:0/1387413481 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7ffaa0038eb0 msgr2=0x7ffaa003b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:36.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.650+0000 7ffabd5f4700 1 --2- 172.21.15.96:0/1387413481 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7ffaa0038eb0 0x7ffaa003b370 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ffab8101d10 tx=0x7ffaa800b410 comp rx=0 tx=0).stop 2024-02-19T19:04:36.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.650+0000 7ffabd5f4700 1 -- 172.21.15.96:0/1387413481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffab8101eb0 msgr2=0x7ffab8198c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:36.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.650+0000 7ffabd5f4700 1 --2- 172.21.15.96:0/1387413481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffab8101eb0 0x7ffab8198c20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ffaac006010 tx=0x7ffaac00bd70 comp rx=0 tx=0).stop 2024-02-19T19:04:36.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.650+0000 7ffabd5f4700 1 -- 172.21.15.96:0/1387413481 shutdown_connections 2024-02-19T19:04:36.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.650+0000 7ffabd5f4700 1 --2- 172.21.15.96:0/1387413481 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffab8100cb0 0x7ffab81986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.651+0000 7ffabd5f4700 1 --2- 172.21.15.96:0/1387413481 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7ffaa0038eb0 0x7ffaa003b370 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.651+0000 7ffabd5f4700 1 --2- 172.21.15.96:0/1387413481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffab8101eb0 0x7ffab8198c20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.651+0000 7ffabd5f4700 1 -- 172.21.15.96:0/1387413481 >> 172.21.15.96:0/1387413481 conn(0x7ffab80fc230 msgr2=0x7ffab81030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:36.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.651+0000 7ffabd5f4700 1 -- 172.21.15.96:0/1387413481 shutdown_connections 2024-02-19T19:04:36.671 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.651+0000 7ffabd5f4700 1 -- 172.21.15.96:0/1387413481 wait complete. 2024-02-19T19:04:36.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.758+0000 7ff4142f3700 1 -- 172.21.15.96:0/1875630390 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff40c100ca0 msgr2=0x7ff40c1010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:36.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.758+0000 7ff4142f3700 1 --2- 172.21.15.96:0/1875630390 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff40c100ca0 0x7ff40c1010c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff408009910 tx=0x7ff408009c20 comp rx=0 tx=0).stop 2024-02-19T19:04:36.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.758+0000 7ff4142f3700 1 -- 172.21.15.96:0/1875630390 shutdown_connections 2024-02-19T19:04:36.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.758+0000 7ff4142f3700 1 --2- 172.21.15.96:0/1875630390 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff40c101ea0 0x7ff40c102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.758+0000 7ff4142f3700 1 --2- 172.21.15.96:0/1875630390 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff40c100ca0 0x7ff40c1010c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.758+0000 7ff4142f3700 1 -- 172.21.15.96:0/1875630390 >> 172.21.15.96:0/1875630390 conn(0x7ff40c0fc260 msgr2=0x7ff40c0fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:36.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.758+0000 7ff4142f3700 1 -- 172.21.15.96:0/1875630390 shutdown_connections 2024-02-19T19:04:36.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.758+0000 7ff4142f3700 1 -- 172.21.15.96:0/1875630390 wait complete. 2024-02-19T19:04:36.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.758+0000 7ff4142f3700 1 Processor -- start 2024-02-19T19:04:36.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.758+0000 7ff4142f3700 1 -- start start 2024-02-19T19:04:36.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.758+0000 7ff4142f3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff40c100ca0 0x7ff40c1964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:36.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.758+0000 7ff4142f3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff40c101ea0 0x7ff40c196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:36.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.759+0000 7ff4142f3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c197030 con 0x7ff40c101ea0 2024-02-19T19:04:36.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.759+0000 7ff4142f3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c197170 con 0x7ff40c100ca0 2024-02-19T19:04:36.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.759+0000 7ff41188e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff40c101ea0 0x7ff40c196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:36.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.759+0000 7ff41208f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff40c100ca0 0x7ff40c1964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:36.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.759+0000 7ff41208f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff40c100ca0 0x7ff40c1964d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.96:36028/0 (socket says 172.21.15.96:36028) 2024-02-19T19:04:36.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.759+0000 7ff41208f700 1 -- 172.21.15.96:0/3062676619 learned_addr learned my addr 172.21.15.96:0/3062676619 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:04:36.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.759+0000 7ff41208f700 1 -- 172.21.15.96:0/3062676619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff40c101ea0 msgr2=0x7ff40c196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:36.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.759+0000 7ff41208f700 1 --2- 172.21.15.96:0/3062676619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff40c101ea0 0x7ff40c196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:36.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.759+0000 7ff41208f700 1 -- 172.21.15.96:0/3062676619 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4080095f0 con 0x7ff40c100ca0 2024-02-19T19:04:36.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.759+0000 7ff41208f700 1 --2- 172.21.15.96:0/3062676619 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff40c100ca0 0x7ff40c1964d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff408000c00 tx=0x7ff40800f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:36.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.759+0000 7ff4037fe700 1 -- 172.21.15.96:0/3062676619 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff40801d070 con 0x7ff40c100ca0 2024-02-19T19:04:36.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.759+0000 7ff4037fe700 1 -- 172.21.15.96:0/3062676619 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff408005dc0 con 0x7ff40c100ca0 2024-02-19T19:04:36.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.759+0000 7ff4142f3700 1 -- 172.21.15.96:0/3062676619 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40c19bbc0 con 0x7ff40c100ca0 2024-02-19T19:04:36.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.759+0000 7ff4037fe700 1 -- 172.21.15.96:0/3062676619 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff408022470 con 0x7ff40c100ca0 2024-02-19T19:04:36.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.759+0000 7ff4142f3700 1 -- 172.21.15.96:0/3062676619 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40c19c0b0 con 0x7ff40c100ca0 2024-02-19T19:04:36.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.760+0000 7ff4037fe700 1 -- 172.21.15.96:0/3062676619 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 28) v1 ==== 46071+0+0 (secure 0 0 0) 0x7ff408017400 con 0x7ff40c100ca0 2024-02-19T19:04:36.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.760+0000 7ff4037fe700 1 --2- 172.21.15.96:0/3062676619 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7ff3f8038eb0 0x7ff3f803b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:36.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.760+0000 7ff4037fe700 1 -- 172.21.15.96:0/3062676619 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff40804e650 con 0x7ff40c100ca0 2024-02-19T19:04:36.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.761+0000 7ff41188e700 1 --2- 172.21.15.96:0/3062676619 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7ff3f8038eb0 0x7ff3f803b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:36.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.761+0000 7ff4142f3700 1 -- 172.21.15.96:0/3062676619 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40c109800 con 0x7ff40c100ca0 2024-02-19T19:04:36.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.761+0000 7ff41188e700 1 --2- 172.21.15.96:0/3062676619 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7ff3f8038eb0 0x7ff3f803b370 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009c60 tx=0x7ff3fc009260 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:36.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:36.766+0000 7ff4037fe700 1 -- 172.21.15.96:0/3062676619 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7ff408017cb0 con 0x7ff40c100ca0 2024-02-19T19:04:37.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:36 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:37.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:36 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:37.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:36 smithi096 ceph-mon[29216]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:37.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:36 smithi096 ceph-mon[29216]: pgmap v6: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:37.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:36 smithi096 ceph-mon[29216]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:37.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.058+0000 7ff4142f3700 1 -- 172.21.15.96:0/3062676619 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff40c19c660 con 0x7ff40c100ca0 2024-02-19T19:04:37.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.059+0000 7ff4037fe700 1 -- 172.21.15.96:0/3062676619 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7ff408021750 con 0x7ff40c100ca0 2024-02-19T19:04:37.079 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:04:37.079 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:04:37.079 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-19T19:04:37.079 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:04:37.079 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:04:37.079 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-19T19:04:37.079 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:04:37.079 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:04:37.079 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-19T19:04:37.079 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:04:37.080 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:04:37.080 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-19T19:04:37.080 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:04:37.080 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:04:37.080 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 12, 2024-02-19T19:04:37.080 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-19T19:04:37.080 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:04:37.080 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:04:37.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.061+0000 7ff4142f3700 1 -- 172.21.15.96:0/3062676619 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7ff3f8038eb0 msgr2=0x7ff3f803b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:37.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.061+0000 7ff4142f3700 1 --2- 172.21.15.96:0/3062676619 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7ff3f8038eb0 0x7ff3f803b370 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009c60 tx=0x7ff3fc009260 comp rx=0 tx=0).stop 2024-02-19T19:04:37.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.061+0000 7ff4142f3700 1 -- 172.21.15.96:0/3062676619 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff40c100ca0 msgr2=0x7ff40c1964d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:37.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.061+0000 7ff4142f3700 1 --2- 172.21.15.96:0/3062676619 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff40c100ca0 0x7ff40c1964d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff408000c00 tx=0x7ff40800f690 comp rx=0 tx=0).stop 2024-02-19T19:04:37.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.062+0000 7ff4142f3700 1 -- 172.21.15.96:0/3062676619 shutdown_connections 2024-02-19T19:04:37.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.062+0000 7ff4142f3700 1 --2- 172.21.15.96:0/3062676619 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff40c100ca0 0x7ff40c1964d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:37.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.062+0000 7ff4142f3700 1 --2- 172.21.15.96:0/3062676619 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7ff3f8038eb0 0x7ff3f803b370 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:37.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.062+0000 7ff4142f3700 1 --2- 172.21.15.96:0/3062676619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff40c101ea0 0x7ff40c196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:37.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.062+0000 7ff4142f3700 1 -- 172.21.15.96:0/3062676619 >> 172.21.15.96:0/3062676619 conn(0x7ff40c0fc260 msgr2=0x7ff40c1050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:37.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.062+0000 7ff4142f3700 1 -- 172.21.15.96:0/3062676619 shutdown_connections 2024-02-19T19:04:37.082 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.062+0000 7ff4142f3700 1 -- 172.21.15.96:0/3062676619 wait complete. 2024-02-19T19:04:37.172 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:36 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:37.172 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:36 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:37.172 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:36 smithi125 ceph-mon[37556]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:37.172 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:36 smithi125 ceph-mon[37556]: pgmap v6: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:04:37.172 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:36 smithi125 ceph-mon[37556]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:37.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.172+0000 7f469c8ec700 1 -- 172.21.15.96:0/611673083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4698100dc0 msgr2=0x7f4698101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:37.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.172+0000 7f469c8ec700 1 --2- 172.21.15.96:0/611673083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4698100dc0 0x7f4698101220 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f468c009910 tx=0x7f468c009c20 comp rx=0 tx=0).stop 2024-02-19T19:04:37.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.172+0000 7f469c8ec700 1 -- 172.21.15.96:0/611673083 shutdown_connections 2024-02-19T19:04:37.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.172+0000 7f469c8ec700 1 --2- 172.21.15.96:0/611673083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4698100dc0 0x7f4698101220 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:37.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.172+0000 7f469c8ec700 1 --2- 172.21.15.96:0/611673083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46980ffbc0 0x7f46980fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:37.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.172+0000 7f469c8ec700 1 -- 172.21.15.96:0/611673083 >> 172.21.15.96:0/611673083 conn(0x7f46980fb160 msgr2=0x7f46980fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:37.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.172+0000 7f469c8ec700 1 -- 172.21.15.96:0/611673083 shutdown_connections 2024-02-19T19:04:37.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.172+0000 7f469c8ec700 1 -- 172.21.15.96:0/611673083 wait complete. 2024-02-19T19:04:37.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.172+0000 7f469c8ec700 1 Processor -- start 2024-02-19T19:04:37.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.172+0000 7f469c8ec700 1 -- start start 2024-02-19T19:04:37.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.173+0000 7f469c8ec700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46980ffbc0 0x7f4698103b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:37.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.173+0000 7f469c8ec700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4698100dc0 0x7f46981021a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:37.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.173+0000 7f469c8ec700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46981026e0 con 0x7f46980ffbc0 2024-02-19T19:04:37.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.173+0000 7f469c8ec700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4698102820 con 0x7f4698100dc0 2024-02-19T19:04:37.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.173+0000 7f469659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46980ffbc0 0x7f4698103b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:37.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.173+0000 7f469659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46980ffbc0 0x7f4698103b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58668/0 (socket says 172.21.15.96:58668) 2024-02-19T19:04:37.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.173+0000 7f469659c700 1 -- 172.21.15.96:0/3657852721 learned_addr learned my addr 172.21.15.96:0/3657852721 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:04:37.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.173+0000 7f4695d9b700 1 --2- 172.21.15.96:0/3657852721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4698100dc0 0x7f46981021a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:37.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.173+0000 7f469659c700 1 -- 172.21.15.96:0/3657852721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4698100dc0 msgr2=0x7f46981021a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:37.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.173+0000 7f469659c700 1 --2- 172.21.15.96:0/3657852721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4698100dc0 0x7f46981021a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:37.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.173+0000 7f469659c700 1 -- 172.21.15.96:0/3657852721 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c0095f0 con 0x7f46980ffbc0 2024-02-19T19:04:37.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.173+0000 7f469659c700 1 --2- 172.21.15.96:0/3657852721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46980ffbc0 0x7f4698103b50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f468800e8f0 tx=0x7f468800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:37.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.173+0000 7f46877fe700 1 -- 172.21.15.96:0/3657852721 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4688009790 con 0x7f46980ffbc0 2024-02-19T19:04:37.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.173+0000 7f469c8ec700 1 -- 172.21.15.96:0/3657852721 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4698102b00 con 0x7f46980ffbc0 2024-02-19T19:04:37.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.173+0000 7f46877fe700 1 -- 172.21.15.96:0/3657852721 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f468800c810 con 0x7f46980ffbc0 2024-02-19T19:04:37.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.173+0000 7f46877fe700 1 -- 172.21.15.96:0/3657852721 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4688003d20 con 0x7f46980ffbc0 2024-02-19T19:04:37.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.174+0000 7f469c8ec700 1 -- 172.21.15.96:0/3657852721 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469819e810 con 0x7f46980ffbc0 2024-02-19T19:04:37.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.175+0000 7f46877fe700 1 -- 172.21.15.96:0/3657852721 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 28) v1 ==== 46071+0+0 (secure 0 0 0) 0x7f4688018430 con 0x7f46980ffbc0 2024-02-19T19:04:37.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.175+0000 7f469c8ec700 1 -- 172.21.15.96:0/3657852721 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4698068af0 con 0x7f46980ffbc0 2024-02-19T19:04:37.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.175+0000 7f46877fe700 1 --2- 172.21.15.96:0/3657852721 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f4680038eb0 0x7f468003b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:04:37.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.175+0000 7f46877fe700 1 -- 172.21.15.96:0/3657852721 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4688014070 con 0x7f46980ffbc0 2024-02-19T19:04:37.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.175+0000 7f4695d9b700 1 --2- 172.21.15.96:0/3657852721 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f4680038eb0 0x7f468003b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:04:37.196 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.175+0000 7f4695d9b700 1 --2- 172.21.15.96:0/3657852721 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f4680038eb0 0x7f468003b370 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f468c00b6f0 tx=0x7f468c005a90 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:04:37.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.180+0000 7f46877fe700 1 -- 172.21.15.96:0/3657852721 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f468801f340 con 0x7f46980ffbc0 2024-02-19T19:04:37.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.424+0000 7f469c8ec700 1 -- 172.21.15.96:0/3657852721 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f46980695a0 con 0x7f4680038eb0 2024-02-19T19:04:37.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.426+0000 7f46877fe700 1 -- 172.21.15.96:0/3657852721 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f46980695a0 con 0x7f4680038eb0 2024-02-19T19:04:37.445 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:04:37.445 INFO:teuthology.orchestra.run.smithi096.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:04:37.445 INFO:teuthology.orchestra.run.smithi096.stdout: "in_progress": true, 2024-02-19T19:04:37.446 INFO:teuthology.orchestra.run.smithi096.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-19T19:04:37.446 INFO:teuthology.orchestra.run.smithi096.stdout: "services_complete": [ 2024-02-19T19:04:37.446 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr" 2024-02-19T19:04:37.446 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-02-19T19:04:37.446 INFO:teuthology.orchestra.run.smithi096.stdout: "progress": "2/2 daemons upgraded", 2024-02-19T19:04:37.446 INFO:teuthology.orchestra.run.smithi096.stdout: "message": "", 2024-02-19T19:04:37.446 INFO:teuthology.orchestra.run.smithi096.stdout: "is_paused": false 2024-02-19T19:04:37.446 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:04:37.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.428+0000 7f469c8ec700 1 -- 172.21.15.96:0/3657852721 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f4680038eb0 msgr2=0x7f468003b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:37.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.428+0000 7f469c8ec700 1 --2- 172.21.15.96:0/3657852721 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f4680038eb0 0x7f468003b370 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f468c00b6f0 tx=0x7f468c005a90 comp rx=0 tx=0).stop 2024-02-19T19:04:37.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.428+0000 7f469c8ec700 1 -- 172.21.15.96:0/3657852721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46980ffbc0 msgr2=0x7f4698103b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:04:37.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.428+0000 7f469c8ec700 1 --2- 172.21.15.96:0/3657852721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46980ffbc0 0x7f4698103b50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f468800e8f0 tx=0x7f468800ec00 comp rx=0 tx=0).stop 2024-02-19T19:04:37.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.428+0000 7f469c8ec700 1 -- 172.21.15.96:0/3657852721 shutdown_connections 2024-02-19T19:04:37.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.428+0000 7f469c8ec700 1 --2- 172.21.15.96:0/3657852721 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f4680038eb0 0x7f468003b370 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:37.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.428+0000 7f469c8ec700 1 --2- 172.21.15.96:0/3657852721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46980ffbc0 0x7f4698103b50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:37.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.428+0000 7f469c8ec700 1 --2- 172.21.15.96:0/3657852721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4698100dc0 0x7f46981021a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:04:37.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.428+0000 7f469c8ec700 1 -- 172.21.15.96:0/3657852721 >> 172.21.15.96:0/3657852721 conn(0x7f46980fb160 msgr2=0x7f4698068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:04:37.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.428+0000 7f469c8ec700 1 -- 172.21.15.96:0/3657852721 shutdown_connections 2024-02-19T19:04:37.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:04:37.428+0000 7f469c8ec700 1 -- 172.21.15.96:0/3657852721 wait complete. 2024-02-19T19:04:38.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:37 smithi096 ceph-mon[29216]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:38.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:37 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:38.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:37 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:38.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:37 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/3062676619' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:38.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:37 smithi096 ceph-mon[29216]: Standby manager daemon smithi125.ygdmdu started 2024-02-19T19:04:38.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:37 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.125:0/980417509' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi125.ygdmdu/crt"}]: dispatch 2024-02-19T19:04:38.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:37 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.125:0/980417509' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:04:38.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:37 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.125:0/980417509' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi125.ygdmdu/key"}]: dispatch 2024-02-19T19:04:38.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:37 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.125:0/980417509' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:04:38.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:37 smithi096 ceph-mon[29216]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:38.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:37 smithi125 ceph-mon[37556]: from='client.14692 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:38.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:37 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:38.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:37 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:38.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:37 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/3062676619' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:04:38.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:37 smithi125 ceph-mon[37556]: Standby manager daemon smithi125.ygdmdu started 2024-02-19T19:04:38.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:37 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.125:0/980417509' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi125.ygdmdu/crt"}]: dispatch 2024-02-19T19:04:38.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:37 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.125:0/980417509' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:04:38.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:37 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.125:0/980417509' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi125.ygdmdu/key"}]: dispatch 2024-02-19T19:04:38.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:37 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.125:0/980417509' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:04:38.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:37 smithi125 ceph-mon[37556]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:04:39.200 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:38 smithi125 ceph-mon[37556]: mgrmap e29: smithi096.zsjdff(active, since 7s), standbys: smithi125.ygdmdu 2024-02-19T19:04:39.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:38 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr metadata", "who": "smithi125.ygdmdu", "id": "smithi125.ygdmdu"}]: dispatch 2024-02-19T19:04:39.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:38 smithi125 ceph-mon[37556]: pgmap v7: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-02-19T19:04:39.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:38 smithi096 ceph-mon[29216]: mgrmap e29: smithi096.zsjdff(active, since 7s), standbys: smithi125.ygdmdu 2024-02-19T19:04:39.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:38 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr metadata", "who": "smithi125.ygdmdu", "id": "smithi125.ygdmdu"}]: dispatch 2024-02-19T19:04:39.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:38 smithi096 ceph-mon[29216]: pgmap v7: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-02-19T19:04:41.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:41 smithi125 ceph-mon[37556]: pgmap v8: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-02-19T19:04:41.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:41 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:41.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:41 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:41.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:41 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:04:41.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:41 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:04:41.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:41 smithi125 ceph-mon[37556]: Updating smithi096:/etc/ceph/ceph.conf 2024-02-19T19:04:41.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:41 smithi125 ceph-mon[37556]: Updating smithi125:/etc/ceph/ceph.conf 2024-02-19T19:04:41.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:41 smithi096 ceph-mon[29216]: pgmap v8: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-02-19T19:04:41.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:41 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:41.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:41 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:41.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:41 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:04:41.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:41 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:04:41.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:41 smithi096 ceph-mon[29216]: Updating smithi096:/etc/ceph/ceph.conf 2024-02-19T19:04:41.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:41 smithi096 ceph-mon[29216]: Updating smithi125:/etc/ceph/ceph.conf 2024-02-19T19:04:42.690 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:42 smithi096 ceph-mon[29216]: Updating smithi125:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:04:42.690 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:42 smithi096 ceph-mon[29216]: Updating smithi096:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:04:42.690 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:42 smithi096 ceph-mon[29216]: Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:04:42.690 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:42 smithi096 ceph-mon[29216]: Updating smithi125:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:04:42.690 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:42 smithi096 ceph-mon[29216]: Updating smithi125:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:04:42.690 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:42 smithi096 ceph-mon[29216]: Updating smithi096:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:04:42.690 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:42 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:42.690 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:42 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:42.690 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:42 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:42.690 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:42 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:42.691 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:42 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:42.691 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:42 smithi096 ceph-mon[29216]: Reconfiguring prometheus.smithi096 (dependencies changed)... 2024-02-19T19:04:42.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:42 smithi125 ceph-mon[37556]: Updating smithi125:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:04:42.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:42 smithi125 ceph-mon[37556]: Updating smithi096:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:04:42.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:42 smithi125 ceph-mon[37556]: Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:04:42.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:42 smithi125 ceph-mon[37556]: Updating smithi125:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:04:42.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:42 smithi125 ceph-mon[37556]: Updating smithi125:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:04:42.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:42 smithi125 ceph-mon[37556]: Updating smithi096:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:04:42.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:42 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:42.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:42 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:42.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:42 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:42.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:42 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:42.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:42 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:42.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:42 smithi125 ceph-mon[37556]: Reconfiguring prometheus.smithi096 (dependencies changed)... 2024-02-19T19:04:43.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:43 smithi096 ceph-mon[29216]: Reconfiguring daemon prometheus.smithi096 on smithi096 2024-02-19T19:04:43.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:43 smithi096 ceph-mon[29216]: pgmap v9: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-19T19:04:43.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:43 smithi125 ceph-mon[37556]: Reconfiguring daemon prometheus.smithi096 on smithi096 2024-02-19T19:04:43.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:43 smithi125 ceph-mon[37556]: pgmap v9: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-19T19:04:45.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:45 smithi096 ceph-mon[29216]: pgmap v10: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-02-19T19:04:45.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:45 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:04:45.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:45 smithi125 ceph-mon[37556]: pgmap v10: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-02-19T19:04:45.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:45 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:04:47.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:47 smithi096 ceph-mon[29216]: pgmap v11: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-02-19T19:04:47.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:47.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:47.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:04:47.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:47.891 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:47 smithi125 ceph-mon[37556]: pgmap v11: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-02-19T19:04:47.891 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:47.892 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:47.892 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:04:47.892 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:48.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:48 smithi096 ceph-mon[29216]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:04:48.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:48 smithi125 ceph-mon[37556]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:04:49.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:49 smithi096 ceph-mon[29216]: pgmap v12: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-19T19:04:49.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:49 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi125.ygdmdu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:04:49.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:49 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T19:04:49.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:49 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:04:49.794 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:49 smithi125 ceph-mon[37556]: pgmap v12: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-19T19:04:49.794 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:49 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi125.ygdmdu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:04:49.794 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:49 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T19:04:49.794 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:49 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:04:50.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:50 smithi096 ceph-mon[29216]: Upgrade: Updating mgr.smithi125.ygdmdu 2024-02-19T19:04:50.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:50 smithi096 ceph-mon[29216]: Deploying daemon mgr.smithi125.ygdmdu on smithi125 2024-02-19T19:04:50.821 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:50 smithi125 ceph-mon[37556]: Upgrade: Updating mgr.smithi125.ygdmdu 2024-02-19T19:04:50.822 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:50 smithi125 ceph-mon[37556]: Deploying daemon mgr.smithi125.ygdmdu on smithi125 2024-02-19T19:04:51.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:51 smithi125 ceph-mon[37556]: pgmap v13: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:04:51.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:51 smithi096 ceph-mon[29216]: pgmap v13: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:04:53.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:53 smithi096 ceph-mon[29216]: pgmap v14: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:04:53.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:53 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:53.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:53 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:53.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:53 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:53.800 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:53 smithi125 ceph-mon[37556]: pgmap v14: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:04:53.800 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:53 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:53.801 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:53 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:53.801 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:53 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:04:55.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:55 smithi096 ceph-mon[29216]: pgmap v15: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:04:55.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:55 smithi125 ceph-mon[37556]: pgmap v15: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:04:57.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:57 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:57.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:57 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:57.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:57 smithi096 ceph-mon[29216]: pgmap v16: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:04:57.300 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:57 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:57.300 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:57 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:57.300 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:57 smithi125 ceph-mon[37556]: pgmap v16: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:04:58.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:58 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:58.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:58 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:58.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:58 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:58.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:58 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:59.533 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:59 smithi125 ceph-mon[37556]: pgmap v17: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:04:59.533 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:59 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:59.534 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:04:59 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:59.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:59 smithi096 ceph-mon[29216]: pgmap v17: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:04:59.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:59 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:04:59.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:04:59 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:00.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:00 smithi125 ceph-mon[37556]: Standby manager daemon smithi125.ygdmdu restarted 2024-02-19T19:05:00.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:00 smithi125 ceph-mon[37556]: Standby manager daemon smithi125.ygdmdu started 2024-02-19T19:05:00.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:00 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.125:0/2329665156' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi125.ygdmdu/crt"}]: dispatch 2024-02-19T19:05:00.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:00 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.125:0/2329665156' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:05:00.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:00 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.125:0/2329665156' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi125.ygdmdu/key"}]: dispatch 2024-02-19T19:05:00.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:00 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.125:0/2329665156' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:05:00.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:00 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:05:00.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:00 smithi096 ceph-mon[29216]: Standby manager daemon smithi125.ygdmdu restarted 2024-02-19T19:05:00.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:00 smithi096 ceph-mon[29216]: Standby manager daemon smithi125.ygdmdu started 2024-02-19T19:05:00.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:00 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.125:0/2329665156' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi125.ygdmdu/crt"}]: dispatch 2024-02-19T19:05:00.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:00 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.125:0/2329665156' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:05:00.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:00 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.125:0/2329665156' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi125.ygdmdu/key"}]: dispatch 2024-02-19T19:05:00.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:00 smithi096 ceph-mon[29216]: from='mgr.? 172.21.15.125:0/2329665156' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:05:00.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:00 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:05:01.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: pgmap v18: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:01.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: mgrmap e30: smithi096.zsjdff(active, since 30s), standbys: smithi125.ygdmdu 2024-02-19T19:05:01.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:01.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:01.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:01.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:05:01.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:01.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:01.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:01.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:01.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi096.zsjdff"}]: dispatch 2024-02-19T19:05:01.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi096.zsjdff"}]': finished 2024-02-19T19:05:01.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi125.ygdmdu"}]: dispatch 2024-02-19T19:05:01.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi125.ygdmdu"}]': finished 2024-02-19T19:05:01.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:01.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:01.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:01.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:01.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:01.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:01.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:01.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:01.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:01.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:01.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:01.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:01 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:01.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: pgmap v18: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:01.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: mgrmap e30: smithi096.zsjdff(active, since 30s), standbys: smithi125.ygdmdu 2024-02-19T19:05:01.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:01.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:01.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:01.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:05:01.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:01.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:01.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:01.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:01.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi096.zsjdff"}]: dispatch 2024-02-19T19:05:01.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi096.zsjdff"}]': finished 2024-02-19T19:05:01.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi125.ygdmdu"}]: dispatch 2024-02-19T19:05:01.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi125.ygdmdu"}]': finished 2024-02-19T19:05:01.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:01.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:01.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:01.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:01.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:01.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:01.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:01.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:01.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:01.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:01.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:01.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:01 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:02.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:02 smithi096 ceph-mon[29216]: Upgrade: Setting container_image for all mgr 2024-02-19T19:05:02.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:02 smithi096 ceph-mon[29216]: Upgrade: Setting container_image for all rgw 2024-02-19T19:05:02.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:02 smithi096 ceph-mon[29216]: Upgrade: Setting container_image for all rbd-mirror 2024-02-19T19:05:02.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:02 smithi096 ceph-mon[29216]: Upgrade: Setting container_image for all cephfs-mirror 2024-02-19T19:05:02.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:02 smithi096 ceph-mon[29216]: Upgrade: Setting container_image for all iscsi 2024-02-19T19:05:02.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:02 smithi096 ceph-mon[29216]: Upgrade: Setting container_image for all nfs 2024-02-19T19:05:02.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:02 smithi096 ceph-mon[29216]: Upgrade: Setting container_image for all nvmeof 2024-02-19T19:05:02.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:02 smithi125 ceph-mon[37556]: Upgrade: Setting container_image for all mgr 2024-02-19T19:05:02.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:02 smithi125 ceph-mon[37556]: Upgrade: Setting container_image for all rgw 2024-02-19T19:05:02.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:02 smithi125 ceph-mon[37556]: Upgrade: Setting container_image for all rbd-mirror 2024-02-19T19:05:02.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:02 smithi125 ceph-mon[37556]: Upgrade: Setting container_image for all cephfs-mirror 2024-02-19T19:05:02.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:02 smithi125 ceph-mon[37556]: Upgrade: Setting container_image for all iscsi 2024-02-19T19:05:02.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:02 smithi125 ceph-mon[37556]: Upgrade: Setting container_image for all nfs 2024-02-19T19:05:02.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:02 smithi125 ceph-mon[37556]: Upgrade: Setting container_image for all nvmeof 2024-02-19T19:05:03.438 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:03 smithi096 ceph-mon[29216]: pgmap v19: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:03.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:03 smithi125 ceph-mon[37556]: pgmap v19: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:04.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:04 smithi096 ceph-mon[29216]: Upgrade: Updating node-exporter.smithi096 (1/2) 2024-02-19T19:05:04.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:04 smithi096 ceph-mon[29216]: Deploying daemon node-exporter.smithi096 on smithi096 2024-02-19T19:05:04.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:04 smithi125 ceph-mon[37556]: Upgrade: Updating node-exporter.smithi096 (1/2) 2024-02-19T19:05:04.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:04 smithi125 ceph-mon[37556]: Deploying daemon node-exporter.smithi096 on smithi096 2024-02-19T19:05:05.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:05 smithi096 ceph-mon[29216]: pgmap v20: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:05.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:05 smithi125 ceph-mon[37556]: pgmap v20: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:06.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:06 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:06.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:06 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:06.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:06 smithi125 ceph-mon[37556]: pgmap v21: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:07.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:06 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:07.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:06 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:07.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:06 smithi096 ceph-mon[29216]: pgmap v21: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:07.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.546+0000 7fe9faeed700 1 -- 172.21.15.96:0/805579165 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9f4100dc0 msgr2=0x7fe9f4101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:07.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.546+0000 7fe9faeed700 1 --2- 172.21.15.96:0/805579165 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9f4100dc0 0x7fe9f4101220 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0009910 tx=0x7fe9e0009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:07.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.546+0000 7fe9faeed700 1 -- 172.21.15.96:0/805579165 shutdown_connections 2024-02-19T19:05:07.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.546+0000 7fe9faeed700 1 --2- 172.21.15.96:0/805579165 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9f4100dc0 0x7fe9f4101220 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:07.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.546+0000 7fe9faeed700 1 --2- 172.21.15.96:0/805579165 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9f40ffbc0 0x7fe9f40fffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:07.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.546+0000 7fe9faeed700 1 -- 172.21.15.96:0/805579165 >> 172.21.15.96:0/805579165 conn(0x7fe9f40fb160 msgr2=0x7fe9f40fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:07.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.546+0000 7fe9faeed700 1 -- 172.21.15.96:0/805579165 shutdown_connections 2024-02-19T19:05:07.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.546+0000 7fe9faeed700 1 -- 172.21.15.96:0/805579165 wait complete. 2024-02-19T19:05:07.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.546+0000 7fe9faeed700 1 Processor -- start 2024-02-19T19:05:07.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.546+0000 7fe9faeed700 1 -- start start 2024-02-19T19:05:07.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.547+0000 7fe9faeed700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9f40ffbc0 0x7fe9f4103b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:07.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.547+0000 7fe9faeed700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9f4100dc0 0x7fe9f41021a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:07.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.547+0000 7fe9faeed700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f41026e0 con 0x7fe9f4100dc0 2024-02-19T19:05:07.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.547+0000 7fe9faeed700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f4102820 con 0x7fe9f40ffbc0 2024-02-19T19:05:07.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.547+0000 7fe9f3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9f4100dc0 0x7fe9f41021a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:07.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.547+0000 7fe9f3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9f4100dc0 0x7fe9f41021a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44476/0 (socket says 172.21.15.96:44476) 2024-02-19T19:05:07.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.547+0000 7fe9f3fff700 1 -- 172.21.15.96:0/2125576957 learned_addr learned my addr 172.21.15.96:0/2125576957 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:05:07.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.547+0000 7fe9f8c89700 1 --2- 172.21.15.96:0/2125576957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9f40ffbc0 0x7fe9f4103b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:07.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.547+0000 7fe9f3fff700 1 -- 172.21.15.96:0/2125576957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9f40ffbc0 msgr2=0x7fe9f4103b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:07.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.547+0000 7fe9f3fff700 1 --2- 172.21.15.96:0/2125576957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9f40ffbc0 0x7fe9f4103b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:07.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.547+0000 7fe9f3fff700 1 -- 172.21.15.96:0/2125576957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e00095f0 con 0x7fe9f4100dc0 2024-02-19T19:05:07.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.547+0000 7fe9f3fff700 1 --2- 172.21.15.96:0/2125576957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9f4100dc0 0x7fe9f41021a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0000c00 tx=0x7fe9e000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:07.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.547+0000 7fe9f1ffb700 1 -- 172.21.15.96:0/2125576957 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9e001d070 con 0x7fe9f4100dc0 2024-02-19T19:05:07.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.547+0000 7fe9f1ffb700 1 -- 172.21.15.96:0/2125576957 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe9e0005dc0 con 0x7fe9f4100dc0 2024-02-19T19:05:07.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.547+0000 7fe9faeed700 1 -- 172.21.15.96:0/2125576957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f4102aa0 con 0x7fe9f4100dc0 2024-02-19T19:05:07.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.547+0000 7fe9f1ffb700 1 -- 172.21.15.96:0/2125576957 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9e00226a0 con 0x7fe9f4100dc0 2024-02-19T19:05:07.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.548+0000 7fe9faeed700 1 -- 172.21.15.96:0/2125576957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f4102f90 con 0x7fe9f4100dc0 2024-02-19T19:05:07.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.549+0000 7fe9faeed700 1 -- 172.21.15.96:0/2125576957 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f4068af0 con 0x7fe9f4100dc0 2024-02-19T19:05:07.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.549+0000 7fe9f1ffb700 1 -- 172.21.15.96:0/2125576957 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 30) v1 ==== 91448+0+0 (secure 0 0 0) 0x7fe9e00038f0 con 0x7fe9f4100dc0 2024-02-19T19:05:07.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.550+0000 7fe9f1ffb700 1 --2- 172.21.15.96:0/2125576957 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fe9e406d660 0x7fe9e406fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:07.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.550+0000 7fe9f1ffb700 1 -- 172.21.15.96:0/2125576957 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fe9e008e6b0 con 0x7fe9f4100dc0 2024-02-19T19:05:07.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.550+0000 7fe9f8c89700 1 --2- 172.21.15.96:0/2125576957 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fe9e406d660 0x7fe9e406fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:07.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.550+0000 7fe9f8c89700 1 --2- 172.21.15.96:0/2125576957 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fe9e406d660 0x7fe9e406fb20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4100c20 tx=0x7fe9e8009260 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:07.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.554+0000 7fe9f1ffb700 1 -- 172.21.15.96:0/2125576957 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fe9e005bca0 con 0x7fe9f4100dc0 2024-02-19T19:05:07.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.767+0000 7fe9faeed700 1 -- 172.21.15.96:0/2125576957 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9f4069560 con 0x7fe9e406d660 2024-02-19T19:05:07.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.768+0000 7fe9f1ffb700 1 -- 172.21.15.96:0/2125576957 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fe9f4069560 con 0x7fe9e406d660 2024-02-19T19:05:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.770+0000 7fe9faeed700 1 -- 172.21.15.96:0/2125576957 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fe9e406d660 msgr2=0x7fe9e406fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.770+0000 7fe9faeed700 1 --2- 172.21.15.96:0/2125576957 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fe9e406d660 0x7fe9e406fb20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4100c20 tx=0x7fe9e8009260 comp rx=0 tx=0).stop 2024-02-19T19:05:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.770+0000 7fe9faeed700 1 -- 172.21.15.96:0/2125576957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9f4100dc0 msgr2=0x7fe9f41021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.770+0000 7fe9faeed700 1 --2- 172.21.15.96:0/2125576957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9f4100dc0 0x7fe9f41021a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0000c00 tx=0x7fe9e000f690 comp rx=0 tx=0).stop 2024-02-19T19:05:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.770+0000 7fe9faeed700 1 -- 172.21.15.96:0/2125576957 shutdown_connections 2024-02-19T19:05:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.770+0000 7fe9faeed700 1 --2- 172.21.15.96:0/2125576957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9f40ffbc0 0x7fe9f4103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.770+0000 7fe9faeed700 1 --2- 172.21.15.96:0/2125576957 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fe9e406d660 0x7fe9e406fb20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.770+0000 7fe9faeed700 1 --2- 172.21.15.96:0/2125576957 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9f4100dc0 0x7fe9f41021a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.770+0000 7fe9faeed700 1 -- 172.21.15.96:0/2125576957 >> 172.21.15.96:0/2125576957 conn(0x7fe9f40fb160 msgr2=0x7fe9f4068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.771+0000 7fe9faeed700 1 -- 172.21.15.96:0/2125576957 shutdown_connections 2024-02-19T19:05:07.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.771+0000 7fe9faeed700 1 -- 172.21.15.96:0/2125576957 wait complete. 2024-02-19T19:05:07.801 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:05:07.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.876+0000 7f6380fc9700 1 -- 172.21.15.96:0/216700719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f637c1017f0 msgr2=0x7f637c103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:07.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.876+0000 7f6380fc9700 1 --2- 172.21.15.96:0/216700719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f637c1017f0 0x7f637c103be0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6370009910 tx=0x7f6370009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:07.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.876+0000 7f6380fc9700 1 -- 172.21.15.96:0/216700719 shutdown_connections 2024-02-19T19:05:07.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.876+0000 7f6380fc9700 1 --2- 172.21.15.96:0/216700719 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f637c104120 0x7f637c106510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:07.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.876+0000 7f6380fc9700 1 --2- 172.21.15.96:0/216700719 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f637c1017f0 0x7f637c103be0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:07.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.876+0000 7f6380fc9700 1 -- 172.21.15.96:0/216700719 >> 172.21.15.96:0/216700719 conn(0x7f637c0fb160 msgr2=0x7f637c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:07.897 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:07 smithi096 ceph-mon[29216]: Upgrade: Updating node-exporter.smithi125 (2/2) 2024-02-19T19:05:07.897 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:07 smithi096 ceph-mon[29216]: Deploying daemon node-exporter.smithi125 on smithi125 2024-02-19T19:05:07.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.876+0000 7f6380fc9700 1 -- 172.21.15.96:0/216700719 shutdown_connections 2024-02-19T19:05:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.876+0000 7f6380fc9700 1 -- 172.21.15.96:0/216700719 wait complete. 2024-02-19T19:05:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.877+0000 7f6380fc9700 1 Processor -- start 2024-02-19T19:05:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.877+0000 7f6380fc9700 1 -- start start 2024-02-19T19:05:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.877+0000 7f6380fc9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f637c1017f0 0x7f637c196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.877+0000 7f6380fc9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f637c104120 0x7f637c196da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.877+0000 7f6380fc9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c1973c0 con 0x7f637c1017f0 2024-02-19T19:05:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.877+0000 7f6380fc9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c197500 con 0x7f637c104120 2024-02-19T19:05:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.878+0000 7f637a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f637c1017f0 0x7f637c196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.878+0000 7f637a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f637c1017f0 0x7f637c196860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44490/0 (socket says 172.21.15.96:44490) 2024-02-19T19:05:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.878+0000 7f637a59c700 1 -- 172.21.15.96:0/3960571966 learned_addr learned my addr 172.21.15.96:0/3960571966 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:05:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.878+0000 7f6379d9b700 1 --2- 172.21.15.96:0/3960571966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f637c104120 0x7f637c196da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.878+0000 7f637a59c700 1 -- 172.21.15.96:0/3960571966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f637c104120 msgr2=0x7f637c196da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.878+0000 7f637a59c700 1 --2- 172.21.15.96:0/3960571966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f637c104120 0x7f637c196da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:07.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.878+0000 7f637a59c700 1 -- 172.21.15.96:0/3960571966 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63700095f0 con 0x7f637c1017f0 2024-02-19T19:05:07.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.878+0000 7f637a59c700 1 --2- 172.21.15.96:0/3960571966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f637c1017f0 0x7f637c196860 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6370006010 tx=0x7f637000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:07.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.878+0000 7f636b7fe700 1 -- 172.21.15.96:0/3960571966 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f637001d070 con 0x7f637c1017f0 2024-02-19T19:05:07.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.878+0000 7f636b7fe700 1 -- 172.21.15.96:0/3960571966 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f637000f460 con 0x7f637c1017f0 2024-02-19T19:05:07.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.878+0000 7f6380fc9700 1 -- 172.21.15.96:0/3960571966 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637c19bf50 con 0x7f637c1017f0 2024-02-19T19:05:07.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.878+0000 7f636b7fe700 1 -- 172.21.15.96:0/3960571966 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6370021640 con 0x7f637c1017f0 2024-02-19T19:05:07.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.878+0000 7f6380fc9700 1 -- 172.21.15.96:0/3960571966 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637c19c3c0 con 0x7f637c1017f0 2024-02-19T19:05:07.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.879+0000 7f6380fc9700 1 -- 172.21.15.96:0/3960571966 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f637c1906c0 con 0x7f637c1017f0 2024-02-19T19:05:07.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.880+0000 7f636b7fe700 1 -- 172.21.15.96:0/3960571966 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 30) v1 ==== 91448+0+0 (secure 0 0 0) 0x7f637000fab0 con 0x7f637c1017f0 2024-02-19T19:05:07.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.880+0000 7f636b7fe700 1 --2- 172.21.15.96:0/3960571966 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f636406d660 0x7f636406fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:07.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.881+0000 7f636b7fe700 1 -- 172.21.15.96:0/3960571966 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f637008e5c0 con 0x7f637c1017f0 2024-02-19T19:05:07.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.881+0000 7f6379d9b700 1 --2- 172.21.15.96:0/3960571966 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f636406d660 0x7f636406fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:07.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.881+0000 7f6379d9b700 1 --2- 172.21.15.96:0/3960571966 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f636406d660 0x7f636406fb20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f636c009a10 tx=0x7f636c009190 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:07.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:07.885+0000 7f636b7fe700 1 -- 172.21.15.96:0/3960571966 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f637005bbd0 con 0x7f637c1017f0 2024-02-19T19:05:07.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:07 smithi125 ceph-mon[37556]: Upgrade: Updating node-exporter.smithi125 (2/2) 2024-02-19T19:05:07.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:07 smithi125 ceph-mon[37556]: Deploying daemon node-exporter.smithi125 on smithi125 2024-02-19T19:05:08.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.097+0000 7f6380fc9700 1 -- 172.21.15.96:0/3960571966 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f637c02cf50 con 0x7f636406d660 2024-02-19T19:05:08.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.098+0000 7f636b7fe700 1 -- 172.21.15.96:0/3960571966 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f637c02cf50 con 0x7f636406d660 2024-02-19T19:05:08.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.100+0000 7f6380fc9700 1 -- 172.21.15.96:0/3960571966 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f636406d660 msgr2=0x7f636406fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:08.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.100+0000 7f6380fc9700 1 --2- 172.21.15.96:0/3960571966 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f636406d660 0x7f636406fb20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f636c009a10 tx=0x7f636c009190 comp rx=0 tx=0).stop 2024-02-19T19:05:08.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.100+0000 7f6380fc9700 1 -- 172.21.15.96:0/3960571966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f637c1017f0 msgr2=0x7f637c196860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:08.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.100+0000 7f6380fc9700 1 --2- 172.21.15.96:0/3960571966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f637c1017f0 0x7f637c196860 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6370006010 tx=0x7f637000bd70 comp rx=0 tx=0).stop 2024-02-19T19:05:08.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.100+0000 7f6380fc9700 1 -- 172.21.15.96:0/3960571966 shutdown_connections 2024-02-19T19:05:08.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.100+0000 7f6380fc9700 1 --2- 172.21.15.96:0/3960571966 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f636406d660 0x7f636406fb20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:08.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.100+0000 7f6380fc9700 1 --2- 172.21.15.96:0/3960571966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f637c1017f0 0x7f637c196860 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:08.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.100+0000 7f6380fc9700 1 --2- 172.21.15.96:0/3960571966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f637c104120 0x7f637c196da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:08.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.100+0000 7f6380fc9700 1 -- 172.21.15.96:0/3960571966 >> 172.21.15.96:0/3960571966 conn(0x7f637c0fb160 msgr2=0x7f637c0fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:08.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.100+0000 7f6380fc9700 1 -- 172.21.15.96:0/3960571966 shutdown_connections 2024-02-19T19:05:08.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.100+0000 7f6380fc9700 1 -- 172.21.15.96:0/3960571966 wait complete. 2024-02-19T19:05:08.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.205+0000 7f5dd2bb1700 1 -- 172.21.15.96:0/1912466986 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dcc101eb0 msgr2=0x7f5dcc102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:08.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.205+0000 7f5dd2bb1700 1 --2- 172.21.15.96:0/1912466986 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dcc101eb0 0x7f5dcc102310 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00b0a0 tx=0x7f5dbc00b3b0 comp rx=0 tx=0).stop 2024-02-19T19:05:08.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.205+0000 7f5dd2bb1700 1 -- 172.21.15.96:0/1912466986 shutdown_connections 2024-02-19T19:05:08.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.205+0000 7f5dd2bb1700 1 --2- 172.21.15.96:0/1912466986 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dcc101eb0 0x7f5dcc102310 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:08.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.205+0000 7f5dd2bb1700 1 --2- 172.21.15.96:0/1912466986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dcc100cb0 0x7f5dcc1010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:08.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.205+0000 7f5dd2bb1700 1 -- 172.21.15.96:0/1912466986 >> 172.21.15.96:0/1912466986 conn(0x7f5dcc0fc230 msgr2=0x7f5dcc0fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:08.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.205+0000 7f5dd2bb1700 1 -- 172.21.15.96:0/1912466986 shutdown_connections 2024-02-19T19:05:08.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.205+0000 7f5dd2bb1700 1 -- 172.21.15.96:0/1912466986 wait complete. 2024-02-19T19:05:08.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.206+0000 7f5dd2bb1700 1 Processor -- start 2024-02-19T19:05:08.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.206+0000 7f5dd2bb1700 1 -- start start 2024-02-19T19:05:08.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.206+0000 7f5dd2bb1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dcc100cb0 0x7f5dcc074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:08.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.206+0000 7f5dd2bb1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dcc101eb0 0x7f5dcc073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:08.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.206+0000 7f5dd2bb1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc0736c0 con 0x7f5dcc101eb0 2024-02-19T19:05:08.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.206+0000 7f5dd2bb1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc073800 con 0x7f5dcc100cb0 2024-02-19T19:05:08.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.206+0000 7f5dcbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dcc101eb0 0x7f5dcc073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:08.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.206+0000 7f5dcbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dcc101eb0 0x7f5dcc073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44514/0 (socket says 172.21.15.96:44514) 2024-02-19T19:05:08.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.206+0000 7f5dd094d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dcc100cb0 0x7f5dcc074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:08.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.206+0000 7f5dcbfff700 1 -- 172.21.15.96:0/2885028756 learned_addr learned my addr 172.21.15.96:0/2885028756 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:05:08.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.206+0000 7f5dd094d700 1 -- 172.21.15.96:0/2885028756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dcc101eb0 msgr2=0x7f5dcc073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:08.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.206+0000 7f5dd094d700 1 --2- 172.21.15.96:0/2885028756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dcc101eb0 0x7f5dcc073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:08.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.206+0000 7f5dd094d700 1 -- 172.21.15.96:0/2885028756 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dbc009d00 con 0x7f5dcc100cb0 2024-02-19T19:05:08.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.206+0000 7f5dcbfff700 1 --2- 172.21.15.96:0/2885028756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dcc101eb0 0x7f5dcc073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:05:08.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.207+0000 7f5dd094d700 1 --2- 172.21.15.96:0/2885028756 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dcc100cb0 0x7f5dcc074b30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400e940 tx=0x7f5dc400ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:08.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.207+0000 7f5dc9ffb700 1 -- 172.21.15.96:0/2885028756 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5dc40041f0 con 0x7f5dcc100cb0 2024-02-19T19:05:08.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.207+0000 7f5dd2bb1700 1 -- 172.21.15.96:0/2885028756 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dcc073ae0 con 0x7f5dcc100cb0 2024-02-19T19:05:08.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.207+0000 7f5dc9ffb700 1 -- 172.21.15.96:0/2885028756 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5dc4004350 con 0x7f5dcc100cb0 2024-02-19T19:05:08.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.207+0000 7f5dc9ffb700 1 -- 172.21.15.96:0/2885028756 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5dc4003c80 con 0x7f5dcc100cb0 2024-02-19T19:05:08.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.207+0000 7f5dd2bb1700 1 -- 172.21.15.96:0/2885028756 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dcc19e510 con 0x7f5dcc100cb0 2024-02-19T19:05:08.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.208+0000 7f5dd2bb1700 1 -- 172.21.15.96:0/2885028756 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dcc109810 con 0x7f5dcc100cb0 2024-02-19T19:05:08.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.208+0000 7f5dc9ffb700 1 -- 172.21.15.96:0/2885028756 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 30) v1 ==== 91448+0+0 (secure 0 0 0) 0x7f5dc400c7c0 con 0x7f5dcc100cb0 2024-02-19T19:05:08.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.209+0000 7f5dc9ffb700 1 --2- 172.21.15.96:0/2885028756 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f5db806d660 0x7f5db806fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:08.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.209+0000 7f5dc9ffb700 1 -- 172.21.15.96:0/2885028756 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f5dc4014070 con 0x7f5dcc100cb0 2024-02-19T19:05:08.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.209+0000 7f5dcbfff700 1 --2- 172.21.15.96:0/2885028756 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f5db806d660 0x7f5db806fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:08.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.209+0000 7f5dcbfff700 1 --2- 172.21.15.96:0/2885028756 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f5db806d660 0x7f5db806fb20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc009480 tx=0x7f5dbc00b700 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:08.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.218+0000 7f5dc9ffb700 1 -- 172.21.15.96:0/2885028756 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f5dc405ab60 con 0x7f5dcc100cb0 2024-02-19T19:05:08.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.422+0000 7f5dd2bb1700 1 -- 172.21.15.96:0/2885028756 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5dcc106800 con 0x7f5db806d660 2024-02-19T19:05:08.452 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.432+0000 7f5dc9ffb700 1 -- 172.21.15.96:0/2885028756 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f5dcc106800 con 0x7f5db806d660 2024-02-19T19:05:08.452 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:05:08.452 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (7m) 10s ago 8m 25.1M - 0.25.0 c8568f914cd2 5dc55ac32e98 2024-02-19T19:05:08.452 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (9m) 10s ago 9m 7805k - 18.2.1 94eadd990e0a b41bff2e0043 2024-02-19T19:05:08.452 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (8m) 12s ago 7m 7704k - 18.2.1 94eadd990e0a 254ab7e7a040 2024-02-19T19:05:08.453 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (9m) 10s ago 9m 6660k - 18.2.1 94eadd990e0a 9250aadb9d78 2024-02-19T19:05:08.453 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (7m) 12s ago 7m 6665k - 18.2.1 94eadd990e0a b98ace7b5ded 2024-02-19T19:05:08.453 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (7m) 10s ago 8m 86.0M - 9.4.7 954c08fa6188 467f574356d5 2024-02-19T19:05:08.453 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (3m) 10s ago 3m 26.8M - 18.2.1 94eadd990e0a 0a61d9cd40d1 2024-02-19T19:05:08.453 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (3m) 10s ago 3m 20.7M - 18.2.1 94eadd990e0a 58db3e7a7d75 2024-02-19T19:05:08.453 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (3m) 12s ago 3m 24.4M - 18.2.1 94eadd990e0a 211d64de8a63 2024-02-19T19:05:08.453 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (3m) 12s ago 3m 22.5M - 18.2.1 94eadd990e0a 2a04b5a8eaf4 2024-02-19T19:05:08.453 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:8443,9283,8765 running (49s) 10s ago 10m 494M - 19.0.0-1450-gf78a58c0 f081f847070a a86fbe94fe3f 2024-02-19T19:05:08.453 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (16s) 12s ago 7m 66.9M - 19.0.0-1450-gf78a58c0 f081f847070a e250486d572d 2024-02-19T19:05:08.453 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (10m) 10s ago 10m 51.7M 2048M 18.2.1 94eadd990e0a 23d5b9626c48 2024-02-19T19:05:08.453 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (7m) 12s ago 7m 42.6M 2048M 18.2.1 94eadd990e0a 27b4cad04cc5 2024-02-19T19:05:08.453 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 starting - - - - 2024-02-19T19:05:08.453 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (7m) 12s ago 7m 15.2M - 1.5.0 0da6a335fe13 fc1d96c078d9 2024-02-19T19:05:08.453 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (6m) 10s ago 6m 49.6M 1216M 18.2.1 94eadd990e0a d5bbf07ad0e7 2024-02-19T19:05:08.454 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (6m) 10s ago 6m 49.4M 1216M 18.2.1 94eadd990e0a 40329d59be45 2024-02-19T19:05:08.454 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (6m) 10s ago 6m 48.2M 1216M 18.2.1 94eadd990e0a 4f1e49db2d41 2024-02-19T19:05:08.454 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (5m) 12s ago 5m 49.7M 2240M 18.2.1 94eadd990e0a 4746b79351fc 2024-02-19T19:05:08.454 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (5m) 12s ago 5m 49.3M 2240M 18.2.1 94eadd990e0a 2b3f0088f6b2 2024-02-19T19:05:08.454 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (4m) 12s ago 4m 46.1M 2240M 18.2.1 94eadd990e0a e5731974b46a 2024-02-19T19:05:08.454 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (22s) 10s ago 8m 37.9M - 2.43.0 a07b618ecd1d f72d5ab87d25 2024-02-19T19:05:08.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.435+0000 7f5dd2bb1700 1 -- 172.21.15.96:0/2885028756 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f5db806d660 msgr2=0x7f5db806fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:08.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.435+0000 7f5dd2bb1700 1 --2- 172.21.15.96:0/2885028756 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f5db806d660 0x7f5db806fb20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc009480 tx=0x7f5dbc00b700 comp rx=0 tx=0).stop 2024-02-19T19:05:08.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.435+0000 7f5dd2bb1700 1 -- 172.21.15.96:0/2885028756 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dcc100cb0 msgr2=0x7f5dcc074b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:08.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.435+0000 7f5dd2bb1700 1 --2- 172.21.15.96:0/2885028756 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dcc100cb0 0x7f5dcc074b30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400e940 tx=0x7f5dc400ec50 comp rx=0 tx=0).stop 2024-02-19T19:05:08.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.435+0000 7f5dd2bb1700 1 -- 172.21.15.96:0/2885028756 shutdown_connections 2024-02-19T19:05:08.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.435+0000 7f5dd2bb1700 1 --2- 172.21.15.96:0/2885028756 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5dcc100cb0 0x7f5dcc074b30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:08.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.435+0000 7f5dd2bb1700 1 --2- 172.21.15.96:0/2885028756 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f5db806d660 0x7f5db806fb20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:08.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.435+0000 7f5dd2bb1700 1 --2- 172.21.15.96:0/2885028756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5dcc101eb0 0x7f5dcc073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:08.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.435+0000 7f5dd2bb1700 1 -- 172.21.15.96:0/2885028756 >> 172.21.15.96:0/2885028756 conn(0x7f5dcc0fc230 msgr2=0x7f5dcc1050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:08.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.435+0000 7f5dd2bb1700 1 -- 172.21.15.96:0/2885028756 shutdown_connections 2024-02-19T19:05:08.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.435+0000 7f5dd2bb1700 1 -- 172.21.15.96:0/2885028756 wait complete. 2024-02-19T19:05:08.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.537+0000 7f6dc5325700 1 -- 172.21.15.96:0/434475522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dc0104170 msgr2=0x7f6dc0106560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:08.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.537+0000 7f6dc5325700 1 --2- 172.21.15.96:0/434475522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dc0104170 0x7f6dc0106560 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6da8009910 tx=0x7f6da8009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:08.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.537+0000 7f6dc5325700 1 -- 172.21.15.96:0/434475522 shutdown_connections 2024-02-19T19:05:08.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.537+0000 7f6dc5325700 1 --2- 172.21.15.96:0/434475522 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dc0104170 0x7f6dc0106560 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:08.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.537+0000 7f6dc5325700 1 --2- 172.21.15.96:0/434475522 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6dc0101840 0x7f6dc0103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:08.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.537+0000 7f6dc5325700 1 -- 172.21.15.96:0/434475522 >> 172.21.15.96:0/434475522 conn(0x7f6dc00fb190 msgr2=0x7f6dc00fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:08.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.538+0000 7f6dc5325700 1 -- 172.21.15.96:0/434475522 shutdown_connections 2024-02-19T19:05:08.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.538+0000 7f6dc5325700 1 -- 172.21.15.96:0/434475522 wait complete. 2024-02-19T19:05:08.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.538+0000 7f6dc5325700 1 Processor -- start 2024-02-19T19:05:08.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.538+0000 7f6dc5325700 1 -- start start 2024-02-19T19:05:08.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.538+0000 7f6dc5325700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dc0101840 0x7f6dc0196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:08.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.538+0000 7f6dc5325700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6dc0104170 0x7f6dc01969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:08.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.538+0000 7f6dc5325700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc0196fd0 con 0x7f6dc0101840 2024-02-19T19:05:08.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.538+0000 7f6dc5325700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc0197110 con 0x7f6dc0104170 2024-02-19T19:05:08.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.539+0000 7f6dbeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dc0101840 0x7f6dc0196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:08.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.539+0000 7f6dbeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dc0101840 0x7f6dc0196470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44542/0 (socket says 172.21.15.96:44542) 2024-02-19T19:05:08.560 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.539+0000 7f6dbeffd700 1 -- 172.21.15.96:0/2117885637 learned_addr learned my addr 172.21.15.96:0/2117885637 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:05:08.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.539+0000 7f6db67fc700 1 --2- 172.21.15.96:0/2117885637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6dc0104170 0x7f6dc01969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:08.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.539+0000 7f6dbeffd700 1 -- 172.21.15.96:0/2117885637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6dc0104170 msgr2=0x7f6dc01969b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:08.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.539+0000 7f6dbeffd700 1 --2- 172.21.15.96:0/2117885637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6dc0104170 0x7f6dc01969b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:08.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.539+0000 7f6dbeffd700 1 -- 172.21.15.96:0/2117885637 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da80095f0 con 0x7f6dc0101840 2024-02-19T19:05:08.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.539+0000 7f6dbeffd700 1 --2- 172.21.15.96:0/2117885637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dc0101840 0x7f6dc0196470 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6db000d8d0 tx=0x7f6db000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:08.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.539+0000 7f6dbcff9700 1 -- 172.21.15.96:0/2117885637 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6db00098a0 con 0x7f6dc0101840 2024-02-19T19:05:08.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.539+0000 7f6dbcff9700 1 -- 172.21.15.96:0/2117885637 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6db0010460 con 0x7f6dc0101840 2024-02-19T19:05:08.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.539+0000 7f6dc5325700 1 -- 172.21.15.96:0/2117885637 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc019bbc0 con 0x7f6dc0101840 2024-02-19T19:05:08.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.539+0000 7f6dbcff9700 1 -- 172.21.15.96:0/2117885637 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6db000f5f0 con 0x7f6dc0101840 2024-02-19T19:05:08.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.539+0000 7f6dc5325700 1 -- 172.21.15.96:0/2117885637 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc019c110 con 0x7f6dc0101840 2024-02-19T19:05:08.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.540+0000 7f6dc5325700 1 -- 172.21.15.96:0/2117885637 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc0109810 con 0x7f6dc0101840 2024-02-19T19:05:08.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.541+0000 7f6dbcff9700 1 -- 172.21.15.96:0/2117885637 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 30) v1 ==== 91448+0+0 (secure 0 0 0) 0x7f6db0009a00 con 0x7f6dc0101840 2024-02-19T19:05:08.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.541+0000 7f6dbcff9700 1 --2- 172.21.15.96:0/2117885637 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f6dac06d660 0x7f6dac06fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:08.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.541+0000 7f6dbcff9700 1 -- 172.21.15.96:0/2117885637 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f6db008d0c0 con 0x7f6dc0101840 2024-02-19T19:05:08.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.541+0000 7f6db67fc700 1 --2- 172.21.15.96:0/2117885637 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f6dac06d660 0x7f6dac06fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:08.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.542+0000 7f6db67fc700 1 --2- 172.21.15.96:0/2117885637 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f6dac06d660 0x7f6dac06fb20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6da8006010 tx=0x7f6da800b540 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:08.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.546+0000 7f6dbcff9700 1 -- 172.21.15.96:0/2117885637 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f6db005a6b0 con 0x7f6dc0101840 2024-02-19T19:05:08.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:08 smithi125 ceph-mon[37556]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:08.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:08 smithi125 ceph-mon[37556]: pgmap v22: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:08.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:08 smithi125 ceph-mon[37556]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:08.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:08 smithi125 ceph-mon[37556]: from='client.24447 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:08.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.822+0000 7f6dc5325700 1 -- 172.21.15.96:0/2117885637 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6dc0109a00 con 0x7f6dc0101840 2024-02-19T19:05:08.842 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:08 smithi096 ceph-mon[29216]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:08.843 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:08 smithi096 ceph-mon[29216]: pgmap v22: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:08.843 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:08 smithi096 ceph-mon[29216]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:08.843 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:08 smithi096 ceph-mon[29216]: from='client.24447 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:08.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.822+0000 7f6dbcff9700 1 -- 172.21.15.96:0/2117885637 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f6db005a240 con 0x7f6dc0101840 2024-02-19T19:05:08.843 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:05:08.843 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:05:08.843 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-19T19:05:08.843 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:05:08.843 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:05:08.844 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:05:08.844 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:05:08.844 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:05:08.844 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-19T19:05:08.844 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:05:08.844 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:05:08.844 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-19T19:05:08.844 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:05:08.844 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:05:08.844 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 12, 2024-02-19T19:05:08.844 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:05:08.844 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:05:08.844 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:05:08.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.824+0000 7f6dc5325700 1 -- 172.21.15.96:0/2117885637 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f6dac06d660 msgr2=0x7f6dac06fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:08.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.824+0000 7f6dc5325700 1 --2- 172.21.15.96:0/2117885637 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f6dac06d660 0x7f6dac06fb20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6da8006010 tx=0x7f6da800b540 comp rx=0 tx=0).stop 2024-02-19T19:05:08.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.824+0000 7f6dc5325700 1 -- 172.21.15.96:0/2117885637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dc0101840 msgr2=0x7f6dc0196470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:08.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.824+0000 7f6dc5325700 1 --2- 172.21.15.96:0/2117885637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dc0101840 0x7f6dc0196470 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6db000d8d0 tx=0x7f6db000dbe0 comp rx=0 tx=0).stop 2024-02-19T19:05:08.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.824+0000 7f6dc5325700 1 -- 172.21.15.96:0/2117885637 shutdown_connections 2024-02-19T19:05:08.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.824+0000 7f6dc5325700 1 --2- 172.21.15.96:0/2117885637 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f6dac06d660 0x7f6dac06fb20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:08.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.824+0000 7f6dc5325700 1 --2- 172.21.15.96:0/2117885637 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6dc0101840 0x7f6dc0196470 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:08.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.824+0000 7f6dc5325700 1 --2- 172.21.15.96:0/2117885637 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6dc0104170 0x7f6dc01969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:08.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.824+0000 7f6dc5325700 1 -- 172.21.15.96:0/2117885637 >> 172.21.15.96:0/2117885637 conn(0x7f6dc00fb190 msgr2=0x7f6dc00fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:08.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.825+0000 7f6dc5325700 1 -- 172.21.15.96:0/2117885637 shutdown_connections 2024-02-19T19:05:08.846 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.825+0000 7f6dc5325700 1 -- 172.21.15.96:0/2117885637 wait complete. 2024-02-19T19:05:08.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.930+0000 7fad2ed67700 1 -- 172.21.15.96:0/2878080089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad280ffbc0 msgr2=0x7fad280fffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:08.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.930+0000 7fad2ed67700 1 --2- 172.21.15.96:0/2878080089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad280ffbc0 0x7fad280fffe0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fad24009910 tx=0x7fad24009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:08.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.930+0000 7fad2ed67700 1 -- 172.21.15.96:0/2878080089 shutdown_connections 2024-02-19T19:05:08.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.930+0000 7fad2ed67700 1 --2- 172.21.15.96:0/2878080089 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad28100dc0 0x7fad28101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:08.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.930+0000 7fad2ed67700 1 --2- 172.21.15.96:0/2878080089 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad280ffbc0 0x7fad280fffe0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:08.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.930+0000 7fad2ed67700 1 -- 172.21.15.96:0/2878080089 >> 172.21.15.96:0/2878080089 conn(0x7fad280fb160 msgr2=0x7fad280fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:08.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.930+0000 7fad2ed67700 1 -- 172.21.15.96:0/2878080089 shutdown_connections 2024-02-19T19:05:08.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.930+0000 7fad2ed67700 1 -- 172.21.15.96:0/2878080089 wait complete. 2024-02-19T19:05:08.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.930+0000 7fad2ed67700 1 Processor -- start 2024-02-19T19:05:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.930+0000 7fad2ed67700 1 -- start start 2024-02-19T19:05:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.931+0000 7fad2ed67700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad280ffbc0 0x7fad28069970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.931+0000 7fad2ed67700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad28100dc0 0x7fad2819d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.931+0000 7fad2ed67700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad281973c0 con 0x7fad28100dc0 2024-02-19T19:05:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.931+0000 7fad2ed67700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2819de90 con 0x7fad280ffbc0 2024-02-19T19:05:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.931+0000 7fad1ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad28100dc0 0x7fad2819d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.931+0000 7fad1ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad28100dc0 0x7fad2819d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44554/0 (socket says 172.21.15.96:44554) 2024-02-19T19:05:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.931+0000 7fad1ffff700 1 -- 172.21.15.96:0/4047343191 learned_addr learned my addr 172.21.15.96:0/4047343191 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:05:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.931+0000 7fad2cb03700 1 --2- 172.21.15.96:0/4047343191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad280ffbc0 0x7fad28069970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.931+0000 7fad1ffff700 1 -- 172.21.15.96:0/4047343191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad280ffbc0 msgr2=0x7fad28069970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.931+0000 7fad1ffff700 1 --2- 172.21.15.96:0/4047343191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad280ffbc0 0x7fad28069970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.931+0000 7fad1ffff700 1 -- 172.21.15.96:0/4047343191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad240095f0 con 0x7fad28100dc0 2024-02-19T19:05:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.931+0000 7fad1ffff700 1 --2- 172.21.15.96:0/4047343191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad28100dc0 0x7fad2819d950 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fad1800b4e0 tx=0x7fad1800b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.931+0000 7fad1dffb700 1 -- 172.21.15.96:0/4047343191 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad18011800 con 0x7fad28100dc0 2024-02-19T19:05:08.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.931+0000 7fad1dffb700 1 -- 172.21.15.96:0/4047343191 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fad18011e10 con 0x7fad28100dc0 2024-02-19T19:05:08.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.931+0000 7fad2ed67700 1 -- 172.21.15.96:0/4047343191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2819e140 con 0x7fad28100dc0 2024-02-19T19:05:08.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.931+0000 7fad1dffb700 1 -- 172.21.15.96:0/4047343191 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad1800f2e0 con 0x7fad28100dc0 2024-02-19T19:05:08.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.932+0000 7fad2ed67700 1 -- 172.21.15.96:0/4047343191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2819e690 con 0x7fad28100dc0 2024-02-19T19:05:08.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.932+0000 7fad2ed67700 1 -- 172.21.15.96:0/4047343191 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2818f5b0 con 0x7fad28100dc0 2024-02-19T19:05:08.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.933+0000 7fad1dffb700 1 -- 172.21.15.96:0/4047343191 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 30) v1 ==== 91448+0+0 (secure 0 0 0) 0x7fad18010380 con 0x7fad28100dc0 2024-02-19T19:05:08.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.933+0000 7fad1dffb700 1 --2- 172.21.15.96:0/4047343191 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fad1006d660 0x7fad1006fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:08.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.933+0000 7fad1dffb700 1 -- 172.21.15.96:0/4047343191 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fad1808cc50 con 0x7fad28100dc0 2024-02-19T19:05:08.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.933+0000 7fad2cb03700 1 --2- 172.21.15.96:0/4047343191 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fad1006d660 0x7fad1006fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:08.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.934+0000 7fad2cb03700 1 --2- 172.21.15.96:0/4047343191 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fad1006d660 0x7fad1006fb20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fad24006010 tx=0x7fad2400b540 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:08.957 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:08.938+0000 7fad1dffb700 1 -- 172.21.15.96:0/4047343191 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fad1805a350 con 0x7fad28100dc0 2024-02-19T19:05:09.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:09.149+0000 7fad2ed67700 1 -- 172.21.15.96:0/4047343191 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fad2802d010 con 0x7fad1006d660 2024-02-19T19:05:09.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:09.150+0000 7fad1dffb700 1 -- 172.21.15.96:0/4047343191 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fad2802d010 con 0x7fad1006d660 2024-02-19T19:05:09.170 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:05:09.170 INFO:teuthology.orchestra.run.smithi096.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:05:09.170 INFO:teuthology.orchestra.run.smithi096.stdout: "in_progress": true, 2024-02-19T19:05:09.170 INFO:teuthology.orchestra.run.smithi096.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-19T19:05:09.170 INFO:teuthology.orchestra.run.smithi096.stdout: "services_complete": [ 2024-02-19T19:05:09.171 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr" 2024-02-19T19:05:09.171 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-02-19T19:05:09.171 INFO:teuthology.orchestra.run.smithi096.stdout: "progress": "2/2 daemons upgraded", 2024-02-19T19:05:09.171 INFO:teuthology.orchestra.run.smithi096.stdout: "message": "Currently upgrading node-exporter daemons", 2024-02-19T19:05:09.171 INFO:teuthology.orchestra.run.smithi096.stdout: "is_paused": false 2024-02-19T19:05:09.171 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:05:09.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:09.152+0000 7fad2ed67700 1 -- 172.21.15.96:0/4047343191 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fad1006d660 msgr2=0x7fad1006fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:09.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:09.152+0000 7fad2ed67700 1 --2- 172.21.15.96:0/4047343191 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fad1006d660 0x7fad1006fb20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fad24006010 tx=0x7fad2400b540 comp rx=0 tx=0).stop 2024-02-19T19:05:09.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:09.152+0000 7fad2ed67700 1 -- 172.21.15.96:0/4047343191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad28100dc0 msgr2=0x7fad2819d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:09.172 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:09.152+0000 7fad2ed67700 1 --2- 172.21.15.96:0/4047343191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad28100dc0 0x7fad2819d950 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fad1800b4e0 tx=0x7fad1800b7f0 comp rx=0 tx=0).stop 2024-02-19T19:05:09.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:09.152+0000 7fad2ed67700 1 -- 172.21.15.96:0/4047343191 shutdown_connections 2024-02-19T19:05:09.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:09.152+0000 7fad2ed67700 1 --2- 172.21.15.96:0/4047343191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad280ffbc0 0x7fad28069970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:09.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:09.152+0000 7fad2ed67700 1 --2- 172.21.15.96:0/4047343191 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fad1006d660 0x7fad1006fb20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:09.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:09.152+0000 7fad2ed67700 1 --2- 172.21.15.96:0/4047343191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad28100dc0 0x7fad2819d950 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:09.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:09.152+0000 7fad2ed67700 1 -- 172.21.15.96:0/4047343191 >> 172.21.15.96:0/4047343191 conn(0x7fad280fb160 msgr2=0x7fad281040f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:09.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:09.152+0000 7fad2ed67700 1 -- 172.21.15.96:0/4047343191 shutdown_connections 2024-02-19T19:05:09.173 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:09.152+0000 7fad2ed67700 1 -- 172.21.15.96:0/4047343191 wait complete. 2024-02-19T19:05:09.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:09 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/2117885637' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:09.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:09 smithi125 ceph-mon[37556]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:10.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:09 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/2117885637' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:10.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:09 smithi096 ceph-mon[29216]: from='client.14724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:11.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:11 smithi125 ceph-mon[37556]: pgmap v23: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:11.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:11 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:11.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:11 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:11.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:11 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:11.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:11 smithi096 ceph-mon[29216]: pgmap v23: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:11.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:11 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:11.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:11 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:11.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:11 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:13.399 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:13 smithi096 ceph-mon[29216]: pgmap v24: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:13.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:13 smithi125 ceph-mon[37556]: pgmap v24: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:14.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:14 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:14.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:14 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:14.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:14 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:14.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:14 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:15.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:15 smithi125 ceph-mon[37556]: pgmap v25: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:15.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:15 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:15.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:15 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:15.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:15 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:05:15.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:15 smithi096 ceph-mon[29216]: pgmap v25: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:15.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:15 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:15.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:15 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:15.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:15 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:05:16.495 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:16 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:16.496 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:16 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:16.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:16 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:16.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:16 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:17.497 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:17 smithi096 ceph-mon[29216]: pgmap v26: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:17.497 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:17 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:17.498 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:17 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:17.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:17 smithi125 ceph-mon[37556]: pgmap v26: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:17.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:17 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:17.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:17 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:19.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:19 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:19.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:19 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:19.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:19 smithi096 ceph-mon[29216]: pgmap v27: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:19.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:19 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:19.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:19 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:19.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:19 smithi125 ceph-mon[37556]: pgmap v27: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:21.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:21 smithi125 ceph-mon[37556]: pgmap v28: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:21.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:21 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:21.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:21 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:21.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:21 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:21.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:21 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:05:21.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:21 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:21.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:21 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:21.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:21 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:21.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:21 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:21.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:21 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:21.453 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:21 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:21.453 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:21 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:21.453 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:21 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:21.453 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:21 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:21.453 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:21 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:21.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:21 smithi096 ceph-mon[29216]: pgmap v28: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:21.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:21 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:21.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:21 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:21.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:21 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:21.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:21 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:05:21.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:21 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:21.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:21 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:21.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:21 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:21.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:21 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:21.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:21 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:21.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:21 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:21.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:21 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:21.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:21 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:21.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:21 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:21.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:21 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:23.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:23 smithi096 ceph-mon[29216]: Upgrade: Updating prometheus.smithi096 2024-02-19T19:05:23.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:23 smithi096 ceph-mon[29216]: pgmap v29: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:23.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:23 smithi096 ceph-mon[29216]: Deploying daemon prometheus.smithi096 on smithi096 2024-02-19T19:05:23.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:23 smithi125 ceph-mon[37556]: Upgrade: Updating prometheus.smithi096 2024-02-19T19:05:23.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:23 smithi125 ceph-mon[37556]: pgmap v29: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:23.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:23 smithi125 ceph-mon[37556]: Deploying daemon prometheus.smithi096 on smithi096 2024-02-19T19:05:25.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:25 smithi125 ceph-mon[37556]: pgmap v30: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:25.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:25 smithi096 ceph-mon[29216]: pgmap v30: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:27.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:27 smithi096 ceph-mon[29216]: pgmap v31: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:27.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:27 smithi125 ceph-mon[37556]: pgmap v31: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:29.367 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:29 smithi096 ceph-mon[29216]: pgmap v32: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:29.367 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:29 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:29.367 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:29 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:29.367 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:29 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:29.367 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:29 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:29.367 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:29 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:29.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:29 smithi125 ceph-mon[37556]: pgmap v32: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:29.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:29 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:29.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:29 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:29.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:29 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:29.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:29 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:29.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:29 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:31.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:31 smithi096 ceph-mon[29216]: pgmap v33: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:31.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:31 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:05:31.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:31 smithi125 ceph-mon[37556]: pgmap v33: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:31.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:31 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:05:33.420 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:33 smithi096 ceph-mon[29216]: pgmap v34: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:33.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:33 smithi125 ceph-mon[37556]: pgmap v34: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:35.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:34 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:35.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:34 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:35.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:34 smithi125 ceph-mon[37556]: pgmap v35: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:35.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:34 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:35.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:34 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:35.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:34 smithi096 ceph-mon[29216]: pgmap v35: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:36.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:35 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:36.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:35 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:36.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:35 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:36.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:35 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:37.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:36 smithi096 ceph-mon[29216]: pgmap v36: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:37.423 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:36 smithi125 ceph-mon[37556]: pgmap v36: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:39.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.267+0000 7fdbfa861700 1 -- 172.21.15.96:0/3978187072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbf4100da0 msgr2=0x7fdbf4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:39.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.267+0000 7fdbfa861700 1 --2- 172.21.15.96:0/3978187072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbf4100da0 0x7fdbf4101200 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8009910 tx=0x7fdbe8009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:39.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.267+0000 7fdbfa861700 1 -- 172.21.15.96:0/3978187072 shutdown_connections 2024-02-19T19:05:39.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.267+0000 7fdbfa861700 1 --2- 172.21.15.96:0/3978187072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbf4100da0 0x7fdbf4101200 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:39.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.267+0000 7fdbfa861700 1 --2- 172.21.15.96:0/3978187072 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbf40ffba0 0x7fdbf40fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:39.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.267+0000 7fdbfa861700 1 -- 172.21.15.96:0/3978187072 >> 172.21.15.96:0/3978187072 conn(0x7fdbf40fb120 msgr2=0x7fdbf40fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:39.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.267+0000 7fdbfa861700 1 -- 172.21.15.96:0/3978187072 shutdown_connections 2024-02-19T19:05:39.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.267+0000 7fdbfa861700 1 -- 172.21.15.96:0/3978187072 wait complete. 2024-02-19T19:05:39.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.268+0000 7fdbfa861700 1 Processor -- start 2024-02-19T19:05:39.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.268+0000 7fdbfa861700 1 -- start start 2024-02-19T19:05:39.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.268+0000 7fdbfa861700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbf40ffba0 0x7fdbf4069970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:39.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.268+0000 7fdbfa861700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbf4100da0 0x7fdbf419b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:39.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.268+0000 7fdbfa861700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf419b7d0 con 0x7fdbf40ffba0 2024-02-19T19:05:39.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.268+0000 7fdbfa861700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf419b910 con 0x7fdbf4100da0 2024-02-19T19:05:39.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.268+0000 7fdbf3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbf40ffba0 0x7fdbf4069970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:39.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.268+0000 7fdbf3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbf40ffba0 0x7fdbf4069970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43870/0 (socket says 172.21.15.96:43870) 2024-02-19T19:05:39.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.268+0000 7fdbf3fff700 1 -- 172.21.15.96:0/1529440738 learned_addr learned my addr 172.21.15.96:0/1529440738 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:05:39.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.269+0000 7fdbf37fe700 1 --2- 172.21.15.96:0/1529440738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbf4100da0 0x7fdbf419b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:39.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.269+0000 7fdbf3fff700 1 -- 172.21.15.96:0/1529440738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbf4100da0 msgr2=0x7fdbf419b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:39.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.269+0000 7fdbf3fff700 1 --2- 172.21.15.96:0/1529440738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbf4100da0 0x7fdbf419b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:39.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.269+0000 7fdbf3fff700 1 -- 172.21.15.96:0/1529440738 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe80095f0 con 0x7fdbf40ffba0 2024-02-19T19:05:39.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.269+0000 7fdbf3fff700 1 --2- 172.21.15.96:0/1529440738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbf40ffba0 0x7fdbf4069970 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400d900 tx=0x7fdbe400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:39.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.269+0000 7fdbf17fa700 1 -- 172.21.15.96:0/1529440738 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbe400b920 con 0x7fdbf40ffba0 2024-02-19T19:05:39.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.269+0000 7fdbfa861700 1 -- 172.21.15.96:0/1529440738 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf419bbf0 con 0x7fdbf40ffba0 2024-02-19T19:05:39.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.269+0000 7fdbf17fa700 1 -- 172.21.15.96:0/1529440738 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdbe4010460 con 0x7fdbf40ffba0 2024-02-19T19:05:39.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.269+0000 7fdbf17fa700 1 -- 172.21.15.96:0/1529440738 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbe400f5d0 con 0x7fdbf40ffba0 2024-02-19T19:05:39.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.269+0000 7fdbfa861700 1 -- 172.21.15.96:0/1529440738 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf419c140 con 0x7fdbf40ffba0 2024-02-19T19:05:39.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.270+0000 7fdbfa861700 1 -- 172.21.15.96:0/1529440738 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf4108700 con 0x7fdbf40ffba0 2024-02-19T19:05:39.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.271+0000 7fdbf17fa700 1 -- 172.21.15.96:0/1529440738 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 30) v1 ==== 91448+0+0 (secure 0 0 0) 0x7fdbe400ba80 con 0x7fdbf40ffba0 2024-02-19T19:05:39.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.271+0000 7fdbf17fa700 1 --2- 172.21.15.96:0/1529440738 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fdbdc06d660 0x7fdbdc06fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:39.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.271+0000 7fdbf17fa700 1 -- 172.21.15.96:0/1529440738 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fdbe408d010 con 0x7fdbf40ffba0 2024-02-19T19:05:39.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.271+0000 7fdbf37fe700 1 --2- 172.21.15.96:0/1529440738 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fdbdc06d660 0x7fdbdc06fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:39.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.271+0000 7fdbf37fe700 1 --2- 172.21.15.96:0/1529440738 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fdbdc06d660 0x7fdbdc06fb20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4069ef0 tx=0x7fdbe800b580 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:39.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.276+0000 7fdbf17fa700 1 -- 172.21.15.96:0/1529440738 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fdbe405a600 con 0x7fdbf40ffba0 2024-02-19T19:05:39.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.495+0000 7fdbfa861700 1 -- 172.21.15.96:0/1529440738 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdbf41056f0 con 0x7fdbdc06d660 2024-02-19T19:05:39.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.496+0000 7fdbf17fa700 1 -- 172.21.15.96:0/1529440738 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fdbf41056f0 con 0x7fdbdc06d660 2024-02-19T19:05:39.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.498+0000 7fdbfa861700 1 -- 172.21.15.96:0/1529440738 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fdbdc06d660 msgr2=0x7fdbdc06fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:39.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.498+0000 7fdbfa861700 1 --2- 172.21.15.96:0/1529440738 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fdbdc06d660 0x7fdbdc06fb20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4069ef0 tx=0x7fdbe800b580 comp rx=0 tx=0).stop 2024-02-19T19:05:39.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.498+0000 7fdbfa861700 1 -- 172.21.15.96:0/1529440738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbf40ffba0 msgr2=0x7fdbf4069970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:39.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.498+0000 7fdbfa861700 1 --2- 172.21.15.96:0/1529440738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbf40ffba0 0x7fdbf4069970 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400d900 tx=0x7fdbe400dcc0 comp rx=0 tx=0).stop 2024-02-19T19:05:39.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.498+0000 7fdbfa861700 1 -- 172.21.15.96:0/1529440738 shutdown_connections 2024-02-19T19:05:39.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.498+0000 7fdbfa861700 1 --2- 172.21.15.96:0/1529440738 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fdbdc06d660 0x7fdbdc06fb20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:39.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.498+0000 7fdbfa861700 1 --2- 172.21.15.96:0/1529440738 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbf40ffba0 0x7fdbf4069970 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:39.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.498+0000 7fdbfa861700 1 --2- 172.21.15.96:0/1529440738 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbf4100da0 0x7fdbf419b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:39.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.498+0000 7fdbfa861700 1 -- 172.21.15.96:0/1529440738 >> 172.21.15.96:0/1529440738 conn(0x7fdbf40fb120 msgr2=0x7fdbf4103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:39.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.498+0000 7fdbfa861700 1 -- 172.21.15.96:0/1529440738 shutdown_connections 2024-02-19T19:05:39.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.498+0000 7fdbfa861700 1 -- 172.21.15.96:0/1529440738 wait complete. 2024-02-19T19:05:39.529 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:05:39.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.607+0000 7f919616b700 1 -- 172.21.15.96:0/3847143047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9190101ea0 msgr2=0x7f9190102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:39.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.607+0000 7f919616b700 1 --2- 172.21.15.96:0/3847143047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9190101ea0 0x7f9190102300 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9184009910 tx=0x7f9184009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:39.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.607+0000 7f919616b700 1 -- 172.21.15.96:0/3847143047 shutdown_connections 2024-02-19T19:05:39.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.607+0000 7f919616b700 1 --2- 172.21.15.96:0/3847143047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9190101ea0 0x7f9190102300 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:39.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.607+0000 7f919616b700 1 --2- 172.21.15.96:0/3847143047 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9190100ca0 0x7f91901010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:39.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.607+0000 7f919616b700 1 -- 172.21.15.96:0/3847143047 >> 172.21.15.96:0/3847143047 conn(0x7f91900fc260 msgr2=0x7f91900fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:39.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.607+0000 7f919616b700 1 -- 172.21.15.96:0/3847143047 shutdown_connections 2024-02-19T19:05:39.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.607+0000 7f919616b700 1 -- 172.21.15.96:0/3847143047 wait complete. 2024-02-19T19:05:39.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.608+0000 7f919616b700 1 Processor -- start 2024-02-19T19:05:39.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.608+0000 7f919616b700 1 -- start start 2024-02-19T19:05:39.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.608+0000 7f919616b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9190100ca0 0x7f91901964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:39.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.608+0000 7f919616b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9190101ea0 0x7f9190196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:39.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.608+0000 7f919616b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9190197040 con 0x7f9190101ea0 2024-02-19T19:05:39.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.608+0000 7f919616b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9190197180 con 0x7f9190100ca0 2024-02-19T19:05:39.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.608+0000 7f918effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9190101ea0 0x7f9190196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:39.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.608+0000 7f918effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9190101ea0 0x7f9190196a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43874/0 (socket says 172.21.15.96:43874) 2024-02-19T19:05:39.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.608+0000 7f918effd700 1 -- 172.21.15.96:0/530768451 learned_addr learned my addr 172.21.15.96:0/530768451 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:05:39.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.608+0000 7f918f7fe700 1 --2- 172.21.15.96:0/530768451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9190100ca0 0x7f91901964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:39.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.609+0000 7f918effd700 1 -- 172.21.15.96:0/530768451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9190100ca0 msgr2=0x7f91901964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:39.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.609+0000 7f918effd700 1 --2- 172.21.15.96:0/530768451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9190100ca0 0x7f91901964e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:39.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.609+0000 7f918effd700 1 -- 172.21.15.96:0/530768451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91840095f0 con 0x7f9190101ea0 2024-02-19T19:05:39.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.609+0000 7f918effd700 1 --2- 172.21.15.96:0/530768451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9190101ea0 0x7f9190196a20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9184006010 tx=0x7f918400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:39.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.609+0000 7f918cff9700 1 -- 172.21.15.96:0/530768451 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f918401d070 con 0x7f9190101ea0 2024-02-19T19:05:39.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.609+0000 7f919616b700 1 -- 172.21.15.96:0/530768451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f919019bbd0 con 0x7f9190101ea0 2024-02-19T19:05:39.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.609+0000 7f918cff9700 1 -- 172.21.15.96:0/530768451 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f918400f460 con 0x7f9190101ea0 2024-02-19T19:05:39.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.609+0000 7f918cff9700 1 -- 172.21.15.96:0/530768451 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9184021640 con 0x7f9190101ea0 2024-02-19T19:05:39.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.609+0000 7f919616b700 1 -- 172.21.15.96:0/530768451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919019c0c0 con 0x7f9190101ea0 2024-02-19T19:05:39.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.610+0000 7f919616b700 1 -- 172.21.15.96:0/530768451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9190109800 con 0x7f9190101ea0 2024-02-19T19:05:39.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.611+0000 7f918cff9700 1 -- 172.21.15.96:0/530768451 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 30) v1 ==== 91448+0+0 (secure 0 0 0) 0x7f9184003a60 con 0x7f9190101ea0 2024-02-19T19:05:39.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.611+0000 7f918cff9700 1 --2- 172.21.15.96:0/530768451 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f917806d660 0x7f917806fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:39.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.611+0000 7f918cff9700 1 -- 172.21.15.96:0/530768451 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f918408e380 con 0x7f9190101ea0 2024-02-19T19:05:39.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.611+0000 7f918f7fe700 1 --2- 172.21.15.96:0/530768451 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f917806d660 0x7f917806fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:39.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.612+0000 7f918f7fe700 1 --2- 172.21.15.96:0/530768451 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f917806d660 0x7f917806fb20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9190101d00 tx=0x7f918000b410 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:39.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.616+0000 7f918cff9700 1 -- 172.21.15.96:0/530768451 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f918405b9f0 con 0x7f9190101ea0 2024-02-19T19:05:39.854 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.833+0000 7f919616b700 1 -- 172.21.15.96:0/530768451 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f91901067f0 con 0x7f917806d660 2024-02-19T19:05:39.854 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:39 smithi096 ceph-mon[29216]: pgmap v37: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:39.854 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:39 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:39.854 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:39 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:39.854 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:39 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:39.854 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:39 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:05:39.854 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:39 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:39.854 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:39 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:05:39.854 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:39 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:39.854 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:39 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:39.855 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:39 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:39.855 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:39 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:39.855 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:39 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:39.855 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:39 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:39.855 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:39 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:39.855 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:39 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:39.855 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:39 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:39.855 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:39 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:39.855 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.834+0000 7f918cff9700 1 -- 172.21.15.96:0/530768451 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f91901067f0 con 0x7f917806d660 2024-02-19T19:05:39.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.836+0000 7f919616b700 1 -- 172.21.15.96:0/530768451 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f917806d660 msgr2=0x7f917806fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:39.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.836+0000 7f919616b700 1 --2- 172.21.15.96:0/530768451 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f917806d660 0x7f917806fb20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9190101d00 tx=0x7f918000b410 comp rx=0 tx=0).stop 2024-02-19T19:05:39.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.836+0000 7f919616b700 1 -- 172.21.15.96:0/530768451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9190101ea0 msgr2=0x7f9190196a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:39.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.836+0000 7f919616b700 1 --2- 172.21.15.96:0/530768451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9190101ea0 0x7f9190196a20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9184006010 tx=0x7f918400bd70 comp rx=0 tx=0).stop 2024-02-19T19:05:39.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.836+0000 7f919616b700 1 -- 172.21.15.96:0/530768451 shutdown_connections 2024-02-19T19:05:39.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.836+0000 7f919616b700 1 --2- 172.21.15.96:0/530768451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9190100ca0 0x7f91901964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:39.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.836+0000 7f919616b700 1 --2- 172.21.15.96:0/530768451 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f917806d660 0x7f917806fb20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:39.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.836+0000 7f919616b700 1 --2- 172.21.15.96:0/530768451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9190101ea0 0x7f9190196a20 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:39.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.836+0000 7f919616b700 1 -- 172.21.15.96:0/530768451 >> 172.21.15.96:0/530768451 conn(0x7f91900fc260 msgr2=0x7f91901050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:39.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.837+0000 7f919616b700 1 -- 172.21.15.96:0/530768451 shutdown_connections 2024-02-19T19:05:39.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.837+0000 7f919616b700 1 -- 172.21.15.96:0/530768451 wait complete. 2024-02-19T19:05:39.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:39 smithi125 ceph-mon[37556]: pgmap v37: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:39.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:39 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:39.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:39 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:39.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:39 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:39.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:39 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:05:39.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:39 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:39.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:39 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:05:39.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:39 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:39.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:39 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:39.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:39 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:39.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:39 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:39.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:39 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:39.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:39 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:39.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:39 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:39.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:39 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:39.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:39 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:39.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:39 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:39.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.947+0000 7fa4cb7b4700 1 -- 172.21.15.96:0/2108337170 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4c40ff320 msgr2=0x7fa4c40ff740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:39.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.947+0000 7fa4cb7b4700 1 --2- 172.21.15.96:0/2108337170 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4c40ff320 0x7fa4c40ff740 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0009910 tx=0x7fa4c0009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:39.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.947+0000 7fa4cb7b4700 1 -- 172.21.15.96:0/2108337170 shutdown_connections 2024-02-19T19:05:39.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.947+0000 7fa4cb7b4700 1 --2- 172.21.15.96:0/2108337170 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4c4100520 0x7fa4c4100980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:39.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.947+0000 7fa4cb7b4700 1 --2- 172.21.15.96:0/2108337170 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4c40ff320 0x7fa4c40ff740 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:39.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.947+0000 7fa4cb7b4700 1 -- 172.21.15.96:0/2108337170 >> 172.21.15.96:0/2108337170 conn(0x7fa4c40fa8c0 msgr2=0x7fa4c40fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:39.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.947+0000 7fa4cb7b4700 1 -- 172.21.15.96:0/2108337170 shutdown_connections 2024-02-19T19:05:39.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.947+0000 7fa4cb7b4700 1 -- 172.21.15.96:0/2108337170 wait complete. 2024-02-19T19:05:39.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.948+0000 7fa4cb7b4700 1 Processor -- start 2024-02-19T19:05:39.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.948+0000 7fa4cb7b4700 1 -- start start 2024-02-19T19:05:39.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.948+0000 7fa4cb7b4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4c40ff320 0x7fa4c41043c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:39.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.948+0000 7fa4cb7b4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4c4100520 0x7fa4c4102a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:39.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.948+0000 7fa4cb7b4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c4102f50 con 0x7fa4c40ff320 2024-02-19T19:05:39.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.948+0000 7fa4cb7b4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c4103090 con 0x7fa4c4100520 2024-02-19T19:05:39.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.948+0000 7fa4c9550700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4c40ff320 0x7fa4c41043c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:39.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.948+0000 7fa4c9550700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4c40ff320 0x7fa4c41043c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43882/0 (socket says 172.21.15.96:43882) 2024-02-19T19:05:39.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.948+0000 7fa4c9550700 1 -- 172.21.15.96:0/166561669 learned_addr learned my addr 172.21.15.96:0/166561669 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:05:39.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.948+0000 7fa4c8d4f700 1 --2- 172.21.15.96:0/166561669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4c4100520 0x7fa4c4102a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:39.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.949+0000 7fa4c9550700 1 -- 172.21.15.96:0/166561669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4c4100520 msgr2=0x7fa4c4102a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:39.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.949+0000 7fa4c9550700 1 --2- 172.21.15.96:0/166561669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4c4100520 0x7fa4c4102a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:39.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.949+0000 7fa4c9550700 1 -- 172.21.15.96:0/166561669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c00095f0 con 0x7fa4c40ff320 2024-02-19T19:05:39.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.949+0000 7fa4c9550700 1 --2- 172.21.15.96:0/166561669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4c40ff320 0x7fa4c41043c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000bda0 tx=0x7fa4c000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:39.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.949+0000 7fa4ba7fc700 1 -- 172.21.15.96:0/166561669 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4c001d070 con 0x7fa4c40ff320 2024-02-19T19:05:39.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.949+0000 7fa4ba7fc700 1 -- 172.21.15.96:0/166561669 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa4c000f460 con 0x7fa4c40ff320 2024-02-19T19:05:39.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.949+0000 7fa4cb7b4700 1 -- 172.21.15.96:0/166561669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c4103310 con 0x7fa4c40ff320 2024-02-19T19:05:39.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.949+0000 7fa4ba7fc700 1 -- 172.21.15.96:0/166561669 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4c0021620 con 0x7fa4c40ff320 2024-02-19T19:05:39.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.949+0000 7fa4cb7b4700 1 -- 172.21.15.96:0/166561669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c4103800 con 0x7fa4c40ff320 2024-02-19T19:05:39.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.950+0000 7fa4cb7b4700 1 -- 172.21.15.96:0/166561669 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c4107e80 con 0x7fa4c40ff320 2024-02-19T19:05:39.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.950+0000 7fa4ba7fc700 1 -- 172.21.15.96:0/166561669 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 30) v1 ==== 91448+0+0 (secure 0 0 0) 0x7fa4c000f5d0 con 0x7fa4c40ff320 2024-02-19T19:05:39.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.951+0000 7fa4ba7fc700 1 --2- 172.21.15.96:0/166561669 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fa4b006d660 0x7fa4b006fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:39.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.951+0000 7fa4c8d4f700 1 --2- 172.21.15.96:0/166561669 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fa4b006d660 0x7fa4b006fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:39.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.951+0000 7fa4ba7fc700 1 -- 172.21.15.96:0/166561669 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa4c008e460 con 0x7fa4c40ff320 2024-02-19T19:05:39.972 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.951+0000 7fa4c8d4f700 1 --2- 172.21.15.96:0/166561669 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fa4b006d660 0x7fa4b006fb20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4005950 tx=0x7fa4b400b410 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:39.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:39.955+0000 7fa4ba7fc700 1 -- 172.21.15.96:0/166561669 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fa4c005ba50 con 0x7fa4c40ff320 2024-02-19T19:05:40.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.168+0000 7fa4cb7b4700 1 -- 172.21.15.96:0/166561669 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4c419e970 con 0x7fa4b006d660 2024-02-19T19:05:40.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.179+0000 7fa4ba7fc700 1 -- 172.21.15.96:0/166561669 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fa4c419e970 con 0x7fa4b006d660 2024-02-19T19:05:40.199 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:05:40.200 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (7m) 6s ago 9m 25.1M - 0.25.0 c8568f914cd2 5dc55ac32e98 2024-02-19T19:05:40.200 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (9m) 6s ago 9m 7852k - 18.2.1 94eadd990e0a b41bff2e0043 2024-02-19T19:05:40.200 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (8m) 26s ago 8m 7721k - 18.2.1 94eadd990e0a 254ab7e7a040 2024-02-19T19:05:40.200 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (9m) 6s ago 9m 6660k - 18.2.1 94eadd990e0a 9250aadb9d78 2024-02-19T19:05:40.200 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (8m) 26s ago 8m 6665k - 18.2.1 94eadd990e0a b98ace7b5ded 2024-02-19T19:05:40.200 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (7m) 6s ago 9m 86.5M - 9.4.7 954c08fa6188 467f574356d5 2024-02-19T19:05:40.200 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (3m) 6s ago 3m 26.9M - 18.2.1 94eadd990e0a 0a61d9cd40d1 2024-02-19T19:05:40.200 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (3m) 6s ago 3m 22.1M - 18.2.1 94eadd990e0a 58db3e7a7d75 2024-02-19T19:05:40.200 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (3m) 26s ago 3m 25.1M - 18.2.1 94eadd990e0a 211d64de8a63 2024-02-19T19:05:40.200 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (3m) 26s ago 3m 22.7M - 18.2.1 94eadd990e0a 2a04b5a8eaf4 2024-02-19T19:05:40.201 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:8443,9283,8765 running (80s) 6s ago 10m 500M - 19.0.0-1450-gf78a58c0 f081f847070a a86fbe94fe3f 2024-02-19T19:05:40.201 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (47s) 26s ago 8m 449M - 19.0.0-1450-gf78a58c0 f081f847070a e250486d572d 2024-02-19T19:05:40.201 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (11m) 6s ago 11m 54.0M 2048M 18.2.1 94eadd990e0a 23d5b9626c48 2024-02-19T19:05:40.201 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (8m) 26s ago 8m 43.8M 2048M 18.2.1 94eadd990e0a 27b4cad04cc5 2024-02-19T19:05:40.201 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (35s) 6s ago 9m 8442k - 1.5.0 0da6a335fe13 51f622ea33d6 2024-02-19T19:05:40.201 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (30s) 26s ago 8m 3590k - 1.5.0 0da6a335fe13 464e076a52a1 2024-02-19T19:05:40.201 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (7m) 6s ago 7m 49.9M 1216M 18.2.1 94eadd990e0a d5bbf07ad0e7 2024-02-19T19:05:40.201 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (7m) 6s ago 7m 49.7M 1216M 18.2.1 94eadd990e0a 40329d59be45 2024-02-19T19:05:40.201 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (6m) 6s ago 6m 48.3M 1216M 18.2.1 94eadd990e0a 4f1e49db2d41 2024-02-19T19:05:40.201 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (6m) 26s ago 6m 49.8M 2240M 18.2.1 94eadd990e0a 4746b79351fc 2024-02-19T19:05:40.201 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (5m) 26s ago 5m 49.4M 2240M 18.2.1 94eadd990e0a 2b3f0088f6b2 2024-02-19T19:05:40.201 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (5m) 26s ago 5m 46.0M 2240M 18.2.1 94eadd990e0a e5731974b46a 2024-02-19T19:05:40.201 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (12s) 6s ago 8m 40.0M - 2.43.0 a07b618ecd1d a4edcf6ed669 2024-02-19T19:05:40.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.181+0000 7fa4cb7b4700 1 -- 172.21.15.96:0/166561669 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fa4b006d660 msgr2=0x7fa4b006fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:40.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.181+0000 7fa4cb7b4700 1 --2- 172.21.15.96:0/166561669 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fa4b006d660 0x7fa4b006fb20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa4b4005950 tx=0x7fa4b400b410 comp rx=0 tx=0).stop 2024-02-19T19:05:40.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.181+0000 7fa4cb7b4700 1 -- 172.21.15.96:0/166561669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4c40ff320 msgr2=0x7fa4c41043c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:40.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.181+0000 7fa4cb7b4700 1 --2- 172.21.15.96:0/166561669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4c40ff320 0x7fa4c41043c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fa4c000bda0 tx=0x7fa4c000bdd0 comp rx=0 tx=0).stop 2024-02-19T19:05:40.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.181+0000 7fa4cb7b4700 1 -- 172.21.15.96:0/166561669 shutdown_connections 2024-02-19T19:05:40.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.181+0000 7fa4cb7b4700 1 --2- 172.21.15.96:0/166561669 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fa4b006d660 0x7fa4b006fb20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:40.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.181+0000 7fa4cb7b4700 1 --2- 172.21.15.96:0/166561669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4c40ff320 0x7fa4c41043c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:40.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.181+0000 7fa4cb7b4700 1 --2- 172.21.15.96:0/166561669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa4c4100520 0x7fa4c4102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:40.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.181+0000 7fa4cb7b4700 1 -- 172.21.15.96:0/166561669 >> 172.21.15.96:0/166561669 conn(0x7fa4c40fa8c0 msgr2=0x7fa4c40fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:40.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.181+0000 7fa4cb7b4700 1 -- 172.21.15.96:0/166561669 shutdown_connections 2024-02-19T19:05:40.202 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.181+0000 7fa4cb7b4700 1 -- 172.21.15.96:0/166561669 wait complete. 2024-02-19T19:05:40.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.285+0000 7f95a86c3700 1 -- 172.21.15.96:0/88800576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95a01040c0 msgr2=0x7f95a01064b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:40.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.285+0000 7f95a86c3700 1 --2- 172.21.15.96:0/88800576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95a01040c0 0x7f95a01064b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9594009910 tx=0x7f9594009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:40.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.285+0000 7f95a86c3700 1 -- 172.21.15.96:0/88800576 shutdown_connections 2024-02-19T19:05:40.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.285+0000 7f95a86c3700 1 --2- 172.21.15.96:0/88800576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95a01040c0 0x7f95a01064b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:40.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.285+0000 7f95a86c3700 1 --2- 172.21.15.96:0/88800576 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95a0101790 0x7f95a0103b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:40.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.285+0000 7f95a86c3700 1 -- 172.21.15.96:0/88800576 >> 172.21.15.96:0/88800576 conn(0x7f95a00fb160 msgr2=0x7f95a00fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:40.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.285+0000 7f95a86c3700 1 -- 172.21.15.96:0/88800576 shutdown_connections 2024-02-19T19:05:40.306 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.285+0000 7f95a86c3700 1 -- 172.21.15.96:0/88800576 wait complete. 2024-02-19T19:05:40.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.286+0000 7f95a86c3700 1 Processor -- start 2024-02-19T19:05:40.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.286+0000 7f95a86c3700 1 -- start start 2024-02-19T19:05:40.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.286+0000 7f95a86c3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95a0101790 0x7f95a0198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:40.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.286+0000 7f95a86c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95a01040c0 0x7f95a0198f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:40.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.286+0000 7f95a86c3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a01994f0 con 0x7f95a01040c0 2024-02-19T19:05:40.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.286+0000 7f95a86c3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a0199630 con 0x7f95a0101790 2024-02-19T19:05:40.308 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.286+0000 7f95a5c5e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95a01040c0 0x7f95a0198f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:40.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.286+0000 7f95a5c5e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95a01040c0 0x7f95a0198f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43902/0 (socket says 172.21.15.96:43902) 2024-02-19T19:05:40.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.286+0000 7f95a5c5e700 1 -- 172.21.15.96:0/2756362517 learned_addr learned my addr 172.21.15.96:0/2756362517 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:05:40.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.286+0000 7f95a5c5e700 1 -- 172.21.15.96:0/2756362517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95a0101790 msgr2=0x7f95a0198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:40.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.286+0000 7f95a5c5e700 1 --2- 172.21.15.96:0/2756362517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95a0101790 0x7f95a0198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:40.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.286+0000 7f95a5c5e700 1 -- 172.21.15.96:0/2756362517 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95940095f0 con 0x7f95a01040c0 2024-02-19T19:05:40.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.287+0000 7f95a5c5e700 1 --2- 172.21.15.96:0/2756362517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95a01040c0 0x7f95a0198f60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9594006010 tx=0x7f959400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:40.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.287+0000 7f959f7fe700 1 -- 172.21.15.96:0/2756362517 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f959401d070 con 0x7f95a01040c0 2024-02-19T19:05:40.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.287+0000 7f95a86c3700 1 -- 172.21.15.96:0/2756362517 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a019e040 con 0x7f95a01040c0 2024-02-19T19:05:40.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.287+0000 7f959f7fe700 1 -- 172.21.15.96:0/2756362517 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f959400f460 con 0x7f95a01040c0 2024-02-19T19:05:40.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.287+0000 7f959f7fe700 1 -- 172.21.15.96:0/2756362517 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9594021640 con 0x7f95a01040c0 2024-02-19T19:05:40.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.287+0000 7f95a86c3700 1 -- 172.21.15.96:0/2756362517 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a019e500 con 0x7f95a01040c0 2024-02-19T19:05:40.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.288+0000 7f95a86c3700 1 -- 172.21.15.96:0/2756362517 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a0068af0 con 0x7f95a01040c0 2024-02-19T19:05:40.309 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.288+0000 7f959f7fe700 1 -- 172.21.15.96:0/2756362517 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 30) v1 ==== 91448+0+0 (secure 0 0 0) 0x7f959400fab0 con 0x7f95a01040c0 2024-02-19T19:05:40.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.288+0000 7f959f7fe700 1 --2- 172.21.15.96:0/2756362517 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f958806d660 0x7f958806fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:40.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.289+0000 7f959f7fe700 1 -- 172.21.15.96:0/2756362517 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f959408e640 con 0x7f95a01040c0 2024-02-19T19:05:40.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.289+0000 7f95a645f700 1 --2- 172.21.15.96:0/2756362517 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f958806d660 0x7f958806fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:40.310 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.289+0000 7f95a645f700 1 --2- 172.21.15.96:0/2756362517 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f958806d660 0x7f958806fb20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f959800d0e0 tx=0x7f95980085a0 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:40.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.293+0000 7f959f7fe700 1 -- 172.21.15.96:0/2756362517 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f959405bc30 con 0x7f95a01040c0 2024-02-19T19:05:40.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.585+0000 7f95a86c3700 1 -- 172.21.15.96:0/2756362517 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f95a019ec70 con 0x7f95a01040c0 2024-02-19T19:05:40.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.586+0000 7f959f7fe700 1 -- 172.21.15.96:0/2756362517 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f959405b7c0 con 0x7f95a01040c0 2024-02-19T19:05:40.607 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:05:40.607 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:05:40.607 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-19T19:05:40.608 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:05:40.608 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:05:40.608 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:05:40.608 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:05:40.608 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:05:40.608 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-19T19:05:40.608 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:05:40.608 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:05:40.608 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-19T19:05:40.608 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:05:40.608 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:05:40.608 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 12, 2024-02-19T19:05:40.608 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:05:40.608 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:05:40.609 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:05:40.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.588+0000 7f95a86c3700 1 -- 172.21.15.96:0/2756362517 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f958806d660 msgr2=0x7f958806fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:40.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.588+0000 7f95a86c3700 1 --2- 172.21.15.96:0/2756362517 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f958806d660 0x7f958806fb20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f959800d0e0 tx=0x7f95980085a0 comp rx=0 tx=0).stop 2024-02-19T19:05:40.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.588+0000 7f95a86c3700 1 -- 172.21.15.96:0/2756362517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95a01040c0 msgr2=0x7f95a0198f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:40.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.588+0000 7f95a86c3700 1 --2- 172.21.15.96:0/2756362517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95a01040c0 0x7f95a0198f60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9594006010 tx=0x7f959400be20 comp rx=0 tx=0).stop 2024-02-19T19:05:40.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.588+0000 7f95a86c3700 1 -- 172.21.15.96:0/2756362517 shutdown_connections 2024-02-19T19:05:40.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.588+0000 7f95a86c3700 1 --2- 172.21.15.96:0/2756362517 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95a0101790 0x7f95a0198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:40.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.588+0000 7f95a86c3700 1 --2- 172.21.15.96:0/2756362517 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f958806d660 0x7f958806fb20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:40.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.588+0000 7f95a86c3700 1 --2- 172.21.15.96:0/2756362517 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95a01040c0 0x7f95a0198f60 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:40.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.588+0000 7f95a86c3700 1 -- 172.21.15.96:0/2756362517 >> 172.21.15.96:0/2756362517 conn(0x7f95a00fb160 msgr2=0x7f95a00ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:40.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.588+0000 7f95a86c3700 1 -- 172.21.15.96:0/2756362517 shutdown_connections 2024-02-19T19:05:40.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.588+0000 7f95a86c3700 1 -- 172.21.15.96:0/2756362517 wait complete. 2024-02-19T19:05:40.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.697+0000 7f17b6344700 1 -- 172.21.15.96:0/221305008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17b0100cb0 msgr2=0x7f17b01010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:40.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.697+0000 7f17b6344700 1 --2- 172.21.15.96:0/221305008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17b0100cb0 0x7f17b01010d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f17a0009910 tx=0x7f17a0009c20 comp rx=0 tx=0).stop 2024-02-19T19:05:40.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.697+0000 7f17b6344700 1 -- 172.21.15.96:0/221305008 shutdown_connections 2024-02-19T19:05:40.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.697+0000 7f17b6344700 1 --2- 172.21.15.96:0/221305008 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17b0101eb0 0x7f17b0102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:40.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.697+0000 7f17b6344700 1 --2- 172.21.15.96:0/221305008 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17b0100cb0 0x7f17b01010d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:40.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.697+0000 7f17b6344700 1 -- 172.21.15.96:0/221305008 >> 172.21.15.96:0/221305008 conn(0x7f17b00fc230 msgr2=0x7f17b00fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:40.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.697+0000 7f17b6344700 1 -- 172.21.15.96:0/221305008 shutdown_connections 2024-02-19T19:05:40.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.697+0000 7f17b6344700 1 -- 172.21.15.96:0/221305008 wait complete. 2024-02-19T19:05:40.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.698+0000 7f17b6344700 1 Processor -- start 2024-02-19T19:05:40.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.698+0000 7f17b6344700 1 -- start start 2024-02-19T19:05:40.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.698+0000 7f17b6344700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17b0100cb0 0x7f17b0074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:40.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.698+0000 7f17b6344700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17b0101eb0 0x7f17b0073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:40.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.698+0000 7f17b6344700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b00736c0 con 0x7f17b0101eb0 2024-02-19T19:05:40.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.698+0000 7f17b6344700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b0073800 con 0x7f17b0100cb0 2024-02-19T19:05:40.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.698+0000 7f17af7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17b0101eb0 0x7f17b0073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:40.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.698+0000 7f17af7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17b0101eb0 0x7f17b0073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:43924/0 (socket says 172.21.15.96:43924) 2024-02-19T19:05:40.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.699+0000 7f17af7fe700 1 -- 172.21.15.96:0/729247822 learned_addr learned my addr 172.21.15.96:0/729247822 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:05:40.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.699+0000 7f17affff700 1 --2- 172.21.15.96:0/729247822 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17b0100cb0 0x7f17b0074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:40.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.699+0000 7f17af7fe700 1 -- 172.21.15.96:0/729247822 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17b0100cb0 msgr2=0x7f17b0074b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:40.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.699+0000 7f17af7fe700 1 --2- 172.21.15.96:0/729247822 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17b0100cb0 0x7f17b0074b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:40.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.699+0000 7f17af7fe700 1 -- 172.21.15.96:0/729247822 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a00095f0 con 0x7f17b0101eb0 2024-02-19T19:05:40.720 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.699+0000 7f17af7fe700 1 --2- 172.21.15.96:0/729247822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17b0101eb0 0x7f17b0073180 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f17a400b4b0 tx=0x7f17a400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:40.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.699+0000 7f17ad7fa700 1 -- 172.21.15.96:0/729247822 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17a4011800 con 0x7f17b0101eb0 2024-02-19T19:05:40.721 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.699+0000 7f17ad7fa700 1 -- 172.21.15.96:0/729247822 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f17a4011e10 con 0x7f17b0101eb0 2024-02-19T19:05:40.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.699+0000 7f17ad7fa700 1 -- 172.21.15.96:0/729247822 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17a400f2e0 con 0x7f17b0101eb0 2024-02-19T19:05:40.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.699+0000 7f17b6344700 1 -- 172.21.15.96:0/729247822 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b0073ae0 con 0x7f17b0101eb0 2024-02-19T19:05:40.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.699+0000 7f17b6344700 1 -- 172.21.15.96:0/729247822 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b019e5c0 con 0x7f17b0101eb0 2024-02-19T19:05:40.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.700+0000 7f17b6344700 1 -- 172.21.15.96:0/729247822 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b0109890 con 0x7f17b0101eb0 2024-02-19T19:05:40.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.701+0000 7f17ad7fa700 1 -- 172.21.15.96:0/729247822 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 30) v1 ==== 91448+0+0 (secure 0 0 0) 0x7f17a4010380 con 0x7f17b0101eb0 2024-02-19T19:05:40.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.701+0000 7f17ad7fa700 1 --2- 172.21.15.96:0/729247822 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f179806d660 0x7f179806fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:05:40.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.701+0000 7f17ad7fa700 1 -- 172.21.15.96:0/729247822 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f17a408cbf0 con 0x7f17b0101eb0 2024-02-19T19:05:40.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.702+0000 7f17affff700 1 --2- 172.21.15.96:0/729247822 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f179806d660 0x7f179806fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:05:40.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.702+0000 7f17affff700 1 --2- 172.21.15.96:0/729247822 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f179806d660 0x7f179806fb20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f17a0006010 tx=0x7f17a000b540 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:05:40.726 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.706+0000 7f17ad7fa700 1 -- 172.21.15.96:0/729247822 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f17a405a370 con 0x7f17b0101eb0 2024-02-19T19:05:40.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:40 smithi125 ceph-mon[37556]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:05:40.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:40 smithi125 ceph-mon[37556]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:40.955 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.935+0000 7f17b6344700 1 -- 172.21.15.96:0/729247822 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f17b0106800 con 0x7f179806d660 2024-02-19T19:05:40.955 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:40 smithi096 ceph-mon[29216]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-19T19:05:40.955 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:40 smithi096 ceph-mon[29216]: from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:40.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.936+0000 7f17ad7fa700 1 -- 172.21.15.96:0/729247822 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f17b0106800 con 0x7f179806d660 2024-02-19T19:05:40.956 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:05:40.957 INFO:teuthology.orchestra.run.smithi096.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:05:40.957 INFO:teuthology.orchestra.run.smithi096.stdout: "in_progress": true, 2024-02-19T19:05:40.957 INFO:teuthology.orchestra.run.smithi096.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-19T19:05:40.957 INFO:teuthology.orchestra.run.smithi096.stdout: "services_complete": [ 2024-02-19T19:05:40.957 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr" 2024-02-19T19:05:40.957 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-02-19T19:05:40.957 INFO:teuthology.orchestra.run.smithi096.stdout: "progress": "2/2 daemons upgraded", 2024-02-19T19:05:40.957 INFO:teuthology.orchestra.run.smithi096.stdout: "message": "Currently upgrading alertmanager daemons", 2024-02-19T19:05:40.957 INFO:teuthology.orchestra.run.smithi096.stdout: "is_paused": false 2024-02-19T19:05:40.957 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:05:40.958 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.938+0000 7f17b6344700 1 -- 172.21.15.96:0/729247822 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f179806d660 msgr2=0x7f179806fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.938+0000 7f17b6344700 1 --2- 172.21.15.96:0/729247822 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f179806d660 0x7f179806fb20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f17a0006010 tx=0x7f17a000b540 comp rx=0 tx=0).stop 2024-02-19T19:05:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.938+0000 7f17b6344700 1 -- 172.21.15.96:0/729247822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17b0101eb0 msgr2=0x7f17b0073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:05:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.938+0000 7f17b6344700 1 --2- 172.21.15.96:0/729247822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17b0101eb0 0x7f17b0073180 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f17a400b4b0 tx=0x7f17a400b7c0 comp rx=0 tx=0).stop 2024-02-19T19:05:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.939+0000 7f17b6344700 1 -- 172.21.15.96:0/729247822 shutdown_connections 2024-02-19T19:05:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.939+0000 7f17b6344700 1 --2- 172.21.15.96:0/729247822 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17b0100cb0 0x7f17b0074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.939+0000 7f17b6344700 1 --2- 172.21.15.96:0/729247822 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f179806d660 0x7f179806fb20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.939+0000 7f17b6344700 1 --2- 172.21.15.96:0/729247822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17b0101eb0 0x7f17b0073180 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:05:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.939+0000 7f17b6344700 1 -- 172.21.15.96:0/729247822 >> 172.21.15.96:0/729247822 conn(0x7f17b00fc230 msgr2=0x7f17b01050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:05:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.939+0000 7f17b6344700 1 -- 172.21.15.96:0/729247822 shutdown_connections 2024-02-19T19:05:40.959 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:05:40.939+0000 7f17b6344700 1 -- 172.21.15.96:0/729247822 wait complete. 2024-02-19T19:05:41.654 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:41 smithi096 ceph-mon[29216]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:41.655 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:41 smithi096 ceph-mon[29216]: pgmap v38: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:41.655 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:41 smithi096 ceph-mon[29216]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:41.655 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:41 smithi096 ceph-mon[29216]: Upgrade: Updating alertmanager.smithi096 2024-02-19T19:05:41.655 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:41 smithi096 ceph-mon[29216]: Deploying daemon alertmanager.smithi096 on smithi096 2024-02-19T19:05:41.655 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:41 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/2756362517' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:41.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:41 smithi125 ceph-mon[37556]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:41.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:41 smithi125 ceph-mon[37556]: pgmap v38: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:41.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:41 smithi125 ceph-mon[37556]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:41.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:41 smithi125 ceph-mon[37556]: Upgrade: Updating alertmanager.smithi096 2024-02-19T19:05:41.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:41 smithi125 ceph-mon[37556]: Deploying daemon alertmanager.smithi096 on smithi096 2024-02-19T19:05:41.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:41 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/2756362517' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:42.872 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:42 smithi096 ceph-mon[29216]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:42.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:42 smithi125 ceph-mon[37556]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:05:43.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:43 smithi096 ceph-mon[29216]: pgmap v39: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:43.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:43 smithi125 ceph-mon[37556]: pgmap v39: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:45.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:45 smithi125 ceph-mon[37556]: pgmap v40: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:45.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:45 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:05:45.991 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:45 smithi096 ceph-mon[29216]: pgmap v40: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:45.991 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:45 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:05:47.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:47 smithi125 ceph-mon[37556]: pgmap v41: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:47.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:47.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:47.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:48.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:47 smithi096 ceph-mon[29216]: pgmap v41: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:48.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:48.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:48.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:49.860 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:49 smithi096 ceph-mon[29216]: pgmap v42: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:49.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:49 smithi125 ceph-mon[37556]: pgmap v42: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:51.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:51 smithi125 ceph-mon[37556]: pgmap v43: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:52.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:51 smithi096 ceph-mon[29216]: pgmap v43: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:53.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:52 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:53.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:52 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:53.201 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:52 smithi125 ceph-mon[37556]: pgmap v44: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:53.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:52 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:53.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:52 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:53.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:52 smithi096 ceph-mon[29216]: pgmap v44: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:54.252 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:53 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:54.253 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:54 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:54.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:53 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:54.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:53 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:55.269 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:54 smithi096 ceph-mon[29216]: pgmap v45: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:55.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:55 smithi125 ceph-mon[37556]: pgmap v45: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:57.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:57 smithi096 ceph-mon[29216]: pgmap v46: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:57.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:57 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:57.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:57 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:57.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:57 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:57.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:57 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:05:57.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:57 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:57.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:57 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T19:05:57.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:57 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:57.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:57 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:57.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:57 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:57.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:57 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:57.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:57 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:57.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:57 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:57.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:57 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:57.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:57 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:57.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:57 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:57.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:57 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:57.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:57 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:57.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:57 smithi125 ceph-mon[37556]: pgmap v46: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:05:57.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:57 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:57.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:57 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:57.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:57 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:05:57.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:57 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:05:57.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:57 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:05:57.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:57 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T19:05:57.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:57 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:05:57.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:57 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:57.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:57 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:57.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:57 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:57.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:57 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:57.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:57 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:57.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:57 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:57.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:57 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:57.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:57 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:57.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:57 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:57.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:57 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:05:58.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:58 smithi096 ceph-mon[29216]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T19:05:58.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:58 smithi125 ceph-mon[37556]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-19T19:05:59.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:05:59 smithi096 ceph-mon[29216]: pgmap v47: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:05:59.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:05:59 smithi125 ceph-mon[37556]: pgmap v47: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:06:00.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:00 smithi096 ceph-mon[29216]: Upgrade: Updating grafana.smithi096 2024-02-19T19:06:00.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:00 smithi096 ceph-mon[29216]: Deploying daemon grafana.smithi096 on smithi096 2024-02-19T19:06:00.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:00 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:06:00.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:00 smithi125 ceph-mon[37556]: Upgrade: Updating grafana.smithi096 2024-02-19T19:06:00.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:00 smithi125 ceph-mon[37556]: Deploying daemon grafana.smithi096 on smithi096 2024-02-19T19:06:00.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:00 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:06:01.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:01 smithi096 ceph-mon[29216]: pgmap v48: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:01.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:01 smithi125 ceph-mon[37556]: pgmap v48: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:03.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:03 smithi096 ceph-mon[29216]: pgmap v49: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-19T19:06:03.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:03 smithi096 ceph-mon[29216]: mgrmap e31: smithi096.zsjdff(active, since 92s), standbys: smithi125.ygdmdu 2024-02-19T19:06:03.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:03 smithi125 ceph-mon[37556]: pgmap v49: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-19T19:06:03.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:03 smithi125 ceph-mon[37556]: mgrmap e31: smithi096.zsjdff(active, since 92s), standbys: smithi125.ygdmdu 2024-02-19T19:06:05.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:05 smithi096 ceph-mon[29216]: pgmap v50: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-02-19T19:06:05.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:05 smithi125 ceph-mon[37556]: pgmap v50: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-02-19T19:06:07.751 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:07 smithi125 ceph-mon[37556]: pgmap v51: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-19T19:06:07.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:07 smithi096 ceph-mon[29216]: pgmap v51: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-19T19:06:09.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:09 smithi096 ceph-mon[29216]: pgmap v52: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-19T19:06:09.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:09 smithi125 ceph-mon[37556]: pgmap v52: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-19T19:06:11.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.050+0000 7faa8d3a8700 1 -- 172.21.15.96:0/1995843237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa880ffc10 msgr2=0x7faa88100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:11.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.050+0000 7faa8d3a8700 1 --2- 172.21.15.96:0/1995843237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa880ffc10 0x7faa88100030 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7faa78009910 tx=0x7faa78009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:11.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.050+0000 7faa8d3a8700 1 -- 172.21.15.96:0/1995843237 shutdown_connections 2024-02-19T19:06:11.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.050+0000 7faa8d3a8700 1 --2- 172.21.15.96:0/1995843237 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa88100e10 0x7faa88101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:11.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.050+0000 7faa8d3a8700 1 --2- 172.21.15.96:0/1995843237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa880ffc10 0x7faa88100030 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:11.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.050+0000 7faa8d3a8700 1 -- 172.21.15.96:0/1995843237 >> 172.21.15.96:0/1995843237 conn(0x7faa880fb190 msgr2=0x7faa880fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:11.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.050+0000 7faa8d3a8700 1 -- 172.21.15.96:0/1995843237 shutdown_connections 2024-02-19T19:06:11.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.050+0000 7faa8d3a8700 1 -- 172.21.15.96:0/1995843237 wait complete. 2024-02-19T19:06:11.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.051+0000 7faa8d3a8700 1 Processor -- start 2024-02-19T19:06:11.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.051+0000 7faa8d3a8700 1 -- start start 2024-02-19T19:06:11.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.051+0000 7faa8d3a8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa880ffc10 0x7faa881953d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:11.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.051+0000 7faa8d3a8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa88100e10 0x7faa88195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:11.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.051+0000 7faa8d3a8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa88195f30 con 0x7faa88100e10 2024-02-19T19:06:11.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.051+0000 7faa8d3a8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa88196070 con 0x7faa880ffc10 2024-02-19T19:06:11.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.051+0000 7faa867fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa88100e10 0x7faa88195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:11.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.051+0000 7faa867fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa88100e10 0x7faa88195910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36752/0 (socket says 172.21.15.96:36752) 2024-02-19T19:06:11.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.052+0000 7faa867fc700 1 -- 172.21.15.96:0/4031572194 learned_addr learned my addr 172.21.15.96:0/4031572194 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:06:11.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.052+0000 7faa86ffd700 1 --2- 172.21.15.96:0/4031572194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa880ffc10 0x7faa881953d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:11.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.052+0000 7faa867fc700 1 -- 172.21.15.96:0/4031572194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa880ffc10 msgr2=0x7faa881953d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:11.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.052+0000 7faa867fc700 1 --2- 172.21.15.96:0/4031572194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa880ffc10 0x7faa881953d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:11.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.052+0000 7faa867fc700 1 -- 172.21.15.96:0/4031572194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa780095f0 con 0x7faa88100e10 2024-02-19T19:06:11.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.052+0000 7faa867fc700 1 --2- 172.21.15.96:0/4031572194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa88100e10 0x7faa88195910 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009970 tx=0x7faa7c009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:11.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.052+0000 7faa6ffff700 1 -- 172.21.15.96:0/4031572194 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa7c012070 con 0x7faa88100e10 2024-02-19T19:06:11.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.052+0000 7faa8d3a8700 1 -- 172.21.15.96:0/4031572194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa880685e0 con 0x7faa88100e10 2024-02-19T19:06:11.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.052+0000 7faa6ffff700 1 -- 172.21.15.96:0/4031572194 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7faa7c007ae0 con 0x7faa88100e10 2024-02-19T19:06:11.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.052+0000 7faa6ffff700 1 -- 172.21.15.96:0/4031572194 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa7c017c20 con 0x7faa88100e10 2024-02-19T19:06:11.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.052+0000 7faa8d3a8700 1 -- 172.21.15.96:0/4031572194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa88068b30 con 0x7faa88100e10 2024-02-19T19:06:11.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.053+0000 7faa8d3a8700 1 -- 172.21.15.96:0/4031572194 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa88108700 con 0x7faa88100e10 2024-02-19T19:06:11.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.054+0000 7faa6ffff700 1 -- 172.21.15.96:0/4031572194 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7faa7c007c50 con 0x7faa88100e10 2024-02-19T19:06:11.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.054+0000 7faa6ffff700 1 --2- 172.21.15.96:0/4031572194 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7faa7006d520 0x7faa7006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:11.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.054+0000 7faa6ffff700 1 -- 172.21.15.96:0/4031572194 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7faa7c08e480 con 0x7faa88100e10 2024-02-19T19:06:11.075 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.054+0000 7faa86ffd700 1 --2- 172.21.15.96:0/4031572194 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7faa7006d520 0x7faa7006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:11.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.055+0000 7faa86ffd700 1 --2- 172.21.15.96:0/4031572194 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7faa7006d520 0x7faa7006f9e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faa78006010 tx=0x7faa7800b540 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:11.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.059+0000 7faa6ffff700 1 -- 172.21.15.96:0/4031572194 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7faa7c05bd40 con 0x7faa88100e10 2024-02-19T19:06:11.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.292+0000 7faa8d3a8700 1 -- 172.21.15.96:0/4031572194 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faa88105760 con 0x7faa7006d520 2024-02-19T19:06:11.313 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.293+0000 7faa6ffff700 1 -- 172.21.15.96:0/4031572194 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7faa88105760 con 0x7faa7006d520 2024-02-19T19:06:11.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.295+0000 7faa8d3a8700 1 -- 172.21.15.96:0/4031572194 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7faa7006d520 msgr2=0x7faa7006f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:11.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.295+0000 7faa8d3a8700 1 --2- 172.21.15.96:0/4031572194 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7faa7006d520 0x7faa7006f9e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7faa78006010 tx=0x7faa7800b540 comp rx=0 tx=0).stop 2024-02-19T19:06:11.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.295+0000 7faa8d3a8700 1 -- 172.21.15.96:0/4031572194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa88100e10 msgr2=0x7faa88195910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:11.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.295+0000 7faa8d3a8700 1 --2- 172.21.15.96:0/4031572194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa88100e10 0x7faa88195910 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009970 tx=0x7faa7c009c80 comp rx=0 tx=0).stop 2024-02-19T19:06:11.315 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.295+0000 7faa8d3a8700 1 -- 172.21.15.96:0/4031572194 shutdown_connections 2024-02-19T19:06:11.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.295+0000 7faa8d3a8700 1 --2- 172.21.15.96:0/4031572194 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faa880ffc10 0x7faa881953d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:11.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.295+0000 7faa8d3a8700 1 --2- 172.21.15.96:0/4031572194 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7faa7006d520 0x7faa7006f9e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:11.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.295+0000 7faa8d3a8700 1 --2- 172.21.15.96:0/4031572194 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa88100e10 0x7faa88195910 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:11.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.295+0000 7faa8d3a8700 1 -- 172.21.15.96:0/4031572194 >> 172.21.15.96:0/4031572194 conn(0x7faa880fb190 msgr2=0x7faa88104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:11.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.295+0000 7faa8d3a8700 1 -- 172.21.15.96:0/4031572194 shutdown_connections 2024-02-19T19:06:11.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.295+0000 7faa8d3a8700 1 -- 172.21.15.96:0/4031572194 wait complete. 2024-02-19T19:06:11.325 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:06:11.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.404+0000 7f3bb676c700 1 -- 172.21.15.96:0/3856657913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bb0100cb0 msgr2=0x7f3bb01010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:11.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.404+0000 7f3bb676c700 1 --2- 172.21.15.96:0/3856657913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bb0100cb0 0x7f3bb01010d0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0009910 tx=0x7f3ba0009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:11.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.404+0000 7f3bb676c700 1 -- 172.21.15.96:0/3856657913 shutdown_connections 2024-02-19T19:06:11.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.404+0000 7f3bb676c700 1 --2- 172.21.15.96:0/3856657913 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bb0101eb0 0x7f3bb0102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:11.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.404+0000 7f3bb676c700 1 --2- 172.21.15.96:0/3856657913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bb0100cb0 0x7f3bb01010d0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:11.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.404+0000 7f3bb676c700 1 -- 172.21.15.96:0/3856657913 >> 172.21.15.96:0/3856657913 conn(0x7f3bb00fc230 msgr2=0x7f3bb00fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:11.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.404+0000 7f3bb676c700 1 -- 172.21.15.96:0/3856657913 shutdown_connections 2024-02-19T19:06:11.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.404+0000 7f3bb676c700 1 -- 172.21.15.96:0/3856657913 wait complete. 2024-02-19T19:06:11.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.405+0000 7f3bb676c700 1 Processor -- start 2024-02-19T19:06:11.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.405+0000 7f3bb676c700 1 -- start start 2024-02-19T19:06:11.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.405+0000 7f3bb676c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bb0100cb0 0x7f3bb01964f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:11.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.405+0000 7f3bb676c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bb0101eb0 0x7f3bb0196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:11.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.406+0000 7f3bb676c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb0197050 con 0x7f3bb0101eb0 2024-02-19T19:06:11.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.406+0000 7f3bb676c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb0197190 con 0x7f3bb0100cb0 2024-02-19T19:06:11.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.406+0000 7f3baf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bb0101eb0 0x7f3bb0196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:11.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.406+0000 7f3baf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bb0101eb0 0x7f3bb0196a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36766/0 (socket says 172.21.15.96:36766) 2024-02-19T19:06:11.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.406+0000 7f3baf7fe700 1 -- 172.21.15.96:0/3611151506 learned_addr learned my addr 172.21.15.96:0/3611151506 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:06:11.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.406+0000 7f3baffff700 1 --2- 172.21.15.96:0/3611151506 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bb0100cb0 0x7f3bb01964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:11.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.406+0000 7f3baf7fe700 1 -- 172.21.15.96:0/3611151506 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bb0100cb0 msgr2=0x7f3bb01964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:11.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.406+0000 7f3baf7fe700 1 --2- 172.21.15.96:0/3611151506 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bb0100cb0 0x7f3bb01964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:11.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.406+0000 7f3baf7fe700 1 -- 172.21.15.96:0/3611151506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba00095f0 con 0x7f3bb0101eb0 2024-02-19T19:06:11.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.406+0000 7f3baf7fe700 1 --2- 172.21.15.96:0/3611151506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bb0101eb0 0x7f3bb0196a30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400d8d0 tx=0x7f3ba400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:11.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.406+0000 7f3bad7fa700 1 -- 172.21.15.96:0/3611151506 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ba4009940 con 0x7f3bb0101eb0 2024-02-19T19:06:11.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.406+0000 7f3bad7fa700 1 -- 172.21.15.96:0/3611151506 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3ba4010460 con 0x7f3bb0101eb0 2024-02-19T19:06:11.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.406+0000 7f3bb676c700 1 -- 172.21.15.96:0/3611151506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb019bc40 con 0x7f3bb0101eb0 2024-02-19T19:06:11.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.406+0000 7f3bad7fa700 1 -- 172.21.15.96:0/3611151506 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ba400f5f0 con 0x7f3bb0101eb0 2024-02-19T19:06:11.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.407+0000 7f3bb676c700 1 -- 172.21.15.96:0/3611151506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb019c190 con 0x7f3bb0101eb0 2024-02-19T19:06:11.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.408+0000 7f3bb676c700 1 -- 172.21.15.96:0/3611151506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb0109810 con 0x7f3bb0101eb0 2024-02-19T19:06:11.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.408+0000 7f3bad7fa700 1 -- 172.21.15.96:0/3611151506 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f3ba40105d0 con 0x7f3bb0101eb0 2024-02-19T19:06:11.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.408+0000 7f3bad7fa700 1 --2- 172.21.15.96:0/3611151506 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f3b9806d520 0x7f3b9806f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:11.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.409+0000 7f3bad7fa700 1 -- 172.21.15.96:0/3611151506 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f3ba408ce70 con 0x7f3bb0101eb0 2024-02-19T19:06:11.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.409+0000 7f3baffff700 1 --2- 172.21.15.96:0/3611151506 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f3b9806d520 0x7f3b9806f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:11.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.409+0000 7f3baffff700 1 --2- 172.21.15.96:0/3611151506 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f3b9806d520 0x7f3b9806f9e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0006010 tx=0x7f3ba000b540 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:11.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.413+0000 7f3bad7fa700 1 -- 172.21.15.96:0/3611151506 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f3ba405a700 con 0x7f3bb0101eb0 2024-02-19T19:06:11.657 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.637+0000 7f3bb676c700 1 -- 172.21.15.96:0/3611151506 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bb0106800 con 0x7f3b9806d520 2024-02-19T19:06:11.657 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:11 smithi096 ceph-mon[29216]: pgmap v53: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-02-19T19:06:11.658 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.638+0000 7f3bad7fa700 1 -- 172.21.15.96:0/3611151506 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f3bb0106800 con 0x7f3b9806d520 2024-02-19T19:06:11.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.640+0000 7f3bb676c700 1 -- 172.21.15.96:0/3611151506 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f3b9806d520 msgr2=0x7f3b9806f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:11.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.640+0000 7f3bb676c700 1 --2- 172.21.15.96:0/3611151506 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f3b9806d520 0x7f3b9806f9e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0006010 tx=0x7f3ba000b540 comp rx=0 tx=0).stop 2024-02-19T19:06:11.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.640+0000 7f3bb676c700 1 -- 172.21.15.96:0/3611151506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bb0101eb0 msgr2=0x7f3bb0196a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:11.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.640+0000 7f3bb676c700 1 --2- 172.21.15.96:0/3611151506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bb0101eb0 0x7f3bb0196a30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400d8d0 tx=0x7f3ba400dc90 comp rx=0 tx=0).stop 2024-02-19T19:06:11.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.640+0000 7f3bb676c700 1 -- 172.21.15.96:0/3611151506 shutdown_connections 2024-02-19T19:06:11.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.640+0000 7f3bb676c700 1 --2- 172.21.15.96:0/3611151506 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bb0100cb0 0x7f3bb01964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:11.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.640+0000 7f3bb676c700 1 --2- 172.21.15.96:0/3611151506 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f3b9806d520 0x7f3b9806f9e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:11.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.640+0000 7f3bb676c700 1 --2- 172.21.15.96:0/3611151506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bb0101eb0 0x7f3bb0196a30 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:11.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.640+0000 7f3bb676c700 1 -- 172.21.15.96:0/3611151506 >> 172.21.15.96:0/3611151506 conn(0x7f3bb00fc230 msgr2=0x7f3bb01050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:11.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.640+0000 7f3bb676c700 1 -- 172.21.15.96:0/3611151506 shutdown_connections 2024-02-19T19:06:11.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.640+0000 7f3bb676c700 1 -- 172.21.15.96:0/3611151506 wait complete. 2024-02-19T19:06:11.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.750+0000 7f58c9447700 1 -- 172.21.15.96:0/3165231283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58c40fef60 msgr2=0x7f58c40ff380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:11.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.750+0000 7f58c9447700 1 --2- 172.21.15.96:0/3165231283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58c40fef60 0x7f58c40ff380 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009910 tx=0x7f58b4009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:11.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.751+0000 7f58c9447700 1 -- 172.21.15.96:0/3165231283 shutdown_connections 2024-02-19T19:06:11.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.751+0000 7f58c9447700 1 --2- 172.21.15.96:0/3165231283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58c4101f40 0x7f58c41023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:11.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.751+0000 7f58c9447700 1 --2- 172.21.15.96:0/3165231283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58c40fef60 0x7f58c40ff380 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:11.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.751+0000 7f58c9447700 1 -- 172.21.15.96:0/3165231283 >> 172.21.15.96:0/3165231283 conn(0x7f58c40fa8c0 msgr2=0x7f58c40fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:11.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.751+0000 7f58c9447700 1 -- 172.21.15.96:0/3165231283 shutdown_connections 2024-02-19T19:06:11.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.751+0000 7f58c9447700 1 -- 172.21.15.96:0/3165231283 wait complete. 2024-02-19T19:06:11.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.751+0000 7f58c9447700 1 Processor -- start 2024-02-19T19:06:11.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.751+0000 7f58c9447700 1 -- start start 2024-02-19T19:06:11.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.751+0000 7f58c9447700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58c40fef60 0x7f58c41986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:11.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.752+0000 7f58c9447700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58c4101f40 0x7f58c4198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:11.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.752+0000 7f58c9447700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c4199230 con 0x7f58c4101f40 2024-02-19T19:06:11.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.752+0000 7f58c9447700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c4199370 con 0x7f58c40fef60 2024-02-19T19:06:11.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.752+0000 7f58c27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58c4101f40 0x7f58c4198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:11.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.752+0000 7f58c27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58c4101f40 0x7f58c4198c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36778/0 (socket says 172.21.15.96:36778) 2024-02-19T19:06:11.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.752+0000 7f58c27fc700 1 -- 172.21.15.96:0/265807243 learned_addr learned my addr 172.21.15.96:0/265807243 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:06:11.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.752+0000 7f58c2ffd700 1 --2- 172.21.15.96:0/265807243 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58c40fef60 0x7f58c41986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:11.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.752+0000 7f58c27fc700 1 -- 172.21.15.96:0/265807243 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58c40fef60 msgr2=0x7f58c41986d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:11.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.752+0000 7f58c27fc700 1 --2- 172.21.15.96:0/265807243 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58c40fef60 0x7f58c41986d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:11.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.752+0000 7f58c27fc700 1 -- 172.21.15.96:0/265807243 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b40095f0 con 0x7f58c4101f40 2024-02-19T19:06:11.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.752+0000 7f58c27fc700 1 --2- 172.21.15.96:0/265807243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58c4101f40 0x7f58c4198c10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f58b800c8a0 tx=0x7f58b800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:11.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.752+0000 7f58abfff700 1 -- 172.21.15.96:0/265807243 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58b80078e0 con 0x7f58c4101f40 2024-02-19T19:06:11.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.752+0000 7f58abfff700 1 -- 172.21.15.96:0/265807243 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f58b800f450 con 0x7f58c4101f40 2024-02-19T19:06:11.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.752+0000 7f58c9447700 1 -- 172.21.15.96:0/265807243 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c419de20 con 0x7f58c4101f40 2024-02-19T19:06:11.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.752+0000 7f58abfff700 1 -- 172.21.15.96:0/265807243 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58b800e5e0 con 0x7f58c4101f40 2024-02-19T19:06:11.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.752+0000 7f58c9447700 1 -- 172.21.15.96:0/265807243 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c419e340 con 0x7f58c4101f40 2024-02-19T19:06:11.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.753+0000 7f58c9447700 1 -- 172.21.15.96:0/265807243 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c4106020 con 0x7f58c4101f40 2024-02-19T19:06:11.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.754+0000 7f58abfff700 1 -- 172.21.15.96:0/265807243 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f58b800f5c0 con 0x7f58c4101f40 2024-02-19T19:06:11.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.754+0000 7f58abfff700 1 --2- 172.21.15.96:0/265807243 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f58ac06d520 0x7f58ac06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:11.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.754+0000 7f58abfff700 1 -- 172.21.15.96:0/265807243 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f58b808cf10 con 0x7f58c4101f40 2024-02-19T19:06:11.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.754+0000 7f58c2ffd700 1 --2- 172.21.15.96:0/265807243 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f58ac06d520 0x7f58ac06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:11.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.755+0000 7f58c2ffd700 1 --2- 172.21.15.96:0/265807243 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f58ac06d520 0x7f58ac06f9e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f58b4006010 tx=0x7f58b400b540 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:11.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.759+0000 7f58abfff700 1 -- 172.21.15.96:0/265807243 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f58b805a720 con 0x7f58c4101f40 2024-02-19T19:06:11.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:11 smithi125 ceph-mon[37556]: pgmap v53: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-02-19T19:06:11.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.970+0000 7f58c9447700 1 -- 172.21.15.96:0/265807243 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f58c40611d0 con 0x7f58ac06d520 2024-02-19T19:06:12.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.981+0000 7f58abfff700 1 -- 172.21.15.96:0/265807243 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f58c40611d0 con 0x7f58ac06d520 2024-02-19T19:06:12.002 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:06:12.002 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (26s) 20s ago 9m 15.8M - 0.25.0 c8568f914cd2 bbaf83a1e476 2024-02-19T19:06:12.002 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (10m) 20s ago 10m 7880k - 18.2.1 94eadd990e0a b41bff2e0043 2024-02-19T19:06:12.002 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (9m) 58s ago 9m 7721k - 18.2.1 94eadd990e0a 254ab7e7a040 2024-02-19T19:06:12.002 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (10m) 20s ago 10m 6660k - 18.2.1 94eadd990e0a 9250aadb9d78 2024-02-19T19:06:12.002 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (9m) 58s ago 8m 6665k - 18.2.1 94eadd990e0a b98ace7b5ded 2024-02-19T19:06:12.002 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (8m) 20s ago 9m 86.5M - 9.4.7 954c08fa6188 467f574356d5 2024-02-19T19:06:12.002 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (4m) 20s ago 4m 27.0M - 18.2.1 94eadd990e0a 0a61d9cd40d1 2024-02-19T19:06:12.002 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (4m) 20s ago 4m 22.9M - 18.2.1 94eadd990e0a 58db3e7a7d75 2024-02-19T19:06:12.002 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (4m) 58s ago 4m 25.1M - 18.2.1 94eadd990e0a 211d64de8a63 2024-02-19T19:06:12.002 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (4m) 58s ago 4m 22.7M - 18.2.1 94eadd990e0a 2a04b5a8eaf4 2024-02-19T19:06:12.002 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:8443,9283,8765 running (112s) 20s ago 11m 501M - 19.0.0-1450-gf78a58c0 f081f847070a a86fbe94fe3f 2024-02-19T19:06:12.002 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (79s) 58s ago 8m 449M - 19.0.0-1450-gf78a58c0 f081f847070a e250486d572d 2024-02-19T19:06:12.003 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (11m) 20s ago 11m 54.7M 2048M 18.2.1 94eadd990e0a 23d5b9626c48 2024-02-19T19:06:12.003 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (8m) 58s ago 8m 43.8M 2048M 18.2.1 94eadd990e0a 27b4cad04cc5 2024-02-19T19:06:12.003 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (66s) 20s ago 10m 15.9M - 1.5.0 0da6a335fe13 51f622ea33d6 2024-02-19T19:06:12.003 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (62s) 58s ago 8m 3590k - 1.5.0 0da6a335fe13 464e076a52a1 2024-02-19T19:06:12.003 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (8m) 20s ago 8m 49.9M 1216M 18.2.1 94eadd990e0a d5bbf07ad0e7 2024-02-19T19:06:12.003 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (7m) 20s ago 7m 49.9M 1216M 18.2.1 94eadd990e0a 40329d59be45 2024-02-19T19:06:12.003 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (7m) 20s ago 7m 48.4M 1216M 18.2.1 94eadd990e0a 4f1e49db2d41 2024-02-19T19:06:12.003 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (6m) 58s ago 6m 49.8M 2240M 18.2.1 94eadd990e0a 4746b79351fc 2024-02-19T19:06:12.003 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (6m) 58s ago 6m 49.4M 2240M 18.2.1 94eadd990e0a 2b3f0088f6b2 2024-02-19T19:06:12.003 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (5m) 58s ago 5m 46.0M 2240M 18.2.1 94eadd990e0a e5731974b46a 2024-02-19T19:06:12.003 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (44s) 20s ago 9m 44.8M - 2.43.0 a07b618ecd1d a4edcf6ed669 2024-02-19T19:06:12.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.983+0000 7f58c9447700 1 -- 172.21.15.96:0/265807243 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f58ac06d520 msgr2=0x7f58ac06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:12.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.983+0000 7f58c9447700 1 --2- 172.21.15.96:0/265807243 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f58ac06d520 0x7f58ac06f9e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f58b4006010 tx=0x7f58b400b540 comp rx=0 tx=0).stop 2024-02-19T19:06:12.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.983+0000 7f58c9447700 1 -- 172.21.15.96:0/265807243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58c4101f40 msgr2=0x7f58c4198c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:12.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.983+0000 7f58c9447700 1 --2- 172.21.15.96:0/265807243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58c4101f40 0x7f58c4198c10 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f58b800c8a0 tx=0x7f58b800cbb0 comp rx=0 tx=0).stop 2024-02-19T19:06:12.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.984+0000 7f58c9447700 1 -- 172.21.15.96:0/265807243 shutdown_connections 2024-02-19T19:06:12.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.984+0000 7f58c9447700 1 --2- 172.21.15.96:0/265807243 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58c40fef60 0x7f58c41986d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:12.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.984+0000 7f58c9447700 1 --2- 172.21.15.96:0/265807243 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f58ac06d520 0x7f58ac06f9e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:12.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.984+0000 7f58c9447700 1 --2- 172.21.15.96:0/265807243 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58c4101f40 0x7f58c4198c10 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:12.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.984+0000 7f58c9447700 1 -- 172.21.15.96:0/265807243 >> 172.21.15.96:0/265807243 conn(0x7f58c40fa8c0 msgr2=0x7f58c4103160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:12.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.984+0000 7f58c9447700 1 -- 172.21.15.96:0/265807243 shutdown_connections 2024-02-19T19:06:12.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:11.984+0000 7f58c9447700 1 -- 172.21.15.96:0/265807243 wait complete. 2024-02-19T19:06:12.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.088+0000 7f9083d27700 1 -- 172.21.15.96:0/1292070218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f907c1017a0 msgr2=0x7f907c103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:12.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.088+0000 7f9083d27700 1 --2- 172.21.15.96:0/1292070218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f907c1017a0 0x7f907c103b90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9078009910 tx=0x7f9078009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:12.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.088+0000 7f9083d27700 1 -- 172.21.15.96:0/1292070218 shutdown_connections 2024-02-19T19:06:12.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.088+0000 7f9083d27700 1 --2- 172.21.15.96:0/1292070218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f907c1040d0 0x7f907c1064c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:12.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.089+0000 7f9083d27700 1 --2- 172.21.15.96:0/1292070218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f907c1017a0 0x7f907c103b90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:12.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.089+0000 7f9083d27700 1 -- 172.21.15.96:0/1292070218 >> 172.21.15.96:0/1292070218 conn(0x7f907c0fb190 msgr2=0x7f907c0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:12.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.089+0000 7f9083d27700 1 -- 172.21.15.96:0/1292070218 shutdown_connections 2024-02-19T19:06:12.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.089+0000 7f9083d27700 1 -- 172.21.15.96:0/1292070218 wait complete. 2024-02-19T19:06:12.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.089+0000 7f9083d27700 1 Processor -- start 2024-02-19T19:06:12.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.089+0000 7f9083d27700 1 -- start start 2024-02-19T19:06:12.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.089+0000 7f9083d27700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f907c1017a0 0x7f907c101100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:12.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.089+0000 7f9083d27700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f907c1040d0 0x7f907c0ff750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:12.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.089+0000 7f9083d27700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907c0ffc90 con 0x7f907c1040d0 2024-02-19T19:06:12.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.089+0000 7f9083d27700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907c0ffdd0 con 0x7f907c1017a0 2024-02-19T19:06:12.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.090+0000 7f90812c2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f907c1040d0 0x7f907c0ff750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:12.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.090+0000 7f9081ac3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f907c1017a0 0x7f907c101100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:12.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.090+0000 7f90812c2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f907c1040d0 0x7f907c0ff750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36788/0 (socket says 172.21.15.96:36788) 2024-02-19T19:06:12.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.090+0000 7f90812c2700 1 -- 172.21.15.96:0/2421626939 learned_addr learned my addr 172.21.15.96:0/2421626939 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:06:12.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.090+0000 7f90812c2700 1 -- 172.21.15.96:0/2421626939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f907c1017a0 msgr2=0x7f907c101100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:12.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.090+0000 7f90812c2700 1 --2- 172.21.15.96:0/2421626939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f907c1017a0 0x7f907c101100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:12.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.090+0000 7f90812c2700 1 -- 172.21.15.96:0/2421626939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90780095f0 con 0x7f907c1040d0 2024-02-19T19:06:12.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.090+0000 7f90812c2700 1 --2- 172.21.15.96:0/2421626939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f907c1040d0 0x7f907c0ff750 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f906c00b4b0 tx=0x7f906c00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:12.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.090+0000 7f9072ffd700 1 -- 172.21.15.96:0/2421626939 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f906c011800 con 0x7f907c1040d0 2024-02-19T19:06:12.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.090+0000 7f9072ffd700 1 -- 172.21.15.96:0/2421626939 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f906c011e10 con 0x7f907c1040d0 2024-02-19T19:06:12.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.090+0000 7f9083d27700 1 -- 172.21.15.96:0/2421626939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907c1000b0 con 0x7f907c1040d0 2024-02-19T19:06:12.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.090+0000 7f9072ffd700 1 -- 172.21.15.96:0/2421626939 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f906c00f2e0 con 0x7f907c1040d0 2024-02-19T19:06:12.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.090+0000 7f9083d27700 1 -- 172.21.15.96:0/2421626939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f907c19e540 con 0x7f907c1040d0 2024-02-19T19:06:12.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.091+0000 7f9083d27700 1 -- 172.21.15.96:0/2421626939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f907c190690 con 0x7f907c1040d0 2024-02-19T19:06:12.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.093+0000 7f9072ffd700 1 -- 172.21.15.96:0/2421626939 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f906c010380 con 0x7f907c1040d0 2024-02-19T19:06:12.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.093+0000 7f9072ffd700 1 --2- 172.21.15.96:0/2421626939 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f906806d520 0x7f906806f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:12.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.093+0000 7f9072ffd700 1 -- 172.21.15.96:0/2421626939 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f906c08cb30 con 0x7f907c1040d0 2024-02-19T19:06:12.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.093+0000 7f9081ac3700 1 --2- 172.21.15.96:0/2421626939 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f906806d520 0x7f906806f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:12.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.093+0000 7f9081ac3700 1 --2- 172.21.15.96:0/2421626939 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f906806d520 0x7f906806f9e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9078006010 tx=0x7f907800b540 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:12.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.102+0000 7f9072ffd700 1 -- 172.21.15.96:0/2421626939 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f906c05a340 con 0x7f907c1040d0 2024-02-19T19:06:12.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.388+0000 7f9083d27700 1 -- 172.21.15.96:0/2421626939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f907c02cc70 con 0x7f907c1040d0 2024-02-19T19:06:12.409 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.389+0000 7f9072ffd700 1 -- 172.21.15.96:0/2421626939 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f906c059ed0 con 0x7f907c1040d0 2024-02-19T19:06:12.409 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:06:12.409 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:06:12.409 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-19T19:06:12.409 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:06:12.410 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:06:12.410 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:06:12.410 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:06:12.410 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:06:12.410 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-19T19:06:12.410 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:06:12.410 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:06:12.410 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-19T19:06:12.410 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:06:12.410 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:06:12.410 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 12, 2024-02-19T19:06:12.410 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:06:12.410 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:06:12.410 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:06:12.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.391+0000 7f9083d27700 1 -- 172.21.15.96:0/2421626939 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f906806d520 msgr2=0x7f906806f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:12.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.391+0000 7f9083d27700 1 --2- 172.21.15.96:0/2421626939 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f906806d520 0x7f906806f9e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9078006010 tx=0x7f907800b540 comp rx=0 tx=0).stop 2024-02-19T19:06:12.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.391+0000 7f9083d27700 1 -- 172.21.15.96:0/2421626939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f907c1040d0 msgr2=0x7f907c0ff750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:12.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.391+0000 7f9083d27700 1 --2- 172.21.15.96:0/2421626939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f907c1040d0 0x7f907c0ff750 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f906c00b4b0 tx=0x7f906c00b7c0 comp rx=0 tx=0).stop 2024-02-19T19:06:12.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.391+0000 7f9083d27700 1 -- 172.21.15.96:0/2421626939 shutdown_connections 2024-02-19T19:06:12.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.391+0000 7f9083d27700 1 --2- 172.21.15.96:0/2421626939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f907c1017a0 0x7f907c101100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:12.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.391+0000 7f9083d27700 1 --2- 172.21.15.96:0/2421626939 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f906806d520 0x7f906806f9e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:12.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.391+0000 7f9083d27700 1 --2- 172.21.15.96:0/2421626939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f907c1040d0 0x7f907c0ff750 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:12.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.391+0000 7f9083d27700 1 -- 172.21.15.96:0/2421626939 >> 172.21.15.96:0/2421626939 conn(0x7f907c0fb190 msgr2=0x7f907c0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:12.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.391+0000 7f9083d27700 1 -- 172.21.15.96:0/2421626939 shutdown_connections 2024-02-19T19:06:12.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.391+0000 7f9083d27700 1 -- 172.21.15.96:0/2421626939 wait complete. 2024-02-19T19:06:12.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.496+0000 7f1b1a212700 1 -- 172.21.15.96:0/1813506399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b14101eb0 msgr2=0x7f1b14102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:12.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.496+0000 7f1b1a212700 1 --2- 172.21.15.96:0/1813506399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b14101eb0 0x7f1b14102310 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f1b08009910 tx=0x7f1b08009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:12.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.496+0000 7f1b1a212700 1 -- 172.21.15.96:0/1813506399 shutdown_connections 2024-02-19T19:06:12.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.496+0000 7f1b1a212700 1 --2- 172.21.15.96:0/1813506399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b14101eb0 0x7f1b14102310 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:12.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.496+0000 7f1b1a212700 1 --2- 172.21.15.96:0/1813506399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b14100cb0 0x7f1b141010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:12.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.496+0000 7f1b1a212700 1 -- 172.21.15.96:0/1813506399 >> 172.21.15.96:0/1813506399 conn(0x7f1b140fc230 msgr2=0x7f1b140fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:12.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.497+0000 7f1b1a212700 1 -- 172.21.15.96:0/1813506399 shutdown_connections 2024-02-19T19:06:12.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.497+0000 7f1b1a212700 1 -- 172.21.15.96:0/1813506399 wait complete. 2024-02-19T19:06:12.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.497+0000 7f1b1a212700 1 Processor -- start 2024-02-19T19:06:12.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.497+0000 7f1b1a212700 1 -- start start 2024-02-19T19:06:12.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.498+0000 7f1b1a212700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b14100cb0 0x7f1b14196530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:12.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.498+0000 7f1b1a212700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b14101eb0 0x7f1b14196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:12.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.498+0000 7f1b1a212700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b14197090 con 0x7f1b14101eb0 2024-02-19T19:06:12.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.498+0000 7f1b1a212700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b141971d0 con 0x7f1b14100cb0 2024-02-19T19:06:12.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.498+0000 7f1b12ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b14101eb0 0x7f1b14196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:12.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.498+0000 7f1b12ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b14101eb0 0x7f1b14196a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:36810/0 (socket says 172.21.15.96:36810) 2024-02-19T19:06:12.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.498+0000 7f1b12ffd700 1 -- 172.21.15.96:0/3023525636 learned_addr learned my addr 172.21.15.96:0/3023525636 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:06:12.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.498+0000 7f1b137fe700 1 --2- 172.21.15.96:0/3023525636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b14100cb0 0x7f1b14196530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:12.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.498+0000 7f1b12ffd700 1 -- 172.21.15.96:0/3023525636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b14100cb0 msgr2=0x7f1b14196530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:12.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.498+0000 7f1b12ffd700 1 --2- 172.21.15.96:0/3023525636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b14100cb0 0x7f1b14196530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:12.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.498+0000 7f1b12ffd700 1 -- 172.21.15.96:0/3023525636 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b080095f0 con 0x7f1b14101eb0 2024-02-19T19:06:12.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.498+0000 7f1b137fe700 1 --2- 172.21.15.96:0/3023525636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b14100cb0 0x7f1b14196530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:06:12.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.498+0000 7f1b12ffd700 1 --2- 172.21.15.96:0/3023525636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b14101eb0 0x7f1b14196a70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1b08006010 tx=0x7f1b0800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:12.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.498+0000 7f1b10ff9700 1 -- 172.21.15.96:0/3023525636 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b0801d070 con 0x7f1b14101eb0 2024-02-19T19:06:12.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.499+0000 7f1b10ff9700 1 -- 172.21.15.96:0/3023525636 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1b0800f460 con 0x7f1b14101eb0 2024-02-19T19:06:12.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.499+0000 7f1b10ff9700 1 -- 172.21.15.96:0/3023525636 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b08021640 con 0x7f1b14101eb0 2024-02-19T19:06:12.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.499+0000 7f1b1a212700 1 -- 172.21.15.96:0/3023525636 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b1419bc20 con 0x7f1b14101eb0 2024-02-19T19:06:12.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.499+0000 7f1b1a212700 1 -- 172.21.15.96:0/3023525636 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b14073250 con 0x7f1b14101eb0 2024-02-19T19:06:12.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.500+0000 7f1b1a212700 1 -- 172.21.15.96:0/3023525636 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b141098b0 con 0x7f1b14101eb0 2024-02-19T19:06:12.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.500+0000 7f1b10ff9700 1 -- 172.21.15.96:0/3023525636 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f1b0800fab0 con 0x7f1b14101eb0 2024-02-19T19:06:12.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.500+0000 7f1b10ff9700 1 --2- 172.21.15.96:0/3023525636 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f1afc06d520 0x7f1afc06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:12.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.501+0000 7f1b10ff9700 1 -- 172.21.15.96:0/3023525636 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1b0808e340 con 0x7f1b14101eb0 2024-02-19T19:06:12.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.501+0000 7f1b137fe700 1 --2- 172.21.15.96:0/3023525636 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f1afc06d520 0x7f1afc06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:12.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.501+0000 7f1b137fe700 1 --2- 172.21.15.96:0/3023525636 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f1afc06d520 0x7f1afc06f9e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1b14101d10 tx=0x7f1b04008040 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:12.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.505+0000 7f1b10ff9700 1 -- 172.21.15.96:0/3023525636 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f1b0805bbd0 con 0x7f1b14101eb0 2024-02-19T19:06:12.762 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.741+0000 7f1b1a212700 1 -- 172.21.15.96:0/3023525636 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b14106800 con 0x7f1afc06d520 2024-02-19T19:06:12.762 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:12 smithi096 ceph-mon[29216]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:12.762 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:12 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/2421626939' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:12.763 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.743+0000 7f1b10ff9700 1 -- 172.21.15.96:0/3023525636 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f1b14106800 con 0x7f1afc06d520 2024-02-19T19:06:12.763 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:06:12.763 INFO:teuthology.orchestra.run.smithi096.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:06:12.763 INFO:teuthology.orchestra.run.smithi096.stdout: "in_progress": true, 2024-02-19T19:06:12.763 INFO:teuthology.orchestra.run.smithi096.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-19T19:06:12.763 INFO:teuthology.orchestra.run.smithi096.stdout: "services_complete": [ 2024-02-19T19:06:12.763 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr" 2024-02-19T19:06:12.763 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-02-19T19:06:12.763 INFO:teuthology.orchestra.run.smithi096.stdout: "progress": "2/2 daemons upgraded", 2024-02-19T19:06:12.763 INFO:teuthology.orchestra.run.smithi096.stdout: "message": "Currently upgrading grafana daemons", 2024-02-19T19:06:12.763 INFO:teuthology.orchestra.run.smithi096.stdout: "is_paused": false 2024-02-19T19:06:12.763 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:06:12.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.745+0000 7f1b1a212700 1 -- 172.21.15.96:0/3023525636 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f1afc06d520 msgr2=0x7f1afc06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:12.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.745+0000 7f1b1a212700 1 --2- 172.21.15.96:0/3023525636 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f1afc06d520 0x7f1afc06f9e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1b14101d10 tx=0x7f1b04008040 comp rx=0 tx=0).stop 2024-02-19T19:06:12.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.745+0000 7f1b1a212700 1 -- 172.21.15.96:0/3023525636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b14101eb0 msgr2=0x7f1b14196a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:12.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.745+0000 7f1b1a212700 1 --2- 172.21.15.96:0/3023525636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b14101eb0 0x7f1b14196a70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1b08006010 tx=0x7f1b0800be20 comp rx=0 tx=0).stop 2024-02-19T19:06:12.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.745+0000 7f1b1a212700 1 -- 172.21.15.96:0/3023525636 shutdown_connections 2024-02-19T19:06:12.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.745+0000 7f1b1a212700 1 --2- 172.21.15.96:0/3023525636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b14100cb0 0x7f1b14196530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:12.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.745+0000 7f1b1a212700 1 --2- 172.21.15.96:0/3023525636 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f1afc06d520 0x7f1afc06f9e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:12.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.745+0000 7f1b1a212700 1 --2- 172.21.15.96:0/3023525636 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b14101eb0 0x7f1b14196a70 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:12.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.745+0000 7f1b1a212700 1 -- 172.21.15.96:0/3023525636 >> 172.21.15.96:0/3023525636 conn(0x7f1b140fc230 msgr2=0x7f1b141050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:12.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.745+0000 7f1b1a212700 1 -- 172.21.15.96:0/3023525636 shutdown_connections 2024-02-19T19:06:12.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:12.745+0000 7f1b1a212700 1 -- 172.21.15.96:0/3023525636 wait complete. 2024-02-19T19:06:12.806 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:12 smithi125 ceph-mon[37556]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:12.806 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:12 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/2421626939' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:13.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:13 smithi096 ceph-mon[29216]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:13.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:13 smithi096 ceph-mon[29216]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:13.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:13 smithi096 ceph-mon[29216]: pgmap v54: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-19T19:06:13.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:13 smithi125 ceph-mon[37556]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:13.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:13 smithi125 ceph-mon[37556]: from='client.14756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:13.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:13 smithi125 ceph-mon[37556]: pgmap v54: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-02-19T19:06:14.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:14 smithi096 ceph-mon[29216]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:14.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:14 smithi125 ceph-mon[37556]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:15.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:15 smithi096 ceph-mon[29216]: pgmap v55: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:15.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:15 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:06:15.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:15 smithi125 ceph-mon[37556]: pgmap v55: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:15.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:15 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:06:17.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:17 smithi096 ceph-mon[29216]: pgmap v56: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:06:17.862 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:17 smithi125 ceph-mon[37556]: pgmap v56: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:06:19.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:19 smithi096 ceph-mon[29216]: pgmap v57: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:19.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:19 smithi125 ceph-mon[37556]: pgmap v57: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:21.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:21 smithi096 ceph-mon[29216]: pgmap v58: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:21.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:21 smithi125 ceph-mon[37556]: pgmap v58: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:23.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:23 smithi096 ceph-mon[29216]: pgmap v59: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:06:23.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:23 smithi125 ceph-mon[37556]: pgmap v59: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:06:25.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:25 smithi096 ceph-mon[29216]: pgmap v60: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:25.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:25 smithi125 ceph-mon[37556]: pgmap v60: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:27.672 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:27 smithi096 ceph-mon[29216]: pgmap v61: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:06:27.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:27 smithi125 ceph-mon[37556]: pgmap v61: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:06:29.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:29 smithi096 ceph-mon[29216]: pgmap v62: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:29.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:29 smithi125 ceph-mon[37556]: pgmap v62: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:30.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:06:30.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:06:31.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:31 smithi096 ceph-mon[29216]: pgmap v63: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:31.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:31 smithi125 ceph-mon[37556]: pgmap v63: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:33.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:33 smithi096 ceph-mon[29216]: pgmap v64: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:06:33.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:33 smithi125 ceph-mon[37556]: pgmap v64: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:06:34.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:34 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:34.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:34 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:34.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:34 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:06:35.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:34 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:35.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:34 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:35.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:34 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:06:35.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:35 smithi125 ceph-mon[37556]: pgmap v65: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:36.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:35 smithi096 ceph-mon[29216]: pgmap v65: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:37.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:37 smithi125 ceph-mon[37556]: pgmap v66: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:06:38.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:37 smithi096 ceph-mon[29216]: pgmap v66: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:06:39.923 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:39 smithi096 ceph-mon[29216]: pgmap v67: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:39.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:39 smithi125 ceph-mon[37556]: pgmap v67: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:41.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:41 smithi125 ceph-mon[37556]: pgmap v68: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:42.036 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:41 smithi096 ceph-mon[29216]: pgmap v68: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:42.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.856+0000 7f359def3700 1 -- 172.21.15.96:0/3864124222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3598100e10 msgr2=0x7f3598101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:42.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.856+0000 7f359def3700 1 --2- 172.21.15.96:0/3864124222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3598100e10 0x7f3598101270 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f358c009910 tx=0x7f358c009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:42.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.856+0000 7f359def3700 1 -- 172.21.15.96:0/3864124222 shutdown_connections 2024-02-19T19:06:42.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.856+0000 7f359def3700 1 --2- 172.21.15.96:0/3864124222 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3598100e10 0x7f3598101270 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:42.877 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.856+0000 7f359def3700 1 --2- 172.21.15.96:0/3864124222 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f35980ffc10 0x7f3598100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:42.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.856+0000 7f359def3700 1 -- 172.21.15.96:0/3864124222 >> 172.21.15.96:0/3864124222 conn(0x7f35980fb190 msgr2=0x7f35980fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:42.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.856+0000 7f359def3700 1 -- 172.21.15.96:0/3864124222 shutdown_connections 2024-02-19T19:06:42.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.856+0000 7f359def3700 1 -- 172.21.15.96:0/3864124222 wait complete. 2024-02-19T19:06:42.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.857+0000 7f359def3700 1 Processor -- start 2024-02-19T19:06:42.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.857+0000 7f359def3700 1 -- start start 2024-02-19T19:06:42.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.857+0000 7f359def3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35980ffc10 0x7f3598196520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:42.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.857+0000 7f359def3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3598100e10 0x7f3598196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:42.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.857+0000 7f359def3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3598197080 con 0x7f35980ffc10 2024-02-19T19:06:42.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.857+0000 7f359def3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35981971c0 con 0x7f3598100e10 2024-02-19T19:06:42.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.857+0000 7f35977fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35980ffc10 0x7f3598196520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:42.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.858+0000 7f35977fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35980ffc10 0x7f3598196520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48874/0 (socket says 172.21.15.96:48874) 2024-02-19T19:06:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.858+0000 7f35977fe700 1 -- 172.21.15.96:0/2239862006 learned_addr learned my addr 172.21.15.96:0/2239862006 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:06:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.858+0000 7f3596ffd700 1 --2- 172.21.15.96:0/2239862006 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3598100e10 0x7f3598196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.858+0000 7f35977fe700 1 -- 172.21.15.96:0/2239862006 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3598100e10 msgr2=0x7f3598196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.858+0000 7f35977fe700 1 --2- 172.21.15.96:0/2239862006 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3598100e10 0x7f3598196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.858+0000 7f35977fe700 1 -- 172.21.15.96:0/2239862006 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c0095f0 con 0x7f35980ffc10 2024-02-19T19:06:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.858+0000 7f3596ffd700 1 --2- 172.21.15.96:0/2239862006 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3598100e10 0x7f3598196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:06:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.858+0000 7f35977fe700 1 --2- 172.21.15.96:0/2239862006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35980ffc10 0x7f3598196520 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f358800b480 tx=0x7f358800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.858+0000 7f3594ff9700 1 -- 172.21.15.96:0/2239862006 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35880118c0 con 0x7f35980ffc10 2024-02-19T19:06:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.858+0000 7f3594ff9700 1 -- 172.21.15.96:0/2239862006 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3588010380 con 0x7f35980ffc10 2024-02-19T19:06:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.858+0000 7f359def3700 1 -- 172.21.15.96:0/2239862006 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359819bc70 con 0x7f35980ffc10 2024-02-19T19:06:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.858+0000 7f3594ff9700 1 -- 172.21.15.96:0/2239862006 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f358800f4f0 con 0x7f35980ffc10 2024-02-19T19:06:42.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.858+0000 7f359def3700 1 -- 172.21.15.96:0/2239862006 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359819c1c0 con 0x7f35980ffc10 2024-02-19T19:06:42.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.859+0000 7f359def3700 1 -- 172.21.15.96:0/2239862006 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35981087a0 con 0x7f35980ffc10 2024-02-19T19:06:42.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.860+0000 7f3594ff9700 1 -- 172.21.15.96:0/2239862006 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f358800f7b0 con 0x7f35980ffc10 2024-02-19T19:06:42.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.860+0000 7f3594ff9700 1 --2- 172.21.15.96:0/2239862006 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f358006d520 0x7f358006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:42.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.860+0000 7f3594ff9700 1 -- 172.21.15.96:0/2239862006 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f358808cc10 con 0x7f35980ffc10 2024-02-19T19:06:42.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.860+0000 7f3596ffd700 1 --2- 172.21.15.96:0/2239862006 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f358006d520 0x7f358006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:42.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.861+0000 7f3596ffd700 1 --2- 172.21.15.96:0/2239862006 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f358006d520 0x7f358006f9e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f358c0059d0 tx=0x7f358c005920 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:42.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:42.865+0000 7f3594ff9700 1 -- 172.21.15.96:0/2239862006 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f358805a420 con 0x7f35980ffc10 2024-02-19T19:06:43.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.089+0000 7f359def3700 1 -- 172.21.15.96:0/2239862006 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f359819c830 con 0x7f358006d520 2024-02-19T19:06:43.110 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.090+0000 7f3594ff9700 1 -- 172.21.15.96:0/2239862006 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f359819c830 con 0x7f358006d520 2024-02-19T19:06:43.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.092+0000 7f359def3700 1 -- 172.21.15.96:0/2239862006 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f358006d520 msgr2=0x7f358006f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:43.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.092+0000 7f359def3700 1 --2- 172.21.15.96:0/2239862006 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f358006d520 0x7f358006f9e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f358c0059d0 tx=0x7f358c005920 comp rx=0 tx=0).stop 2024-02-19T19:06:43.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.092+0000 7f359def3700 1 -- 172.21.15.96:0/2239862006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35980ffc10 msgr2=0x7f3598196520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:43.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.092+0000 7f359def3700 1 --2- 172.21.15.96:0/2239862006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35980ffc10 0x7f3598196520 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f358800b480 tx=0x7f358800b840 comp rx=0 tx=0).stop 2024-02-19T19:06:43.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.092+0000 7f359def3700 1 -- 172.21.15.96:0/2239862006 shutdown_connections 2024-02-19T19:06:43.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.092+0000 7f359def3700 1 --2- 172.21.15.96:0/2239862006 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f358006d520 0x7f358006f9e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:43.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.092+0000 7f359def3700 1 --2- 172.21.15.96:0/2239862006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35980ffc10 0x7f3598196520 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:43.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.092+0000 7f359def3700 1 --2- 172.21.15.96:0/2239862006 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3598100e10 0x7f3598196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:43.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.092+0000 7f359def3700 1 -- 172.21.15.96:0/2239862006 >> 172.21.15.96:0/2239862006 conn(0x7f35980fb190 msgr2=0x7f3598068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:43.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.092+0000 7f359def3700 1 -- 172.21.15.96:0/2239862006 shutdown_connections 2024-02-19T19:06:43.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.092+0000 7f359def3700 1 -- 172.21.15.96:0/2239862006 wait complete. 2024-02-19T19:06:43.123 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:06:43.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.203+0000 7f285d1dc700 1 -- 172.21.15.96:0/976122334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28580fed20 msgr2=0x7f28580ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:43.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.203+0000 7f285d1dc700 1 --2- 172.21.15.96:0/976122334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28580fed20 0x7f28580ff1a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f284c009910 tx=0x7f284c009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:43.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.203+0000 7f285d1dc700 1 -- 172.21.15.96:0/976122334 shutdown_connections 2024-02-19T19:06:43.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.203+0000 7f285d1dc700 1 --2- 172.21.15.96:0/976122334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28580fed20 0x7f28580ff1a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:43.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.203+0000 7f285d1dc700 1 --2- 172.21.15.96:0/976122334 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28581022a0 0x7f28581026c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:43.224 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:43 smithi096 ceph-mon[29216]: pgmap v69: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:06:43.225 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:43 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:43.225 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:43 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:43.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.203+0000 7f285d1dc700 1 -- 172.21.15.96:0/976122334 >> 172.21.15.96:0/976122334 conn(0x7f28580fa8c0 msgr2=0x7f28580fcd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:43.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.203+0000 7f285d1dc700 1 -- 172.21.15.96:0/976122334 shutdown_connections 2024-02-19T19:06:43.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.204+0000 7f285d1dc700 1 -- 172.21.15.96:0/976122334 wait complete. 2024-02-19T19:06:43.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.204+0000 7f285d1dc700 1 Processor -- start 2024-02-19T19:06:43.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.204+0000 7f285d1dc700 1 -- start start 2024-02-19T19:06:43.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.205+0000 7f285d1dc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28580fed20 0x7f28581019a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:43.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.205+0000 7f285d1dc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28581022a0 0x7f28580ffff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:43.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.205+0000 7f285d1dc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2858100530 con 0x7f28581022a0 2024-02-19T19:06:43.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.205+0000 7f285d1dc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2858100670 con 0x7f28580fed20 2024-02-19T19:06:43.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.205+0000 7f285659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28581022a0 0x7f28580ffff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:43.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.205+0000 7f285659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28581022a0 0x7f28580ffff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48896/0 (socket says 172.21.15.96:48896) 2024-02-19T19:06:43.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.205+0000 7f285659c700 1 -- 172.21.15.96:0/370714075 learned_addr learned my addr 172.21.15.96:0/370714075 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:06:43.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.205+0000 7f2856d9d700 1 --2- 172.21.15.96:0/370714075 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28580fed20 0x7f28581019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:43.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.205+0000 7f285659c700 1 -- 172.21.15.96:0/370714075 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28580fed20 msgr2=0x7f28581019a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:43.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.205+0000 7f285659c700 1 --2- 172.21.15.96:0/370714075 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28580fed20 0x7f28581019a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:43.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.205+0000 7f285659c700 1 -- 172.21.15.96:0/370714075 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c0095f0 con 0x7f28581022a0 2024-02-19T19:06:43.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.205+0000 7f285659c700 1 --2- 172.21.15.96:0/370714075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28581022a0 0x7f28580ffff0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f284c00bda0 tx=0x7f284c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:43.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.206+0000 7f283ffff700 1 -- 172.21.15.96:0/370714075 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f284c01d070 con 0x7f28581022a0 2024-02-19T19:06:43.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.206+0000 7f283ffff700 1 -- 172.21.15.96:0/370714075 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f284c004c50 con 0x7f28581022a0 2024-02-19T19:06:43.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.206+0000 7f283ffff700 1 -- 172.21.15.96:0/370714075 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f284c00f690 con 0x7f28581022a0 2024-02-19T19:06:43.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.206+0000 7f285d1dc700 1 -- 172.21.15.96:0/370714075 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28581008f0 con 0x7f28581022a0 2024-02-19T19:06:43.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.206+0000 7f285d1dc700 1 -- 172.21.15.96:0/370714075 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2858100d90 con 0x7f28581022a0 2024-02-19T19:06:43.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.207+0000 7f285d1dc700 1 -- 172.21.15.96:0/370714075 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28581098c0 con 0x7f28581022a0 2024-02-19T19:06:43.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.207+0000 7f283ffff700 1 -- 172.21.15.96:0/370714075 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f284c0229b0 con 0x7f28581022a0 2024-02-19T19:06:43.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.208+0000 7f283ffff700 1 --2- 172.21.15.96:0/370714075 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f284006d520 0x7f284006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:43.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.208+0000 7f2856d9d700 1 --2- 172.21.15.96:0/370714075 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f284006d520 0x7f284006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:43.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.208+0000 7f283ffff700 1 -- 172.21.15.96:0/370714075 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f284c08e6a0 con 0x7f28581022a0 2024-02-19T19:06:43.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.208+0000 7f2856d9d700 1 --2- 172.21.15.96:0/370714075 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f284006d520 0x7f284006f9e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2848006fd0 tx=0x7f2848008040 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:43.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.212+0000 7f283ffff700 1 -- 172.21.15.96:0/370714075 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f284c05bf60 con 0x7f28581022a0 2024-02-19T19:06:43.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:43 smithi125 ceph-mon[37556]: pgmap v69: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:06:43.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:43 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:43.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:43 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:43.454 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.434+0000 7f285d1dc700 1 -- 172.21.15.96:0/370714075 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2858106990 con 0x7f284006d520 2024-02-19T19:06:43.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.435+0000 7f283ffff700 1 -- 172.21.15.96:0/370714075 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f2858106990 con 0x7f284006d520 2024-02-19T19:06:43.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.437+0000 7f285d1dc700 1 -- 172.21.15.96:0/370714075 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f284006d520 msgr2=0x7f284006f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:43.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.437+0000 7f285d1dc700 1 --2- 172.21.15.96:0/370714075 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f284006d520 0x7f284006f9e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2848006fd0 tx=0x7f2848008040 comp rx=0 tx=0).stop 2024-02-19T19:06:43.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.437+0000 7f285d1dc700 1 -- 172.21.15.96:0/370714075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28581022a0 msgr2=0x7f28580ffff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:43.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.437+0000 7f285d1dc700 1 --2- 172.21.15.96:0/370714075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28581022a0 0x7f28580ffff0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f284c00bda0 tx=0x7f284c00be80 comp rx=0 tx=0).stop 2024-02-19T19:06:43.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.437+0000 7f285d1dc700 1 -- 172.21.15.96:0/370714075 shutdown_connections 2024-02-19T19:06:43.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.437+0000 7f285d1dc700 1 --2- 172.21.15.96:0/370714075 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f28580fed20 0x7f28581019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:43.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.437+0000 7f285d1dc700 1 --2- 172.21.15.96:0/370714075 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f284006d520 0x7f284006f9e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:43.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.437+0000 7f285d1dc700 1 --2- 172.21.15.96:0/370714075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f28581022a0 0x7f28580ffff0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:43.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.437+0000 7f285d1dc700 1 -- 172.21.15.96:0/370714075 >> 172.21.15.96:0/370714075 conn(0x7f28580fa8c0 msgr2=0x7f2858105270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:43.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.437+0000 7f285d1dc700 1 -- 172.21.15.96:0/370714075 shutdown_connections 2024-02-19T19:06:43.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.437+0000 7f285d1dc700 1 -- 172.21.15.96:0/370714075 wait complete. 2024-02-19T19:06:43.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.545+0000 7f29d02f5700 1 -- 172.21.15.96:0/3365949847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29c80ffc10 msgr2=0x7f29c8100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:43.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.545+0000 7f29d02f5700 1 --2- 172.21.15.96:0/3365949847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29c80ffc10 0x7f29c8100030 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f29c4009910 tx=0x7f29c4009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:43.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.546+0000 7f29d02f5700 1 -- 172.21.15.96:0/3365949847 shutdown_connections 2024-02-19T19:06:43.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.546+0000 7f29d02f5700 1 --2- 172.21.15.96:0/3365949847 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29c8100e10 0x7f29c8101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:43.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.546+0000 7f29d02f5700 1 --2- 172.21.15.96:0/3365949847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29c80ffc10 0x7f29c8100030 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:43.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.546+0000 7f29d02f5700 1 -- 172.21.15.96:0/3365949847 >> 172.21.15.96:0/3365949847 conn(0x7f29c80fb190 msgr2=0x7f29c80fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:43.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.546+0000 7f29d02f5700 1 -- 172.21.15.96:0/3365949847 shutdown_connections 2024-02-19T19:06:43.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.546+0000 7f29d02f5700 1 -- 172.21.15.96:0/3365949847 wait complete. 2024-02-19T19:06:43.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.546+0000 7f29d02f5700 1 Processor -- start 2024-02-19T19:06:43.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.546+0000 7f29d02f5700 1 -- start start 2024-02-19T19:06:43.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.546+0000 7f29d02f5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29c80ffc10 0x7f29c8198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:43.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.546+0000 7f29d02f5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29c8100e10 0x7f29c8198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:43.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.546+0000 7f29d02f5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c8199290 con 0x7f29c8100e10 2024-02-19T19:06:43.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.546+0000 7f29d02f5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c81993d0 con 0x7f29c80ffc10 2024-02-19T19:06:43.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.547+0000 7f29cd890700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29c8100e10 0x7f29c8198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:43.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.547+0000 7f29cd890700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29c8100e10 0x7f29c8198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57662/0 (socket says 172.21.15.96:57662) 2024-02-19T19:06:43.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.547+0000 7f29cd890700 1 -- 172.21.15.96:0/120867447 learned_addr learned my addr 172.21.15.96:0/120867447 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:06:43.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.547+0000 7f29ce091700 1 --2- 172.21.15.96:0/120867447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29c80ffc10 0x7f29c8198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:43.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.547+0000 7f29cd890700 1 -- 172.21.15.96:0/120867447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29c80ffc10 msgr2=0x7f29c8198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:43.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.547+0000 7f29cd890700 1 --2- 172.21.15.96:0/120867447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29c80ffc10 0x7f29c8198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:43.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.547+0000 7f29cd890700 1 -- 172.21.15.96:0/120867447 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c40095f0 con 0x7f29c8100e10 2024-02-19T19:06:43.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.547+0000 7f29cd890700 1 --2- 172.21.15.96:0/120867447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29c8100e10 0x7f29c8198c70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f29b800b4b0 tx=0x7f29b800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:43.569 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.547+0000 7f29bf7fe700 1 -- 172.21.15.96:0/120867447 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b8011800 con 0x7f29c8100e10 2024-02-19T19:06:43.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.547+0000 7f29d02f5700 1 -- 172.21.15.96:0/120867447 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c819de80 con 0x7f29c8100e10 2024-02-19T19:06:43.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.547+0000 7f29bf7fe700 1 -- 172.21.15.96:0/120867447 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f29b8011e10 con 0x7f29c8100e10 2024-02-19T19:06:43.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.547+0000 7f29d02f5700 1 -- 172.21.15.96:0/120867447 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c819e3a0 con 0x7f29c8100e10 2024-02-19T19:06:43.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.547+0000 7f29bf7fe700 1 -- 172.21.15.96:0/120867447 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f29b800f2e0 con 0x7f29c8100e10 2024-02-19T19:06:43.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.548+0000 7f29d02f5700 1 -- 172.21.15.96:0/120867447 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c8108780 con 0x7f29c8100e10 2024-02-19T19:06:43.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.549+0000 7f29bf7fe700 1 -- 172.21.15.96:0/120867447 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f29b8011960 con 0x7f29c8100e10 2024-02-19T19:06:43.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.549+0000 7f29bf7fe700 1 --2- 172.21.15.96:0/120867447 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f29b406d520 0x7f29b406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:43.570 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.549+0000 7f29bf7fe700 1 -- 172.21.15.96:0/120867447 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f29b808cb50 con 0x7f29c8100e10 2024-02-19T19:06:43.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.549+0000 7f29ce091700 1 --2- 172.21.15.96:0/120867447 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f29b406d520 0x7f29b406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:43.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.550+0000 7f29ce091700 1 --2- 172.21.15.96:0/120867447 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f29b406d520 0x7f29b406f9e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f29c4006010 tx=0x7f29c400b540 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:43.575 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.554+0000 7f29bf7fe700 1 -- 172.21.15.96:0/120867447 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f29b805a360 con 0x7f29c8100e10 2024-02-19T19:06:43.809 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.789+0000 7f29d02f5700 1 -- 172.21.15.96:0/120867447 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f29c8068c90 con 0x7f29b406d520 2024-02-19T19:06:43.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.800+0000 7f29bf7fe700 1 -- 172.21.15.96:0/120867447 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f29c8068c90 con 0x7f29b406d520 2024-02-19T19:06:43.821 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:06:43.821 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (57s) 1s ago 10m 15.8M - 0.25.0 c8568f914cd2 bbaf83a1e476 2024-02-19T19:06:43.821 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (10m) 1s ago 10m 7948k - 18.2.1 94eadd990e0a b41bff2e0043 2024-02-19T19:06:43.821 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (9m) 90s ago 9m 7721k - 18.2.1 94eadd990e0a 254ab7e7a040 2024-02-19T19:06:43.821 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (10m) 1s ago 10m 6665k - 18.2.1 94eadd990e0a 9250aadb9d78 2024-02-19T19:06:43.821 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (9m) 90s ago 9m 6665k - 18.2.1 94eadd990e0a b98ace7b5ded 2024-02-19T19:06:43.821 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (13s) 1s ago 10m 67.5M - 9.4.12 a0ea5e3c46d9 0102d90938e4 2024-02-19T19:06:43.821 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (4m) 1s ago 4m 26.8M - 18.2.1 94eadd990e0a 0a61d9cd40d1 2024-02-19T19:06:43.821 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (4m) 1s ago 4m 24.0M - 18.2.1 94eadd990e0a 58db3e7a7d75 2024-02-19T19:06:43.822 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (4m) 90s ago 4m 25.1M - 18.2.1 94eadd990e0a 211d64de8a63 2024-02-19T19:06:43.822 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (4m) 90s ago 4m 22.7M - 18.2.1 94eadd990e0a 2a04b5a8eaf4 2024-02-19T19:06:43.822 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:8443,9283,8765 running (2m) 1s ago 12m 503M - 19.0.0-1450-gf78a58c0 f081f847070a a86fbe94fe3f 2024-02-19T19:06:43.822 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (111s) 90s ago 9m 449M - 19.0.0-1450-gf78a58c0 f081f847070a e250486d572d 2024-02-19T19:06:43.822 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (12m) 1s ago 12m 56.2M 2048M 18.2.1 94eadd990e0a 23d5b9626c48 2024-02-19T19:06:43.822 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (9m) 90s ago 9m 43.8M 2048M 18.2.1 94eadd990e0a 27b4cad04cc5 2024-02-19T19:06:43.822 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (98s) 1s ago 10m 15.5M - 1.5.0 0da6a335fe13 51f622ea33d6 2024-02-19T19:06:43.822 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (94s) 90s ago 9m 3590k - 1.5.0 0da6a335fe13 464e076a52a1 2024-02-19T19:06:43.822 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (8m) 1s ago 8m 50.3M 1216M 18.2.1 94eadd990e0a d5bbf07ad0e7 2024-02-19T19:06:43.822 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (8m) 1s ago 8m 50.2M 1216M 18.2.1 94eadd990e0a 40329d59be45 2024-02-19T19:06:43.822 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (7m) 1s ago 7m 48.6M 1216M 18.2.1 94eadd990e0a 4f1e49db2d41 2024-02-19T19:06:43.822 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (7m) 90s ago 7m 49.8M 2240M 18.2.1 94eadd990e0a 4746b79351fc 2024-02-19T19:06:43.822 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (6m) 90s ago 6m 49.4M 2240M 18.2.1 94eadd990e0a 2b3f0088f6b2 2024-02-19T19:06:43.822 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (6m) 90s ago 6m 46.0M 2240M 18.2.1 94eadd990e0a e5731974b46a 2024-02-19T19:06:43.822 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (76s) 1s ago 9m 51.9M - 2.43.0 a07b618ecd1d a4edcf6ed669 2024-02-19T19:06:43.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.804+0000 7f29d02f5700 1 -- 172.21.15.96:0/120867447 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f29b406d520 msgr2=0x7f29b406f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:43.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.804+0000 7f29d02f5700 1 --2- 172.21.15.96:0/120867447 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f29b406d520 0x7f29b406f9e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f29c4006010 tx=0x7f29c400b540 comp rx=0 tx=0).stop 2024-02-19T19:06:43.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.804+0000 7f29d02f5700 1 -- 172.21.15.96:0/120867447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29c8100e10 msgr2=0x7f29c8198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:43.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.804+0000 7f29d02f5700 1 --2- 172.21.15.96:0/120867447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29c8100e10 0x7f29c8198c70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f29b800b4b0 tx=0x7f29b800b7c0 comp rx=0 tx=0).stop 2024-02-19T19:06:43.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.804+0000 7f29d02f5700 1 -- 172.21.15.96:0/120867447 shutdown_connections 2024-02-19T19:06:43.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.804+0000 7f29d02f5700 1 --2- 172.21.15.96:0/120867447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29c80ffc10 0x7f29c8198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:43.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.804+0000 7f29d02f5700 1 --2- 172.21.15.96:0/120867447 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f29b406d520 0x7f29b406f9e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:43.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.804+0000 7f29d02f5700 1 --2- 172.21.15.96:0/120867447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29c8100e10 0x7f29c8198c70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:43.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.804+0000 7f29d02f5700 1 -- 172.21.15.96:0/120867447 >> 172.21.15.96:0/120867447 conn(0x7f29c80fb190 msgr2=0x7f29c8068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:43.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.804+0000 7f29d02f5700 1 -- 172.21.15.96:0/120867447 shutdown_connections 2024-02-19T19:06:43.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.804+0000 7f29d02f5700 1 -- 172.21.15.96:0/120867447 wait complete. 2024-02-19T19:06:43.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.908+0000 7f1d13741700 1 -- 172.21.15.96:0/3799877312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d0c0ffc10 msgr2=0x7f1d0c100030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:43.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.908+0000 7f1d13741700 1 --2- 172.21.15.96:0/3799877312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d0c0ffc10 0x7f1d0c100030 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1d0400b0a0 tx=0x7f1d0400b3b0 comp rx=0 tx=0).stop 2024-02-19T19:06:43.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.908+0000 7f1d13741700 1 -- 172.21.15.96:0/3799877312 shutdown_connections 2024-02-19T19:06:43.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.908+0000 7f1d13741700 1 --2- 172.21.15.96:0/3799877312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d0c100e10 0x7f1d0c101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:43.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.908+0000 7f1d13741700 1 --2- 172.21.15.96:0/3799877312 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d0c0ffc10 0x7f1d0c100030 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:43.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.908+0000 7f1d13741700 1 -- 172.21.15.96:0/3799877312 >> 172.21.15.96:0/3799877312 conn(0x7f1d0c0fb190 msgr2=0x7f1d0c0fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:43.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.908+0000 7f1d13741700 1 -- 172.21.15.96:0/3799877312 shutdown_connections 2024-02-19T19:06:43.929 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.908+0000 7f1d13741700 1 -- 172.21.15.96:0/3799877312 wait complete. 2024-02-19T19:06:43.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.909+0000 7f1d13741700 1 Processor -- start 2024-02-19T19:06:43.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.909+0000 7f1d13741700 1 -- start start 2024-02-19T19:06:43.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.909+0000 7f1d13741700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d0c0ffc10 0x7f1d0c1964d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:43.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.909+0000 7f1d13741700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d0c100e10 0x7f1d0c196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:43.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.909+0000 7f1d13741700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c197030 con 0x7f1d0c100e10 2024-02-19T19:06:43.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.909+0000 7f1d13741700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0c197170 con 0x7f1d0c0ffc10 2024-02-19T19:06:43.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.909+0000 7f1d10cdc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d0c100e10 0x7f1d0c196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:43.931 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.909+0000 7f1d10cdc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d0c100e10 0x7f1d0c196a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57694/0 (socket says 172.21.15.96:57694) 2024-02-19T19:06:43.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.909+0000 7f1d10cdc700 1 -- 172.21.15.96:0/2207421753 learned_addr learned my addr 172.21.15.96:0/2207421753 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:06:43.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.909+0000 7f1d114dd700 1 --2- 172.21.15.96:0/2207421753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d0c0ffc10 0x7f1d0c1964d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:43.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.910+0000 7f1d10cdc700 1 -- 172.21.15.96:0/2207421753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d0c0ffc10 msgr2=0x7f1d0c1964d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:43.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.910+0000 7f1d10cdc700 1 --2- 172.21.15.96:0/2207421753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d0c0ffc10 0x7f1d0c1964d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:43.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.910+0000 7f1d10cdc700 1 -- 172.21.15.96:0/2207421753 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d04009d00 con 0x7f1d0c100e10 2024-02-19T19:06:43.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.910+0000 7f1d10cdc700 1 --2- 172.21.15.96:0/2207421753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d0c100e10 0x7f1d0c196a10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000d8d0 tx=0x7f1d0000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:43.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.910+0000 7f1d0a7fc700 1 -- 172.21.15.96:0/2207421753 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d00009940 con 0x7f1d0c100e10 2024-02-19T19:06:43.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.910+0000 7f1d0a7fc700 1 -- 172.21.15.96:0/2207421753 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1d00010460 con 0x7f1d0c100e10 2024-02-19T19:06:43.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.910+0000 7f1d13741700 1 -- 172.21.15.96:0/2207421753 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d0c19bc20 con 0x7f1d0c100e10 2024-02-19T19:06:43.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.910+0000 7f1d0a7fc700 1 -- 172.21.15.96:0/2207421753 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d0000f5f0 con 0x7f1d0c100e10 2024-02-19T19:06:43.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.910+0000 7f1d13741700 1 -- 172.21.15.96:0/2207421753 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d0c19c170 con 0x7f1d0c100e10 2024-02-19T19:06:43.932 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.911+0000 7f1d13741700 1 -- 172.21.15.96:0/2207421753 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d0c108700 con 0x7f1d0c100e10 2024-02-19T19:06:43.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.911+0000 7f1d0a7fc700 1 -- 172.21.15.96:0/2207421753 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f1d000105d0 con 0x7f1d0c100e10 2024-02-19T19:06:43.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.912+0000 7f1d0a7fc700 1 --2- 172.21.15.96:0/2207421753 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f1cf406d520 0x7f1cf406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:43.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.912+0000 7f1d0a7fc700 1 -- 172.21.15.96:0/2207421753 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1d0008cf60 con 0x7f1d0c100e10 2024-02-19T19:06:43.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.912+0000 7f1d114dd700 1 --2- 172.21.15.96:0/2207421753 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f1cf406d520 0x7f1cf406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:43.933 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.912+0000 7f1d114dd700 1 --2- 172.21.15.96:0/2207421753 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f1cf406d520 0x7f1cf406f9e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1d04000f80 tx=0x7f1d040061f0 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:43.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:43.916+0000 7f1d0a7fc700 1 -- 172.21.15.96:0/2207421753 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f1d000c0a70 con 0x7f1d0c100e10 2024-02-19T19:06:44.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.208+0000 7f1d13741700 1 -- 172.21.15.96:0/2207421753 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1d0c1088f0 con 0x7f1d0c100e10 2024-02-19T19:06:44.230 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.209+0000 7f1d0a7fc700 1 -- 172.21.15.96:0/2207421753 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f1d0005a770 con 0x7f1d0c100e10 2024-02-19T19:06:44.230 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:06:44.230 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:06:44.230 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-19T19:06:44.230 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:06:44.230 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:06:44.230 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:06:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:06:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:06:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-19T19:06:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:06:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:06:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-19T19:06:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:06:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:06:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 12, 2024-02-19T19:06:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:06:44.231 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:06:44.231 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:06:44.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.211+0000 7f1d13741700 1 -- 172.21.15.96:0/2207421753 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f1cf406d520 msgr2=0x7f1cf406f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:44.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.211+0000 7f1d13741700 1 --2- 172.21.15.96:0/2207421753 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f1cf406d520 0x7f1cf406f9e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1d04000f80 tx=0x7f1d040061f0 comp rx=0 tx=0).stop 2024-02-19T19:06:44.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.211+0000 7f1d13741700 1 -- 172.21.15.96:0/2207421753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d0c100e10 msgr2=0x7f1d0c196a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:44.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.211+0000 7f1d13741700 1 --2- 172.21.15.96:0/2207421753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d0c100e10 0x7f1d0c196a10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000d8d0 tx=0x7f1d0000dc90 comp rx=0 tx=0).stop 2024-02-19T19:06:44.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.211+0000 7f1d13741700 1 -- 172.21.15.96:0/2207421753 shutdown_connections 2024-02-19T19:06:44.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.211+0000 7f1d13741700 1 --2- 172.21.15.96:0/2207421753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d0c0ffc10 0x7f1d0c1964d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:44.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.211+0000 7f1d13741700 1 --2- 172.21.15.96:0/2207421753 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f1cf406d520 0x7f1cf406f9e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:44.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.211+0000 7f1d13741700 1 --2- 172.21.15.96:0/2207421753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d0c100e10 0x7f1d0c196a10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:44.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.212+0000 7f1d13741700 1 -- 172.21.15.96:0/2207421753 >> 172.21.15.96:0/2207421753 conn(0x7f1d0c0fb190 msgr2=0x7f1d0c068580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:44.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.212+0000 7f1d13741700 1 -- 172.21.15.96:0/2207421753 shutdown_connections 2024-02-19T19:06:44.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.212+0000 7f1d13741700 1 -- 172.21.15.96:0/2207421753 wait complete. 2024-02-19T19:06:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.319+0000 7ff6757d3700 1 -- 172.21.15.96:0/2844968096 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6701017a0 msgr2=0x7ff670103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.319+0000 7ff6757d3700 1 --2- 172.21.15.96:0/2844968096 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6701017a0 0x7ff670103b90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ff660009910 tx=0x7ff660009c20 comp rx=0 tx=0).stop 2024-02-19T19:06:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.319+0000 7ff6757d3700 1 -- 172.21.15.96:0/2844968096 shutdown_connections 2024-02-19T19:06:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.319+0000 7ff6757d3700 1 --2- 172.21.15.96:0/2844968096 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6701040d0 0x7ff6701064c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.319+0000 7ff6757d3700 1 --2- 172.21.15.96:0/2844968096 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6701017a0 0x7ff670103b90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.319+0000 7ff6757d3700 1 -- 172.21.15.96:0/2844968096 >> 172.21.15.96:0/2844968096 conn(0x7ff6700fb190 msgr2=0x7ff6700fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.319+0000 7ff6757d3700 1 -- 172.21.15.96:0/2844968096 shutdown_connections 2024-02-19T19:06:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.319+0000 7ff6757d3700 1 -- 172.21.15.96:0/2844968096 wait complete. 2024-02-19T19:06:44.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.319+0000 7ff6757d3700 1 Processor -- start 2024-02-19T19:06:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.320+0000 7ff6757d3700 1 -- start start 2024-02-19T19:06:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.320+0000 7ff6757d3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6701017a0 0x7ff6701964e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.320+0000 7ff6757d3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6701040d0 0x7ff670196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.320+0000 7ff6757d3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff670197040 con 0x7ff6701040d0 2024-02-19T19:06:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.320+0000 7ff6757d3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff670197180 con 0x7ff6701017a0 2024-02-19T19:06:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.320+0000 7ff6667fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6701040d0 0x7ff670196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.320+0000 7ff6667fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6701040d0 0x7ff670196a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57716/0 (socket says 172.21.15.96:57716) 2024-02-19T19:06:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.320+0000 7ff6667fc700 1 -- 172.21.15.96:0/1124063735 learned_addr learned my addr 172.21.15.96:0/1124063735 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:06:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.320+0000 7ff6667fc700 1 -- 172.21.15.96:0/1124063735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6701017a0 msgr2=0x7ff6701964e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.320+0000 7ff66effd700 1 --2- 172.21.15.96:0/1124063735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6701017a0 0x7ff6701964e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.320+0000 7ff6667fc700 1 --2- 172.21.15.96:0/1124063735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6701017a0 0x7ff6701964e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.320+0000 7ff6667fc700 1 -- 172.21.15.96:0/1124063735 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6600095f0 con 0x7ff6701040d0 2024-02-19T19:06:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.320+0000 7ff66effd700 1 --2- 172.21.15.96:0/1124063735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6701017a0 0x7ff6701964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:06:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.320+0000 7ff6667fc700 1 --2- 172.21.15.96:0/1124063735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6701040d0 0x7ff670196a20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff65800b4b0 tx=0x7ff65800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.320+0000 7ff66cff9700 1 -- 172.21.15.96:0/1124063735 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff658011800 con 0x7ff6701040d0 2024-02-19T19:06:44.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.320+0000 7ff6757d3700 1 -- 172.21.15.96:0/1124063735 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67019bc30 con 0x7ff6701040d0 2024-02-19T19:06:44.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.321+0000 7ff66cff9700 1 -- 172.21.15.96:0/1124063735 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff658011e10 con 0x7ff6701040d0 2024-02-19T19:06:44.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.321+0000 7ff66cff9700 1 -- 172.21.15.96:0/1124063735 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff65800f2e0 con 0x7ff6701040d0 2024-02-19T19:06:44.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.321+0000 7ff6757d3700 1 -- 172.21.15.96:0/1124063735 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff67019c180 con 0x7ff6701040d0 2024-02-19T19:06:44.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.322+0000 7ff6757d3700 1 -- 172.21.15.96:0/1124063735 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff670190690 con 0x7ff6701040d0 2024-02-19T19:06:44.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.322+0000 7ff66cff9700 1 -- 172.21.15.96:0/1124063735 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7ff658010380 con 0x7ff6701040d0 2024-02-19T19:06:44.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.322+0000 7ff66cff9700 1 --2- 172.21.15.96:0/1124063735 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7ff65c06d520 0x7ff65c06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:06:44.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.323+0000 7ff66cff9700 1 -- 172.21.15.96:0/1124063735 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff65808cba0 con 0x7ff6701040d0 2024-02-19T19:06:44.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.323+0000 7ff66effd700 1 --2- 172.21.15.96:0/1124063735 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7ff65c06d520 0x7ff65c06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:06:44.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.323+0000 7ff66effd700 1 --2- 172.21.15.96:0/1124063735 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7ff65c06d520 0x7ff65c06f9e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff66000b5c0 tx=0x7ff660005e20 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:06:44.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.327+0000 7ff66cff9700 1 -- 172.21.15.96:0/1124063735 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7ff65805a3b0 con 0x7ff6701040d0 2024-02-19T19:06:44.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:44 smithi096 ceph-mon[29216]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:44.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:44 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:44.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:44 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:44.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:44 smithi096 ceph-mon[29216]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:44.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:44 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/2207421753' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:44.573 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.552+0000 7ff6757d3700 1 -- 172.21.15.96:0/1124063735 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6700611d0 con 0x7ff65c06d520 2024-02-19T19:06:44.574 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.554+0000 7ff66cff9700 1 -- 172.21.15.96:0/1124063735 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7ff6700611d0 con 0x7ff65c06d520 2024-02-19T19:06:44.574 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:06:44.574 INFO:teuthology.orchestra.run.smithi096.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:06:44.574 INFO:teuthology.orchestra.run.smithi096.stdout: "in_progress": true, 2024-02-19T19:06:44.574 INFO:teuthology.orchestra.run.smithi096.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-19T19:06:44.574 INFO:teuthology.orchestra.run.smithi096.stdout: "services_complete": [ 2024-02-19T19:06:44.574 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr" 2024-02-19T19:06:44.574 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-02-19T19:06:44.575 INFO:teuthology.orchestra.run.smithi096.stdout: "progress": "2/2 daemons upgraded", 2024-02-19T19:06:44.575 INFO:teuthology.orchestra.run.smithi096.stdout: "message": "Currently upgrading grafana daemons", 2024-02-19T19:06:44.575 INFO:teuthology.orchestra.run.smithi096.stdout: "is_paused": false 2024-02-19T19:06:44.575 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:06:44.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.556+0000 7ff6757d3700 1 -- 172.21.15.96:0/1124063735 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7ff65c06d520 msgr2=0x7ff65c06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:44.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.556+0000 7ff6757d3700 1 --2- 172.21.15.96:0/1124063735 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7ff65c06d520 0x7ff65c06f9e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff66000b5c0 tx=0x7ff660005e20 comp rx=0 tx=0).stop 2024-02-19T19:06:44.576 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.556+0000 7ff6757d3700 1 -- 172.21.15.96:0/1124063735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6701040d0 msgr2=0x7ff670196a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:06:44.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.556+0000 7ff6757d3700 1 --2- 172.21.15.96:0/1124063735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6701040d0 0x7ff670196a20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff65800b4b0 tx=0x7ff65800b870 comp rx=0 tx=0).stop 2024-02-19T19:06:44.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.556+0000 7ff6757d3700 1 -- 172.21.15.96:0/1124063735 shutdown_connections 2024-02-19T19:06:44.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.556+0000 7ff6757d3700 1 --2- 172.21.15.96:0/1124063735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff6701017a0 0x7ff6701964e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:44.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.556+0000 7ff6757d3700 1 --2- 172.21.15.96:0/1124063735 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7ff65c06d520 0x7ff65c06f9e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:44.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.556+0000 7ff6757d3700 1 --2- 172.21.15.96:0/1124063735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6701040d0 0x7ff670196a20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:06:44.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.556+0000 7ff6757d3700 1 -- 172.21.15.96:0/1124063735 >> 172.21.15.96:0/1124063735 conn(0x7ff6700fb190 msgr2=0x7ff6700fd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:06:44.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.556+0000 7ff6757d3700 1 -- 172.21.15.96:0/1124063735 shutdown_connections 2024-02-19T19:06:44.577 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:06:44.556+0000 7ff6757d3700 1 -- 172.21.15.96:0/1124063735 wait complete. 2024-02-19T19:06:44.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:44 smithi125 ceph-mon[37556]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:44.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:44 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:44.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:44 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:44.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:44 smithi125 ceph-mon[37556]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:44.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:44 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/2207421753' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:45.478 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:45 smithi096 ceph-mon[29216]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:45.478 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:45 smithi096 ceph-mon[29216]: pgmap v70: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:45.479 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:45 smithi096 ceph-mon[29216]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:45.479 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:45 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:06:45.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:45 smithi125 ceph-mon[37556]: from='client.14776 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:45.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:45 smithi125 ceph-mon[37556]: pgmap v70: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:45.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:45 smithi125 ceph-mon[37556]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:06:45.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:45 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:06:47.766 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: pgmap v71: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:06:47.766 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:47.766 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:47.766 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:47.766 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:06:47.766 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:47.767 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T19:06:47.767 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:06:47.767 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.767 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.767 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.767 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.767 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.767 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.767 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.767 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.767 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.767 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.768 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.768 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.768 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.768 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:47.768 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-19T19:06:47.768 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-19T19:06:47.768 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:06:47.768 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-19T19:06:47.768 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-19T19:06:47.768 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-19T19:06:47.768 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-19T19:06:47.768 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-19T19:06:47.769 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-19T19:06:47.769 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-19T19:06:47.769 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-19T19:06:47.769 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:06:47.769 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-19T19:06:47.769 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-19T19:06:47.769 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-19T19:06:47.769 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-19T19:06:47.769 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-19T19:06:47.769 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-19T19:06:47.769 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-19T19:06:47.769 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:06:47.769 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:06:47.769 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:06:47.769 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:06:47.770 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:06:47.770 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:06:47.770 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-19T19:06:47.770 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-19T19:06:47.770 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:06:47.770 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:47.770 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:06:47.770 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:47.770 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:06:47.770 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:47.770 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:06:47.770 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:47.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: pgmap v71: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:06:47.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:47.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:47.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:47.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:06:47.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:47.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T19:06:47.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:06:47.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:06:47.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:47.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-19T19:06:47.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-19T19:06:47.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:06:47.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-19T19:06:47.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-19T19:06:47.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-19T19:06:47.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-19T19:06:47.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-19T19:06:47.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-19T19:06:47.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-19T19:06:47.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-19T19:06:47.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:06:47.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-19T19:06:47.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-19T19:06:47.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-19T19:06:47.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-19T19:06:47.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-19T19:06:47.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-19T19:06:47.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-19T19:06:47.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:06:47.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:06:47.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:06:47.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:06:47.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:06:47.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:06:47.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-19T19:06:47.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-19T19:06:47.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:06:47.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:47.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:06:47.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:47.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:06:47.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:06:47.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:06:47.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:48.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:48 smithi096 ceph-mon[29216]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T19:06:48.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:48 smithi096 ceph-mon[29216]: Upgrade: Finalizing container_image settings 2024-02-19T19:06:48.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:48 smithi096 ceph-mon[29216]: Upgrade: Complete! 2024-02-19T19:06:48.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:48 smithi125 ceph-mon[37556]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-19T19:06:48.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:48 smithi125 ceph-mon[37556]: Upgrade: Finalizing container_image settings 2024-02-19T19:06:48.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:48 smithi125 ceph-mon[37556]: Upgrade: Complete! 2024-02-19T19:06:49.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:49 smithi096 ceph-mon[29216]: pgmap v72: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:49.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:49 smithi125 ceph-mon[37556]: pgmap v72: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:51.286 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:51 smithi096 ceph-mon[29216]: pgmap v73: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:51.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:51 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:51.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:51 smithi125 ceph-mon[37556]: pgmap v73: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:51.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:51 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:06:53.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:53 smithi096 ceph-mon[29216]: pgmap v74: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:06:53.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:53 smithi125 ceph-mon[37556]: pgmap v74: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:06:55.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:55 smithi125 ceph-mon[37556]: pgmap v75: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:55.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:55 smithi096 ceph-mon[29216]: pgmap v75: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:57.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:57 smithi096 ceph-mon[29216]: pgmap v76: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:06:57.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:57 smithi125 ceph-mon[37556]: pgmap v76: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:06:59.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:06:59 smithi096 ceph-mon[29216]: pgmap v77: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:06:59.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:06:59 smithi125 ceph-mon[37556]: pgmap v77: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:00.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:00 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:07:00.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:00 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:07:01.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:01 smithi096 ceph-mon[29216]: pgmap v78: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:01.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:01 smithi125 ceph-mon[37556]: pgmap v78: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:03.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:03 smithi125 ceph-mon[37556]: pgmap v79: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:03.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:03 smithi096 ceph-mon[29216]: pgmap v79: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:05.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:05 smithi096 ceph-mon[29216]: pgmap v80: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:05.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:05 smithi125 ceph-mon[37556]: pgmap v80: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:07.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:07 smithi096 ceph-mon[29216]: pgmap v81: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:07.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:07 smithi125 ceph-mon[37556]: pgmap v81: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:09.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:09 smithi096 ceph-mon[29216]: pgmap v82: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:09.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:09 smithi125 ceph-mon[37556]: pgmap v82: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:11.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:11 smithi096 ceph-mon[29216]: pgmap v83: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:11.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:11 smithi125 ceph-mon[37556]: pgmap v83: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:13.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:13 smithi096 ceph-mon[29216]: pgmap v84: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:13.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:13 smithi125 ceph-mon[37556]: pgmap v84: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:14.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.676+0000 7f142211d700 1 -- 172.21.15.96:0/5744607 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f141c100c70 msgr2=0x7f141c1010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:14.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.676+0000 7f142211d700 1 --2- 172.21.15.96:0/5744607 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f141c100c70 0x7f141c1010d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1410009910 tx=0x7f1410009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:14.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.676+0000 7f142211d700 1 -- 172.21.15.96:0/5744607 shutdown_connections 2024-02-19T19:07:14.700 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.676+0000 7f142211d700 1 --2- 172.21.15.96:0/5744607 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f141c100c70 0x7f141c1010d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.676+0000 7f142211d700 1 --2- 172.21.15.96:0/5744607 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f141c0ffa70 0x7f141c0ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.676+0000 7f142211d700 1 -- 172.21.15.96:0/5744607 >> 172.21.15.96:0/5744607 conn(0x7f141c0fafd0 msgr2=0x7f141c0fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.676+0000 7f142211d700 1 -- 172.21.15.96:0/5744607 shutdown_connections 2024-02-19T19:07:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.676+0000 7f142211d700 1 -- 172.21.15.96:0/5744607 wait complete. 2024-02-19T19:07:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.676+0000 7f142211d700 1 Processor -- start 2024-02-19T19:07:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.677+0000 7f142211d700 1 -- start start 2024-02-19T19:07:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.677+0000 7f142211d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f141c0ffa70 0x7f141c1951d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.677+0000 7f142211d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f141c100c70 0x7f141c195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.677+0000 7f142211d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c195d30 con 0x7f141c100c70 2024-02-19T19:07:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.677+0000 7f142211d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c195e70 con 0x7f141c0ffa70 2024-02-19T19:07:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.677+0000 7f141affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f141c100c70 0x7f141c195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.677+0000 7f141affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f141c100c70 0x7f141c195710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55968/0 (socket says 172.21.15.96:55968) 2024-02-19T19:07:14.701 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.677+0000 7f141affd700 1 -- 172.21.15.96:0/2387804680 learned_addr learned my addr 172.21.15.96:0/2387804680 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:07:14.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.677+0000 7f141b7fe700 1 --2- 172.21.15.96:0/2387804680 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f141c0ffa70 0x7f141c1951d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:14.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.677+0000 7f141affd700 1 -- 172.21.15.96:0/2387804680 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f141c0ffa70 msgr2=0x7f141c1951d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:14.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.677+0000 7f141affd700 1 --2- 172.21.15.96:0/2387804680 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f141c0ffa70 0x7f141c1951d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:14.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.677+0000 7f141affd700 1 -- 172.21.15.96:0/2387804680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14100095f0 con 0x7f141c100c70 2024-02-19T19:07:14.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.677+0000 7f141b7fe700 1 --2- 172.21.15.96:0/2387804680 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f141c0ffa70 0x7f141c1951d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:07:14.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.678+0000 7f141affd700 1 --2- 172.21.15.96:0/2387804680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f141c100c70 0x7f141c195710 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1410006010 tx=0x7f141000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:14.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.678+0000 7f1418ff9700 1 -- 172.21.15.96:0/2387804680 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f141001d070 con 0x7f141c100c70 2024-02-19T19:07:14.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.678+0000 7f1418ff9700 1 -- 172.21.15.96:0/2387804680 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f141000f460 con 0x7f141c100c70 2024-02-19T19:07:14.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.678+0000 7f1418ff9700 1 -- 172.21.15.96:0/2387804680 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1410021640 con 0x7f141c100c70 2024-02-19T19:07:14.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.678+0000 7f142211d700 1 -- 172.21.15.96:0/2387804680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f141c19a8c0 con 0x7f141c100c70 2024-02-19T19:07:14.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.678+0000 7f142211d700 1 -- 172.21.15.96:0/2387804680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f141c19ae30 con 0x7f141c100c70 2024-02-19T19:07:14.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.679+0000 7f142211d700 1 -- 172.21.15.96:0/2387804680 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141c1085d0 con 0x7f141c100c70 2024-02-19T19:07:14.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.679+0000 7f1418ff9700 1 -- 172.21.15.96:0/2387804680 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f141000fab0 con 0x7f141c100c70 2024-02-19T19:07:14.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.680+0000 7f1418ff9700 1 --2- 172.21.15.96:0/2387804680 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f140406d520 0x7f140406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:14.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.680+0000 7f1418ff9700 1 -- 172.21.15.96:0/2387804680 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f141008e220 con 0x7f141c100c70 2024-02-19T19:07:14.703 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.680+0000 7f141b7fe700 1 --2- 172.21.15.96:0/2387804680 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f140406d520 0x7f140406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:14.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.680+0000 7f141b7fe700 1 --2- 172.21.15.96:0/2387804680 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f140406d520 0x7f140406f9e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f140c005950 tx=0x7f140c0058e0 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:14.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.684+0000 7f1418ff9700 1 -- 172.21.15.96:0/2387804680 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f141005bab0 con 0x7f141c100c70 2024-02-19T19:07:14.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.901+0000 7f142211d700 1 -- 172.21.15.96:0/2387804680 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f141c1055c0 con 0x7f140406d520 2024-02-19T19:07:14.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.902+0000 7f1418ff9700 1 -- 172.21.15.96:0/2387804680 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f141c1055c0 con 0x7f140406d520 2024-02-19T19:07:14.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.904+0000 7f142211d700 1 -- 172.21.15.96:0/2387804680 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f140406d520 msgr2=0x7f140406f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:14.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.904+0000 7f142211d700 1 --2- 172.21.15.96:0/2387804680 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f140406d520 0x7f140406f9e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f140c005950 tx=0x7f140c0058e0 comp rx=0 tx=0).stop 2024-02-19T19:07:14.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.904+0000 7f142211d700 1 -- 172.21.15.96:0/2387804680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f141c100c70 msgr2=0x7f141c195710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:14.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.904+0000 7f142211d700 1 --2- 172.21.15.96:0/2387804680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f141c100c70 0x7f141c195710 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1410006010 tx=0x7f141000be20 comp rx=0 tx=0).stop 2024-02-19T19:07:14.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.904+0000 7f142211d700 1 -- 172.21.15.96:0/2387804680 shutdown_connections 2024-02-19T19:07:14.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.904+0000 7f142211d700 1 --2- 172.21.15.96:0/2387804680 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f141c0ffa70 0x7f141c1951d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:14.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.904+0000 7f142211d700 1 --2- 172.21.15.96:0/2387804680 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f140406d520 0x7f140406f9e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:14.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.904+0000 7f142211d700 1 --2- 172.21.15.96:0/2387804680 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f141c100c70 0x7f141c195710 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:14.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.904+0000 7f142211d700 1 -- 172.21.15.96:0/2387804680 >> 172.21.15.96:0/2387804680 conn(0x7f141c0fafd0 msgr2=0x7f141c103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:14.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.905+0000 7f142211d700 1 -- 172.21.15.96:0/2387804680 shutdown_connections 2024-02-19T19:07:14.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:14.905+0000 7f142211d700 1 -- 172.21.15.96:0/2387804680 wait complete. 2024-02-19T19:07:15.765 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:15 smithi096 ceph-mon[29216]: pgmap v85: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:15.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:15 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:07:15.787 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-02-19T19:07:15.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:15 smithi125 ceph-mon[37556]: pgmap v85: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:15.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:15 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:07:16.040 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:07:16.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:16 smithi096 ceph-mon[29216]: from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:16.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:16 smithi125 ceph-mon[37556]: from='client.14788 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:17.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:17 smithi096 ceph-mon[29216]: pgmap v86: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.800+0000 7fe20bd60700 1 -- 172.21.15.96:0/322469376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2040ffda0 msgr2=0x7fe204100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.800+0000 7fe20bd60700 1 --2- 172.21.15.96:0/322469376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2040ffda0 0x7fe204100180 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe200009910 tx=0x7fe200009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.800+0000 7fe20bd60700 1 -- 172.21.15.96:0/322469376 shutdown_connections 2024-02-19T19:07:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.800+0000 7fe20bd60700 1 --2- 172.21.15.96:0/322469376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe204100750 0x7fe2041047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.800+0000 7fe20bd60700 1 --2- 172.21.15.96:0/322469376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2040ffda0 0x7fe204100180 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.800+0000 7fe20bd60700 1 -- 172.21.15.96:0/322469376 >> 172.21.15.96:0/322469376 conn(0x7fe2040fb650 msgr2=0x7fe2040fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.800+0000 7fe20bd60700 1 -- 172.21.15.96:0/322469376 shutdown_connections 2024-02-19T19:07:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.800+0000 7fe20bd60700 1 -- 172.21.15.96:0/322469376 wait complete. 2024-02-19T19:07:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.800+0000 7fe20bd60700 1 Processor -- start 2024-02-19T19:07:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.800+0000 7fe20bd60700 1 -- start start 2024-02-19T19:07:17.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.801+0000 7fe20bd60700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2040ffda0 0x7fe20410ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:17.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.801+0000 7fe20bd60700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe204100750 0x7fe20410b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:17.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.801+0000 7fe20bd60700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20410b590 con 0x7fe2040ffda0 2024-02-19T19:07:17.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.801+0000 7fe20bd60700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20410b6d0 con 0x7fe204100750 2024-02-19T19:07:17.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.801+0000 7fe209afc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2040ffda0 0x7fe20410ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:17.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.801+0000 7fe209afc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2040ffda0 0x7fe20410ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55984/0 (socket says 172.21.15.96:55984) 2024-02-19T19:07:17.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.801+0000 7fe209afc700 1 -- 172.21.15.96:0/4139579956 learned_addr learned my addr 172.21.15.96:0/4139579956 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:07:17.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.801+0000 7fe209afc700 1 -- 172.21.15.96:0/4139579956 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe204100750 msgr2=0x7fe20410b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:17.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.801+0000 7fe2092fb700 1 --2- 172.21.15.96:0/4139579956 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe204100750 0x7fe20410b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:17.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.801+0000 7fe209afc700 1 --2- 172.21.15.96:0/4139579956 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe204100750 0x7fe20410b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:17.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.801+0000 7fe209afc700 1 -- 172.21.15.96:0/4139579956 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2000095f0 con 0x7fe2040ffda0 2024-02-19T19:07:17.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.801+0000 7fe2092fb700 1 --2- 172.21.15.96:0/4139579956 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe204100750 0x7fe20410b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:07:17.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.801+0000 7fe209afc700 1 --2- 172.21.15.96:0/4139579956 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2040ffda0 0x7fe20410ab10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe200006010 tx=0x7fe20000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:17.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.801+0000 7fe1faffd700 1 -- 172.21.15.96:0/4139579956 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe20001d070 con 0x7fe2040ffda0 2024-02-19T19:07:17.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.801+0000 7fe1faffd700 1 -- 172.21.15.96:0/4139579956 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe200004fb0 con 0x7fe2040ffda0 2024-02-19T19:07:17.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.801+0000 7fe20bd60700 1 -- 172.21.15.96:0/4139579956 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe20410b950 con 0x7fe2040ffda0 2024-02-19T19:07:17.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.801+0000 7fe1faffd700 1 -- 172.21.15.96:0/4139579956 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe200022ea0 con 0x7fe2040ffda0 2024-02-19T19:07:17.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.801+0000 7fe20bd60700 1 -- 172.21.15.96:0/4139579956 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2041a2eb0 con 0x7fe2040ffda0 2024-02-19T19:07:17.825 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.802+0000 7fe20bd60700 1 -- 172.21.15.96:0/4139579956 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe204108140 con 0x7fe2040ffda0 2024-02-19T19:07:17.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.803+0000 7fe1faffd700 1 -- 172.21.15.96:0/4139579956 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7fe200022470 con 0x7fe2040ffda0 2024-02-19T19:07:17.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.803+0000 7fe1faffd700 1 --2- 172.21.15.96:0/4139579956 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fe1f006d520 0x7fe1f006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:17.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.803+0000 7fe1faffd700 1 -- 172.21.15.96:0/4139579956 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fe20008e710 con 0x7fe2040ffda0 2024-02-19T19:07:17.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.803+0000 7fe2092fb700 1 --2- 172.21.15.96:0/4139579956 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fe1f006d520 0x7fe1f006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:17.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.804+0000 7fe2092fb700 1 --2- 172.21.15.96:0/4139579956 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fe1f006d520 0x7fe1f006f9e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe20410c300 tx=0x7fe1f4008040 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:17.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:17.808+0000 7fe1faffd700 1 -- 172.21.15.96:0/4139579956 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fe2000585c0 con 0x7fe2040ffda0 2024-02-19T19:07:17.853 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:17 smithi125 ceph-mon[37556]: pgmap v86: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:18.108 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:18.088+0000 7fe20bd60700 1 -- 172.21.15.96:0/4139579956 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe204107b20 con 0x7fe2040ffda0 2024-02-19T19:07:18.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:18.088+0000 7fe1faffd700 1 -- 172.21.15.96:0/4139579956 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fe200022720 con 0x7fe2040ffda0 2024-02-19T19:07:18.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:18.090+0000 7fe20bd60700 1 -- 172.21.15.96:0/4139579956 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fe1f006d520 msgr2=0x7fe1f006f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:18.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:18.090+0000 7fe20bd60700 1 --2- 172.21.15.96:0/4139579956 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fe1f006d520 0x7fe1f006f9e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe20410c300 tx=0x7fe1f4008040 comp rx=0 tx=0).stop 2024-02-19T19:07:18.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:18.090+0000 7fe20bd60700 1 -- 172.21.15.96:0/4139579956 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2040ffda0 msgr2=0x7fe20410ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:18.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:18.090+0000 7fe20bd60700 1 --2- 172.21.15.96:0/4139579956 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2040ffda0 0x7fe20410ab10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe200006010 tx=0x7fe20000be20 comp rx=0 tx=0).stop 2024-02-19T19:07:18.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:18.090+0000 7fe20bd60700 1 -- 172.21.15.96:0/4139579956 shutdown_connections 2024-02-19T19:07:18.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:18.090+0000 7fe20bd60700 1 --2- 172.21.15.96:0/4139579956 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fe1f006d520 0x7fe1f006f9e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:18.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:18.090+0000 7fe20bd60700 1 --2- 172.21.15.96:0/4139579956 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2040ffda0 0x7fe20410ab10 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:18.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:18.090+0000 7fe20bd60700 1 --2- 172.21.15.96:0/4139579956 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe204100750 0x7fe20410b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:18.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:18.090+0000 7fe20bd60700 1 -- 172.21.15.96:0/4139579956 >> 172.21.15.96:0/4139579956 conn(0x7fe2040fb650 msgr2=0x7fe2040fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:18.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:18.091+0000 7fe20bd60700 1 -- 172.21.15.96:0/4139579956 shutdown_connections 2024-02-19T19:07:18.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:18.091+0000 7fe20bd60700 1 -- 172.21.15.96:0/4139579956 wait complete. 2024-02-19T19:07:18.122 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:07:18.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:18 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/4139579956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:18.924 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-02-19T19:07:18.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:18 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/4139579956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:19.144 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:07:19.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:19 smithi096 ceph-mon[29216]: pgmap v87: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:19.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:19 smithi125 ceph-mon[37556]: pgmap v87: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:20.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.927+0000 7fdb1f36e700 1 -- 172.21.15.96:0/523815084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb180ffc20 msgr2=0x7fdb18100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:20.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.927+0000 7fdb1f36e700 1 --2- 172.21.15.96:0/523815084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb180ffc20 0x7fdb18100080 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c009910 tx=0x7fdb0c009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:20.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.927+0000 7fdb1f36e700 1 -- 172.21.15.96:0/523815084 shutdown_connections 2024-02-19T19:07:20.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.927+0000 7fdb1f36e700 1 --2- 172.21.15.96:0/523815084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb180ffc20 0x7fdb18100080 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:20.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.927+0000 7fdb1f36e700 1 --2- 172.21.15.96:0/523815084 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb18105bd0 0x7fdb18105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:20.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.927+0000 7fdb1f36e700 1 -- 172.21.15.96:0/523815084 >> 172.21.15.96:0/523815084 conn(0x7fdb18075670 msgr2=0x7fdb18075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:20.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.927+0000 7fdb1f36e700 1 -- 172.21.15.96:0/523815084 shutdown_connections 2024-02-19T19:07:20.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.927+0000 7fdb1f36e700 1 -- 172.21.15.96:0/523815084 wait complete. 2024-02-19T19:07:20.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.928+0000 7fdb1f36e700 1 Processor -- start 2024-02-19T19:07:20.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.928+0000 7fdb1f36e700 1 -- start start 2024-02-19T19:07:20.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.928+0000 7fdb1f36e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb180ffc20 0x7fdb1819b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:20.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.928+0000 7fdb1f36e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb18105bd0 0x7fdb1819bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:20.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.928+0000 7fdb1f36e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb18195620 con 0x7fdb18105bd0 2024-02-19T19:07:20.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.928+0000 7fdb1f36e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb18195790 con 0x7fdb180ffc20 2024-02-19T19:07:20.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.928+0000 7fdb1c909700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb18105bd0 0x7fdb1819bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:20.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.928+0000 7fdb1c909700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb18105bd0 0x7fdb1819bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55996/0 (socket says 172.21.15.96:55996) 2024-02-19T19:07:20.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.929+0000 7fdb1c909700 1 -- 172.21.15.96:0/1108081159 learned_addr learned my addr 172.21.15.96:0/1108081159 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:07:20.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.929+0000 7fdb1d10a700 1 --2- 172.21.15.96:0/1108081159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb180ffc20 0x7fdb1819b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:20.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.929+0000 7fdb1c909700 1 -- 172.21.15.96:0/1108081159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb180ffc20 msgr2=0x7fdb1819b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:20.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.929+0000 7fdb1c909700 1 --2- 172.21.15.96:0/1108081159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb180ffc20 0x7fdb1819b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:20.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.929+0000 7fdb1c909700 1 -- 172.21.15.96:0/1108081159 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c0095f0 con 0x7fdb18105bd0 2024-02-19T19:07:20.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.929+0000 7fdb1d10a700 1 --2- 172.21.15.96:0/1108081159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb180ffc20 0x7fdb1819b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:07:20.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.929+0000 7fdb1c909700 1 --2- 172.21.15.96:0/1108081159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb18105bd0 0x7fdb1819bb70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c006010 tx=0x7fdb0c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:20.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.929+0000 7fdb167fc700 1 -- 172.21.15.96:0/1108081159 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb0c01d070 con 0x7fdb18105bd0 2024-02-19T19:07:20.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.929+0000 7fdb1f36e700 1 -- 172.21.15.96:0/1108081159 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb18195a10 con 0x7fdb18105bd0 2024-02-19T19:07:20.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.929+0000 7fdb167fc700 1 -- 172.21.15.96:0/1108081159 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdb0c004fb0 con 0x7fdb18105bd0 2024-02-19T19:07:20.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.929+0000 7fdb167fc700 1 -- 172.21.15.96:0/1108081159 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb0c022ea0 con 0x7fdb18105bd0 2024-02-19T19:07:20.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.929+0000 7fdb1f36e700 1 -- 172.21.15.96:0/1108081159 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb18195f00 con 0x7fdb18105bd0 2024-02-19T19:07:20.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.930+0000 7fdb1f36e700 1 -- 172.21.15.96:0/1108081159 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb181080d0 con 0x7fdb18105bd0 2024-02-19T19:07:20.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.931+0000 7fdb167fc700 1 -- 172.21.15.96:0/1108081159 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7fdb0c022470 con 0x7fdb18105bd0 2024-02-19T19:07:20.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.931+0000 7fdb167fc700 1 --2- 172.21.15.96:0/1108081159 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fdb0006d520 0x7fdb0006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:20.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.931+0000 7fdb167fc700 1 -- 172.21.15.96:0/1108081159 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fdb0c08e650 con 0x7fdb18105bd0 2024-02-19T19:07:20.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.931+0000 7fdb1d10a700 1 --2- 172.21.15.96:0/1108081159 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fdb0006d520 0x7fdb0006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:20.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.931+0000 7fdb1d10a700 1 --2- 172.21.15.96:0/1108081159 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fdb0006d520 0x7fdb0006f9e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdb10007fd0 tx=0x7fdb10007830 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:20.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:20.936+0000 7fdb167fc700 1 -- 172.21.15.96:0/1108081159 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fdb0c058500 con 0x7fdb18105bd0 2024-02-19T19:07:21.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:21.214+0000 7fdb1f36e700 1 -- 172.21.15.96:0/1108081159 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdb18196b80 con 0x7fdb18105bd0 2024-02-19T19:07:21.235 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:21.215+0000 7fdb167fc700 1 -- 172.21.15.96:0/1108081159 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fdb0c022720 con 0x7fdb18105bd0 2024-02-19T19:07:21.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:21.217+0000 7fdb1f36e700 1 -- 172.21.15.96:0/1108081159 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fdb0006d520 msgr2=0x7fdb0006f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:21.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:21.217+0000 7fdb1f36e700 1 --2- 172.21.15.96:0/1108081159 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fdb0006d520 0x7fdb0006f9e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdb10007fd0 tx=0x7fdb10007830 comp rx=0 tx=0).stop 2024-02-19T19:07:21.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:21.217+0000 7fdb1f36e700 1 -- 172.21.15.96:0/1108081159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb18105bd0 msgr2=0x7fdb1819bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:21.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:21.217+0000 7fdb1f36e700 1 --2- 172.21.15.96:0/1108081159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb18105bd0 0x7fdb1819bb70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c006010 tx=0x7fdb0c00be20 comp rx=0 tx=0).stop 2024-02-19T19:07:21.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:21.217+0000 7fdb1f36e700 1 -- 172.21.15.96:0/1108081159 shutdown_connections 2024-02-19T19:07:21.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:21.217+0000 7fdb1f36e700 1 --2- 172.21.15.96:0/1108081159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdb180ffc20 0x7fdb1819b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:21.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:21.217+0000 7fdb1f36e700 1 --2- 172.21.15.96:0/1108081159 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fdb0006d520 0x7fdb0006f9e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:21.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:21.217+0000 7fdb1f36e700 1 --2- 172.21.15.96:0/1108081159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb18105bd0 0x7fdb1819bb70 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:21.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:21.217+0000 7fdb1f36e700 1 -- 172.21.15.96:0/1108081159 >> 172.21.15.96:0/1108081159 conn(0x7fdb18075670 msgr2=0x7fdb180fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:21.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:21.217+0000 7fdb1f36e700 1 -- 172.21.15.96:0/1108081159 shutdown_connections 2024-02-19T19:07:21.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:21.217+0000 7fdb1f36e700 1 -- 172.21.15.96:0/1108081159 wait complete. 2024-02-19T19:07:21.247 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)" 2024-02-19T19:07:21.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:21 smithi096 ceph-mon[29216]: pgmap v88: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:21.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:21 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/1108081159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:21.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:21 smithi125 ceph-mon[37556]: pgmap v88: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:21.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:21 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/1108081159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:22.025 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-02-19T19:07:22.234 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:07:23.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:23 smithi096 ceph-mon[29216]: pgmap v89: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:23.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:23 smithi125 ceph-mon[37556]: pgmap v89: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:24.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.022+0000 7f2e2b616700 1 -- 172.21.15.96:0/429310566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e24105bd0 msgr2=0x7f2e24105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:24.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.022+0000 7f2e2b616700 1 --2- 172.21.15.96:0/429310566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e24105bd0 0x7f2e24105fb0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2e20009910 tx=0x7f2e20009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:24.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.022+0000 7f2e2b616700 1 -- 172.21.15.96:0/429310566 shutdown_connections 2024-02-19T19:07:24.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.022+0000 7f2e2b616700 1 --2- 172.21.15.96:0/429310566 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e240ffc20 0x7f2e24100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:24.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.022+0000 7f2e2b616700 1 --2- 172.21.15.96:0/429310566 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e24105bd0 0x7f2e24105fb0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:24.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.022+0000 7f2e2b616700 1 -- 172.21.15.96:0/429310566 >> 172.21.15.96:0/429310566 conn(0x7f2e24075670 msgr2=0x7f2e24075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:24.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.023+0000 7f2e2b616700 1 -- 172.21.15.96:0/429310566 shutdown_connections 2024-02-19T19:07:24.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.023+0000 7f2e2b616700 1 -- 172.21.15.96:0/429310566 wait complete. 2024-02-19T19:07:24.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.023+0000 7f2e2b616700 1 Processor -- start 2024-02-19T19:07:24.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.023+0000 7f2e2b616700 1 -- start start 2024-02-19T19:07:24.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.023+0000 7f2e2b616700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e240ffc20 0x7f2e2419e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:24.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.023+0000 7f2e2b616700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e24105bd0 0x7f2e2419ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:24.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.023+0000 7f2e2b616700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e241988c0 con 0x7f2e240ffc20 2024-02-19T19:07:24.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.023+0000 7f2e2b616700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e24198a30 con 0x7f2e24105bd0 2024-02-19T19:07:24.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.023+0000 7f2e293b2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e240ffc20 0x7f2e2419e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:24.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.024+0000 7f2e293b2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e240ffc20 0x7f2e2419e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42550/0 (socket says 172.21.15.96:42550) 2024-02-19T19:07:24.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.024+0000 7f2e293b2700 1 -- 172.21.15.96:0/3840896393 learned_addr learned my addr 172.21.15.96:0/3840896393 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:07:24.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.024+0000 7f2e28bb1700 1 --2- 172.21.15.96:0/3840896393 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e24105bd0 0x7f2e2419ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:24.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.024+0000 7f2e293b2700 1 -- 172.21.15.96:0/3840896393 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e24105bd0 msgr2=0x7f2e2419ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:24.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.024+0000 7f2e293b2700 1 --2- 172.21.15.96:0/3840896393 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e24105bd0 0x7f2e2419ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:24.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.024+0000 7f2e293b2700 1 -- 172.21.15.96:0/3840896393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e200095f0 con 0x7f2e240ffc20 2024-02-19T19:07:24.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.024+0000 7f2e293b2700 1 --2- 172.21.15.96:0/3840896393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e240ffc20 0x7f2e2419e8d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2e20006010 tx=0x7f2e2000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:24.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.024+0000 7f2e1a7fc700 1 -- 172.21.15.96:0/3840896393 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e2001d070 con 0x7f2e240ffc20 2024-02-19T19:07:24.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.024+0000 7f2e1a7fc700 1 -- 172.21.15.96:0/3840896393 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2e20005dc0 con 0x7f2e240ffc20 2024-02-19T19:07:24.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.024+0000 7f2e2b616700 1 -- 172.21.15.96:0/3840896393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e24198cb0 con 0x7f2e240ffc20 2024-02-19T19:07:24.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.024+0000 7f2e1a7fc700 1 -- 172.21.15.96:0/3840896393 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e20017400 con 0x7f2e240ffc20 2024-02-19T19:07:24.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.024+0000 7f2e2b616700 1 -- 172.21.15.96:0/3840896393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e241991a0 con 0x7f2e240ffc20 2024-02-19T19:07:24.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.025+0000 7f2e2b616700 1 -- 172.21.15.96:0/3840896393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2404f2e0 con 0x7f2e240ffc20 2024-02-19T19:07:24.047 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.026+0000 7f2e1a7fc700 1 -- 172.21.15.96:0/3840896393 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f2e20003a60 con 0x7f2e240ffc20 2024-02-19T19:07:24.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.026+0000 7f2e1a7fc700 1 --2- 172.21.15.96:0/3840896393 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f2e1006d520 0x7f2e1006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:24.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.026+0000 7f2e1a7fc700 1 -- 172.21.15.96:0/3840896393 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f2e2008e410 con 0x7f2e240ffc20 2024-02-19T19:07:24.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.026+0000 7f2e28bb1700 1 --2- 172.21.15.96:0/3840896393 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f2e1006d520 0x7f2e1006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:24.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.026+0000 7f2e28bb1700 1 --2- 172.21.15.96:0/3840896393 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f2e1006d520 0x7f2e1006f9e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2e2419a0f0 tx=0x7f2e1400b410 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:24.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.030+0000 7f2e1a7fc700 1 -- 172.21.15.96:0/3840896393 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f2e200580f0 con 0x7f2e240ffc20 2024-02-19T19:07:24.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.314+0000 7f2e2b616700 1 -- 172.21.15.96:0/3840896393 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2e241993c0 con 0x7f2e240ffc20 2024-02-19T19:07:24.335 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.315+0000 7f2e1a7fc700 1 -- 172.21.15.96:0/3840896393 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f2e2005b7b0 con 0x7f2e240ffc20 2024-02-19T19:07:24.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.317+0000 7f2e2b616700 1 -- 172.21.15.96:0/3840896393 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f2e1006d520 msgr2=0x7f2e1006f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:24.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.317+0000 7f2e2b616700 1 --2- 172.21.15.96:0/3840896393 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f2e1006d520 0x7f2e1006f9e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2e2419a0f0 tx=0x7f2e1400b410 comp rx=0 tx=0).stop 2024-02-19T19:07:24.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.317+0000 7f2e2b616700 1 -- 172.21.15.96:0/3840896393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e240ffc20 msgr2=0x7f2e2419e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:24.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.317+0000 7f2e2b616700 1 --2- 172.21.15.96:0/3840896393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e240ffc20 0x7f2e2419e8d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2e20006010 tx=0x7f2e2000bd70 comp rx=0 tx=0).stop 2024-02-19T19:07:24.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.317+0000 7f2e2b616700 1 -- 172.21.15.96:0/3840896393 shutdown_connections 2024-02-19T19:07:24.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.317+0000 7f2e2b616700 1 --2- 172.21.15.96:0/3840896393 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f2e1006d520 0x7f2e1006f9e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:24.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.317+0000 7f2e2b616700 1 --2- 172.21.15.96:0/3840896393 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e240ffc20 0x7f2e2419e8d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:24.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.317+0000 7f2e2b616700 1 --2- 172.21.15.96:0/3840896393 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e24105bd0 0x7f2e2419ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:24.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.317+0000 7f2e2b616700 1 -- 172.21.15.96:0/3840896393 >> 172.21.15.96:0/3840896393 conn(0x7f2e24075670 msgr2=0x7f2e240fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:24.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.317+0000 7f2e2b616700 1 -- 172.21.15.96:0/3840896393 shutdown_connections 2024-02-19T19:07:24.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:24.317+0000 7f2e2b616700 1 -- 172.21.15.96:0/3840896393 wait complete. 2024-02-19T19:07:24.348 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:07:24.704 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:24 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/3840896393' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:24.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:24 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/3840896393' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:25.136 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-02-19T19:07:25.345 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:07:25.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:25 smithi096 ceph-mon[29216]: pgmap v90: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:25.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:25 smithi125 ceph-mon[37556]: pgmap v90: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:27.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.226+0000 7f871acc0700 1 -- 172.21.15.96:0/2685199433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87141027c0 msgr2=0x7f871410acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:27.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.226+0000 7f871acc0700 1 --2- 172.21.15.96:0/2685199433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87141027c0 0x7f871410acb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8700009910 tx=0x7f8700009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:27.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.226+0000 7f871acc0700 1 -- 172.21.15.96:0/2685199433 shutdown_connections 2024-02-19T19:07:27.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.226+0000 7f871acc0700 1 --2- 172.21.15.96:0/2685199433 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87141027c0 0x7f871410acb0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:27.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.226+0000 7f871acc0700 1 --2- 172.21.15.96:0/2685199433 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8714101ea0 0x7f8714102280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:27.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.226+0000 7f871acc0700 1 -- 172.21.15.96:0/2685199433 >> 172.21.15.96:0/2685199433 conn(0x7f87140fb650 msgr2=0x7f87140fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:27.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.226+0000 7f871acc0700 1 -- 172.21.15.96:0/2685199433 shutdown_connections 2024-02-19T19:07:27.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.226+0000 7f871acc0700 1 -- 172.21.15.96:0/2685199433 wait complete. 2024-02-19T19:07:27.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.227+0000 7f871acc0700 1 Processor -- start 2024-02-19T19:07:27.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.227+0000 7f871acc0700 1 -- start start 2024-02-19T19:07:27.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.227+0000 7f871acc0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8714101ea0 0x7f871419e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:27.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.227+0000 7f871acc0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87141027c0 0x7f871419ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:27.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.227+0000 7f871acc0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871419f4f0 con 0x7f8714101ea0 2024-02-19T19:07:27.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.227+0000 7f871acc0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87141989a0 con 0x7f87141027c0 2024-02-19T19:07:27.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.227+0000 7f8718a5c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8714101ea0 0x7f871419e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:27.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.227+0000 7f8718a5c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8714101ea0 0x7f871419e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42578/0 (socket says 172.21.15.96:42578) 2024-02-19T19:07:27.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.227+0000 7f8718a5c700 1 -- 172.21.15.96:0/2568935063 learned_addr learned my addr 172.21.15.96:0/2568935063 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:07:27.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.227+0000 7f8713fff700 1 --2- 172.21.15.96:0/2568935063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87141027c0 0x7f871419ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:27.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.227+0000 7f8718a5c700 1 -- 172.21.15.96:0/2568935063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87141027c0 msgr2=0x7f871419ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:27.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.227+0000 7f8718a5c700 1 --2- 172.21.15.96:0/2568935063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87141027c0 0x7f871419ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:27.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.227+0000 7f8718a5c700 1 -- 172.21.15.96:0/2568935063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87000095f0 con 0x7f8714101ea0 2024-02-19T19:07:27.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.228+0000 7f8718a5c700 1 --2- 172.21.15.96:0/2568935063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8714101ea0 0x7f871419e920 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f870800b4b0 tx=0x7f870800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:27.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.228+0000 7f8711ffb700 1 -- 172.21.15.96:0/2568935063 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8708011800 con 0x7f8714101ea0 2024-02-19T19:07:27.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.228+0000 7f8711ffb700 1 -- 172.21.15.96:0/2568935063 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8708011e20 con 0x7f8714101ea0 2024-02-19T19:07:27.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.228+0000 7f871acc0700 1 -- 172.21.15.96:0/2568935063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8714198c80 con 0x7f8714101ea0 2024-02-19T19:07:27.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.228+0000 7f8711ffb700 1 -- 172.21.15.96:0/2568935063 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f870800f2e0 con 0x7f8714101ea0 2024-02-19T19:07:27.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.228+0000 7f871acc0700 1 -- 172.21.15.96:0/2568935063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87141991d0 con 0x7f8714101ea0 2024-02-19T19:07:27.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.229+0000 7f871acc0700 1 -- 172.21.15.96:0/2568935063 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871410a7a0 con 0x7f8714101ea0 2024-02-19T19:07:27.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.230+0000 7f8711ffb700 1 -- 172.21.15.96:0/2568935063 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f8708010380 con 0x7f8714101ea0 2024-02-19T19:07:27.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.230+0000 7f8711ffb700 1 --2- 172.21.15.96:0/2568935063 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f870406d520 0x7f870406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:27.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.230+0000 7f8711ffb700 1 -- 172.21.15.96:0/2568935063 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f870808cb30 con 0x7f8714101ea0 2024-02-19T19:07:27.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.230+0000 7f8713fff700 1 --2- 172.21.15.96:0/2568935063 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f870406d520 0x7f870406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:27.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.230+0000 7f8713fff700 1 --2- 172.21.15.96:0/2568935063 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f870406d520 0x7f870406f9e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f87140fcec0 tx=0x7f870001a040 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:27.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.234+0000 7f8711ffb700 1 -- 172.21.15.96:0/2568935063 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f870805a340 con 0x7f8714101ea0 2024-02-19T19:07:27.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:27.449+0000 7f871acc0700 1 -- 172.21.15.96:0/2568935063 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}) v1 -- 0x7f8714199450 con 0x7f870406d520 2024-02-19T19:07:27.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:27 smithi096 ceph-mon[29216]: pgmap v91: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:27.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:27 smithi125 ceph-mon[37556]: pgmap v91: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:28.656 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:28 smithi096 ceph-mon[29216]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:28.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:28 smithi125 ceph-mon[37556]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:29.631 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:29 smithi096 ceph-mon[29216]: pgmap v92: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:29.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:29.670+0000 7f8711ffb700 1 -- 172.21.15.96:0/2568935063 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5391 (secure 0 0 0) 0x7f8714199450 con 0x7f870406d520 2024-02-19T19:07:29.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:29.672+0000 7f871acc0700 1 -- 172.21.15.96:0/2568935063 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f870406d520 msgr2=0x7f870406f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:29.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:29.672+0000 7f871acc0700 1 --2- 172.21.15.96:0/2568935063 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f870406d520 0x7f870406f9e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f87140fcec0 tx=0x7f870001a040 comp rx=0 tx=0).stop 2024-02-19T19:07:29.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:29.672+0000 7f871acc0700 1 -- 172.21.15.96:0/2568935063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8714101ea0 msgr2=0x7f871419e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:29.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:29.672+0000 7f871acc0700 1 --2- 172.21.15.96:0/2568935063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8714101ea0 0x7f871419e920 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f870800b4b0 tx=0x7f870800b870 comp rx=0 tx=0).stop 2024-02-19T19:07:29.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:29.672+0000 7f871acc0700 1 -- 172.21.15.96:0/2568935063 shutdown_connections 2024-02-19T19:07:29.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:29.672+0000 7f871acc0700 1 --2- 172.21.15.96:0/2568935063 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f870406d520 0x7f870406f9e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:29.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:29.672+0000 7f871acc0700 1 --2- 172.21.15.96:0/2568935063 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8714101ea0 0x7f871419e920 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:29.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:29.672+0000 7f871acc0700 1 --2- 172.21.15.96:0/2568935063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f87141027c0 0x7f871419ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:29.693 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:29.672+0000 7f871acc0700 1 -- 172.21.15.96:0/2568935063 >> 172.21.15.96:0/2568935063 conn(0x7f87140fb650 msgr2=0x7f87141002c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:29.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:29.672+0000 7f871acc0700 1 -- 172.21.15.96:0/2568935063 shutdown_connections 2024-02-19T19:07:29.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:29.672+0000 7f871acc0700 1 -- 172.21.15.96:0/2568935063 wait complete. 2024-02-19T19:07:29.703 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:07:29.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:29 smithi125 ceph-mon[37556]: pgmap v92: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:30.374 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch ps' 2024-02-19T19:07:30.588 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:07:30.711 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:30 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:07:30.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:30 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:07:31.926 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:31 smithi096 ceph-mon[29216]: pgmap v93: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:31.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:31 smithi125 ceph-mon[37556]: pgmap v93: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:32.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.389+0000 7fda2020b700 1 -- 172.21.15.96:0/1576533698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda18102720 msgr2=0x7fda1810ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:32.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.389+0000 7fda2020b700 1 --2- 172.21.15.96:0/1576533698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda18102720 0x7fda1810ac10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fda08009910 tx=0x7fda08009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:32.411 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.389+0000 7fda2020b700 1 -- 172.21.15.96:0/1576533698 shutdown_connections 2024-02-19T19:07:32.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.389+0000 7fda2020b700 1 --2- 172.21.15.96:0/1576533698 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda18102720 0x7fda1810ac10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:32.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.389+0000 7fda2020b700 1 --2- 172.21.15.96:0/1576533698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda18101e00 0x7fda181021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:32.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.389+0000 7fda2020b700 1 -- 172.21.15.96:0/1576533698 >> 172.21.15.96:0/1576533698 conn(0x7fda180fb650 msgr2=0x7fda180fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:32.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.389+0000 7fda2020b700 1 -- 172.21.15.96:0/1576533698 shutdown_connections 2024-02-19T19:07:32.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.389+0000 7fda2020b700 1 -- 172.21.15.96:0/1576533698 wait complete. 2024-02-19T19:07:32.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.389+0000 7fda2020b700 1 Processor -- start 2024-02-19T19:07:32.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.390+0000 7fda2020b700 1 -- start start 2024-02-19T19:07:32.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.390+0000 7fda2020b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda18101e00 0x7fda1819e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:32.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.390+0000 7fda2020b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda18102720 0x7fda1819eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:32.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.390+0000 7fda2020b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1819f550 con 0x7fda18102720 2024-02-19T19:07:32.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.390+0000 7fda2020b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda18198a00 con 0x7fda18101e00 2024-02-19T19:07:32.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.390+0000 7fda1d7a6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda18102720 0x7fda1819eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:32.412 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.390+0000 7fda1d7a6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda18102720 0x7fda1819eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42592/0 (socket says 172.21.15.96:42592) 2024-02-19T19:07:32.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.390+0000 7fda1d7a6700 1 -- 172.21.15.96:0/1206458991 learned_addr learned my addr 172.21.15.96:0/1206458991 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:07:32.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.390+0000 7fda1d7a6700 1 -- 172.21.15.96:0/1206458991 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda18101e00 msgr2=0x7fda1819e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:32.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.390+0000 7fda1dfa7700 1 --2- 172.21.15.96:0/1206458991 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda18101e00 0x7fda1819e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:32.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.390+0000 7fda1d7a6700 1 --2- 172.21.15.96:0/1206458991 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda18101e00 0x7fda1819e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:32.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.390+0000 7fda1d7a6700 1 -- 172.21.15.96:0/1206458991 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda080095f0 con 0x7fda18102720 2024-02-19T19:07:32.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.390+0000 7fda1dfa7700 1 --2- 172.21.15.96:0/1206458991 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda18101e00 0x7fda1819e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:07:32.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.390+0000 7fda1d7a6700 1 --2- 172.21.15.96:0/1206458991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda18102720 0x7fda1819eec0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fda0800bd70 tx=0x7fda0800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:32.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.390+0000 7fda0effd700 1 -- 172.21.15.96:0/1206458991 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda0801d070 con 0x7fda18102720 2024-02-19T19:07:32.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.390+0000 7fda0effd700 1 -- 172.21.15.96:0/1206458991 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda0800f460 con 0x7fda18102720 2024-02-19T19:07:32.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.390+0000 7fda2020b700 1 -- 172.21.15.96:0/1206458991 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda18198c80 con 0x7fda18102720 2024-02-19T19:07:32.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.391+0000 7fda0effd700 1 -- 172.21.15.96:0/1206458991 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda08017630 con 0x7fda18102720 2024-02-19T19:07:32.413 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.391+0000 7fda2020b700 1 -- 172.21.15.96:0/1206458991 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda18199170 con 0x7fda18102720 2024-02-19T19:07:32.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.392+0000 7fda2020b700 1 -- 172.21.15.96:0/1206458991 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1810a770 con 0x7fda18102720 2024-02-19T19:07:32.414 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.392+0000 7fda0effd700 1 -- 172.21.15.96:0/1206458991 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7fda0800f5d0 con 0x7fda18102720 2024-02-19T19:07:32.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.392+0000 7fda0effd700 1 --2- 172.21.15.96:0/1206458991 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fda0406d520 0x7fda0406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:32.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.392+0000 7fda0effd700 1 -- 172.21.15.96:0/1206458991 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fda0808e490 con 0x7fda18102720 2024-02-19T19:07:32.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.392+0000 7fda1dfa7700 1 --2- 172.21.15.96:0/1206458991 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fda0406d520 0x7fda0406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:32.415 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.393+0000 7fda1dfa7700 1 --2- 172.21.15.96:0/1206458991 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fda0406d520 0x7fda0406f9e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fda14007900 tx=0x7fda14008040 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:32.417 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.397+0000 7fda0effd700 1 -- 172.21.15.96:0/1206458991 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fda0805bd20 con 0x7fda18102720 2024-02-19T19:07:32.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.600+0000 7fda2020b700 1 -- 172.21.15.96:0/1206458991 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fda181993e0 con 0x7fda0406d520 2024-02-19T19:07:32.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.610+0000 7fda0effd700 1 -- 172.21.15.96:0/1206458991 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fda181993e0 con 0x7fda0406d520 2024-02-19T19:07:32.631 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:07:32.632 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (106s) 50s ago 11m 15.8M - 0.25.0 c8568f914cd2 bbaf83a1e476 2024-02-19T19:07:32.632 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (11m) 50s ago 11m 7948k - 18.2.1 94eadd990e0a b41bff2e0043 2024-02-19T19:07:32.632 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (10m) 2m ago 10m 7721k - 18.2.1 94eadd990e0a 254ab7e7a040 2024-02-19T19:07:32.632 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (11m) 50s ago 11m 6665k - 18.2.1 94eadd990e0a 9250aadb9d78 2024-02-19T19:07:32.632 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (10m) 2m ago 10m 6665k - 18.2.1 94eadd990e0a b98ace7b5ded 2024-02-19T19:07:32.632 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (62s) 50s ago 11m 67.5M - 9.4.12 a0ea5e3c46d9 0102d90938e4 2024-02-19T19:07:32.632 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (5m) 50s ago 5m 26.8M - 18.2.1 94eadd990e0a 0a61d9cd40d1 2024-02-19T19:07:32.632 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (5m) 50s ago 5m 24.0M - 18.2.1 94eadd990e0a 58db3e7a7d75 2024-02-19T19:07:32.632 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (5m) 2m ago 5m 25.1M - 18.2.1 94eadd990e0a 211d64de8a63 2024-02-19T19:07:32.632 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (5m) 2m ago 5m 22.7M - 18.2.1 94eadd990e0a 2a04b5a8eaf4 2024-02-19T19:07:32.632 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:8443,9283,8765 running (3m) 50s ago 12m 503M - 19.0.0-1450-gf78a58c0 f081f847070a a86fbe94fe3f 2024-02-19T19:07:32.632 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (2m) 2m ago 10m 449M - 19.0.0-1450-gf78a58c0 f081f847070a e250486d572d 2024-02-19T19:07:32.633 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (12m) 50s ago 12m 56.2M 2048M 18.2.1 94eadd990e0a 23d5b9626c48 2024-02-19T19:07:32.633 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (10m) 2m ago 10m 43.8M 2048M 18.2.1 94eadd990e0a 27b4cad04cc5 2024-02-19T19:07:32.633 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2m) 50s ago 11m 15.5M - 1.5.0 0da6a335fe13 51f622ea33d6 2024-02-19T19:07:32.633 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (2m) 2m ago 10m 3590k - 1.5.0 0da6a335fe13 464e076a52a1 2024-02-19T19:07:32.633 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (9m) 50s ago 9m 50.3M 1216M 18.2.1 94eadd990e0a d5bbf07ad0e7 2024-02-19T19:07:32.633 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (8m) 50s ago 8m 50.2M 1216M 18.2.1 94eadd990e0a 40329d59be45 2024-02-19T19:07:32.633 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (8m) 50s ago 8m 48.6M 1216M 18.2.1 94eadd990e0a 4f1e49db2d41 2024-02-19T19:07:32.633 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (8m) 2m ago 8m 49.8M 2240M 18.2.1 94eadd990e0a 4746b79351fc 2024-02-19T19:07:32.633 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (7m) 2m ago 7m 49.4M 2240M 18.2.1 94eadd990e0a 2b3f0088f6b2 2024-02-19T19:07:32.633 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (7m) 2m ago 7m 46.0M 2240M 18.2.1 94eadd990e0a e5731974b46a 2024-02-19T19:07:32.633 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2m) 50s ago 10m 51.9M - 2.43.0 a07b618ecd1d a4edcf6ed669 2024-02-19T19:07:32.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.612+0000 7fda2020b700 1 -- 172.21.15.96:0/1206458991 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fda0406d520 msgr2=0x7fda0406f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:32.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.612+0000 7fda2020b700 1 --2- 172.21.15.96:0/1206458991 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fda0406d520 0x7fda0406f9e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fda14007900 tx=0x7fda14008040 comp rx=0 tx=0).stop 2024-02-19T19:07:32.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.612+0000 7fda2020b700 1 -- 172.21.15.96:0/1206458991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda18102720 msgr2=0x7fda1819eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:32.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.612+0000 7fda2020b700 1 --2- 172.21.15.96:0/1206458991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda18102720 0x7fda1819eec0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fda0800bd70 tx=0x7fda0800be50 comp rx=0 tx=0).stop 2024-02-19T19:07:32.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.613+0000 7fda2020b700 1 -- 172.21.15.96:0/1206458991 shutdown_connections 2024-02-19T19:07:32.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.613+0000 7fda2020b700 1 --2- 172.21.15.96:0/1206458991 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda18101e00 0x7fda1819e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:32.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.613+0000 7fda2020b700 1 --2- 172.21.15.96:0/1206458991 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fda0406d520 0x7fda0406f9e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:32.634 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.613+0000 7fda2020b700 1 --2- 172.21.15.96:0/1206458991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda18102720 0x7fda1819eec0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:32.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.613+0000 7fda2020b700 1 -- 172.21.15.96:0/1206458991 >> 172.21.15.96:0/1206458991 conn(0x7fda180fb650 msgr2=0x7fda18100220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:32.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.613+0000 7fda2020b700 1 -- 172.21.15.96:0/1206458991 shutdown_connections 2024-02-19T19:07:32.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:32.613+0000 7fda2020b700 1 -- 172.21.15.96:0/1206458991 wait complete. 2024-02-19T19:07:33.337 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-19T19:07:33.338 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi096.front.sepia.ceph.com 2024-02-19T19:07:33.338 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-02-19T19:07:33.551 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:07:33.672 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:33 smithi096 ceph-mon[29216]: pgmap v94: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:33.672 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:33 smithi096 ceph-mon[29216]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:33.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:33 smithi125 ceph-mon[37556]: pgmap v94: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:33.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:33 smithi125 ceph-mon[37556]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:35.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.234+0000 7f0a84349700 1 -- 172.21.15.96:0/2372062621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a7c101e60 msgr2=0x7f0a7c102240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.234+0000 7f0a84349700 1 --2- 172.21.15.96:0/2372062621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a7c101e60 0x7f0a7c102240 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0a78009940 tx=0x7f0a78009c50 comp rx=0 tx=0).stop 2024-02-19T19:07:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.234+0000 7f0a84349700 1 -- 172.21.15.96:0/2372062621 shutdown_connections 2024-02-19T19:07:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.234+0000 7f0a84349700 1 --2- 172.21.15.96:0/2372062621 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a7c102780 0x7f0a7c10ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.234+0000 7f0a84349700 1 --2- 172.21.15.96:0/2372062621 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a7c101e60 0x7f0a7c102240 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.234+0000 7f0a84349700 1 -- 172.21.15.96:0/2372062621 >> 172.21.15.96:0/2372062621 conn(0x7f0a7c0fb610 msgr2=0x7f0a7c0fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.234+0000 7f0a84349700 1 -- 172.21.15.96:0/2372062621 shutdown_connections 2024-02-19T19:07:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.234+0000 7f0a84349700 1 -- 172.21.15.96:0/2372062621 wait complete. 2024-02-19T19:07:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.234+0000 7f0a84349700 1 Processor -- start 2024-02-19T19:07:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.234+0000 7f0a84349700 1 -- start start 2024-02-19T19:07:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.235+0000 7f0a84349700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a7c101e60 0x7f0a7c1969d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.235+0000 7f0a84349700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a7c102780 0x7f0a7c196f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.235+0000 7f0a84349700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c1975a0 con 0x7f0a7c102780 2024-02-19T19:07:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.235+0000 7f0a84349700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7c19b360 con 0x7f0a7c101e60 2024-02-19T19:07:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.235+0000 7f0a818e4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a7c102780 0x7f0a7c196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:35.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.235+0000 7f0a818e4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a7c102780 0x7f0a7c196f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57080/0 (socket says 172.21.15.96:57080) 2024-02-19T19:07:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.235+0000 7f0a818e4700 1 -- 172.21.15.96:0/1065773264 learned_addr learned my addr 172.21.15.96:0/1065773264 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:07:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.235+0000 7f0a820e5700 1 --2- 172.21.15.96:0/1065773264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a7c101e60 0x7f0a7c1969d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.235+0000 7f0a818e4700 1 -- 172.21.15.96:0/1065773264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a7c101e60 msgr2=0x7f0a7c1969d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.235+0000 7f0a818e4700 1 --2- 172.21.15.96:0/1065773264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a7c101e60 0x7f0a7c1969d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.235+0000 7f0a818e4700 1 -- 172.21.15.96:0/1065773264 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a780095f0 con 0x7f0a7c102780 2024-02-19T19:07:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.235+0000 7f0a818e4700 1 --2- 172.21.15.96:0/1065773264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a7c102780 0x7f0a7c196f10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00b480 tx=0x7f0a6c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.235+0000 7f0a737fe700 1 -- 172.21.15.96:0/1065773264 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a6c011800 con 0x7f0a7c102780 2024-02-19T19:07:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.235+0000 7f0a84349700 1 -- 172.21.15.96:0/1065773264 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a7c19b640 con 0x7f0a7c102780 2024-02-19T19:07:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.236+0000 7f0a737fe700 1 -- 172.21.15.96:0/1065773264 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0a6c011e20 con 0x7f0a7c102780 2024-02-19T19:07:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.236+0000 7f0a737fe700 1 -- 172.21.15.96:0/1065773264 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a6c010ea0 con 0x7f0a7c102780 2024-02-19T19:07:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.236+0000 7f0a84349700 1 -- 172.21.15.96:0/1065773264 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7c19bb90 con 0x7f0a7c102780 2024-02-19T19:07:35.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.237+0000 7f0a84349700 1 -- 172.21.15.96:0/1065773264 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a60005320 con 0x7f0a7c102780 2024-02-19T19:07:35.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.237+0000 7f0a737fe700 1 -- 172.21.15.96:0/1065773264 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f0a6c011960 con 0x7f0a7c102780 2024-02-19T19:07:35.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.237+0000 7f0a737fe700 1 --2- 172.21.15.96:0/1065773264 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f0a6806d520 0x7f0a6806f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:35.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.237+0000 7f0a737fe700 1 -- 172.21.15.96:0/1065773264 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f0a6c08c980 con 0x7f0a7c102780 2024-02-19T19:07:35.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.238+0000 7f0a820e5700 1 --2- 172.21.15.96:0/1065773264 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f0a6806d520 0x7f0a6806f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:35.259 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.238+0000 7f0a820e5700 1 --2- 172.21.15.96:0/1065773264 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f0a6806d520 0x7f0a6806f9e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0a78006010 tx=0x7f0a7800b790 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:35.262 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.242+0000 7f0a737fe700 1 -- 172.21.15.96:0/1065773264 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f0a6c05a190 con 0x7f0a7c102780 2024-02-19T19:07:35.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.438+0000 7f0a84349700 1 -- 172.21.15.96:0/1065773264 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f0a60005f70 con 0x7f0a7c102780 2024-02-19T19:07:35.463 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.443+0000 7f0a737fe700 1 -- 172.21.15.96:0/1065773264 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v44)=0 v44) v1 ==== 125+0+0 (secure 0 0 0) 0x7f0a6c059d20 con 0x7f0a7c102780 2024-02-19T19:07:35.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.445+0000 7f0a84349700 1 -- 172.21.15.96:0/1065773264 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f0a6806d520 msgr2=0x7f0a6806f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:35.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.445+0000 7f0a84349700 1 --2- 172.21.15.96:0/1065773264 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f0a6806d520 0x7f0a6806f9e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0a78006010 tx=0x7f0a7800b790 comp rx=0 tx=0).stop 2024-02-19T19:07:35.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.445+0000 7f0a84349700 1 -- 172.21.15.96:0/1065773264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a7c102780 msgr2=0x7f0a7c196f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:35.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.445+0000 7f0a84349700 1 --2- 172.21.15.96:0/1065773264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a7c102780 0x7f0a7c196f10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00b480 tx=0x7f0a6c00b790 comp rx=0 tx=0).stop 2024-02-19T19:07:35.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.445+0000 7f0a84349700 1 -- 172.21.15.96:0/1065773264 shutdown_connections 2024-02-19T19:07:35.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.445+0000 7f0a84349700 1 --2- 172.21.15.96:0/1065773264 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a7c101e60 0x7f0a7c1969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:35.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.445+0000 7f0a84349700 1 --2- 172.21.15.96:0/1065773264 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f0a6806d520 0x7f0a6806f9e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:35.466 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.445+0000 7f0a84349700 1 --2- 172.21.15.96:0/1065773264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a7c102780 0x7f0a7c196f10 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:35.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.445+0000 7f0a84349700 1 -- 172.21.15.96:0/1065773264 >> 172.21.15.96:0/1065773264 conn(0x7f0a7c0fb610 msgr2=0x7f0a7c1054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:35.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.445+0000 7f0a84349700 1 -- 172.21.15.96:0/1065773264 shutdown_connections 2024-02-19T19:07:35.467 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:35.445+0000 7f0a84349700 1 -- 172.21.15.96:0/1065773264 wait complete. 2024-02-19T19:07:35.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:35 smithi096 ceph-mon[29216]: pgmap v95: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:35.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:35 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/1065773264' entity='client.admin' 2024-02-19T19:07:35.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:35 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:07:35.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:35 smithi125 ceph-mon[37556]: pgmap v95: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:35.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:35 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/1065773264' entity='client.admin' 2024-02-19T19:07:35.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:35 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:07:36.186 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-19T19:07:36.187 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi096.front.sepia.ceph.com 2024-02-19T19:07:36.187 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-19T19:07:36.397 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:07:37.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:36 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:07:37.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:36 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:07:37.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:36 smithi096 ceph-mon[29216]: pgmap v96: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:37.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:36 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:07:37.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:36 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:07:37.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:36 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:07:37.451 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:36 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:07:37.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:36 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:07:37.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:36 smithi125 ceph-mon[37556]: pgmap v96: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:37.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:36 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:07:37.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:36 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:07:37.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:36 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:07:38.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.119+0000 7fd0db1c3700 1 -- 172.21.15.96:0/1363407352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0d4105350 msgr2=0x7fd0d4105730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:38.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.119+0000 7fd0db1c3700 1 --2- 172.21.15.96:0/1363407352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0d4105350 0x7fd0d4105730 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8009910 tx=0x7fd0c8009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:38.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.119+0000 7fd0db1c3700 1 -- 172.21.15.96:0/1363407352 shutdown_connections 2024-02-19T19:07:38.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.119+0000 7fd0db1c3700 1 --2- 172.21.15.96:0/1363407352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0d40ff340 0x7fd0d40ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:38.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.119+0000 7fd0db1c3700 1 --2- 172.21.15.96:0/1363407352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0d4105350 0x7fd0d4105730 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:38.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.119+0000 7fd0db1c3700 1 -- 172.21.15.96:0/1363407352 >> 172.21.15.96:0/1363407352 conn(0x7fd0d4074e30 msgr2=0x7fd0d4075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:38.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.120+0000 7fd0db1c3700 1 -- 172.21.15.96:0/1363407352 shutdown_connections 2024-02-19T19:07:38.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.120+0000 7fd0db1c3700 1 -- 172.21.15.96:0/1363407352 wait complete. 2024-02-19T19:07:38.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.120+0000 7fd0db1c3700 1 Processor -- start 2024-02-19T19:07:38.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.120+0000 7fd0db1c3700 1 -- start start 2024-02-19T19:07:38.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.120+0000 7fd0db1c3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0d40ff340 0x7fd0d419c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:38.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.120+0000 7fd0db1c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0d4105350 0x7fd0d419cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:38.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.120+0000 7fd0db1c3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d419d160 con 0x7fd0d4105350 2024-02-19T19:07:38.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.120+0000 7fd0db1c3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d41966a0 con 0x7fd0d40ff340 2024-02-19T19:07:38.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.120+0000 7fd0d3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0d4105350 0x7fd0d419cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:38.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.121+0000 7fd0d3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0d4105350 0x7fd0d419cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57084/0 (socket says 172.21.15.96:57084) 2024-02-19T19:07:38.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.121+0000 7fd0d3fff700 1 -- 172.21.15.96:0/2007862547 learned_addr learned my addr 172.21.15.96:0/2007862547 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:07:38.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.121+0000 7fd0d8f5f700 1 --2- 172.21.15.96:0/2007862547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0d40ff340 0x7fd0d419c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:38.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.121+0000 7fd0d3fff700 1 -- 172.21.15.96:0/2007862547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0d40ff340 msgr2=0x7fd0d419c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:38.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.121+0000 7fd0d3fff700 1 --2- 172.21.15.96:0/2007862547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0d40ff340 0x7fd0d419c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:38.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.121+0000 7fd0d3fff700 1 -- 172.21.15.96:0/2007862547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c80095f0 con 0x7fd0d4105350 2024-02-19T19:07:38.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.121+0000 7fd0d3fff700 1 --2- 172.21.15.96:0/2007862547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0d4105350 0x7fd0d419cb60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd0c000c930 tx=0x7fd0c000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:38.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.121+0000 7fd0d1ffb700 1 -- 172.21.15.96:0/2007862547 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0c0007ad0 con 0x7fd0d4105350 2024-02-19T19:07:38.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.121+0000 7fd0d1ffb700 1 -- 172.21.15.96:0/2007862547 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd0c000ce80 con 0x7fd0d4105350 2024-02-19T19:07:38.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.121+0000 7fd0db1c3700 1 -- 172.21.15.96:0/2007862547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d4196980 con 0x7fd0d4105350 2024-02-19T19:07:38.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.121+0000 7fd0d1ffb700 1 -- 172.21.15.96:0/2007862547 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0c0018630 con 0x7fd0d4105350 2024-02-19T19:07:38.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.121+0000 7fd0db1c3700 1 -- 172.21.15.96:0/2007862547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d4196ed0 con 0x7fd0d4105350 2024-02-19T19:07:38.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.122+0000 7fd0db1c3700 1 -- 172.21.15.96:0/2007862547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d4109880 con 0x7fd0d4105350 2024-02-19T19:07:38.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.123+0000 7fd0d1ffb700 1 -- 172.21.15.96:0/2007862547 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7fd0c0007c30 con 0x7fd0d4105350 2024-02-19T19:07:38.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.123+0000 7fd0d1ffb700 1 --2- 172.21.15.96:0/2007862547 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fd0c406d520 0x7fd0c406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:38.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.123+0000 7fd0d1ffb700 1 -- 172.21.15.96:0/2007862547 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd0c008cfa0 con 0x7fd0d4105350 2024-02-19T19:07:38.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.123+0000 7fd0d8f5f700 1 --2- 172.21.15.96:0/2007862547 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fd0c406d520 0x7fd0c406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:38.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.123+0000 7fd0d8f5f700 1 --2- 172.21.15.96:0/2007862547 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fd0c406d520 0x7fd0c406f9e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8006010 tx=0x7fd0c801a040 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:38.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.128+0000 7fd0d1ffb700 1 -- 172.21.15.96:0/2007862547 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fd0c005a7b0 con 0x7fd0d4105350 2024-02-19T19:07:38.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.325+0000 7fd0db1c3700 1 -- 172.21.15.96:0/2007862547 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fd0d404f2e0 con 0x7fd0d4105350 2024-02-19T19:07:38.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.326+0000 7fd0d1ffb700 1 -- 172.21.15.96:0/2007862547 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v44)=0 v44) v1 ==== 155+0+0 (secure 0 0 0) 0x7fd0c005a340 con 0x7fd0d4105350 2024-02-19T19:07:38.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.328+0000 7fd0db1c3700 1 -- 172.21.15.96:0/2007862547 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fd0c406d520 msgr2=0x7fd0c406f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:38.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.328+0000 7fd0db1c3700 1 --2- 172.21.15.96:0/2007862547 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fd0c406d520 0x7fd0c406f9e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd0c8006010 tx=0x7fd0c801a040 comp rx=0 tx=0).stop 2024-02-19T19:07:38.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.328+0000 7fd0db1c3700 1 -- 172.21.15.96:0/2007862547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0d4105350 msgr2=0x7fd0d419cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:38.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.328+0000 7fd0db1c3700 1 --2- 172.21.15.96:0/2007862547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0d4105350 0x7fd0d419cb60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd0c000c930 tx=0x7fd0c000cc40 comp rx=0 tx=0).stop 2024-02-19T19:07:38.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.328+0000 7fd0db1c3700 1 -- 172.21.15.96:0/2007862547 shutdown_connections 2024-02-19T19:07:38.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.328+0000 7fd0db1c3700 1 --2- 172.21.15.96:0/2007862547 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0d40ff340 0x7fd0d419c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:38.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.328+0000 7fd0db1c3700 1 --2- 172.21.15.96:0/2007862547 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fd0c406d520 0x7fd0c406f9e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:38.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.328+0000 7fd0db1c3700 1 --2- 172.21.15.96:0/2007862547 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0d4105350 0x7fd0d419cb60 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:38.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.328+0000 7fd0db1c3700 1 -- 172.21.15.96:0/2007862547 >> 172.21.15.96:0/2007862547 conn(0x7fd0d4074e30 msgr2=0x7fd0d4103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:38.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.328+0000 7fd0db1c3700 1 -- 172.21.15.96:0/2007862547 shutdown_connections 2024-02-19T19:07:38.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:38.328+0000 7fd0db1c3700 1 -- 172.21.15.96:0/2007862547 wait complete. 2024-02-19T19:07:39.020 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-19T19:07:39.232 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:07:39.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:39 smithi096 ceph-mon[29216]: pgmap v97: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:39.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:39 smithi125 ceph-mon[37556]: pgmap v97: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:40.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.870+0000 7f3df441a700 1 -- 172.21.15.96:0/2923255419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dec0ffda0 msgr2=0x7f3dec100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:40.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.870+0000 7f3df441a700 1 --2- 172.21.15.96:0/2923255419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dec0ffda0 0x7f3dec100180 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3de8009910 tx=0x7f3de8009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:40.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.871+0000 7f3df441a700 1 -- 172.21.15.96:0/2923255419 shutdown_connections 2024-02-19T19:07:40.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.871+0000 7f3df441a700 1 --2- 172.21.15.96:0/2923255419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dec100750 0x7f3dec1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:40.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.871+0000 7f3df441a700 1 --2- 172.21.15.96:0/2923255419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dec0ffda0 0x7f3dec100180 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:40.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.871+0000 7f3df441a700 1 -- 172.21.15.96:0/2923255419 >> 172.21.15.96:0/2923255419 conn(0x7f3dec0fb650 msgr2=0x7f3dec0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:40.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.871+0000 7f3df441a700 1 -- 172.21.15.96:0/2923255419 shutdown_connections 2024-02-19T19:07:40.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.871+0000 7f3df441a700 1 -- 172.21.15.96:0/2923255419 wait complete. 2024-02-19T19:07:40.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.872+0000 7f3df441a700 1 Processor -- start 2024-02-19T19:07:40.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.872+0000 7f3df441a700 1 -- start start 2024-02-19T19:07:40.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.872+0000 7f3df441a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dec0ffda0 0x7f3dec19b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:40.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.872+0000 7f3df441a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dec100750 0x7f3dec19bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:40.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.872+0000 7f3df441a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec19c250 con 0x7f3dec0ffda0 2024-02-19T19:07:40.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.872+0000 7f3df441a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec195700 con 0x7f3dec100750 2024-02-19T19:07:40.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.872+0000 7f3df21b6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dec0ffda0 0x7f3dec19b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:40.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.872+0000 7f3df21b6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dec0ffda0 0x7f3dec19b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:57114/0 (socket says 172.21.15.96:57114) 2024-02-19T19:07:40.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.872+0000 7f3df21b6700 1 -- 172.21.15.96:0/3146183568 learned_addr learned my addr 172.21.15.96:0/3146183568 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:07:40.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.872+0000 7f3df19b5700 1 --2- 172.21.15.96:0/3146183568 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dec100750 0x7f3dec19bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:40.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.872+0000 7f3df21b6700 1 -- 172.21.15.96:0/3146183568 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dec100750 msgr2=0x7f3dec19bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:40.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.872+0000 7f3df21b6700 1 --2- 172.21.15.96:0/3146183568 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dec100750 0x7f3dec19bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:40.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.872+0000 7f3df21b6700 1 -- 172.21.15.96:0/3146183568 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de80095f0 con 0x7f3dec0ffda0 2024-02-19T19:07:40.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.872+0000 7f3df21b6700 1 --2- 172.21.15.96:0/3146183568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dec0ffda0 0x7f3dec19b680 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3de8006010 tx=0x7f3de800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:40.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.873+0000 7f3de37fe700 1 -- 172.21.15.96:0/3146183568 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3de801d070 con 0x7f3dec0ffda0 2024-02-19T19:07:40.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.873+0000 7f3de37fe700 1 -- 172.21.15.96:0/3146183568 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3de8004fb0 con 0x7f3dec0ffda0 2024-02-19T19:07:40.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.873+0000 7f3df441a700 1 -- 172.21.15.96:0/3146183568 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dec195980 con 0x7f3dec0ffda0 2024-02-19T19:07:40.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.873+0000 7f3df441a700 1 -- 172.21.15.96:0/3146183568 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dec195e70 con 0x7f3dec0ffda0 2024-02-19T19:07:40.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.873+0000 7f3de37fe700 1 -- 172.21.15.96:0/3146183568 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3de8022ea0 con 0x7f3dec0ffda0 2024-02-19T19:07:40.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.874+0000 7f3df441a700 1 -- 172.21.15.96:0/3146183568 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dec04f2e0 con 0x7f3dec0ffda0 2024-02-19T19:07:40.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.874+0000 7f3de37fe700 1 -- 172.21.15.96:0/3146183568 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f3de8004af0 con 0x7f3dec0ffda0 2024-02-19T19:07:40.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.875+0000 7f3de37fe700 1 --2- 172.21.15.96:0/3146183568 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f3dd806f730 0x7f3dd8071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:40.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.875+0000 7f3de37fe700 1 -- 172.21.15.96:0/3146183568 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f3de808e550 con 0x7f3dec0ffda0 2024-02-19T19:07:40.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.875+0000 7f3df19b5700 1 --2- 172.21.15.96:0/3146183568 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f3dd806f730 0x7f3dd8071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:40.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.875+0000 7f3df19b5700 1 --2- 172.21.15.96:0/3146183568 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f3dd806f730 0x7f3dd8071bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc006fd0 tx=0x7f3ddc008040 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:40.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:40.879+0000 7f3de37fe700 1 -- 172.21.15.96:0/3146183568 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f3de805bfb0 con 0x7f3dec0ffda0 2024-02-19T19:07:41.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:41.074+0000 7f3df441a700 1 -- 172.21.15.96:0/3146183568 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f3dec1960e0 con 0x7f3dec0ffda0 2024-02-19T19:07:41.095 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:41.074+0000 7f3de37fe700 1 -- 172.21.15.96:0/3146183568 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v44)=0 v44) v1 ==== 163+0+0 (secure 0 0 0) 0x7f3de805bb40 con 0x7f3dec0ffda0 2024-02-19T19:07:41.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:41.076+0000 7f3df441a700 1 -- 172.21.15.96:0/3146183568 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f3dd806f730 msgr2=0x7f3dd8071bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:41.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:41.076+0000 7f3df441a700 1 --2- 172.21.15.96:0/3146183568 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f3dd806f730 0x7f3dd8071bf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc006fd0 tx=0x7f3ddc008040 comp rx=0 tx=0).stop 2024-02-19T19:07:41.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:41.076+0000 7f3df441a700 1 -- 172.21.15.96:0/3146183568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dec0ffda0 msgr2=0x7f3dec19b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:41.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:41.076+0000 7f3df441a700 1 --2- 172.21.15.96:0/3146183568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dec0ffda0 0x7f3dec19b680 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3de8006010 tx=0x7f3de800be20 comp rx=0 tx=0).stop 2024-02-19T19:07:41.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:41.076+0000 7f3df441a700 1 -- 172.21.15.96:0/3146183568 shutdown_connections 2024-02-19T19:07:41.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:41.076+0000 7f3df441a700 1 --2- 172.21.15.96:0/3146183568 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f3dd806f730 0x7f3dd8071bf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:41.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:41.076+0000 7f3df441a700 1 --2- 172.21.15.96:0/3146183568 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3dec0ffda0 0x7f3dec19b680 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:41.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:41.076+0000 7f3df441a700 1 --2- 172.21.15.96:0/3146183568 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dec100750 0x7f3dec19bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:41.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:41.076+0000 7f3df441a700 1 -- 172.21.15.96:0/3146183568 >> 172.21.15.96:0/3146183568 conn(0x7f3dec0fb650 msgr2=0x7f3dec0fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:41.097 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:41.076+0000 7f3df441a700 1 -- 172.21.15.96:0/3146183568 shutdown_connections 2024-02-19T19:07:41.098 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:41.076+0000 7f3df441a700 1 -- 172.21.15.96:0/3146183568 wait complete. 2024-02-19T19:07:41.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:41 smithi096 ceph-mon[29216]: pgmap v98: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:41.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:41 smithi125 ceph-mon[37556]: pgmap v98: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:42.031 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-19T19:07:42.244 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:07:43.740 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:43 smithi096 ceph-mon[29216]: pgmap v99: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:43.803 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:43 smithi125 ceph-mon[37556]: pgmap v99: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:44.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.110+0000 7f2e07139700 1 -- 172.21.15.96:0/2539403482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e000ff5a0 msgr2=0x7f2e000ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:44.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.110+0000 7f2e07139700 1 --2- 172.21.15.96:0/2539403482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e000ff5a0 0x7f2e000ff980 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2df4009910 tx=0x7f2df4009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:44.133 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.110+0000 7f2e07139700 1 -- 172.21.15.96:0/2539403482 shutdown_connections 2024-02-19T19:07:44.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.110+0000 7f2e07139700 1 --2- 172.21.15.96:0/2539403482 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e000fff50 0x7f2e00105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:44.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.110+0000 7f2e07139700 1 --2- 172.21.15.96:0/2539403482 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e000ff5a0 0x7f2e000ff980 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:44.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.110+0000 7f2e07139700 1 -- 172.21.15.96:0/2539403482 >> 172.21.15.96:0/2539403482 conn(0x7f2e00074e30 msgr2=0x7f2e00075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:44.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.110+0000 7f2e07139700 1 -- 172.21.15.96:0/2539403482 shutdown_connections 2024-02-19T19:07:44.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.110+0000 7f2e07139700 1 -- 172.21.15.96:0/2539403482 wait complete. 2024-02-19T19:07:44.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.110+0000 7f2e07139700 1 Processor -- start 2024-02-19T19:07:44.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.110+0000 7f2e07139700 1 -- start start 2024-02-19T19:07:44.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.111+0000 7f2e07139700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e000ff5a0 0x7f2e00100520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:44.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.111+0000 7f2e07139700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e000fff50 0x7f2e00100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:44.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.111+0000 7f2e07139700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e00100fa0 con 0x7f2e000fff50 2024-02-19T19:07:44.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.111+0000 7f2e07139700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e001010e0 con 0x7f2e000ff5a0 2024-02-19T19:07:44.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.111+0000 7f2dfffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e000fff50 0x7f2e00100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:44.134 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.111+0000 7f2dfffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e000fff50 0x7f2e00100a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33336/0 (socket says 172.21.15.96:33336) 2024-02-19T19:07:44.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.111+0000 7f2dfffff700 1 -- 172.21.15.96:0/4006601971 learned_addr learned my addr 172.21.15.96:0/4006601971 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:07:44.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.111+0000 7f2e04ed5700 1 --2- 172.21.15.96:0/4006601971 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e000ff5a0 0x7f2e00100520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:44.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.111+0000 7f2dfffff700 1 -- 172.21.15.96:0/4006601971 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e000ff5a0 msgr2=0x7f2e00100520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:44.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.111+0000 7f2dfffff700 1 --2- 172.21.15.96:0/4006601971 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e000ff5a0 0x7f2e00100520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:44.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.111+0000 7f2dfffff700 1 -- 172.21.15.96:0/4006601971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df40095f0 con 0x7f2e000fff50 2024-02-19T19:07:44.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.111+0000 7f2dfffff700 1 --2- 172.21.15.96:0/4006601971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e000fff50 0x7f2e00100a60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00c8f0 tx=0x7f2dec00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:44.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.111+0000 7f2dfdffb700 1 -- 172.21.15.96:0/4006601971 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2dec0078a0 con 0x7f2e000fff50 2024-02-19T19:07:44.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.111+0000 7f2dfdffb700 1 -- 172.21.15.96:0/4006601971 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2dec00f450 con 0x7f2e000fff50 2024-02-19T19:07:44.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.112+0000 7f2e07139700 1 -- 172.21.15.96:0/4006601971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e001a2a80 con 0x7f2e000fff50 2024-02-19T19:07:44.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.112+0000 7f2dfdffb700 1 -- 172.21.15.96:0/4006601971 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2dec018610 con 0x7f2e000fff50 2024-02-19T19:07:44.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.112+0000 7f2e07139700 1 -- 172.21.15.96:0/4006601971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e001a2e90 con 0x7f2e000fff50 2024-02-19T19:07:44.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.113+0000 7f2e07139700 1 -- 172.21.15.96:0/4006601971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e00109270 con 0x7f2e000fff50 2024-02-19T19:07:44.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.113+0000 7f2dfdffb700 1 -- 172.21.15.96:0/4006601971 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f2dec00f5c0 con 0x7f2e000fff50 2024-02-19T19:07:44.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.113+0000 7f2dfdffb700 1 --2- 172.21.15.96:0/4006601971 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f2df006d520 0x7f2df006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:44.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.114+0000 7f2dfdffb700 1 -- 172.21.15.96:0/4006601971 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f2dec08ce60 con 0x7f2e000fff50 2024-02-19T19:07:44.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.114+0000 7f2e04ed5700 1 --2- 172.21.15.96:0/4006601971 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f2df006d520 0x7f2df006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:44.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.114+0000 7f2e04ed5700 1 --2- 172.21.15.96:0/4006601971 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f2df006d520 0x7f2df006f9e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2df4006010 tx=0x7f2df401a040 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:44.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.118+0000 7f2dfdffb700 1 -- 172.21.15.96:0/4006601971 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f2dec056bc0 con 0x7f2e000fff50 2024-02-19T19:07:44.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.312+0000 7f2e07139700 1 -- 172.21.15.96:0/4006601971 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f2e001012a0 con 0x7f2e000fff50 2024-02-19T19:07:44.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.312+0000 7f2dfdffb700 1 -- 172.21.15.96:0/4006601971 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v44)=0 v44) v1 ==== 135+0+0 (secure 0 0 0) 0x7f2dec05a280 con 0x7f2e000fff50 2024-02-19T19:07:44.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.314+0000 7f2e07139700 1 -- 172.21.15.96:0/4006601971 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f2df006d520 msgr2=0x7f2df006f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:44.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.314+0000 7f2e07139700 1 --2- 172.21.15.96:0/4006601971 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f2df006d520 0x7f2df006f9e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2df4006010 tx=0x7f2df401a040 comp rx=0 tx=0).stop 2024-02-19T19:07:44.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.314+0000 7f2e07139700 1 -- 172.21.15.96:0/4006601971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e000fff50 msgr2=0x7f2e00100a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:44.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.314+0000 7f2e07139700 1 --2- 172.21.15.96:0/4006601971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e000fff50 0x7f2e00100a60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00c8f0 tx=0x7f2dec00cc00 comp rx=0 tx=0).stop 2024-02-19T19:07:44.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.314+0000 7f2e07139700 1 -- 172.21.15.96:0/4006601971 shutdown_connections 2024-02-19T19:07:44.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.314+0000 7f2e07139700 1 --2- 172.21.15.96:0/4006601971 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2e000ff5a0 0x7f2e00100520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:44.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.314+0000 7f2e07139700 1 --2- 172.21.15.96:0/4006601971 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f2df006d520 0x7f2df006f9e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:44.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.314+0000 7f2e07139700 1 --2- 172.21.15.96:0/4006601971 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e000fff50 0x7f2e00100a60 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:44.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.314+0000 7f2e07139700 1 -- 172.21.15.96:0/4006601971 >> 172.21.15.96:0/4006601971 conn(0x7f2e00074e30 msgr2=0x7f2e000fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:44.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.314+0000 7f2e07139700 1 -- 172.21.15.96:0/4006601971 shutdown_connections 2024-02-19T19:07:44.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:44.314+0000 7f2e07139700 1 -- 172.21.15.96:0/4006601971 wait complete. 2024-02-19T19:07:45.012 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-02-19T19:07:45.229 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:07:45.609 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:45 smithi096 ceph-mon[29216]: pgmap v100: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:45.609 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:45 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:07:45.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:45 smithi125 ceph-mon[37556]: pgmap v100: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:45.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:45 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:07:46.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.890+0000 7fda49de8700 1 -- 172.21.15.96:0/1821486647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda440ffc20 msgr2=0x7fda44100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:46.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.890+0000 7fda49de8700 1 --2- 172.21.15.96:0/1821486647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda440ffc20 0x7fda44100080 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fda34009910 tx=0x7fda34009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:46.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.890+0000 7fda49de8700 1 -- 172.21.15.96:0/1821486647 shutdown_connections 2024-02-19T19:07:46.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.890+0000 7fda49de8700 1 --2- 172.21.15.96:0/1821486647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda440ffc20 0x7fda44100080 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:46.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.890+0000 7fda49de8700 1 --2- 172.21.15.96:0/1821486647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda44105bd0 0x7fda44105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:46.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.890+0000 7fda49de8700 1 -- 172.21.15.96:0/1821486647 >> 172.21.15.96:0/1821486647 conn(0x7fda44075670 msgr2=0x7fda44075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:46.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.890+0000 7fda49de8700 1 -- 172.21.15.96:0/1821486647 shutdown_connections 2024-02-19T19:07:46.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.890+0000 7fda49de8700 1 -- 172.21.15.96:0/1821486647 wait complete. 2024-02-19T19:07:46.913 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.891+0000 7fda49de8700 1 Processor -- start 2024-02-19T19:07:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.891+0000 7fda49de8700 1 -- start start 2024-02-19T19:07:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.891+0000 7fda49de8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda440ffc20 0x7fda4419c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.891+0000 7fda49de8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda44105bd0 0x7fda4419cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.891+0000 7fda49de8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4419d1f0 con 0x7fda44105bd0 2024-02-19T19:07:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.891+0000 7fda49de8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda441966a0 con 0x7fda440ffc20 2024-02-19T19:07:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.891+0000 7fda42ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda44105bd0 0x7fda4419cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.891+0000 7fda42ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda44105bd0 0x7fda4419cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33360/0 (socket says 172.21.15.96:33360) 2024-02-19T19:07:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.891+0000 7fda42ffd700 1 -- 172.21.15.96:0/330362310 learned_addr learned my addr 172.21.15.96:0/330362310 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:07:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.892+0000 7fda437fe700 1 --2- 172.21.15.96:0/330362310 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda440ffc20 0x7fda4419c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.892+0000 7fda42ffd700 1 -- 172.21.15.96:0/330362310 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda440ffc20 msgr2=0x7fda4419c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.892+0000 7fda42ffd700 1 --2- 172.21.15.96:0/330362310 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda440ffc20 0x7fda4419c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.892+0000 7fda42ffd700 1 -- 172.21.15.96:0/330362310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda340095f0 con 0x7fda44105bd0 2024-02-19T19:07:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.892+0000 7fda437fe700 1 --2- 172.21.15.96:0/330362310 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda440ffc20 0x7fda4419c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:07:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.892+0000 7fda42ffd700 1 --2- 172.21.15.96:0/330362310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda44105bd0 0x7fda4419cb60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fda34006010 tx=0x7fda3400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.892+0000 7fda40ff9700 1 -- 172.21.15.96:0/330362310 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda3401d070 con 0x7fda44105bd0 2024-02-19T19:07:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.892+0000 7fda40ff9700 1 -- 172.21.15.96:0/330362310 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda3400f460 con 0x7fda44105bd0 2024-02-19T19:07:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.892+0000 7fda49de8700 1 -- 172.21.15.96:0/330362310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda44196920 con 0x7fda44105bd0 2024-02-19T19:07:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.892+0000 7fda40ff9700 1 -- 172.21.15.96:0/330362310 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda34017630 con 0x7fda44105bd0 2024-02-19T19:07:46.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.892+0000 7fda49de8700 1 -- 172.21.15.96:0/330362310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda44196e10 con 0x7fda44105bd0 2024-02-19T19:07:46.916 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.893+0000 7fda49de8700 1 -- 172.21.15.96:0/330362310 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda4404f2e0 con 0x7fda44105bd0 2024-02-19T19:07:46.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.894+0000 7fda40ff9700 1 -- 172.21.15.96:0/330362310 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7fda3400f5d0 con 0x7fda44105bd0 2024-02-19T19:07:46.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.894+0000 7fda40ff9700 1 --2- 172.21.15.96:0/330362310 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fda2c06d520 0x7fda2c06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:46.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.894+0000 7fda40ff9700 1 -- 172.21.15.96:0/330362310 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fda3408e3c0 con 0x7fda44105bd0 2024-02-19T19:07:46.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.894+0000 7fda437fe700 1 --2- 172.21.15.96:0/330362310 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fda2c06d520 0x7fda2c06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:46.917 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.895+0000 7fda437fe700 1 --2- 172.21.15.96:0/330362310 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fda2c06d520 0x7fda2c06f9e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fda38005950 tx=0x7fda380058e0 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:46.920 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:46.899+0000 7fda40ff9700 1 -- 172.21.15.96:0/330362310 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fda3405bc50 con 0x7fda44105bd0 2024-02-19T19:07:47.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:47.108+0000 7fda49de8700 1 -- 172.21.15.96:0/330362310 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}) v1 -- 0x7fda441971b0 con 0x7fda2c06d520 2024-02-19T19:07:47.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:47.113+0000 7fda40ff9700 1 -- 172.21.15.96:0/330362310 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7fda441971b0 con 0x7fda2c06d520 2024-02-19T19:07:47.135 INFO:teuthology.orchestra.run.smithi096.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T19:07:47.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:47.115+0000 7fda49de8700 1 -- 172.21.15.96:0/330362310 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fda2c06d520 msgr2=0x7fda2c06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:47.137 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:47.115+0000 7fda49de8700 1 --2- 172.21.15.96:0/330362310 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fda2c06d520 0x7fda2c06f9e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fda38005950 tx=0x7fda380058e0 comp rx=0 tx=0).stop 2024-02-19T19:07:47.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:47.115+0000 7fda49de8700 1 -- 172.21.15.96:0/330362310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda44105bd0 msgr2=0x7fda4419cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:47.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:47.115+0000 7fda49de8700 1 --2- 172.21.15.96:0/330362310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda44105bd0 0x7fda4419cb60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fda34006010 tx=0x7fda3400be20 comp rx=0 tx=0).stop 2024-02-19T19:07:47.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:47.115+0000 7fda49de8700 1 -- 172.21.15.96:0/330362310 shutdown_connections 2024-02-19T19:07:47.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:47.115+0000 7fda49de8700 1 --2- 172.21.15.96:0/330362310 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fda440ffc20 0x7fda4419c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:47.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:47.115+0000 7fda49de8700 1 --2- 172.21.15.96:0/330362310 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fda2c06d520 0x7fda2c06f9e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:47.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:47.115+0000 7fda49de8700 1 --2- 172.21.15.96:0/330362310 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda44105bd0 0x7fda4419cb60 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:47.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:47.115+0000 7fda49de8700 1 -- 172.21.15.96:0/330362310 >> 172.21.15.96:0/330362310 conn(0x7fda44075670 msgr2=0x7fda44068680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:47.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:47.116+0000 7fda49de8700 1 -- 172.21.15.96:0/330362310 shutdown_connections 2024-02-19T19:07:47.138 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:47.116+0000 7fda49de8700 1 -- 172.21.15.96:0/330362310 wait complete. 2024-02-19T19:07:47.754 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:47 smithi125 ceph-mon[37556]: pgmap v101: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:47.754 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:07:47.754 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:47 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:07:47.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:47 smithi096 ceph-mon[29216]: pgmap v101: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:47.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:07:47.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:47 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:07:48.021 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-19T19:07:48.021 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi096.front.sepia.ceph.com 2024-02-19T19:07:48.022 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-02-19T19:07:48.239 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:07:48.651 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:48 smithi096 ceph-mon[29216]: from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:48.651 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:48 smithi096 ceph-mon[29216]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T19:07:48.651 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:48 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:07:48.651 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:48 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:07:48.651 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:48 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:07:48.857 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:48 smithi125 ceph-mon[37556]: from='client.14828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:48.857 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:48 smithi125 ceph-mon[37556]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T19:07:48.857 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:48 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:07:48.857 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:48 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:07:48.857 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:48 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:07:49.751 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:49 smithi096 ceph-mon[29216]: pgmap v102: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:49.751 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:49 smithi096 ceph-mon[29216]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T19:07:49.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:49 smithi125 ceph-mon[37556]: pgmap v102: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:49.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:49 smithi125 ceph-mon[37556]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:f78a58c0ffd401d1493058a1022c35f011d65275 2024-02-19T19:07:50.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.139+0000 7f69163ab700 1 -- 172.21.15.96:0/2893534428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6910101840 msgr2=0x7f6910105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:50.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.139+0000 7f69163ab700 1 --2- 172.21.15.96:0/2893534428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6910101840 0x7f6910105890 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6904009910 tx=0x7f6904009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:50.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.139+0000 7f69163ab700 1 -- 172.21.15.96:0/2893534428 shutdown_connections 2024-02-19T19:07:50.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.139+0000 7f69163ab700 1 --2- 172.21.15.96:0/2893534428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6910101840 0x7f6910105890 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:50.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.139+0000 7f69163ab700 1 --2- 172.21.15.96:0/2893534428 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6910100e90 0x7f6910101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:50.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.139+0000 7f69163ab700 1 -- 172.21.15.96:0/2893534428 >> 172.21.15.96:0/2893534428 conn(0x7f69100fc740 msgr2=0x7f69100feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:50.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.139+0000 7f69163ab700 1 -- 172.21.15.96:0/2893534428 shutdown_connections 2024-02-19T19:07:50.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.139+0000 7f69163ab700 1 -- 172.21.15.96:0/2893534428 wait complete. 2024-02-19T19:07:50.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.140+0000 7f69163ab700 1 Processor -- start 2024-02-19T19:07:50.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.140+0000 7f69163ab700 1 -- start start 2024-02-19T19:07:50.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.140+0000 7f69163ab700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6910100e90 0x7f691019c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:50.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.140+0000 7f69163ab700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6910101840 0x7f691019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:50.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.140+0000 7f69163ab700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691019d350 con 0x7f6910100e90 2024-02-19T19:07:50.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.140+0000 7f69163ab700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6910196800 con 0x7f6910101840 2024-02-19T19:07:50.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.140+0000 7f690ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6910100e90 0x7f691019c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:50.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.140+0000 7f690ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6910100e90 0x7f691019c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33374/0 (socket says 172.21.15.96:33374) 2024-02-19T19:07:50.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.140+0000 7f690ffff700 1 -- 172.21.15.96:0/2977260467 learned_addr learned my addr 172.21.15.96:0/2977260467 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:07:50.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.141+0000 7f690f7fe700 1 --2- 172.21.15.96:0/2977260467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6910101840 0x7f691019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:50.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.141+0000 7f690ffff700 1 -- 172.21.15.96:0/2977260467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6910101840 msgr2=0x7f691019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:50.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.141+0000 7f690ffff700 1 --2- 172.21.15.96:0/2977260467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6910101840 0x7f691019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:50.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.141+0000 7f690ffff700 1 -- 172.21.15.96:0/2977260467 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69040095f0 con 0x7f6910100e90 2024-02-19T19:07:50.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.141+0000 7f690ffff700 1 --2- 172.21.15.96:0/2977260467 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6910100e90 0x7f691019c780 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f690000b4b0 tx=0x7f690000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:50.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.141+0000 7f690d7fa700 1 -- 172.21.15.96:0/2977260467 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6900011800 con 0x7f6910100e90 2024-02-19T19:07:50.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.141+0000 7f690d7fa700 1 -- 172.21.15.96:0/2977260467 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6900011e20 con 0x7f6910100e90 2024-02-19T19:07:50.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.141+0000 7f69163ab700 1 -- 172.21.15.96:0/2977260467 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6910196ae0 con 0x7f6910100e90 2024-02-19T19:07:50.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.141+0000 7f690d7fa700 1 -- 172.21.15.96:0/2977260467 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f690000f2e0 con 0x7f6910100e90 2024-02-19T19:07:50.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.141+0000 7f69163ab700 1 -- 172.21.15.96:0/2977260467 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6910197000 con 0x7f6910100e90 2024-02-19T19:07:50.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.142+0000 7f69163ab700 1 -- 172.21.15.96:0/2977260467 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69101091c0 con 0x7f6910100e90 2024-02-19T19:07:50.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.143+0000 7f690d7fa700 1 -- 172.21.15.96:0/2977260467 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f6900010380 con 0x7f6910100e90 2024-02-19T19:07:50.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.143+0000 7f690d7fa700 1 --2- 172.21.15.96:0/2977260467 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f68f806d520 0x7f68f806f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:50.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.144+0000 7f690d7fa700 1 -- 172.21.15.96:0/2977260467 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f690008cab0 con 0x7f6910100e90 2024-02-19T19:07:50.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.144+0000 7f690f7fe700 1 --2- 172.21.15.96:0/2977260467 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f68f806d520 0x7f68f806f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:50.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.144+0000 7f690f7fe700 1 --2- 172.21.15.96:0/2977260467 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f68f806d520 0x7f68f806f9e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6904006010 tx=0x7f690401a040 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:50.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.148+0000 7f690d7fa700 1 -- 172.21.15.96:0/2977260467 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f690005a2c0 con 0x7f6910100e90 2024-02-19T19:07:50.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.376+0000 7f69163ab700 1 -- 172.21.15.96:0/2977260467 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6910197280 con 0x7f68f806d520 2024-02-19T19:07:50.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.377+0000 7f690d7fa700 1 -- 172.21.15.96:0/2977260467 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f6910197280 con 0x7f68f806d520 2024-02-19T19:07:50.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.379+0000 7f69163ab700 1 -- 172.21.15.96:0/2977260467 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f68f806d520 msgr2=0x7f68f806f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:50.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.379+0000 7f69163ab700 1 --2- 172.21.15.96:0/2977260467 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f68f806d520 0x7f68f806f9e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6904006010 tx=0x7f690401a040 comp rx=0 tx=0).stop 2024-02-19T19:07:50.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.379+0000 7f69163ab700 1 -- 172.21.15.96:0/2977260467 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6910100e90 msgr2=0x7f691019c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:50.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.379+0000 7f69163ab700 1 --2- 172.21.15.96:0/2977260467 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6910100e90 0x7f691019c780 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f690000b4b0 tx=0x7f690000b7c0 comp rx=0 tx=0).stop 2024-02-19T19:07:50.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.379+0000 7f69163ab700 1 -- 172.21.15.96:0/2977260467 shutdown_connections 2024-02-19T19:07:50.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.379+0000 7f69163ab700 1 --2- 172.21.15.96:0/2977260467 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f68f806d520 0x7f68f806f9e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:50.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.379+0000 7f69163ab700 1 --2- 172.21.15.96:0/2977260467 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6910100e90 0x7f691019c780 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:50.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.379+0000 7f69163ab700 1 --2- 172.21.15.96:0/2977260467 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6910101840 0x7f691019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:50.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.379+0000 7f69163ab700 1 -- 172.21.15.96:0/2977260467 >> 172.21.15.96:0/2977260467 conn(0x7f69100fc740 msgr2=0x7f69100fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:50.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.379+0000 7f69163ab700 1 -- 172.21.15.96:0/2977260467 shutdown_connections 2024-02-19T19:07:50.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.380+0000 7f69163ab700 1 -- 172.21.15.96:0/2977260467 wait complete. 2024-02-19T19:07:50.411 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:07:50.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.490+0000 7f9e375be700 1 -- 172.21.15.96:0/3200785375 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e30068580 msgr2=0x7f9e300689e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:50.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.490+0000 7f9e375be700 1 --2- 172.21.15.96:0/3200785375 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e30068580 0x7f9e300689e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9e20009910 tx=0x7f9e20009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:50.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.490+0000 7f9e375be700 1 -- 172.21.15.96:0/3200785375 shutdown_connections 2024-02-19T19:07:50.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.490+0000 7f9e375be700 1 --2- 172.21.15.96:0/3200785375 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e30068580 0x7f9e300689e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:50.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.490+0000 7f9e375be700 1 --2- 172.21.15.96:0/3200785375 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e30106cd0 0x7f9e301070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:50.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.490+0000 7f9e375be700 1 -- 172.21.15.96:0/3200785375 >> 172.21.15.96:0/3200785375 conn(0x7f9e30075670 msgr2=0x7f9e30075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:50.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.491+0000 7f9e375be700 1 -- 172.21.15.96:0/3200785375 shutdown_connections 2024-02-19T19:07:50.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.491+0000 7f9e375be700 1 -- 172.21.15.96:0/3200785375 wait complete. 2024-02-19T19:07:50.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.491+0000 7f9e375be700 1 Processor -- start 2024-02-19T19:07:50.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.491+0000 7f9e375be700 1 -- start start 2024-02-19T19:07:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.491+0000 7f9e375be700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e30068580 0x7f9e300ffcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.491+0000 7f9e375be700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e30106cd0 0x7f9e30100230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.491+0000 7f9e375be700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e30100770 con 0x7f9e30068580 2024-02-19T19:07:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.491+0000 7f9e375be700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e301008b0 con 0x7f9e30106cd0 2024-02-19T19:07:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.492+0000 7f9e3535a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e30068580 0x7f9e300ffcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.492+0000 7f9e3535a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e30068580 0x7f9e300ffcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33396/0 (socket says 172.21.15.96:33396) 2024-02-19T19:07:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.492+0000 7f9e3535a700 1 -- 172.21.15.96:0/1093461480 learned_addr learned my addr 172.21.15.96:0/1093461480 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:07:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.492+0000 7f9e34b59700 1 --2- 172.21.15.96:0/1093461480 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e30106cd0 0x7f9e30100230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.492+0000 7f9e3535a700 1 -- 172.21.15.96:0/1093461480 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e30106cd0 msgr2=0x7f9e30100230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.492+0000 7f9e3535a700 1 --2- 172.21.15.96:0/1093461480 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e30106cd0 0x7f9e30100230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:50.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.492+0000 7f9e3535a700 1 -- 172.21.15.96:0/1093461480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e200095f0 con 0x7f9e30068580 2024-02-19T19:07:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.492+0000 7f9e34b59700 1 --2- 172.21.15.96:0/1093461480 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e30106cd0 0x7f9e30100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:07:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.492+0000 7f9e3535a700 1 --2- 172.21.15.96:0/1093461480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e30068580 0x7f9e300ffcf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00d8d0 tx=0x7f9e2c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.492+0000 7f9e267fc700 1 -- 172.21.15.96:0/1093461480 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e2c009940 con 0x7f9e30068580 2024-02-19T19:07:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.492+0000 7f9e375be700 1 -- 172.21.15.96:0/1093461480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e301a2a30 con 0x7f9e30068580 2024-02-19T19:07:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.492+0000 7f9e267fc700 1 -- 172.21.15.96:0/1093461480 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9e2c010460 con 0x7f9e30068580 2024-02-19T19:07:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.492+0000 7f9e267fc700 1 -- 172.21.15.96:0/1093461480 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e2c00f5f0 con 0x7f9e30068580 2024-02-19T19:07:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.492+0000 7f9e375be700 1 -- 172.21.15.96:0/1093461480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e301a2e40 con 0x7f9e30068580 2024-02-19T19:07:50.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.493+0000 7f9e375be700 1 -- 172.21.15.96:0/1093461480 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e301091d0 con 0x7f9e30068580 2024-02-19T19:07:50.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.494+0000 7f9e267fc700 1 -- 172.21.15.96:0/1093461480 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f9e2c009aa0 con 0x7f9e30068580 2024-02-19T19:07:50.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.494+0000 7f9e267fc700 1 --2- 172.21.15.96:0/1093461480 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f9e1c06d520 0x7f9e1c06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:50.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.494+0000 7f9e267fc700 1 -- 172.21.15.96:0/1093461480 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f9e2c08cf60 con 0x7f9e30068580 2024-02-19T19:07:50.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.494+0000 7f9e34b59700 1 --2- 172.21.15.96:0/1093461480 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f9e1c06d520 0x7f9e1c06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:50.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.495+0000 7f9e34b59700 1 --2- 172.21.15.96:0/1093461480 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f9e1c06d520 0x7f9e1c06f9e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9e20005b40 tx=0x7f9e2001a040 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:50.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.499+0000 7f9e267fc700 1 -- 172.21.15.96:0/1093461480 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f9e2c056c40 con 0x7f9e30068580 2024-02-19T19:07:50.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.722+0000 7f9e375be700 1 -- 172.21.15.96:0/1093461480 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e300611d0 con 0x7f9e1c06d520 2024-02-19T19:07:50.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.724+0000 7f9e267fc700 1 -- 172.21.15.96:0/1093461480 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f9e300611d0 con 0x7f9e1c06d520 2024-02-19T19:07:50.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.726+0000 7f9e375be700 1 -- 172.21.15.96:0/1093461480 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f9e1c06d520 msgr2=0x7f9e1c06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:50.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.726+0000 7f9e375be700 1 --2- 172.21.15.96:0/1093461480 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f9e1c06d520 0x7f9e1c06f9e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9e20005b40 tx=0x7f9e2001a040 comp rx=0 tx=0).stop 2024-02-19T19:07:50.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.726+0000 7f9e375be700 1 -- 172.21.15.96:0/1093461480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e30068580 msgr2=0x7f9e300ffcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:50.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.726+0000 7f9e375be700 1 --2- 172.21.15.96:0/1093461480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e30068580 0x7f9e300ffcf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00d8d0 tx=0x7f9e2c00dc90 comp rx=0 tx=0).stop 2024-02-19T19:07:50.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.726+0000 7f9e375be700 1 -- 172.21.15.96:0/1093461480 shutdown_connections 2024-02-19T19:07:50.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.726+0000 7f9e375be700 1 --2- 172.21.15.96:0/1093461480 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f9e1c06d520 0x7f9e1c06f9e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:50.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.726+0000 7f9e375be700 1 --2- 172.21.15.96:0/1093461480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e30068580 0x7f9e300ffcf0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:50.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.726+0000 7f9e375be700 1 --2- 172.21.15.96:0/1093461480 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9e30106cd0 0x7f9e30100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:50.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.726+0000 7f9e375be700 1 -- 172.21.15.96:0/1093461480 >> 172.21.15.96:0/1093461480 conn(0x7f9e30075670 msgr2=0x7f9e300feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:50.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.726+0000 7f9e375be700 1 -- 172.21.15.96:0/1093461480 shutdown_connections 2024-02-19T19:07:50.748 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.726+0000 7f9e375be700 1 -- 172.21.15.96:0/1093461480 wait complete. 2024-02-19T19:07:50.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.838+0000 7f86f2026700 1 -- 172.21.15.96:0/1614955434 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86ec100e90 msgr2=0x7f86ec101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:50.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.838+0000 7f86f2026700 1 --2- 172.21.15.96:0/1614955434 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86ec100e90 0x7f86ec101270 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009910 tx=0x7f86dc009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:50.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.838+0000 7f86f2026700 1 -- 172.21.15.96:0/1614955434 shutdown_connections 2024-02-19T19:07:50.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.838+0000 7f86f2026700 1 --2- 172.21.15.96:0/1614955434 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86ec101840 0x7f86ec105890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:50.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.838+0000 7f86f2026700 1 --2- 172.21.15.96:0/1614955434 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86ec100e90 0x7f86ec101270 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:50.859 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.838+0000 7f86f2026700 1 -- 172.21.15.96:0/1614955434 >> 172.21.15.96:0/1614955434 conn(0x7f86ec0fc740 msgr2=0x7f86ec0feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:50.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.838+0000 7f86f2026700 1 -- 172.21.15.96:0/1614955434 shutdown_connections 2024-02-19T19:07:50.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.838+0000 7f86f2026700 1 -- 172.21.15.96:0/1614955434 wait complete. 2024-02-19T19:07:50.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.839+0000 7f86f2026700 1 Processor -- start 2024-02-19T19:07:50.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.839+0000 7f86f2026700 1 -- start start 2024-02-19T19:07:50.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.839+0000 7f86f2026700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86ec100e90 0x7f86ec073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:50.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.839+0000 7f86f2026700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86ec101840 0x7f86ec0735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:50.861 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.839+0000 7f86f2026700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec073b10 con 0x7f86ec101840 2024-02-19T19:07:50.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.839+0000 7f86f2026700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec073c50 con 0x7f86ec100e90 2024-02-19T19:07:50.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.839+0000 7f86eaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86ec101840 0x7f86ec0735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:50.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.839+0000 7f86eaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86ec101840 0x7f86ec0735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33406/0 (socket says 172.21.15.96:33406) 2024-02-19T19:07:50.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.839+0000 7f86eaffd700 1 -- 172.21.15.96:0/1411346563 learned_addr learned my addr 172.21.15.96:0/1411346563 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:07:50.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.840+0000 7f86eb7fe700 1 --2- 172.21.15.96:0/1411346563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86ec100e90 0x7f86ec073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:50.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.840+0000 7f86eaffd700 1 -- 172.21.15.96:0/1411346563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86ec100e90 msgr2=0x7f86ec073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:50.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.840+0000 7f86eaffd700 1 --2- 172.21.15.96:0/1411346563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86ec100e90 0x7f86ec073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:50.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.840+0000 7f86eaffd700 1 -- 172.21.15.96:0/1411346563 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc0095f0 con 0x7f86ec101840 2024-02-19T19:07:50.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.840+0000 7f86eaffd700 1 --2- 172.21.15.96:0/1411346563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86ec101840 0x7f86ec0735d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f86e000b480 tx=0x7f86e000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:50.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.840+0000 7f86e8ff9700 1 -- 172.21.15.96:0/1411346563 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86e00118c0 con 0x7f86ec101840 2024-02-19T19:07:50.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.840+0000 7f86f2026700 1 -- 172.21.15.96:0/1411346563 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ec1a2b50 con 0x7f86ec101840 2024-02-19T19:07:50.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.840+0000 7f86e8ff9700 1 -- 172.21.15.96:0/1411346563 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f86e0010380 con 0x7f86ec101840 2024-02-19T19:07:50.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.840+0000 7f86f2026700 1 -- 172.21.15.96:0/1411346563 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ec1a2f60 con 0x7f86ec101840 2024-02-19T19:07:50.862 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.840+0000 7f86e8ff9700 1 -- 172.21.15.96:0/1411346563 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86e000f4f0 con 0x7f86ec101840 2024-02-19T19:07:50.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.841+0000 7f86f2026700 1 -- 172.21.15.96:0/1411346563 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ec109230 con 0x7f86ec101840 2024-02-19T19:07:50.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.842+0000 7f86e8ff9700 1 -- 172.21.15.96:0/1411346563 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f86e00104f0 con 0x7f86ec101840 2024-02-19T19:07:50.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.842+0000 7f86e8ff9700 1 --2- 172.21.15.96:0/1411346563 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f86d406d520 0x7f86d406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:50.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.842+0000 7f86e8ff9700 1 -- 172.21.15.96:0/1411346563 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f86e008cb10 con 0x7f86ec101840 2024-02-19T19:07:50.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.842+0000 7f86eb7fe700 1 --2- 172.21.15.96:0/1411346563 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f86d406d520 0x7f86d406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:50.863 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.843+0000 7f86eb7fe700 1 --2- 172.21.15.96:0/1411346563 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f86d406d520 0x7f86d406f9e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00b5c0 tx=0x7f86dc01a040 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:50.867 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:50.847+0000 7f86e8ff9700 1 -- 172.21.15.96:0/1411346563 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f86e0056870 con 0x7f86ec101840 2024-02-19T19:07:51.091 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.071+0000 7f86f2026700 1 -- 172.21.15.96:0/1411346563 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f86ec0611d0 con 0x7f86d406d520 2024-02-19T19:07:51.103 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.082+0000 7f86e8ff9700 1 -- 172.21.15.96:0/1411346563 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f86ec0611d0 con 0x7f86d406d520 2024-02-19T19:07:51.103 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:07:51.103 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2m) 68s ago 11m 15.8M - 0.25.0 c8568f914cd2 bbaf83a1e476 2024-02-19T19:07:51.103 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (11m) 69s ago 11m 7948k - 18.2.1 94eadd990e0a b41bff2e0043 2024-02-19T19:07:51.103 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (10m) 2m ago 10m 7721k - 18.2.1 94eadd990e0a 254ab7e7a040 2024-02-19T19:07:51.103 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (11m) 69s ago 11m 6665k - 18.2.1 94eadd990e0a 9250aadb9d78 2024-02-19T19:07:51.103 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (10m) 2m ago 10m 6665k - 18.2.1 94eadd990e0a b98ace7b5ded 2024-02-19T19:07:51.103 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (80s) 68s ago 11m 67.5M - 9.4.12 a0ea5e3c46d9 0102d90938e4 2024-02-19T19:07:51.103 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (5m) 68s ago 5m 26.8M - 18.2.1 94eadd990e0a 0a61d9cd40d1 2024-02-19T19:07:51.104 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (6m) 68s ago 6m 24.0M - 18.2.1 94eadd990e0a 58db3e7a7d75 2024-02-19T19:07:51.104 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (5m) 2m ago 5m 25.1M - 18.2.1 94eadd990e0a 211d64de8a63 2024-02-19T19:07:51.104 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (6m) 2m ago 6m 22.7M - 18.2.1 94eadd990e0a 2a04b5a8eaf4 2024-02-19T19:07:51.104 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:8443,9283,8765 running (3m) 69s ago 13m 503M - 19.0.0-1450-gf78a58c0 f081f847070a a86fbe94fe3f 2024-02-19T19:07:51.104 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (2m) 2m ago 10m 449M - 19.0.0-1450-gf78a58c0 f081f847070a e250486d572d 2024-02-19T19:07:51.104 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (13m) 69s ago 13m 56.2M 2048M 18.2.1 94eadd990e0a 23d5b9626c48 2024-02-19T19:07:51.104 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (10m) 2m ago 10m 43.8M 2048M 18.2.1 94eadd990e0a 27b4cad04cc5 2024-02-19T19:07:51.104 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (2m) 68s ago 11m 15.5M - 1.5.0 0da6a335fe13 51f622ea33d6 2024-02-19T19:07:51.104 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (2m) 2m ago 10m 3590k - 1.5.0 0da6a335fe13 464e076a52a1 2024-02-19T19:07:51.104 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (9m) 68s ago 9m 50.3M 1216M 18.2.1 94eadd990e0a d5bbf07ad0e7 2024-02-19T19:07:51.104 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (9m) 68s ago 9m 50.2M 1216M 18.2.1 94eadd990e0a 40329d59be45 2024-02-19T19:07:51.104 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (8m) 68s ago 8m 48.6M 1216M 18.2.1 94eadd990e0a 4f1e49db2d41 2024-02-19T19:07:51.105 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (8m) 2m ago 8m 49.8M 2240M 18.2.1 94eadd990e0a 4746b79351fc 2024-02-19T19:07:51.105 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (7m) 2m ago 7m 49.4M 2240M 18.2.1 94eadd990e0a 2b3f0088f6b2 2024-02-19T19:07:51.105 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (7m) 2m ago 7m 46.0M 2240M 18.2.1 94eadd990e0a e5731974b46a 2024-02-19T19:07:51.105 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2m) 68s ago 11m 51.9M - 2.43.0 a07b618ecd1d a4edcf6ed669 2024-02-19T19:07:51.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.084+0000 7f86f2026700 1 -- 172.21.15.96:0/1411346563 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f86d406d520 msgr2=0x7f86d406f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:51.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.084+0000 7f86f2026700 1 --2- 172.21.15.96:0/1411346563 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f86d406d520 0x7f86d406f9e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00b5c0 tx=0x7f86dc01a040 comp rx=0 tx=0).stop 2024-02-19T19:07:51.105 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.084+0000 7f86f2026700 1 -- 172.21.15.96:0/1411346563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86ec101840 msgr2=0x7f86ec0735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:51.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.084+0000 7f86f2026700 1 --2- 172.21.15.96:0/1411346563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86ec101840 0x7f86ec0735d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f86e000b480 tx=0x7f86e000b840 comp rx=0 tx=0).stop 2024-02-19T19:07:51.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.084+0000 7f86f2026700 1 -- 172.21.15.96:0/1411346563 shutdown_connections 2024-02-19T19:07:51.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.084+0000 7f86f2026700 1 --2- 172.21.15.96:0/1411346563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86ec100e90 0x7f86ec073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:51.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.084+0000 7f86f2026700 1 --2- 172.21.15.96:0/1411346563 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f86d406d520 0x7f86d406f9e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:51.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.084+0000 7f86f2026700 1 --2- 172.21.15.96:0/1411346563 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f86ec101840 0x7f86ec0735d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:51.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.084+0000 7f86f2026700 1 -- 172.21.15.96:0/1411346563 >> 172.21.15.96:0/1411346563 conn(0x7f86ec0fc740 msgr2=0x7f86ec0fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:51.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.084+0000 7f86f2026700 1 -- 172.21.15.96:0/1411346563 shutdown_connections 2024-02-19T19:07:51.106 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.084+0000 7f86f2026700 1 -- 172.21.15.96:0/1411346563 wait complete. 2024-02-19T19:07:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.189+0000 7f6e25c65700 1 -- 172.21.15.96:0/3774110110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e20106cd0 msgr2=0x7f6e201070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.189+0000 7f6e25c65700 1 --2- 172.21.15.96:0/3774110110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e20106cd0 0x7f6e201070b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009910 tx=0x7f6e10009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.189+0000 7f6e25c65700 1 -- 172.21.15.96:0/3774110110 shutdown_connections 2024-02-19T19:07:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.189+0000 7f6e25c65700 1 --2- 172.21.15.96:0/3774110110 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e20068580 0x7f6e200689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.189+0000 7f6e25c65700 1 --2- 172.21.15.96:0/3774110110 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e20106cd0 0x7f6e201070b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.189+0000 7f6e25c65700 1 -- 172.21.15.96:0/3774110110 >> 172.21.15.96:0/3774110110 conn(0x7f6e20075670 msgr2=0x7f6e20075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.189+0000 7f6e25c65700 1 -- 172.21.15.96:0/3774110110 shutdown_connections 2024-02-19T19:07:51.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.189+0000 7f6e25c65700 1 -- 172.21.15.96:0/3774110110 wait complete. 2024-02-19T19:07:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.190+0000 7f6e25c65700 1 Processor -- start 2024-02-19T19:07:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.190+0000 7f6e25c65700 1 -- start start 2024-02-19T19:07:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.190+0000 7f6e25c65700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e20068580 0x7f6e200ffcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.190+0000 7f6e25c65700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e20106cd0 0x7f6e20100230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.190+0000 7f6e25c65700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e20100770 con 0x7f6e20106cd0 2024-02-19T19:07:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.190+0000 7f6e25c65700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e201008b0 con 0x7f6e20068580 2024-02-19T19:07:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.190+0000 7f6e16ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e20106cd0 0x7f6e20100230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.190+0000 7f6e16ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e20106cd0 0x7f6e20100230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33420/0 (socket says 172.21.15.96:33420) 2024-02-19T19:07:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.190+0000 7f6e1f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e20068580 0x7f6e200ffcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.190+0000 7f6e16ffd700 1 -- 172.21.15.96:0/3481585783 learned_addr learned my addr 172.21.15.96:0/3481585783 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:07:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.191+0000 7f6e16ffd700 1 -- 172.21.15.96:0/3481585783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e20068580 msgr2=0x7f6e200ffcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.191+0000 7f6e16ffd700 1 --2- 172.21.15.96:0/3481585783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e20068580 0x7f6e200ffcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.191+0000 7f6e16ffd700 1 -- 172.21.15.96:0/3481585783 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e100095f0 con 0x7f6e20106cd0 2024-02-19T19:07:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.191+0000 7f6e16ffd700 1 --2- 172.21.15.96:0/3481585783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e20106cd0 0x7f6e20100230 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800d8d0 tx=0x7f6e0800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.191+0000 7f6e1d7fa700 1 -- 172.21.15.96:0/3481585783 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e080098a0 con 0x7f6e20106cd0 2024-02-19T19:07:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.191+0000 7f6e1d7fa700 1 -- 172.21.15.96:0/3481585783 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e08010460 con 0x7f6e20106cd0 2024-02-19T19:07:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.191+0000 7f6e25c65700 1 -- 172.21.15.96:0/3481585783 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e201a2a60 con 0x7f6e20106cd0 2024-02-19T19:07:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.191+0000 7f6e1d7fa700 1 -- 172.21.15.96:0/3481585783 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e0800f5f0 con 0x7f6e20106cd0 2024-02-19T19:07:51.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.191+0000 7f6e25c65700 1 -- 172.21.15.96:0/3481585783 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e201a2e70 con 0x7f6e20106cd0 2024-02-19T19:07:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.192+0000 7f6e25c65700 1 -- 172.21.15.96:0/3481585783 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e201091d0 con 0x7f6e20106cd0 2024-02-19T19:07:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.193+0000 7f6e1d7fa700 1 -- 172.21.15.96:0/3481585783 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f6e08009a00 con 0x7f6e20106cd0 2024-02-19T19:07:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.193+0000 7f6e1d7fa700 1 --2- 172.21.15.96:0/3481585783 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f6e0c06d520 0x7f6e0c06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.193+0000 7f6e1d7fa700 1 -- 172.21.15.96:0/3481585783 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f6e0808cd80 con 0x7f6e20106cd0 2024-02-19T19:07:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.193+0000 7f6e1f7fe700 1 --2- 172.21.15.96:0/3481585783 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f6e0c06d520 0x7f6e0c06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:51.214 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.194+0000 7f6e1f7fe700 1 --2- 172.21.15.96:0/3481585783 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f6e0c06d520 0x7f6e0c06f9e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000b5c0 tx=0x7f6e1001a040 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:51.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.197+0000 7f6e1d7fa700 1 -- 172.21.15.96:0/3481585783 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f6e08056ae0 con 0x7f6e20106cd0 2024-02-19T19:07:51.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.490+0000 7f6e25c65700 1 -- 172.21.15.96:0/3481585783 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6e2004f2e0 con 0x7f6e20106cd0 2024-02-19T19:07:51.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.491+0000 7f6e1d7fa700 1 -- 172.21.15.96:0/3481585783 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f6e080162c0 con 0x7f6e20106cd0 2024-02-19T19:07:51.512 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:07:51.512 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:07:51.512 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-19T19:07:51.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:07:51.512 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:07:51.512 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:07:51.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:07:51.512 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:07:51.512 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-19T19:07:51.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:07:51.512 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:07:51.512 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-19T19:07:51.512 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:07:51.513 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:07:51.513 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 12, 2024-02-19T19:07:51.513 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:07:51.513 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:07:51.513 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:07:51.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.493+0000 7f6e25c65700 1 -- 172.21.15.96:0/3481585783 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f6e0c06d520 msgr2=0x7f6e0c06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:51.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.493+0000 7f6e25c65700 1 --2- 172.21.15.96:0/3481585783 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f6e0c06d520 0x7f6e0c06f9e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6e1000b5c0 tx=0x7f6e1001a040 comp rx=0 tx=0).stop 2024-02-19T19:07:51.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.493+0000 7f6e25c65700 1 -- 172.21.15.96:0/3481585783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e20106cd0 msgr2=0x7f6e20100230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:51.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.493+0000 7f6e25c65700 1 --2- 172.21.15.96:0/3481585783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e20106cd0 0x7f6e20100230 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6e0800d8d0 tx=0x7f6e0800dbe0 comp rx=0 tx=0).stop 2024-02-19T19:07:51.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.493+0000 7f6e25c65700 1 -- 172.21.15.96:0/3481585783 shutdown_connections 2024-02-19T19:07:51.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.493+0000 7f6e25c65700 1 --2- 172.21.15.96:0/3481585783 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6e20068580 0x7f6e200ffcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:51.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.493+0000 7f6e25c65700 1 --2- 172.21.15.96:0/3481585783 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f6e0c06d520 0x7f6e0c06f9e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:51.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.493+0000 7f6e25c65700 1 --2- 172.21.15.96:0/3481585783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6e20106cd0 0x7f6e20100230 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:51.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.493+0000 7f6e25c65700 1 -- 172.21.15.96:0/3481585783 >> 172.21.15.96:0/3481585783 conn(0x7f6e20075670 msgr2=0x7f6e200fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:51.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.493+0000 7f6e25c65700 1 -- 172.21.15.96:0/3481585783 shutdown_connections 2024-02-19T19:07:51.514 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.493+0000 7f6e25c65700 1 -- 172.21.15.96:0/3481585783 wait complete. 2024-02-19T19:07:51.622 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.602+0000 7f2b36041700 1 -- 172.21.15.96:0/3386332815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b301006b0 msgr2=0x7f2b30100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:51.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.602+0000 7f2b36041700 1 --2- 172.21.15.96:0/3386332815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b301006b0 0x7f2b30100a90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2b20009910 tx=0x7f2b20009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:51.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.602+0000 7f2b36041700 1 -- 172.21.15.96:0/3386332815 shutdown_connections 2024-02-19T19:07:51.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.602+0000 7f2b36041700 1 --2- 172.21.15.96:0/3386332815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b30101060 0x7f2b301047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:51.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.602+0000 7f2b36041700 1 --2- 172.21.15.96:0/3386332815 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b301006b0 0x7f2b30100a90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:51.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.602+0000 7f2b36041700 1 -- 172.21.15.96:0/3386332815 >> 172.21.15.96:0/3386332815 conn(0x7f2b30074e30 msgr2=0x7f2b30075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:51.623 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:51 smithi096 ceph-mon[29216]: pgmap v103: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:51.623 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:51 smithi096 ceph-mon[29216]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:51.623 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:51 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:07:51.623 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:51 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:07:51.624 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:51 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:51.624 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:51 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:07:51.624 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:51 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-19T19:07:51.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.602+0000 7f2b36041700 1 -- 172.21.15.96:0/3386332815 shutdown_connections 2024-02-19T19:07:51.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.602+0000 7f2b36041700 1 -- 172.21.15.96:0/3386332815 wait complete. 2024-02-19T19:07:51.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.602+0000 7f2b36041700 1 Processor -- start 2024-02-19T19:07:51.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.603+0000 7f2b36041700 1 -- start start 2024-02-19T19:07:51.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.603+0000 7f2b36041700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b301006b0 0x7f2b3019e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:51.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.603+0000 7f2b36041700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b30101060 0x7f2b3019ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:51.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.603+0000 7f2b36041700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3019f3f0 con 0x7f2b30101060 2024-02-19T19:07:51.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.603+0000 7f2b36041700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b301988a0 con 0x7f2b301006b0 2024-02-19T19:07:51.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.603+0000 7f2b2effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b30101060 0x7f2b3019ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:51.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.603+0000 7f2b2effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b30101060 0x7f2b3019ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33438/0 (socket says 172.21.15.96:33438) 2024-02-19T19:07:51.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.603+0000 7f2b2effd700 1 -- 172.21.15.96:0/1487876049 learned_addr learned my addr 172.21.15.96:0/1487876049 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:07:51.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.603+0000 7f2b2f7fe700 1 --2- 172.21.15.96:0/1487876049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b301006b0 0x7f2b3019e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:51.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.603+0000 7f2b2effd700 1 -- 172.21.15.96:0/1487876049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b301006b0 msgr2=0x7f2b3019e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:51.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.603+0000 7f2b2effd700 1 --2- 172.21.15.96:0/1487876049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b301006b0 0x7f2b3019e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:51.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.603+0000 7f2b2effd700 1 -- 172.21.15.96:0/1487876049 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b200095f0 con 0x7f2b30101060 2024-02-19T19:07:51.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.604+0000 7f2b2effd700 1 --2- 172.21.15.96:0/1487876049 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b30101060 0x7f2b3019ed60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400d900 tx=0x7f2b2400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:51.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.604+0000 7f2b2cff9700 1 -- 172.21.15.96:0/1487876049 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b24009900 con 0x7f2b30101060 2024-02-19T19:07:51.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.604+0000 7f2b2cff9700 1 -- 172.21.15.96:0/1487876049 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b24010460 con 0x7f2b30101060 2024-02-19T19:07:51.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.604+0000 7f2b2cff9700 1 -- 172.21.15.96:0/1487876049 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b2400f5f0 con 0x7f2b30101060 2024-02-19T19:07:51.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.604+0000 7f2b36041700 1 -- 172.21.15.96:0/1487876049 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b30198b80 con 0x7f2b30101060 2024-02-19T19:07:51.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.605+0000 7f2b36041700 1 -- 172.21.15.96:0/1487876049 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b301990d0 con 0x7f2b30101060 2024-02-19T19:07:51.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.606+0000 7f2b36041700 1 -- 172.21.15.96:0/1487876049 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3004f2e0 con 0x7f2b30101060 2024-02-19T19:07:51.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.606+0000 7f2b2cff9700 1 -- 172.21.15.96:0/1487876049 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f2b240105d0 con 0x7f2b30101060 2024-02-19T19:07:51.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.607+0000 7f2b2cff9700 1 --2- 172.21.15.96:0/1487876049 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f2b1806d520 0x7f2b1806f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:51.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.607+0000 7f2b2cff9700 1 -- 172.21.15.96:0/1487876049 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f2b2408ca70 con 0x7f2b30101060 2024-02-19T19:07:51.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.607+0000 7f2b2f7fe700 1 --2- 172.21.15.96:0/1487876049 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f2b1806d520 0x7f2b1806f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:51.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.607+0000 7f2b2f7fe700 1 --2- 172.21.15.96:0/1487876049 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f2b1806d520 0x7f2b1806f9e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000b5c0 tx=0x7f2b2001a040 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:51.632 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.611+0000 7f2b2cff9700 1 -- 172.21.15.96:0/1487876049 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f2b2408ee60 con 0x7f2b30101060 2024-02-19T19:07:51.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.857+0000 7f2b36041700 1 -- 172.21.15.96:0/1487876049 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2b30199db0 con 0x7f2b30101060 2024-02-19T19:07:51.878 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.858+0000 7f2b2cff9700 1 -- 172.21.15.96:0/1487876049 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1848 (secure 0 0 0) 0x7f2b24017750 con 0x7f2b30101060 2024-02-19T19:07:51.879 INFO:teuthology.orchestra.run.smithi096.stdout:e19 2024-02-19T19:07:51.879 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:07:51.879 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:07:51.879 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2024-02-19T19:07:51.879 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:07:51.879 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:07:51.879 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2024-02-19T19:07:51.879 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 19 2024-02-19T19:07:51.879 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-19T19:07:51.879 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-02-19T19:01:42.881136+0000 2024-02-19T19:07:51.879 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2024-02-19T19:02:02.873590+0000 2024-02-19T19:07:51.879 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2024-02-19T19:07:51.880 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2024-02-19T19:07:51.880 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2024-02-19T19:07:51.880 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2024-02-19T19:07:51.880 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2024-02-19T19:07:51.880 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2024-02-19T19:07:51.880 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2024-02-19T19:07:51.880 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 46 2024-02-19T19:07:51.880 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:07:51.880 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2024-02-19T19:07:51.880 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2024-02-19T19:07:51.880 INFO:teuthology.orchestra.run.smithi096.stdout:up {0=14490,1=24267} 2024-02-19T19:07:51.880 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2024-02-19T19:07:51.880 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2024-02-19T19:07:51.880 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2024-02-19T19:07:51.881 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2024-02-19T19:07:51.881 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2024-02-19T19:07:51.881 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data enabled 2024-02-19T19:07:51.881 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2024-02-19T19:07:51.881 INFO:teuthology.orchestra.run.smithi096.stdout:bal_rank_mask -1 2024-02-19T19:07:51.881 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2024-02-19T19:07:51.881 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pccmys{0:14490} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:07:51.881 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.usrmcg{0:14502} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/413113741,v1:172.21.15.96:6827/413113741] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:07:51.881 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.srnlol{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.125:6824/3084054986,v1:172.21.15.125:6825/3084054986] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:07:51.881 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.pwyuga{1:24275} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.125:6826/3098247423,v1:172.21.15.125:6827/3098247423] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:07:51.881 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:07:51.881 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:07:51.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.861+0000 7f2b36041700 1 -- 172.21.15.96:0/1487876049 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f2b1806d520 msgr2=0x7f2b1806f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:51.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.861+0000 7f2b36041700 1 --2- 172.21.15.96:0/1487876049 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f2b1806d520 0x7f2b1806f9e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000b5c0 tx=0x7f2b2001a040 comp rx=0 tx=0).stop 2024-02-19T19:07:51.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.861+0000 7f2b36041700 1 -- 172.21.15.96:0/1487876049 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b30101060 msgr2=0x7f2b3019ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:51.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.861+0000 7f2b36041700 1 --2- 172.21.15.96:0/1487876049 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b30101060 0x7f2b3019ed60 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400d900 tx=0x7f2b2400dc10 comp rx=0 tx=0).stop 2024-02-19T19:07:51.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.861+0000 7f2b36041700 1 -- 172.21.15.96:0/1487876049 shutdown_connections 2024-02-19T19:07:51.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.861+0000 7f2b36041700 1 --2- 172.21.15.96:0/1487876049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2b301006b0 0x7f2b3019e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:51.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.861+0000 7f2b36041700 1 --2- 172.21.15.96:0/1487876049 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f2b1806d520 0x7f2b1806f9e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:51.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.861+0000 7f2b36041700 1 --2- 172.21.15.96:0/1487876049 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b30101060 0x7f2b3019ed60 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:51.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.861+0000 7f2b36041700 1 -- 172.21.15.96:0/1487876049 >> 172.21.15.96:0/1487876049 conn(0x7f2b30074e30 msgr2=0x7f2b300fd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:51.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.861+0000 7f2b36041700 1 -- 172.21.15.96:0/1487876049 shutdown_connections 2024-02-19T19:07:51.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.861+0000 7f2b36041700 1 -- 172.21.15.96:0/1487876049 wait complete. 2024-02-19T19:07:51.883 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 19 2024-02-19T19:07:51.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:51 smithi125 ceph-mon[37556]: pgmap v103: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:07:51.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:51 smithi125 ceph-mon[37556]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:51.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:51 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:07:51.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:51 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:07:51.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:51 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:51.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:51 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:07:51.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:51 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-19T19:07:52.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.981+0000 7f5666a7c700 1 -- 172.21.15.96:0/3684551942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56600ff5a0 msgr2=0x7f56600ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:52.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.981+0000 7f5666a7c700 1 --2- 172.21.15.96:0/3684551942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56600ff5a0 0x7f56600ff980 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f565c00b0a0 tx=0x7f565c00b3b0 comp rx=0 tx=0).stop 2024-02-19T19:07:52.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.981+0000 7f5666a7c700 1 -- 172.21.15.96:0/3684551942 shutdown_connections 2024-02-19T19:07:52.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.981+0000 7f5666a7c700 1 --2- 172.21.15.96:0/3684551942 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56600fff50 0x7f5660105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:52.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.981+0000 7f5666a7c700 1 --2- 172.21.15.96:0/3684551942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56600ff5a0 0x7f56600ff980 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:52.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.981+0000 7f5666a7c700 1 -- 172.21.15.96:0/3684551942 >> 172.21.15.96:0/3684551942 conn(0x7f5660074e30 msgr2=0x7f5660075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:52.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.981+0000 7f5666a7c700 1 -- 172.21.15.96:0/3684551942 shutdown_connections 2024-02-19T19:07:52.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.981+0000 7f5666a7c700 1 -- 172.21.15.96:0/3684551942 wait complete. 2024-02-19T19:07:52.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.981+0000 7f5666a7c700 1 Processor -- start 2024-02-19T19:07:52.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.981+0000 7f5666a7c700 1 -- start start 2024-02-19T19:07:52.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.982+0000 7f5666a7c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56600ff5a0 0x7f566019c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:52.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.982+0000 7f5666a7c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56600fff50 0x7f566019cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:52.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.982+0000 7f5666a7c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566019d250 con 0x7f56600fff50 2024-02-19T19:07:52.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.982+0000 7f5666a7c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5660196700 con 0x7f56600ff5a0 2024-02-19T19:07:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.982+0000 7f5657fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56600fff50 0x7f566019cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.982+0000 7f5657fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56600fff50 0x7f566019cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33442/0 (socket says 172.21.15.96:33442) 2024-02-19T19:07:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.982+0000 7f5657fff700 1 -- 172.21.15.96:0/3796825693 learned_addr learned my addr 172.21.15.96:0/3796825693 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:07:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.982+0000 7f5664818700 1 --2- 172.21.15.96:0/3796825693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56600ff5a0 0x7f566019c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.982+0000 7f5657fff700 1 -- 172.21.15.96:0/3796825693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56600ff5a0 msgr2=0x7f566019c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.982+0000 7f5657fff700 1 --2- 172.21.15.96:0/3796825693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56600ff5a0 0x7f566019c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.982+0000 7f5657fff700 1 -- 172.21.15.96:0/3796825693 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c009d00 con 0x7f56600fff50 2024-02-19T19:07:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.982+0000 7f5657fff700 1 --2- 172.21.15.96:0/3796825693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56600fff50 0x7f566019cbc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f565000c8f0 tx=0x7f565000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.982+0000 7f5655ffb700 1 -- 172.21.15.96:0/3796825693 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56500078a0 con 0x7f56600fff50 2024-02-19T19:07:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.982+0000 7f5655ffb700 1 -- 172.21.15.96:0/3796825693 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f565000f450 con 0x7f56600fff50 2024-02-19T19:07:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.982+0000 7f5666a7c700 1 -- 172.21.15.96:0/3796825693 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56601969e0 con 0x7f56600fff50 2024-02-19T19:07:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.982+0000 7f5655ffb700 1 -- 172.21.15.96:0/3796825693 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5650018610 con 0x7f56600fff50 2024-02-19T19:07:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.983+0000 7f5666a7c700 1 -- 172.21.15.96:0/3796825693 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5660196f30 con 0x7f56600fff50 2024-02-19T19:07:52.005 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.983+0000 7f5666a7c700 1 -- 172.21.15.96:0/3796825693 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5660109270 con 0x7f56600fff50 2024-02-19T19:07:52.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.984+0000 7f5655ffb700 1 -- 172.21.15.96:0/3796825693 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7f565000f5c0 con 0x7f56600fff50 2024-02-19T19:07:52.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.984+0000 7f5655ffb700 1 --2- 172.21.15.96:0/3796825693 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f564806d520 0x7f564806f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:52.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.984+0000 7f5655ffb700 1 -- 172.21.15.96:0/3796825693 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f565008cee0 con 0x7f56600fff50 2024-02-19T19:07:52.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.984+0000 7f5664818700 1 --2- 172.21.15.96:0/3796825693 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f564806d520 0x7f564806f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:52.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.985+0000 7f5664818700 1 --2- 172.21.15.96:0/3796825693 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f564806d520 0x7f564806f9e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f565c000f80 tx=0x7f565c0060c0 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:52.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:51.989+0000 7f5655ffb700 1 -- 172.21.15.96:0/3796825693 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f565005a6f0 con 0x7f56600fff50 2024-02-19T19:07:52.228 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.207+0000 7f5666a7c700 1 -- 172.21.15.96:0/3796825693 --> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f56601971b0 con 0x7f564806d520 2024-02-19T19:07:52.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.209+0000 7f5655ffb700 1 -- 172.21.15.96:0/3796825693 <== mgr.14652 v2:172.21.15.96:6800/967937024 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f56601971b0 con 0x7f564806d520 2024-02-19T19:07:52.229 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:07:52.229 INFO:teuthology.orchestra.run.smithi096.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:07:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "in_progress": true, 2024-02-19T19:07:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:07:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "services_complete": [ 2024-02-19T19:07:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr" 2024-02-19T19:07:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-02-19T19:07:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "progress": "2/23 daemons upgraded", 2024-02-19T19:07:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "message": "Currently upgrading mon daemons", 2024-02-19T19:07:52.230 INFO:teuthology.orchestra.run.smithi096.stdout: "is_paused": false 2024-02-19T19:07:52.230 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:07:52.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.211+0000 7f5666a7c700 1 -- 172.21.15.96:0/3796825693 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f564806d520 msgr2=0x7f564806f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:52.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.211+0000 7f5666a7c700 1 --2- 172.21.15.96:0/3796825693 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f564806d520 0x7f564806f9e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f565c000f80 tx=0x7f565c0060c0 comp rx=0 tx=0).stop 2024-02-19T19:07:52.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.211+0000 7f5666a7c700 1 -- 172.21.15.96:0/3796825693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56600fff50 msgr2=0x7f566019cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:52.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.211+0000 7f5666a7c700 1 --2- 172.21.15.96:0/3796825693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56600fff50 0x7f566019cbc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f565000c8f0 tx=0x7f565000cc00 comp rx=0 tx=0).stop 2024-02-19T19:07:52.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.211+0000 7f5666a7c700 1 -- 172.21.15.96:0/3796825693 shutdown_connections 2024-02-19T19:07:52.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.211+0000 7f5666a7c700 1 --2- 172.21.15.96:0/3796825693 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56600ff5a0 0x7f566019c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:52.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.211+0000 7f5666a7c700 1 --2- 172.21.15.96:0/3796825693 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7f564806d520 0x7f564806f9e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:52.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.211+0000 7f5666a7c700 1 --2- 172.21.15.96:0/3796825693 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f56600fff50 0x7f566019cbc0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:52.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.211+0000 7f5666a7c700 1 -- 172.21.15.96:0/3796825693 >> 172.21.15.96:0/3796825693 conn(0x7f5660074e30 msgr2=0x7f56600fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:52.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.211+0000 7f5666a7c700 1 -- 172.21.15.96:0/3796825693 shutdown_connections 2024-02-19T19:07:52.232 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.211+0000 7f5666a7c700 1 -- 172.21.15.96:0/3796825693 wait complete. 2024-02-19T19:07:52.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.317+0000 7fdbc9dfa700 1 -- 172.21.15.96:0/2096053327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbc40ffc20 msgr2=0x7fdbc4100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:52.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.317+0000 7fdbc9dfa700 1 --2- 172.21.15.96:0/2096053327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbc40ffc20 0x7fdbc4100080 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8009910 tx=0x7fdbb8009c20 comp rx=0 tx=0).stop 2024-02-19T19:07:52.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.317+0000 7fdbc9dfa700 1 -- 172.21.15.96:0/2096053327 shutdown_connections 2024-02-19T19:07:52.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.317+0000 7fdbc9dfa700 1 --2- 172.21.15.96:0/2096053327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbc40ffc20 0x7fdbc4100080 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:52.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.317+0000 7fdbc9dfa700 1 --2- 172.21.15.96:0/2096053327 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc4105bd0 0x7fdbc4105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:52.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.317+0000 7fdbc9dfa700 1 -- 172.21.15.96:0/2096053327 >> 172.21.15.96:0/2096053327 conn(0x7fdbc4075670 msgr2=0x7fdbc4075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:52.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.317+0000 7fdbc9dfa700 1 -- 172.21.15.96:0/2096053327 shutdown_connections 2024-02-19T19:07:52.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.317+0000 7fdbc9dfa700 1 -- 172.21.15.96:0/2096053327 wait complete. 2024-02-19T19:07:52.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.318+0000 7fdbc9dfa700 1 Processor -- start 2024-02-19T19:07:52.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.318+0000 7fdbc9dfa700 1 -- start start 2024-02-19T19:07:52.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.318+0000 7fdbc9dfa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc40ffc20 0x7fdbc4195550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:52.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.318+0000 7fdbc9dfa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbc4105bd0 0x7fdbc4195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:52.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.318+0000 7fdbc9dfa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc4195fd0 con 0x7fdbc4105bd0 2024-02-19T19:07:52.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.318+0000 7fdbc9dfa700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc4196140 con 0x7fdbc40ffc20 2024-02-19T19:07:52.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.318+0000 7fdbc2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbc4105bd0 0x7fdbc4195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:52.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.318+0000 7fdbc2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbc4105bd0 0x7fdbc4195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:33456/0 (socket says 172.21.15.96:33456) 2024-02-19T19:07:52.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.318+0000 7fdbc2ffd700 1 -- 172.21.15.96:0/3227383618 learned_addr learned my addr 172.21.15.96:0/3227383618 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:07:52.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.319+0000 7fdbc37fe700 1 --2- 172.21.15.96:0/3227383618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc40ffc20 0x7fdbc4195550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:52.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.319+0000 7fdbc2ffd700 1 -- 172.21.15.96:0/3227383618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc40ffc20 msgr2=0x7fdbc4195550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:52.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.319+0000 7fdbc2ffd700 1 --2- 172.21.15.96:0/3227383618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc40ffc20 0x7fdbc4195550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:52.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.319+0000 7fdbc2ffd700 1 -- 172.21.15.96:0/3227383618 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb80095f0 con 0x7fdbc4105bd0 2024-02-19T19:07:52.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.319+0000 7fdbc2ffd700 1 --2- 172.21.15.96:0/3227383618 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbc4105bd0 0x7fdbc4195a90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8006010 tx=0x7fdbb800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:52.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.319+0000 7fdbc0ff9700 1 -- 172.21.15.96:0/3227383618 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbb801d070 con 0x7fdbc4105bd0 2024-02-19T19:07:52.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.319+0000 7fdbc0ff9700 1 -- 172.21.15.96:0/3227383618 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdbb8005dc0 con 0x7fdbc4105bd0 2024-02-19T19:07:52.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.319+0000 7fdbc9dfa700 1 -- 172.21.15.96:0/3227383618 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc41963c0 con 0x7fdbc4105bd0 2024-02-19T19:07:52.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.319+0000 7fdbc0ff9700 1 -- 172.21.15.96:0/3227383618 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdbb8017400 con 0x7fdbc4105bd0 2024-02-19T19:07:52.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.319+0000 7fdbc9dfa700 1 -- 172.21.15.96:0/3227383618 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc41a2df0 con 0x7fdbc4105bd0 2024-02-19T19:07:52.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.320+0000 7fdbc9dfa700 1 -- 172.21.15.96:0/3227383618 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc41080d0 con 0x7fdbc4105bd0 2024-02-19T19:07:52.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.321+0000 7fdbc0ff9700 1 -- 172.21.15.96:0/3227383618 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 31) v1 ==== 91346+0+0 (secure 0 0 0) 0x7fdbb8003a60 con 0x7fdbc4105bd0 2024-02-19T19:07:52.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.322+0000 7fdbc0ff9700 1 --2- 172.21.15.96:0/3227383618 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fdbac06d520 0x7fdbac06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:07:52.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.322+0000 7fdbc0ff9700 1 -- 172.21.15.96:0/3227383618 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fdbb808e1e0 con 0x7fdbc4105bd0 2024-02-19T19:07:52.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.322+0000 7fdbc37fe700 1 --2- 172.21.15.96:0/3227383618 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fdbac06d520 0x7fdbac06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:07:52.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.322+0000 7fdbc37fe700 1 --2- 172.21.15.96:0/3227383618 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fdbac06d520 0x7fdbac06f9e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4005950 tx=0x7fdbb400b410 comp rx=0 tx=0).ready entity=mgr.14652 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:07:52.350 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.330+0000 7fdbc0ff9700 1 -- 172.21.15.96:0/3227383618 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fdbb8057f40 con 0x7fdbc4105bd0 2024-02-19T19:07:52.636 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.615+0000 7fdbc9dfa700 1 -- 172.21.15.96:0/3227383618 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdbc404f2e0 con 0x7fdbc4105bd0 2024-02-19T19:07:52.637 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.616+0000 7fdbc0ff9700 1 -- 172.21.15.96:0/3227383618 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fdbb805b600 con 0x7fdbc4105bd0 2024-02-19T19:07:52.637 INFO:teuthology.orchestra.run.smithi096.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T19:07:52.637 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-19T19:07:52.637 INFO:teuthology.orchestra.run.smithi096.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-19T19:07:52.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.618+0000 7fdbc9dfa700 1 -- 172.21.15.96:0/3227383618 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fdbac06d520 msgr2=0x7fdbac06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:52.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.618+0000 7fdbc9dfa700 1 --2- 172.21.15.96:0/3227383618 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fdbac06d520 0x7fdbac06f9e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4005950 tx=0x7fdbb400b410 comp rx=0 tx=0).stop 2024-02-19T19:07:52.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.618+0000 7fdbc9dfa700 1 -- 172.21.15.96:0/3227383618 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbc4105bd0 msgr2=0x7fdbc4195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:07:52.638 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.618+0000 7fdbc9dfa700 1 --2- 172.21.15.96:0/3227383618 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbc4105bd0 0x7fdbc4195a90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fdbb8006010 tx=0x7fdbb800bd70 comp rx=0 tx=0).stop 2024-02-19T19:07:52.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.618+0000 7fdbc9dfa700 1 -- 172.21.15.96:0/3227383618 shutdown_connections 2024-02-19T19:07:52.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.618+0000 7fdbc9dfa700 1 --2- 172.21.15.96:0/3227383618 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdbc40ffc20 0x7fdbc4195550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:52.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.618+0000 7fdbc9dfa700 1 --2- 172.21.15.96:0/3227383618 >> [v2:172.21.15.96:6800/967937024,v1:172.21.15.96:6801/967937024] conn(0x7fdbac06d520 0x7fdbac06f9e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:52.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.618+0000 7fdbc9dfa700 1 --2- 172.21.15.96:0/3227383618 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbc4105bd0 0x7fdbc4195a90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:07:52.639 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.618+0000 7fdbc9dfa700 1 -- 172.21.15.96:0/3227383618 >> 172.21.15.96:0/3227383618 conn(0x7fdbc4075670 msgr2=0x7fdbc40fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:07:52.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.618+0000 7fdbc9dfa700 1 -- 172.21.15.96:0/3227383618 shutdown_connections 2024-02-19T19:07:52.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:07:52.618+0000 7fdbc9dfa700 1 -- 172.21.15.96:0/3227383618 wait complete. 2024-02-19T19:07:52.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:52 smithi096 ceph-mon[29216]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:52.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:52 smithi096 ceph-mon[29216]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:52.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:52 smithi096 ceph-mon[29216]: Upgrade: Target is version 19.0.0-1450-gf78a58c0 (squid) 2024-02-19T19:07:52.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:52 smithi096 ceph-mon[29216]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, digests ['quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526'] 2024-02-19T19:07:52.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:52 smithi096 ceph-mon[29216]: Upgrade: Setting container_image for all mgr 2024-02-19T19:07:52.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:52 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/3481585783' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:52.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:52 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/1487876049' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:07:52.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:52 smithi125 ceph-mon[37556]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:52.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:52 smithi125 ceph-mon[37556]: from='client.14840 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:52.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:52 smithi125 ceph-mon[37556]: Upgrade: Target is version 19.0.0-1450-gf78a58c0 (squid) 2024-02-19T19:07:52.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:52 smithi125 ceph-mon[37556]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, digests ['quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526'] 2024-02-19T19:07:52.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:52 smithi125 ceph-mon[37556]: Upgrade: Setting container_image for all mgr 2024-02-19T19:07:52.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:52 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/3481585783' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:07:52.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:52 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/1487876049' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:07:53.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:53 smithi096 ceph-mon[29216]: pgmap v104: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:53.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:53 smithi096 ceph-mon[29216]: from='client.14852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:53.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:53 smithi096 ceph-mon[29216]: from='client.? 172.21.15.96:0/3227383618' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:07:53.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:53 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:07:53.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:53 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T19:07:53.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:53 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T19:07:53.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:53 smithi096 ceph-mon[29216]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:07:53.913 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:53 smithi125 ceph-mon[37556]: pgmap v104: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:53.913 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:53 smithi125 ceph-mon[37556]: from='client.14852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:07:53.913 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:53 smithi125 ceph-mon[37556]: from='client.? 172.21.15.96:0/3227383618' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:07:53.913 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:53 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' 2024-02-19T19:07:53.913 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:53 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T19:07:53.913 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:53 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T19:07:53.913 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:53 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:07:54.704 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:54 smithi096 ceph-mon[29216]: Upgrade: Updating mon.smithi096 2024-02-19T19:07:54.704 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:54 smithi096 ceph-mon[29216]: Deploying daemon mon.smithi096 on smithi096 2024-02-19T19:07:54.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:54 smithi125 ceph-mon[37556]: Upgrade: Updating mon.smithi096 2024-02-19T19:07:54.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:54 smithi125 ceph-mon[37556]: Deploying daemon mon.smithi096 on smithi096 2024-02-19T19:07:55.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:54 smithi096 systemd[1]: Stopping Ceph mon.smithi096 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T19:07:55.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:55 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096[29212]: 2024-02-19T19:07:55.246+0000 7fe854902700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi096 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T19:07:55.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:55 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096[29212]: 2024-02-19T19:07:55.246+0000 7fe854902700 -1 mon.smithi096@0(leader) e2 *** Got Signal Terminated *** 2024-02-19T19:07:55.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:55 smithi096 podman[112311]: 2024-02-19 19:07:55.308359644 +0000 UTC m=+0.186456102 container died 23d5b9626c48850f499130afab4722d7c99671c927866e99e03ea33f55882e80 (image=quay.io/ceph/ceph:v18.2.1, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.1, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-19T19:07:55.944 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:55 smithi096 podman[112311]: 2024-02-19 19:07:55.722534575 +0000 UTC m=+0.600631041 container cleanup 23d5b9626c48850f499130afab4722d7c99671c927866e99e03ea33f55882e80 (image=quay.io/ceph/ceph:v18.2.1, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=HEAD, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.1, GIT_BRANCH=HEAD) 2024-02-19T19:07:55.944 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:55 smithi096 bash[112311]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096 2024-02-19T19:07:56.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:55 smithi096 podman[112336]: 2024-02-19 19:07:55.923892267 +0000 UTC m=+0.616657046 container remove 23d5b9626c48850f499130afab4722d7c99671c927866e99e03ea33f55882e80 (image=quay.io/ceph/ceph:v18.2.1, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=-18.2.1, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=HEAD, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T19:07:56.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 systemd[1]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715@mon.smithi096.service: Deactivated successfully. 2024-02-19T19:07:56.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 systemd[1]: Stopped Ceph mon.smithi096 for 06580d2c-cf58-11ee-95bb-87774f69a715. 2024-02-19T19:07:56.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 systemd[1]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715@mon.smithi096.service: Consumed 13.183s CPU time. 2024-02-19T19:07:56.718 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 systemd[1]: Starting Ceph mon.smithi096 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T19:07:56.718 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 podman[112464]: 2024-02-19 19:07:56.464049601 +0000 UTC m=+0.017511928 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:07:56.718 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 podman[112464]: 2024-02-19 19:07:56.583555139 +0000 UTC m=+0.137017456 container create d70090d516e3e15263547e1a5a03c1e415208f10236f95bb463f99e57327d52c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-02-19T19:07:57.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 podman[112464]: 2024-02-19 19:07:56.829636331 +0000 UTC m=+0.383098654 container init d70090d516e3e15263547e1a5a03c1e415208f10236f95bb463f99e57327d52c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-02-19T19:07:57.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 podman[112464]: 2024-02-19 19:07:56.832768122 +0000 UTC m=+0.386230446 container start d70090d516e3e15263547e1a5a03c1e415208f10236f95bb463f99e57327d52c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-02-19T19:07:57.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: set uid:gid to 167:167 (ceph:ceph) 2024-02-19T19:07:57.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev), process ceph-mon, pid 2 2024-02-19T19:07:57.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: pidfile_write: ignore empty --pid-file 2024-02-19T19:07:57.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: load: jerasure load: lrc 2024-02-19T19:07:57.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: RocksDB version: 7.9.2 2024-02-19T19:07:57.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Git sha 0 2024-02-19T19:07:57.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Compile date 2024-02-15 18:05:23 2024-02-19T19:07:57.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: DB SUMMARY 2024-02-19T19:07:57.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: DB Session ID: 9N62YE8018IPJCQ3FOCS 2024-02-19T19:07:57.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: CURRENT file: CURRENT 2024-02-19T19:07:57.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: IDENTITY file: IDENTITY 2024-02-19T19:07:57.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1509 Bytes 2024-02-19T19:07:57.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi096/store.db dir, Total Num: 1, files: 000032.sst 2024-02-19T19:07:57.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi096/store.db: 000030.log size: 2828323 ; 2024-02-19T19:07:57.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.error_if_exists: 0 2024-02-19T19:07:57.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.create_if_missing: 0 2024-02-19T19:07:57.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.paranoid_checks: 1 2024-02-19T19:07:57.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-19T19:07:57.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-19T19:07:57.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-19T19:07:57.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.env: 0x55f2138d0ae0 2024-02-19T19:07:57.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.fs: PosixFileSystem 2024-02-19T19:07:57.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.info_log: 0x55f215c5b760 2024-02-19T19:07:57.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_file_opening_threads: 16 2024-02-19T19:07:57.290 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.statistics: (nil) 2024-02-19T19:07:57.290 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.use_fsync: 0 2024-02-19T19:07:57.290 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_log_file_size: 0 2024-02-19T19:07:57.290 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-19T19:07:57.291 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-19T19:07:57.291 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.keep_log_file_num: 1000 2024-02-19T19:07:57.291 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.recycle_log_file_num: 0 2024-02-19T19:07:57.291 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.allow_fallocate: 1 2024-02-19T19:07:57.291 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.allow_mmap_reads: 0 2024-02-19T19:07:57.291 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.allow_mmap_writes: 0 2024-02-19T19:07:57.291 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.use_direct_reads: 0 2024-02-19T19:07:57.291 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-19T19:07:57.291 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.create_missing_column_families: 0 2024-02-19T19:07:57.291 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.db_log_dir: 2024-02-19T19:07:57.291 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.wal_dir: 2024-02-19T19:07:57.291 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-19T19:07:57.291 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-19T19:07:57.292 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-19T19:07:57.292 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-19T19:07:57.292 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-19T19:07:57.292 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-19T19:07:57.292 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.advise_random_on_open: 1 2024-02-19T19:07:57.292 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.db_write_buffer_size: 0 2024-02-19T19:07:57.292 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.write_buffer_manager: 0x55f215c2f400 2024-02-19T19:07:57.292 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-19T19:07:57.292 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-19T19:07:57.292 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-19T19:07:57.292 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.rate_limiter: (nil) 2024-02-19T19:07:57.292 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-19T19:07:57.294 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.wal_recovery_mode: 2 2024-02-19T19:07:57.295 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.enable_thread_tracking: 0 2024-02-19T19:07:57.295 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.enable_pipelined_write: 0 2024-02-19T19:07:57.295 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.unordered_write: 0 2024-02-19T19:07:57.295 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-19T19:07:57.295 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-19T19:07:57.295 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-19T19:07:57.295 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-19T19:07:57.295 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.row_cache: None 2024-02-19T19:07:57.295 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.wal_filter: None 2024-02-19T19:07:57.295 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-19T19:07:57.295 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.allow_ingest_behind: 0 2024-02-19T19:07:57.295 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.two_write_queues: 0 2024-02-19T19:07:57.295 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.manual_wal_flush: 0 2024-02-19T19:07:57.296 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.wal_compression: 0 2024-02-19T19:07:57.296 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.atomic_flush: 0 2024-02-19T19:07:57.296 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-19T19:07:57.296 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-19T19:07:57.296 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-19T19:07:57.296 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.log_readahead_size: 0 2024-02-19T19:07:57.296 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-19T19:07:57.296 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.best_efforts_recovery: 0 2024-02-19T19:07:57.296 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-19T19:07:57.296 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-19T19:07:57.296 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.allow_data_in_errors: 0 2024-02-19T19:07:57.296 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.db_host_id: __hostname__ 2024-02-19T19:07:57.296 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-19T19:07:57.296 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_background_jobs: 2 2024-02-19T19:07:57.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_background_compactions: -1 2024-02-19T19:07:57.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_subcompactions: 1 2024-02-19T19:07:57.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-19T19:07:57.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-19T19:07:57.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-19T19:07:57.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_total_wal_size: 0 2024-02-19T19:07:57.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-19T19:07:57.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-19T19:07:57.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-19T19:07:57.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-19T19:07:57.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_open_files: -1 2024-02-19T19:07:57.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.bytes_per_sync: 0 2024-02-19T19:07:57.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-19T19:07:57.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-19T19:07:57.297 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compaction_readahead_size: 0 2024-02-19T19:07:57.298 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_background_flushes: -1 2024-02-19T19:07:57.298 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Compression algorithms supported: 2024-02-19T19:07:57.298 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-19T19:07:57.298 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: kZSTD supported: 0 2024-02-19T19:07:57.298 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: kXpressCompression supported: 0 2024-02-19T19:07:57.298 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: kLZ4HCCompression supported: 1 2024-02-19T19:07:57.298 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: kZlibCompression supported: 1 2024-02-19T19:07:57.298 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: kSnappyCompression supported: 1 2024-02-19T19:07:57.298 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: kLZ4Compression supported: 1 2024-02-19T19:07:57.298 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: kBZip2Compression supported: 0 2024-02-19T19:07:57.298 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-19T19:07:57.298 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-19T19:07:57.298 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi096/store.db/MANIFEST-000015 2024-02-19T19:07:57.298 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-19T19:07:57.298 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-19T19:07:57.299 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.merge_operator: 2024-02-19T19:07:57.299 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compaction_filter: None 2024-02-19T19:07:57.299 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compaction_filter_factory: None 2024-02-19T19:07:57.299 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.sst_partitioner_factory: None 2024-02-19T19:07:57.299 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-19T19:07:57.299 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-19T19:07:57.299 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f215c5b880) 2024-02-19T19:07:57.299 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: cache_index_and_filter_blocks: 1 2024-02-19T19:07:57.299 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-19T19:07:57.299 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-19T19:07:57.299 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: pin_top_level_index_and_filter: 1 2024-02-19T19:07:57.299 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: index_type: 0 2024-02-19T19:07:57.299 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: data_block_index_type: 0 2024-02-19T19:07:57.299 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: index_shortening: 1 2024-02-19T19:07:57.300 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-19T19:07:57.300 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: checksum: 4 2024-02-19T19:07:57.300 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: no_block_cache: 0 2024-02-19T19:07:57.300 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_cache: 0x55f215c5f090 2024-02-19T19:07:57.300 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_cache_name: BinnedLRUCache 2024-02-19T19:07:57.300 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_cache_options: 2024-02-19T19:07:57.300 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: capacity : 536870912 2024-02-19T19:07:57.300 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: num_shard_bits : 4 2024-02-19T19:07:57.300 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: strict_capacity_limit : 0 2024-02-19T19:07:57.300 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: high_pri_pool_ratio: 0.000 2024-02-19T19:07:57.300 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_cache_compressed: (nil) 2024-02-19T19:07:57.300 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: persistent_cache: (nil) 2024-02-19T19:07:57.300 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_size: 4096 2024-02-19T19:07:57.300 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_size_deviation: 10 2024-02-19T19:07:57.301 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_restart_interval: 16 2024-02-19T19:07:57.301 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: index_block_restart_interval: 1 2024-02-19T19:07:57.301 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: metadata_block_size: 4096 2024-02-19T19:07:57.301 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: partition_filters: 0 2024-02-19T19:07:57.301 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: use_delta_encoding: 1 2024-02-19T19:07:57.301 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: filter_policy: bloomfilter 2024-02-19T19:07:57.301 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: whole_key_filtering: 1 2024-02-19T19:07:57.301 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: verify_compression: 0 2024-02-19T19:07:57.301 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: read_amp_bytes_per_bit: 0 2024-02-19T19:07:57.301 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: format_version: 5 2024-02-19T19:07:57.301 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: enable_index_compression: 1 2024-02-19T19:07:57.301 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: block_align: 0 2024-02-19T19:07:57.301 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: max_auto_readahead_size: 262144 2024-02-19T19:07:57.301 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: prepopulate_block_cache: 0 2024-02-19T19:07:57.301 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: initial_auto_readahead_size: 8192 2024-02-19T19:07:57.301 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: num_file_reads_for_auto_readahead: 2 2024-02-19T19:07:57.302 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.write_buffer_size: 33554432 2024-02-19T19:07:57.302 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_write_buffer_number: 2 2024-02-19T19:07:57.302 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compression: NoCompression 2024-02-19T19:07:57.302 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.bottommost_compression: Disabled 2024-02-19T19:07:57.302 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.prefix_extractor: nullptr 2024-02-19T19:07:57.302 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-19T19:07:57.302 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.num_levels: 7 2024-02-19T19:07:57.302 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-19T19:07:57.302 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-19T19:07:57.302 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-19T19:07:57.302 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-19T19:07:57.302 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-19T19:07:57.302 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-19T19:07:57.302 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-19T19:07:57.302 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-19T19:07:57.303 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-19T19:07:57.303 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-19T19:07:57.303 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-19T19:07:57.303 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-19T19:07:57.303 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-19T19:07:57.303 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compression_opts.level: 32767 2024-02-19T19:07:57.303 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compression_opts.strategy: 0 2024-02-19T19:07:57.303 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-19T19:07:57.303 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-19T19:07:57.303 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-19T19:07:57.303 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-19T19:07:57.303 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compression_opts.enabled: false 2024-02-19T19:07:57.303 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-19T19:07:57.303 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-19T19:07:57.303 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-19T19:07:57.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-19T19:07:57.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.target_file_size_base: 67108864 2024-02-19T19:07:57.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-19T19:07:57.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-19T19:07:57.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-19T19:07:57.304 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-19T19:07:57.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-19T19:07:57.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-19T19:07:57.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-19T19:07:57.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-19T19:07:57.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-19T19:07:57.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-19T19:07:57.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-19T19:07:57.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-19T19:07:57.305 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-19T19:07:57.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-19T19:07:57.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.arena_block_size: 1048576 2024-02-19T19:07:57.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-19T19:07:57.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-19T19:07:57.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.disable_auto_compactions: 0 2024-02-19T19:07:57.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-19T19:07:57.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-19T19:07:57.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-19T19:07:57.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-19T19:07:57.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-19T19:07:57.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-19T19:07:57.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-19T19:07:57.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-19T19:07:57.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-19T19:07:57.306 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-19T19:07:57.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.table_properties_collectors: 2024-02-19T19:07:57.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.inplace_update_support: 0 2024-02-19T19:07:57.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-19T19:07:57.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-19T19:07:57.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-19T19:07:57.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-19T19:07:57.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.bloom_locality: 0 2024-02-19T19:07:57.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.max_successive_merges: 0 2024-02-19T19:07:57.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-19T19:07:57.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.paranoid_file_checks: 0 2024-02-19T19:07:57.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.force_consistency_checks: 1 2024-02-19T19:07:57.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.report_bg_io_stats: 0 2024-02-19T19:07:57.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.ttl: 2592000 2024-02-19T19:07:57.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-19T19:07:57.307 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-19T19:07:57.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-19T19:07:57.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.enable_blob_files: false 2024-02-19T19:07:57.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.min_blob_size: 0 2024-02-19T19:07:57.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.blob_file_size: 268435456 2024-02-19T19:07:57.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-19T19:07:57.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-19T19:07:57.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-19T19:07:57.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-19T19:07:57.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-19T19:07:57.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.blob_file_starting_level: 0 2024-02-19T19:07:57.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-19T19:07:57.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-19T19:07:57.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi096/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12138, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-02-19T19:07:57.308 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-02-19T19:07:57.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 69a6b136-c85f-416a-8963-0ad95b29c42d 2024-02-19T19:07:57.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708369676872895, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-02-19T19:07:57.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-02-19T19:07:57.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708369676881966, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 2481955, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12139, "largest_seqno": 14923, "table_properties": {"data_size": 2471303, "index_size": 6431, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3205, "raw_key_size": 27220, "raw_average_key_size": 21, "raw_value_size": 2447047, "raw_average_value_size": 1948, "num_data_blocks": 293, "num_entries": 1256, "num_filter_entries": 1256, "num_deletions": 257, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1708369676, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "69a6b136-c85f-416a-8963-0ad95b29c42d", "db_session_id": "9N62YE8018IPJCQ3FOCS", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-02-19T19:07:57.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708369676882051, "job": 1, "event": "recovery_finished"} 2024-02-19T19:07:57.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-02-19T19:07:57.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-19T19:07:57.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi096/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-19T19:07:57.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f215d4e000 2024-02-19T19:07:57.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: DB pointer 0x55f215d3a000 2024-02-19T19:07:57.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-19T19:07:57.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-19T19:07:57.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: ** DB Stats ** 2024-02-19T19:07:57.309 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T19:07:57.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-19T19:07:57.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-19T19:07:57.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T19:07:57.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-19T19:07:57.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-19T19:07:57.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T19:07:57.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2024-02-19T19:07:57.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: ** Compaction Stats [default] ** 2024-02-19T19:07:57.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-19T19:07:57.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-19T19:07:57.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: L0 1/0 2.37 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 563.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-02-19T19:07:57.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: L6 1/0 6.11 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-19T19:07:57.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Sum 2/0 8.48 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 563.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-02-19T19:07:57.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 563.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-02-19T19:07:57.310 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2024-02-19T19:07:57.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: ** Compaction Stats [default] ** 2024-02-19T19:07:57.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-19T19:07:57.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T19:07:57.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 563.6 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-02-19T19:07:57.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2024-02-19T19:07:57.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-19T19:07:57.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2024-02-19T19:07:57.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T19:07:57.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-02-19T19:07:57.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-19T19:07:57.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-19T19:07:57.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-19T19:07:57.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-19T19:07:57.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Cumulative compaction: 0.00 GB write, 99.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T19:07:57.311 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Interval compaction: 0.00 GB write, 99.12 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T19:07:57.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-19T19:07:57.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Block cache BinnedLRUCache@0x55f215c5f090#2 capacity: 512.00 MB usage: 9.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-02-19T19:07:57.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,3.28 KB,0.000625849%) IndexBlock(1,6.58 KB,0.00125468%) Misc(1,0.00 KB,0%) 2024-02-19T19:07:57.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2024-02-19T19:07:57.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-19T19:07:57.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: starting mon.smithi096 rank 0 at public addrs [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] at bind addrs [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi096 fsid 06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T19:07:57.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: mon.smithi096@-1(???) e2 preinit fsid 06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T19:07:57.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: mon.smithi096@-1(???).mds e19 new map 2024-02-19T19:07:57.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: mon.smithi096@-1(???).mds e19 print_map 2024-02-19T19:07:57.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: e19 2024-02-19T19:07:57.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:07:57.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:07:57.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: legacy client fscid: 1 2024-02-19T19:07:57.312 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2024-02-19T19:07:57.313 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: Filesystem 'cephfs' (1) 2024-02-19T19:07:57.313 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: fs_name cephfs 2024-02-19T19:07:57.313 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: epoch 19 2024-02-19T19:07:57.313 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-19T19:07:57.313 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: created 2024-02-19T19:01:42.881136+0000 2024-02-19T19:07:57.313 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: modified 2024-02-19T19:02:02.873590+0000 2024-02-19T19:07:57.313 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: tableserver 0 2024-02-19T19:07:57.313 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: root 0 2024-02-19T19:07:57.313 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: session_timeout 60 2024-02-19T19:07:57.313 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: session_autoclose 300 2024-02-19T19:07:57.313 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: max_file_size 1099511627776 2024-02-19T19:07:57.313 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: max_xattr_size 65536 2024-02-19T19:07:57.314 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: required_client_features {} 2024-02-19T19:07:57.314 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: last_failure 0 2024-02-19T19:07:57.314 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: last_failure_osd_epoch 46 2024-02-19T19:07:57.314 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:07:57.314 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: max_mds 2 2024-02-19T19:07:57.314 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: in 0,1 2024-02-19T19:07:57.314 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: up {0=14490,1=24267} 2024-02-19T19:07:57.314 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: failed 2024-02-19T19:07:57.314 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: damaged 2024-02-19T19:07:57.314 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: stopped 2024-02-19T19:07:57.314 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: data_pools [3] 2024-02-19T19:07:57.314 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: metadata_pool 2 2024-02-19T19:07:57.314 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: inline_data enabled 2024-02-19T19:07:57.315 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: balancer 2024-02-19T19:07:57.315 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: bal_rank_mask -1 2024-02-19T19:07:57.315 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: standby_count_wanted 1 2024-02-19T19:07:57.315 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: [mds.cephfs.smithi096.pccmys{0:14490} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:07:57.315 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: [mds.cephfs.smithi096.usrmcg{0:14502} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/413113741,v1:172.21.15.96:6827/413113741] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:07:57.315 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: [mds.cephfs.smithi125.srnlol{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.125:6824/3084054986,v1:172.21.15.125:6825/3084054986] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:07:57.315 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: [mds.cephfs.smithi125.pwyuga{1:24275} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.125:6826/3098247423,v1:172.21.15.125:6827/3098247423] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:07:57.315 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2024-02-19T19:07:57.315 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout: 2024-02-19T19:07:57.315 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: mon.smithi096@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-19T19:07:57.315 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: mon.smithi096@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-19T19:07:57.315 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: mon.smithi096@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-19T19:07:57.315 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: mon.smithi096@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-19T19:07:57.315 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 ceph-mon[112483]: mon.smithi096@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-02-19T19:07:57.315 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 bash[112464]: d70090d516e3e15263547e1a5a03c1e415208f10236f95bb463f99e57327d52c 2024-02-19T19:07:57.316 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:56 smithi096 systemd[1]: Started Ceph mon.smithi096 for 06580d2c-cf58-11ee-95bb-87774f69a715. 2024-02-19T19:07:58.690 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:58 smithi096 ceph-mon[112483]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2024-02-19T19:07:58.691 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:58 smithi096 ceph-mon[112483]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T19:07:58.691 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:58 smithi096 ceph-mon[112483]: pgmap v106: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:58.691 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:58 smithi096 ceph-mon[112483]: mon.smithi096 calling monitor election 2024-02-19T19:07:58.691 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:58 smithi096 ceph-mon[112483]: mon.smithi096 is new leader, mons smithi096,smithi125 in quorum (ranks 0,1) 2024-02-19T19:07:58.691 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:58 smithi096 ceph-mon[112483]: monmap e2: 2 mons at {smithi096=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],smithi125=[v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-19T19:07:58.691 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:58 smithi096 ceph-mon[112483]: fsmap cephfs:2 {0=cephfs.smithi096.pccmys=up:active,1=cephfs.smithi125.srnlol=up:active} 2 up:standby-replay 2024-02-19T19:07:58.691 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:58 smithi096 ceph-mon[112483]: osdmap e48: 6 total, 6 up, 6 in 2024-02-19T19:07:58.691 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:58 smithi096 ceph-mon[112483]: mgrmap e31: smithi096.zsjdff(active, since 3m), standbys: smithi125.ygdmdu 2024-02-19T19:07:58.691 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:58 smithi096 ceph-mon[112483]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T19:07:58.691 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:58 smithi096 ceph-mon[112483]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-19T19:07:58.691 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:58 smithi096 ceph-mon[112483]: fs cephfs has deprecated feature inline_data enabled. 2024-02-19T19:07:58.692 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:58 smithi096 ceph-mon[112483]: from='mgr.14652 ' entity='' 2024-02-19T19:07:58.692 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:07:58 smithi096 ceph-mon[112483]: mgrmap e32: smithi096.zsjdff(active, since 3m), standbys: smithi125.ygdmdu 2024-02-19T19:07:58.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:58 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2024-02-19T19:07:58.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:58 smithi125 ceph-mon[37556]: from='mgr.14652 172.21.15.96:0/856693330' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T19:07:58.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:58 smithi125 ceph-mon[37556]: pgmap v106: 65 pgs: 65 active+clean; 593 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:07:58.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:58 smithi125 ceph-mon[37556]: mon.smithi096 calling monitor election 2024-02-19T19:07:58.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:58 smithi125 ceph-mon[37556]: mon.smithi096 is new leader, mons smithi096,smithi125 in quorum (ranks 0,1) 2024-02-19T19:07:58.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:58 smithi125 ceph-mon[37556]: monmap e2: 2 mons at {smithi096=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],smithi125=[v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-19T19:07:58.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:58 smithi125 ceph-mon[37556]: fsmap cephfs:2 {0=cephfs.smithi096.pccmys=up:active,1=cephfs.smithi125.srnlol=up:active} 2 up:standby-replay 2024-02-19T19:07:58.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:58 smithi125 ceph-mon[37556]: osdmap e48: 6 total, 6 up, 6 in 2024-02-19T19:07:58.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:58 smithi125 ceph-mon[37556]: mgrmap e31: smithi096.zsjdff(active, since 3m), standbys: smithi125.ygdmdu 2024-02-19T19:07:58.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:58 smithi125 ceph-mon[37556]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T19:07:58.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:58 smithi125 ceph-mon[37556]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-19T19:07:58.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:58 smithi125 ceph-mon[37556]: fs cephfs has deprecated feature inline_data enabled. 2024-02-19T19:07:58.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:58 smithi125 ceph-mon[37556]: from='mgr.14652 ' entity='' 2024-02-19T19:07:58.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:07:58 smithi125 ceph-mon[37556]: mgrmap e32: smithi096.zsjdff(active, since 3m), standbys: smithi125.ygdmdu 2024-02-19T19:08:05.475 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:05 smithi125 ceph-mon[37556]: Standby manager daemon smithi125.ygdmdu restarted 2024-02-19T19:08:05.475 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:05 smithi125 ceph-mon[37556]: Standby manager daemon smithi125.ygdmdu started 2024-02-19T19:08:05.475 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:05 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.125:0/3897691614' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi125.ygdmdu/crt"}]: dispatch 2024-02-19T19:08:05.475 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:05 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.125:0/3897691614' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:08:05.475 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:05 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.125:0/3897691614' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi125.ygdmdu/key"}]: dispatch 2024-02-19T19:08:05.475 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:05 smithi125 ceph-mon[37556]: from='mgr.? 172.21.15.125:0/3897691614' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:08:05.475 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:05 smithi125 ceph-mon[37556]: Active manager daemon smithi096.zsjdff restarted 2024-02-19T19:08:05.475 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:05 smithi125 ceph-mon[37556]: Activating manager daemon smithi096.zsjdff 2024-02-19T19:08:05.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:05 smithi096 ceph-mon[112483]: Standby manager daemon smithi125.ygdmdu restarted 2024-02-19T19:08:05.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:05 smithi096 ceph-mon[112483]: Standby manager daemon smithi125.ygdmdu started 2024-02-19T19:08:05.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:05 smithi096 ceph-mon[112483]: from='mgr.? 172.21.15.125:0/3897691614' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi125.ygdmdu/crt"}]: dispatch 2024-02-19T19:08:05.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:05 smithi096 ceph-mon[112483]: from='mgr.? 172.21.15.125:0/3897691614' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-19T19:08:05.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:05 smithi096 ceph-mon[112483]: from='mgr.? 172.21.15.125:0/3897691614' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi125.ygdmdu/key"}]: dispatch 2024-02-19T19:08:05.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:05 smithi096 ceph-mon[112483]: from='mgr.? 172.21.15.125:0/3897691614' entity='mgr.smithi125.ygdmdu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-19T19:08:05.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:05 smithi096 ceph-mon[112483]: Active manager daemon smithi096.zsjdff restarted 2024-02-19T19:08:05.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:05 smithi096 ceph-mon[112483]: Activating manager daemon smithi096.zsjdff 2024-02-19T19:08:06.587 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: osdmap e49: 6 total, 6 up, 6 in 2024-02-19T19:08:06.587 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: mgrmap e33: smithi096.zsjdff(active, starting, since 0.00585717s), standbys: smithi125.ygdmdu 2024-02-19T19:08:06.588 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2024-02-19T19:08:06.588 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T19:08:06.588 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pccmys"}]: dispatch 2024-02-19T19:08:06.588 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.usrmcg"}]: dispatch 2024-02-19T19:08:06.588 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.srnlol"}]: dispatch 2024-02-19T19:08:06.588 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.pwyuga"}]: dispatch 2024-02-19T19:08:06.588 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr metadata", "who": "smithi096.zsjdff", "id": "smithi096.zsjdff"}]: dispatch 2024-02-19T19:08:06.588 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr metadata", "who": "smithi125.ygdmdu", "id": "smithi125.ygdmdu"}]: dispatch 2024-02-19T19:08:06.588 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T19:08:06.588 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T19:08:06.588 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T19:08:06.588 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T19:08:06.588 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:08:06.588 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:08:06.589 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T19:08:06.589 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T19:08:06.589 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T19:08:06.589 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: Manager daemon smithi096.zsjdff is now available 2024-02-19T19:08:06.589 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:08:06.589 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:08:06.589 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:08:06.589 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.zsjdff/mirror_snapshot_schedule"}]: dispatch 2024-02-19T19:08:06.589 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.zsjdff/trash_purge_schedule"}]: dispatch 2024-02-19T19:08:06.590 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: osdmap e49: 6 total, 6 up, 6 in 2024-02-19T19:08:06.590 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: mgrmap e33: smithi096.zsjdff(active, starting, since 0.00585717s), standbys: smithi125.ygdmdu 2024-02-19T19:08:06.590 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2024-02-19T19:08:06.590 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T19:08:06.590 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pccmys"}]: dispatch 2024-02-19T19:08:06.590 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.usrmcg"}]: dispatch 2024-02-19T19:08:06.590 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.srnlol"}]: dispatch 2024-02-19T19:08:06.590 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.pwyuga"}]: dispatch 2024-02-19T19:08:06.590 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr metadata", "who": "smithi096.zsjdff", "id": "smithi096.zsjdff"}]: dispatch 2024-02-19T19:08:06.590 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr metadata", "who": "smithi125.ygdmdu", "id": "smithi125.ygdmdu"}]: dispatch 2024-02-19T19:08:06.590 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T19:08:06.591 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T19:08:06.591 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T19:08:06.591 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T19:08:06.591 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:08:06.591 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:08:06.591 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-19T19:08:06.591 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-19T19:08:06.591 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-19T19:08:06.591 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: Manager daemon smithi096.zsjdff is now available 2024-02-19T19:08:06.591 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:08:06.591 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:08:06.591 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:08:06.591 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.zsjdff/mirror_snapshot_schedule"}]: dispatch 2024-02-19T19:08:06.591 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:06 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi096.zsjdff/trash_purge_schedule"}]: dispatch 2024-02-19T19:08:07.448 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:07 smithi125 ceph-mon[37556]: [19/Feb/2024:19:08:06] ENGINE Bus STARTING 2024-02-19T19:08:07.448 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:07 smithi125 ceph-mon[37556]: [19/Feb/2024:19:08:06] ENGINE Serving on https://172.21.15.96:7150 2024-02-19T19:08:07.448 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:07 smithi125 ceph-mon[37556]: [19/Feb/2024:19:08:06] ENGINE Serving on http://172.21.15.96:8765 2024-02-19T19:08:07.448 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:07 smithi125 ceph-mon[37556]: [19/Feb/2024:19:08:06] ENGINE Bus STARTED 2024-02-19T19:08:07.448 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:07 smithi125 ceph-mon[37556]: mgrmap e34: smithi096.zsjdff(active, since 1.0186s), standbys: smithi125.ygdmdu 2024-02-19T19:08:07.448 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:07 smithi125 ceph-mon[37556]: pgmap v3: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:08:07.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:07 smithi096 ceph-mon[112483]: [19/Feb/2024:19:08:06] ENGINE Bus STARTING 2024-02-19T19:08:07.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:07 smithi096 ceph-mon[112483]: [19/Feb/2024:19:08:06] ENGINE Serving on https://172.21.15.96:7150 2024-02-19T19:08:07.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:07 smithi096 ceph-mon[112483]: [19/Feb/2024:19:08:06] ENGINE Serving on http://172.21.15.96:8765 2024-02-19T19:08:07.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:07 smithi096 ceph-mon[112483]: [19/Feb/2024:19:08:06] ENGINE Bus STARTED 2024-02-19T19:08:07.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:07 smithi096 ceph-mon[112483]: mgrmap e34: smithi096.zsjdff(active, since 1.0186s), standbys: smithi125.ygdmdu 2024-02-19T19:08:07.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:07 smithi096 ceph-mon[112483]: pgmap v3: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:08:08.662 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:08 smithi096 ceph-mon[112483]: pgmap v4: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:08:08.662 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:08 smithi096 ceph-mon[112483]: mgrmap e35: smithi096.zsjdff(active, since 2s), standbys: smithi125.ygdmdu 2024-02-19T19:08:08.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:08 smithi125 ceph-mon[37556]: pgmap v4: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:08:08.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:08 smithi125 ceph-mon[37556]: mgrmap e35: smithi096.zsjdff(active, since 2s), standbys: smithi125.ygdmdu 2024-02-19T19:08:09.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:09 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:09.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:09 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:09.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:09 smithi125 ceph-mon[37556]: pgmap v5: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:08:10.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:09 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:10.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:09 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:10.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:09 smithi096 ceph-mon[112483]: pgmap v5: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:08:11.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:10 smithi096 ceph-mon[112483]: mgrmap e36: smithi096.zsjdff(active, since 4s), standbys: smithi125.ygdmdu 2024-02-19T19:08:11.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:10 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:11.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:10 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:11.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:10 smithi125 ceph-mon[37556]: mgrmap e36: smithi096.zsjdff(active, since 4s), standbys: smithi125.ygdmdu 2024-02-19T19:08:11.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:10 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:11.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:10 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:12.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:11 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:12.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:11 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:12.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:11 smithi125 ceph-mon[37556]: pgmap v6: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:08:12.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:11 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:12.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:11 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:12.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:11 smithi096 ceph-mon[112483]: pgmap v6: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:08:13.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:12 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:13.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:12 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:13.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:12 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:13.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:12 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:14.166 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:13 smithi096 ceph-mon[112483]: pgmap v7: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-02-19T19:08:14.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:13 smithi125 ceph-mon[37556]: pgmap v7: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-02-19T19:08:16.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:16 smithi125 ceph-mon[37556]: pgmap v8: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-02-19T19:08:16.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:16 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:16.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:16 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:16.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:16 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:16.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:16 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:08:16.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:16 smithi096 ceph-mon[112483]: pgmap v8: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-02-19T19:08:16.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:16 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:16.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:16 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:16.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:16 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:16.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:16 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:08:17.603 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:17 smithi125 ceph-mon[37556]: Detected new or changed devices on smithi096 2024-02-19T19:08:17.604 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:17 smithi125 ceph-mon[37556]: Updating smithi096:/etc/ceph/ceph.conf 2024-02-19T19:08:17.604 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:17 smithi125 ceph-mon[37556]: Updating smithi125:/etc/ceph/ceph.conf 2024-02-19T19:08:17.604 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:17 smithi125 ceph-mon[37556]: Updating smithi096:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:08:17.604 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:17 smithi125 ceph-mon[37556]: Updating smithi125:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:08:17.604 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:17 smithi125 ceph-mon[37556]: Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:08:17.604 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:17 smithi125 ceph-mon[37556]: Updating smithi125:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:08:17.604 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:17 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:17.604 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:17 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:17.604 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:17 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:17.604 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:17 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:17.604 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:17 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:17.604 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:17 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:08:17.605 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:17 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:08:17.605 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:17 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-19T19:08:17.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:17 smithi096 ceph-mon[112483]: Detected new or changed devices on smithi096 2024-02-19T19:08:17.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:17 smithi096 ceph-mon[112483]: Updating smithi096:/etc/ceph/ceph.conf 2024-02-19T19:08:17.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:17 smithi096 ceph-mon[112483]: Updating smithi125:/etc/ceph/ceph.conf 2024-02-19T19:08:17.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:17 smithi096 ceph-mon[112483]: Updating smithi096:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:08:17.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:17 smithi096 ceph-mon[112483]: Updating smithi125:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.conf 2024-02-19T19:08:17.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:17 smithi096 ceph-mon[112483]: Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:08:17.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:17 smithi096 ceph-mon[112483]: Updating smithi125:/etc/ceph/ceph.client.admin.keyring 2024-02-19T19:08:17.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:17.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:17.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:17.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:17.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:17.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:08:17.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:08:17.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-19T19:08:18.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:18 smithi125 ceph-mon[37556]: Updating smithi096:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:08:18.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:18 smithi125 ceph-mon[37556]: Updating smithi125:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:08:18.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:18 smithi125 ceph-mon[37556]: pgmap v9: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-19T19:08:18.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:18 smithi096 ceph-mon[112483]: Updating smithi096:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:08:18.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:18 smithi096 ceph-mon[112483]: Updating smithi125:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/config/ceph.client.admin.keyring 2024-02-19T19:08:18.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:18 smithi096 ceph-mon[112483]: pgmap v9: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-19T19:08:19.988 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:19 smithi125 ceph-mon[37556]: Upgrade: Updating mon.smithi125 2024-02-19T19:08:19.988 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:19 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:19.988 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:19 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T19:08:19.988 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:19 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T19:08:19.988 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:19 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:19.988 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:19 smithi125 ceph-mon[37556]: Deploying daemon mon.smithi125 on smithi125 2024-02-19T19:08:19.988 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:19 smithi125 ceph-mon[37556]: pgmap v10: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-02-19T19:08:20.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:19 smithi096 ceph-mon[112483]: Upgrade: Updating mon.smithi125 2024-02-19T19:08:20.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:19 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:20.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:19 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T19:08:20.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:19 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T19:08:20.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:19 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:20.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:19 smithi096 ceph-mon[112483]: Deploying daemon mon.smithi125 on smithi125 2024-02-19T19:08:20.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:19 smithi096 ceph-mon[112483]: pgmap v10: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-02-19T19:08:20.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:20 smithi125 systemd[1]: Stopping Ceph mon.smithi125 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T19:08:20.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:08:21.152 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:20 smithi125 ceph-mon[37556]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:08:21.152 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:20 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi125[37551]: 2024-02-19T19:08:20.796+0000 7fb78ef6b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi125 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T19:08:21.152 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:20 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi125[37551]: 2024-02-19T19:08:20.796+0000 7fb78ef6b700 -1 mon.smithi125@1(peon) e2 *** Got Signal Terminated *** 2024-02-19T19:08:21.152 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:20 smithi125 podman[85950]: 2024-02-19 19:08:20.848036702 +0000 UTC m=+0.163675009 container died 27b4cad04cc5a08c3095b5cc6c7a83a15f424a924db49a1ab2a67aeda1abc48a (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi125, GIT_CLEAN=True, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0) 2024-02-19T19:08:21.453 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:21 smithi125 podman[85950]: 2024-02-19 19:08:21.239097198 +0000 UTC m=+0.554735513 container cleanup 27b4cad04cc5a08c3095b5cc6c7a83a15f424a924db49a1ab2a67aeda1abc48a (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi125, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.build-date=20240214, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-02-19T19:08:21.453 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:21 smithi125 bash[85950]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi125 2024-02-19T19:08:21.874 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:21 smithi125 podman[85964]: 2024-02-19 19:08:21.507464786 +0000 UTC m=+0.655768166 container remove 27b4cad04cc5a08c3095b5cc6c7a83a15f424a924db49a1ab2a67aeda1abc48a (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi125, RELEASE=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240214, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.1) 2024-02-19T19:08:21.874 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:21 smithi125 systemd[1]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715@mon.smithi125.service: Deactivated successfully. 2024-02-19T19:08:21.874 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:21 smithi125 systemd[1]: Stopped Ceph mon.smithi125 for 06580d2c-cf58-11ee-95bb-87774f69a715. 2024-02-19T19:08:21.874 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:21 smithi125 systemd[1]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715@mon.smithi125.service: Consumed 7.150s CPU time. 2024-02-19T19:08:22.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:21 smithi125 systemd[1]: Starting Ceph mon.smithi125 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T19:08:22.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 podman[86096]: 2024-02-19 19:08:22.067301221 +0000 UTC m=+0.112817675 container create f56b17bdc9a041e4bb0514a8f440155c780167860a928ca0d196ec5992c68c23 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi125, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0) 2024-02-19T19:08:22.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 podman[86096]: 2024-02-19 19:08:21.971357176 +0000 UTC m=+0.016873572 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:08:22.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 podman[86096]: 2024-02-19 19:08:22.328667541 +0000 UTC m=+0.374183927 container init f56b17bdc9a041e4bb0514a8f440155c780167860a928ca0d196ec5992c68c23 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi125, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-19T19:08:22.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 podman[86096]: 2024-02-19 19:08:22.331718373 +0000 UTC m=+0.377234767 container start f56b17bdc9a041e4bb0514a8f440155c780167860a928ca0d196ec5992c68c23 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi125, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214) 2024-02-19T19:08:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: set uid:gid to 167:167 (ceph:ceph) 2024-02-19T19:08:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev), process ceph-mon, pid 2 2024-02-19T19:08:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: pidfile_write: ignore empty --pid-file 2024-02-19T19:08:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: load: jerasure load: lrc 2024-02-19T19:08:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: RocksDB version: 7.9.2 2024-02-19T19:08:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Git sha 0 2024-02-19T19:08:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Compile date 2024-02-15 18:05:23 2024-02-19T19:08:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: DB SUMMARY 2024-02-19T19:08:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: DB Session ID: BMGDXGX26P77UVTN3264 2024-02-19T19:08:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: CURRENT file: CURRENT 2024-02-19T19:08:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: IDENTITY file: IDENTITY 2024-02-19T19:08:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1403 Bytes 2024-02-19T19:08:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi125/store.db dir, Total Num: 1, files: 000027.sst 2024-02-19T19:08:22.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi125/store.db: 000025.log size: 6841600 ; 2024-02-19T19:08:22.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.error_if_exists: 0 2024-02-19T19:08:22.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.create_if_missing: 0 2024-02-19T19:08:22.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.paranoid_checks: 1 2024-02-19T19:08:22.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-19T19:08:22.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-19T19:08:22.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-19T19:08:22.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.env: 0x55907e905ae0 2024-02-19T19:08:22.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.fs: PosixFileSystem 2024-02-19T19:08:22.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.info_log: 0x55907f971760 2024-02-19T19:08:22.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_file_opening_threads: 16 2024-02-19T19:08:22.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.statistics: (nil) 2024-02-19T19:08:22.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.use_fsync: 0 2024-02-19T19:08:22.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_log_file_size: 0 2024-02-19T19:08:22.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-19T19:08:22.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-19T19:08:22.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.keep_log_file_num: 1000 2024-02-19T19:08:22.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.recycle_log_file_num: 0 2024-02-19T19:08:22.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.allow_fallocate: 1 2024-02-19T19:08:22.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.allow_mmap_reads: 0 2024-02-19T19:08:22.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.allow_mmap_writes: 0 2024-02-19T19:08:22.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.use_direct_reads: 0 2024-02-19T19:08:22.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-19T19:08:22.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.create_missing_column_families: 0 2024-02-19T19:08:22.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.db_log_dir: 2024-02-19T19:08:22.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.wal_dir: 2024-02-19T19:08:22.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-19T19:08:22.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-19T19:08:22.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-19T19:08:22.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-19T19:08:22.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-19T19:08:22.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-19T19:08:22.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.advise_random_on_open: 1 2024-02-19T19:08:22.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.db_write_buffer_size: 0 2024-02-19T19:08:22.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.write_buffer_manager: 0x55907f945400 2024-02-19T19:08:22.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-19T19:08:22.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-19T19:08:22.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-19T19:08:22.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.rate_limiter: (nil) 2024-02-19T19:08:22.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-19T19:08:22.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.wal_recovery_mode: 2 2024-02-19T19:08:22.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.enable_thread_tracking: 0 2024-02-19T19:08:22.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.enable_pipelined_write: 0 2024-02-19T19:08:22.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.unordered_write: 0 2024-02-19T19:08:22.707 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-19T19:08:22.707 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-19T19:08:22.707 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-19T19:08:22.707 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-19T19:08:22.707 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.row_cache: None 2024-02-19T19:08:22.707 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.wal_filter: None 2024-02-19T19:08:22.708 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-19T19:08:22.708 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.allow_ingest_behind: 0 2024-02-19T19:08:22.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.two_write_queues: 0 2024-02-19T19:08:22.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.manual_wal_flush: 0 2024-02-19T19:08:22.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.wal_compression: 0 2024-02-19T19:08:22.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.atomic_flush: 0 2024-02-19T19:08:22.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-19T19:08:22.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-19T19:08:22.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-19T19:08:22.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.log_readahead_size: 0 2024-02-19T19:08:22.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-19T19:08:22.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.best_efforts_recovery: 0 2024-02-19T19:08:22.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-19T19:08:22.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-19T19:08:22.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.allow_data_in_errors: 0 2024-02-19T19:08:22.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.db_host_id: __hostname__ 2024-02-19T19:08:22.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-19T19:08:22.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_background_jobs: 2 2024-02-19T19:08:22.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_background_compactions: -1 2024-02-19T19:08:22.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_subcompactions: 1 2024-02-19T19:08:22.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-19T19:08:22.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-19T19:08:22.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-19T19:08:22.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_total_wal_size: 0 2024-02-19T19:08:22.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-19T19:08:22.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-19T19:08:22.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-19T19:08:22.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-19T19:08:22.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_open_files: -1 2024-02-19T19:08:22.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.bytes_per_sync: 0 2024-02-19T19:08:22.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-19T19:08:22.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-19T19:08:22.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compaction_readahead_size: 0 2024-02-19T19:08:22.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_background_flushes: -1 2024-02-19T19:08:22.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Compression algorithms supported: 2024-02-19T19:08:22.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-19T19:08:22.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: kZSTD supported: 0 2024-02-19T19:08:22.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: kXpressCompression supported: 0 2024-02-19T19:08:22.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: kLZ4HCCompression supported: 1 2024-02-19T19:08:22.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: kZlibCompression supported: 1 2024-02-19T19:08:22.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: kSnappyCompression supported: 1 2024-02-19T19:08:22.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: kLZ4Compression supported: 1 2024-02-19T19:08:22.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: kBZip2Compression supported: 0 2024-02-19T19:08:22.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-19T19:08:22.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-19T19:08:22.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi125/store.db/MANIFEST-000010 2024-02-19T19:08:22.712 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-19T19:08:22.712 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-19T19:08:22.712 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.merge_operator: 2024-02-19T19:08:22.712 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compaction_filter: None 2024-02-19T19:08:22.712 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compaction_filter_factory: None 2024-02-19T19:08:22.712 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.sst_partitioner_factory: None 2024-02-19T19:08:22.712 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-19T19:08:22.712 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-19T19:08:22.712 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55907f971880) 2024-02-19T19:08:22.712 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: cache_index_and_filter_blocks: 1 2024-02-19T19:08:22.712 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-19T19:08:22.712 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-19T19:08:22.712 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: pin_top_level_index_and_filter: 1 2024-02-19T19:08:22.712 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: index_type: 0 2024-02-19T19:08:22.713 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: data_block_index_type: 0 2024-02-19T19:08:22.713 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: index_shortening: 1 2024-02-19T19:08:22.713 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-19T19:08:22.713 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: checksum: 4 2024-02-19T19:08:22.713 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: no_block_cache: 0 2024-02-19T19:08:22.713 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: block_cache: 0x55907f975090 2024-02-19T19:08:22.713 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: block_cache_name: BinnedLRUCache 2024-02-19T19:08:22.713 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: block_cache_options: 2024-02-19T19:08:22.713 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: capacity : 536870912 2024-02-19T19:08:22.713 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: num_shard_bits : 4 2024-02-19T19:08:22.713 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: strict_capacity_limit : 0 2024-02-19T19:08:22.713 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: high_pri_pool_ratio: 0.000 2024-02-19T19:08:22.713 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: block_cache_compressed: (nil) 2024-02-19T19:08:22.713 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: persistent_cache: (nil) 2024-02-19T19:08:22.714 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: block_size: 4096 2024-02-19T19:08:22.714 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: block_size_deviation: 10 2024-02-19T19:08:22.714 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: block_restart_interval: 16 2024-02-19T19:08:22.714 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: index_block_restart_interval: 1 2024-02-19T19:08:22.714 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: metadata_block_size: 4096 2024-02-19T19:08:22.714 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: partition_filters: 0 2024-02-19T19:08:22.714 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: use_delta_encoding: 1 2024-02-19T19:08:22.714 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: filter_policy: bloomfilter 2024-02-19T19:08:22.714 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: whole_key_filtering: 1 2024-02-19T19:08:22.714 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: verify_compression: 0 2024-02-19T19:08:22.714 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: read_amp_bytes_per_bit: 0 2024-02-19T19:08:22.714 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: format_version: 5 2024-02-19T19:08:22.714 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: enable_index_compression: 1 2024-02-19T19:08:22.714 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: block_align: 0 2024-02-19T19:08:22.714 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: max_auto_readahead_size: 262144 2024-02-19T19:08:22.715 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: prepopulate_block_cache: 0 2024-02-19T19:08:22.715 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: initial_auto_readahead_size: 8192 2024-02-19T19:08:22.715 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: num_file_reads_for_auto_readahead: 2 2024-02-19T19:08:22.715 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.write_buffer_size: 33554432 2024-02-19T19:08:22.715 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_write_buffer_number: 2 2024-02-19T19:08:22.715 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compression: NoCompression 2024-02-19T19:08:22.715 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.bottommost_compression: Disabled 2024-02-19T19:08:22.715 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.prefix_extractor: nullptr 2024-02-19T19:08:22.715 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-19T19:08:22.715 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.num_levels: 7 2024-02-19T19:08:22.715 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-19T19:08:22.715 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-19T19:08:22.715 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-19T19:08:22.715 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-19T19:08:22.715 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-19T19:08:22.715 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-19T19:08:22.715 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-19T19:08:22.716 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-19T19:08:22.716 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-19T19:08:22.716 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-19T19:08:22.716 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-19T19:08:22.716 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-19T19:08:22.716 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-19T19:08:22.716 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compression_opts.level: 32767 2024-02-19T19:08:22.716 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compression_opts.strategy: 0 2024-02-19T19:08:22.716 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-19T19:08:22.716 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-19T19:08:22.716 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-19T19:08:22.716 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-19T19:08:22.716 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compression_opts.enabled: false 2024-02-19T19:08:22.716 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-19T19:08:22.716 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-19T19:08:22.717 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-19T19:08:22.717 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-19T19:08:22.717 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.target_file_size_base: 67108864 2024-02-19T19:08:22.717 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-19T19:08:22.717 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-19T19:08:22.717 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-19T19:08:22.717 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-19T19:08:22.717 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-19T19:08:22.717 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-19T19:08:22.717 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-19T19:08:22.717 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-19T19:08:22.717 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-19T19:08:22.717 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-19T19:08:22.717 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-19T19:08:22.718 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-19T19:08:22.718 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-19T19:08:22.718 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-19T19:08:22.718 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.arena_block_size: 1048576 2024-02-19T19:08:22.718 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-19T19:08:22.718 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-19T19:08:22.718 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.disable_auto_compactions: 0 2024-02-19T19:08:22.718 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-19T19:08:22.718 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-19T19:08:22.718 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-19T19:08:22.718 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-19T19:08:22.718 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-19T19:08:22.718 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-19T19:08:22.718 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-19T19:08:22.718 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-19T19:08:22.718 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-19T19:08:22.719 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-19T19:08:22.719 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.table_properties_collectors: 2024-02-19T19:08:22.719 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.inplace_update_support: 0 2024-02-19T19:08:22.719 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-19T19:08:22.719 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-19T19:08:22.719 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-19T19:08:22.719 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-19T19:08:22.719 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.bloom_locality: 0 2024-02-19T19:08:22.719 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.max_successive_merges: 0 2024-02-19T19:08:22.719 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-19T19:08:22.719 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.paranoid_file_checks: 0 2024-02-19T19:08:22.719 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.force_consistency_checks: 1 2024-02-19T19:08:22.719 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.report_bg_io_stats: 0 2024-02-19T19:08:22.719 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.ttl: 2592000 2024-02-19T19:08:22.719 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-19T19:08:22.720 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-19T19:08:22.720 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-19T19:08:22.720 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.enable_blob_files: false 2024-02-19T19:08:22.720 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.min_blob_size: 0 2024-02-19T19:08:22.720 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.blob_file_size: 268435456 2024-02-19T19:08:22.720 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-19T19:08:22.720 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-19T19:08:22.720 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-19T19:08:22.720 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-19T19:08:22.720 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-19T19:08:22.720 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.blob_file_starting_level: 0 2024-02-19T19:08:22.720 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-19T19:08:22.720 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-19T19:08:22.720 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi125/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12100, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-02-19T19:08:22.721 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-02-19T19:08:22.721 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0f067443-18d0-4e63-876c-a107f7ae45b7 2024-02-19T19:08:22.721 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708369702371723, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-02-19T19:08:22.721 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-02-19T19:08:22.721 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708369702389196, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 4104384, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12105, "largest_seqno": 15661, "table_properties": {"data_size": 4091881, "index_size": 7834, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3653, "raw_key_size": 31969, "raw_average_key_size": 21, "raw_value_size": 4063339, "raw_average_value_size": 2785, "num_data_blocks": 355, "num_entries": 1459, "num_filter_entries": 1459, "num_deletions": 257, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1708369702, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0f067443-18d0-4e63-876c-a107f7ae45b7", "db_session_id": "BMGDXGX26P77UVTN3264", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-02-19T19:08:22.721 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: EVENT_LOG_v1 {"time_micros": 1708369702389349, "job": 1, "event": "recovery_finished"} 2024-02-19T19:08:22.721 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-02-19T19:08:22.721 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-19T19:08:22.721 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi125/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-19T19:08:22.721 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55907fa64000 2024-02-19T19:08:22.721 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: DB pointer 0x55907fa50000 2024-02-19T19:08:22.721 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-19T19:08:22.721 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-19T19:08:22.721 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: ** DB Stats ** 2024-02-19T19:08:22.721 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T19:08:22.722 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-19T19:08:22.722 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-19T19:08:22.722 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T19:08:22.722 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-19T19:08:22.722 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-19T19:08:22.722 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-19T19:08:22.722 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: 2024-02-19T19:08:22.722 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: ** Compaction Stats [default] ** 2024-02-19T19:08:22.722 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-19T19:08:22.722 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-19T19:08:22.722 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: L0 1/0 3.91 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 517.1 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-02-19T19:08:22.722 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: L6 1/0 6.11 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-19T19:08:22.722 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Sum 2/0 10.03 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 517.1 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-02-19T19:08:22.722 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 517.1 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-02-19T19:08:22.722 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: 2024-02-19T19:08:22.722 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: ** Compaction Stats [default] ** 2024-02-19T19:08:22.723 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-19T19:08:22.723 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-19T19:08:22.723 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 517.1 0.01 0.00 1 0.008 0 0 0.0 0.0 2024-02-19T19:08:22.723 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: 2024-02-19T19:08:22.723 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-19T19:08:22.723 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: 2024-02-19T19:08:22.723 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-19T19:08:22.723 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Flush(GB): cumulative 0.004, interval 0.004 2024-02-19T19:08:22.723 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-19T19:08:22.723 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-19T19:08:22.723 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-19T19:08:22.723 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-19T19:08:22.723 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Cumulative compaction: 0.00 GB write, 125.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T19:08:22.723 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Interval compaction: 0.00 GB write, 125.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-19T19:08:22.723 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-19T19:08:22.724 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Block cache BinnedLRUCache@0x55907f975090#2 capacity: 512.00 MB usage: 12.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-02-19T19:08:22.724 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,4.03 KB,0.0007689%) IndexBlock(1,8.08 KB,0.00154078%) Misc(1,0.00 KB,0%) 2024-02-19T19:08:22.724 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: 2024-02-19T19:08:22.724 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-19T19:08:22.724 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: starting mon.smithi125 rank 1 at public addrs [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] at bind addrs [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi125 fsid 06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T19:08:22.724 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: mon.smithi125@-1(???) e2 preinit fsid 06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T19:08:22.724 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: mon.smithi125@-1(???).mds e19 new map 2024-02-19T19:08:22.724 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: mon.smithi125@-1(???).mds e19 print_map 2024-02-19T19:08:22.724 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: e19 2024-02-19T19:08:22.724 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:08:22.724 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:08:22.724 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: legacy client fscid: 1 2024-02-19T19:08:22.724 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: 2024-02-19T19:08:22.724 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: Filesystem 'cephfs' (1) 2024-02-19T19:08:22.725 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: fs_name cephfs 2024-02-19T19:08:22.725 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: epoch 19 2024-02-19T19:08:22.725 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-19T19:08:22.725 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: created 2024-02-19T19:01:42.881136+0000 2024-02-19T19:08:22.725 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: modified 2024-02-19T19:02:02.873590+0000 2024-02-19T19:08:22.725 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: tableserver 0 2024-02-19T19:08:22.725 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: root 0 2024-02-19T19:08:22.725 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: session_timeout 60 2024-02-19T19:08:22.725 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: session_autoclose 300 2024-02-19T19:08:22.725 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: max_file_size 1099511627776 2024-02-19T19:08:22.725 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: max_xattr_size 65536 2024-02-19T19:08:22.725 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: required_client_features {} 2024-02-19T19:08:22.725 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: last_failure 0 2024-02-19T19:08:22.725 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: last_failure_osd_epoch 46 2024-02-19T19:08:22.725 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:08:22.726 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: max_mds 2 2024-02-19T19:08:22.726 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: in 0,1 2024-02-19T19:08:22.726 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: up {0=14490,1=24267} 2024-02-19T19:08:22.726 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: failed 2024-02-19T19:08:22.726 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: damaged 2024-02-19T19:08:22.726 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: stopped 2024-02-19T19:08:22.726 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: data_pools [3] 2024-02-19T19:08:22.726 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: metadata_pool 2 2024-02-19T19:08:22.726 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: inline_data enabled 2024-02-19T19:08:22.726 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: balancer 2024-02-19T19:08:22.726 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: bal_rank_mask -1 2024-02-19T19:08:22.726 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: standby_count_wanted 1 2024-02-19T19:08:22.726 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: [mds.cephfs.smithi096.pccmys{0:14490} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:08:22.726 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: [mds.cephfs.smithi096.usrmcg{0:14502} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/413113741,v1:172.21.15.96:6827/413113741] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:08:22.726 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: [mds.cephfs.smithi125.srnlol{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.125:6824/3084054986,v1:172.21.15.125:6825/3084054986] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:08:22.727 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: [mds.cephfs.smithi125.pwyuga{1:24275} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.125:6826/3098247423,v1:172.21.15.125:6827/3098247423] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:08:22.727 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: 2024-02-19T19:08:22.727 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout: 2024-02-19T19:08:22.727 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: mon.smithi125@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-19T19:08:22.727 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: mon.smithi125@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-19T19:08:22.727 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: mon.smithi125@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-19T19:08:22.727 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: mon.smithi125@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-19T19:08:22.727 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 ceph-mon[86115]: mon.smithi125@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-02-19T19:08:22.727 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 bash[86096]: f56b17bdc9a041e4bb0514a8f440155c780167860a928ca0d196ec5992c68c23 2024-02-19T19:08:22.727 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:22 smithi125 systemd[1]: Started Ceph mon.smithi125 for 06580d2c-cf58-11ee-95bb-87774f69a715. 2024-02-19T19:08:22.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.754+0000 7fea65ffb700 1 -- 172.21.15.96:0/4161056613 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea60007ea0 con 0x7fea68100ea0 2024-02-19T19:08:22.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.754+0000 7fea6d427700 1 -- 172.21.15.96:0/4161056613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea68100ea0 msgr2=0x7fea68101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:22.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.754+0000 7fea6d427700 1 --2- 172.21.15.96:0/4161056613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea68100ea0 0x7fea68101280 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fea6000b0a0 tx=0x7fea6000b3b0 comp rx=0 tx=0).stop 2024-02-19T19:08:22.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.754+0000 7fea6d427700 1 -- 172.21.15.96:0/4161056613 shutdown_connections 2024-02-19T19:08:22.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.754+0000 7fea6d427700 1 --2- 172.21.15.96:0/4161056613 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea68101850 0x7fea681058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:22.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.754+0000 7fea6d427700 1 --2- 172.21.15.96:0/4161056613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea68100ea0 0x7fea68101280 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:22.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.754+0000 7fea6d427700 1 -- 172.21.15.96:0/4161056613 >> 172.21.15.96:0/4161056613 conn(0x7fea680fc750 msgr2=0x7fea680feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:22.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.754+0000 7fea6d427700 1 -- 172.21.15.96:0/4161056613 shutdown_connections 2024-02-19T19:08:22.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.754+0000 7fea6d427700 1 -- 172.21.15.96:0/4161056613 wait complete. 2024-02-19T19:08:22.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.755+0000 7fea6d427700 1 Processor -- start 2024-02-19T19:08:22.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.755+0000 7fea6d427700 1 -- start start 2024-02-19T19:08:22.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.756+0000 7fea6d427700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea68100ea0 0x7fea6819c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:22.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.756+0000 7fea6d427700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea68101850 0x7fea6819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:22.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.756+0000 7fea6d427700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6819d2a0 con 0x7fea68100ea0 2024-02-19T19:08:22.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.756+0000 7fea6d427700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea68196750 con 0x7fea68101850 2024-02-19T19:08:22.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.756+0000 7fea66ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea68100ea0 0x7fea6819c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:22.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.756+0000 7fea667fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea68101850 0x7fea6819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:22.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.756+0000 7fea66ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea68100ea0 0x7fea6819c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58904/0 (socket says 172.21.15.96:58904) 2024-02-19T19:08:22.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.756+0000 7fea66ffd700 1 -- 172.21.15.96:0/1535917674 learned_addr learned my addr 172.21.15.96:0/1535917674 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:08:22.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.756+0000 7fea667fc700 1 -- 172.21.15.96:0/1535917674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea68101850 msgr2=0x7fea6819cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-19T19:08:22.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.756+0000 7fea667fc700 1 -- 172.21.15.96:0/1535917674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea68101850 msgr2=0x7fea6819cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-19T19:08:22.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.756+0000 7fea667fc700 1 --2- 172.21.15.96:0/1535917674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea68101850 0x7fea6819cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T19:08:22.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.756+0000 7fea667fc700 1 --2- 172.21.15.96:0/1535917674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea68101850 0x7fea6819cc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T19:08:22.778 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.756+0000 7fea66ffd700 1 -- 172.21.15.96:0/1535917674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea68101850 msgr2=0x7fea6819cc10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T19:08:22.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.756+0000 7fea66ffd700 1 --2- 172.21.15.96:0/1535917674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea68101850 0x7fea6819cc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:22.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.756+0000 7fea66ffd700 1 -- 172.21.15.96:0/1535917674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea60009d00 con 0x7fea68100ea0 2024-02-19T19:08:22.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.756+0000 7fea66ffd700 1 --2- 172.21.15.96:0/1535917674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea68100ea0 0x7fea6819c6d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea60015040 tx=0x7fea600077f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:22.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.758+0000 7fea5ffff700 1 -- 172.21.15.96:0/1535917674 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea6000e040 con 0x7fea68100ea0 2024-02-19T19:08:22.779 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.758+0000 7fea5ffff700 1 -- 172.21.15.96:0/1535917674 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea60004990 con 0x7fea68100ea0 2024-02-19T19:08:22.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.758+0000 7fea6d427700 1 -- 172.21.15.96:0/1535917674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea681969d0 con 0x7fea68100ea0 2024-02-19T19:08:22.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.758+0000 7fea5ffff700 1 -- 172.21.15.96:0/1535917674 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea6001dc70 con 0x7fea68100ea0 2024-02-19T19:08:22.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.758+0000 7fea6d427700 1 -- 172.21.15.96:0/1535917674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea68196ec0 con 0x7fea68100ea0 2024-02-19T19:08:22.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.759+0000 7fea6d427700 1 -- 172.21.15.96:0/1535917674 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea681091f0 con 0x7fea68100ea0 2024-02-19T19:08:22.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.760+0000 7fea5ffff700 1 -- 172.21.15.96:0/1535917674 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 36) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fea60019070 con 0x7fea68100ea0 2024-02-19T19:08:22.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.760+0000 7fea5ffff700 1 --2- 172.21.15.96:0/1535917674 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fea5406d9d0 0x7fea5406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:22.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.760+0000 7fea5ffff700 1 -- 172.21.15.96:0/1535917674 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fea6008efe0 con 0x7fea68100ea0 2024-02-19T19:08:22.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.760+0000 7fea667fc700 1 --2- 172.21.15.96:0/1535917674 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fea5406d9d0 0x7fea5406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:22.781 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.761+0000 7fea667fc700 1 --2- 172.21.15.96:0/1535917674 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fea5406d9d0 0x7fea5406fe90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fea50005950 tx=0x7fea500058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:22.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.765+0000 7fea5ffff700 1 -- 172.21.15.96:0/1535917674 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fea6005c240 con 0x7fea68100ea0 2024-02-19T19:08:23.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.986+0000 7fea6d427700 1 -- 172.21.15.96:0/1535917674 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fea68197cd0 con 0x7fea5406d9d0 2024-02-19T19:08:23.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.988+0000 7fea5ffff700 1 -- 172.21.15.96:0/1535917674 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fea68197cd0 con 0x7fea5406d9d0 2024-02-19T19:08:23.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.990+0000 7fea6d427700 1 -- 172.21.15.96:0/1535917674 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fea5406d9d0 msgr2=0x7fea5406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:23.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.990+0000 7fea6d427700 1 --2- 172.21.15.96:0/1535917674 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fea5406d9d0 0x7fea5406fe90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fea50005950 tx=0x7fea500058e0 comp rx=0 tx=0).stop 2024-02-19T19:08:23.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.990+0000 7fea6d427700 1 -- 172.21.15.96:0/1535917674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea68100ea0 msgr2=0x7fea6819c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:23.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.990+0000 7fea6d427700 1 --2- 172.21.15.96:0/1535917674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea68100ea0 0x7fea6819c6d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea60015040 tx=0x7fea600077f0 comp rx=0 tx=0).stop 2024-02-19T19:08:23.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.990+0000 7fea6d427700 1 -- 172.21.15.96:0/1535917674 shutdown_connections 2024-02-19T19:08:23.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.990+0000 7fea6d427700 1 --2- 172.21.15.96:0/1535917674 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fea5406d9d0 0x7fea5406fe90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:23.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.990+0000 7fea6d427700 1 --2- 172.21.15.96:0/1535917674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea68100ea0 0x7fea6819c6d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:23.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.990+0000 7fea6d427700 1 --2- 172.21.15.96:0/1535917674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fea68101850 0x7fea6819cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:23.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.990+0000 7fea6d427700 1 -- 172.21.15.96:0/1535917674 >> 172.21.15.96:0/1535917674 conn(0x7fea680fc750 msgr2=0x7fea680fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:23.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.990+0000 7fea6d427700 1 -- 172.21.15.96:0/1535917674 shutdown_connections 2024-02-19T19:08:23.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:22.990+0000 7fea6d427700 1 -- 172.21.15.96:0/1535917674 wait complete. 2024-02-19T19:08:23.021 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:08:23.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.095+0000 7f7f0025b700 1 -- 172.21.15.96:0/639179653 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ef8101850 msgr2=0x7f7ef81058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:23.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.095+0000 7f7f0025b700 1 --2- 172.21.15.96:0/639179653 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ef8101850 0x7f7ef81058a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8009910 tx=0x7f7ee8009c20 comp rx=0 tx=0).stop 2024-02-19T19:08:23.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.095+0000 7f7f0025b700 1 -- 172.21.15.96:0/639179653 shutdown_connections 2024-02-19T19:08:23.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.095+0000 7f7f0025b700 1 --2- 172.21.15.96:0/639179653 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ef8101850 0x7f7ef81058a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:23.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.095+0000 7f7f0025b700 1 --2- 172.21.15.96:0/639179653 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ef8100ea0 0x7f7ef8101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:23.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.095+0000 7f7f0025b700 1 -- 172.21.15.96:0/639179653 >> 172.21.15.96:0/639179653 conn(0x7f7ef80fc750 msgr2=0x7f7ef80feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:23.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.095+0000 7f7f0025b700 1 -- 172.21.15.96:0/639179653 shutdown_connections 2024-02-19T19:08:23.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.095+0000 7f7f0025b700 1 -- 172.21.15.96:0/639179653 wait complete. 2024-02-19T19:08:23.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.096+0000 7f7f0025b700 1 Processor -- start 2024-02-19T19:08:23.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.096+0000 7f7f0025b700 1 -- start start 2024-02-19T19:08:23.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.096+0000 7f7f0025b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ef8100ea0 0x7f7ef819e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:23.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.096+0000 7f7f0025b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ef8101850 0x7f7ef819eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:23.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.096+0000 7f7f0025b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef819f430 con 0x7f7ef8101850 2024-02-19T19:08:23.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.096+0000 7f7f0025b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef81988e0 con 0x7f7ef8100ea0 2024-02-19T19:08:23.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.096+0000 7f7efd7f6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ef8101850 0x7f7ef819eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:23.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.096+0000 7f7efdff7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ef8100ea0 0x7f7ef819e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:23.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.096+0000 7f7efd7f6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ef8101850 0x7f7ef819eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58918/0 (socket says 172.21.15.96:58918) 2024-02-19T19:08:23.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.096+0000 7f7efd7f6700 1 -- 172.21.15.96:0/2339729209 learned_addr learned my addr 172.21.15.96:0/2339729209 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:08:23.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.096+0000 7f7efdff7700 1 -- 172.21.15.96:0/2339729209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ef8100ea0 msgr2=0x7f7ef819e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-19T19:08:23.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.096+0000 7f7efdff7700 1 -- 172.21.15.96:0/2339729209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ef8100ea0 msgr2=0x7f7ef819e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-19T19:08:23.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.096+0000 7f7efdff7700 1 --2- 172.21.15.96:0/2339729209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ef8100ea0 0x7f7ef819e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T19:08:23.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.096+0000 7f7efdff7700 1 --2- 172.21.15.96:0/2339729209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ef8100ea0 0x7f7ef819e860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T19:08:23.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.096+0000 7f7efd7f6700 1 -- 172.21.15.96:0/2339729209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ef8100ea0 msgr2=0x7f7ef819e860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T19:08:23.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.096+0000 7f7efd7f6700 1 --2- 172.21.15.96:0/2339729209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ef8100ea0 0x7f7ef819e860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:23.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.096+0000 7f7efd7f6700 1 -- 172.21.15.96:0/2339729209 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee80095f0 con 0x7f7ef8101850 2024-02-19T19:08:23.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.096+0000 7f7efd7f6700 1 --2- 172.21.15.96:0/2339729209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ef8101850 0x7f7ef819eda0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ee80092e0 tx=0x7f7ee800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:23.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.097+0000 7f7eeeffd700 1 -- 172.21.15.96:0/2339729209 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ee801d070 con 0x7f7ef8101850 2024-02-19T19:08:23.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.097+0000 7f7eeeffd700 1 -- 172.21.15.96:0/2339729209 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ee8005dc0 con 0x7f7ef8101850 2024-02-19T19:08:23.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.097+0000 7f7f0025b700 1 -- 172.21.15.96:0/2339729209 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef8198b60 con 0x7f7ef8101850 2024-02-19T19:08:23.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.097+0000 7f7f0025b700 1 -- 172.21.15.96:0/2339729209 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef8199050 con 0x7f7ef8101850 2024-02-19T19:08:23.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.097+0000 7f7eeeffd700 1 -- 172.21.15.96:0/2339729209 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ee8017400 con 0x7f7ef8101850 2024-02-19T19:08:23.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.097+0000 7f7f0025b700 1 -- 172.21.15.96:0/2339729209 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7edc005320 con 0x7f7ef8101850 2024-02-19T19:08:23.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.098+0000 7f7eeeffd700 1 -- 172.21.15.96:0/2339729209 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 36) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f7ee800f460 con 0x7f7ef8101850 2024-02-19T19:08:23.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.098+0000 7f7eeeffd700 1 --2- 172.21.15.96:0/2339729209 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7ee406d9e0 0x7f7ee406fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:23.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.098+0000 7f7eeeffd700 1 -- 172.21.15.96:0/2339729209 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7ee808ea10 con 0x7f7ef8101850 2024-02-19T19:08:23.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.098+0000 7f7efdff7700 1 --2- 172.21.15.96:0/2339729209 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7ee406d9e0 0x7f7ee406fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:23.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.099+0000 7f7efdff7700 1 --2- 172.21.15.96:0/2339729209 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7ee406d9e0 0x7f7ee406fea0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4005920 tx=0x7f7ef400b2c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:23.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.103+0000 7f7eeeffd700 1 -- 172.21.15.96:0/2339729209 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7ee805bc00 con 0x7f7ef8101850 2024-02-19T19:08:23.336 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.315+0000 7f7f0025b700 1 -- 172.21.15.96:0/2339729209 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7edc000bf0 con 0x7f7ee406d9e0 2024-02-19T19:08:23.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.316+0000 7f7eeeffd700 1 -- 172.21.15.96:0/2339729209 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f7edc000bf0 con 0x7f7ee406d9e0 2024-02-19T19:08:23.339 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.318+0000 7f7f0025b700 1 -- 172.21.15.96:0/2339729209 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7ee406d9e0 msgr2=0x7f7ee406fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:23.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.318+0000 7f7f0025b700 1 --2- 172.21.15.96:0/2339729209 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7ee406d9e0 0x7f7ee406fea0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4005920 tx=0x7f7ef400b2c0 comp rx=0 tx=0).stop 2024-02-19T19:08:23.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.318+0000 7f7f0025b700 1 -- 172.21.15.96:0/2339729209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ef8101850 msgr2=0x7f7ef819eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:23.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.318+0000 7f7f0025b700 1 --2- 172.21.15.96:0/2339729209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ef8101850 0x7f7ef819eda0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7ee80092e0 tx=0x7f7ee800be20 comp rx=0 tx=0).stop 2024-02-19T19:08:23.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.319+0000 7f7f0025b700 1 -- 172.21.15.96:0/2339729209 shutdown_connections 2024-02-19T19:08:23.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.319+0000 7f7f0025b700 1 --2- 172.21.15.96:0/2339729209 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7ee406d9e0 0x7f7ee406fea0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:23.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.319+0000 7f7f0025b700 1 --2- 172.21.15.96:0/2339729209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ef8100ea0 0x7f7ef819e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:23.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.319+0000 7f7f0025b700 1 --2- 172.21.15.96:0/2339729209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ef8101850 0x7f7ef819eda0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:23.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.319+0000 7f7f0025b700 1 -- 172.21.15.96:0/2339729209 >> 172.21.15.96:0/2339729209 conn(0x7f7ef80fc750 msgr2=0x7f7ef80fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:23.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.319+0000 7f7f0025b700 1 -- 172.21.15.96:0/2339729209 shutdown_connections 2024-02-19T19:08:23.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.319+0000 7f7f0025b700 1 -- 172.21.15.96:0/2339729209 wait complete. 2024-02-19T19:08:23.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.424+0000 7f473e6e9700 1 -- 172.21.15.96:0/258423380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4738101e00 msgr2=0x7f47381021e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:23.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.424+0000 7f473e6e9700 1 --2- 172.21.15.96:0/258423380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4738101e00 0x7f47381021e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4728009910 tx=0x7f4728009c20 comp rx=0 tx=0).stop 2024-02-19T19:08:23.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.424+0000 7f473e6e9700 1 -- 172.21.15.96:0/258423380 shutdown_connections 2024-02-19T19:08:23.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.424+0000 7f473e6e9700 1 --2- 172.21.15.96:0/258423380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4738102720 0x7f473810ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:23.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.424+0000 7f473e6e9700 1 --2- 172.21.15.96:0/258423380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4738101e00 0x7f47381021e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:23.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.424+0000 7f473e6e9700 1 -- 172.21.15.96:0/258423380 >> 172.21.15.96:0/258423380 conn(0x7f47380fb650 msgr2=0x7f47380fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:23.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.424+0000 7f473e6e9700 1 -- 172.21.15.96:0/258423380 shutdown_connections 2024-02-19T19:08:23.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.424+0000 7f473e6e9700 1 -- 172.21.15.96:0/258423380 wait complete. 2024-02-19T19:08:23.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.425+0000 7f473e6e9700 1 Processor -- start 2024-02-19T19:08:23.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.425+0000 7f473e6e9700 1 -- start start 2024-02-19T19:08:23.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.425+0000 7f473e6e9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4738101e00 0x7f473819c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:23.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.425+0000 7f473e6e9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4738102720 0x7f473819cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:23.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.425+0000 7f473e6e9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473819d260 con 0x7f4738101e00 2024-02-19T19:08:23.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.425+0000 7f473e6e9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4738196710 con 0x7f4738102720 2024-02-19T19:08:23.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.425+0000 7f4737fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4738101e00 0x7f473819c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:23.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.425+0000 7f4737fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4738101e00 0x7f473819c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58934/0 (socket says 172.21.15.96:58934) 2024-02-19T19:08:23.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.425+0000 7f4737fff700 1 -- 172.21.15.96:0/3188498504 learned_addr learned my addr 172.21.15.96:0/3188498504 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:08:23.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.425+0000 7f47377fe700 1 --2- 172.21.15.96:0/3188498504 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4738102720 0x7f473819cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:23.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.425+0000 7f4737fff700 1 -- 172.21.15.96:0/3188498504 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4738102720 msgr2=0x7f473819cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:23.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.425+0000 7f4737fff700 1 --2- 172.21.15.96:0/3188498504 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4738102720 0x7f473819cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:23.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.425+0000 7f4737fff700 1 -- 172.21.15.96:0/3188498504 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47280095f0 con 0x7f4738101e00 2024-02-19T19:08:23.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.426+0000 7f4737fff700 1 --2- 172.21.15.96:0/3188498504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4738101e00 0x7f473819c690 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4728006010 tx=0x7f472800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:23.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.426+0000 7f47357fa700 1 -- 172.21.15.96:0/3188498504 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f472801d070 con 0x7f4738101e00 2024-02-19T19:08:23.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.426+0000 7f47357fa700 1 -- 172.21.15.96:0/3188498504 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f472800f460 con 0x7f4738101e00 2024-02-19T19:08:23.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.426+0000 7f473e6e9700 1 -- 172.21.15.96:0/3188498504 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4738196990 con 0x7f4738101e00 2024-02-19T19:08:23.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.426+0000 7f47357fa700 1 -- 172.21.15.96:0/3188498504 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4728017630 con 0x7f4738101e00 2024-02-19T19:08:23.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.426+0000 7f473e6e9700 1 -- 172.21.15.96:0/3188498504 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4738196e80 con 0x7f4738101e00 2024-02-19T19:08:23.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.427+0000 7f473e6e9700 1 -- 172.21.15.96:0/3188498504 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4738108310 con 0x7f4738101e00 2024-02-19T19:08:23.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.427+0000 7f47357fa700 1 -- 172.21.15.96:0/3188498504 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 36) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f472800f5d0 con 0x7f4738101e00 2024-02-19T19:08:23.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.428+0000 7f47357fa700 1 --2- 172.21.15.96:0/3188498504 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f472006d9e0 0x7f472006fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:23.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.428+0000 7f47357fa700 1 -- 172.21.15.96:0/3188498504 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f472808eb50 con 0x7f4738101e00 2024-02-19T19:08:23.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.428+0000 7f47377fe700 1 --2- 172.21.15.96:0/3188498504 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f472006d9e0 0x7f472006fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:23.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.428+0000 7f47377fe700 1 --2- 172.21.15.96:0/3188498504 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f472006d9e0 0x7f472006fea0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f472c005950 tx=0x7f472c0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:23.453 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.432+0000 7f47357fa700 1 -- 172.21.15.96:0/3188498504 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f472805bd40 con 0x7f4738101e00 2024-02-19T19:08:23.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.640+0000 7f473e6e9700 1 -- 172.21.15.96:0/3188498504 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f47381970a0 con 0x7f472006d9e0 2024-02-19T19:08:23.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.651+0000 7f47357fa700 1 -- 172.21.15.96:0/3188498504 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f47381970a0 con 0x7f472006d9e0 2024-02-19T19:08:23.672 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:08:23.672 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (2m) 12s ago 12m 26.0M - 0.25.0 c8568f914cd2 bbaf83a1e476 2024-02-19T19:08:23.672 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (12m) 12s ago 12m 8066k - 18.2.1 94eadd990e0a b41bff2e0043 2024-02-19T19:08:23.672 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (11m) 14s ago 11m 7956k - 18.2.1 94eadd990e0a 254ab7e7a040 2024-02-19T19:08:23.672 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (12m) 12s ago 12m 6665k - 18.2.1 94eadd990e0a 9250aadb9d78 2024-02-19T19:08:23.672 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (11m) 14s ago 11m 6669k - 18.2.1 94eadd990e0a b98ace7b5ded 2024-02-19T19:08:23.672 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (113s) 12s ago 11m 80.9M - 9.4.12 a0ea5e3c46d9 0102d90938e4 2024-02-19T19:08:23.672 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (6m) 12s ago 6m 27.5M - 18.2.1 94eadd990e0a 0a61d9cd40d1 2024-02-19T19:08:23.672 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (6m) 12s ago 6m 24.5M - 18.2.1 94eadd990e0a 58db3e7a7d75 2024-02-19T19:08:23.672 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (6m) 14s ago 6m 28.3M - 18.2.1 94eadd990e0a 211d64de8a63 2024-02-19T19:08:23.673 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (6m) 14s ago 6m 26.4M - 18.2.1 94eadd990e0a 2a04b5a8eaf4 2024-02-19T19:08:23.673 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:8443,9283,8765 running (4m) 12s ago 13m 472M - 19.0.0-1450-gf78a58c0 f081f847070a a86fbe94fe3f 2024-02-19T19:08:23.673 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (3m) 14s ago 11m 446M - 19.0.0-1450-gf78a58c0 f081f847070a e250486d572d 2024-02-19T19:08:23.673 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (27s) 12s ago 13m 31.2M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d70090d516e3 2024-02-19T19:08:23.673 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 starting - - - 2048M 2024-02-19T19:08:23.673 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3m) 12s ago 12m 16.0M - 1.5.0 0da6a335fe13 51f622ea33d6 2024-02-19T19:08:23.673 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (3m) 14s ago 11m 17.5M - 1.5.0 0da6a335fe13 464e076a52a1 2024-02-19T19:08:23.673 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (10m) 12s ago 10m 51.0M 1216M 18.2.1 94eadd990e0a d5bbf07ad0e7 2024-02-19T19:08:23.673 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (9m) 12s ago 9m 51.1M 1216M 18.2.1 94eadd990e0a 40329d59be45 2024-02-19T19:08:23.673 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (9m) 12s ago 9m 49.4M 1216M 18.2.1 94eadd990e0a 4f1e49db2d41 2024-02-19T19:08:23.673 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (8m) 14s ago 8m 51.2M 2240M 18.2.1 94eadd990e0a 4746b79351fc 2024-02-19T19:08:23.673 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (8m) 14s ago 8m 50.5M 2240M 18.2.1 94eadd990e0a 2b3f0088f6b2 2024-02-19T19:08:23.673 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (8m) 14s ago 8m 47.4M 2240M 18.2.1 94eadd990e0a e5731974b46a 2024-02-19T19:08:23.674 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (2m) 12s ago 11m 60.6M - 2.43.0 a07b618ecd1d a4edcf6ed669 2024-02-19T19:08:23.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.653+0000 7f473e6e9700 1 -- 172.21.15.96:0/3188498504 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f472006d9e0 msgr2=0x7f472006fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:23.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.653+0000 7f473e6e9700 1 --2- 172.21.15.96:0/3188498504 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f472006d9e0 0x7f472006fea0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f472c005950 tx=0x7f472c0058e0 comp rx=0 tx=0).stop 2024-02-19T19:08:23.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.653+0000 7f473e6e9700 1 -- 172.21.15.96:0/3188498504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4738101e00 msgr2=0x7f473819c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:23.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.653+0000 7f473e6e9700 1 --2- 172.21.15.96:0/3188498504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4738101e00 0x7f473819c690 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4728006010 tx=0x7f472800be20 comp rx=0 tx=0).stop 2024-02-19T19:08:23.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.653+0000 7f473e6e9700 1 -- 172.21.15.96:0/3188498504 shutdown_connections 2024-02-19T19:08:23.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.653+0000 7f473e6e9700 1 --2- 172.21.15.96:0/3188498504 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f472006d9e0 0x7f472006fea0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:23.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.653+0000 7f473e6e9700 1 --2- 172.21.15.96:0/3188498504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4738101e00 0x7f473819c690 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:23.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.653+0000 7f473e6e9700 1 --2- 172.21.15.96:0/3188498504 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4738102720 0x7f473819cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:23.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.653+0000 7f473e6e9700 1 -- 172.21.15.96:0/3188498504 >> 172.21.15.96:0/3188498504 conn(0x7f47380fb650 msgr2=0x7f4738105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:23.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.653+0000 7f473e6e9700 1 -- 172.21.15.96:0/3188498504 shutdown_connections 2024-02-19T19:08:23.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.653+0000 7f473e6e9700 1 -- 172.21.15.96:0/3188498504 wait complete. 2024-02-19T19:08:23.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.758+0000 7f9c0900e700 1 -- 172.21.15.96:0/1986425111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c04106cd0 msgr2=0x7f9c041070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:23.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.758+0000 7f9c0900e700 1 --2- 172.21.15.96:0/1986425111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c04106cd0 0x7f9c041070b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009910 tx=0x7f9bf4009c20 comp rx=0 tx=0).stop 2024-02-19T19:08:23.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.758+0000 7f9c0900e700 1 -- 172.21.15.96:0/1986425111 shutdown_connections 2024-02-19T19:08:23.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.758+0000 7f9c0900e700 1 --2- 172.21.15.96:0/1986425111 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c04068580 0x7f9c040689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:23.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.758+0000 7f9c0900e700 1 --2- 172.21.15.96:0/1986425111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c04106cd0 0x7f9c041070b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:23.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.758+0000 7f9c0900e700 1 -- 172.21.15.96:0/1986425111 >> 172.21.15.96:0/1986425111 conn(0x7f9c04075670 msgr2=0x7f9c04075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:23.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.759+0000 7f9c0900e700 1 -- 172.21.15.96:0/1986425111 shutdown_connections 2024-02-19T19:08:23.780 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.759+0000 7f9c0900e700 1 -- 172.21.15.96:0/1986425111 wait complete. 2024-02-19T19:08:23.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.759+0000 7f9c0900e700 1 Processor -- start 2024-02-19T19:08:23.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.760+0000 7f9c0900e700 1 -- start start 2024-02-19T19:08:23.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.760+0000 7f9c0900e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c04068580 0x7f9c0419c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:23.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.760+0000 7f9c0900e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c04106cd0 0x7f9c0419cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:23.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.760+0000 7f9c0900e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0419d1a0 con 0x7f9c04106cd0 2024-02-19T19:08:23.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.760+0000 7f9c0900e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c041966e0 con 0x7f9c04068580 2024-02-19T19:08:23.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.760+0000 7f9c0259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c04106cd0 0x7f9c0419cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:23.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.760+0000 7f9c0259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c04106cd0 0x7f9c0419cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53882/0 (socket says 172.21.15.96:53882) 2024-02-19T19:08:23.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.760+0000 7f9c0259c700 1 -- 172.21.15.96:0/1078571515 learned_addr learned my addr 172.21.15.96:0/1078571515 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:08:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.760+0000 7f9c02d9d700 1 --2- 172.21.15.96:0/1078571515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c04068580 0x7f9c0419c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.760+0000 7f9c02d9d700 1 -- 172.21.15.96:0/1078571515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c04068580 msgr2=0x7f9c0419c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-02-19T19:08:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.760+0000 7f9c02d9d700 1 -- 172.21.15.96:0/1078571515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c04068580 msgr2=0x7f9c0419c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-19T19:08:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.760+0000 7f9c02d9d700 1 --2- 172.21.15.96:0/1078571515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c04068580 0x7f9c0419c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T19:08:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.760+0000 7f9c02d9d700 1 --2- 172.21.15.96:0/1078571515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c04068580 0x7f9c0419c660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T19:08:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.760+0000 7f9c0259c700 1 -- 172.21.15.96:0/1078571515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c04068580 msgr2=0x7f9c0419c660 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T19:08:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.760+0000 7f9c0259c700 1 --2- 172.21.15.96:0/1078571515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c04068580 0x7f9c0419c660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.760+0000 7f9c0259c700 1 -- 172.21.15.96:0/1078571515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf40095f0 con 0x7f9c04106cd0 2024-02-19T19:08:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.760+0000 7f9c0259c700 1 --2- 172.21.15.96:0/1078571515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c04106cd0 0x7f9c0419cba0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800c930 tx=0x7f9bf800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.760+0000 7f9bebfff700 1 -- 172.21.15.96:0/1078571515 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bf8007ad0 con 0x7f9c04106cd0 2024-02-19T19:08:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.761+0000 7f9bebfff700 1 -- 172.21.15.96:0/1078571515 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9bf8007c30 con 0x7f9c04106cd0 2024-02-19T19:08:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.761+0000 7f9c0900e700 1 -- 172.21.15.96:0/1078571515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c041969c0 con 0x7f9c04106cd0 2024-02-19T19:08:23.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.761+0000 7f9bebfff700 1 -- 172.21.15.96:0/1078571515 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9bf8018610 con 0x7f9c04106cd0 2024-02-19T19:08:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.761+0000 7f9c0900e700 1 -- 172.21.15.96:0/1078571515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c04196f10 con 0x7f9c04106cd0 2024-02-19T19:08:23.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.762+0000 7f9c0900e700 1 -- 172.21.15.96:0/1078571515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c041091d0 con 0x7f9c04106cd0 2024-02-19T19:08:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.762+0000 7f9bebfff700 1 -- 172.21.15.96:0/1078571515 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 36) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f9bf800f450 con 0x7f9c04106cd0 2024-02-19T19:08:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.762+0000 7f9bebfff700 1 --2- 172.21.15.96:0/1078571515 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9bec06d9d0 0x7f9bec06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.762+0000 7f9bebfff700 1 -- 172.21.15.96:0/1078571515 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9bf808d950 con 0x7f9c04106cd0 2024-02-19T19:08:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.763+0000 7f9c02d9d700 1 --2- 172.21.15.96:0/1078571515 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9bec06d9d0 0x7f9bec06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:23.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.763+0000 7f9c02d9d700 1 --2- 172.21.15.96:0/1078571515 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9bec06d9d0 0x7f9bec06fe90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4006010 tx=0x7f9bf401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:23.788 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:23.767+0000 7f9bebfff700 1 -- 172.21.15.96:0/1078571515 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9bf805aac0 con 0x7f9c04106cd0 2024-02-19T19:08:23.946 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2024-02-19T19:08:23.946 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:23 smithi096 ceph-mon[112483]: mon.smithi125 calling monitor election 2024-02-19T19:08:23.947 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:23 smithi096 ceph-mon[112483]: mon.smithi096 calling monitor election 2024-02-19T19:08:23.947 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T19:08:23.947 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:23 smithi096 ceph-mon[112483]: mon.smithi096 is new leader, mons smithi096,smithi125 in quorum (ranks 0,1) 2024-02-19T19:08:23.947 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:23 smithi096 ceph-mon[112483]: monmap e3: 2 mons at {smithi096=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],smithi125=[v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-19T19:08:23.947 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:23 smithi096 ceph-mon[112483]: fsmap cephfs:2 {0=cephfs.smithi096.pccmys=up:active,1=cephfs.smithi125.srnlol=up:active} 2 up:standby-replay 2024-02-19T19:08:23.947 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:23 smithi096 ceph-mon[112483]: osdmap e49: 6 total, 6 up, 6 in 2024-02-19T19:08:23.947 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:23 smithi096 ceph-mon[112483]: mgrmap e36: smithi096.zsjdff(active, since 17s), standbys: smithi125.ygdmdu 2024-02-19T19:08:23.947 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:23 smithi096 ceph-mon[112483]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T19:08:23.947 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:23 smithi096 ceph-mon[112483]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-19T19:08:23.947 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:23 smithi096 ceph-mon[112483]: fs cephfs has deprecated feature inline_data enabled. 2024-02-19T19:08:23.947 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:23.948 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:23.948 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:08:23.948 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:23 smithi096 ceph-mon[112483]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:23.948 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:23 smithi096 ceph-mon[112483]: pgmap v12: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-19T19:08:23.948 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:23 smithi096 ceph-mon[112483]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:23.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi096"}]: dispatch 2024-02-19T19:08:23.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:23 smithi125 ceph-mon[86115]: mon.smithi125 calling monitor election 2024-02-19T19:08:23.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:23 smithi125 ceph-mon[86115]: mon.smithi096 calling monitor election 2024-02-19T19:08:23.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mon metadata", "id": "smithi125"}]: dispatch 2024-02-19T19:08:23.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:23 smithi125 ceph-mon[86115]: mon.smithi096 is new leader, mons smithi096,smithi125 in quorum (ranks 0,1) 2024-02-19T19:08:23.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:23 smithi125 ceph-mon[86115]: monmap e3: 2 mons at {smithi096=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],smithi125=[v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-19T19:08:23.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:23 smithi125 ceph-mon[86115]: fsmap cephfs:2 {0=cephfs.smithi096.pccmys=up:active,1=cephfs.smithi125.srnlol=up:active} 2 up:standby-replay 2024-02-19T19:08:23.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:23 smithi125 ceph-mon[86115]: osdmap e49: 6 total, 6 up, 6 in 2024-02-19T19:08:23.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:23 smithi125 ceph-mon[86115]: mgrmap e36: smithi096.zsjdff(active, since 17s), standbys: smithi125.ygdmdu 2024-02-19T19:08:23.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:23 smithi125 ceph-mon[86115]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T19:08:23.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:23 smithi125 ceph-mon[86115]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-19T19:08:23.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:23 smithi125 ceph-mon[86115]: fs cephfs has deprecated feature inline_data enabled. 2024-02-19T19:08:23.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:23.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:23.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:08:23.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:23 smithi125 ceph-mon[86115]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:23.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:23 smithi125 ceph-mon[86115]: pgmap v12: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-19T19:08:23.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:23 smithi125 ceph-mon[86115]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:24.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.052+0000 7f9c0900e700 1 -- 172.21.15.96:0/1078571515 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9c0404f2e0 con 0x7f9c04106cd0 2024-02-19T19:08:24.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.052+0000 7f9bebfff700 1 -- 172.21.15.96:0/1078571515 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7f9bf805a650 con 0x7f9c04106cd0 2024-02-19T19:08:24.074 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:08:24.074 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:08:24.074 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:08:24.074 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:08:24.074 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:08:24.074 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:08:24.074 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:08:24.074 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:08:24.074 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-19T19:08:24.074 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:08:24.074 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:08:24.075 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-19T19:08:24.075 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:08:24.075 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:08:24.075 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 10, 2024-02-19T19:08:24.075 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-19T19:08:24.075 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:08:24.075 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:08:24.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.055+0000 7f9c0900e700 1 -- 172.21.15.96:0/1078571515 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9bec06d9d0 msgr2=0x7f9bec06fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:24.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.055+0000 7f9c0900e700 1 --2- 172.21.15.96:0/1078571515 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9bec06d9d0 0x7f9bec06fe90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4006010 tx=0x7f9bf401a040 comp rx=0 tx=0).stop 2024-02-19T19:08:24.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.055+0000 7f9c0900e700 1 -- 172.21.15.96:0/1078571515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c04106cd0 msgr2=0x7f9c0419cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:24.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.055+0000 7f9c0900e700 1 --2- 172.21.15.96:0/1078571515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c04106cd0 0x7f9c0419cba0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800c930 tx=0x7f9bf800ccf0 comp rx=0 tx=0).stop 2024-02-19T19:08:24.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.055+0000 7f9c0900e700 1 -- 172.21.15.96:0/1078571515 shutdown_connections 2024-02-19T19:08:24.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.055+0000 7f9c0900e700 1 --2- 172.21.15.96:0/1078571515 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9bec06d9d0 0x7f9bec06fe90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:24.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.055+0000 7f9c0900e700 1 --2- 172.21.15.96:0/1078571515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9c04068580 0x7f9c0419c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:24.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.055+0000 7f9c0900e700 1 --2- 172.21.15.96:0/1078571515 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9c04106cd0 0x7f9c0419cba0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:24.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.055+0000 7f9c0900e700 1 -- 172.21.15.96:0/1078571515 >> 172.21.15.96:0/1078571515 conn(0x7f9c04075670 msgr2=0x7f9c040fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:24.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.055+0000 7f9c0900e700 1 -- 172.21.15.96:0/1078571515 shutdown_connections 2024-02-19T19:08:24.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.055+0000 7f9c0900e700 1 -- 172.21.15.96:0/1078571515 wait complete. 2024-02-19T19:08:24.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.160+0000 7ff48f47d700 1 -- 172.21.15.96:0/3924173819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff488106cd0 msgr2=0x7ff4881070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:24.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.160+0000 7ff48f47d700 1 --2- 172.21.15.96:0/3924173819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff488106cd0 0x7ff4881070b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff48000b0a0 tx=0x7ff48000b3b0 comp rx=0 tx=0).stop 2024-02-19T19:08:24.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.160+0000 7ff48f47d700 1 -- 172.21.15.96:0/3924173819 shutdown_connections 2024-02-19T19:08:24.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.160+0000 7ff48f47d700 1 --2- 172.21.15.96:0/3924173819 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff488068580 0x7ff4880689e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:24.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.160+0000 7ff48f47d700 1 --2- 172.21.15.96:0/3924173819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff488106cd0 0x7ff4881070b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:24.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.160+0000 7ff48f47d700 1 -- 172.21.15.96:0/3924173819 >> 172.21.15.96:0/3924173819 conn(0x7ff488075670 msgr2=0x7ff488075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:24.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.160+0000 7ff48f47d700 1 -- 172.21.15.96:0/3924173819 shutdown_connections 2024-02-19T19:08:24.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.160+0000 7ff48f47d700 1 -- 172.21.15.96:0/3924173819 wait complete. 2024-02-19T19:08:24.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.160+0000 7ff48f47d700 1 Processor -- start 2024-02-19T19:08:24.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.160+0000 7ff48f47d700 1 -- start start 2024-02-19T19:08:24.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.160+0000 7ff48f47d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff488068580 0x7ff4880ffcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:24.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.160+0000 7ff48f47d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff488106cd0 0x7ff488100230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:24.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.161+0000 7ff48f47d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff488100770 con 0x7ff488068580 2024-02-19T19:08:24.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.161+0000 7ff48f47d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4881008b0 con 0x7ff488106cd0 2024-02-19T19:08:24.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.161+0000 7ff48d219700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff488068580 0x7ff4880ffcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:24.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.161+0000 7ff48d219700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff488068580 0x7ff4880ffcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53900/0 (socket says 172.21.15.96:53900) 2024-02-19T19:08:24.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.161+0000 7ff48d219700 1 -- 172.21.15.96:0/3313890376 learned_addr learned my addr 172.21.15.96:0/3313890376 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:08:24.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.161+0000 7ff48ca18700 1 --2- 172.21.15.96:0/3313890376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff488106cd0 0x7ff488100230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:24.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.161+0000 7ff48ca18700 1 -- 172.21.15.96:0/3313890376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff488106cd0 msgr2=0x7ff488100230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-19T19:08:24.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.161+0000 7ff48d219700 1 -- 172.21.15.96:0/3313890376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff488106cd0 msgr2=0x7ff488100230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:24.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.161+0000 7ff48ca18700 1 -- 172.21.15.96:0/3313890376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff488106cd0 msgr2=0x7ff488100230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-19T19:08:24.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.161+0000 7ff48ca18700 1 --2- 172.21.15.96:0/3313890376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff488106cd0 0x7ff488100230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T19:08:24.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.161+0000 7ff48ca18700 1 --2- 172.21.15.96:0/3313890376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff488106cd0 0x7ff488100230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T19:08:24.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.161+0000 7ff48d219700 1 --2- 172.21.15.96:0/3313890376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff488106cd0 0x7ff488100230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:24.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.161+0000 7ff48d219700 1 -- 172.21.15.96:0/3313890376 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff480009d00 con 0x7ff488068580 2024-02-19T19:08:24.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.161+0000 7ff48d219700 1 --2- 172.21.15.96:0/3313890376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff488068580 0x7ff4880ffcf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff480000f80 tx=0x7ff48000cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:24.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.161+0000 7ff47e7fc700 1 -- 172.21.15.96:0/3313890376 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff48000e040 con 0x7ff488068580 2024-02-19T19:08:24.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.161+0000 7ff47e7fc700 1 -- 172.21.15.96:0/3313890376 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff480003de0 con 0x7ff488068580 2024-02-19T19:08:24.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.161+0000 7ff47e7fc700 1 -- 172.21.15.96:0/3313890376 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff48001d790 con 0x7ff488068580 2024-02-19T19:08:24.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.161+0000 7ff48f47d700 1 -- 172.21.15.96:0/3313890376 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff488100b30 con 0x7ff488068580 2024-02-19T19:08:24.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.161+0000 7ff48f47d700 1 -- 172.21.15.96:0/3313890376 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4881a2da0 con 0x7ff488068580 2024-02-19T19:08:24.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.162+0000 7ff48f47d700 1 -- 172.21.15.96:0/3313890376 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4881091f0 con 0x7ff488068580 2024-02-19T19:08:24.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.163+0000 7ff47e7fc700 1 -- 172.21.15.96:0/3313890376 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 36) v1 ==== 91595+0+0 (secure 0 0 0) 0x7ff480004040 con 0x7ff488068580 2024-02-19T19:08:24.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.163+0000 7ff47e7fc700 1 --2- 172.21.15.96:0/3313890376 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff47406d9e0 0x7ff47406fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:24.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.163+0000 7ff47e7fc700 1 -- 172.21.15.96:0/3313890376 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff48008ee40 con 0x7ff488068580 2024-02-19T19:08:24.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.163+0000 7ff48ca18700 1 --2- 172.21.15.96:0/3313890376 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff47406d9e0 0x7ff47406fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:24.186 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.164+0000 7ff48ca18700 1 --2- 172.21.15.96:0/3313890376 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff47406d9e0 0x7ff47406fea0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff478005950 tx=0x7ff4780058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:24.188 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.168+0000 7ff47e7fc700 1 -- 172.21.15.96:0/3313890376 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff480058500 con 0x7ff488068580 2024-02-19T19:08:24.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.411+0000 7ff48f47d700 1 -- 172.21.15.96:0/3313890376 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff48804f2e0 con 0x7ff488068580 2024-02-19T19:08:24.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.411+0000 7ff47e7fc700 1 -- 172.21.15.96:0/3313890376 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1869 (secure 0 0 0) 0x7ff48005bbc0 con 0x7ff488068580 2024-02-19T19:08:24.432 INFO:teuthology.orchestra.run.smithi096.stdout:e19 2024-02-19T19:08:24.432 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:08:24.432 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:08:24.433 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2024-02-19T19:08:24.433 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:08:24.433 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:08:24.433 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2024-02-19T19:08:24.433 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 19 2024-02-19T19:08:24.433 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-19T19:08:24.433 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-02-19T19:01:42.881136+0000 2024-02-19T19:08:24.433 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2024-02-19T19:02:02.873590+0000 2024-02-19T19:08:24.433 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2024-02-19T19:08:24.433 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2024-02-19T19:08:24.433 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2024-02-19T19:08:24.433 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2024-02-19T19:08:24.433 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2024-02-19T19:08:24.433 INFO:teuthology.orchestra.run.smithi096.stdout:max_xattr_size 65536 2024-02-19T19:08:24.434 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2024-02-19T19:08:24.434 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2024-02-19T19:08:24.434 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 46 2024-02-19T19:08:24.434 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:08:24.434 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2024-02-19T19:08:24.434 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2024-02-19T19:08:24.434 INFO:teuthology.orchestra.run.smithi096.stdout:up {0=14490,1=24267} 2024-02-19T19:08:24.434 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2024-02-19T19:08:24.434 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2024-02-19T19:08:24.434 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2024-02-19T19:08:24.434 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2024-02-19T19:08:24.434 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2024-02-19T19:08:24.434 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data enabled 2024-02-19T19:08:24.434 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2024-02-19T19:08:24.434 INFO:teuthology.orchestra.run.smithi096.stdout:bal_rank_mask -1 2024-02-19T19:08:24.434 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2024-02-19T19:08:24.435 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pccmys{0:14490} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:08:24.435 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.usrmcg{0:14502} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/413113741,v1:172.21.15.96:6827/413113741] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:08:24.435 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.srnlol{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.125:6824/3084054986,v1:172.21.15.125:6825/3084054986] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:08:24.435 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.pwyuga{1:24275} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.125:6826/3098247423,v1:172.21.15.125:6827/3098247423] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:08:24.435 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:08:24.435 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:08:24.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.413+0000 7ff48f47d700 1 -- 172.21.15.96:0/3313890376 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff47406d9e0 msgr2=0x7ff47406fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:24.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.413+0000 7ff48f47d700 1 --2- 172.21.15.96:0/3313890376 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff47406d9e0 0x7ff47406fea0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff478005950 tx=0x7ff4780058e0 comp rx=0 tx=0).stop 2024-02-19T19:08:24.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.413+0000 7ff48f47d700 1 -- 172.21.15.96:0/3313890376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff488068580 msgr2=0x7ff4880ffcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:24.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.413+0000 7ff48f47d700 1 --2- 172.21.15.96:0/3313890376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff488068580 0x7ff4880ffcf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff480000f80 tx=0x7ff48000cdd0 comp rx=0 tx=0).stop 2024-02-19T19:08:24.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.413+0000 7ff48f47d700 1 -- 172.21.15.96:0/3313890376 shutdown_connections 2024-02-19T19:08:24.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.413+0000 7ff48f47d700 1 --2- 172.21.15.96:0/3313890376 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff47406d9e0 0x7ff47406fea0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:24.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.413+0000 7ff48f47d700 1 --2- 172.21.15.96:0/3313890376 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff488068580 0x7ff4880ffcf0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:24.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.413+0000 7ff48f47d700 1 --2- 172.21.15.96:0/3313890376 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff488106cd0 0x7ff488100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:24.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.413+0000 7ff48f47d700 1 -- 172.21.15.96:0/3313890376 >> 172.21.15.96:0/3313890376 conn(0x7ff488075670 msgr2=0x7ff4880fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:24.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.413+0000 7ff48f47d700 1 -- 172.21.15.96:0/3313890376 shutdown_connections 2024-02-19T19:08:24.437 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.413+0000 7ff48f47d700 1 -- 172.21.15.96:0/3313890376 wait complete. 2024-02-19T19:08:24.437 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 19 2024-02-19T19:08:24.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.520+0000 7f0215d02700 1 -- 172.21.15.96:0/1895503137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02100ffc20 msgr2=0x7f0210100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:24.543 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.520+0000 7f0215d02700 1 --2- 172.21.15.96:0/1895503137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02100ffc20 0x7f0210100080 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0204009910 tx=0x7f0204009c20 comp rx=0 tx=0).stop 2024-02-19T19:08:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.520+0000 7f0215d02700 1 -- 172.21.15.96:0/1895503137 shutdown_connections 2024-02-19T19:08:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.520+0000 7f0215d02700 1 --2- 172.21.15.96:0/1895503137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02100ffc20 0x7f0210100080 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.520+0000 7f0215d02700 1 --2- 172.21.15.96:0/1895503137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0210105bd0 0x7f0210105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.520+0000 7f0215d02700 1 -- 172.21.15.96:0/1895503137 >> 172.21.15.96:0/1895503137 conn(0x7f0210075670 msgr2=0x7f0210075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.520+0000 7f0215d02700 1 -- 172.21.15.96:0/1895503137 shutdown_connections 2024-02-19T19:08:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.520+0000 7f0215d02700 1 -- 172.21.15.96:0/1895503137 wait complete. 2024-02-19T19:08:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.521+0000 7f0215d02700 1 Processor -- start 2024-02-19T19:08:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.521+0000 7f0215d02700 1 -- start start 2024-02-19T19:08:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.521+0000 7f0215d02700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02100ffc20 0x7f0210101c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.521+0000 7f0215d02700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0210105bd0 0x7f02101021b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:24.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.521+0000 7f0215d02700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0210102780 con 0x7f02100ffc20 2024-02-19T19:08:24.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.521+0000 7f0215d02700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02101028f0 con 0x7f0210105bd0 2024-02-19T19:08:24.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.521+0000 7f020f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02100ffc20 0x7f0210101c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:24.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.521+0000 7f020f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02100ffc20 0x7f0210101c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53918/0 (socket says 172.21.15.96:53918) 2024-02-19T19:08:24.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.521+0000 7f020f7fe700 1 -- 172.21.15.96:0/44988227 learned_addr learned my addr 172.21.15.96:0/44988227 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:08:24.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.521+0000 7f020effd700 1 --2- 172.21.15.96:0/44988227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0210105bd0 0x7f02101021b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:24.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.521+0000 7f020effd700 1 -- 172.21.15.96:0/44988227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0210105bd0 msgr2=0x7f02101021b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-19T19:08:24.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.521+0000 7f020effd700 1 -- 172.21.15.96:0/44988227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0210105bd0 msgr2=0x7f02101021b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-19T19:08:24.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.521+0000 7f020effd700 1 --2- 172.21.15.96:0/44988227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0210105bd0 0x7f02101021b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T19:08:24.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.521+0000 7f020effd700 1 --2- 172.21.15.96:0/44988227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0210105bd0 0x7f02101021b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T19:08:24.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.522+0000 7f020f7fe700 1 -- 172.21.15.96:0/44988227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0210105bd0 msgr2=0x7f02101021b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T19:08:24.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.522+0000 7f020f7fe700 1 --2- 172.21.15.96:0/44988227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0210105bd0 0x7f02101021b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:24.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.522+0000 7f020f7fe700 1 -- 172.21.15.96:0/44988227 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02040095f0 con 0x7f02100ffc20 2024-02-19T19:08:24.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.522+0000 7f020f7fe700 1 --2- 172.21.15.96:0/44988227 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02100ffc20 0x7f0210101c70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f020000d8d0 tx=0x7f020000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:24.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.522+0000 7f020cff9700 1 -- 172.21.15.96:0/44988227 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0200009940 con 0x7f02100ffc20 2024-02-19T19:08:24.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.522+0000 7f020cff9700 1 -- 172.21.15.96:0/44988227 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0200010460 con 0x7f02100ffc20 2024-02-19T19:08:24.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.522+0000 7f0215d02700 1 -- 172.21.15.96:0/44988227 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02101a2ae0 con 0x7f02100ffc20 2024-02-19T19:08:24.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.522+0000 7f020cff9700 1 -- 172.21.15.96:0/44988227 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f020000f5f0 con 0x7f02100ffc20 2024-02-19T19:08:24.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.522+0000 7f0215d02700 1 -- 172.21.15.96:0/44988227 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02101a2f50 con 0x7f02100ffc20 2024-02-19T19:08:24.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.523+0000 7f0215d02700 1 -- 172.21.15.96:0/44988227 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021004f2e0 con 0x7f02100ffc20 2024-02-19T19:08:24.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.523+0000 7f020cff9700 1 -- 172.21.15.96:0/44988227 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 36) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f02000105d0 con 0x7f02100ffc20 2024-02-19T19:08:24.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.524+0000 7f020cff9700 1 --2- 172.21.15.96:0/44988227 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f01f806d9e0 0x7f01f806fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:24.547 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.524+0000 7f020cff9700 1 -- 172.21.15.96:0/44988227 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f020008d600 con 0x7f02100ffc20 2024-02-19T19:08:24.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.524+0000 7f020effd700 1 --2- 172.21.15.96:0/44988227 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f01f806d9e0 0x7f01f806fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:24.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.524+0000 7f020effd700 1 --2- 172.21.15.96:0/44988227 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f01f806d9e0 0x7f01f806fea0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0210103460 tx=0x7f020401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:24.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.528+0000 7f020cff9700 1 -- 172.21.15.96:0/44988227 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0200056cc0 con 0x7f02100ffc20 2024-02-19T19:08:24.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.751+0000 7f0215d02700 1 -- 172.21.15.96:0/44988227 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f02100fea50 con 0x7f01f806d9e0 2024-02-19T19:08:24.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.752+0000 7f020cff9700 1 -- 172.21.15.96:0/44988227 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f02100fea50 con 0x7f01f806d9e0 2024-02-19T19:08:24.773 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:08:24.773 INFO:teuthology.orchestra.run.smithi096.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:08:24.773 INFO:teuthology.orchestra.run.smithi096.stdout: "in_progress": true, 2024-02-19T19:08:24.773 INFO:teuthology.orchestra.run.smithi096.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:08:24.773 INFO:teuthology.orchestra.run.smithi096.stdout: "services_complete": [ 2024-02-19T19:08:24.773 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr" 2024-02-19T19:08:24.773 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-02-19T19:08:24.773 INFO:teuthology.orchestra.run.smithi096.stdout: "progress": "3/23 daemons upgraded", 2024-02-19T19:08:24.773 INFO:teuthology.orchestra.run.smithi096.stdout: "message": "Currently upgrading mon daemons", 2024-02-19T19:08:24.774 INFO:teuthology.orchestra.run.smithi096.stdout: "is_paused": false 2024-02-19T19:08:24.774 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:08:24.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.754+0000 7f0215d02700 1 -- 172.21.15.96:0/44988227 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f01f806d9e0 msgr2=0x7f01f806fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:24.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.755+0000 7f0215d02700 1 --2- 172.21.15.96:0/44988227 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f01f806d9e0 0x7f01f806fea0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0210103460 tx=0x7f020401a040 comp rx=0 tx=0).stop 2024-02-19T19:08:24.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.755+0000 7f0215d02700 1 -- 172.21.15.96:0/44988227 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02100ffc20 msgr2=0x7f0210101c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:24.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.755+0000 7f0215d02700 1 --2- 172.21.15.96:0/44988227 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02100ffc20 0x7f0210101c70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f020000d8d0 tx=0x7f020000dc90 comp rx=0 tx=0).stop 2024-02-19T19:08:24.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.755+0000 7f0215d02700 1 -- 172.21.15.96:0/44988227 shutdown_connections 2024-02-19T19:08:24.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.755+0000 7f0215d02700 1 --2- 172.21.15.96:0/44988227 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f01f806d9e0 0x7f01f806fea0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:24.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.755+0000 7f0215d02700 1 --2- 172.21.15.96:0/44988227 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f02100ffc20 0x7f0210101c70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:24.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.755+0000 7f0215d02700 1 --2- 172.21.15.96:0/44988227 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0210105bd0 0x7f02101021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:24.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.755+0000 7f0215d02700 1 -- 172.21.15.96:0/44988227 >> 172.21.15.96:0/44988227 conn(0x7f0210075670 msgr2=0x7f0210103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:24.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.755+0000 7f0215d02700 1 -- 172.21.15.96:0/44988227 shutdown_connections 2024-02-19T19:08:24.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.755+0000 7f0215d02700 1 -- 172.21.15.96:0/44988227 wait complete. 2024-02-19T19:08:24.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.858+0000 7fc2bd18a700 1 -- 172.21.15.96:0/228784749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2b80ff5a0 msgr2=0x7fc2b80ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:24.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.858+0000 7fc2bd18a700 1 --2- 172.21.15.96:0/228784749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2b80ff5a0 0x7fc2b80ff980 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009910 tx=0x7fc2a8009c20 comp rx=0 tx=0).stop 2024-02-19T19:08:24.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.858+0000 7fc2bd18a700 1 -- 172.21.15.96:0/228784749 shutdown_connections 2024-02-19T19:08:24.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.858+0000 7fc2bd18a700 1 --2- 172.21.15.96:0/228784749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b80fff50 0x7fc2b8105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:24.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.858+0000 7fc2bd18a700 1 --2- 172.21.15.96:0/228784749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2b80ff5a0 0x7fc2b80ff980 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:24.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.858+0000 7fc2bd18a700 1 -- 172.21.15.96:0/228784749 >> 172.21.15.96:0/228784749 conn(0x7fc2b8074e30 msgr2=0x7fc2b8075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:24.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.858+0000 7fc2bd18a700 1 -- 172.21.15.96:0/228784749 shutdown_connections 2024-02-19T19:08:24.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.858+0000 7fc2bd18a700 1 -- 172.21.15.96:0/228784749 wait complete. 2024-02-19T19:08:24.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.859+0000 7fc2bd18a700 1 Processor -- start 2024-02-19T19:08:24.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.859+0000 7fc2bd18a700 1 -- start start 2024-02-19T19:08:24.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.859+0000 7fc2bd18a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2b80ff5a0 0x7fc2b8100520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:24.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.859+0000 7fc2bd18a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b80fff50 0x7fc2b8100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:24.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.859+0000 7fc2bd18a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b8100fa0 con 0x7fc2b80ff5a0 2024-02-19T19:08:24.881 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.859+0000 7fc2bd18a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2b81010e0 con 0x7fc2b80fff50 2024-02-19T19:08:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.859+0000 7fc2b6d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2b80ff5a0 0x7fc2b8100520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.859+0000 7fc2b6d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2b80ff5a0 0x7fc2b8100520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53930/0 (socket says 172.21.15.96:53930) 2024-02-19T19:08:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.859+0000 7fc2b6d9d700 1 -- 172.21.15.96:0/2632491722 learned_addr learned my addr 172.21.15.96:0/2632491722 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:08:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.859+0000 7fc2b659c700 1 --2- 172.21.15.96:0/2632491722 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b80fff50 0x7fc2b8100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.860+0000 7fc2b659c700 1 -- 172.21.15.96:0/2632491722 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b80fff50 msgr2=0x7fc2b8100a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-19T19:08:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.860+0000 7fc2b659c700 1 -- 172.21.15.96:0/2632491722 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b80fff50 msgr2=0x7fc2b8100a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-19T19:08:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.860+0000 7fc2b659c700 1 --2- 172.21.15.96:0/2632491722 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b80fff50 0x7fc2b8100a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-19T19:08:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.860+0000 7fc2b659c700 1 --2- 172.21.15.96:0/2632491722 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b80fff50 0x7fc2b8100a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-19T19:08:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.860+0000 7fc2b6d9d700 1 -- 172.21.15.96:0/2632491722 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b80fff50 msgr2=0x7fc2b8100a60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-19T19:08:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.860+0000 7fc2b6d9d700 1 --2- 172.21.15.96:0/2632491722 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b80fff50 0x7fc2b8100a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.860+0000 7fc2b6d9d700 1 -- 172.21.15.96:0/2632491722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a80095f0 con 0x7fc2b80ff5a0 2024-02-19T19:08:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.860+0000 7fc2b6d9d700 1 --2- 172.21.15.96:0/2632491722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2b80ff5a0 0x7fc2b8100520 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc2a80092e0 tx=0x7fc2a800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.860+0000 7fc29ffff700 1 -- 172.21.15.96:0/2632491722 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2a801d070 con 0x7fc2b80ff5a0 2024-02-19T19:08:24.882 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.860+0000 7fc29ffff700 1 -- 172.21.15.96:0/2632491722 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2a8005e00 con 0x7fc2b80ff5a0 2024-02-19T19:08:24.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.860+0000 7fc29ffff700 1 -- 172.21.15.96:0/2632491722 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2a8017400 con 0x7fc2b80ff5a0 2024-02-19T19:08:24.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.860+0000 7fc2bd18a700 1 -- 172.21.15.96:0/2632491722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2b8101360 con 0x7fc2b80ff5a0 2024-02-19T19:08:24.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.860+0000 7fc2bd18a700 1 -- 172.21.15.96:0/2632491722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2b81a2de0 con 0x7fc2b80ff5a0 2024-02-19T19:08:24.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.861+0000 7fc2bd18a700 1 -- 172.21.15.96:0/2632491722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2b8109270 con 0x7fc2b80ff5a0 2024-02-19T19:08:24.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.861+0000 7fc29ffff700 1 -- 172.21.15.96:0/2632491722 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 36) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fc2a800f460 con 0x7fc2b80ff5a0 2024-02-19T19:08:24.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.862+0000 7fc29ffff700 1 --2- 172.21.15.96:0/2632491722 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc2a006d9d0 0x7fc2a006fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:24.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.862+0000 7fc2b659c700 1 --2- 172.21.15.96:0/2632491722 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc2a006d9d0 0x7fc2a006fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:24.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.862+0000 7fc29ffff700 1 -- 172.21.15.96:0/2632491722 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc2a808ec20 con 0x7fc2b80ff5a0 2024-02-19T19:08:24.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.862+0000 7fc2b659c700 1 --2- 172.21.15.96:0/2632491722 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc2a006d9d0 0x7fc2a006fe90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac005950 tx=0x7fc2ac0058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:24.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:24.867+0000 7fc29ffff700 1 -- 172.21.15.96:0/2632491722 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc2a8058260 con 0x7fc2b80ff5a0 2024-02-19T19:08:24.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:24 smithi125 ceph-mon[86115]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:24.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:24 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/1078571515' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:08:24.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:24 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/3313890376' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:08:25.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:24 smithi096 ceph-mon[112483]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:25.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:24 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/1078571515' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:08:25.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:24 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/3313890376' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:08:25.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:25.143+0000 7fc2bd18a700 1 -- 172.21.15.96:0/2632491722 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc2b804f2e0 con 0x7fc2b80ff5a0 2024-02-19T19:08:25.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:25.144+0000 7fc29ffff700 1 -- 172.21.15.96:0/2632491722 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fc2a805b920 con 0x7fc2b80ff5a0 2024-02-19T19:08:25.166 INFO:teuthology.orchestra.run.smithi096.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T19:08:25.166 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-19T19:08:25.166 INFO:teuthology.orchestra.run.smithi096.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-19T19:08:25.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:25.146+0000 7fc2bd18a700 1 -- 172.21.15.96:0/2632491722 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc2a006d9d0 msgr2=0x7fc2a006fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:25.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:25.146+0000 7fc2bd18a700 1 --2- 172.21.15.96:0/2632491722 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc2a006d9d0 0x7fc2a006fe90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac005950 tx=0x7fc2ac0058e0 comp rx=0 tx=0).stop 2024-02-19T19:08:25.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:25.146+0000 7fc2bd18a700 1 -- 172.21.15.96:0/2632491722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2b80ff5a0 msgr2=0x7fc2b8100520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:25.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:25.146+0000 7fc2bd18a700 1 --2- 172.21.15.96:0/2632491722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2b80ff5a0 0x7fc2b8100520 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc2a80092e0 tx=0x7fc2a800be20 comp rx=0 tx=0).stop 2024-02-19T19:08:25.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:25.146+0000 7fc2bd18a700 1 -- 172.21.15.96:0/2632491722 shutdown_connections 2024-02-19T19:08:25.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:25.146+0000 7fc2bd18a700 1 --2- 172.21.15.96:0/2632491722 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc2a006d9d0 0x7fc2a006fe90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:25.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:25.146+0000 7fc2bd18a700 1 --2- 172.21.15.96:0/2632491722 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2b80ff5a0 0x7fc2b8100520 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:25.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:25.146+0000 7fc2bd18a700 1 --2- 172.21.15.96:0/2632491722 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc2b80fff50 0x7fc2b8100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:25.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:25.146+0000 7fc2bd18a700 1 -- 172.21.15.96:0/2632491722 >> 172.21.15.96:0/2632491722 conn(0x7fc2b8074e30 msgr2=0x7fc2b80fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:25.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:25.146+0000 7fc2bd18a700 1 -- 172.21.15.96:0/2632491722 shutdown_connections 2024-02-19T19:08:25.169 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:25.146+0000 7fc2bd18a700 1 -- 172.21.15.96:0/2632491722 wait complete. 2024-02-19T19:08:26.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:25 smithi125 ceph-mon[86115]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:26.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:25 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/2632491722' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:08:26.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:25 smithi125 ceph-mon[86115]: pgmap v13: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:08:26.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:25 smithi096 ceph-mon[112483]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:26.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:25 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/2632491722' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:08:26.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:25 smithi096 ceph-mon[112483]: pgmap v13: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:08:27.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:26 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:27.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:26 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:27.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:26 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:27.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:26 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:28.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:27 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:28.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:27 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:28.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:27 smithi125 ceph-mon[86115]: pgmap v14: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:08:28.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:27 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:28.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:27 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:28.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:27 smithi096 ceph-mon[112483]: pgmap v14: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:08:30.553 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:30 smithi125 ceph-mon[86115]: pgmap v15: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:08:30.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:30 smithi096 ceph-mon[112483]: pgmap v15: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:08:31.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:31 smithi096 ceph-mon[112483]: Detected new or changed devices on smithi125 2024-02-19T19:08:31.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:31 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:31.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:31 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:31.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:31 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:31.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:31 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:08:31.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:31 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:31.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:31 smithi096 ceph-mon[112483]: Reconfiguring mon.smithi096 (monmap changed)... 2024-02-19T19:08:31.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:31 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T19:08:31.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:31 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T19:08:31.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:31 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:31.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:31 smithi096 ceph-mon[112483]: Reconfiguring daemon mon.smithi096 on smithi096 2024-02-19T19:08:31.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:31 smithi096 ceph-mon[112483]: pgmap v16: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:08:31.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:31 smithi125 ceph-mon[86115]: Detected new or changed devices on smithi125 2024-02-19T19:08:31.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:31 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:31.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:31 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:31.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:31 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:31.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:31 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:08:31.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:31 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:31.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:31 smithi125 ceph-mon[86115]: Reconfiguring mon.smithi096 (monmap changed)... 2024-02-19T19:08:31.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:31 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T19:08:31.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:31 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T19:08:31.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:31 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:31.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:31 smithi125 ceph-mon[86115]: Reconfiguring daemon mon.smithi096 on smithi096 2024-02-19T19:08:31.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:31 smithi125 ceph-mon[86115]: pgmap v16: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:08:33.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:33 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:33.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:33 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:33.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:33 smithi096 ceph-mon[112483]: Reconfiguring mgr.smithi096.zsjdff (monmap changed)... 2024-02-19T19:08:33.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:33 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi096.zsjdff", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:08:33.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:33 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T19:08:33.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:33 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:33.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:33 smithi096 ceph-mon[112483]: Reconfiguring daemon mgr.smithi096.zsjdff on smithi096 2024-02-19T19:08:33.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:33 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:33.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:33 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:33.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:33 smithi125 ceph-mon[86115]: Reconfiguring mgr.smithi096.zsjdff (monmap changed)... 2024-02-19T19:08:33.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:33 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi096.zsjdff", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:08:33.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:33 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T19:08:33.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:33 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:33.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:33 smithi125 ceph-mon[86115]: Reconfiguring daemon mgr.smithi096.zsjdff on smithi096 2024-02-19T19:08:34.623 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:34 smithi096 ceph-mon[112483]: pgmap v17: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:08:34.623 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:34 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:34.623 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:34 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:34.623 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:34 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi096", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:08:34.623 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:34 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi096", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:08:34.623 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:34 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi096", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-19T19:08:34.623 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:34 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi096"}]: dispatch 2024-02-19T19:08:34.624 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:34 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:34.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:34 smithi125 ceph-mon[86115]: pgmap v17: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:08:34.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:34 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:34.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:34 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:34.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:34 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi096", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:08:34.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:34 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi096", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:08:34.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:34 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi096", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-19T19:08:34.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:34 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi096"}]: dispatch 2024-02-19T19:08:34.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:34 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:35.657 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:35 smithi096 ceph-mon[112483]: Reconfiguring ceph-exporter.smithi096 (monmap changed)... 2024-02-19T19:08:35.657 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:35 smithi096 ceph-mon[112483]: Unable to update caps for client.ceph-exporter.smithi096 2024-02-19T19:08:35.657 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:35 smithi096 ceph-mon[112483]: Reconfiguring daemon ceph-exporter.smithi096 on smithi096 2024-02-19T19:08:35.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:35 smithi125 ceph-mon[86115]: Reconfiguring ceph-exporter.smithi096 (monmap changed)... 2024-02-19T19:08:35.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:35 smithi125 ceph-mon[86115]: Unable to update caps for client.ceph-exporter.smithi096 2024-02-19T19:08:35.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:35 smithi125 ceph-mon[86115]: Reconfiguring daemon ceph-exporter.smithi096 on smithi096 2024-02-19T19:08:36.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:36 smithi096 ceph-mon[112483]: pgmap v18: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:08:36.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:08:36.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:36.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:36.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi096", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T19:08:36.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:36.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:36 smithi125 ceph-mon[86115]: pgmap v18: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:08:36.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:08:36.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:36.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:36.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi096", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T19:08:36.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:37.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:37 smithi096 ceph-mon[112483]: Reconfiguring crash.smithi096 (monmap changed)... 2024-02-19T19:08:37.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:37 smithi096 ceph-mon[112483]: Reconfiguring daemon crash.smithi096 on smithi096 2024-02-19T19:08:37.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:37 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:37.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:37 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:37.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:37 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-19T19:08:37.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:37 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:37.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:37 smithi125 ceph-mon[86115]: Reconfiguring crash.smithi096 (monmap changed)... 2024-02-19T19:08:37.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:37 smithi125 ceph-mon[86115]: Reconfiguring daemon crash.smithi096 on smithi096 2024-02-19T19:08:37.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:37 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:37.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:37 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:37.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:37 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-19T19:08:37.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:37 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:38.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:38 smithi096 ceph-mon[112483]: Reconfiguring osd.0 (monmap changed)... 2024-02-19T19:08:38.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:38 smithi096 ceph-mon[112483]: Reconfiguring daemon osd.0 on smithi096 2024-02-19T19:08:38.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:38 smithi096 ceph-mon[112483]: pgmap v19: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:08:38.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:38 smithi125 ceph-mon[86115]: Reconfiguring osd.0 (monmap changed)... 2024-02-19T19:08:38.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:38 smithi125 ceph-mon[86115]: Reconfiguring daemon osd.0 on smithi096 2024-02-19T19:08:38.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:38 smithi125 ceph-mon[86115]: pgmap v19: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:08:40.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:39 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:40.242 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:39 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:40.242 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:39 smithi125 ceph-mon[86115]: Reconfiguring osd.1 (monmap changed)... 2024-02-19T19:08:40.242 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:39 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-19T19:08:40.242 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:39 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:40.242 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:39 smithi125 ceph-mon[86115]: Reconfiguring daemon osd.1 on smithi096 2024-02-19T19:08:40.242 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:39 smithi125 ceph-mon[86115]: pgmap v20: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:08:40.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:39 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:40.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:39 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:40.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:39 smithi096 ceph-mon[112483]: Reconfiguring osd.1 (monmap changed)... 2024-02-19T19:08:40.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:39 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-19T19:08:40.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:39 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:40.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:39 smithi096 ceph-mon[112483]: Reconfiguring daemon osd.1 on smithi096 2024-02-19T19:08:40.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:39 smithi096 ceph-mon[112483]: pgmap v20: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:08:41.896 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:41 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:41.896 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:41 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:41.896 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:41 smithi096 ceph-mon[112483]: Reconfiguring osd.2 (monmap changed)... 2024-02-19T19:08:41.896 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:41 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-19T19:08:41.896 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:41 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:41.896 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:41 smithi096 ceph-mon[112483]: Reconfiguring daemon osd.2 on smithi096 2024-02-19T19:08:41.896 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:41 smithi096 ceph-mon[112483]: pgmap v21: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:08:41.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:41 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:41.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:41 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:41.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:41 smithi125 ceph-mon[86115]: Reconfiguring osd.2 (monmap changed)... 2024-02-19T19:08:41.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:41 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-19T19:08:41.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:41 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:41.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:41 smithi125 ceph-mon[86115]: Reconfiguring daemon osd.2 on smithi096 2024-02-19T19:08:41.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:41 smithi125 ceph-mon[86115]: pgmap v21: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:08:43.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:43 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:43.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:43 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:43.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:43 smithi096 ceph-mon[112483]: Reconfiguring mds.cephfs.smithi096.usrmcg (monmap changed)... 2024-02-19T19:08:43.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:43 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.usrmcg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:08:43.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:43 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:43.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:43 smithi096 ceph-mon[112483]: Reconfiguring daemon mds.cephfs.smithi096.usrmcg on smithi096 2024-02-19T19:08:43.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:43 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:43.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:43 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:43.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:43 smithi125 ceph-mon[86115]: Reconfiguring mds.cephfs.smithi096.usrmcg (monmap changed)... 2024-02-19T19:08:43.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:43 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.usrmcg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:08:43.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:43 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:43.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:43 smithi125 ceph-mon[86115]: Reconfiguring daemon mds.cephfs.smithi096.usrmcg on smithi096 2024-02-19T19:08:44.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:44 smithi096 ceph-mon[112483]: pgmap v22: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:08:44.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:44 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:44.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:44 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:44.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:44 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.pccmys", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:08:44.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:44 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:44.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:44 smithi125 ceph-mon[86115]: pgmap v22: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:08:44.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:44 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:44.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:44 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:44.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:44 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.pccmys", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:08:44.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:44 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:45.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:45 smithi096 ceph-mon[112483]: Reconfiguring mds.cephfs.smithi096.pccmys (monmap changed)... 2024-02-19T19:08:45.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:45 smithi096 ceph-mon[112483]: Reconfiguring daemon mds.cephfs.smithi096.pccmys on smithi096 2024-02-19T19:08:45.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:45 smithi125 ceph-mon[86115]: Reconfiguring mds.cephfs.smithi096.pccmys (monmap changed)... 2024-02-19T19:08:45.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:45 smithi125 ceph-mon[86115]: Reconfiguring daemon mds.cephfs.smithi096.pccmys on smithi096 2024-02-19T19:08:46.477 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:46 smithi125 ceph-mon[86115]: pgmap v23: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:08:46.477 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:46 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:46.477 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:46 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:46.477 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:46 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi125", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:08:46.477 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:46 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi125", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:08:46.477 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:46 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi125", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-19T19:08:46.477 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:46 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi125"}]: dispatch 2024-02-19T19:08:46.478 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:46 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:46.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:46 smithi096 ceph-mon[112483]: pgmap v23: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:08:46.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:46 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:46.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:46 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:46.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:46 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi125", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:08:46.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:46 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi125", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:08:46.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:46 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi125", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-19T19:08:46.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:46 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi125"}]: dispatch 2024-02-19T19:08:46.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:46 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:47.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:47 smithi125 ceph-mon[86115]: Reconfiguring ceph-exporter.smithi125 (monmap changed)... 2024-02-19T19:08:47.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:47 smithi125 ceph-mon[86115]: Unable to update caps for client.ceph-exporter.smithi125 2024-02-19T19:08:47.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:47 smithi125 ceph-mon[86115]: Reconfiguring daemon ceph-exporter.smithi125 on smithi125 2024-02-19T19:08:47.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:47 smithi096 ceph-mon[112483]: Reconfiguring ceph-exporter.smithi125 (monmap changed)... 2024-02-19T19:08:47.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:47 smithi096 ceph-mon[112483]: Unable to update caps for client.ceph-exporter.smithi125 2024-02-19T19:08:47.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:47 smithi096 ceph-mon[112483]: Reconfiguring daemon ceph-exporter.smithi125 on smithi125 2024-02-19T19:08:48.561 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:48 smithi125 ceph-mon[86115]: pgmap v24: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:08:48.561 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:48 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:48.561 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:48 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:48.561 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:48 smithi125 ceph-mon[86115]: Reconfiguring crash.smithi125 (monmap changed)... 2024-02-19T19:08:48.561 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:48 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi125", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T19:08:48.561 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:48 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:48.561 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:48 smithi125 ceph-mon[86115]: Reconfiguring daemon crash.smithi125 on smithi125 2024-02-19T19:08:48.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:48 smithi096 ceph-mon[112483]: pgmap v24: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:08:48.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:48 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:48.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:48 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:48.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:48 smithi096 ceph-mon[112483]: Reconfiguring crash.smithi125 (monmap changed)... 2024-02-19T19:08:48.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:48 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi125", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T19:08:48.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:48 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:48.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:48 smithi096 ceph-mon[112483]: Reconfiguring daemon crash.smithi125 on smithi125 2024-02-19T19:08:50.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:50.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:50.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:50 smithi125 ceph-mon[86115]: Reconfiguring mgr.smithi125.ygdmdu (monmap changed)... 2024-02-19T19:08:50.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi125.ygdmdu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:08:50.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T19:08:50.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:50.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:50 smithi125 ceph-mon[86115]: Reconfiguring daemon mgr.smithi125.ygdmdu on smithi125 2024-02-19T19:08:50.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:50 smithi125 ceph-mon[86115]: pgmap v25: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:08:50.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:50.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:50.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:50 smithi096 ceph-mon[112483]: Reconfiguring mgr.smithi125.ygdmdu (monmap changed)... 2024-02-19T19:08:50.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi125.ygdmdu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-19T19:08:50.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-19T19:08:50.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:50.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:50 smithi096 ceph-mon[112483]: Reconfiguring daemon mgr.smithi125.ygdmdu on smithi125 2024-02-19T19:08:50.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:50 smithi096 ceph-mon[112483]: pgmap v25: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:08:51.437 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:08:51.437 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:51.437 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:51.437 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T19:08:51.438 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T19:08:51.438 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:51.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:08:51.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:51.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:51.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-19T19:08:51.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-19T19:08:51.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:52.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:52 smithi125 ceph-mon[86115]: Reconfiguring mon.smithi125 (monmap changed)... 2024-02-19T19:08:52.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:52 smithi125 ceph-mon[86115]: Reconfiguring daemon mon.smithi125 on smithi125 2024-02-19T19:08:52.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:52 smithi125 ceph-mon[86115]: pgmap v26: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:08:52.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:52 smithi096 ceph-mon[112483]: Reconfiguring mon.smithi125 (monmap changed)... 2024-02-19T19:08:52.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:52 smithi096 ceph-mon[112483]: Reconfiguring daemon mon.smithi125 on smithi125 2024-02-19T19:08:52.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:52 smithi096 ceph-mon[112483]: pgmap v26: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:08:53.669 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:53 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:53.669 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:53 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:53.669 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:53 smithi125 ceph-mon[86115]: Reconfiguring osd.3 (monmap changed)... 2024-02-19T19:08:53.669 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:53 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-19T19:08:53.669 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:53 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:53.669 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:53 smithi125 ceph-mon[86115]: Reconfiguring daemon osd.3 on smithi125 2024-02-19T19:08:53.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:53 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:53.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:53 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:53.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:53 smithi096 ceph-mon[112483]: Reconfiguring osd.3 (monmap changed)... 2024-02-19T19:08:53.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:53 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-19T19:08:53.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:53 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:53.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:53 smithi096 ceph-mon[112483]: Reconfiguring daemon osd.3 on smithi125 2024-02-19T19:08:54.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:54 smithi096 ceph-mon[112483]: pgmap v27: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:08:54.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:54 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:54.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:54 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:54.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:54 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-19T19:08:54.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:54 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:54.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:54 smithi125 ceph-mon[86115]: pgmap v27: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:08:54.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:54 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:54.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:54 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:54.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:54 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-19T19:08:54.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:54 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:55.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.265+0000 7fcff147a700 1 -- 172.21.15.96:0/2988297216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfec101de0 msgr2=0x7fcfec1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:55.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.265+0000 7fcff147a700 1 --2- 172.21.15.96:0/2988297216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfec101de0 0x7fcfec1021c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00b0a0 tx=0x7fcfdc00b3b0 comp rx=0 tx=0).stop 2024-02-19T19:08:55.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.265+0000 7fcff147a700 1 -- 172.21.15.96:0/2988297216 shutdown_connections 2024-02-19T19:08:55.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.265+0000 7fcff147a700 1 --2- 172.21.15.96:0/2988297216 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfec102700 0x7fcfec10abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:55.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.265+0000 7fcff147a700 1 --2- 172.21.15.96:0/2988297216 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfec101de0 0x7fcfec1021c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:55.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.265+0000 7fcff147a700 1 -- 172.21.15.96:0/2988297216 >> 172.21.15.96:0/2988297216 conn(0x7fcfec0fb610 msgr2=0x7fcfec0fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:55.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.265+0000 7fcff147a700 1 -- 172.21.15.96:0/2988297216 shutdown_connections 2024-02-19T19:08:55.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.265+0000 7fcff147a700 1 -- 172.21.15.96:0/2988297216 wait complete. 2024-02-19T19:08:55.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.266+0000 7fcff147a700 1 Processor -- start 2024-02-19T19:08:55.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.266+0000 7fcff147a700 1 -- start start 2024-02-19T19:08:55.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.266+0000 7fcff147a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfec101de0 0x7fcfec0ffa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:55.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.266+0000 7fcff147a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfec102700 0x7fcfec0fff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:55.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.266+0000 7fcff147a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec1004c0 con 0x7fcfec101de0 2024-02-19T19:08:55.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.266+0000 7fcff147a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfec100600 con 0x7fcfec102700 2024-02-19T19:08:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.266+0000 7fcfeaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfec101de0 0x7fcfec0ffa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.266+0000 7fcfeaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfec101de0 0x7fcfec0ffa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42542/0 (socket says 172.21.15.96:42542) 2024-02-19T19:08:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.267+0000 7fcfeaffd700 1 -- 172.21.15.96:0/282880065 learned_addr learned my addr 172.21.15.96:0/282880065 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:08:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.267+0000 7fcfea7fc700 1 --2- 172.21.15.96:0/282880065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfec102700 0x7fcfec0fff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.267+0000 7fcfeaffd700 1 -- 172.21.15.96:0/282880065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfec102700 msgr2=0x7fcfec0fff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.267+0000 7fcfeaffd700 1 --2- 172.21.15.96:0/282880065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfec102700 0x7fcfec0fff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.267+0000 7fcfeaffd700 1 -- 172.21.15.96:0/282880065 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc009d00 con 0x7fcfec101de0 2024-02-19T19:08:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.267+0000 7fcfeaffd700 1 --2- 172.21.15.96:0/282880065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfec101de0 0x7fcfec0ffa40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00b070 tx=0x7fcfdc003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.267+0000 7fcfe3fff700 1 -- 172.21.15.96:0/282880065 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfdc00e040 con 0x7fcfec101de0 2024-02-19T19:08:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.267+0000 7fcff147a700 1 -- 172.21.15.96:0/282880065 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfec100880 con 0x7fcfec101de0 2024-02-19T19:08:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.267+0000 7fcfe3fff700 1 -- 172.21.15.96:0/282880065 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcfdc0096e0 con 0x7fcfec101de0 2024-02-19T19:08:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.267+0000 7fcfe3fff700 1 -- 172.21.15.96:0/282880065 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfdc01d6b0 con 0x7fcfec101de0 2024-02-19T19:08:55.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.267+0000 7fcff147a700 1 -- 172.21.15.96:0/282880065 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfec1a2e10 con 0x7fcfec101de0 2024-02-19T19:08:55.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.268+0000 7fcff147a700 1 -- 172.21.15.96:0/282880065 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfec1082f0 con 0x7fcfec101de0 2024-02-19T19:08:55.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.269+0000 7fcfe3fff700 1 -- 172.21.15.96:0/282880065 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 36) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fcfdc007c00 con 0x7fcfec101de0 2024-02-19T19:08:55.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.269+0000 7fcfe3fff700 1 --2- 172.21.15.96:0/282880065 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fcfd806d9d0 0x7fcfd806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:55.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.269+0000 7fcfea7fc700 1 --2- 172.21.15.96:0/282880065 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fcfd806d9d0 0x7fcfd806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:55.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.269+0000 7fcfe3fff700 1 -- 172.21.15.96:0/282880065 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fcfdc08ed70 con 0x7fcfec101de0 2024-02-19T19:08:55.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.270+0000 7fcfea7fc700 1 --2- 172.21.15.96:0/282880065 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fcfd806d9d0 0x7fcfd806fe90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcfec101230 tx=0x7fcfd4007320 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:55.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.274+0000 7fcfe3fff700 1 -- 172.21.15.96:0/282880065 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcfdc0583b0 con 0x7fcfec101de0 2024-02-19T19:08:55.516 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.495+0000 7fcff147a700 1 -- 172.21.15.96:0/282880065 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfec0611d0 con 0x7fcfd806d9d0 2024-02-19T19:08:55.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.497+0000 7fcfe3fff700 1 -- 172.21.15.96:0/282880065 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fcfec0611d0 con 0x7fcfd806d9d0 2024-02-19T19:08:55.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.499+0000 7fcff147a700 1 -- 172.21.15.96:0/282880065 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fcfd806d9d0 msgr2=0x7fcfd806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:55.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.499+0000 7fcff147a700 1 --2- 172.21.15.96:0/282880065 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fcfd806d9d0 0x7fcfd806fe90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcfec101230 tx=0x7fcfd4007320 comp rx=0 tx=0).stop 2024-02-19T19:08:55.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.499+0000 7fcff147a700 1 -- 172.21.15.96:0/282880065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfec101de0 msgr2=0x7fcfec0ffa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:55.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.499+0000 7fcff147a700 1 --2- 172.21.15.96:0/282880065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfec101de0 0x7fcfec0ffa40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00b070 tx=0x7fcfdc003c30 comp rx=0 tx=0).stop 2024-02-19T19:08:55.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.499+0000 7fcff147a700 1 -- 172.21.15.96:0/282880065 shutdown_connections 2024-02-19T19:08:55.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.499+0000 7fcff147a700 1 --2- 172.21.15.96:0/282880065 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fcfd806d9d0 0x7fcfd806fe90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:55.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.499+0000 7fcff147a700 1 --2- 172.21.15.96:0/282880065 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfec101de0 0x7fcfec0ffa40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:55.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.499+0000 7fcff147a700 1 --2- 172.21.15.96:0/282880065 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcfec102700 0x7fcfec0fff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:55.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.499+0000 7fcff147a700 1 -- 172.21.15.96:0/282880065 >> 172.21.15.96:0/282880065 conn(0x7fcfec0fb610 msgr2=0x7fcfec105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:55.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.499+0000 7fcff147a700 1 -- 172.21.15.96:0/282880065 shutdown_connections 2024-02-19T19:08:55.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.499+0000 7fcff147a700 1 -- 172.21.15.96:0/282880065 wait complete. 2024-02-19T19:08:55.530 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:08:55.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:55 smithi096 ceph-mon[112483]: Reconfiguring osd.4 (monmap changed)... 2024-02-19T19:08:55.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:55 smithi096 ceph-mon[112483]: Reconfiguring daemon osd.4 on smithi125 2024-02-19T19:08:55.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.604+0000 7fc16a664700 1 -- 172.21.15.96:0/508365255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1640ffda0 msgr2=0x7fc164100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:55.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.604+0000 7fc16a664700 1 --2- 172.21.15.96:0/508365255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1640ffda0 0x7fc164100180 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc154009910 tx=0x7fc154009c20 comp rx=0 tx=0).stop 2024-02-19T19:08:55.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.604+0000 7fc16a664700 1 -- 172.21.15.96:0/508365255 shutdown_connections 2024-02-19T19:08:55.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.604+0000 7fc16a664700 1 --2- 172.21.15.96:0/508365255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc164100750 0x7fc1641047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:55.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.604+0000 7fc16a664700 1 --2- 172.21.15.96:0/508365255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc1640ffda0 0x7fc164100180 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:55.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.604+0000 7fc16a664700 1 -- 172.21.15.96:0/508365255 >> 172.21.15.96:0/508365255 conn(0x7fc1640fb650 msgr2=0x7fc1640fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:55.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.604+0000 7fc16a664700 1 -- 172.21.15.96:0/508365255 shutdown_connections 2024-02-19T19:08:55.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.604+0000 7fc16a664700 1 -- 172.21.15.96:0/508365255 wait complete. 2024-02-19T19:08:55.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.605+0000 7fc16a664700 1 Processor -- start 2024-02-19T19:08:55.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.605+0000 7fc16a664700 1 -- start start 2024-02-19T19:08:55.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.605+0000 7fc16a664700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1640ffda0 0x7fc1641954e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:55.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.605+0000 7fc16a664700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc164100750 0x7fc164195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:55.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.605+0000 7fc16a664700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc164195f60 con 0x7fc164100750 2024-02-19T19:08:55.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.605+0000 7fc16a664700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1641960d0 con 0x7fc1640ffda0 2024-02-19T19:08:55.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.605+0000 7fc1637fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc164100750 0x7fc164195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.605+0000 7fc1637fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc164100750 0x7fc164195a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42562/0 (socket says 172.21.15.96:42562) 2024-02-19T19:08:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.605+0000 7fc1637fe700 1 -- 172.21.15.96:0/4215414623 learned_addr learned my addr 172.21.15.96:0/4215414623 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:08:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.605+0000 7fc163fff700 1 --2- 172.21.15.96:0/4215414623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1640ffda0 0x7fc1641954e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.605+0000 7fc1637fe700 1 -- 172.21.15.96:0/4215414623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1640ffda0 msgr2=0x7fc1641954e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.605+0000 7fc1637fe700 1 --2- 172.21.15.96:0/4215414623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1640ffda0 0x7fc1641954e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.606+0000 7fc1637fe700 1 -- 172.21.15.96:0/4215414623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1540095f0 con 0x7fc164100750 2024-02-19T19:08:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.606+0000 7fc1637fe700 1 --2- 172.21.15.96:0/4215414623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc164100750 0x7fc164195a20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc15800d900 tx=0x7fc15800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.606+0000 7fc1617fa700 1 -- 172.21.15.96:0/4215414623 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc158009900 con 0x7fc164100750 2024-02-19T19:08:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.606+0000 7fc1617fa700 1 -- 172.21.15.96:0/4215414623 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc158010460 con 0x7fc164100750 2024-02-19T19:08:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.606+0000 7fc1617fa700 1 -- 172.21.15.96:0/4215414623 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc15800f5f0 con 0x7fc164100750 2024-02-19T19:08:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.606+0000 7fc16a664700 1 -- 172.21.15.96:0/4215414623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1641a2b50 con 0x7fc164100750 2024-02-19T19:08:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.606+0000 7fc16a664700 1 -- 172.21.15.96:0/4215414623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1641a2eb0 con 0x7fc164100750 2024-02-19T19:08:55.629 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.607+0000 7fc16a664700 1 -- 172.21.15.96:0/4215414623 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc164108140 con 0x7fc164100750 2024-02-19T19:08:55.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.607+0000 7fc1617fa700 1 -- 172.21.15.96:0/4215414623 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 36) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fc1580105d0 con 0x7fc164100750 2024-02-19T19:08:55.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.608+0000 7fc1617fa700 1 --2- 172.21.15.96:0/4215414623 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc14c06d9d0 0x7fc14c06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:55.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.608+0000 7fc1617fa700 1 -- 172.21.15.96:0/4215414623 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc15808d120 con 0x7fc164100750 2024-02-19T19:08:55.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.608+0000 7fc163fff700 1 --2- 172.21.15.96:0/4215414623 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc14c06d9d0 0x7fc14c06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:55.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.608+0000 7fc163fff700 1 --2- 172.21.15.96:0/4215414623 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc14c06d9d0 0x7fc14c06fe90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc15400b5c0 tx=0x7fc15401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:55.633 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.612+0000 7fc1617fa700 1 -- 172.21.15.96:0/4215414623 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc15805a310 con 0x7fc164100750 2024-02-19T19:08:55.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:55 smithi125 ceph-mon[86115]: Reconfiguring osd.4 (monmap changed)... 2024-02-19T19:08:55.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:55 smithi125 ceph-mon[86115]: Reconfiguring daemon osd.4 on smithi125 2024-02-19T19:08:55.856 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.834+0000 7fc16a664700 1 -- 172.21.15.96:0/4215414623 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc164196290 con 0x7fc14c06d9d0 2024-02-19T19:08:55.857 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.836+0000 7fc1617fa700 1 -- 172.21.15.96:0/4215414623 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fc164196290 con 0x7fc14c06d9d0 2024-02-19T19:08:55.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.838+0000 7fc16a664700 1 -- 172.21.15.96:0/4215414623 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc14c06d9d0 msgr2=0x7fc14c06fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:55.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.838+0000 7fc16a664700 1 --2- 172.21.15.96:0/4215414623 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc14c06d9d0 0x7fc14c06fe90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc15400b5c0 tx=0x7fc15401a040 comp rx=0 tx=0).stop 2024-02-19T19:08:55.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.838+0000 7fc16a664700 1 -- 172.21.15.96:0/4215414623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc164100750 msgr2=0x7fc164195a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:55.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.838+0000 7fc16a664700 1 --2- 172.21.15.96:0/4215414623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc164100750 0x7fc164195a20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc15800d900 tx=0x7fc15800dc10 comp rx=0 tx=0).stop 2024-02-19T19:08:55.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.839+0000 7fc16a664700 1 -- 172.21.15.96:0/4215414623 shutdown_connections 2024-02-19T19:08:55.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.839+0000 7fc16a664700 1 --2- 172.21.15.96:0/4215414623 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc14c06d9d0 0x7fc14c06fe90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:55.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.839+0000 7fc16a664700 1 --2- 172.21.15.96:0/4215414623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc1640ffda0 0x7fc1641954e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:55.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.839+0000 7fc16a664700 1 --2- 172.21.15.96:0/4215414623 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc164100750 0x7fc164195a20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:55.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.839+0000 7fc16a664700 1 -- 172.21.15.96:0/4215414623 >> 172.21.15.96:0/4215414623 conn(0x7fc1640fb650 msgr2=0x7fc1640fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:55.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.839+0000 7fc16a664700 1 -- 172.21.15.96:0/4215414623 shutdown_connections 2024-02-19T19:08:55.860 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.839+0000 7fc16a664700 1 -- 172.21.15.96:0/4215414623 wait complete. 2024-02-19T19:08:55.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.944+0000 7f2182e7f700 1 -- 172.21.15.96:0/578682062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f217c101850 msgr2=0x7f217c1058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:55.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.944+0000 7f2182e7f700 1 --2- 172.21.15.96:0/578682062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f217c101850 0x7f217c1058a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2170009910 tx=0x7f2170009c20 comp rx=0 tx=0).stop 2024-02-19T19:08:55.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.944+0000 7f2182e7f700 1 -- 172.21.15.96:0/578682062 shutdown_connections 2024-02-19T19:08:55.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.944+0000 7f2182e7f700 1 --2- 172.21.15.96:0/578682062 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f217c101850 0x7f217c1058a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:55.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.944+0000 7f2182e7f700 1 --2- 172.21.15.96:0/578682062 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f217c100ea0 0x7f217c101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:55.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.944+0000 7f2182e7f700 1 -- 172.21.15.96:0/578682062 >> 172.21.15.96:0/578682062 conn(0x7f217c0fc750 msgr2=0x7f217c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:55.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.944+0000 7f2182e7f700 1 -- 172.21.15.96:0/578682062 shutdown_connections 2024-02-19T19:08:55.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.944+0000 7f2182e7f700 1 -- 172.21.15.96:0/578682062 wait complete. 2024-02-19T19:08:55.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.945+0000 7f2182e7f700 1 Processor -- start 2024-02-19T19:08:55.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.945+0000 7f2182e7f700 1 -- start start 2024-02-19T19:08:55.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.945+0000 7f2182e7f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f217c100ea0 0x7f217c073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:55.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.945+0000 7f2182e7f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f217c101850 0x7f217c0735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:55.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.945+0000 7f2182e7f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c073b10 con 0x7f217c100ea0 2024-02-19T19:08:55.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.945+0000 7f2182e7f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217c073c50 con 0x7f217c101850 2024-02-19T19:08:55.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.945+0000 7f2180c1b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f217c100ea0 0x7f217c073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:55.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.945+0000 7f2180c1b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f217c100ea0 0x7f217c073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42576/0 (socket says 172.21.15.96:42576) 2024-02-19T19:08:55.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.945+0000 7f2180c1b700 1 -- 172.21.15.96:0/847795514 learned_addr learned my addr 172.21.15.96:0/847795514 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:08:55.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.945+0000 7f217bfff700 1 --2- 172.21.15.96:0/847795514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f217c101850 0x7f217c0735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:55.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.946+0000 7f2180c1b700 1 -- 172.21.15.96:0/847795514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f217c101850 msgr2=0x7f217c0735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:55.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.946+0000 7f2180c1b700 1 --2- 172.21.15.96:0/847795514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f217c101850 0x7f217c0735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:55.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.946+0000 7f2180c1b700 1 -- 172.21.15.96:0/847795514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21700095f0 con 0x7f217c100ea0 2024-02-19T19:08:55.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.946+0000 7f2180c1b700 1 --2- 172.21.15.96:0/847795514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f217c100ea0 0x7f217c073090 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f217400ef10 tx=0x7f217400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:55.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.946+0000 7f2179ffb700 1 -- 172.21.15.96:0/847795514 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f217400c9f0 con 0x7f217c100ea0 2024-02-19T19:08:55.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.946+0000 7f2179ffb700 1 -- 172.21.15.96:0/847795514 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f217400f040 con 0x7f217c100ea0 2024-02-19T19:08:55.969 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.946+0000 7f2182e7f700 1 -- 172.21.15.96:0/847795514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f217c073ed0 con 0x7f217c100ea0 2024-02-19T19:08:55.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.947+0000 7f2179ffb700 1 -- 172.21.15.96:0/847795514 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21740146b0 con 0x7f217c100ea0 2024-02-19T19:08:55.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.947+0000 7f2182e7f700 1 -- 172.21.15.96:0/847795514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f217c1a2e90 con 0x7f217c100ea0 2024-02-19T19:08:55.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.948+0000 7f2179ffb700 1 -- 172.21.15.96:0/847795514 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 36) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f217400cb50 con 0x7f217c100ea0 2024-02-19T19:08:55.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.948+0000 7f2182e7f700 1 -- 172.21.15.96:0/847795514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f217c1092a0 con 0x7f217c100ea0 2024-02-19T19:08:55.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.948+0000 7f2179ffb700 1 --2- 172.21.15.96:0/847795514 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f216406d7c0 0x7f216406fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:55.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.948+0000 7f2179ffb700 1 -- 172.21.15.96:0/847795514 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f217408d630 con 0x7f217c100ea0 2024-02-19T19:08:55.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.948+0000 7f217bfff700 1 --2- 172.21.15.96:0/847795514 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f216406d7c0 0x7f216406fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:55.970 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.949+0000 7f217bfff700 1 --2- 172.21.15.96:0/847795514 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f216406d7c0 0x7f216406fc80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f21700059d0 tx=0x7f2170005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:55.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:55.953+0000 7f2179ffb700 1 -- 172.21.15.96:0/847795514 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2174056c70 con 0x7f217c100ea0 2024-02-19T19:08:56.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.160+0000 7f2182e7f700 1 -- 172.21.15.96:0/847795514 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f217c074680 con 0x7f216406d7c0 2024-02-19T19:08:56.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.171+0000 7f2179ffb700 1 -- 172.21.15.96:0/847795514 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f217c074680 con 0x7f216406d7c0 2024-02-19T19:08:56.192 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:08:56.193 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3m) 45s ago 12m 26.0M - 0.25.0 c8568f914cd2 bbaf83a1e476 2024-02-19T19:08:56.193 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (13m) 45s ago 13m 8066k - 18.2.1 94eadd990e0a b41bff2e0043 2024-02-19T19:08:56.193 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (11m) 30s ago 11m 7977k - 18.2.1 94eadd990e0a 254ab7e7a040 2024-02-19T19:08:56.193 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (12m) 45s ago 12m 6665k - 18.2.1 94eadd990e0a 9250aadb9d78 2024-02-19T19:08:56.193 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (11m) 30s ago 11m 6669k - 18.2.1 94eadd990e0a b98ace7b5ded 2024-02-19T19:08:56.193 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2m) 45s ago 12m 80.9M - 9.4.12 a0ea5e3c46d9 0102d90938e4 2024-02-19T19:08:56.193 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (7m) 45s ago 7m 27.5M - 18.2.1 94eadd990e0a 0a61d9cd40d1 2024-02-19T19:08:56.193 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (7m) 45s ago 7m 24.5M - 18.2.1 94eadd990e0a 58db3e7a7d75 2024-02-19T19:08:56.193 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (7m) 30s ago 6m 28.5M - 18.2.1 94eadd990e0a 211d64de8a63 2024-02-19T19:08:56.193 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (7m) 30s ago 7m 26.6M - 18.2.1 94eadd990e0a 2a04b5a8eaf4 2024-02-19T19:08:56.193 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:8443,9283,8765 running (4m) 45s ago 14m 472M - 19.0.0-1450-gf78a58c0 f081f847070a a86fbe94fe3f 2024-02-19T19:08:56.193 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (4m) 30s ago 11m 447M - 19.0.0-1450-gf78a58c0 f081f847070a e250486d572d 2024-02-19T19:08:56.193 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (59s) 45s ago 14m 31.2M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d70090d516e3 2024-02-19T19:08:56.193 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (34s) 30s ago 11m 26.1M 2048M 19.0.0-1450-gf78a58c0 f081f847070a f56b17bdc9a0 2024-02-19T19:08:56.194 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (3m) 45s ago 12m 16.0M - 1.5.0 0da6a335fe13 51f622ea33d6 2024-02-19T19:08:56.194 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (3m) 30s ago 11m 17.0M - 1.5.0 0da6a335fe13 464e076a52a1 2024-02-19T19:08:56.194 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (10m) 45s ago 10m 51.0M 1216M 18.2.1 94eadd990e0a d5bbf07ad0e7 2024-02-19T19:08:56.194 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (10m) 45s ago 10m 51.1M 1216M 18.2.1 94eadd990e0a 40329d59be45 2024-02-19T19:08:56.194 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (9m) 45s ago 9m 49.4M 1216M 18.2.1 94eadd990e0a 4f1e49db2d41 2024-02-19T19:08:56.194 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (9m) 30s ago 9m 51.6M 2240M 18.2.1 94eadd990e0a 4746b79351fc 2024-02-19T19:08:56.194 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (9m) 30s ago 9m 50.9M 2240M 18.2.1 94eadd990e0a 2b3f0088f6b2 2024-02-19T19:08:56.194 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (8m) 30s ago 8m 47.7M 2240M 18.2.1 94eadd990e0a e5731974b46a 2024-02-19T19:08:56.194 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (3m) 45s ago 12m 60.6M - 2.43.0 a07b618ecd1d a4edcf6ed669 2024-02-19T19:08:56.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.173+0000 7f2182e7f700 1 -- 172.21.15.96:0/847795514 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f216406d7c0 msgr2=0x7f216406fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:56.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.173+0000 7f2182e7f700 1 --2- 172.21.15.96:0/847795514 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f216406d7c0 0x7f216406fc80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f21700059d0 tx=0x7f2170005940 comp rx=0 tx=0).stop 2024-02-19T19:08:56.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.173+0000 7f2182e7f700 1 -- 172.21.15.96:0/847795514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f217c100ea0 msgr2=0x7f217c073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:56.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.173+0000 7f2182e7f700 1 --2- 172.21.15.96:0/847795514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f217c100ea0 0x7f217c073090 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f217400ef10 tx=0x7f217400c3a0 comp rx=0 tx=0).stop 2024-02-19T19:08:56.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.173+0000 7f2182e7f700 1 -- 172.21.15.96:0/847795514 shutdown_connections 2024-02-19T19:08:56.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.173+0000 7f2182e7f700 1 --2- 172.21.15.96:0/847795514 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f216406d7c0 0x7f216406fc80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:56.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.173+0000 7f2182e7f700 1 --2- 172.21.15.96:0/847795514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f217c100ea0 0x7f217c073090 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:56.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.173+0000 7f2182e7f700 1 --2- 172.21.15.96:0/847795514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f217c101850 0x7f217c0735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:56.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.173+0000 7f2182e7f700 1 -- 172.21.15.96:0/847795514 >> 172.21.15.96:0/847795514 conn(0x7f217c0fc750 msgr2=0x7f217c0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:56.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.174+0000 7f2182e7f700 1 -- 172.21.15.96:0/847795514 shutdown_connections 2024-02-19T19:08:56.195 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.174+0000 7f2182e7f700 1 -- 172.21.15.96:0/847795514 wait complete. 2024-02-19T19:08:56.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.275+0000 7f111a0e5700 1 -- 172.21.15.96:0/1994281616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11140ffe50 msgr2=0x7f11141057e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:56.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.275+0000 7f111a0e5700 1 --2- 172.21.15.96:0/1994281616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11140ffe50 0x7f11141057e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1108009910 tx=0x7f1108009c20 comp rx=0 tx=0).stop 2024-02-19T19:08:56.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.275+0000 7f111a0e5700 1 -- 172.21.15.96:0/1994281616 shutdown_connections 2024-02-19T19:08:56.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.275+0000 7f111a0e5700 1 --2- 172.21.15.96:0/1994281616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11140ffe50 0x7f11141057e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:56.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.275+0000 7f111a0e5700 1 --2- 172.21.15.96:0/1994281616 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11140ff4a0 0x7f11140ff880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:56.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.275+0000 7f111a0e5700 1 -- 172.21.15.96:0/1994281616 >> 172.21.15.96:0/1994281616 conn(0x7f1114074d40 msgr2=0x7f1114075150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:56.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.275+0000 7f111a0e5700 1 -- 172.21.15.96:0/1994281616 shutdown_connections 2024-02-19T19:08:56.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.275+0000 7f111a0e5700 1 -- 172.21.15.96:0/1994281616 wait complete. 2024-02-19T19:08:56.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.276+0000 7f111a0e5700 1 Processor -- start 2024-02-19T19:08:56.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.276+0000 7f111a0e5700 1 -- start start 2024-02-19T19:08:56.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.276+0000 7f111a0e5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11140ff4a0 0x7f111419c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:56.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.276+0000 7f111a0e5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11140ffe50 0x7f111419ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:56.299 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.276+0000 7f111a0e5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111419d040 con 0x7f11140ff4a0 2024-02-19T19:08:56.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.276+0000 7f111a0e5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1114196580 con 0x7f11140ffe50 2024-02-19T19:08:56.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.277+0000 7f11137fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11140ff4a0 0x7f111419c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:56.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.277+0000 7f11137fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11140ff4a0 0x7f111419c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42596/0 (socket says 172.21.15.96:42596) 2024-02-19T19:08:56.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.277+0000 7f11137fe700 1 -- 172.21.15.96:0/1771510046 learned_addr learned my addr 172.21.15.96:0/1771510046 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:08:56.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.277+0000 7f1112ffd700 1 --2- 172.21.15.96:0/1771510046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11140ffe50 0x7f111419ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:56.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.277+0000 7f11137fe700 1 -- 172.21.15.96:0/1771510046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11140ffe50 msgr2=0x7f111419ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:56.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.277+0000 7f11137fe700 1 --2- 172.21.15.96:0/1771510046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11140ffe50 0x7f111419ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:56.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.277+0000 7f11137fe700 1 -- 172.21.15.96:0/1771510046 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11080095f0 con 0x7f11140ff4a0 2024-02-19T19:08:56.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.277+0000 7f11137fe700 1 --2- 172.21.15.96:0/1771510046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11140ff4a0 0x7f111419c500 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f110400c930 tx=0x7f110400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:56.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.277+0000 7f1110ff9700 1 -- 172.21.15.96:0/1771510046 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1104007ad0 con 0x7f11140ff4a0 2024-02-19T19:08:56.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.277+0000 7f111a0e5700 1 -- 172.21.15.96:0/1771510046 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1114196860 con 0x7f11140ff4a0 2024-02-19T19:08:56.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.277+0000 7f1110ff9700 1 -- 172.21.15.96:0/1771510046 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1104007c30 con 0x7f11140ff4a0 2024-02-19T19:08:56.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.277+0000 7f1110ff9700 1 -- 172.21.15.96:0/1771510046 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1104018610 con 0x7f11140ff4a0 2024-02-19T19:08:56.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.277+0000 7f111a0e5700 1 -- 172.21.15.96:0/1771510046 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1114196db0 con 0x7f11140ff4a0 2024-02-19T19:08:56.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.278+0000 7f111a0e5700 1 -- 172.21.15.96:0/1771510046 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11141090c0 con 0x7f11140ff4a0 2024-02-19T19:08:56.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.279+0000 7f1110ff9700 1 -- 172.21.15.96:0/1771510046 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 36) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f110400f450 con 0x7f11140ff4a0 2024-02-19T19:08:56.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.279+0000 7f1110ff9700 1 --2- 172.21.15.96:0/1771510046 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f10fc06d9e0 0x7f10fc06fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:56.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.279+0000 7f1110ff9700 1 -- 172.21.15.96:0/1771510046 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f110408d930 con 0x7f11140ff4a0 2024-02-19T19:08:56.301 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.279+0000 7f1112ffd700 1 --2- 172.21.15.96:0/1771510046 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f10fc06d9e0 0x7f10fc06fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:56.302 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.280+0000 7f1112ffd700 1 --2- 172.21.15.96:0/1771510046 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f10fc06d9e0 0x7f10fc06fea0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f11140fe020 tx=0x7f110801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:56.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.284+0000 7f1110ff9700 1 -- 172.21.15.96:0/1771510046 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f110405aaa0 con 0x7f11140ff4a0 2024-02-19T19:08:56.587 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.566+0000 7f111a0e5700 1 -- 172.21.15.96:0/1771510046 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1114197030 con 0x7f11140ff4a0 2024-02-19T19:08:56.588 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:56 smithi096 ceph-mon[112483]: pgmap v28: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:08:56.588 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:56 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:56.588 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:56 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:56.588 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:56 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-19T19:08:56.588 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:56 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:56.588 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.566+0000 7f1110ff9700 1 -- 172.21.15.96:0/1771510046 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7f110405a630 con 0x7f11140ff4a0 2024-02-19T19:08:56.588 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:08:56.588 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:08:56.589 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:08:56.589 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:08:56.589 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:08:56.589 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:08:56.589 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:08:56.589 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:08:56.589 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-19T19:08:56.589 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:08:56.589 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:08:56.589 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-19T19:08:56.589 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:08:56.589 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:08:56.589 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 10, 2024-02-19T19:08:56.589 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-19T19:08:56.590 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:08:56.590 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:08:56.590 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.568+0000 7f111a0e5700 1 -- 172.21.15.96:0/1771510046 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f10fc06d9e0 msgr2=0x7f10fc06fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:56.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.568+0000 7f111a0e5700 1 --2- 172.21.15.96:0/1771510046 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f10fc06d9e0 0x7f10fc06fea0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f11140fe020 tx=0x7f110801a040 comp rx=0 tx=0).stop 2024-02-19T19:08:56.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.568+0000 7f111a0e5700 1 -- 172.21.15.96:0/1771510046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11140ff4a0 msgr2=0x7f111419c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:56.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.568+0000 7f111a0e5700 1 --2- 172.21.15.96:0/1771510046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11140ff4a0 0x7f111419c500 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f110400c930 tx=0x7f110400ccf0 comp rx=0 tx=0).stop 2024-02-19T19:08:56.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.569+0000 7f111a0e5700 1 -- 172.21.15.96:0/1771510046 shutdown_connections 2024-02-19T19:08:56.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.569+0000 7f111a0e5700 1 --2- 172.21.15.96:0/1771510046 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f10fc06d9e0 0x7f10fc06fea0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:56.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.569+0000 7f111a0e5700 1 --2- 172.21.15.96:0/1771510046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11140ff4a0 0x7f111419c500 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:56.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.569+0000 7f111a0e5700 1 --2- 172.21.15.96:0/1771510046 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11140ffe50 0x7f111419ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:56.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.569+0000 7f111a0e5700 1 -- 172.21.15.96:0/1771510046 >> 172.21.15.96:0/1771510046 conn(0x7f1114074d40 msgr2=0x7f1114105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:56.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.569+0000 7f111a0e5700 1 -- 172.21.15.96:0/1771510046 shutdown_connections 2024-02-19T19:08:56.591 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.569+0000 7f111a0e5700 1 -- 172.21.15.96:0/1771510046 wait complete. 2024-02-19T19:08:56.606 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:56 smithi125 ceph-mon[86115]: pgmap v28: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:08:56.606 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:56 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:56.606 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:56 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:56.607 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:56 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-19T19:08:56.607 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:56 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:56.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.672+0000 7f2918978700 1 -- 172.21.15.96:0/3995621492 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29140fff50 msgr2=0x7f2914105840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:56.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.672+0000 7f2918978700 1 --2- 172.21.15.96:0/3995621492 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29140fff50 0x7f2914105840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2904009910 tx=0x7f2904009c20 comp rx=0 tx=0).stop 2024-02-19T19:08:56.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.672+0000 7f2918978700 1 -- 172.21.15.96:0/3995621492 shutdown_connections 2024-02-19T19:08:56.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.672+0000 7f2918978700 1 --2- 172.21.15.96:0/3995621492 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29140fff50 0x7f2914105840 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:56.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.672+0000 7f2918978700 1 --2- 172.21.15.96:0/3995621492 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29140ff5a0 0x7f29140ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:56.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.673+0000 7f2918978700 1 -- 172.21.15.96:0/3995621492 >> 172.21.15.96:0/3995621492 conn(0x7f2914074e30 msgr2=0x7f2914075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:56.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.673+0000 7f2918978700 1 -- 172.21.15.96:0/3995621492 shutdown_connections 2024-02-19T19:08:56.694 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.673+0000 7f2918978700 1 -- 172.21.15.96:0/3995621492 wait complete. 2024-02-19T19:08:56.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.673+0000 7f2918978700 1 Processor -- start 2024-02-19T19:08:56.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.673+0000 7f2918978700 1 -- start start 2024-02-19T19:08:56.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.674+0000 7f2918978700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29140ff5a0 0x7f2914100520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:56.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.674+0000 7f2918978700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29140fff50 0x7f2914100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:56.696 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.674+0000 7f2918978700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2914100fa0 con 0x7f29140fff50 2024-02-19T19:08:56.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.674+0000 7f2918978700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29141010e0 con 0x7f29140ff5a0 2024-02-19T19:08:56.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.674+0000 7f2911d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29140fff50 0x7f2914100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:56.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.674+0000 7f291259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29140ff5a0 0x7f2914100520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:56.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.674+0000 7f2911d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29140fff50 0x7f2914100a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42622/0 (socket says 172.21.15.96:42622) 2024-02-19T19:08:56.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.674+0000 7f2911d9b700 1 -- 172.21.15.96:0/1594236514 learned_addr learned my addr 172.21.15.96:0/1594236514 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:08:56.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.674+0000 7f2911d9b700 1 -- 172.21.15.96:0/1594236514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29140ff5a0 msgr2=0x7f2914100520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:56.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.674+0000 7f2911d9b700 1 --2- 172.21.15.96:0/1594236514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29140ff5a0 0x7f2914100520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:56.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.674+0000 7f2911d9b700 1 -- 172.21.15.96:0/1594236514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29040095f0 con 0x7f29140fff50 2024-02-19T19:08:56.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.674+0000 7f291259c700 1 --2- 172.21.15.96:0/1594236514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29140ff5a0 0x7f2914100520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:08:56.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.674+0000 7f2911d9b700 1 --2- 172.21.15.96:0/1594236514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29140fff50 0x7f2914100a60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2904009fd0 tx=0x7f290400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:56.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.674+0000 7f29037fe700 1 -- 172.21.15.96:0/1594236514 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f290401d070 con 0x7f29140fff50 2024-02-19T19:08:56.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.674+0000 7f2918978700 1 -- 172.21.15.96:0/1594236514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2914101360 con 0x7f29140fff50 2024-02-19T19:08:56.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.674+0000 7f29037fe700 1 -- 172.21.15.96:0/1594236514 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2904022470 con 0x7f29140fff50 2024-02-19T19:08:56.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.674+0000 7f29037fe700 1 -- 172.21.15.96:0/1594236514 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2904017650 con 0x7f29140fff50 2024-02-19T19:08:56.697 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.674+0000 7f2918978700 1 -- 172.21.15.96:0/1594236514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29141a2d10 con 0x7f29140fff50 2024-02-19T19:08:56.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.675+0000 7f2918978700 1 -- 172.21.15.96:0/1594236514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2914109200 con 0x7f29140fff50 2024-02-19T19:08:56.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.676+0000 7f29037fe700 1 -- 172.21.15.96:0/1594236514 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 36) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f29040225e0 con 0x7f29140fff50 2024-02-19T19:08:56.698 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.676+0000 7f29037fe700 1 --2- 172.21.15.96:0/1594236514 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f28fc06d9d0 0x7f28fc06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:56.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.677+0000 7f291259c700 1 --2- 172.21.15.96:0/1594236514 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f28fc06d9d0 0x7f28fc06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:56.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.677+0000 7f29037fe700 1 -- 172.21.15.96:0/1594236514 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f290408ec00 con 0x7f29140fff50 2024-02-19T19:08:56.699 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.677+0000 7f291259c700 1 --2- 172.21.15.96:0/1594236514 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f28fc06d9d0 0x7f28fc06fe90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2908011490 tx=0x7f2908009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:56.702 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.681+0000 7f29037fe700 1 -- 172.21.15.96:0/1594236514 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2904094020 con 0x7f29140fff50 2024-02-19T19:08:56.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.923+0000 7f2918978700 1 -- 172.21.15.96:0/1594236514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f291404f2e0 con 0x7f29140fff50 2024-02-19T19:08:56.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.923+0000 7f29037fe700 1 -- 172.21.15.96:0/1594236514 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1869 (secure 0 0 0) 0x7f2904058240 con 0x7f29140fff50 2024-02-19T19:08:56.944 INFO:teuthology.orchestra.run.smithi096.stdout:e19 2024-02-19T19:08:56.945 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:08:56.945 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:08:56.945 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2024-02-19T19:08:56.945 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:08:56.945 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:08:56.945 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2024-02-19T19:08:56.945 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 19 2024-02-19T19:08:56.945 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-19T19:08:56.945 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-02-19T19:01:42.881136+0000 2024-02-19T19:08:56.945 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2024-02-19T19:02:02.873590+0000 2024-02-19T19:08:56.945 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2024-02-19T19:08:56.945 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2024-02-19T19:08:56.945 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2024-02-19T19:08:56.945 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2024-02-19T19:08:56.945 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2024-02-19T19:08:56.945 INFO:teuthology.orchestra.run.smithi096.stdout:max_xattr_size 65536 2024-02-19T19:08:56.945 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2024-02-19T19:08:56.946 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2024-02-19T19:08:56.946 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 46 2024-02-19T19:08:56.946 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:08:56.946 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2024-02-19T19:08:56.946 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2024-02-19T19:08:56.946 INFO:teuthology.orchestra.run.smithi096.stdout:up {0=14490,1=24267} 2024-02-19T19:08:56.946 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2024-02-19T19:08:56.946 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2024-02-19T19:08:56.946 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2024-02-19T19:08:56.946 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2024-02-19T19:08:56.946 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2024-02-19T19:08:56.946 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data enabled 2024-02-19T19:08:56.947 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2024-02-19T19:08:56.947 INFO:teuthology.orchestra.run.smithi096.stdout:bal_rank_mask -1 2024-02-19T19:08:56.947 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2024-02-19T19:08:56.947 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pccmys{0:14490} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:08:56.947 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.usrmcg{0:14502} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/413113741,v1:172.21.15.96:6827/413113741] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:08:56.947 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.srnlol{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.125:6824/3084054986,v1:172.21.15.125:6825/3084054986] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:08:56.947 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.pwyuga{1:24275} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.125:6826/3098247423,v1:172.21.15.125:6827/3098247423] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:08:56.947 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:08:56.947 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:08:56.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.925+0000 7f2918978700 1 -- 172.21.15.96:0/1594236514 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f28fc06d9d0 msgr2=0x7f28fc06fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:56.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.925+0000 7f2918978700 1 --2- 172.21.15.96:0/1594236514 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f28fc06d9d0 0x7f28fc06fe90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2908011490 tx=0x7f2908009260 comp rx=0 tx=0).stop 2024-02-19T19:08:56.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.925+0000 7f2918978700 1 -- 172.21.15.96:0/1594236514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29140fff50 msgr2=0x7f2914100a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:56.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.925+0000 7f2918978700 1 --2- 172.21.15.96:0/1594236514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29140fff50 0x7f2914100a60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2904009fd0 tx=0x7f290400f690 comp rx=0 tx=0).stop 2024-02-19T19:08:56.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.925+0000 7f2918978700 1 -- 172.21.15.96:0/1594236514 shutdown_connections 2024-02-19T19:08:56.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.925+0000 7f2918978700 1 --2- 172.21.15.96:0/1594236514 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f28fc06d9d0 0x7f28fc06fe90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:56.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.925+0000 7f2918978700 1 --2- 172.21.15.96:0/1594236514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f29140ff5a0 0x7f2914100520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:56.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.925+0000 7f2918978700 1 --2- 172.21.15.96:0/1594236514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f29140fff50 0x7f2914100a60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:56.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.925+0000 7f2918978700 1 -- 172.21.15.96:0/1594236514 >> 172.21.15.96:0/1594236514 conn(0x7f2914074e30 msgr2=0x7f29140fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:56.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.925+0000 7f2918978700 1 -- 172.21.15.96:0/1594236514 shutdown_connections 2024-02-19T19:08:56.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:56.925+0000 7f2918978700 1 -- 172.21.15.96:0/1594236514 wait complete. 2024-02-19T19:08:56.949 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 19 2024-02-19T19:08:57.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.029+0000 7fe633387700 1 -- 172.21.15.96:0/2320795921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe62c0ffda0 msgr2=0x7fe62c100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:57.050 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.029+0000 7fe633387700 1 --2- 172.21.15.96:0/2320795921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe62c0ffda0 0x7fe62c100180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe628009910 tx=0x7fe628009c20 comp rx=0 tx=0).stop 2024-02-19T19:08:57.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.029+0000 7fe633387700 1 -- 172.21.15.96:0/2320795921 shutdown_connections 2024-02-19T19:08:57.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.029+0000 7fe633387700 1 --2- 172.21.15.96:0/2320795921 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe62c100750 0x7fe62c1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:57.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.029+0000 7fe633387700 1 --2- 172.21.15.96:0/2320795921 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe62c0ffda0 0x7fe62c100180 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:57.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.029+0000 7fe633387700 1 -- 172.21.15.96:0/2320795921 >> 172.21.15.96:0/2320795921 conn(0x7fe62c0fb650 msgr2=0x7fe62c0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:57.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.029+0000 7fe633387700 1 -- 172.21.15.96:0/2320795921 shutdown_connections 2024-02-19T19:08:57.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.029+0000 7fe633387700 1 -- 172.21.15.96:0/2320795921 wait complete. 2024-02-19T19:08:57.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.030+0000 7fe633387700 1 Processor -- start 2024-02-19T19:08:57.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.030+0000 7fe633387700 1 -- start start 2024-02-19T19:08:57.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.030+0000 7fe633387700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe62c0ffda0 0x7fe62c19c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:57.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.030+0000 7fe633387700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe62c100750 0x7fe62c19cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:57.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.030+0000 7fe633387700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c19d2c0 con 0x7fe62c0ffda0 2024-02-19T19:08:57.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.030+0000 7fe633387700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62c196770 con 0x7fe62c100750 2024-02-19T19:08:57.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.030+0000 7fe631123700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe62c0ffda0 0x7fe62c19c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:57.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.030+0000 7fe631123700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe62c0ffda0 0x7fe62c19c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42642/0 (socket says 172.21.15.96:42642) 2024-02-19T19:08:57.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.030+0000 7fe631123700 1 -- 172.21.15.96:0/3086132361 learned_addr learned my addr 172.21.15.96:0/3086132361 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:08:57.053 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.030+0000 7fe630922700 1 --2- 172.21.15.96:0/3086132361 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe62c100750 0x7fe62c19cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:57.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.030+0000 7fe631123700 1 -- 172.21.15.96:0/3086132361 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe62c100750 msgr2=0x7fe62c19cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:57.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.030+0000 7fe631123700 1 --2- 172.21.15.96:0/3086132361 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe62c100750 0x7fe62c19cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:57.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.030+0000 7fe631123700 1 -- 172.21.15.96:0/3086132361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6280095f0 con 0x7fe62c0ffda0 2024-02-19T19:08:57.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.031+0000 7fe631123700 1 --2- 172.21.15.96:0/3086132361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe62c0ffda0 0x7fe62c19c6f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe628006010 tx=0x7fe62800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:57.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.031+0000 7fe6227fc700 1 -- 172.21.15.96:0/3086132361 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe62801d070 con 0x7fe62c0ffda0 2024-02-19T19:08:57.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.031+0000 7fe633387700 1 -- 172.21.15.96:0/3086132361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe62c1969f0 con 0x7fe62c0ffda0 2024-02-19T19:08:57.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.031+0000 7fe6227fc700 1 -- 172.21.15.96:0/3086132361 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe628005dc0 con 0x7fe62c0ffda0 2024-02-19T19:08:57.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.031+0000 7fe6227fc700 1 -- 172.21.15.96:0/3086132361 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe628017400 con 0x7fe62c0ffda0 2024-02-19T19:08:57.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.031+0000 7fe633387700 1 -- 172.21.15.96:0/3086132361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe62c196ee0 con 0x7fe62c0ffda0 2024-02-19T19:08:57.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.032+0000 7fe633387700 1 -- 172.21.15.96:0/3086132361 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe62c04f2e0 con 0x7fe62c0ffda0 2024-02-19T19:08:57.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.032+0000 7fe6227fc700 1 -- 172.21.15.96:0/3086132361 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 36) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fe628003a60 con 0x7fe62c0ffda0 2024-02-19T19:08:57.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.033+0000 7fe6227fc700 1 --2- 172.21.15.96:0/3086132361 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe61806d9e0 0x7fe61806fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:57.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.033+0000 7fe6227fc700 1 -- 172.21.15.96:0/3086132361 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe62808eba0 con 0x7fe62c0ffda0 2024-02-19T19:08:57.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.033+0000 7fe630922700 1 --2- 172.21.15.96:0/3086132361 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe61806d9e0 0x7fe61806fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:57.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.033+0000 7fe630922700 1 --2- 172.21.15.96:0/3086132361 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe61806d9e0 0x7fe61806fea0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe62c197be0 tx=0x7fe61c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:57.058 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.037+0000 7fe6227fc700 1 -- 172.21.15.96:0/3086132361 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe62805bd10 con 0x7fe62c0ffda0 2024-02-19T19:08:57.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.253+0000 7fe633387700 1 -- 172.21.15.96:0/3086132361 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe62c197100 con 0x7fe61806d9e0 2024-02-19T19:08:57.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.254+0000 7fe6227fc700 1 -- 172.21.15.96:0/3086132361 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fe62c197100 con 0x7fe61806d9e0 2024-02-19T19:08:57.275 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:08:57.275 INFO:teuthology.orchestra.run.smithi096.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:08:57.275 INFO:teuthology.orchestra.run.smithi096.stdout: "in_progress": true, 2024-02-19T19:08:57.275 INFO:teuthology.orchestra.run.smithi096.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:08:57.275 INFO:teuthology.orchestra.run.smithi096.stdout: "services_complete": [ 2024-02-19T19:08:57.276 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr", 2024-02-19T19:08:57.276 INFO:teuthology.orchestra.run.smithi096.stdout: "mon" 2024-02-19T19:08:57.276 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-02-19T19:08:57.276 INFO:teuthology.orchestra.run.smithi096.stdout: "progress": "4/23 daemons upgraded", 2024-02-19T19:08:57.276 INFO:teuthology.orchestra.run.smithi096.stdout: "message": "Currently upgrading mon daemons", 2024-02-19T19:08:57.276 INFO:teuthology.orchestra.run.smithi096.stdout: "is_paused": false 2024-02-19T19:08:57.276 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:08:57.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.256+0000 7fe633387700 1 -- 172.21.15.96:0/3086132361 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe61806d9e0 msgr2=0x7fe61806fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:57.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.256+0000 7fe633387700 1 --2- 172.21.15.96:0/3086132361 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe61806d9e0 0x7fe61806fea0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe62c197be0 tx=0x7fe61c00b410 comp rx=0 tx=0).stop 2024-02-19T19:08:57.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.256+0000 7fe633387700 1 -- 172.21.15.96:0/3086132361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe62c0ffda0 msgr2=0x7fe62c19c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:57.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.256+0000 7fe633387700 1 --2- 172.21.15.96:0/3086132361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe62c0ffda0 0x7fe62c19c6f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe628006010 tx=0x7fe62800bd70 comp rx=0 tx=0).stop 2024-02-19T19:08:57.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.256+0000 7fe633387700 1 -- 172.21.15.96:0/3086132361 shutdown_connections 2024-02-19T19:08:57.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.256+0000 7fe633387700 1 --2- 172.21.15.96:0/3086132361 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe61806d9e0 0x7fe61806fea0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:57.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.257+0000 7fe633387700 1 --2- 172.21.15.96:0/3086132361 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe62c0ffda0 0x7fe62c19c6f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:57.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.257+0000 7fe633387700 1 --2- 172.21.15.96:0/3086132361 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe62c100750 0x7fe62c19cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:57.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.257+0000 7fe633387700 1 -- 172.21.15.96:0/3086132361 >> 172.21.15.96:0/3086132361 conn(0x7fe62c0fb650 msgr2=0x7fe62c103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:57.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.257+0000 7fe633387700 1 -- 172.21.15.96:0/3086132361 shutdown_connections 2024-02-19T19:08:57.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.257+0000 7fe633387700 1 -- 172.21.15.96:0/3086132361 wait complete. 2024-02-19T19:08:57.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.360+0000 7f21e69a2700 1 -- 172.21.15.96:0/1238570988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e0102a50 msgr2=0x7f21e0102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:57.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.360+0000 7f21e69a2700 1 --2- 172.21.15.96:0/1238570988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e0102a50 0x7f21e0102e30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009910 tx=0x7f21dc009c20 comp rx=0 tx=0).stop 2024-02-19T19:08:57.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.360+0000 7f21e69a2700 1 -- 172.21.15.96:0/1238570988 shutdown_connections 2024-02-19T19:08:57.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.360+0000 7f21e69a2700 1 --2- 172.21.15.96:0/1238570988 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21e00feec0 0x7f21e00ff340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:57.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.360+0000 7f21e69a2700 1 --2- 172.21.15.96:0/1238570988 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e0102a50 0x7f21e0102e30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:57.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.360+0000 7f21e69a2700 1 -- 172.21.15.96:0/1238570988 >> 172.21.15.96:0/1238570988 conn(0x7f21e0075da0 msgr2=0x7f21e00fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:57.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.360+0000 7f21e69a2700 1 -- 172.21.15.96:0/1238570988 shutdown_connections 2024-02-19T19:08:57.383 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.360+0000 7f21e69a2700 1 -- 172.21.15.96:0/1238570988 wait complete. 2024-02-19T19:08:57.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.361+0000 7f21e69a2700 1 Processor -- start 2024-02-19T19:08:57.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.361+0000 7f21e69a2700 1 -- start start 2024-02-19T19:08:57.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.361+0000 7f21e69a2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21e00feec0 0x7f21e019c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:57.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.361+0000 7f21e69a2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e0102a50 0x7f21e019cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:57.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.361+0000 7f21e69a2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e019d160 con 0x7f21e0102a50 2024-02-19T19:08:57.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.361+0000 7f21e69a2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e0196610 con 0x7f21e00feec0 2024-02-19T19:08:57.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.361+0000 7f21e519f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e0102a50 0x7f21e019cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:57.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.361+0000 7f21e519f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e0102a50 0x7f21e019cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42660/0 (socket says 172.21.15.96:42660) 2024-02-19T19:08:57.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.361+0000 7f21e519f700 1 -- 172.21.15.96:0/4017267864 learned_addr learned my addr 172.21.15.96:0/4017267864 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:08:57.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.361+0000 7f21e59a0700 1 --2- 172.21.15.96:0/4017267864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21e00feec0 0x7f21e019c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:57.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.361+0000 7f21e519f700 1 -- 172.21.15.96:0/4017267864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21e00feec0 msgr2=0x7f21e019c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:57.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.361+0000 7f21e519f700 1 --2- 172.21.15.96:0/4017267864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21e00feec0 0x7f21e019c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:57.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.361+0000 7f21e519f700 1 -- 172.21.15.96:0/4017267864 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21dc0095f0 con 0x7f21e0102a50 2024-02-19T19:08:57.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.361+0000 7f21e519f700 1 --2- 172.21.15.96:0/4017267864 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e0102a50 0x7f21e019cad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f21d000e920 tx=0x7f21d000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:57.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.362+0000 7f21d6ffd700 1 -- 172.21.15.96:0/4017267864 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21d000c9d0 con 0x7f21e0102a50 2024-02-19T19:08:57.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.362+0000 7f21d6ffd700 1 -- 172.21.15.96:0/4017267864 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f21d0010430 con 0x7f21e0102a50 2024-02-19T19:08:57.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.362+0000 7f21e69a2700 1 -- 172.21.15.96:0/4017267864 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e0196890 con 0x7f21e0102a50 2024-02-19T19:08:57.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.362+0000 7f21d6ffd700 1 -- 172.21.15.96:0/4017267864 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21d0018630 con 0x7f21e0102a50 2024-02-19T19:08:57.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.362+0000 7f21e69a2700 1 -- 172.21.15.96:0/4017267864 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e0196de0 con 0x7f21e0102a50 2024-02-19T19:08:57.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.363+0000 7f21e69a2700 1 -- 172.21.15.96:0/4017267864 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e00623c0 con 0x7f21e0102a50 2024-02-19T19:08:57.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.363+0000 7f21d6ffd700 1 -- 172.21.15.96:0/4017267864 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 36) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f21d00105a0 con 0x7f21e0102a50 2024-02-19T19:08:57.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.363+0000 7f21d6ffd700 1 --2- 172.21.15.96:0/4017267864 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f21cc06d9e0 0x7f21cc06fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:08:57.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.364+0000 7f21d6ffd700 1 -- 172.21.15.96:0/4017267864 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f21d0014070 con 0x7f21e0102a50 2024-02-19T19:08:57.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.364+0000 7f21e59a0700 1 --2- 172.21.15.96:0/4017267864 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f21cc06d9e0 0x7f21cc06fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:08:57.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.364+0000 7f21e59a0700 1 --2- 172.21.15.96:0/4017267864 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f21cc06d9e0 0x7f21cc06fea0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f21dc000c00 tx=0x7f21dc009f70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:08:57.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.368+0000 7f21d6ffd700 1 -- 172.21.15.96:0/4017267864 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f21d0052d20 con 0x7f21e0102a50 2024-02-19T19:08:57.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:57 smithi096 ceph-mon[112483]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:57.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:57 smithi096 ceph-mon[112483]: Reconfiguring osd.5 (monmap changed)... 2024-02-19T19:08:57.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:57 smithi096 ceph-mon[112483]: Reconfiguring daemon osd.5 on smithi125 2024-02-19T19:08:57.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:57 smithi096 ceph-mon[112483]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:57.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:57 smithi096 ceph-mon[112483]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:57.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:57 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/1771510046' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:08:57.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:57 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/1594236514' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:08:57.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.651+0000 7f21e69a2700 1 -- 172.21.15.96:0/4017267864 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f21e0197b20 con 0x7f21e0102a50 2024-02-19T19:08:57.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.651+0000 7f21d6ffd700 1 -- 172.21.15.96:0/4017267864 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f21d005ab30 con 0x7f21e0102a50 2024-02-19T19:08:57.673 INFO:teuthology.orchestra.run.smithi096.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T19:08:57.673 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-19T19:08:57.673 INFO:teuthology.orchestra.run.smithi096.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-19T19:08:57.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.653+0000 7f21e69a2700 1 -- 172.21.15.96:0/4017267864 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f21cc06d9e0 msgr2=0x7f21cc06fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:57.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.653+0000 7f21e69a2700 1 --2- 172.21.15.96:0/4017267864 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f21cc06d9e0 0x7f21cc06fea0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f21dc000c00 tx=0x7f21dc009f70 comp rx=0 tx=0).stop 2024-02-19T19:08:57.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.653+0000 7f21e69a2700 1 -- 172.21.15.96:0/4017267864 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e0102a50 msgr2=0x7f21e019cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:08:57.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.653+0000 7f21e69a2700 1 --2- 172.21.15.96:0/4017267864 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e0102a50 0x7f21e019cad0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f21d000e920 tx=0x7f21d000ec30 comp rx=0 tx=0).stop 2024-02-19T19:08:57.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.653+0000 7f21e69a2700 1 -- 172.21.15.96:0/4017267864 shutdown_connections 2024-02-19T19:08:57.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.653+0000 7f21e69a2700 1 --2- 172.21.15.96:0/4017267864 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f21cc06d9e0 0x7f21cc06fea0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:57.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.653+0000 7f21e69a2700 1 --2- 172.21.15.96:0/4017267864 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21e00feec0 0x7f21e019c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:57.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.653+0000 7f21e69a2700 1 --2- 172.21.15.96:0/4017267864 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e0102a50 0x7f21e019cad0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:08:57.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.653+0000 7f21e69a2700 1 -- 172.21.15.96:0/4017267864 >> 172.21.15.96:0/4017267864 conn(0x7f21e0075da0 msgr2=0x7f21e00fb570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:08:57.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.654+0000 7f21e69a2700 1 -- 172.21.15.96:0/4017267864 shutdown_connections 2024-02-19T19:08:57.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:08:57.654+0000 7f21e69a2700 1 -- 172.21.15.96:0/4017267864 wait complete. 2024-02-19T19:08:57.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:57 smithi125 ceph-mon[86115]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:57.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:57 smithi125 ceph-mon[86115]: Reconfiguring osd.5 (monmap changed)... 2024-02-19T19:08:57.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:57 smithi125 ceph-mon[86115]: Reconfiguring daemon osd.5 on smithi125 2024-02-19T19:08:57.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:57 smithi125 ceph-mon[86115]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:57.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:57 smithi125 ceph-mon[86115]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:57.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:57 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/1771510046' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:08:57.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:57 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/1594236514' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:08:58.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:58 smithi125 ceph-mon[86115]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:58.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:58 smithi125 ceph-mon[86115]: pgmap v29: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:08:58.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:58 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:58.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:58 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:58.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:58 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi125.srnlol", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:08:58.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:58 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:58.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:58 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/4017267864' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:08:58.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:58 smithi096 ceph-mon[112483]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:08:58.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:58 smithi096 ceph-mon[112483]: pgmap v29: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:08:58.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:58 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:58.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:58 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:58.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:58 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi125.srnlol", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:08:58.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:58 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:58.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:58 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/4017267864' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:08:59.658 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:59 smithi125 ceph-mon[86115]: Reconfiguring mds.cephfs.smithi125.srnlol (monmap changed)... 2024-02-19T19:08:59.658 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:59 smithi125 ceph-mon[86115]: Reconfiguring daemon mds.cephfs.smithi125.srnlol on smithi125 2024-02-19T19:08:59.658 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:59 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:59.658 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:59 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:59.658 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:59 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi125.pwyuga", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:08:59.658 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:08:59 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:08:59.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:59 smithi096 ceph-mon[112483]: Reconfiguring mds.cephfs.smithi125.srnlol (monmap changed)... 2024-02-19T19:08:59.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:59 smithi096 ceph-mon[112483]: Reconfiguring daemon mds.cephfs.smithi125.srnlol on smithi125 2024-02-19T19:08:59.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:59 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:59.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:59 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:08:59.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:59 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi125.pwyuga", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:08:59.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:08:59 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:09:00.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:00 smithi096 ceph-mon[112483]: Reconfiguring mds.cephfs.smithi125.pwyuga (monmap changed)... 2024-02-19T19:09:00.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:00 smithi096 ceph-mon[112483]: Reconfiguring daemon mds.cephfs.smithi125.pwyuga on smithi125 2024-02-19T19:09:00.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:00 smithi096 ceph-mon[112483]: pgmap v30: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:09:00.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:00 smithi125 ceph-mon[86115]: Reconfiguring mds.cephfs.smithi125.pwyuga (monmap changed)... 2024-02-19T19:09:00.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:00 smithi125 ceph-mon[86115]: Reconfiguring daemon mds.cephfs.smithi125.pwyuga on smithi125 2024-02-19T19:09:00.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:00 smithi125 ceph-mon[86115]: pgmap v30: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:09:02.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:01 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:02.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:01 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:02.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:01 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:09:02.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:01 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:02.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:01 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:02.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:01 smithi096 ceph-mon[112483]: Upgrade: Setting container_image for all mon 2024-02-19T19:09:02.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:01 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:02.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:01 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi096"}]: dispatch 2024-02-19T19:09:02.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:01 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi096"}]': finished 2024-02-19T19:09:02.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:01 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi125"}]: dispatch 2024-02-19T19:09:02.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:01 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi125"}]': finished 2024-02-19T19:09:02.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:01 smithi096 ceph-mon[112483]: pgmap v31: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:09:02.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:01 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:02.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:01 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:02.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:01 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:09:02.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:01 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:02.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:01 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:02.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:01 smithi125 ceph-mon[86115]: Upgrade: Setting container_image for all mon 2024-02-19T19:09:02.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:01 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:02.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:01 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi096"}]: dispatch 2024-02-19T19:09:02.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:01 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi096"}]': finished 2024-02-19T19:09:02.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:01 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi125"}]: dispatch 2024-02-19T19:09:02.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:01 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi125"}]': finished 2024-02-19T19:09:02.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:01 smithi125 ceph-mon[86115]: pgmap v31: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:09:03.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:03 smithi096 ceph-mon[112483]: Upgrade: Updating crash.smithi096 (1/2) 2024-02-19T19:09:03.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:03 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:03.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:03 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi096", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T19:09:03.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:03 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:09:03.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:03 smithi096 ceph-mon[112483]: Deploying daemon crash.smithi096 on smithi096 2024-02-19T19:09:03.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:03 smithi096 ceph-mon[112483]: pgmap v32: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:09:03.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:03 smithi125 ceph-mon[86115]: Upgrade: Updating crash.smithi096 (1/2) 2024-02-19T19:09:03.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:03 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:03.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:03 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi096", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T19:09:03.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:03 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:09:03.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:03 smithi125 ceph-mon[86115]: Deploying daemon crash.smithi096 on smithi096 2024-02-19T19:09:03.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:03 smithi125 ceph-mon[86115]: pgmap v32: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:09:06.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:06 smithi096 ceph-mon[112483]: pgmap v33: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:09:06.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:09:06.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:06.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:06.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:06 smithi125 ceph-mon[86115]: pgmap v33: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:09:06.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:09:06.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:06.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:08.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:08 smithi125 ceph-mon[86115]: pgmap v34: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:09:08.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:08 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:08.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:08 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi125", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T19:09:08.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:08 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:09:08.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:08 smithi096 ceph-mon[112483]: pgmap v34: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:09:08.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:08 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:08.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:08 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi125", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-19T19:09:08.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:08 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:09:09.625 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:09 smithi125 ceph-mon[86115]: Upgrade: Updating crash.smithi125 (2/2) 2024-02-19T19:09:09.625 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:09 smithi125 ceph-mon[86115]: Deploying daemon crash.smithi125 on smithi125 2024-02-19T19:09:09.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:09 smithi096 ceph-mon[112483]: Upgrade: Updating crash.smithi125 (2/2) 2024-02-19T19:09:09.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:09 smithi096 ceph-mon[112483]: Deploying daemon crash.smithi125 on smithi125 2024-02-19T19:09:10.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:10 smithi125 ceph-mon[86115]: pgmap v35: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:09:10.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:10 smithi096 ceph-mon[112483]: pgmap v35: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:09:12.665 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:12 smithi125 ceph-mon[86115]: pgmap v36: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:09:12.666 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:12 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:12.666 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:12 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:12.666 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:12 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:09:12.706 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:12 smithi096 ceph-mon[112483]: pgmap v36: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:09:12.707 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:12 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:12.707 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:12 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:12.707 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:12 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:09:14.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:14 smithi096 ceph-mon[112483]: pgmap v37: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:09:14.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:14 smithi125 ceph-mon[86115]: pgmap v37: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:09:16.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:15 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:16.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:15 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:16.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:15 smithi125 ceph-mon[86115]: pgmap v38: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:09:16.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:15 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:16.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:15 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:16.287 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:15 smithi096 ceph-mon[112483]: pgmap v38: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:09:17.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:17 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:17.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:17 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:17.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:17.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:18.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:18 smithi125 ceph-mon[86115]: pgmap v39: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:09:18.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:18 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:18.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:18 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:18.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:18 smithi096 ceph-mon[112483]: pgmap v39: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:09:18.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:18 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:18.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:18 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:19.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:19 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:19.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:19 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:19.620 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:19 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:19.621 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:19 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:20.662 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:20 smithi096 ceph-mon[112483]: pgmap v40: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:09:20.663 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:20.663 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:20.663 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:09:20.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:20 smithi125 ceph-mon[86115]: pgmap v40: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:09:20.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:20.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:20.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:09:22.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:22 smithi125 ceph-mon[86115]: pgmap v41: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:09:22.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:09:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:09:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:09:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi096"}]: dispatch 2024-02-19T19:09:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi096"}]': finished 2024-02-19T19:09:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi125"}]: dispatch 2024-02-19T19:09:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi125"}]': finished 2024-02-19T19:09:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-19T19:09:22.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:22 smithi096 ceph-mon[112483]: pgmap v41: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:09:22.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:22.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:22.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:09:22.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:09:22.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:22.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:09:22.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:22.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:22.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:22.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:22.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi096"}]: dispatch 2024-02-19T19:09:22.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi096"}]': finished 2024-02-19T19:09:22.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi125"}]: dispatch 2024-02-19T19:09:22.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi125"}]': finished 2024-02-19T19:09:22.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-19T19:09:23.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:23 smithi125 ceph-mon[86115]: Upgrade: Setting container_image for all crash 2024-02-19T19:09:23.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:23 smithi125 ceph-mon[86115]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-19T19:09:23.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:23 smithi125 ceph-mon[86115]: Upgrade: osd.0 is safe to restart 2024-02-19T19:09:23.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:23 smithi096 ceph-mon[112483]: Upgrade: Setting container_image for all crash 2024-02-19T19:09:23.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:23 smithi096 ceph-mon[112483]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-19T19:09:23.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:23 smithi096 ceph-mon[112483]: Upgrade: osd.0 is safe to restart 2024-02-19T19:09:24.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:24 smithi125 ceph-mon[86115]: pgmap v42: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:09:24.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:24 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:24.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:24 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-19T19:09:24.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:24 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:09:24.757 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:24 smithi096 ceph-mon[112483]: pgmap v42: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:09:24.757 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:24 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:24.757 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:24 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-19T19:09:24.757 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:24 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:09:25.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:25 smithi125 ceph-mon[86115]: Upgrade: Updating osd.0 2024-02-19T19:09:25.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:25 smithi125 ceph-mon[86115]: Deploying daemon osd.0 on smithi096 2024-02-19T19:09:25.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:25 smithi096 ceph-mon[112483]: Upgrade: Updating osd.0 2024-02-19T19:09:25.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:25 smithi096 ceph-mon[112483]: Deploying daemon osd.0 on smithi096 2024-02-19T19:09:26.496 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:26 smithi096 ceph-mon[112483]: pgmap v43: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:09:26.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:26 smithi125 ceph-mon[86115]: pgmap v43: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:09:27.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:27 smithi125 ceph-mon[86115]: pgmap v44: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:09:27.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:27 smithi096 ceph-mon[112483]: pgmap v44: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:09:27.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.760+0000 7f955d867700 1 -- 172.21.15.96:0/3818480629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95580ffda0 msgr2=0x7f9558100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:27.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.760+0000 7f955d867700 1 --2- 172.21.15.96:0/3818480629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95580ffda0 0x7f9558100180 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9548009910 tx=0x7f9548009c20 comp rx=0 tx=0).stop 2024-02-19T19:09:27.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.760+0000 7f955d867700 1 -- 172.21.15.96:0/3818480629 shutdown_connections 2024-02-19T19:09:27.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.760+0000 7f955d867700 1 --2- 172.21.15.96:0/3818480629 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9558100750 0x7f95581047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:27.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.760+0000 7f955d867700 1 --2- 172.21.15.96:0/3818480629 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95580ffda0 0x7f9558100180 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:27.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.760+0000 7f955d867700 1 -- 172.21.15.96:0/3818480629 >> 172.21.15.96:0/3818480629 conn(0x7f95580fb650 msgr2=0x7f95580fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:27.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.760+0000 7f955d867700 1 -- 172.21.15.96:0/3818480629 shutdown_connections 2024-02-19T19:09:27.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.760+0000 7f955d867700 1 -- 172.21.15.96:0/3818480629 wait complete. 2024-02-19T19:09:27.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.761+0000 7f955d867700 1 Processor -- start 2024-02-19T19:09:27.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.761+0000 7f955d867700 1 -- start start 2024-02-19T19:09:27.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.762+0000 7f955d867700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95580ffda0 0x7f955819c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:27.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.762+0000 7f955d867700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9558100750 0x7f955819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:27.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.762+0000 7f955d867700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955819d2b0 con 0x7f95580ffda0 2024-02-19T19:09:27.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.762+0000 7f955d867700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9558196760 con 0x7f9558100750 2024-02-19T19:09:27.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.762+0000 7f9556ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95580ffda0 0x7f955819c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:27.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.762+0000 7f9556ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95580ffda0 0x7f955819c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55128/0 (socket says 172.21.15.96:55128) 2024-02-19T19:09:27.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.762+0000 7f9556ffd700 1 -- 172.21.15.96:0/4184622829 learned_addr learned my addr 172.21.15.96:0/4184622829 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:09:27.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.762+0000 7f95567fc700 1 --2- 172.21.15.96:0/4184622829 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9558100750 0x7f955819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:27.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.762+0000 7f9556ffd700 1 -- 172.21.15.96:0/4184622829 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9558100750 msgr2=0x7f955819cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:27.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.762+0000 7f9556ffd700 1 --2- 172.21.15.96:0/4184622829 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9558100750 0x7f955819cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:27.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.762+0000 7f9556ffd700 1 -- 172.21.15.96:0/4184622829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95480095f0 con 0x7f95580ffda0 2024-02-19T19:09:27.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.762+0000 7f9556ffd700 1 --2- 172.21.15.96:0/4184622829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95580ffda0 0x7f955819c6e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9548006010 tx=0x7f954800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:27.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.763+0000 7f955c865700 1 -- 172.21.15.96:0/4184622829 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f954801d070 con 0x7f95580ffda0 2024-02-19T19:09:27.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.763+0000 7f955c865700 1 -- 172.21.15.96:0/4184622829 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9548005dc0 con 0x7f95580ffda0 2024-02-19T19:09:27.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.763+0000 7f955d867700 1 -- 172.21.15.96:0/4184622829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95581969e0 con 0x7f95580ffda0 2024-02-19T19:09:27.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.763+0000 7f955c865700 1 -- 172.21.15.96:0/4184622829 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9548017400 con 0x7f95580ffda0 2024-02-19T19:09:27.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.763+0000 7f955d867700 1 -- 172.21.15.96:0/4184622829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9558196ed0 con 0x7f95580ffda0 2024-02-19T19:09:27.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.764+0000 7f955d867700 1 -- 172.21.15.96:0/4184622829 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95440052f0 con 0x7f95580ffda0 2024-02-19T19:09:27.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.764+0000 7f955c865700 1 -- 172.21.15.96:0/4184622829 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 36) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f954800f460 con 0x7f95580ffda0 2024-02-19T19:09:27.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.765+0000 7f955c865700 1 --2- 172.21.15.96:0/4184622829 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f954006d9e0 0x7f954006fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:27.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.765+0000 7f955c865700 1 -- 172.21.15.96:0/4184622829 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f954808ea50 con 0x7f95580ffda0 2024-02-19T19:09:27.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.765+0000 7f95567fc700 1 --2- 172.21.15.96:0/4184622829 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f954006d9e0 0x7f954006fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:27.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.765+0000 7f95567fc700 1 --2- 172.21.15.96:0/4184622829 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f954006d9e0 0x7f954006fea0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9558197bd0 tx=0x7f954c00b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:27.791 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:27.770+0000 7f955c865700 1 -- 172.21.15.96:0/4184622829 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f954805bc40 con 0x7f95580ffda0 2024-02-19T19:09:28.037 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:27 smithi096 systemd[1]: Stopping Ceph osd.0 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T19:09:28.045 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.024+0000 7f955d867700 1 -- 172.21.15.96:0/4184622829 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9544000bc0 con 0x7f954006d9e0 2024-02-19T19:09:28.046 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.025+0000 7f955c865700 1 -- 172.21.15.96:0/4184622829 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9544000bc0 con 0x7f954006d9e0 2024-02-19T19:09:28.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.027+0000 7f955d867700 1 -- 172.21.15.96:0/4184622829 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f954006d9e0 msgr2=0x7f954006fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:28.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.027+0000 7f955d867700 1 --2- 172.21.15.96:0/4184622829 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f954006d9e0 0x7f954006fea0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9558197bd0 tx=0x7f954c00b410 comp rx=0 tx=0).stop 2024-02-19T19:09:28.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.027+0000 7f955d867700 1 -- 172.21.15.96:0/4184622829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95580ffda0 msgr2=0x7f955819c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:28.048 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.027+0000 7f955d867700 1 --2- 172.21.15.96:0/4184622829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95580ffda0 0x7f955819c6e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9548006010 tx=0x7f954800bd70 comp rx=0 tx=0).stop 2024-02-19T19:09:28.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.027+0000 7f955d867700 1 -- 172.21.15.96:0/4184622829 shutdown_connections 2024-02-19T19:09:28.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.027+0000 7f955d867700 1 --2- 172.21.15.96:0/4184622829 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f954006d9e0 0x7f954006fea0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:28.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.027+0000 7f955d867700 1 --2- 172.21.15.96:0/4184622829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95580ffda0 0x7f955819c6e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:28.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.027+0000 7f955d867700 1 --2- 172.21.15.96:0/4184622829 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9558100750 0x7f955819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:28.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.027+0000 7f955d867700 1 -- 172.21.15.96:0/4184622829 >> 172.21.15.96:0/4184622829 conn(0x7f95580fb650 msgr2=0x7f9558103f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:28.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.027+0000 7f955d867700 1 -- 172.21.15.96:0/4184622829 shutdown_connections 2024-02-19T19:09:28.049 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.027+0000 7f955d867700 1 -- 172.21.15.96:0/4184622829 wait complete. 2024-02-19T19:09:28.059 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:09:28.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.134+0000 7fa025301700 1 -- 172.21.15.96:0/3616973139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa020100750 msgr2=0x7fa0201047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:28.155 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.134+0000 7fa025301700 1 --2- 172.21.15.96:0/3616973139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa020100750 0x7fa0201047a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa008009910 tx=0x7fa008009c20 comp rx=0 tx=0).stop 2024-02-19T19:09:28.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.134+0000 7fa025301700 1 -- 172.21.15.96:0/3616973139 shutdown_connections 2024-02-19T19:09:28.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.134+0000 7fa025301700 1 --2- 172.21.15.96:0/3616973139 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa020100750 0x7fa0201047a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:28.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.134+0000 7fa025301700 1 --2- 172.21.15.96:0/3616973139 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0200ffda0 0x7fa020100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:28.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.134+0000 7fa025301700 1 -- 172.21.15.96:0/3616973139 >> 172.21.15.96:0/3616973139 conn(0x7fa0200fb650 msgr2=0x7fa0200fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:28.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.134+0000 7fa025301700 1 -- 172.21.15.96:0/3616973139 shutdown_connections 2024-02-19T19:09:28.156 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.134+0000 7fa025301700 1 -- 172.21.15.96:0/3616973139 wait complete. 2024-02-19T19:09:28.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.135+0000 7fa025301700 1 Processor -- start 2024-02-19T19:09:28.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.135+0000 7fa025301700 1 -- start start 2024-02-19T19:09:28.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.135+0000 7fa025301700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0200ffda0 0x7fa0201969a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:28.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.135+0000 7fa025301700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa020100750 0x7fa020196ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:28.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.135+0000 7fa025301700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa020197570 con 0x7fa020100750 2024-02-19T19:09:28.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.135+0000 7fa025301700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa02019b380 con 0x7fa0200ffda0 2024-02-19T19:09:28.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.135+0000 7fa01e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa020100750 0x7fa020196ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:28.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.135+0000 7fa01e7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa020100750 0x7fa020196ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55136/0 (socket says 172.21.15.96:55136) 2024-02-19T19:09:28.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.135+0000 7fa01e7fc700 1 -- 172.21.15.96:0/1617521530 learned_addr learned my addr 172.21.15.96:0/1617521530 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:09:28.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.135+0000 7fa01effd700 1 --2- 172.21.15.96:0/1617521530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0200ffda0 0x7fa0201969a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:28.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.135+0000 7fa01e7fc700 1 -- 172.21.15.96:0/1617521530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0200ffda0 msgr2=0x7fa0201969a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:28.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.135+0000 7fa01e7fc700 1 --2- 172.21.15.96:0/1617521530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0200ffda0 0x7fa0201969a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:28.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.135+0000 7fa01e7fc700 1 -- 172.21.15.96:0/1617521530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0080095f0 con 0x7fa020100750 2024-02-19T19:09:28.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.135+0000 7fa01e7fc700 1 --2- 172.21.15.96:0/1617521530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa020100750 0x7fa020196ee0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa0080092e0 tx=0x7fa00800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:28.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.136+0000 7fa017fff700 1 -- 172.21.15.96:0/1617521530 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa00801d070 con 0x7fa020100750 2024-02-19T19:09:28.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.136+0000 7fa017fff700 1 -- 172.21.15.96:0/1617521530 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa00800f460 con 0x7fa020100750 2024-02-19T19:09:28.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.136+0000 7fa017fff700 1 -- 172.21.15.96:0/1617521530 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0080175f0 con 0x7fa020100750 2024-02-19T19:09:28.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.136+0000 7fa025301700 1 -- 172.21.15.96:0/1617521530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa02019b600 con 0x7fa020100750 2024-02-19T19:09:28.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.136+0000 7fa025301700 1 -- 172.21.15.96:0/1617521530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa02019baf0 con 0x7fa020100750 2024-02-19T19:09:28.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.137+0000 7fa025301700 1 -- 172.21.15.96:0/1617521530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa02004f2e0 con 0x7fa020100750 2024-02-19T19:09:28.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.137+0000 7fa017fff700 1 -- 172.21.15.96:0/1617521530 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 36) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fa00800f5d0 con 0x7fa020100750 2024-02-19T19:09:28.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.138+0000 7fa017fff700 1 --2- 172.21.15.96:0/1617521530 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa00c06d9e0 0x7fa00c06fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:28.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.138+0000 7fa017fff700 1 -- 172.21.15.96:0/1617521530 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa00808eb70 con 0x7fa020100750 2024-02-19T19:09:28.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.138+0000 7fa01effd700 1 --2- 172.21.15.96:0/1617521530 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa00c06d9e0 0x7fa00c06fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:28.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.138+0000 7fa01effd700 1 --2- 172.21.15.96:0/1617521530 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa00c06d9e0 0x7fa00c06fea0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa010009f20 tx=0x7fa0100094f0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:28.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.142+0000 7fa017fff700 1 -- 172.21.15.96:0/1617521530 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa00805bd60 con 0x7fa020100750 2024-02-19T19:09:28.381 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.360+0000 7fa025301700 1 -- 172.21.15.96:0/1617521530 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa02019be20 con 0x7fa00c06d9e0 2024-02-19T19:09:28.381 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:28 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0[48312]: 2024-02-19T19:09:28.093+0000 7f08be7b7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T19:09:28.382 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:28 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0[48312]: 2024-02-19T19:09:28.093+0000 7f08be7b7700 -1 osd.0 49 *** Got signal Terminated *** 2024-02-19T19:09:28.382 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:28 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0[48312]: 2024-02-19T19:09:28.093+0000 7f08be7b7700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T19:09:28.382 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.361+0000 7fa017fff700 1 -- 172.21.15.96:0/1617521530 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa02019be20 con 0x7fa00c06d9e0 2024-02-19T19:09:28.384 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.363+0000 7fa025301700 1 -- 172.21.15.96:0/1617521530 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa00c06d9e0 msgr2=0x7fa00c06fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:28.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.363+0000 7fa025301700 1 --2- 172.21.15.96:0/1617521530 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa00c06d9e0 0x7fa00c06fea0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa010009f20 tx=0x7fa0100094f0 comp rx=0 tx=0).stop 2024-02-19T19:09:28.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.363+0000 7fa025301700 1 -- 172.21.15.96:0/1617521530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa020100750 msgr2=0x7fa020196ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:28.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.363+0000 7fa025301700 1 --2- 172.21.15.96:0/1617521530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa020100750 0x7fa020196ee0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa0080092e0 tx=0x7fa00800be20 comp rx=0 tx=0).stop 2024-02-19T19:09:28.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.363+0000 7fa025301700 1 -- 172.21.15.96:0/1617521530 shutdown_connections 2024-02-19T19:09:28.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.363+0000 7fa025301700 1 --2- 172.21.15.96:0/1617521530 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa00c06d9e0 0x7fa00c06fea0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:28.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.363+0000 7fa025301700 1 --2- 172.21.15.96:0/1617521530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0200ffda0 0x7fa0201969a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:28.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.363+0000 7fa025301700 1 --2- 172.21.15.96:0/1617521530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa020100750 0x7fa020196ee0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:28.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.363+0000 7fa025301700 1 -- 172.21.15.96:0/1617521530 >> 172.21.15.96:0/1617521530 conn(0x7fa0200fb650 msgr2=0x7fa020103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:28.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.363+0000 7fa025301700 1 -- 172.21.15.96:0/1617521530 shutdown_connections 2024-02-19T19:09:28.385 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.363+0000 7fa025301700 1 -- 172.21.15.96:0/1617521530 wait complete. 2024-02-19T19:09:28.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.473+0000 7f46d2507700 1 -- 172.21.15.96:0/51015666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46cc0ffda0 msgr2=0x7f46cc100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:28.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.473+0000 7f46d2507700 1 --2- 172.21.15.96:0/51015666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46cc0ffda0 0x7f46cc100180 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009910 tx=0x7f46bc009c20 comp rx=0 tx=0).stop 2024-02-19T19:09:28.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.473+0000 7f46d2507700 1 -- 172.21.15.96:0/51015666 shutdown_connections 2024-02-19T19:09:28.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.473+0000 7f46d2507700 1 --2- 172.21.15.96:0/51015666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46cc100750 0x7f46cc1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:28.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.473+0000 7f46d2507700 1 --2- 172.21.15.96:0/51015666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46cc0ffda0 0x7f46cc100180 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:28.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.473+0000 7f46d2507700 1 -- 172.21.15.96:0/51015666 >> 172.21.15.96:0/51015666 conn(0x7f46cc0fb650 msgr2=0x7f46cc0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:28.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.473+0000 7f46d2507700 1 -- 172.21.15.96:0/51015666 shutdown_connections 2024-02-19T19:09:28.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.473+0000 7f46d2507700 1 -- 172.21.15.96:0/51015666 wait complete. 2024-02-19T19:09:28.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.474+0000 7f46d2507700 1 Processor -- start 2024-02-19T19:09:28.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.474+0000 7f46d2507700 1 -- start start 2024-02-19T19:09:28.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.474+0000 7f46d2507700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46cc0ffda0 0x7f46cc101840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:28.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.474+0000 7f46d2507700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46cc100750 0x7f46cc101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:28.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.474+0000 7f46d2507700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc1022c0 con 0x7f46cc100750 2024-02-19T19:09:28.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.474+0000 7f46d2507700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc102400 con 0x7f46cc0ffda0 2024-02-19T19:09:28.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.474+0000 7f46cb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46cc100750 0x7f46cc101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:28.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.474+0000 7f46cb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46cc100750 0x7f46cc101d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55164/0 (socket says 172.21.15.96:55164) 2024-02-19T19:09:28.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.474+0000 7f46cb7fe700 1 -- 172.21.15.96:0/2076396767 learned_addr learned my addr 172.21.15.96:0/2076396767 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:09:28.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.474+0000 7f46cbfff700 1 --2- 172.21.15.96:0/2076396767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46cc0ffda0 0x7f46cc101840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:28.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.474+0000 7f46cb7fe700 1 -- 172.21.15.96:0/2076396767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46cc0ffda0 msgr2=0x7f46cc101840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:28.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.475+0000 7f46cb7fe700 1 --2- 172.21.15.96:0/2076396767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46cc0ffda0 0x7f46cc101840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:28.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.475+0000 7f46cb7fe700 1 -- 172.21.15.96:0/2076396767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc0095f0 con 0x7f46cc100750 2024-02-19T19:09:28.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.475+0000 7f46cbfff700 1 --2- 172.21.15.96:0/2076396767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46cc0ffda0 0x7f46cc101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:09:28.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.475+0000 7f46cb7fe700 1 --2- 172.21.15.96:0/2076396767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46cc100750 0x7f46cc101d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f46c000c960 tx=0x7f46c000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:28.498 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.475+0000 7f46c97fa700 1 -- 172.21.15.96:0/2076396767 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46c0007a70 con 0x7f46cc100750 2024-02-19T19:09:28.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.475+0000 7f46c97fa700 1 -- 172.21.15.96:0/2076396767 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f46c0007bd0 con 0x7f46cc100750 2024-02-19T19:09:28.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.475+0000 7f46d2507700 1 -- 172.21.15.96:0/2076396767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46cc1a2ae0 con 0x7f46cc100750 2024-02-19T19:09:28.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.475+0000 7f46c97fa700 1 -- 172.21.15.96:0/2076396767 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46c00186c0 con 0x7f46cc100750 2024-02-19T19:09:28.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.475+0000 7f46d2507700 1 -- 172.21.15.96:0/2076396767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46cc1a2e40 con 0x7f46cc100750 2024-02-19T19:09:28.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.476+0000 7f46d2507700 1 -- 172.21.15.96:0/2076396767 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46cc04f2e0 con 0x7f46cc100750 2024-02-19T19:09:28.499 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.477+0000 7f46c97fa700 1 -- 172.21.15.96:0/2076396767 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 36) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f46c000faa0 con 0x7f46cc100750 2024-02-19T19:09:28.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.477+0000 7f46c97fa700 1 --2- 172.21.15.96:0/2076396767 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f46b406d9e0 0x7f46b406fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:28.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.477+0000 7f46c97fa700 1 -- 172.21.15.96:0/2076396767 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f46c008d6b0 con 0x7f46cc100750 2024-02-19T19:09:28.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.477+0000 7f46cbfff700 1 --2- 172.21.15.96:0/2076396767 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f46b406d9e0 0x7f46b406fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:28.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.478+0000 7f46cbfff700 1 --2- 172.21.15.96:0/2076396767 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f46b406d9e0 0x7f46b406fea0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00b5c0 tx=0x7f46bc005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:28.503 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.482+0000 7f46c97fa700 1 -- 172.21.15.96:0/2076396767 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f46c005a8a0 con 0x7f46cc100750 2024-02-19T19:09:28.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:28 smithi125 ceph-mon[86115]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:28.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:28 smithi125 ceph-mon[86115]: osd.0 marked itself down and dead 2024-02-19T19:09:28.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:28 smithi125 ceph-mon[86115]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:28.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.685+0000 7f46d2507700 1 -- 172.21.15.96:0/2076396767 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f46cc0fc440 con 0x7f46b406d9e0 2024-02-19T19:09:28.707 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:28 smithi096 ceph-mon[112483]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:28.707 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:28 smithi096 ceph-mon[112483]: osd.0 marked itself down and dead 2024-02-19T19:09:28.707 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:28 smithi096 ceph-mon[112483]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:28.719 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.697+0000 7f46c97fa700 1 -- 172.21.15.96:0/2076396767 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f46cc0fc440 con 0x7f46b406d9e0 2024-02-19T19:09:28.719 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:09:28.719 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (3m) 11s ago 13m 26.0M - 0.25.0 c8568f914cd2 bbaf83a1e476 2024-02-19T19:09:28.719 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (13m) 11s ago 13m 8154k - 18.2.1 94eadd990e0a b41bff2e0043 2024-02-19T19:09:28.719 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (12m) 13s ago 12m 8044k - 18.2.1 94eadd990e0a 254ab7e7a040 2024-02-19T19:09:28.719 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (22s) 11s ago 13m 6669k - 19.0.0-1450-gf78a58c0 f081f847070a deea0ffefa0f 2024-02-19T19:09:28.719 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (17s) 13s ago 12m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 3421965dc5b0 2024-02-19T19:09:28.719 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (2m) 11s ago 12m 85.0M - 9.4.12 a0ea5e3c46d9 0102d90938e4 2024-02-19T19:09:28.719 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (7m) 11s ago 7m 27.6M - 18.2.1 94eadd990e0a 0a61d9cd40d1 2024-02-19T19:09:28.719 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (7m) 11s ago 7m 24.5M - 18.2.1 94eadd990e0a 58db3e7a7d75 2024-02-19T19:09:28.720 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (7m) 13s ago 7m 28.4M - 18.2.1 94eadd990e0a 211d64de8a63 2024-02-19T19:09:28.720 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (7m) 13s ago 7m 26.5M - 18.2.1 94eadd990e0a 2a04b5a8eaf4 2024-02-19T19:09:28.720 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:8443,9283,8765 running (5m) 11s ago 14m 495M - 19.0.0-1450-gf78a58c0 f081f847070a a86fbe94fe3f 2024-02-19T19:09:28.720 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (4m) 13s ago 12m 448M - 19.0.0-1450-gf78a58c0 f081f847070a e250486d572d 2024-02-19T19:09:28.720 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (92s) 11s ago 14m 44.5M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d70090d516e3 2024-02-19T19:09:28.720 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (66s) 13s ago 12m 36.7M 2048M 19.0.0-1450-gf78a58c0 f081f847070a f56b17bdc9a0 2024-02-19T19:09:28.720 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4m) 11s ago 13m 15.6M - 1.5.0 0da6a335fe13 51f622ea33d6 2024-02-19T19:09:28.720 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (4m) 13s ago 12m 17.2M - 1.5.0 0da6a335fe13 464e076a52a1 2024-02-19T19:09:28.720 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (11m) 11s ago 11m 51.5M 1216M 18.2.1 94eadd990e0a d5bbf07ad0e7 2024-02-19T19:09:28.720 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (10m) 11s ago 10m 51.7M 1216M 18.2.1 94eadd990e0a 40329d59be45 2024-02-19T19:09:28.720 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (10m) 11s ago 10m 49.9M 1216M 18.2.1 94eadd990e0a 4f1e49db2d41 2024-02-19T19:09:28.720 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (9m) 13s ago 9m 51.9M 2240M 18.2.1 94eadd990e0a 4746b79351fc 2024-02-19T19:09:28.720 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (9m) 13s ago 9m 51.2M 2240M 18.2.1 94eadd990e0a 2b3f0088f6b2 2024-02-19T19:09:28.720 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (9m) 13s ago 9m 48.0M 2240M 18.2.1 94eadd990e0a e5731974b46a 2024-02-19T19:09:28.720 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4m) 11s ago 12m 62.7M - 2.43.0 a07b618ecd1d a4edcf6ed669 2024-02-19T19:09:28.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.701+0000 7f46d2507700 1 -- 172.21.15.96:0/2076396767 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f46b406d9e0 msgr2=0x7f46b406fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:28.722 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.701+0000 7f46d2507700 1 --2- 172.21.15.96:0/2076396767 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f46b406d9e0 0x7f46b406fea0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00b5c0 tx=0x7f46bc005960 comp rx=0 tx=0).stop 2024-02-19T19:09:28.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.701+0000 7f46d2507700 1 -- 172.21.15.96:0/2076396767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46cc100750 msgr2=0x7f46cc101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:28.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.701+0000 7f46d2507700 1 --2- 172.21.15.96:0/2076396767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46cc100750 0x7f46cc101d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f46c000c960 tx=0x7f46c000cd20 comp rx=0 tx=0).stop 2024-02-19T19:09:28.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.701+0000 7f46d2507700 1 -- 172.21.15.96:0/2076396767 shutdown_connections 2024-02-19T19:09:28.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.701+0000 7f46d2507700 1 --2- 172.21.15.96:0/2076396767 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f46b406d9e0 0x7f46b406fea0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:28.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.701+0000 7f46d2507700 1 --2- 172.21.15.96:0/2076396767 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46cc0ffda0 0x7f46cc101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:28.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.701+0000 7f46d2507700 1 --2- 172.21.15.96:0/2076396767 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46cc100750 0x7f46cc101d80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:28.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.701+0000 7f46d2507700 1 -- 172.21.15.96:0/2076396767 >> 172.21.15.96:0/2076396767 conn(0x7f46cc0fb650 msgr2=0x7f46cc103f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:28.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.701+0000 7f46d2507700 1 -- 172.21.15.96:0/2076396767 shutdown_connections 2024-02-19T19:09:28.723 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.701+0000 7f46d2507700 1 -- 172.21.15.96:0/2076396767 wait complete. 2024-02-19T19:09:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.805+0000 7f13dc9e7700 1 -- 172.21.15.96:0/2308678191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13d80fff50 msgr2=0x7f13d8105840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.805+0000 7f13dc9e7700 1 --2- 172.21.15.96:0/2308678191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13d80fff50 0x7f13d8105840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009910 tx=0x7f13cc009c20 comp rx=0 tx=0).stop 2024-02-19T19:09:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.805+0000 7f13dc9e7700 1 -- 172.21.15.96:0/2308678191 shutdown_connections 2024-02-19T19:09:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.805+0000 7f13dc9e7700 1 --2- 172.21.15.96:0/2308678191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13d80fff50 0x7f13d8105840 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.805+0000 7f13dc9e7700 1 --2- 172.21.15.96:0/2308678191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d80ff5a0 0x7f13d80ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.805+0000 7f13dc9e7700 1 -- 172.21.15.96:0/2308678191 >> 172.21.15.96:0/2308678191 conn(0x7f13d8074e30 msgr2=0x7f13d8075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:28.827 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.806+0000 7f13dc9e7700 1 -- 172.21.15.96:0/2308678191 shutdown_connections 2024-02-19T19:09:28.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.806+0000 7f13dc9e7700 1 -- 172.21.15.96:0/2308678191 wait complete. 2024-02-19T19:09:28.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.806+0000 7f13dc9e7700 1 Processor -- start 2024-02-19T19:09:28.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.806+0000 7f13dc9e7700 1 -- start start 2024-02-19T19:09:28.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.806+0000 7f13dc9e7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13d80ff5a0 0x7f13d8100520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:28.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.806+0000 7f13dc9e7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d80fff50 0x7f13d8100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:28.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.806+0000 7f13dc9e7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d8100fa0 con 0x7f13d80ff5a0 2024-02-19T19:09:28.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.806+0000 7f13dc9e7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d81010e0 con 0x7f13d80fff50 2024-02-19T19:09:28.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.807+0000 7f13d659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13d80ff5a0 0x7f13d8100520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:28.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.807+0000 7f13d659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13d80ff5a0 0x7f13d8100520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55180/0 (socket says 172.21.15.96:55180) 2024-02-19T19:09:28.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.807+0000 7f13d659c700 1 -- 172.21.15.96:0/45358351 learned_addr learned my addr 172.21.15.96:0/45358351 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:09:28.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.807+0000 7f13d5d9b700 1 --2- 172.21.15.96:0/45358351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d80fff50 0x7f13d8100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:28.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.807+0000 7f13d659c700 1 -- 172.21.15.96:0/45358351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d80fff50 msgr2=0x7f13d8100a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:28.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.807+0000 7f13d659c700 1 --2- 172.21.15.96:0/45358351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d80fff50 0x7f13d8100a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:28.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.807+0000 7f13d659c700 1 -- 172.21.15.96:0/45358351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13cc0095f0 con 0x7f13d80ff5a0 2024-02-19T19:09:28.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.807+0000 7f13d659c700 1 --2- 172.21.15.96:0/45358351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13d80ff5a0 0x7f13d8100520 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f13c800d8d0 tx=0x7f13c800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:28.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.807+0000 7f13c77fe700 1 -- 172.21.15.96:0/45358351 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13c8009940 con 0x7f13d80ff5a0 2024-02-19T19:09:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.807+0000 7f13c77fe700 1 -- 172.21.15.96:0/45358351 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f13c8010460 con 0x7f13d80ff5a0 2024-02-19T19:09:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.807+0000 7f13dc9e7700 1 -- 172.21.15.96:0/45358351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d81a2a90 con 0x7f13d80ff5a0 2024-02-19T19:09:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.807+0000 7f13c77fe700 1 -- 172.21.15.96:0/45358351 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13c800f5f0 con 0x7f13d80ff5a0 2024-02-19T19:09:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.807+0000 7f13dc9e7700 1 -- 172.21.15.96:0/45358351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d81a2ea0 con 0x7f13d80ff5a0 2024-02-19T19:09:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.808+0000 7f13dc9e7700 1 -- 172.21.15.96:0/45358351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d8109200 con 0x7f13d80ff5a0 2024-02-19T19:09:28.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.809+0000 7f13c77fe700 1 -- 172.21.15.96:0/45358351 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 36) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f13c80105d0 con 0x7f13d80ff5a0 2024-02-19T19:09:28.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.809+0000 7f13c77fe700 1 --2- 172.21.15.96:0/45358351 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f13c006d9e0 0x7f13c006fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:28.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.809+0000 7f13d5d9b700 1 --2- 172.21.15.96:0/45358351 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f13c006d9e0 0x7f13c006fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:28.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.809+0000 7f13c77fe700 1 -- 172.21.15.96:0/45358351 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f13c808d710 con 0x7f13d80ff5a0 2024-02-19T19:09:28.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.810+0000 7f13d5d9b700 1 --2- 172.21.15.96:0/45358351 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f13c006d9e0 0x7f13c006fea0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f13d8101d10 tx=0x7f13cc01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:28.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:28.814+0000 7f13c77fe700 1 -- 172.21.15.96:0/45358351 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f13c8056d50 con 0x7f13d80ff5a0 2024-02-19T19:09:29.037 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:28 smithi096 podman[123590]: 2024-02-19 19:09:28.856137848 +0000 UTC m=+0.883691532 container died d5bbf07ad0e792d0e1716d51f5d22008e68b7feedb8e0f880ef1d2c9c914a803 (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, org.label-schema.build-date=20240214, GIT_CLEAN=True, RELEASE=HEAD, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-02-19T19:09:29.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.107+0000 7f13dc9e7700 1 -- 172.21.15.96:0/45358351 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f13d804f2e0 con 0x7f13d80ff5a0 2024-02-19T19:09:29.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.108+0000 7f13c77fe700 1 -- 172.21.15.96:0/45358351 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+687 (secure 0 0 0) 0x7f13c805a410 con 0x7f13d80ff5a0 2024-02-19T19:09:29.129 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:09:29.129 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:09:29.130 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:09:29.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:09:29.130 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:09:29.130 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:09:29.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:09:29.130 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:09:29.130 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 5 2024-02-19T19:09:29.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:09:29.130 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:09:29.130 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-19T19:09:29.130 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:09:29.130 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:09:29.130 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 9, 2024-02-19T19:09:29.130 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-19T19:09:29.130 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:09:29.130 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:09:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.110+0000 7f13dc9e7700 1 -- 172.21.15.96:0/45358351 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f13c006d9e0 msgr2=0x7f13c006fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.110+0000 7f13dc9e7700 1 --2- 172.21.15.96:0/45358351 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f13c006d9e0 0x7f13c006fea0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f13d8101d10 tx=0x7f13cc01a040 comp rx=0 tx=0).stop 2024-02-19T19:09:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.110+0000 7f13dc9e7700 1 -- 172.21.15.96:0/45358351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13d80ff5a0 msgr2=0x7f13d8100520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.110+0000 7f13dc9e7700 1 --2- 172.21.15.96:0/45358351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13d80ff5a0 0x7f13d8100520 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f13c800d8d0 tx=0x7f13c800dc90 comp rx=0 tx=0).stop 2024-02-19T19:09:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.110+0000 7f13dc9e7700 1 -- 172.21.15.96:0/45358351 shutdown_connections 2024-02-19T19:09:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.110+0000 7f13dc9e7700 1 --2- 172.21.15.96:0/45358351 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f13c006d9e0 0x7f13c006fea0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.110+0000 7f13dc9e7700 1 --2- 172.21.15.96:0/45358351 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f13d80ff5a0 0x7f13d8100520 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.110+0000 7f13dc9e7700 1 --2- 172.21.15.96:0/45358351 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13d80fff50 0x7f13d8100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.110+0000 7f13dc9e7700 1 -- 172.21.15.96:0/45358351 >> 172.21.15.96:0/45358351 conn(0x7f13d8074e30 msgr2=0x7f13d80fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.110+0000 7f13dc9e7700 1 -- 172.21.15.96:0/45358351 shutdown_connections 2024-02-19T19:09:29.132 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.110+0000 7f13dc9e7700 1 -- 172.21.15.96:0/45358351 wait complete. 2024-02-19T19:09:29.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.215+0000 7f3bb0f33700 1 -- 172.21.15.96:0/245247268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bac101de0 msgr2=0x7f3bac1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:29.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.215+0000 7f3bb0f33700 1 --2- 172.21.15.96:0/245247268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bac101de0 0x7f3bac1021c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c009910 tx=0x7f3b9c009c20 comp rx=0 tx=0).stop 2024-02-19T19:09:29.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.215+0000 7f3bb0f33700 1 -- 172.21.15.96:0/245247268 shutdown_connections 2024-02-19T19:09:29.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.215+0000 7f3bb0f33700 1 --2- 172.21.15.96:0/245247268 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bac102700 0x7f3bac10abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:29.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.216+0000 7f3bb0f33700 1 --2- 172.21.15.96:0/245247268 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bac101de0 0x7f3bac1021c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:29.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.216+0000 7f3bb0f33700 1 -- 172.21.15.96:0/245247268 >> 172.21.15.96:0/245247268 conn(0x7f3bac0fb650 msgr2=0x7f3bac0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:29.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.216+0000 7f3bb0f33700 1 -- 172.21.15.96:0/245247268 shutdown_connections 2024-02-19T19:09:29.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.216+0000 7f3bb0f33700 1 -- 172.21.15.96:0/245247268 wait complete. 2024-02-19T19:09:29.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.216+0000 7f3bb0f33700 1 Processor -- start 2024-02-19T19:09:29.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.216+0000 7f3bb0f33700 1 -- start start 2024-02-19T19:09:29.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.217+0000 7f3bb0f33700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bac101de0 0x7f3bac0ffa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:29.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.217+0000 7f3bb0f33700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bac102700 0x7f3bac0fff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:29.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.217+0000 7f3bb0f33700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac1004c0 con 0x7f3bac102700 2024-02-19T19:09:29.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.217+0000 7f3bb0f33700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac100600 con 0x7f3bac101de0 2024-02-19T19:09:29.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.217+0000 7f3ba1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bac102700 0x7f3bac0fff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:29.239 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.217+0000 7f3ba1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bac102700 0x7f3bac0fff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55208/0 (socket says 172.21.15.96:55208) 2024-02-19T19:09:29.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.217+0000 7f3ba1d9b700 1 -- 172.21.15.96:0/331021210 learned_addr learned my addr 172.21.15.96:0/331021210 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:09:29.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.217+0000 7f3baa59c700 1 --2- 172.21.15.96:0/331021210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bac101de0 0x7f3bac0ffa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:29.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.217+0000 7f3ba1d9b700 1 -- 172.21.15.96:0/331021210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bac101de0 msgr2=0x7f3bac0ffa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:29.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.217+0000 7f3ba1d9b700 1 --2- 172.21.15.96:0/331021210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bac101de0 0x7f3bac0ffa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:29.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.217+0000 7f3ba1d9b700 1 -- 172.21.15.96:0/331021210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c0095f0 con 0x7f3bac102700 2024-02-19T19:09:29.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.217+0000 7f3ba1d9b700 1 --2- 172.21.15.96:0/331021210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bac102700 0x7f3bac0fff80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3b9400d6a0 tx=0x7f3b9400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:29.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.217+0000 7f3ba3fff700 1 -- 172.21.15.96:0/331021210 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b940041f0 con 0x7f3bac102700 2024-02-19T19:09:29.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.217+0000 7f3bb0f33700 1 -- 172.21.15.96:0/331021210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bac1a2aa0 con 0x7f3bac102700 2024-02-19T19:09:29.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.217+0000 7f3ba3fff700 1 -- 172.21.15.96:0/331021210 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b94004350 con 0x7f3bac102700 2024-02-19T19:09:29.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.217+0000 7f3ba3fff700 1 -- 172.21.15.96:0/331021210 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b94003c10 con 0x7f3bac102700 2024-02-19T19:09:29.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.218+0000 7f3bb0f33700 1 -- 172.21.15.96:0/331021210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bac1a2eb0 con 0x7f3bac102700 2024-02-19T19:09:29.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.219+0000 7f3bb0f33700 1 -- 172.21.15.96:0/331021210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bac1082f0 con 0x7f3bac102700 2024-02-19T19:09:29.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.219+0000 7f3ba3fff700 1 -- 172.21.15.96:0/331021210 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 36) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f3b9400f690 con 0x7f3bac102700 2024-02-19T19:09:29.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.219+0000 7f3ba3fff700 1 --2- 172.21.15.96:0/331021210 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f3b9806d9d0 0x7f3b9806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:29.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.220+0000 7f3ba3fff700 1 -- 172.21.15.96:0/331021210 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3b9408d1b0 con 0x7f3bac102700 2024-02-19T19:09:29.241 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.220+0000 7f3baa59c700 1 --2- 172.21.15.96:0/331021210 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f3b9806d9d0 0x7f3b9806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:29.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.220+0000 7f3baa59c700 1 --2- 172.21.15.96:0/331021210 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f3b9806d9d0 0x7f3b9806fe90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c006010 tx=0x7f3b9c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:29.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.224+0000 7f3ba3fff700 1 -- 172.21.15.96:0/331021210 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3b940567f0 con 0x7f3bac102700 2024-02-19T19:09:29.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.475+0000 7f3bb0f33700 1 -- 172.21.15.96:0/331021210 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3bac1007c0 con 0x7f3bac102700 2024-02-19T19:09:29.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.476+0000 7f3ba3fff700 1 -- 172.21.15.96:0/331021210 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1869 (secure 0 0 0) 0x7f3b94059eb0 con 0x7f3bac102700 2024-02-19T19:09:29.498 INFO:teuthology.orchestra.run.smithi096.stdout:e19 2024-02-19T19:09:29.498 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:09:29.498 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:09:29.498 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2024-02-19T19:09:29.498 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:09:29.498 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:09:29.498 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2024-02-19T19:09:29.498 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 19 2024-02-19T19:09:29.498 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-19T19:09:29.498 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-02-19T19:01:42.881136+0000 2024-02-19T19:09:29.498 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2024-02-19T19:02:02.873590+0000 2024-02-19T19:09:29.499 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2024-02-19T19:09:29.499 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2024-02-19T19:09:29.499 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2024-02-19T19:09:29.499 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2024-02-19T19:09:29.499 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2024-02-19T19:09:29.499 INFO:teuthology.orchestra.run.smithi096.stdout:max_xattr_size 65536 2024-02-19T19:09:29.499 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2024-02-19T19:09:29.499 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2024-02-19T19:09:29.499 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 46 2024-02-19T19:09:29.499 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:09:29.499 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2024-02-19T19:09:29.499 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2024-02-19T19:09:29.499 INFO:teuthology.orchestra.run.smithi096.stdout:up {0=14490,1=24267} 2024-02-19T19:09:29.499 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2024-02-19T19:09:29.499 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2024-02-19T19:09:29.499 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2024-02-19T19:09:29.500 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2024-02-19T19:09:29.500 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2024-02-19T19:09:29.500 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data enabled 2024-02-19T19:09:29.500 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2024-02-19T19:09:29.500 INFO:teuthology.orchestra.run.smithi096.stdout:bal_rank_mask -1 2024-02-19T19:09:29.500 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2024-02-19T19:09:29.500 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pccmys{0:14490} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:09:29.500 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.usrmcg{0:14502} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/413113741,v1:172.21.15.96:6827/413113741] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:09:29.500 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.srnlol{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.125:6824/3084054986,v1:172.21.15.125:6825/3084054986] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:09:29.500 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.pwyuga{1:24275} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.125:6826/3098247423,v1:172.21.15.125:6827/3098247423] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:09:29.500 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:09:29.500 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:09:29.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.478+0000 7f3bb0f33700 1 -- 172.21.15.96:0/331021210 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f3b9806d9d0 msgr2=0x7f3b9806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:29.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.478+0000 7f3bb0f33700 1 --2- 172.21.15.96:0/331021210 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f3b9806d9d0 0x7f3b9806fe90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c006010 tx=0x7f3b9c01a040 comp rx=0 tx=0).stop 2024-02-19T19:09:29.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.478+0000 7f3bb0f33700 1 -- 172.21.15.96:0/331021210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bac102700 msgr2=0x7f3bac0fff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:29.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.478+0000 7f3bb0f33700 1 --2- 172.21.15.96:0/331021210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bac102700 0x7f3bac0fff80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3b9400d6a0 tx=0x7f3b9400da60 comp rx=0 tx=0).stop 2024-02-19T19:09:29.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.478+0000 7f3bb0f33700 1 -- 172.21.15.96:0/331021210 shutdown_connections 2024-02-19T19:09:29.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.478+0000 7f3bb0f33700 1 --2- 172.21.15.96:0/331021210 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f3b9806d9d0 0x7f3b9806fe90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:29.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.478+0000 7f3bb0f33700 1 --2- 172.21.15.96:0/331021210 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bac101de0 0x7f3bac0ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:29.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.478+0000 7f3bb0f33700 1 --2- 172.21.15.96:0/331021210 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3bac102700 0x7f3bac0fff80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:29.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.478+0000 7f3bb0f33700 1 -- 172.21.15.96:0/331021210 >> 172.21.15.96:0/331021210 conn(0x7f3bac0fb650 msgr2=0x7f3bac105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:29.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.478+0000 7f3bb0f33700 1 -- 172.21.15.96:0/331021210 shutdown_connections 2024-02-19T19:09:29.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.478+0000 7f3bb0f33700 1 -- 172.21.15.96:0/331021210 wait complete. 2024-02-19T19:09:29.502 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 19 2024-02-19T19:09:29.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.585+0000 7f95b1c93700 1 -- 172.21.15.96:0/27355010 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95ac0ffc20 msgr2=0x7f95ac100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:29.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.585+0000 7f95b1c93700 1 --2- 172.21.15.96:0/27355010 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95ac0ffc20 0x7f95ac100080 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009910 tx=0x7f95a0009c20 comp rx=0 tx=0).stop 2024-02-19T19:09:29.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.585+0000 7f95b1c93700 1 -- 172.21.15.96:0/27355010 shutdown_connections 2024-02-19T19:09:29.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.585+0000 7f95b1c93700 1 --2- 172.21.15.96:0/27355010 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95ac0ffc20 0x7f95ac100080 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:29.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.585+0000 7f95b1c93700 1 --2- 172.21.15.96:0/27355010 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95ac105bd0 0x7f95ac105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:29.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.585+0000 7f95b1c93700 1 -- 172.21.15.96:0/27355010 >> 172.21.15.96:0/27355010 conn(0x7f95ac075670 msgr2=0x7f95ac075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:29.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.585+0000 7f95b1c93700 1 -- 172.21.15.96:0/27355010 shutdown_connections 2024-02-19T19:09:29.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.585+0000 7f95b1c93700 1 -- 172.21.15.96:0/27355010 wait complete. 2024-02-19T19:09:29.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.586+0000 7f95b1c93700 1 Processor -- start 2024-02-19T19:09:29.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.586+0000 7f95b1c93700 1 -- start start 2024-02-19T19:09:29.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.586+0000 7f95b1c93700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95ac0ffc20 0x7f95ac197740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:29.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.586+0000 7f95b1c93700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95ac105bd0 0x7f95ac197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:29.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.586+0000 7f95b1c93700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac198360 con 0x7f95ac0ffc20 2024-02-19T19:09:29.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.586+0000 7f95b1c93700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac1984d0 con 0x7f95ac105bd0 2024-02-19T19:09:29.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.587+0000 7f95ab7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95ac0ffc20 0x7f95ac197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:29.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.587+0000 7f95ab7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95ac0ffc20 0x7f95ac197740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55228/0 (socket says 172.21.15.96:55228) 2024-02-19T19:09:29.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.587+0000 7f95ab7fe700 1 -- 172.21.15.96:0/835570929 learned_addr learned my addr 172.21.15.96:0/835570929 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:09:29.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.587+0000 7f95aaffd700 1 --2- 172.21.15.96:0/835570929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95ac105bd0 0x7f95ac197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:29.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.587+0000 7f95ab7fe700 1 -- 172.21.15.96:0/835570929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95ac105bd0 msgr2=0x7f95ac197c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:29.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.587+0000 7f95ab7fe700 1 --2- 172.21.15.96:0/835570929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95ac105bd0 0x7f95ac197c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:29.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.587+0000 7f95ab7fe700 1 -- 172.21.15.96:0/835570929 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a00095f0 con 0x7f95ac0ffc20 2024-02-19T19:09:29.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.587+0000 7f95ab7fe700 1 --2- 172.21.15.96:0/835570929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95ac0ffc20 0x7f95ac197740 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f959c00d8d0 tx=0x7f959c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:29.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.587+0000 7f95a8ff9700 1 -- 172.21.15.96:0/835570929 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f959c0098a0 con 0x7f95ac0ffc20 2024-02-19T19:09:29.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.587+0000 7f95a8ff9700 1 -- 172.21.15.96:0/835570929 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f959c010460 con 0x7f95ac0ffc20 2024-02-19T19:09:29.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.587+0000 7f95b1c93700 1 -- 172.21.15.96:0/835570929 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95ac1a07b0 con 0x7f95ac0ffc20 2024-02-19T19:09:29.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.587+0000 7f95a8ff9700 1 -- 172.21.15.96:0/835570929 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f959c00f5f0 con 0x7f95ac0ffc20 2024-02-19T19:09:29.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.587+0000 7f95b1c93700 1 -- 172.21.15.96:0/835570929 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ac1a0d00 con 0x7f95ac0ffc20 2024-02-19T19:09:29.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.588+0000 7f95b1c93700 1 -- 172.21.15.96:0/835570929 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ac1080d0 con 0x7f95ac0ffc20 2024-02-19T19:09:29.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.589+0000 7f95a8ff9700 1 -- 172.21.15.96:0/835570929 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 36) v1 ==== 91595+0+0 (secure 0 0 0) 0x7f959c009a00 con 0x7f95ac0ffc20 2024-02-19T19:09:29.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.589+0000 7f95a8ff9700 1 --2- 172.21.15.96:0/835570929 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f959406d9e0 0x7f959406fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:29.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.589+0000 7f95a8ff9700 1 -- 172.21.15.96:0/835570929 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f959c08d510 con 0x7f95ac0ffc20 2024-02-19T19:09:29.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.589+0000 7f95aaffd700 1 --2- 172.21.15.96:0/835570929 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f959406d9e0 0x7f959406fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:29.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.590+0000 7f95aaffd700 1 --2- 172.21.15.96:0/835570929 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f959406d9e0 0x7f959406fea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0691d0 tx=0x7f95a001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:29.615 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.594+0000 7f95a8ff9700 1 -- 172.21.15.96:0/835570929 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f959c056bd0 con 0x7f95ac0ffc20 2024-02-19T19:09:29.657 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:29 smithi096 ceph-mon[112483]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:09:29.658 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:29 smithi096 ceph-mon[112483]: osdmap e50: 6 total, 5 up, 6 in 2024-02-19T19:09:29.658 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:29 smithi096 ceph-mon[112483]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:29.658 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:29 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/45358351' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:29.658 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:29 smithi096 ceph-mon[112483]: pgmap v46: 65 pgs: 9 stale+active+clean, 56 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:09:29.658 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:29 smithi096 podman[123590]: 2024-02-19 19:09:29.378301525 +0000 UTC m=+1.405855219 container cleanup d5bbf07ad0e792d0e1716d51f5d22008e68b7feedb8e0f880ef1d2c9c914a803 (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0, ceph=True, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-02-19T19:09:29.658 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:29 smithi096 bash[123590]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0 2024-02-19T19:09:29.658 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:29 smithi096 podman[123678]: 2024-02-19 19:09:29.622267412 +0000 UTC m=+0.765994810 container remove d5bbf07ad0e792d0e1716d51f5d22008e68b7feedb8e0f880ef1d2c9c914a803 (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0, io.buildah.version=1.29.1, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.1, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, RELEASE=HEAD, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-19T19:09:29.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:29 smithi125 ceph-mon[86115]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:09:29.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:29 smithi125 ceph-mon[86115]: osdmap e50: 6 total, 5 up, 6 in 2024-02-19T19:09:29.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:29 smithi125 ceph-mon[86115]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:29.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:29 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/45358351' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:29.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:29 smithi125 ceph-mon[86115]: pgmap v46: 65 pgs: 9 stale+active+clean, 56 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:09:29.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.826+0000 7f95b1c93700 1 -- 172.21.15.96:0/835570929 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f95ac0611d0 con 0x7f959406d9e0 2024-02-19T19:09:29.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.827+0000 7f95a8ff9700 1 -- 172.21.15.96:0/835570929 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f95ac0611d0 con 0x7f959406d9e0 2024-02-19T19:09:29.849 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:09:29.849 INFO:teuthology.orchestra.run.smithi096.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:09:29.849 INFO:teuthology.orchestra.run.smithi096.stdout: "in_progress": true, 2024-02-19T19:09:29.849 INFO:teuthology.orchestra.run.smithi096.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:09:29.849 INFO:teuthology.orchestra.run.smithi096.stdout: "services_complete": [ 2024-02-19T19:09:29.849 INFO:teuthology.orchestra.run.smithi096.stdout: "crash", 2024-02-19T19:09:29.849 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr", 2024-02-19T19:09:29.849 INFO:teuthology.orchestra.run.smithi096.stdout: "mon" 2024-02-19T19:09:29.849 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-02-19T19:09:29.849 INFO:teuthology.orchestra.run.smithi096.stdout: "progress": "6/23 daemons upgraded", 2024-02-19T19:09:29.849 INFO:teuthology.orchestra.run.smithi096.stdout: "message": "Currently upgrading osd daemons", 2024-02-19T19:09:29.849 INFO:teuthology.orchestra.run.smithi096.stdout: "is_paused": false 2024-02-19T19:09:29.850 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:09:29.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.829+0000 7f95b1c93700 1 -- 172.21.15.96:0/835570929 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f959406d9e0 msgr2=0x7f959406fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:29.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.829+0000 7f95b1c93700 1 --2- 172.21.15.96:0/835570929 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f959406d9e0 0x7f959406fea0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f95ac0691d0 tx=0x7f95a001a040 comp rx=0 tx=0).stop 2024-02-19T19:09:29.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.829+0000 7f95b1c93700 1 -- 172.21.15.96:0/835570929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95ac0ffc20 msgr2=0x7f95ac197740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:29.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.829+0000 7f95b1c93700 1 --2- 172.21.15.96:0/835570929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95ac0ffc20 0x7f95ac197740 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f959c00d8d0 tx=0x7f959c00dbe0 comp rx=0 tx=0).stop 2024-02-19T19:09:29.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.829+0000 7f95b1c93700 1 -- 172.21.15.96:0/835570929 shutdown_connections 2024-02-19T19:09:29.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.830+0000 7f95b1c93700 1 --2- 172.21.15.96:0/835570929 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f959406d9e0 0x7f959406fea0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:29.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.830+0000 7f95b1c93700 1 --2- 172.21.15.96:0/835570929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95ac0ffc20 0x7f95ac197740 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:29.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.830+0000 7f95b1c93700 1 --2- 172.21.15.96:0/835570929 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95ac105bd0 0x7f95ac197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:29.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.830+0000 7f95b1c93700 1 -- 172.21.15.96:0/835570929 >> 172.21.15.96:0/835570929 conn(0x7f95ac075670 msgr2=0x7f95ac0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:29.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.830+0000 7f95b1c93700 1 -- 172.21.15.96:0/835570929 shutdown_connections 2024-02-19T19:09:29.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.830+0000 7f95b1c93700 1 -- 172.21.15.96:0/835570929 wait complete. 2024-02-19T19:09:29.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.953+0000 7fcaed1ee700 1 -- 172.21.15.96:0/447623732 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcae81027a0 msgr2=0x7fcae810ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:29.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.953+0000 7fcaed1ee700 1 --2- 172.21.15.96:0/447623732 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcae81027a0 0x7fcae810ac90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009910 tx=0x7fcadc009c20 comp rx=0 tx=0).stop 2024-02-19T19:09:29.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.953+0000 7fcaed1ee700 1 -- 172.21.15.96:0/447623732 shutdown_connections 2024-02-19T19:09:29.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.953+0000 7fcaed1ee700 1 --2- 172.21.15.96:0/447623732 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcae81027a0 0x7fcae810ac90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:29.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.953+0000 7fcaed1ee700 1 --2- 172.21.15.96:0/447623732 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcae8101e80 0x7fcae8102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:29.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.953+0000 7fcaed1ee700 1 -- 172.21.15.96:0/447623732 >> 172.21.15.96:0/447623732 conn(0x7fcae80fb610 msgr2=0x7fcae80fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:29.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.953+0000 7fcaed1ee700 1 -- 172.21.15.96:0/447623732 shutdown_connections 2024-02-19T19:09:29.977 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.953+0000 7fcaed1ee700 1 -- 172.21.15.96:0/447623732 wait complete. 2024-02-19T19:09:29.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.954+0000 7fcaed1ee700 1 Processor -- start 2024-02-19T19:09:29.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.954+0000 7fcaed1ee700 1 -- start start 2024-02-19T19:09:29.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.955+0000 7fcaed1ee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcae8101e80 0x7fcae819c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:29.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.955+0000 7fcaed1ee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcae81027a0 0x7fcae819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:29.980 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.955+0000 7fcaed1ee700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae819d240 con 0x7fcae8101e80 2024-02-19T19:09:29.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.955+0000 7fcaed1ee700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae81966f0 con 0x7fcae81027a0 2024-02-19T19:09:29.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.955+0000 7fcae659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcae81027a0 0x7fcae819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:29.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.955+0000 7fcae659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcae81027a0 0x7fcae819cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.96:60664/0 (socket says 172.21.15.96:60664) 2024-02-19T19:09:29.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.955+0000 7fcae659c700 1 -- 172.21.15.96:0/46839551 learned_addr learned my addr 172.21.15.96:0/46839551 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:09:29.981 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.955+0000 7fcae6d9d700 1 --2- 172.21.15.96:0/46839551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcae8101e80 0x7fcae819c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:29.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.955+0000 7fcae659c700 1 -- 172.21.15.96:0/46839551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcae8101e80 msgr2=0x7fcae819c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:29.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.955+0000 7fcae659c700 1 --2- 172.21.15.96:0/46839551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcae8101e80 0x7fcae819c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:29.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.955+0000 7fcae659c700 1 -- 172.21.15.96:0/46839551 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc0095f0 con 0x7fcae81027a0 2024-02-19T19:09:29.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.956+0000 7fcae659c700 1 --2- 172.21.15.96:0/46839551 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcae81027a0 0x7fcae819cbb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0092e0 tx=0x7fcadc00bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:29.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.956+0000 7fcacffff700 1 -- 172.21.15.96:0/46839551 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcadc01d070 con 0x7fcae81027a0 2024-02-19T19:09:29.982 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.956+0000 7fcacffff700 1 -- 172.21.15.96:0/46839551 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcadc005dc0 con 0x7fcae81027a0 2024-02-19T19:09:29.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.956+0000 7fcacffff700 1 -- 172.21.15.96:0/46839551 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcadc017400 con 0x7fcae81027a0 2024-02-19T19:09:29.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.957+0000 7fcaed1ee700 1 -- 172.21.15.96:0/46839551 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae8196970 con 0x7fcae81027a0 2024-02-19T19:09:29.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.957+0000 7fcaed1ee700 1 -- 172.21.15.96:0/46839551 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae8196d20 con 0x7fcae81027a0 2024-02-19T19:09:29.984 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.959+0000 7fcacffff700 1 -- 172.21.15.96:0/46839551 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 36) v1 ==== 91595+0+0 (secure 0 0 0) 0x7fcadc003a60 con 0x7fcae81027a0 2024-02-19T19:09:29.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.959+0000 7fcacffff700 1 --2- 172.21.15.96:0/46839551 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fcad006d9e0 0x7fcad006fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:09:29.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.959+0000 7fcaed1ee700 1 -- 172.21.15.96:0/46839551 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae8108390 con 0x7fcae81027a0 2024-02-19T19:09:29.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.959+0000 7fcacffff700 1 -- 172.21.15.96:0/46839551 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fcadc08eb20 con 0x7fcae81027a0 2024-02-19T19:09:29.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.960+0000 7fcae6d9d700 1 --2- 172.21.15.96:0/46839551 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fcad006d9e0 0x7fcad006fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:09:29.985 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.960+0000 7fcae6d9d700 1 --2- 172.21.15.96:0/46839551 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fcad006d9e0 0x7fcad006fea0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcad8007be0 tx=0x7fcad80073d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:09:29.987 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:29.966+0000 7fcacffff700 1 -- 172.21.15.96:0/46839551 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcadc05bc90 con 0x7fcae81027a0 2024-02-19T19:09:30.235 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:30 smithi096 podman[123821]: 2024-02-19 19:09:29.956030281 +0000 UTC m=+0.020559967 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:09:30.236 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:30 smithi096 podman[123821]: 2024-02-19 19:09:30.089997371 +0000 UTC m=+0.154527019 container create 7bc6fec7e50b60ea705cc4ea6f62ffd0a44ea0c3b2fcc8419bb0a51dbabd29cd (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-02-19T19:09:30.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:30.265+0000 7fcaed1ee700 1 -- 172.21.15.96:0/46839551 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcae80679c0 con 0x7fcae81027a0 2024-02-19T19:09:30.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:30.265+0000 7fcacffff700 1 -- 172.21.15.96:0/46839551 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+290 (secure 0 0 0) 0x7fcadc05b820 con 0x7fcae81027a0 2024-02-19T19:09:30.287 INFO:teuthology.orchestra.run.smithi096.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down 2024-02-19T19:09:30.287 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-19T19:09:30.287 INFO:teuthology.orchestra.run.smithi096.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-19T19:09:30.287 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-19T19:09:30.287 INFO:teuthology.orchestra.run.smithi096.stdout: osd.0 (root=default,host=smithi096) is down 2024-02-19T19:09:30.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:30.268+0000 7fcaed1ee700 1 -- 172.21.15.96:0/46839551 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fcad006d9e0 msgr2=0x7fcad006fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:30.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:30.268+0000 7fcaed1ee700 1 --2- 172.21.15.96:0/46839551 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fcad006d9e0 0x7fcad006fea0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcad8007be0 tx=0x7fcad80073d0 comp rx=0 tx=0).stop 2024-02-19T19:09:30.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:30.268+0000 7fcaed1ee700 1 -- 172.21.15.96:0/46839551 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcae81027a0 msgr2=0x7fcae819cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:09:30.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:30.268+0000 7fcaed1ee700 1 --2- 172.21.15.96:0/46839551 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcae81027a0 0x7fcae819cbb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcadc0092e0 tx=0x7fcadc00bd70 comp rx=0 tx=0).stop 2024-02-19T19:09:30.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:30.268+0000 7fcaed1ee700 1 -- 172.21.15.96:0/46839551 shutdown_connections 2024-02-19T19:09:30.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:30.268+0000 7fcaed1ee700 1 --2- 172.21.15.96:0/46839551 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fcad006d9e0 0x7fcad006fea0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:30.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:30.268+0000 7fcaed1ee700 1 --2- 172.21.15.96:0/46839551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcae8101e80 0x7fcae819c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:30.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:30.268+0000 7fcaed1ee700 1 --2- 172.21.15.96:0/46839551 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcae81027a0 0x7fcae819cbb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:09:30.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:30.268+0000 7fcaed1ee700 1 -- 172.21.15.96:0/46839551 >> 172.21.15.96:0/46839551 conn(0x7fcae80fb610 msgr2=0x7fcae81054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:09:30.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:30.268+0000 7fcaed1ee700 1 -- 172.21.15.96:0/46839551 shutdown_connections 2024-02-19T19:09:30.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:09:30.268+0000 7fcaed1ee700 1 -- 172.21.15.96:0/46839551 wait complete. 2024-02-19T19:09:30.488 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:30 smithi096 ceph-mon[112483]: osdmap e51: 6 total, 5 up, 6 in 2024-02-19T19:09:30.489 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:30 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/331021210' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:09:30.489 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:30 smithi096 ceph-mon[112483]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:30.489 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:30 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/46839551' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:09:30.489 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:30 smithi096 podman[123821]: 2024-02-19 19:09:30.367945246 +0000 UTC m=+0.432474895 container init 7bc6fec7e50b60ea705cc4ea6f62ffd0a44ea0c3b2fcc8419bb0a51dbabd29cd (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-02-19T19:09:30.489 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:30 smithi096 podman[123821]: 2024-02-19 19:09:30.371742555 +0000 UTC m=+0.436272214 container start 7bc6fec7e50b60ea705cc4ea6f62ffd0a44ea0c3b2fcc8419bb0a51dbabd29cd (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T19:09:30.489 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:30 smithi096 podman[123821]: 2024-02-19 19:09:30.468043964 +0000 UTC m=+0.532573643 container attach 7bc6fec7e50b60ea705cc4ea6f62ffd0a44ea0c3b2fcc8419bb0a51dbabd29cd (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-02-19T19:09:30.788 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:30 smithi096 podman[123821]: 2024-02-19 19:09:30.699053836 +0000 UTC m=+0.763583511 container died 7bc6fec7e50b60ea705cc4ea6f62ffd0a44ea0c3b2fcc8419bb0a51dbabd29cd (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-deactivate, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-02-19T19:09:30.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:30 smithi125 ceph-mon[86115]: osdmap e51: 6 total, 5 up, 6 in 2024-02-19T19:09:30.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:30 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/331021210' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:09:30.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:30 smithi125 ceph-mon[86115]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:09:30.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:30 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/46839551' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:09:31.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:31 smithi096 ceph-mon[112483]: pgmap v48: 65 pgs: 9 stale+active+clean, 56 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-19T19:09:31.537 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:31 smithi096 podman[123870]: 2024-02-19 19:09:31.355995313 +0000 UTC m=+0.652099762 container remove 7bc6fec7e50b60ea705cc4ea6f62ffd0a44ea0c3b2fcc8419bb0a51dbabd29cd (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-deactivate, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-19T19:09:31.538 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:31 smithi096 systemd[1]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.0.service: Deactivated successfully. 2024-02-19T19:09:31.538 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:31 smithi096 systemd[1]: Stopped Ceph osd.0 for 06580d2c-cf58-11ee-95bb-87774f69a715. 2024-02-19T19:09:31.538 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:31 smithi096 systemd[1]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.0.service: Consumed 5.526s CPU time. 2024-02-19T19:09:31.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:31 smithi125 ceph-mon[86115]: pgmap v48: 65 pgs: 9 stale+active+clean, 56 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-19T19:09:31.978 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:31 smithi096 systemd[1]: Starting Ceph osd.0 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T19:09:31.979 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:31 smithi096 podman[123978]: 2024-02-19 19:09:31.712684172 +0000 UTC m=+0.018879043 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:09:31.979 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:31 smithi096 podman[123978]: 2024-02-19 19:09:31.83245757 +0000 UTC m=+0.138652436 container create b7f870245c04833dfda72a091f6e699aba6e7b401ee0dd1b999515e66f0f17c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-activate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-02-19T19:09:32.287 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:32 smithi096 podman[123978]: 2024-02-19 19:09:32.093434555 +0000 UTC m=+0.399629421 container init b7f870245c04833dfda72a091f6e699aba6e7b401ee0dd1b999515e66f0f17c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-activate, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-02-19T19:09:32.288 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:32 smithi096 podman[123978]: 2024-02-19 19:09:32.096576637 +0000 UTC m=+0.402771512 container start b7f870245c04833dfda72a091f6e699aba6e7b401ee0dd1b999515e66f0f17c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-activate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T19:09:32.288 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:32 smithi096 podman[123978]: 2024-02-19 19:09:32.193423346 +0000 UTC m=+0.499618226 container attach b7f870245c04833dfda72a091f6e699aba6e7b401ee0dd1b999515e66f0f17c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-activate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240214, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-02-19T19:09:32.893 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:32 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-activate[123993]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-19T19:09:32.893 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:32 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-activate[123993]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-19T19:09:32.893 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:32 smithi096 bash[123978]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-19T19:09:32.894 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:32 smithi096 bash[123978]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-19T19:09:32.894 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:32 smithi096 bash[123978]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-19T19:09:32.894 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:32 smithi096 bash[123978]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-19T19:09:32.894 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:32 smithi096 bash[123978]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-19T19:09:32.894 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:32 smithi096 bash[123978]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-19T19:09:32.894 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:32 smithi096 bash[123978]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-19T19:09:32.894 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:32 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-activate[123993]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-19T19:09:32.894 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:32 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-activate[123993]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-19T19:09:32.894 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:32 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-activate[123993]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-19T19:09:32.894 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:32 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-activate[123993]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-19T19:09:32.894 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:32 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-activate[123993]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-19T19:09:32.894 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:32 smithi096 podman[123978]: 2024-02-19 19:09:32.56415109 +0000 UTC m=+0.870345957 container died b7f870245c04833dfda72a091f6e699aba6e7b401ee0dd1b999515e66f0f17c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-activate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=) 2024-02-19T19:09:33.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:33 smithi096 ceph-mon[112483]: Health check failed: Degraded data redundancy: 25/129 objects degraded (19.380%), 13 pgs degraded (PG_DEGRADED) 2024-02-19T19:09:33.538 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:33 smithi096 podman[124133]: 2024-02-19 19:09:33.172912819 +0000 UTC m=+0.602162196 container remove b7f870245c04833dfda72a091f6e699aba6e7b401ee0dd1b999515e66f0f17c8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-activate, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T19:09:33.538 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:33 smithi096 podman[124199]: 2024-02-19 19:09:33.28825927 +0000 UTC m=+0.018588689 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:09:33.538 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:33 smithi096 podman[124199]: 2024-02-19 19:09:33.415739825 +0000 UTC m=+0.146069236 container create b3dffd6a3fb28a0182955e8226a4dc4773c71b331c611db468ed0590fa95b84a (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, ceph=True, CEPH_POINT_RELEASE=) 2024-02-19T19:09:33.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:33 smithi125 ceph-mon[86115]: Health check failed: Degraded data redundancy: 25/129 objects degraded (19.380%), 13 pgs degraded (PG_DEGRADED) 2024-02-19T19:09:34.037 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:33 smithi096 podman[124199]: 2024-02-19 19:09:33.643270697 +0000 UTC m=+0.373600109 container init b3dffd6a3fb28a0182955e8226a4dc4773c71b331c611db468ed0590fa95b84a (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-02-19T19:09:34.038 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:33 smithi096 podman[124199]: 2024-02-19 19:09:33.646228679 +0000 UTC m=+0.376558086 container start b3dffd6a3fb28a0182955e8226a4dc4773c71b331c611db468ed0590fa95b84a (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-02-19T19:09:34.038 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:33 smithi096 ceph-osd[124218]: -- 172.21.15.96:0/3773666367 <== mon.0 v2:172.21.15.96:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563bf52271e0 con 0x563bf51f8c00 2024-02-19T19:09:34.038 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:33 smithi096 bash[124199]: b3dffd6a3fb28a0182955e8226a4dc4773c71b331c611db468ed0590fa95b84a 2024-02-19T19:09:34.038 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:33 smithi096 systemd[1]: Started Ceph osd.0 for 06580d2c-cf58-11ee-95bb-87774f69a715. 2024-02-19T19:09:34.537 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:34 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0[124214]: 2024-02-19T19:09:34.184+0000 7fa1fd40e7c0 -1 Falling back to public interface 2024-02-19T19:09:34.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:34 smithi096 ceph-mon[112483]: pgmap v49: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 2 op/s; 25/129 objects degraded (19.380%) 2024-02-19T19:09:34.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:34 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:34.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:34 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:34.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:34 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:09:34.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:34 smithi125 ceph-mon[86115]: pgmap v49: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 511 B/s rd, 2 op/s; 25/129 objects degraded (19.380%) 2024-02-19T19:09:34.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:34 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:34.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:34 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:34.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:34 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:09:36.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:36 smithi096 ceph-mon[112483]: pgmap v50: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 25/129 objects degraded (19.380%) 2024-02-19T19:09:36.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:36.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:09:36.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:36 smithi125 ceph-mon[86115]: pgmap v50: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 25/129 objects degraded (19.380%) 2024-02-19T19:09:36.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:36.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:09:37.684 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:37 smithi096 ceph-mon[112483]: mgrmap e37: smithi096.zsjdff(active, since 91s), standbys: smithi125.ygdmdu 2024-02-19T19:09:37.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:37 smithi125 ceph-mon[86115]: mgrmap e37: smithi096.zsjdff(active, since 91s), standbys: smithi125.ygdmdu 2024-02-19T19:09:38.037 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:37 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0[124214]: 2024-02-19T19:09:37.662+0000 7fa1fd40e7c0 -1 osd.0 0 read_superblock omap replica is missing. 2024-02-19T19:09:38.038 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:37 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0[124214]: 2024-02-19T19:09:37.695+0000 7fa1fd40e7c0 -1 osd.0 49 log_to_monitors true 2024-02-19T19:09:38.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:38 smithi125 ceph-mon[86115]: pgmap v51: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 692 B/s rd, 692 B/s wr, 3 op/s; 25/129 objects degraded (19.380%) 2024-02-19T19:09:38.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:38 smithi125 ceph-mon[86115]: from='osd.0 [v2:172.21.15.96:6802/56546766,v1:172.21.15.96:6803/56546766]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T19:09:38.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:38 smithi096 ceph-mon[112483]: pgmap v51: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 692 B/s rd, 692 B/s wr, 3 op/s; 25/129 objects degraded (19.380%) 2024-02-19T19:09:38.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:38 smithi096 ceph-mon[112483]: from='osd.0 [v2:172.21.15.96:6802/56546766,v1:172.21.15.96:6803/56546766]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-19T19:09:38.788 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 19:09:38 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0[124214]: 2024-02-19T19:09:38.433+0000 7fa1ee866700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T19:09:39.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:39 smithi125 ceph-mon[86115]: from='osd.0 [v2:172.21.15.96:6802/56546766,v1:172.21.15.96:6803/56546766]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-19T19:09:39.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:39 smithi125 ceph-mon[86115]: osdmap e52: 6 total, 5 up, 6 in 2024-02-19T19:09:39.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:39 smithi125 ceph-mon[86115]: from='osd.0 [v2:172.21.15.96:6802/56546766,v1:172.21.15.96:6803/56546766]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2024-02-19T19:09:39.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:39 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:39.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:39 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:39.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:39 smithi125 ceph-mon[86115]: pgmap v53: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 622 B/s rd, 622 B/s wr, 3 op/s; 25/129 objects degraded (19.380%) 2024-02-19T19:09:39.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:39 smithi096 ceph-mon[112483]: from='osd.0 [v2:172.21.15.96:6802/56546766,v1:172.21.15.96:6803/56546766]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-19T19:09:39.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:39 smithi096 ceph-mon[112483]: osdmap e52: 6 total, 5 up, 6 in 2024-02-19T19:09:39.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:39 smithi096 ceph-mon[112483]: from='osd.0 [v2:172.21.15.96:6802/56546766,v1:172.21.15.96:6803/56546766]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2024-02-19T19:09:39.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:39 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:39.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:39 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:39.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:39 smithi096 ceph-mon[112483]: pgmap v53: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 622 B/s rd, 622 B/s wr, 3 op/s; 25/129 objects degraded (19.380%) 2024-02-19T19:09:40.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:40 smithi125 ceph-mon[86115]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:09:40.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:40 smithi125 ceph-mon[86115]: osd.0 [v2:172.21.15.96:6802/56546766,v1:172.21.15.96:6803/56546766] boot 2024-02-19T19:09:40.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:40 smithi125 ceph-mon[86115]: osdmap e53: 6 total, 6 up, 6 in 2024-02-19T19:09:40.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:40 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T19:09:40.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:40 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:40.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:40 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:40.774 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:40 smithi096 ceph-mon[112483]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:09:40.774 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:40 smithi096 ceph-mon[112483]: osd.0 [v2:172.21.15.96:6802/56546766,v1:172.21.15.96:6803/56546766] boot 2024-02-19T19:09:40.774 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:40 smithi096 ceph-mon[112483]: osdmap e53: 6 total, 6 up, 6 in 2024-02-19T19:09:40.774 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:40 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-19T19:09:40.774 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:40 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:40.774 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:40 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:41.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:41 smithi125 ceph-mon[86115]: osdmap e54: 6 total, 6 up, 6 in 2024-02-19T19:09:41.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:41 smithi125 ceph-mon[86115]: pgmap v56: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 1023 B/s wr, 4 op/s; 25/129 objects degraded (19.380%) 2024-02-19T19:09:41.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:41 smithi096 ceph-mon[112483]: osdmap e54: 6 total, 6 up, 6 in 2024-02-19T19:09:41.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:41 smithi096 ceph-mon[112483]: pgmap v56: 65 pgs: 13 active+undersized+degraded, 21 active+undersized, 31 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 1023 B/s wr, 4 op/s; 25/129 objects degraded (19.380%) 2024-02-19T19:09:43.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:43 smithi125 ceph-mon[86115]: Health check update: Degraded data redundancy: 5/129 objects degraded (3.876%), 2 pgs degraded (PG_DEGRADED) 2024-02-19T19:09:43.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:43 smithi096 ceph-mon[112483]: Health check update: Degraded data redundancy: 5/129 objects degraded (3.876%), 2 pgs degraded (PG_DEGRADED) 2024-02-19T19:09:44.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:44 smithi125 ceph-mon[86115]: pgmap v57: 65 pgs: 2 active+undersized+degraded, 7 active+undersized, 56 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 5/129 objects degraded (3.876%); 46 B/s, 0 objects/s recovering 2024-02-19T19:09:44.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:44 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:44.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:44 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:44.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:44 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:09:44.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:44 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:09:44.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:44 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:44.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:44 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:09:44.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:44 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:44.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:44 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:44.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:44 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:44.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:44 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-19T19:09:44.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:44 smithi096 ceph-mon[112483]: pgmap v57: 65 pgs: 2 active+undersized+degraded, 7 active+undersized, 56 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 5/129 objects degraded (3.876%); 46 B/s, 0 objects/s recovering 2024-02-19T19:09:44.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:44 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:44.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:44 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:44.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:44 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:09:44.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:44 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:09:44.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:44 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:44.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:44 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:09:44.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:44 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:44.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:44 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:44.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:44 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:09:44.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:44 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-19T19:09:45.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:45 smithi125 ceph-mon[86115]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-19T19:09:45.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:45 smithi125 ceph-mon[86115]: Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2024-02-19T19:09:45.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:45 smithi096 ceph-mon[112483]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-19T19:09:45.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:45 smithi096 ceph-mon[112483]: Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2024-02-19T19:09:46.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:46 smithi125 ceph-mon[86115]: pgmap v58: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 40 B/s, 0 objects/s recovering 2024-02-19T19:09:46.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:46 smithi125 ceph-mon[86115]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/129 objects degraded (3.876%), 2 pgs degraded) 2024-02-19T19:09:46.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:46 smithi096 ceph-mon[112483]: pgmap v58: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 40 B/s, 0 objects/s recovering 2024-02-19T19:09:46.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:46 smithi096 ceph-mon[112483]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/129 objects degraded (3.876%), 2 pgs degraded) 2024-02-19T19:09:48.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:48 smithi125 ceph-mon[86115]: pgmap v59: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 35 B/s, 0 objects/s recovering 2024-02-19T19:09:48.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:48 smithi096 ceph-mon[112483]: pgmap v59: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 35 B/s, 0 objects/s recovering 2024-02-19T19:09:50.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:50 smithi125 ceph-mon[86115]: pgmap v60: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s; 28 B/s, 0 objects/s recovering 2024-02-19T19:09:50.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:50.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:09:50.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:50.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:50 smithi096 ceph-mon[112483]: pgmap v60: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s; 28 B/s, 0 objects/s recovering 2024-02-19T19:09:50.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:50.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:09:50.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:09:51.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:51 smithi125 ceph-mon[86115]: pgmap v61: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 25 B/s, 0 objects/s recovering 2024-02-19T19:09:51.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:51 smithi096 ceph-mon[112483]: pgmap v61: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 25 B/s, 0 objects/s recovering 2024-02-19T19:09:54.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:54 smithi125 ceph-mon[86115]: pgmap v62: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s; 23 B/s, 0 objects/s recovering 2024-02-19T19:09:54.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:54 smithi096 ceph-mon[112483]: pgmap v62: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s; 23 B/s, 0 objects/s recovering 2024-02-19T19:09:56.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:56 smithi125 ceph-mon[86115]: pgmap v63: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:09:56.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:56 smithi096 ceph-mon[112483]: pgmap v63: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:09:58.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:58 smithi125 ceph-mon[86115]: pgmap v64: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:09:58.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:58 smithi096 ceph-mon[112483]: pgmap v64: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:09:59.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:09:59 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-19T19:09:59.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:09:59 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-19T19:10:00.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.376+0000 7fb5ddc48700 1 -- 172.21.15.96:0/3370139819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5d8101830 msgr2=0x7fb5d8105880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:00.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.376+0000 7fb5ddc48700 1 --2- 172.21.15.96:0/3370139819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5d8101830 0x7fb5d8105880 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0009910 tx=0x7fb5c0009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:00.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.376+0000 7fb5ddc48700 1 -- 172.21.15.96:0/3370139819 shutdown_connections 2024-02-19T19:10:00.400 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.376+0000 7fb5ddc48700 1 --2- 172.21.15.96:0/3370139819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5d8101830 0x7fb5d8105880 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:00.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.376+0000 7fb5ddc48700 1 --2- 172.21.15.96:0/3370139819 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5d8100e80 0x7fb5d8101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:00.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.376+0000 7fb5ddc48700 1 -- 172.21.15.96:0/3370139819 >> 172.21.15.96:0/3370139819 conn(0x7fb5d80fc710 msgr2=0x7fb5d80feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:00.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.376+0000 7fb5ddc48700 1 -- 172.21.15.96:0/3370139819 shutdown_connections 2024-02-19T19:10:00.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.376+0000 7fb5ddc48700 1 -- 172.21.15.96:0/3370139819 wait complete. 2024-02-19T19:10:00.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.377+0000 7fb5ddc48700 1 Processor -- start 2024-02-19T19:10:00.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.377+0000 7fb5ddc48700 1 -- start start 2024-02-19T19:10:00.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.377+0000 7fb5ddc48700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5d8100e80 0x7fb5d819c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:00.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.377+0000 7fb5ddc48700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5d8101830 0x7fb5d819cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:00.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.377+0000 7fb5ddc48700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d819d210 con 0x7fb5d8100e80 2024-02-19T19:10:00.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.377+0000 7fb5ddc48700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5d81966c0 con 0x7fb5d8101830 2024-02-19T19:10:00.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.377+0000 7fb5d77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5d8100e80 0x7fb5d819c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:00.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.377+0000 7fb5d77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5d8100e80 0x7fb5d819c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53930/0 (socket says 172.21.15.96:53930) 2024-02-19T19:10:00.401 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.377+0000 7fb5d77fe700 1 -- 172.21.15.96:0/3148527608 learned_addr learned my addr 172.21.15.96:0/3148527608 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:10:00.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.377+0000 7fb5cffff700 1 --2- 172.21.15.96:0/3148527608 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5d8101830 0x7fb5d819cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:00.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.377+0000 7fb5d77fe700 1 -- 172.21.15.96:0/3148527608 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5d8101830 msgr2=0x7fb5d819cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:00.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.377+0000 7fb5d77fe700 1 --2- 172.21.15.96:0/3148527608 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5d8101830 0x7fb5d819cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:00.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.377+0000 7fb5d77fe700 1 -- 172.21.15.96:0/3148527608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c00095f0 con 0x7fb5d8100e80 2024-02-19T19:10:00.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.378+0000 7fb5d77fe700 1 --2- 172.21.15.96:0/3148527608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5d8100e80 0x7fb5d819c640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb5c800d8d0 tx=0x7fb5c800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:00.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.378+0000 7fb5d57fa700 1 -- 172.21.15.96:0/3148527608 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5c80098a0 con 0x7fb5d8100e80 2024-02-19T19:10:00.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.378+0000 7fb5d57fa700 1 -- 172.21.15.96:0/3148527608 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb5c8010460 con 0x7fb5d8100e80 2024-02-19T19:10:00.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.378+0000 7fb5ddc48700 1 -- 172.21.15.96:0/3148527608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5d81969a0 con 0x7fb5d8100e80 2024-02-19T19:10:00.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.378+0000 7fb5d57fa700 1 -- 172.21.15.96:0/3148527608 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5c800f5f0 con 0x7fb5d8100e80 2024-02-19T19:10:00.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.378+0000 7fb5ddc48700 1 -- 172.21.15.96:0/3148527608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5d8196ec0 con 0x7fb5d8100e80 2024-02-19T19:10:00.402 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.379+0000 7fb5ddc48700 1 -- 172.21.15.96:0/3148527608 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5d8109280 con 0x7fb5d8100e80 2024-02-19T19:10:00.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.379+0000 7fb5d57fa700 1 -- 172.21.15.96:0/3148527608 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb5c8009a00 con 0x7fb5d8100e80 2024-02-19T19:10:00.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.380+0000 7fb5d57fa700 1 --2- 172.21.15.96:0/3148527608 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb5c406d8a0 0x7fb5c406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:00.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.380+0000 7fb5cffff700 1 --2- 172.21.15.96:0/3148527608 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb5c406d8a0 0x7fb5c406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:00.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.380+0000 7fb5d57fa700 1 -- 172.21.15.96:0/3148527608 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb5c808d380 con 0x7fb5d8100e80 2024-02-19T19:10:00.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.380+0000 7fb5cffff700 1 --2- 172.21.15.96:0/3148527608 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb5c406d8a0 0x7fb5c406fd60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0006010 tx=0x7fb5c001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:00.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.385+0000 7fb5d57fa700 1 -- 172.21.15.96:0/3148527608 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb5c805a710 con 0x7fb5d8100e80 2024-02-19T19:10:00.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.604+0000 7fb5ddc48700 1 -- 172.21.15.96:0/3148527608 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5d81970e0 con 0x7fb5c406d8a0 2024-02-19T19:10:00.627 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.606+0000 7fb5d57fa700 1 -- 172.21.15.96:0/3148527608 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fb5d81970e0 con 0x7fb5c406d8a0 2024-02-19T19:10:00.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.608+0000 7fb5ddc48700 1 -- 172.21.15.96:0/3148527608 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb5c406d8a0 msgr2=0x7fb5c406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:00.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.608+0000 7fb5ddc48700 1 --2- 172.21.15.96:0/3148527608 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb5c406d8a0 0x7fb5c406fd60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb5c0006010 tx=0x7fb5c001a040 comp rx=0 tx=0).stop 2024-02-19T19:10:00.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.608+0000 7fb5ddc48700 1 -- 172.21.15.96:0/3148527608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5d8100e80 msgr2=0x7fb5d819c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:00.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.608+0000 7fb5ddc48700 1 --2- 172.21.15.96:0/3148527608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5d8100e80 0x7fb5d819c640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb5c800d8d0 tx=0x7fb5c800dbe0 comp rx=0 tx=0).stop 2024-02-19T19:10:00.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.608+0000 7fb5ddc48700 1 -- 172.21.15.96:0/3148527608 shutdown_connections 2024-02-19T19:10:00.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.608+0000 7fb5ddc48700 1 --2- 172.21.15.96:0/3148527608 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb5c406d8a0 0x7fb5c406fd60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:00.630 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.608+0000 7fb5ddc48700 1 --2- 172.21.15.96:0/3148527608 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5d8100e80 0x7fb5d819c640 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:00.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.608+0000 7fb5ddc48700 1 --2- 172.21.15.96:0/3148527608 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5d8101830 0x7fb5d819cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:00.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.608+0000 7fb5ddc48700 1 -- 172.21.15.96:0/3148527608 >> 172.21.15.96:0/3148527608 conn(0x7fb5d80fc710 msgr2=0x7fb5d80fdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:00.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.608+0000 7fb5ddc48700 1 -- 172.21.15.96:0/3148527608 shutdown_connections 2024-02-19T19:10:00.631 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.608+0000 7fb5ddc48700 1 -- 172.21.15.96:0/3148527608 wait complete. 2024-02-19T19:10:00.640 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:10:00.640 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:00 smithi096 ceph-mon[112483]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-19T19:10:00.640 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:00 smithi096 ceph-mon[112483]: Upgrade: osd.1 is safe to restart 2024-02-19T19:10:00.640 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:00 smithi096 ceph-mon[112483]: pgmap v65: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:10:00.641 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:00 smithi096 ceph-mon[112483]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T19:10:00.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:00 smithi125 ceph-mon[86115]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-19T19:10:00.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:00 smithi125 ceph-mon[86115]: Upgrade: osd.1 is safe to restart 2024-02-19T19:10:00.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:00 smithi125 ceph-mon[86115]: pgmap v65: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:10:00.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:00 smithi125 ceph-mon[86115]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T19:10:00.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.715+0000 7f9a43fc5700 1 -- 172.21.15.96:0/1269315880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a3c101e60 msgr2=0x7f9a3c102240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:00.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.715+0000 7f9a43fc5700 1 --2- 172.21.15.96:0/1269315880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a3c101e60 0x7f9a3c102240 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9a38009910 tx=0x7f9a38009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:00.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.715+0000 7f9a43fc5700 1 -- 172.21.15.96:0/1269315880 shutdown_connections 2024-02-19T19:10:00.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.715+0000 7f9a43fc5700 1 --2- 172.21.15.96:0/1269315880 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a3c102780 0x7f9a3c10ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:00.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.715+0000 7f9a43fc5700 1 --2- 172.21.15.96:0/1269315880 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a3c101e60 0x7f9a3c102240 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:00.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.715+0000 7f9a43fc5700 1 -- 172.21.15.96:0/1269315880 >> 172.21.15.96:0/1269315880 conn(0x7f9a3c0fb650 msgr2=0x7f9a3c0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:00.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.716+0000 7f9a43fc5700 1 -- 172.21.15.96:0/1269315880 shutdown_connections 2024-02-19T19:10:00.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.716+0000 7f9a43fc5700 1 -- 172.21.15.96:0/1269315880 wait complete. 2024-02-19T19:10:00.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.716+0000 7f9a43fc5700 1 Processor -- start 2024-02-19T19:10:00.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.716+0000 7f9a43fc5700 1 -- start start 2024-02-19T19:10:00.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.716+0000 7f9a43fc5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a3c101e60 0x7f9a3c19c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:00.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.716+0000 7f9a43fc5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a3c102780 0x7f9a3c19cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:00.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.716+0000 7f9a43fc5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c19d220 con 0x7f9a3c102780 2024-02-19T19:10:00.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.716+0000 7f9a43fc5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c196720 con 0x7f9a3c101e60 2024-02-19T19:10:00.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.716+0000 7f9a41560700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a3c102780 0x7f9a3c19cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:00.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.717+0000 7f9a41560700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a3c102780 0x7f9a3c19cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53958/0 (socket says 172.21.15.96:53958) 2024-02-19T19:10:00.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.717+0000 7f9a41560700 1 -- 172.21.15.96:0/132340475 learned_addr learned my addr 172.21.15.96:0/132340475 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:10:00.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.717+0000 7f9a41d61700 1 --2- 172.21.15.96:0/132340475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a3c101e60 0x7f9a3c19c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:00.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.717+0000 7f9a41560700 1 -- 172.21.15.96:0/132340475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a3c101e60 msgr2=0x7f9a3c19c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:00.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.717+0000 7f9a41560700 1 --2- 172.21.15.96:0/132340475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a3c101e60 0x7f9a3c19c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:00.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.717+0000 7f9a41560700 1 -- 172.21.15.96:0/132340475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a380095f0 con 0x7f9a3c102780 2024-02-19T19:10:00.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.717+0000 7f9a41560700 1 --2- 172.21.15.96:0/132340475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a3c102780 0x7f9a3c19cb90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00c8f0 tx=0x7f9a2c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:00.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.717+0000 7f9a32ffd700 1 -- 172.21.15.96:0/132340475 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a2c0078a0 con 0x7f9a3c102780 2024-02-19T19:10:00.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.717+0000 7f9a32ffd700 1 -- 172.21.15.96:0/132340475 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a2c00f450 con 0x7f9a3c102780 2024-02-19T19:10:00.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.717+0000 7f9a32ffd700 1 -- 172.21.15.96:0/132340475 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a2c018610 con 0x7f9a3c102780 2024-02-19T19:10:00.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.717+0000 7f9a43fc5700 1 -- 172.21.15.96:0/132340475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3c196a00 con 0x7f9a3c102780 2024-02-19T19:10:00.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.717+0000 7f9a43fc5700 1 -- 172.21.15.96:0/132340475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3c196f50 con 0x7f9a3c102780 2024-02-19T19:10:00.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.718+0000 7f9a43fc5700 1 -- 172.21.15.96:0/132340475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a3c108310 con 0x7f9a3c102780 2024-02-19T19:10:00.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.719+0000 7f9a32ffd700 1 -- 172.21.15.96:0/132340475 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f9a2c00f5c0 con 0x7f9a3c102780 2024-02-19T19:10:00.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.719+0000 7f9a32ffd700 1 --2- 172.21.15.96:0/132340475 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9a2806d8a0 0x7f9a2806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:00.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.719+0000 7f9a32ffd700 1 -- 172.21.15.96:0/132340475 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9a2c08d350 con 0x7f9a3c102780 2024-02-19T19:10:00.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.719+0000 7f9a41d61700 1 --2- 172.21.15.96:0/132340475 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9a2806d8a0 0x7f9a2806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:00.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.719+0000 7f9a41d61700 1 --2- 172.21.15.96:0/132340475 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9a2806d8a0 0x7f9a2806fd60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9a38005f50 tx=0x7f9a3801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:00.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.724+0000 7f9a32ffd700 1 -- 172.21.15.96:0/132340475 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9a2c05a760 con 0x7f9a3c102780 2024-02-19T19:10:00.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.943+0000 7f9a43fc5700 1 -- 172.21.15.96:0/132340475 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a3c197cf0 con 0x7f9a2806d8a0 2024-02-19T19:10:00.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.944+0000 7f9a32ffd700 1 -- 172.21.15.96:0/132340475 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f9a3c197cf0 con 0x7f9a2806d8a0 2024-02-19T19:10:00.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.946+0000 7f9a43fc5700 1 -- 172.21.15.96:0/132340475 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9a2806d8a0 msgr2=0x7f9a2806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:00.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.946+0000 7f9a43fc5700 1 --2- 172.21.15.96:0/132340475 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9a2806d8a0 0x7f9a2806fd60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9a38005f50 tx=0x7f9a3801a040 comp rx=0 tx=0).stop 2024-02-19T19:10:00.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.946+0000 7f9a43fc5700 1 -- 172.21.15.96:0/132340475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a3c102780 msgr2=0x7f9a3c19cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:00.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.946+0000 7f9a43fc5700 1 --2- 172.21.15.96:0/132340475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a3c102780 0x7f9a3c19cb90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c00c8f0 tx=0x7f9a2c00cc00 comp rx=0 tx=0).stop 2024-02-19T19:10:00.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.946+0000 7f9a43fc5700 1 -- 172.21.15.96:0/132340475 shutdown_connections 2024-02-19T19:10:00.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.946+0000 7f9a43fc5700 1 --2- 172.21.15.96:0/132340475 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9a2806d8a0 0x7f9a2806fd60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:00.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.946+0000 7f9a43fc5700 1 --2- 172.21.15.96:0/132340475 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a3c101e60 0x7f9a3c19c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:00.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.946+0000 7f9a43fc5700 1 --2- 172.21.15.96:0/132340475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a3c102780 0x7f9a3c19cb90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:00.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.946+0000 7f9a43fc5700 1 -- 172.21.15.96:0/132340475 >> 172.21.15.96:0/132340475 conn(0x7f9a3c0fb650 msgr2=0x7f9a3c105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:00.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.946+0000 7f9a43fc5700 1 -- 172.21.15.96:0/132340475 shutdown_connections 2024-02-19T19:10:00.968 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:00.946+0000 7f9a43fc5700 1 -- 172.21.15.96:0/132340475 wait complete. 2024-02-19T19:10:01.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.054+0000 7feed1237700 1 -- 172.21.15.96:0/2225619726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feecc0ffda0 msgr2=0x7feecc100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:01.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.054+0000 7feed1237700 1 --2- 172.21.15.96:0/2225619726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feecc0ffda0 0x7feecc100180 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feebc009910 tx=0x7feebc009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:01.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.054+0000 7feed1237700 1 -- 172.21.15.96:0/2225619726 shutdown_connections 2024-02-19T19:10:01.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.054+0000 7feed1237700 1 --2- 172.21.15.96:0/2225619726 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feecc100750 0x7feecc1047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:01.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.054+0000 7feed1237700 1 --2- 172.21.15.96:0/2225619726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feecc0ffda0 0x7feecc100180 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:01.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.054+0000 7feed1237700 1 -- 172.21.15.96:0/2225619726 >> 172.21.15.96:0/2225619726 conn(0x7feecc0fb650 msgr2=0x7feecc0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:01.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.055+0000 7feed1237700 1 -- 172.21.15.96:0/2225619726 shutdown_connections 2024-02-19T19:10:01.077 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.055+0000 7feed1237700 1 -- 172.21.15.96:0/2225619726 wait complete. 2024-02-19T19:10:01.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.056+0000 7feed1237700 1 Processor -- start 2024-02-19T19:10:01.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.056+0000 7feed1237700 1 -- start start 2024-02-19T19:10:01.078 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.056+0000 7feed1237700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feecc0ffda0 0x7feecc101840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.056+0000 7feed1237700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feecc100750 0x7feecc101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.056+0000 7feed1237700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc102350 con 0x7feecc0ffda0 2024-02-19T19:10:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.056+0000 7feed1237700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc1024c0 con 0x7feecc100750 2024-02-19T19:10:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.056+0000 7feecad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feecc0ffda0 0x7feecc101840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.056+0000 7feecad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feecc0ffda0 0x7feecc101840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53970/0 (socket says 172.21.15.96:53970) 2024-02-19T19:10:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.056+0000 7feecad9d700 1 -- 172.21.15.96:0/4039493201 learned_addr learned my addr 172.21.15.96:0/4039493201 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:10:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.056+0000 7feeca59c700 1 --2- 172.21.15.96:0/4039493201 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feecc100750 0x7feecc101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.057+0000 7feecad9d700 1 -- 172.21.15.96:0/4039493201 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feecc100750 msgr2=0x7feecc101d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.057+0000 7feecad9d700 1 --2- 172.21.15.96:0/4039493201 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feecc100750 0x7feecc101d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.057+0000 7feecad9d700 1 -- 172.21.15.96:0/4039493201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc0095f0 con 0x7feecc0ffda0 2024-02-19T19:10:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.057+0000 7feecad9d700 1 --2- 172.21.15.96:0/4039493201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feecc0ffda0 0x7feecc101840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feebc006010 tx=0x7feebc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.057+0000 7feeb3fff700 1 -- 172.21.15.96:0/4039493201 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feebc01d070 con 0x7feecc0ffda0 2024-02-19T19:10:01.079 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.057+0000 7feeb3fff700 1 -- 172.21.15.96:0/4039493201 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feebc00f460 con 0x7feecc0ffda0 2024-02-19T19:10:01.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.057+0000 7feed1237700 1 -- 172.21.15.96:0/4039493201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feecc1a2c00 con 0x7feecc0ffda0 2024-02-19T19:10:01.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.057+0000 7feed1237700 1 -- 172.21.15.96:0/4039493201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feecc1a2fb0 con 0x7feecc0ffda0 2024-02-19T19:10:01.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.057+0000 7feeb3fff700 1 -- 172.21.15.96:0/4039493201 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feebc017610 con 0x7feecc0ffda0 2024-02-19T19:10:01.080 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.058+0000 7feed1237700 1 -- 172.21.15.96:0/4039493201 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feecc04f2e0 con 0x7feecc0ffda0 2024-02-19T19:10:01.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.059+0000 7feeb3fff700 1 -- 172.21.15.96:0/4039493201 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7feebc00f5d0 con 0x7feecc0ffda0 2024-02-19T19:10:01.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.059+0000 7feeb3fff700 1 --2- 172.21.15.96:0/4039493201 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7feeb406d8a0 0x7feeb406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:01.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.059+0000 7feeb3fff700 1 -- 172.21.15.96:0/4039493201 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6414+0+0 (secure 0 0 0) 0x7feebc08ea40 con 0x7feecc0ffda0 2024-02-19T19:10:01.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.059+0000 7feeca59c700 1 --2- 172.21.15.96:0/4039493201 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7feeb406d8a0 0x7feeb406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:01.081 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.060+0000 7feeca59c700 1 --2- 172.21.15.96:0/4039493201 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7feeb406d8a0 0x7feeb406fd60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feecc103030 tx=0x7feec0009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:01.085 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.064+0000 7feeb3fff700 1 -- 172.21.15.96:0/4039493201 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7feebc058200 con 0x7feecc0ffda0 2024-02-19T19:10:01.305 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.283+0000 7feed1237700 1 -- 172.21.15.96:0/4039493201 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feecc068e50 con 0x7feeb406d8a0 2024-02-19T19:10:01.316 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.295+0000 7feeb3fff700 1 -- 172.21.15.96:0/4039493201 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7feecc068e50 con 0x7feeb406d8a0 2024-02-19T19:10:01.316 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:10:01.316 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4m) 22s ago 13m 26.0M - 0.25.0 c8568f914cd2 bbaf83a1e476 2024-02-19T19:10:01.317 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (14m) 22s ago 14m 8178k - 18.2.1 94eadd990e0a b41bff2e0043 2024-02-19T19:10:01.317 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (12m) 46s ago 12m 8044k - 18.2.1 94eadd990e0a 254ab7e7a040 2024-02-19T19:10:01.317 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (55s) 22s ago 14m 6669k - 19.0.0-1450-gf78a58c0 f081f847070a deea0ffefa0f 2024-02-19T19:10:01.317 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (50s) 46s ago 12m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 3421965dc5b0 2024-02-19T19:10:01.317 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (3m) 22s ago 13m 87.1M - 9.4.12 a0ea5e3c46d9 0102d90938e4 2024-02-19T19:10:01.317 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (8m) 22s ago 8m 27.3M - 18.2.1 94eadd990e0a 0a61d9cd40d1 2024-02-19T19:10:01.317 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (8m) 22s ago 8m 24.2M - 18.2.1 94eadd990e0a 58db3e7a7d75 2024-02-19T19:10:01.317 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (8m) 46s ago 8m 28.4M - 18.2.1 94eadd990e0a 211d64de8a63 2024-02-19T19:10:01.317 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (8m) 46s ago 8m 26.5M - 18.2.1 94eadd990e0a 2a04b5a8eaf4 2024-02-19T19:10:01.317 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:8443,9283,8765 running (5m) 22s ago 15m 498M - 19.0.0-1450-gf78a58c0 f081f847070a a86fbe94fe3f 2024-02-19T19:10:01.317 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (5m) 46s ago 12m 448M - 19.0.0-1450-gf78a58c0 f081f847070a e250486d572d 2024-02-19T19:10:01.317 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2m) 22s ago 15m 46.9M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d70090d516e3 2024-02-19T19:10:01.318 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (99s) 46s ago 12m 36.7M 2048M 19.0.0-1450-gf78a58c0 f081f847070a f56b17bdc9a0 2024-02-19T19:10:01.318 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (4m) 22s ago 13m 15.7M - 1.5.0 0da6a335fe13 51f622ea33d6 2024-02-19T19:10:01.318 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (4m) 46s ago 12m 17.2M - 1.5.0 0da6a335fe13 464e076a52a1 2024-02-19T19:10:01.318 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (27s) 22s ago 11m 15.1M 1216M 19.0.0-1450-gf78a58c0 f081f847070a b3dffd6a3fb2 2024-02-19T19:10:01.318 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (11m) 22s ago 11m 52.4M 1216M 18.2.1 94eadd990e0a 40329d59be45 2024-02-19T19:10:01.318 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (10m) 22s ago 10m 49.4M 1216M 18.2.1 94eadd990e0a 4f1e49db2d41 2024-02-19T19:10:01.318 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (10m) 46s ago 10m 51.9M 2240M 18.2.1 94eadd990e0a 4746b79351fc 2024-02-19T19:10:01.318 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (10m) 46s ago 10m 51.2M 2240M 18.2.1 94eadd990e0a 2b3f0088f6b2 2024-02-19T19:10:01.318 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (9m) 46s ago 9m 48.0M 2240M 18.2.1 94eadd990e0a e5731974b46a 2024-02-19T19:10:01.318 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (4m) 22s ago 13m 62.7M - 2.43.0 a07b618ecd1d a4edcf6ed669 2024-02-19T19:10:01.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.297+0000 7feed1237700 1 -- 172.21.15.96:0/4039493201 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7feeb406d8a0 msgr2=0x7feeb406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:01.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.297+0000 7feed1237700 1 --2- 172.21.15.96:0/4039493201 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7feeb406d8a0 0x7feeb406fd60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7feecc103030 tx=0x7feec0009190 comp rx=0 tx=0).stop 2024-02-19T19:10:01.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.297+0000 7feed1237700 1 -- 172.21.15.96:0/4039493201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feecc0ffda0 msgr2=0x7feecc101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:01.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.297+0000 7feed1237700 1 --2- 172.21.15.96:0/4039493201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feecc0ffda0 0x7feecc101840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feebc006010 tx=0x7feebc00bd70 comp rx=0 tx=0).stop 2024-02-19T19:10:01.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.298+0000 7feed1237700 1 -- 172.21.15.96:0/4039493201 shutdown_connections 2024-02-19T19:10:01.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.298+0000 7feed1237700 1 --2- 172.21.15.96:0/4039493201 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7feeb406d8a0 0x7feeb406fd60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:01.319 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.298+0000 7feed1237700 1 --2- 172.21.15.96:0/4039493201 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feecc0ffda0 0x7feecc101840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:01.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.298+0000 7feed1237700 1 --2- 172.21.15.96:0/4039493201 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feecc100750 0x7feecc101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:01.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.298+0000 7feed1237700 1 -- 172.21.15.96:0/4039493201 >> 172.21.15.96:0/4039493201 conn(0x7feecc0fb650 msgr2=0x7feecc104090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:01.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.298+0000 7feed1237700 1 -- 172.21.15.96:0/4039493201 shutdown_connections 2024-02-19T19:10:01.320 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.298+0000 7feed1237700 1 -- 172.21.15.96:0/4039493201 wait complete. 2024-02-19T19:10:01.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.404+0000 7f0372cbd700 1 -- 172.21.15.96:0/1396135622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f036c105bd0 msgr2=0x7f036c105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:01.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.404+0000 7f0372cbd700 1 --2- 172.21.15.96:0/1396135622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f036c105bd0 0x7f036c105fb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0360009910 tx=0x7f0360009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:01.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.405+0000 7f0372cbd700 1 -- 172.21.15.96:0/1396135622 shutdown_connections 2024-02-19T19:10:01.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.405+0000 7f0372cbd700 1 --2- 172.21.15.96:0/1396135622 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f036c0ffc20 0x7f036c100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:01.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.405+0000 7f0372cbd700 1 --2- 172.21.15.96:0/1396135622 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f036c105bd0 0x7f036c105fb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:01.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.405+0000 7f0372cbd700 1 -- 172.21.15.96:0/1396135622 >> 172.21.15.96:0/1396135622 conn(0x7f036c075670 msgr2=0x7f036c075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:01.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.405+0000 7f0372cbd700 1 -- 172.21.15.96:0/1396135622 shutdown_connections 2024-02-19T19:10:01.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.405+0000 7f0372cbd700 1 -- 172.21.15.96:0/1396135622 wait complete. 2024-02-19T19:10:01.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.405+0000 7f0372cbd700 1 Processor -- start 2024-02-19T19:10:01.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.405+0000 7f0372cbd700 1 -- start start 2024-02-19T19:10:01.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.405+0000 7f0372cbd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f036c0ffc20 0x7f036c196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:01.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.405+0000 7f0372cbd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f036c105bd0 0x7f036c196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:01.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.405+0000 7f0372cbd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c197530 con 0x7f036c105bd0 2024-02-19T19:10:01.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.405+0000 7f0372cbd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036c19b340 con 0x7f036c0ffc20 2024-02-19T19:10:01.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.406+0000 7f036bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f036c105bd0 0x7f036c196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:01.430 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.406+0000 7f036bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f036c105bd0 0x7f036c196ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53988/0 (socket says 172.21.15.96:53988) 2024-02-19T19:10:01.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.406+0000 7f036bfff700 1 -- 172.21.15.96:0/2100373175 learned_addr learned my addr 172.21.15.96:0/2100373175 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:10:01.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.406+0000 7f0370a59700 1 --2- 172.21.15.96:0/2100373175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f036c0ffc20 0x7f036c196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:01.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.406+0000 7f036bfff700 1 -- 172.21.15.96:0/2100373175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f036c0ffc20 msgr2=0x7f036c196960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:01.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.406+0000 7f036bfff700 1 --2- 172.21.15.96:0/2100373175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f036c0ffc20 0x7f036c196960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:01.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.406+0000 7f036bfff700 1 -- 172.21.15.96:0/2100373175 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03600095f0 con 0x7f036c105bd0 2024-02-19T19:10:01.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.406+0000 7f036bfff700 1 --2- 172.21.15.96:0/2100373175 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f036c105bd0 0x7f036c196ea0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f035800b4b0 tx=0x7f035800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:01.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.406+0000 7f0369ffb700 1 -- 172.21.15.96:0/2100373175 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0358011800 con 0x7f036c105bd0 2024-02-19T19:10:01.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.406+0000 7f0369ffb700 1 -- 172.21.15.96:0/2100373175 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0358011e20 con 0x7f036c105bd0 2024-02-19T19:10:01.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.406+0000 7f0372cbd700 1 -- 172.21.15.96:0/2100373175 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f036c19b620 con 0x7f036c105bd0 2024-02-19T19:10:01.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.406+0000 7f0369ffb700 1 -- 172.21.15.96:0/2100373175 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f035800f2e0 con 0x7f036c105bd0 2024-02-19T19:10:01.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.407+0000 7f0372cbd700 1 -- 172.21.15.96:0/2100373175 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f036c19bb70 con 0x7f036c105bd0 2024-02-19T19:10:01.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.408+0000 7f0372cbd700 1 -- 172.21.15.96:0/2100373175 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f036c04f2e0 con 0x7f036c105bd0 2024-02-19T19:10:01.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.408+0000 7f0369ffb700 1 -- 172.21.15.96:0/2100373175 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f0358010380 con 0x7f036c105bd0 2024-02-19T19:10:01.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.409+0000 7f0369ffb700 1 --2- 172.21.15.96:0/2100373175 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f035c06d8a0 0x7f035c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:01.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.409+0000 7f0369ffb700 1 -- 172.21.15.96:0/2100373175 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f035808cef0 con 0x7f036c105bd0 2024-02-19T19:10:01.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.409+0000 7f0370a59700 1 --2- 172.21.15.96:0/2100373175 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f035c06d8a0 0x7f035c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:01.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.409+0000 7f0370a59700 1 --2- 172.21.15.96:0/2100373175 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f035c06d8a0 0x7f035c06fd60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0360006010 tx=0x7f036001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:01.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.413+0000 7f0369ffb700 1 -- 172.21.15.96:0/2100373175 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f035805a300 con 0x7f036c105bd0 2024-02-19T19:10:01.733 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.712+0000 7f0372cbd700 1 -- 172.21.15.96:0/2100373175 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f036c19be40 con 0x7f036c105bd0 2024-02-19T19:10:01.734 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.712+0000 7f0369ffb700 1 -- 172.21.15.96:0/2100373175 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f0358059e90 con 0x7f036c105bd0 2024-02-19T19:10:01.734 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:10:01.734 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:10:01.734 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:10:01.734 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:10:01.734 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:10:01.735 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:10:01.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:10:01.735 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:10:01.735 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 5, 2024-02-19T19:10:01.735 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 1 2024-02-19T19:10:01.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:10:01.735 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:10:01.735 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-19T19:10:01.735 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:10:01.735 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:10:01.735 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 9, 2024-02-19T19:10:01.735 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 5 2024-02-19T19:10:01.735 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:10:01.735 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:10:01.736 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.715+0000 7f0372cbd700 1 -- 172.21.15.96:0/2100373175 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f035c06d8a0 msgr2=0x7f035c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:01.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.715+0000 7f0372cbd700 1 --2- 172.21.15.96:0/2100373175 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f035c06d8a0 0x7f035c06fd60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0360006010 tx=0x7f036001a040 comp rx=0 tx=0).stop 2024-02-19T19:10:01.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.715+0000 7f0372cbd700 1 -- 172.21.15.96:0/2100373175 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f036c105bd0 msgr2=0x7f036c196ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:01.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.715+0000 7f0372cbd700 1 --2- 172.21.15.96:0/2100373175 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f036c105bd0 0x7f036c196ea0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f035800b4b0 tx=0x7f035800b7c0 comp rx=0 tx=0).stop 2024-02-19T19:10:01.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.715+0000 7f0372cbd700 1 -- 172.21.15.96:0/2100373175 shutdown_connections 2024-02-19T19:10:01.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.715+0000 7f0372cbd700 1 --2- 172.21.15.96:0/2100373175 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f035c06d8a0 0x7f035c06fd60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:01.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.715+0000 7f0372cbd700 1 --2- 172.21.15.96:0/2100373175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f036c0ffc20 0x7f036c196960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:01.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.715+0000 7f0372cbd700 1 --2- 172.21.15.96:0/2100373175 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f036c105bd0 0x7f036c196ea0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:01.737 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.715+0000 7f0372cbd700 1 -- 172.21.15.96:0/2100373175 >> 172.21.15.96:0/2100373175 conn(0x7f036c075670 msgr2=0x7f036c103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:01.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.715+0000 7f0372cbd700 1 -- 172.21.15.96:0/2100373175 shutdown_connections 2024-02-19T19:10:01.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.715+0000 7f0372cbd700 1 -- 172.21.15.96:0/2100373175 wait complete. 2024-02-19T19:10:01.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.822+0000 7ff7b4aa3700 1 -- 172.21.15.96:0/2424851125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7b00ffda0 msgr2=0x7ff7b0100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:01.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.822+0000 7ff7b4aa3700 1 --2- 172.21.15.96:0/2424851125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7b00ffda0 0x7ff7b0100180 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0009910 tx=0x7ff7a0009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:01.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.822+0000 7ff7b4aa3700 1 -- 172.21.15.96:0/2424851125 shutdown_connections 2024-02-19T19:10:01.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.822+0000 7ff7b4aa3700 1 --2- 172.21.15.96:0/2424851125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7b0100750 0x7ff7b01047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:01.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.822+0000 7ff7b4aa3700 1 --2- 172.21.15.96:0/2424851125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7b00ffda0 0x7ff7b0100180 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:01.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.822+0000 7ff7b4aa3700 1 -- 172.21.15.96:0/2424851125 >> 172.21.15.96:0/2424851125 conn(0x7ff7b00fb650 msgr2=0x7ff7b00fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:01.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.823+0000 7ff7b4aa3700 1 -- 172.21.15.96:0/2424851125 shutdown_connections 2024-02-19T19:10:01.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.823+0000 7ff7b4aa3700 1 -- 172.21.15.96:0/2424851125 wait complete. 2024-02-19T19:10:01.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.823+0000 7ff7b4aa3700 1 Processor -- start 2024-02-19T19:10:01.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.823+0000 7ff7b4aa3700 1 -- start start 2024-02-19T19:10:01.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.823+0000 7ff7b4aa3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7b00ffda0 0x7ff7b019e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:01.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.823+0000 7ff7b4aa3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7b0100750 0x7ff7b019ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:01.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.823+0000 7ff7b4aa3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b019f410 con 0x7ff7b00ffda0 2024-02-19T19:10:01.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.823+0000 7ff7b4aa3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b01988c0 con 0x7ff7b0100750 2024-02-19T19:10:01.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.824+0000 7ff7ae59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7b00ffda0 0x7ff7b019e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:01.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.824+0000 7ff7ae59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7b00ffda0 0x7ff7b019e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54010/0 (socket says 172.21.15.96:54010) 2024-02-19T19:10:01.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.824+0000 7ff7ae59c700 1 -- 172.21.15.96:0/2773210005 learned_addr learned my addr 172.21.15.96:0/2773210005 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:10:01.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.824+0000 7ff7add9b700 1 --2- 172.21.15.96:0/2773210005 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7b0100750 0x7ff7b019ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:01.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.824+0000 7ff7ae59c700 1 -- 172.21.15.96:0/2773210005 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7b0100750 msgr2=0x7ff7b019ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:01.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.824+0000 7ff7ae59c700 1 --2- 172.21.15.96:0/2773210005 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7b0100750 0x7ff7b019ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:01.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.824+0000 7ff7ae59c700 1 -- 172.21.15.96:0/2773210005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a00095f0 con 0x7ff7b00ffda0 2024-02-19T19:10:01.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.824+0000 7ff7ae59c700 1 --2- 172.21.15.96:0/2773210005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7b00ffda0 0x7ff7b019e840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0006010 tx=0x7ff7a000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:01.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.824+0000 7ff79f7fe700 1 -- 172.21.15.96:0/2773210005 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a001d070 con 0x7ff7b00ffda0 2024-02-19T19:10:01.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.824+0000 7ff79f7fe700 1 -- 172.21.15.96:0/2773210005 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff7a0005dc0 con 0x7ff7b00ffda0 2024-02-19T19:10:01.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.824+0000 7ff7b4aa3700 1 -- 172.21.15.96:0/2773210005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b0198b40 con 0x7ff7b00ffda0 2024-02-19T19:10:01.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.824+0000 7ff79f7fe700 1 -- 172.21.15.96:0/2773210005 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a0017400 con 0x7ff7b00ffda0 2024-02-19T19:10:01.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.824+0000 7ff7b4aa3700 1 -- 172.21.15.96:0/2773210005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b0199030 con 0x7ff7b00ffda0 2024-02-19T19:10:01.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.825+0000 7ff7b4aa3700 1 -- 172.21.15.96:0/2773210005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b004f2e0 con 0x7ff7b00ffda0 2024-02-19T19:10:01.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.826+0000 7ff79f7fe700 1 -- 172.21.15.96:0/2773210005 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7ff7a0003a60 con 0x7ff7b00ffda0 2024-02-19T19:10:01.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.826+0000 7ff79f7fe700 1 --2- 172.21.15.96:0/2773210005 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff79806d8a0 0x7ff79806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:01.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.826+0000 7ff79f7fe700 1 -- 172.21.15.96:0/2773210005 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff7a008e920 con 0x7ff7b00ffda0 2024-02-19T19:10:01.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.826+0000 7ff7add9b700 1 --2- 172.21.15.96:0/2773210005 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff79806d8a0 0x7ff79806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:01.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.827+0000 7ff7add9b700 1 --2- 172.21.15.96:0/2773210005 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff79806d8a0 0x7ff79806fd60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff7b01066b0 tx=0x7ff7a400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:01.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:01.831+0000 7ff79f7fe700 1 -- 172.21.15.96:0/2773210005 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff7a005bcb0 con 0x7ff7b00ffda0 2024-02-19T19:10:02.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.087+0000 7ff7b4aa3700 1 -- 172.21.15.96:0/2773210005 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff7b0199310 con 0x7ff7b00ffda0 2024-02-19T19:10:02.109 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.088+0000 7ff79f7fe700 1 -- 172.21.15.96:0/2773210005 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1869 (secure 0 0 0) 0x7ff7a005b840 con 0x7ff7b00ffda0 2024-02-19T19:10:02.109 INFO:teuthology.orchestra.run.smithi096.stdout:e19 2024-02-19T19:10:02.110 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:10:02.110 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:10:02.110 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2024-02-19T19:10:02.110 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:10:02.110 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:10:02.110 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2024-02-19T19:10:02.110 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 19 2024-02-19T19:10:02.110 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-19T19:10:02.110 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-02-19T19:01:42.881136+0000 2024-02-19T19:10:02.110 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2024-02-19T19:02:02.873590+0000 2024-02-19T19:10:02.110 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2024-02-19T19:10:02.110 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2024-02-19T19:10:02.110 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2024-02-19T19:10:02.110 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2024-02-19T19:10:02.111 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2024-02-19T19:10:02.111 INFO:teuthology.orchestra.run.smithi096.stdout:max_xattr_size 65536 2024-02-19T19:10:02.111 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2024-02-19T19:10:02.111 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2024-02-19T19:10:02.111 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 46 2024-02-19T19:10:02.111 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:10:02.111 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2024-02-19T19:10:02.111 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2024-02-19T19:10:02.111 INFO:teuthology.orchestra.run.smithi096.stdout:up {0=14490,1=24267} 2024-02-19T19:10:02.111 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2024-02-19T19:10:02.111 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2024-02-19T19:10:02.111 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2024-02-19T19:10:02.111 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2024-02-19T19:10:02.111 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2024-02-19T19:10:02.111 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data enabled 2024-02-19T19:10:02.112 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2024-02-19T19:10:02.112 INFO:teuthology.orchestra.run.smithi096.stdout:bal_rank_mask -1 2024-02-19T19:10:02.112 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2024-02-19T19:10:02.112 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pccmys{0:14490} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:10:02.112 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.usrmcg{0:14502} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/413113741,v1:172.21.15.96:6827/413113741] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:10:02.112 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.srnlol{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.125:6824/3084054986,v1:172.21.15.125:6825/3084054986] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:10:02.112 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.pwyuga{1:24275} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.125:6826/3098247423,v1:172.21.15.125:6827/3098247423] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:10:02.112 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:10:02.112 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:10:02.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.090+0000 7ff7b4aa3700 1 -- 172.21.15.96:0/2773210005 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff79806d8a0 msgr2=0x7ff79806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:02.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.090+0000 7ff7b4aa3700 1 --2- 172.21.15.96:0/2773210005 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff79806d8a0 0x7ff79806fd60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff7b01066b0 tx=0x7ff7a400b410 comp rx=0 tx=0).stop 2024-02-19T19:10:02.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.090+0000 7ff7b4aa3700 1 -- 172.21.15.96:0/2773210005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7b00ffda0 msgr2=0x7ff7b019e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:02.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.090+0000 7ff7b4aa3700 1 --2- 172.21.15.96:0/2773210005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7b00ffda0 0x7ff7b019e840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff7a0006010 tx=0x7ff7a000bd70 comp rx=0 tx=0).stop 2024-02-19T19:10:02.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.090+0000 7ff7b4aa3700 1 -- 172.21.15.96:0/2773210005 shutdown_connections 2024-02-19T19:10:02.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.090+0000 7ff7b4aa3700 1 --2- 172.21.15.96:0/2773210005 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff79806d8a0 0x7ff79806fd60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:02.113 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.090+0000 7ff7b4aa3700 1 --2- 172.21.15.96:0/2773210005 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7b00ffda0 0x7ff7b019e840 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:02.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.090+0000 7ff7b4aa3700 1 --2- 172.21.15.96:0/2773210005 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7b0100750 0x7ff7b019ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:02.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.090+0000 7ff7b4aa3700 1 -- 172.21.15.96:0/2773210005 >> 172.21.15.96:0/2773210005 conn(0x7ff7b00fb650 msgr2=0x7ff7b0103eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:02.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.090+0000 7ff7b4aa3700 1 -- 172.21.15.96:0/2773210005 shutdown_connections 2024-02-19T19:10:02.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.090+0000 7ff7b4aa3700 1 -- 172.21.15.96:0/2773210005 wait complete. 2024-02-19T19:10:02.114 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 19 2024-02-19T19:10:02.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.196+0000 7f3a236e9700 1 -- 172.21.15.96:0/1829285456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a1c100750 msgr2=0x7f3a1c1047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:02.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.196+0000 7f3a236e9700 1 --2- 172.21.15.96:0/1829285456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a1c100750 0x7f3a1c1047a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009910 tx=0x7f3a0c009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:02.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.196+0000 7f3a236e9700 1 -- 172.21.15.96:0/1829285456 shutdown_connections 2024-02-19T19:10:02.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.196+0000 7f3a236e9700 1 --2- 172.21.15.96:0/1829285456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a1c100750 0x7f3a1c1047a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:02.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.196+0000 7f3a236e9700 1 --2- 172.21.15.96:0/1829285456 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a1c0ffda0 0x7f3a1c100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:02.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.196+0000 7f3a236e9700 1 -- 172.21.15.96:0/1829285456 >> 172.21.15.96:0/1829285456 conn(0x7f3a1c0fb650 msgr2=0x7f3a1c0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:02.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.196+0000 7f3a236e9700 1 -- 172.21.15.96:0/1829285456 shutdown_connections 2024-02-19T19:10:02.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.196+0000 7f3a236e9700 1 -- 172.21.15.96:0/1829285456 wait complete. 2024-02-19T19:10:02.218 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:02 smithi096 ceph-mon[112483]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:02.218 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:02 smithi096 ceph-mon[112483]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:02.218 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:02 smithi096 ceph-mon[112483]: Upgrade: Updating osd.1 2024-02-19T19:10:02.219 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:02 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:02.219 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:02 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-19T19:10:02.219 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:02 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:10:02.219 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:02 smithi096 ceph-mon[112483]: Deploying daemon osd.1 on smithi096 2024-02-19T19:10:02.219 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:02 smithi096 ceph-mon[112483]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:02.219 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:02 smithi096 ceph-mon[112483]: pgmap v66: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:10:02.219 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:02 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/2100373175' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:02.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.197+0000 7f3a236e9700 1 Processor -- start 2024-02-19T19:10:02.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.197+0000 7f3a236e9700 1 -- start start 2024-02-19T19:10:02.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.197+0000 7f3a236e9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a1c0ffda0 0x7f3a1c19e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:02.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.197+0000 7f3a236e9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a1c100750 0x7f3a1c19edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:02.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.197+0000 7f3a236e9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c19f450 con 0x7f3a1c100750 2024-02-19T19:10:02.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.197+0000 7f3a236e9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c198900 con 0x7f3a1c0ffda0 2024-02-19T19:10:02.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.197+0000 7f3a20c84700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a1c100750 0x7f3a1c19edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:02.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.197+0000 7f3a20c84700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a1c100750 0x7f3a1c19edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54018/0 (socket says 172.21.15.96:54018) 2024-02-19T19:10:02.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.197+0000 7f3a20c84700 1 -- 172.21.15.96:0/3317216049 learned_addr learned my addr 172.21.15.96:0/3317216049 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:10:02.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.197+0000 7f3a21485700 1 --2- 172.21.15.96:0/3317216049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a1c0ffda0 0x7f3a1c19e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:02.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.197+0000 7f3a20c84700 1 -- 172.21.15.96:0/3317216049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a1c0ffda0 msgr2=0x7f3a1c19e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.197+0000 7f3a20c84700 1 --2- 172.21.15.96:0/3317216049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a1c0ffda0 0x7f3a1c19e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.197+0000 7f3a20c84700 1 -- 172.21.15.96:0/3317216049 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a0c0095f0 con 0x7f3a1c100750 2024-02-19T19:10:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.197+0000 7f3a21485700 1 --2- 172.21.15.96:0/3317216049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a1c0ffda0 0x7f3a1c19e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:10:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.197+0000 7f3a20c84700 1 --2- 172.21.15.96:0/3317216049 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a1c100750 0x7f3a1c19edc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00bda0 tx=0x7f3a0c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.197+0000 7f3a127fc700 1 -- 172.21.15.96:0/3317216049 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a0c01d070 con 0x7f3a1c100750 2024-02-19T19:10:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.198+0000 7f3a236e9700 1 -- 172.21.15.96:0/3317216049 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1c198b80 con 0x7f3a1c100750 2024-02-19T19:10:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.198+0000 7f3a127fc700 1 -- 172.21.15.96:0/3317216049 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a0c00f460 con 0x7f3a1c100750 2024-02-19T19:10:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.198+0000 7f3a127fc700 1 -- 172.21.15.96:0/3317216049 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a0c017630 con 0x7f3a1c100750 2024-02-19T19:10:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.198+0000 7f3a236e9700 1 -- 172.21.15.96:0/3317216049 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1c199070 con 0x7f3a1c100750 2024-02-19T19:10:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.199+0000 7f3a236e9700 1 -- 172.21.15.96:0/3317216049 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1c04f2e0 con 0x7f3a1c100750 2024-02-19T19:10:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.199+0000 7f3a127fc700 1 -- 172.21.15.96:0/3317216049 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f3a0c003a60 con 0x7f3a1c100750 2024-02-19T19:10:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.199+0000 7f3a127fc700 1 --2- 172.21.15.96:0/3317216049 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f3a0806d690 0x7f3a0806fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.199+0000 7f3a127fc700 1 -- 172.21.15.96:0/3317216049 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3a0c08e890 con 0x7f3a1c100750 2024-02-19T19:10:02.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.199+0000 7f3a21485700 1 --2- 172.21.15.96:0/3317216049 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f3a0806d690 0x7f3a0806fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:02.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.200+0000 7f3a21485700 1 --2- 172.21.15.96:0/3317216049 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f3a0806d690 0x7f3a0806fb50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3a18005950 tx=0x7f3a180058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:02.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.204+0000 7f3a127fc700 1 -- 172.21.15.96:0/3317216049 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3a0c05bc20 con 0x7f3a1c100750 2024-02-19T19:10:02.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.423+0000 7f3a236e9700 1 -- 172.21.15.96:0/3317216049 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a1c1992b0 con 0x7f3a0806d690 2024-02-19T19:10:02.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.425+0000 7f3a127fc700 1 -- 172.21.15.96:0/3317216049 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3a1c1992b0 con 0x7f3a0806d690 2024-02-19T19:10:02.448 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:10:02.448 INFO:teuthology.orchestra.run.smithi096.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:10:02.448 INFO:teuthology.orchestra.run.smithi096.stdout: "in_progress": true, 2024-02-19T19:10:02.448 INFO:teuthology.orchestra.run.smithi096.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:10:02.448 INFO:teuthology.orchestra.run.smithi096.stdout: "services_complete": [ 2024-02-19T19:10:02.448 INFO:teuthology.orchestra.run.smithi096.stdout: "crash", 2024-02-19T19:10:02.448 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr", 2024-02-19T19:10:02.448 INFO:teuthology.orchestra.run.smithi096.stdout: "mon" 2024-02-19T19:10:02.449 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-02-19T19:10:02.449 INFO:teuthology.orchestra.run.smithi096.stdout: "progress": "7/23 daemons upgraded", 2024-02-19T19:10:02.449 INFO:teuthology.orchestra.run.smithi096.stdout: "message": "Currently upgrading osd daemons", 2024-02-19T19:10:02.449 INFO:teuthology.orchestra.run.smithi096.stdout: "is_paused": false 2024-02-19T19:10:02.449 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:10:02.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.427+0000 7f3a236e9700 1 -- 172.21.15.96:0/3317216049 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f3a0806d690 msgr2=0x7f3a0806fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:02.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.427+0000 7f3a236e9700 1 --2- 172.21.15.96:0/3317216049 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f3a0806d690 0x7f3a0806fb50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3a18005950 tx=0x7f3a180058e0 comp rx=0 tx=0).stop 2024-02-19T19:10:02.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.427+0000 7f3a236e9700 1 -- 172.21.15.96:0/3317216049 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a1c100750 msgr2=0x7f3a1c19edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:02.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.427+0000 7f3a236e9700 1 --2- 172.21.15.96:0/3317216049 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a1c100750 0x7f3a1c19edc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00bda0 tx=0x7f3a0c00be80 comp rx=0 tx=0).stop 2024-02-19T19:10:02.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.427+0000 7f3a236e9700 1 -- 172.21.15.96:0/3317216049 shutdown_connections 2024-02-19T19:10:02.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.427+0000 7f3a236e9700 1 --2- 172.21.15.96:0/3317216049 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f3a0806d690 0x7f3a0806fb50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:02.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.427+0000 7f3a236e9700 1 --2- 172.21.15.96:0/3317216049 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3a1c0ffda0 0x7f3a1c19e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:02.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.427+0000 7f3a236e9700 1 --2- 172.21.15.96:0/3317216049 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3a1c100750 0x7f3a1c19edc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:02.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.427+0000 7f3a236e9700 1 -- 172.21.15.96:0/3317216049 >> 172.21.15.96:0/3317216049 conn(0x7f3a1c0fb650 msgr2=0x7f3a1c103780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:02.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.427+0000 7f3a236e9700 1 -- 172.21.15.96:0/3317216049 shutdown_connections 2024-02-19T19:10:02.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.427+0000 7f3a236e9700 1 -- 172.21.15.96:0/3317216049 wait complete. 2024-02-19T19:10:02.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:02 smithi125 ceph-mon[86115]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:02.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:02 smithi125 ceph-mon[86115]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:02.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:02 smithi125 ceph-mon[86115]: Upgrade: Updating osd.1 2024-02-19T19:10:02.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:02 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:02.453 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:02 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-19T19:10:02.453 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:02 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:10:02.453 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:02 smithi125 ceph-mon[86115]: Deploying daemon osd.1 on smithi096 2024-02-19T19:10:02.453 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:02 smithi125 ceph-mon[86115]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:02.453 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:02 smithi125 ceph-mon[86115]: pgmap v66: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:10:02.453 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:02 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/2100373175' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:02.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.532+0000 7fc319b09700 1 -- 172.21.15.96:0/2192922852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc314105bd0 msgr2=0x7fc314105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:02.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.532+0000 7fc319b09700 1 --2- 172.21.15.96:0/2192922852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc314105bd0 0x7fc314105fb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00b0a0 tx=0x7fc30c00b3b0 comp rx=0 tx=0).stop 2024-02-19T19:10:02.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.532+0000 7fc319b09700 1 -- 172.21.15.96:0/2192922852 shutdown_connections 2024-02-19T19:10:02.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.532+0000 7fc319b09700 1 --2- 172.21.15.96:0/2192922852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3140ffc20 0x7fc314100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:02.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.532+0000 7fc319b09700 1 --2- 172.21.15.96:0/2192922852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc314105bd0 0x7fc314105fb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:02.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.532+0000 7fc319b09700 1 -- 172.21.15.96:0/2192922852 >> 172.21.15.96:0/2192922852 conn(0x7fc314075670 msgr2=0x7fc314075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:02.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.532+0000 7fc319b09700 1 -- 172.21.15.96:0/2192922852 shutdown_connections 2024-02-19T19:10:02.554 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.532+0000 7fc319b09700 1 -- 172.21.15.96:0/2192922852 wait complete. 2024-02-19T19:10:02.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.533+0000 7fc319b09700 1 Processor -- start 2024-02-19T19:10:02.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.533+0000 7fc319b09700 1 -- start start 2024-02-19T19:10:02.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.533+0000 7fc319b09700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3140ffc20 0x7fc31419c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:02.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.533+0000 7fc319b09700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc314105bd0 0x7fc31419cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:02.556 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.533+0000 7fc319b09700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31419d1f0 con 0x7fc314105bd0 2024-02-19T19:10:02.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.533+0000 7fc319b09700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3141966a0 con 0x7fc3140ffc20 2024-02-19T19:10:02.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.533+0000 7fc312ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc314105bd0 0x7fc31419cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:02.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.533+0000 7fc312ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc314105bd0 0x7fc31419cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54034/0 (socket says 172.21.15.96:54034) 2024-02-19T19:10:02.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.533+0000 7fc312ffd700 1 -- 172.21.15.96:0/1718483710 learned_addr learned my addr 172.21.15.96:0/1718483710 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:10:02.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.533+0000 7fc312ffd700 1 -- 172.21.15.96:0/1718483710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3140ffc20 msgr2=0x7fc31419c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:02.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.533+0000 7fc3137fe700 1 --2- 172.21.15.96:0/1718483710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3140ffc20 0x7fc31419c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:02.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.533+0000 7fc312ffd700 1 --2- 172.21.15.96:0/1718483710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3140ffc20 0x7fc31419c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:02.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.533+0000 7fc312ffd700 1 -- 172.21.15.96:0/1718483710 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c009d00 con 0x7fc314105bd0 2024-02-19T19:10:02.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.534+0000 7fc3137fe700 1 --2- 172.21.15.96:0/1718483710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3140ffc20 0x7fc31419c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:10:02.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.534+0000 7fc312ffd700 1 --2- 172.21.15.96:0/1718483710 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc314105bd0 0x7fc31419cb60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00c8a0 tx=0x7fc2fc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:02.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.534+0000 7fc310ff9700 1 -- 172.21.15.96:0/1718483710 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2fc00cea0 con 0x7fc314105bd0 2024-02-19T19:10:02.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.534+0000 7fc310ff9700 1 -- 172.21.15.96:0/1718483710 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2fc004830 con 0x7fc314105bd0 2024-02-19T19:10:02.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.534+0000 7fc310ff9700 1 -- 172.21.15.96:0/1718483710 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2fc0055b0 con 0x7fc314105bd0 2024-02-19T19:10:02.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.534+0000 7fc319b09700 1 -- 172.21.15.96:0/1718483710 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc314196980 con 0x7fc314105bd0 2024-02-19T19:10:02.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.534+0000 7fc319b09700 1 -- 172.21.15.96:0/1718483710 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc314196ed0 con 0x7fc314105bd0 2024-02-19T19:10:02.557 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.535+0000 7fc319b09700 1 -- 172.21.15.96:0/1718483710 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31404f2e0 con 0x7fc314105bd0 2024-02-19T19:10:02.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.535+0000 7fc310ff9700 1 -- 172.21.15.96:0/1718483710 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fc2fc0049a0 con 0x7fc314105bd0 2024-02-19T19:10:02.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.536+0000 7fc310ff9700 1 --2- 172.21.15.96:0/1718483710 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc30006d8a0 0x7fc30006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:02.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.536+0000 7fc310ff9700 1 -- 172.21.15.96:0/1718483710 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc2fc08d120 con 0x7fc314105bd0 2024-02-19T19:10:02.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.536+0000 7fc3137fe700 1 --2- 172.21.15.96:0/1718483710 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc30006d8a0 0x7fc30006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:02.558 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.536+0000 7fc3137fe700 1 --2- 172.21.15.96:0/1718483710 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc30006d8a0 0x7fc30006fd60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009480 tx=0x7fc30c006000 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:02.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.540+0000 7fc310ff9700 1 -- 172.21.15.96:0/1718483710 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc2fc05a4b0 con 0x7fc314105bd0 2024-02-19T19:10:02.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.820+0000 7fc319b09700 1 -- 172.21.15.96:0/1718483710 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc3141971a0 con 0x7fc314105bd0 2024-02-19T19:10:02.842 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.820+0000 7fc310ff9700 1 -- 172.21.15.96:0/1718483710 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7fc2fc004c50 con 0x7fc314105bd0 2024-02-19T19:10:02.842 INFO:teuthology.orchestra.run.smithi096.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T19:10:02.842 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-19T19:10:02.842 INFO:teuthology.orchestra.run.smithi096.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-19T19:10:02.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.822+0000 7fc319b09700 1 -- 172.21.15.96:0/1718483710 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc30006d8a0 msgr2=0x7fc30006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:02.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.822+0000 7fc319b09700 1 --2- 172.21.15.96:0/1718483710 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc30006d8a0 0x7fc30006fd60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009480 tx=0x7fc30c006000 comp rx=0 tx=0).stop 2024-02-19T19:10:02.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.822+0000 7fc319b09700 1 -- 172.21.15.96:0/1718483710 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc314105bd0 msgr2=0x7fc31419cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:02.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.822+0000 7fc319b09700 1 --2- 172.21.15.96:0/1718483710 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc314105bd0 0x7fc31419cb60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc00c8a0 tx=0x7fc2fc00cc60 comp rx=0 tx=0).stop 2024-02-19T19:10:02.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.822+0000 7fc319b09700 1 -- 172.21.15.96:0/1718483710 shutdown_connections 2024-02-19T19:10:02.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.822+0000 7fc319b09700 1 --2- 172.21.15.96:0/1718483710 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc30006d8a0 0x7fc30006fd60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:02.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.822+0000 7fc319b09700 1 --2- 172.21.15.96:0/1718483710 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc3140ffc20 0x7fc31419c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:02.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.822+0000 7fc319b09700 1 --2- 172.21.15.96:0/1718483710 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc314105bd0 0x7fc31419cb60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:02.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.822+0000 7fc319b09700 1 -- 172.21.15.96:0/1718483710 >> 172.21.15.96:0/1718483710 conn(0x7fc314075670 msgr2=0x7fc3140686c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:02.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.823+0000 7fc319b09700 1 -- 172.21.15.96:0/1718483710 shutdown_connections 2024-02-19T19:10:02.845 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:02.823+0000 7fc319b09700 1 -- 172.21.15.96:0/1718483710 wait complete. 2024-02-19T19:10:03.113 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:03 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/2773210005' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:10:03.114 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:03 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/1718483710' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:10:03.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:03 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/2773210005' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:10:03.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:03 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/1718483710' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:10:04.452 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:04 smithi125 ceph-mon[86115]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:04.453 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:04 smithi125 ceph-mon[86115]: pgmap v67: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:10:04.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:04 smithi096 ceph-mon[112483]: from='client.34240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:04.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:04 smithi096 ceph-mon[112483]: pgmap v67: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-02-19T19:10:05.288 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:05 smithi096 systemd[1]: Stopping Ceph osd.1 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T19:10:05.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:05 smithi125 ceph-mon[86115]: osd.1 marked itself down and dead 2024-02-19T19:10:05.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:10:05.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:05 smithi096 ceph-mon[112483]: osd.1 marked itself down and dead 2024-02-19T19:10:05.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:10:05.788 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:05 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1[55889]: 2024-02-19T19:10:05.313+0000 7fdbb19a5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T19:10:05.788 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:05 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1[55889]: 2024-02-19T19:10:05.313+0000 7fdbb19a5700 -1 osd.1 54 *** Got signal Terminated *** 2024-02-19T19:10:05.788 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:05 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1[55889]: 2024-02-19T19:10:05.313+0000 7fdbb19a5700 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T19:10:06.194 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:05 smithi096 podman[129177]: 2024-02-19 19:10:05.875114282 +0000 UTC m=+0.676245261 container died 40329d59be45eb5ab9b08dfae46eb7df31fd74914afaa30571343670e5071969 (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.1) 2024-02-19T19:10:06.538 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:06 smithi096 podman[129177]: 2024-02-19 19:10:06.264245376 +0000 UTC m=+1.065376354 container cleanup 40329d59be45eb5ab9b08dfae46eb7df31fd74914afaa30571343670e5071969 (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.1, io.buildah.version=1.29.1, GIT_CLEAN=True, RELEASE=HEAD, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-02-19T19:10:06.538 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:06 smithi096 bash[129177]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1 2024-02-19T19:10:06.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:06 smithi096 ceph-mon[112483]: pgmap v68: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:10:06.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:06 smithi096 ceph-mon[112483]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:10:06.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:06 smithi096 ceph-mon[112483]: osdmap e55: 6 total, 5 up, 6 in 2024-02-19T19:10:06.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:06 smithi096 ceph-mon[112483]: osdmap e56: 6 total, 5 up, 6 in 2024-02-19T19:10:06.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:06 smithi125 ceph-mon[86115]: pgmap v68: 65 pgs: 65 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:10:06.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:06 smithi125 ceph-mon[86115]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:10:06.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:06 smithi125 ceph-mon[86115]: osdmap e55: 6 total, 5 up, 6 in 2024-02-19T19:10:06.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:06 smithi125 ceph-mon[86115]: osdmap e56: 6 total, 5 up, 6 in 2024-02-19T19:10:06.915 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:06 smithi096 podman[129194]: 2024-02-19 19:10:06.574555018 +0000 UTC m=+0.694478073 container remove 40329d59be45eb5ab9b08dfae46eb7df31fd74914afaa30571343670e5071969 (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-02-19T19:10:07.208 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:06 smithi096 podman[129287]: 2024-02-19 19:10:06.797495692 +0000 UTC m=+0.017767948 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:10:07.209 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:06 smithi096 podman[129287]: 2024-02-19 19:10:06.917259583 +0000 UTC m=+0.137531871 container create ffe1cba2d9dc666ba7020110e352c63d4f09ded895f2e4e92e4d53309b299879 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T19:10:07.209 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:07 smithi096 podman[129287]: 2024-02-19 19:10:07.187807837 +0000 UTC m=+0.408080087 container init ffe1cba2d9dc666ba7020110e352c63d4f09ded895f2e4e92e4d53309b299879 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-02-19T19:10:07.514 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:07 smithi096 ceph-mon[112483]: pgmap v71: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 383 B/s rd, 2 op/s 2024-02-19T19:10:07.515 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:07 smithi096 ceph-mon[112483]: Health check failed: Reduced data availability: 4 pgs inactive, 9 pgs peering (PG_AVAILABILITY) 2024-02-19T19:10:07.515 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:07 smithi096 podman[129287]: 2024-02-19 19:10:07.191173231 +0000 UTC m=+0.411445483 container start ffe1cba2d9dc666ba7020110e352c63d4f09ded895f2e4e92e4d53309b299879 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T19:10:07.515 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:07 smithi096 podman[129287]: 2024-02-19 19:10:07.287174653 +0000 UTC m=+0.507446903 container attach ffe1cba2d9dc666ba7020110e352c63d4f09ded895f2e4e92e4d53309b299879 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-02-19T19:10:07.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:07 smithi125 ceph-mon[86115]: pgmap v71: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 383 B/s rd, 2 op/s 2024-02-19T19:10:07.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:07 smithi125 ceph-mon[86115]: Health check failed: Reduced data availability: 4 pgs inactive, 9 pgs peering (PG_AVAILABILITY) 2024-02-19T19:10:07.787 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:07 smithi096 podman[129287]: 2024-02-19 19:10:07.494075233 +0000 UTC m=+0.714347487 container died ffe1cba2d9dc666ba7020110e352c63d4f09ded895f2e4e92e4d53309b299879 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-02-19T19:10:08.538 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:08 smithi096 podman[129313]: 2024-02-19 19:10:08.183488913 +0000 UTC m=+0.684294488 container remove ffe1cba2d9dc666ba7020110e352c63d4f09ded895f2e4e92e4d53309b299879 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-deactivate, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-02-19T19:10:08.538 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:08 smithi096 systemd[1]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.1.service: Deactivated successfully. 2024-02-19T19:10:08.538 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:08 smithi096 systemd[1]: Stopped Ceph osd.1 for 06580d2c-cf58-11ee-95bb-87774f69a715. 2024-02-19T19:10:08.538 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:08 smithi096 systemd[1]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.1.service: Consumed 6.529s CPU time. 2024-02-19T19:10:08.538 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:08 smithi096 systemd[1]: Starting Ceph osd.1 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T19:10:08.934 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:08 smithi096 podman[129416]: 2024-02-19 19:10:08.534571361 +0000 UTC m=+0.018579800 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:10:08.934 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:08 smithi096 podman[129416]: 2024-02-19 19:10:08.659982932 +0000 UTC m=+0.143991371 container create c33e9389f0933f59fbfae2b8e05548410ce44322417604d824e52e86858b7813 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-activate, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-02-19T19:10:08.934 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:08 smithi096 podman[129416]: 2024-02-19 19:10:08.91317179 +0000 UTC m=+0.397180229 container init c33e9389f0933f59fbfae2b8e05548410ce44322417604d824e52e86858b7813 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-activate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214) 2024-02-19T19:10:09.287 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:08 smithi096 podman[129416]: 2024-02-19 19:10:08.91638708 +0000 UTC m=+0.400395526 container start c33e9389f0933f59fbfae2b8e05548410ce44322417604d824e52e86858b7813 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-activate, GIT_CLEAN=True, org.label-schema.build-date=20240214, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T19:10:09.288 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:09 smithi096 podman[129416]: 2024-02-19 19:10:09.013184837 +0000 UTC m=+0.497193281 container attach c33e9389f0933f59fbfae2b8e05548410ce44322417604d824e52e86858b7813 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-activate, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-02-19T19:10:09.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:09 smithi125 ceph-mon[86115]: Health check failed: Degraded data redundancy: 2/129 objects degraded (1.550%), 1 pg degraded (PG_DEGRADED) 2024-02-19T19:10:09.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:09 smithi096 ceph-mon[112483]: Health check failed: Degraded data redundancy: 2/129 objects degraded (1.550%), 1 pg degraded (PG_DEGRADED) 2024-02-19T19:10:09.788 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:09 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-activate[129432]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-19T19:10:09.788 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:09 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-activate[129432]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-19T19:10:09.788 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:09 smithi096 bash[129416]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-19T19:10:09.788 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:09 smithi096 bash[129416]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-19T19:10:09.788 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:09 smithi096 bash[129416]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-19T19:10:09.788 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:09 smithi096 bash[129416]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-19T19:10:09.788 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:09 smithi096 bash[129416]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-19T19:10:09.788 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:09 smithi096 bash[129416]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-19T19:10:09.789 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:09 smithi096 bash[129416]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-19T19:10:09.789 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:09 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-activate[129432]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-19T19:10:09.789 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:09 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-activate[129432]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-19T19:10:09.789 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:09 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-activate[129432]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-19T19:10:09.789 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:09 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-activate[129432]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-19T19:10:09.789 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:09 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-activate[129432]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-19T19:10:09.789 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:09 smithi096 podman[129416]: 2024-02-19 19:10:09.386970455 +0000 UTC m=+0.870978892 container died c33e9389f0933f59fbfae2b8e05548410ce44322417604d824e52e86858b7813 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-02-19T19:10:10.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:10 smithi096 ceph-mon[112483]: pgmap v72: 65 pgs: 1 active+undersized+degraded, 29 peering, 4 active+undersized, 31 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2/129 objects degraded (1.550%) 2024-02-19T19:10:10.538 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:10 smithi096 podman[129557]: 2024-02-19 19:10:10.209942195 +0000 UTC m=+0.817851426 container remove c33e9389f0933f59fbfae2b8e05548410ce44322417604d824e52e86858b7813 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-activate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-02-19T19:10:10.538 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:10 smithi096 podman[129619]: 2024-02-19 19:10:10.323086006 +0000 UTC m=+0.018471861 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:10:10.538 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:10 smithi096 podman[129619]: 2024-02-19 19:10:10.444638993 +0000 UTC m=+0.140024842 container create f0dd6d8f952f641be74d2a6670510f264717de61f3fde536d05424af2ff285f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-02-19T19:10:10.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:10 smithi125 ceph-mon[86115]: pgmap v72: 65 pgs: 1 active+undersized+degraded, 29 peering, 4 active+undersized, 31 active+clean; 595 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2/129 objects degraded (1.550%) 2024-02-19T19:10:11.038 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:10 smithi096 podman[129619]: 2024-02-19 19:10:10.672432997 +0000 UTC m=+0.367818855 container init f0dd6d8f952f641be74d2a6670510f264717de61f3fde536d05424af2ff285f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-02-19T19:10:11.038 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:10 smithi096 podman[129619]: 2024-02-19 19:10:10.675772998 +0000 UTC m=+0.371158850 container start f0dd6d8f952f641be74d2a6670510f264717de61f3fde536d05424af2ff285f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T19:10:11.038 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:10 smithi096 ceph-osd[129637]: -- 172.21.15.96:0/550557763 <== mon.0 v2:172.21.15.96:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a7e0ba31e0 con 0x55a7e0b74c00 2024-02-19T19:10:11.038 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:10 smithi096 bash[129619]: f0dd6d8f952f641be74d2a6670510f264717de61f3fde536d05424af2ff285f9 2024-02-19T19:10:11.038 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:10 smithi096 systemd[1]: Started Ceph osd.1 for 06580d2c-cf58-11ee-95bb-87774f69a715. 2024-02-19T19:10:11.537 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:11 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1[129633]: 2024-02-19T19:10:11.214+0000 7f400c6837c0 -1 Falling back to public interface 2024-02-19T19:10:12.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:11 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:12.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:11 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:12.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:11 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:10:12.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:11 smithi096 ceph-mon[112483]: pgmap v73: 65 pgs: 11 active+undersized+degraded, 23 active+undersized, 31 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 22/129 objects degraded (17.054%) 2024-02-19T19:10:12.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:11 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:12.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:11 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:12.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:11 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:10:12.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:11 smithi125 ceph-mon[86115]: pgmap v73: 65 pgs: 11 active+undersized+degraded, 23 active+undersized, 31 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 22/129 objects degraded (17.054%) 2024-02-19T19:10:13.107 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:12 smithi096 ceph-mon[112483]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 9 pgs peering) 2024-02-19T19:10:13.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:12 smithi125 ceph-mon[86115]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 9 pgs peering) 2024-02-19T19:10:14.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:13 smithi125 ceph-mon[86115]: pgmap v74: 65 pgs: 11 active+undersized+degraded, 23 active+undersized, 31 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 22/129 objects degraded (17.054%) 2024-02-19T19:10:14.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:13 smithi096 ceph-mon[112483]: pgmap v74: 65 pgs: 11 active+undersized+degraded, 23 active+undersized, 31 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 22/129 objects degraded (17.054%) 2024-02-19T19:10:14.877 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:14 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1[129633]: 2024-02-19T19:10:14.698+0000 7f400c6837c0 -1 osd.1 0 read_superblock omap replica is missing. 2024-02-19T19:10:14.877 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:14 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1[129633]: 2024-02-19T19:10:14.739+0000 7f400c6837c0 -1 osd.1 54 log_to_monitors true 2024-02-19T19:10:14.877 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 19:10:14 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1[129633]: 2024-02-19T19:10:14.855+0000 7f3ffdadb700 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T19:10:14.877 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:14 smithi096 ceph-mon[112483]: from='osd.1 [v2:172.21.15.96:6810/3087706183,v1:172.21.15.96:6811/3087706183]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-19T19:10:15.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:14 smithi125 ceph-mon[86115]: from='osd.1 [v2:172.21.15.96:6810/3087706183,v1:172.21.15.96:6811/3087706183]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-19T19:10:15.877 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:15 smithi096 ceph-mon[112483]: from='osd.1 [v2:172.21.15.96:6810/3087706183,v1:172.21.15.96:6811/3087706183]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-19T19:10:15.877 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:15 smithi096 ceph-mon[112483]: osdmap e57: 6 total, 5 up, 6 in 2024-02-19T19:10:15.878 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:15 smithi096 ceph-mon[112483]: from='osd.1 [v2:172.21.15.96:6810/3087706183,v1:172.21.15.96:6811/3087706183]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2024-02-19T19:10:15.878 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:15 smithi096 ceph-mon[112483]: pgmap v76: 65 pgs: 11 active+undersized+degraded, 23 active+undersized, 31 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 22/129 objects degraded (17.054%) 2024-02-19T19:10:16.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:15 smithi125 ceph-mon[86115]: from='osd.1 [v2:172.21.15.96:6810/3087706183,v1:172.21.15.96:6811/3087706183]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-19T19:10:16.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:15 smithi125 ceph-mon[86115]: osdmap e57: 6 total, 5 up, 6 in 2024-02-19T19:10:16.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:15 smithi125 ceph-mon[86115]: from='osd.1 [v2:172.21.15.96:6810/3087706183,v1:172.21.15.96:6811/3087706183]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2024-02-19T19:10:16.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:15 smithi125 ceph-mon[86115]: pgmap v76: 65 pgs: 11 active+undersized+degraded, 23 active+undersized, 31 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 22/129 objects degraded (17.054%) 2024-02-19T19:10:17.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:16 smithi125 ceph-mon[86115]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:10:17.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:16 smithi125 ceph-mon[86115]: osd.1 [v2:172.21.15.96:6810/3087706183,v1:172.21.15.96:6811/3087706183] boot 2024-02-19T19:10:17.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:16 smithi125 ceph-mon[86115]: osdmap e58: 6 total, 6 up, 6 in 2024-02-19T19:10:17.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:16 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T19:10:17.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:16 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:17.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:16 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:17.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:16 smithi096 ceph-mon[112483]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:10:17.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:16 smithi096 ceph-mon[112483]: osd.1 [v2:172.21.15.96:6810/3087706183,v1:172.21.15.96:6811/3087706183] boot 2024-02-19T19:10:17.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:16 smithi096 ceph-mon[112483]: osdmap e58: 6 total, 6 up, 6 in 2024-02-19T19:10:17.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:16 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-19T19:10:17.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:16 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:17.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:16 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:18.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:17 smithi125 ceph-mon[86115]: osdmap e59: 6 total, 6 up, 6 in 2024-02-19T19:10:18.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:17 smithi125 ceph-mon[86115]: Health check update: Degraded data redundancy: 22/129 objects degraded (17.054%), 11 pgs degraded (PG_DEGRADED) 2024-02-19T19:10:18.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:17 smithi125 ceph-mon[86115]: pgmap v79: 65 pgs: 20 peering, 6 active+undersized+degraded, 8 active+undersized, 31 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s; 10/129 objects degraded (7.752%) 2024-02-19T19:10:18.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:17 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:18.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:17 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:18.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:17 smithi096 ceph-mon[112483]: osdmap e59: 6 total, 6 up, 6 in 2024-02-19T19:10:18.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:17 smithi096 ceph-mon[112483]: Health check update: Degraded data redundancy: 22/129 objects degraded (17.054%), 11 pgs degraded (PG_DEGRADED) 2024-02-19T19:10:18.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:17 smithi096 ceph-mon[112483]: pgmap v79: 65 pgs: 20 peering, 6 active+undersized+degraded, 8 active+undersized, 31 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s; 10/129 objects degraded (7.752%) 2024-02-19T19:10:18.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:18.239 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:20.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:20 smithi096 ceph-mon[112483]: pgmap v80: 65 pgs: 20 peering, 6 active+undersized+degraded, 6 active+undersized, 33 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s; 10/129 objects degraded (7.752%) 2024-02-19T19:10:20.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:20.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:10:20.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:20 smithi125 ceph-mon[86115]: pgmap v80: 65 pgs: 20 peering, 6 active+undersized+degraded, 6 active+undersized, 33 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s; 10/129 objects degraded (7.752%) 2024-02-19T19:10:20.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:20.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:10:22.580 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:22 smithi096 ceph-mon[112483]: pgmap v81: 65 pgs: 65 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 5 op/s 2024-02-19T19:10:22.580 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:22.580 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:22.580 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:10:22.580 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:10:22.580 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:22.580 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:22 smithi096 ceph-mon[112483]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/129 objects degraded (7.752%), 6 pgs degraded) 2024-02-19T19:10:22.580 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:10:22.580 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:22.580 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:22.580 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:22.581 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-19T19:10:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:22 smithi125 ceph-mon[86115]: pgmap v81: 65 pgs: 65 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 5 op/s 2024-02-19T19:10:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:10:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:10:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:22 smithi125 ceph-mon[86115]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/129 objects degraded (7.752%), 6 pgs degraded) 2024-02-19T19:10:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:10:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-19T19:10:23.369 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:23 smithi096 ceph-mon[112483]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-19T19:10:23.370 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:23 smithi096 ceph-mon[112483]: Upgrade: osd.2 is safe to restart 2024-02-19T19:10:23.370 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:23.370 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-19T19:10:23.370 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:10:23.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:23 smithi125 ceph-mon[86115]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-19T19:10:23.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:23 smithi125 ceph-mon[86115]: Upgrade: osd.2 is safe to restart 2024-02-19T19:10:23.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:23.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-19T19:10:23.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:10:24.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:24 smithi096 ceph-mon[112483]: Upgrade: Updating osd.2 2024-02-19T19:10:24.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:24 smithi096 ceph-mon[112483]: Deploying daemon osd.2 on smithi096 2024-02-19T19:10:24.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:24 smithi096 ceph-mon[112483]: pgmap v82: 65 pgs: 65 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-19T19:10:24.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:24 smithi125 ceph-mon[86115]: Upgrade: Updating osd.2 2024-02-19T19:10:24.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:24 smithi125 ceph-mon[86115]: Deploying daemon osd.2 on smithi096 2024-02-19T19:10:24.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:24 smithi125 ceph-mon[86115]: pgmap v82: 65 pgs: 65 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-02-19T19:10:26.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:26 smithi125 ceph-mon[86115]: pgmap v83: 65 pgs: 65 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:10:26.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:26 smithi096 ceph-mon[112483]: pgmap v83: 65 pgs: 65 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:10:27.096 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:27 smithi096 systemd[1]: Stopping Ceph osd.2 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T19:10:27.788 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:27 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2[63258]: 2024-02-19T19:10:27.368+0000 7f1f8ef8f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T19:10:27.788 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:27 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2[63258]: 2024-02-19T19:10:27.368+0000 7f1f8ef8f700 -1 osd.2 59 *** Got signal Terminated *** 2024-02-19T19:10:27.788 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:27 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2[63258]: 2024-02-19T19:10:27.368+0000 7f1f8ef8f700 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T19:10:28.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:28 smithi125 ceph-mon[86115]: pgmap v84: 65 pgs: 65 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-02-19T19:10:28.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:28 smithi125 ceph-mon[86115]: osd.2 marked itself down and dead 2024-02-19T19:10:28.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:28 smithi096 ceph-mon[112483]: pgmap v84: 65 pgs: 65 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-02-19T19:10:28.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:28 smithi096 ceph-mon[112483]: osd.2 marked itself down and dead 2024-02-19T19:10:29.232 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:28 smithi096 podman[134503]: 2024-02-19 19:10:28.871596879 +0000 UTC m=+1.621246755 container died 4f1e49db2d41271f1faf45d971a5656bc372d678b7d90b845d251c1a249f1bff (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2, org.label-schema.license=GPLv2, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, RELEASE=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.1) 2024-02-19T19:10:29.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:29 smithi096 ceph-mon[112483]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:10:29.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:29 smithi096 ceph-mon[112483]: osdmap e60: 6 total, 5 up, 6 in 2024-02-19T19:10:29.538 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:29 smithi096 podman[134503]: 2024-02-19 19:10:29.284348263 +0000 UTC m=+2.033998146 container cleanup 4f1e49db2d41271f1faf45d971a5656bc372d678b7d90b845d251c1a249f1bff (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T19:10:29.538 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:29 smithi096 bash[134503]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2 2024-02-19T19:10:29.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:29 smithi125 ceph-mon[86115]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:10:29.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:29 smithi125 ceph-mon[86115]: osdmap e60: 6 total, 5 up, 6 in 2024-02-19T19:10:29.954 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:29 smithi096 podman[134520]: 2024-02-19 19:10:29.544531139 +0000 UTC m=+0.669411070 container remove 4f1e49db2d41271f1faf45d971a5656bc372d678b7d90b845d251c1a249f1bff (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=HEAD, io.buildah.version=1.29.1, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.1, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-02-19T19:10:30.236 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:29 smithi096 podman[134601]: 2024-02-19 19:10:29.838203155 +0000 UTC m=+0.020834067 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:10:30.237 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:29 smithi096 podman[134601]: 2024-02-19 19:10:29.953968786 +0000 UTC m=+0.136599735 container create e698cd8f543594869d3456716ed38ea041a7c78c0e3d54a98a88b62d8a6dddd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240214) 2024-02-19T19:10:30.237 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:30 smithi096 podman[134601]: 2024-02-19 19:10:30.21528665 +0000 UTC m=+0.397917580 container init e698cd8f543594869d3456716ed38ea041a7c78c0e3d54a98a88b62d8a6dddd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-deactivate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T19:10:30.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:30 smithi096 ceph-mon[112483]: pgmap v86: 65 pgs: 8 peering, 6 stale+active+clean, 51 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s 2024-02-19T19:10:30.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:30 smithi096 ceph-mon[112483]: Health check failed: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY) 2024-02-19T19:10:30.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:30 smithi096 ceph-mon[112483]: osdmap e61: 6 total, 5 up, 6 in 2024-02-19T19:10:30.538 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:30 smithi096 podman[134601]: 2024-02-19 19:10:30.22048397 +0000 UTC m=+0.403114893 container start e698cd8f543594869d3456716ed38ea041a7c78c0e3d54a98a88b62d8a6dddd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T19:10:30.538 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:30 smithi096 podman[134601]: 2024-02-19 19:10:30.315084725 +0000 UTC m=+0.497715645 container attach e698cd8f543594869d3456716ed38ea041a7c78c0e3d54a98a88b62d8a6dddd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-02-19T19:10:30.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:30 smithi125 ceph-mon[86115]: pgmap v86: 65 pgs: 8 peering, 6 stale+active+clean, 51 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s 2024-02-19T19:10:30.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:30 smithi125 ceph-mon[86115]: Health check failed: Reduced data availability: 1 pg inactive, 2 pgs peering (PG_AVAILABILITY) 2024-02-19T19:10:30.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:30 smithi125 ceph-mon[86115]: osdmap e61: 6 total, 5 up, 6 in 2024-02-19T19:10:31.038 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:30 smithi096 podman[134601]: 2024-02-19 19:10:30.608853869 +0000 UTC m=+0.791484789 container died e698cd8f543594869d3456716ed38ea041a7c78c0e3d54a98a88b62d8a6dddd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, GIT_CLEAN=True) 2024-02-19T19:10:31.403 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:31 smithi096 podman[134625]: 2024-02-19 19:10:31.219885295 +0000 UTC m=+0.605300337 container remove e698cd8f543594869d3456716ed38ea041a7c78c0e3d54a98a88b62d8a6dddd1 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, ceph=True) 2024-02-19T19:10:31.403 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:31 smithi096 systemd[1]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.2.service: Deactivated successfully. 2024-02-19T19:10:31.403 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:31 smithi096 systemd[1]: Stopped Ceph osd.2 for 06580d2c-cf58-11ee-95bb-87774f69a715. 2024-02-19T19:10:31.403 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:31 smithi096 systemd[1]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.2.service: Consumed 5.859s CPU time. 2024-02-19T19:10:31.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:31 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:31.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:31 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:31.788 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:31 smithi096 systemd[1]: Starting Ceph osd.2 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T19:10:32.069 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:31 smithi096 podman[134723]: 2024-02-19 19:10:31.675581058 +0000 UTC m=+0.024177049 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:10:32.069 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:31 smithi096 podman[134723]: 2024-02-19 19:10:31.803552737 +0000 UTC m=+0.152148710 container create bd206e2d21d6edd59afff969ccf22ab03059aa35052e384a56f45f1602c48556 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-activate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, ceph=True) 2024-02-19T19:10:32.070 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:32 smithi096 podman[134723]: 2024-02-19 19:10:32.048174657 +0000 UTC m=+0.396770647 container init bd206e2d21d6edd59afff969ccf22ab03059aa35052e384a56f45f1602c48556 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_CLEAN=True) 2024-02-19T19:10:32.404 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:32 smithi096 podman[134723]: 2024-02-19 19:10:32.053380217 +0000 UTC m=+0.401976194 container start bd206e2d21d6edd59afff969ccf22ab03059aa35052e384a56f45f1602c48556 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-activate, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214) 2024-02-19T19:10:32.404 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:32 smithi096 podman[134723]: 2024-02-19 19:10:32.156426948 +0000 UTC m=+0.505022922 container attach bd206e2d21d6edd59afff969ccf22ab03059aa35052e384a56f45f1602c48556 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-activate, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-02-19T19:10:32.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:32 smithi125 ceph-mon[86115]: pgmap v88: 65 pgs: 7 active+undersized+degraded, 8 peering, 12 active+undersized, 38 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 14/129 objects degraded (10.853%) 2024-02-19T19:10:32.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:32 smithi125 ceph-mon[86115]: Health check failed: Degraded data redundancy: 14/129 objects degraded (10.853%), 7 pgs degraded (PG_DEGRADED) 2024-02-19T19:10:32.746 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:32 smithi096 ceph-mon[112483]: pgmap v88: 65 pgs: 7 active+undersized+degraded, 8 peering, 12 active+undersized, 38 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 14/129 objects degraded (10.853%) 2024-02-19T19:10:32.746 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:32 smithi096 ceph-mon[112483]: Health check failed: Degraded data redundancy: 14/129 objects degraded (10.853%), 7 pgs degraded (PG_DEGRADED) 2024-02-19T19:10:32.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.948+0000 7ff7ff19f700 1 -- 172.21.15.96:0/3025328894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7f8105920 msgr2=0x7ff7f8105d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:32.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.948+0000 7ff7ff19f700 1 --2- 172.21.15.96:0/3025328894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7f8105920 0x7ff7f8105d00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4009910 tx=0x7ff7f4009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:32.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.948+0000 7ff7ff19f700 1 -- 172.21.15.96:0/3025328894 shutdown_connections 2024-02-19T19:10:32.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.948+0000 7ff7ff19f700 1 --2- 172.21.15.96:0/3025328894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7f80ff920 0x7ff7f80ffda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:32.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.948+0000 7ff7ff19f700 1 --2- 172.21.15.96:0/3025328894 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7f8105920 0x7ff7f8105d00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:32.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.948+0000 7ff7ff19f700 1 -- 172.21.15.96:0/3025328894 >> 172.21.15.96:0/3025328894 conn(0x7ff7f80fb470 msgr2=0x7ff7f80fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:32.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.948+0000 7ff7ff19f700 1 -- 172.21.15.96:0/3025328894 shutdown_connections 2024-02-19T19:10:32.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.948+0000 7ff7ff19f700 1 -- 172.21.15.96:0/3025328894 wait complete. 2024-02-19T19:10:32.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.949+0000 7ff7ff19f700 1 Processor -- start 2024-02-19T19:10:32.971 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.949+0000 7ff7ff19f700 1 -- start start 2024-02-19T19:10:32.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.950+0000 7ff7ff19f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7f80ff920 0x7ff7f81954f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:32.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.950+0000 7ff7ff19f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7f8105920 0x7ff7f8195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:32.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.950+0000 7ff7ff19f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f8196110 con 0x7ff7f80ff920 2024-02-19T19:10:32.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.950+0000 7ff7ff19f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f8199ea0 con 0x7ff7f8105920 2024-02-19T19:10:32.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.950+0000 7ff7fe19d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7f80ff920 0x7ff7f81954f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:32.973 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.950+0000 7ff7fe19d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7f80ff920 0x7ff7f81954f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48670/0 (socket says 172.21.15.96:48670) 2024-02-19T19:10:32.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.950+0000 7ff7fe19d700 1 -- 172.21.15.96:0/2401614749 learned_addr learned my addr 172.21.15.96:0/2401614749 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:10:32.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.950+0000 7ff7fd99c700 1 --2- 172.21.15.96:0/2401614749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7f8105920 0x7ff7f8195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:32.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.950+0000 7ff7fe19d700 1 -- 172.21.15.96:0/2401614749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7f8105920 msgr2=0x7ff7f8195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:32.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.950+0000 7ff7fe19d700 1 --2- 172.21.15.96:0/2401614749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7f8105920 0x7ff7f8195a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:32.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.950+0000 7ff7fe19d700 1 -- 172.21.15.96:0/2401614749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f40095f0 con 0x7ff7f80ff920 2024-02-19T19:10:32.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.950+0000 7ff7fd99c700 1 --2- 172.21.15.96:0/2401614749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7f8105920 0x7ff7f8195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:10:32.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.951+0000 7ff7fe19d700 1 --2- 172.21.15.96:0/2401614749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7f80ff920 0x7ff7f81954f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4005f50 tx=0x7ff7f401a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:32.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.951+0000 7ff7ef7fe700 1 -- 172.21.15.96:0/2401614749 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7f401f070 con 0x7ff7f80ff920 2024-02-19T19:10:32.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.951+0000 7ff7ef7fe700 1 -- 172.21.15.96:0/2401614749 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff7f400b610 con 0x7ff7f80ff920 2024-02-19T19:10:32.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.951+0000 7ff7ff19f700 1 -- 172.21.15.96:0/2401614749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f819a120 con 0x7ff7f80ff920 2024-02-19T19:10:32.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.951+0000 7ff7ff19f700 1 -- 172.21.15.96:0/2401614749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f819a610 con 0x7ff7f80ff920 2024-02-19T19:10:32.974 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.951+0000 7ff7ef7fe700 1 -- 172.21.15.96:0/2401614749 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7f400f460 con 0x7ff7f80ff920 2024-02-19T19:10:32.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.952+0000 7ff7ff19f700 1 -- 172.21.15.96:0/2401614749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7dc005320 con 0x7ff7f80ff920 2024-02-19T19:10:32.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.953+0000 7ff7ef7fe700 1 -- 172.21.15.96:0/2401614749 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7ff7f4023070 con 0x7ff7f80ff920 2024-02-19T19:10:32.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.954+0000 7ff7ef7fe700 1 --2- 172.21.15.96:0/2401614749 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff7e406d9c0 0x7ff7e406fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:32.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.954+0000 7ff7ef7fe700 1 -- 172.21.15.96:0/2401614749 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff7f40906d0 con 0x7ff7f80ff920 2024-02-19T19:10:32.975 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.954+0000 7ff7fd99c700 1 --2- 172.21.15.96:0/2401614749 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff7e406d9c0 0x7ff7e406fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:32.976 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.954+0000 7ff7fd99c700 1 --2- 172.21.15.96:0/2401614749 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff7e406d9c0 0x7ff7e406fe80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8196b10 tx=0x7ff7e8009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:32.983 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:32.961+0000 7ff7ef7fe700 1 -- 172.21.15.96:0/2401614749 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff7f4059f90 con 0x7ff7f80ff920 2024-02-19T19:10:33.038 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:32 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-activate[134738]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-19T19:10:33.038 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:32 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-activate[134738]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-19T19:10:33.038 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:32 smithi096 bash[134723]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-19T19:10:33.038 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:32 smithi096 bash[134723]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-19T19:10:33.038 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:32 smithi096 bash[134723]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-19T19:10:33.039 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:32 smithi096 bash[134723]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-19T19:10:33.039 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:32 smithi096 bash[134723]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-19T19:10:33.039 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:32 smithi096 bash[134723]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-19T19:10:33.039 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:32 smithi096 bash[134723]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-19T19:10:33.039 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:32 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-activate[134738]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-19T19:10:33.039 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:32 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-activate[134738]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-19T19:10:33.039 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:32 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-activate[134738]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-19T19:10:33.039 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:32 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-activate[134738]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-19T19:10:33.039 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:32 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-activate[134738]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-19T19:10:33.039 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:32 smithi096 podman[134723]: 2024-02-19 19:10:32.759874113 +0000 UTC m=+1.108470091 container died bd206e2d21d6edd59afff969ccf22ab03059aa35052e384a56f45f1602c48556 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-activate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-02-19T19:10:33.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.255+0000 7ff7ff19f700 1 -- 172.21.15.96:0/2401614749 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7dc000bf0 con 0x7ff7e406d9c0 2024-02-19T19:10:33.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.257+0000 7ff7ef7fe700 1 -- 172.21.15.96:0/2401614749 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff7dc000bf0 con 0x7ff7e406d9c0 2024-02-19T19:10:33.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.259+0000 7ff7ff19f700 1 -- 172.21.15.96:0/2401614749 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff7e406d9c0 msgr2=0x7ff7e406fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:33.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.259+0000 7ff7ff19f700 1 --2- 172.21.15.96:0/2401614749 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff7e406d9c0 0x7ff7e406fe80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8196b10 tx=0x7ff7e8009260 comp rx=0 tx=0).stop 2024-02-19T19:10:33.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.259+0000 7ff7ff19f700 1 -- 172.21.15.96:0/2401614749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7f80ff920 msgr2=0x7ff7f81954f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:33.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.259+0000 7ff7ff19f700 1 --2- 172.21.15.96:0/2401614749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7f80ff920 0x7ff7f81954f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4005f50 tx=0x7ff7f401a900 comp rx=0 tx=0).stop 2024-02-19T19:10:33.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.259+0000 7ff7ff19f700 1 -- 172.21.15.96:0/2401614749 shutdown_connections 2024-02-19T19:10:33.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.259+0000 7ff7ff19f700 1 --2- 172.21.15.96:0/2401614749 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff7e406d9c0 0x7ff7e406fe80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:33.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.259+0000 7ff7ff19f700 1 --2- 172.21.15.96:0/2401614749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7f80ff920 0x7ff7f81954f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:33.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.259+0000 7ff7ff19f700 1 --2- 172.21.15.96:0/2401614749 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7f8105920 0x7ff7f8195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:33.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.259+0000 7ff7ff19f700 1 -- 172.21.15.96:0/2401614749 >> 172.21.15.96:0/2401614749 conn(0x7ff7f80fb470 msgr2=0x7ff7f80fbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:33.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.259+0000 7ff7ff19f700 1 -- 172.21.15.96:0/2401614749 shutdown_connections 2024-02-19T19:10:33.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.259+0000 7ff7ff19f700 1 -- 172.21.15.96:0/2401614749 wait complete. 2024-02-19T19:10:33.295 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:10:33.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.423+0000 7ffb48614700 1 -- 172.21.15.96:0/1484884003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb40068ac0 msgr2=0x7ffb40068f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:33.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.423+0000 7ffb48614700 1 --2- 172.21.15.96:0/1484884003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb40068ac0 0x7ffb40068f20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c009870 tx=0x7ffb3c009b80 comp rx=0 tx=0).stop 2024-02-19T19:10:33.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.424+0000 7ffb48614700 1 -- 172.21.15.96:0/1484884003 shutdown_connections 2024-02-19T19:10:33.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.424+0000 7ffb48614700 1 --2- 172.21.15.96:0/1484884003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb40068ac0 0x7ffb40068f20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:33.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.424+0000 7ffb48614700 1 --2- 172.21.15.96:0/1484884003 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb40105b80 0x7ffb40068580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:33.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.424+0000 7ffb48614700 1 -- 172.21.15.96:0/1484884003 >> 172.21.15.96:0/1484884003 conn(0x7ffb40075670 msgr2=0x7ffb40075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:33.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.424+0000 7ffb48614700 1 -- 172.21.15.96:0/1484884003 shutdown_connections 2024-02-19T19:10:33.446 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.424+0000 7ffb48614700 1 -- 172.21.15.96:0/1484884003 wait complete. 2024-02-19T19:10:33.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.424+0000 7ffb48614700 1 Processor -- start 2024-02-19T19:10:33.447 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.425+0000 7ffb48614700 1 -- start start 2024-02-19T19:10:33.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.425+0000 7ffb48614700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb40068ac0 0x7ffb4019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:33.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.425+0000 7ffb48614700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb40105b80 0x7ffb4019d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:33.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.425+0000 7ffb48614700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4019dad0 con 0x7ffb40068ac0 2024-02-19T19:10:33.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.425+0000 7ffb48614700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb401a1860 con 0x7ffb40105b80 2024-02-19T19:10:33.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.425+0000 7ffb463b0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb40068ac0 0x7ffb4019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:33.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.425+0000 7ffb463b0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb40068ac0 0x7ffb4019ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:48692/0 (socket says 172.21.15.96:48692) 2024-02-19T19:10:33.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.425+0000 7ffb463b0700 1 -- 172.21.15.96:0/1998429340 learned_addr learned my addr 172.21.15.96:0/1998429340 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:10:33.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.425+0000 7ffb45baf700 1 --2- 172.21.15.96:0/1998429340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb40105b80 0x7ffb4019d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:33.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.425+0000 7ffb45baf700 1 -- 172.21.15.96:0/1998429340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb40068ac0 msgr2=0x7ffb4019ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:33.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.425+0000 7ffb45baf700 1 --2- 172.21.15.96:0/1998429340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb40068ac0 0x7ffb4019ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:33.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.425+0000 7ffb45baf700 1 -- 172.21.15.96:0/1998429340 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3c009520 con 0x7ffb40105b80 2024-02-19T19:10:33.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.426+0000 7ffb45baf700 1 --2- 172.21.15.96:0/1998429340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb40105b80 0x7ffb4019d3f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c000c00 tx=0x7ffb3c0047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:33.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.426+0000 7ffb377fe700 1 -- 172.21.15.96:0/1998429340 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb3c01c070 con 0x7ffb40105b80 2024-02-19T19:10:33.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.426+0000 7ffb377fe700 1 -- 172.21.15.96:0/1998429340 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffb3c00fb70 con 0x7ffb40105b80 2024-02-19T19:10:33.448 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.426+0000 7ffb48614700 1 -- 172.21.15.96:0/1998429340 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb401a1ae0 con 0x7ffb40105b80 2024-02-19T19:10:33.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.426+0000 7ffb48614700 1 -- 172.21.15.96:0/1998429340 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb401a1fd0 con 0x7ffb40105b80 2024-02-19T19:10:33.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.426+0000 7ffb377fe700 1 -- 172.21.15.96:0/1998429340 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb3c022d70 con 0x7ffb40105b80 2024-02-19T19:10:33.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.427+0000 7ffb48614700 1 -- 172.21.15.96:0/1998429340 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb24005320 con 0x7ffb40105b80 2024-02-19T19:10:33.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.428+0000 7ffb377fe700 1 -- 172.21.15.96:0/1998429340 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7ffb3c020070 con 0x7ffb40105b80 2024-02-19T19:10:33.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.428+0000 7ffb377fe700 1 --2- 172.21.15.96:0/1998429340 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ffb2c06d8a0 0x7ffb2c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:33.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.429+0000 7ffb463b0700 1 --2- 172.21.15.96:0/1998429340 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ffb2c06d8a0 0x7ffb2c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:33.450 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.429+0000 7ffb377fe700 1 -- 172.21.15.96:0/1998429340 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ffb3c08e210 con 0x7ffb40105b80 2024-02-19T19:10:33.451 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.429+0000 7ffb463b0700 1 --2- 172.21.15.96:0/1998429340 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ffb2c06d8a0 0x7ffb2c06fd60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffb30005950 tx=0x7ffb30009310 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:33.455 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.434+0000 7ffb377fe700 1 -- 172.21.15.96:0/1998429340 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ffb3c057ba0 con 0x7ffb40105b80 2024-02-19T19:10:33.787 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:33 smithi096 podman[134873]: 2024-02-19 19:10:33.419316666 +0000 UTC m=+0.654076963 container remove bd206e2d21d6edd59afff969ccf22ab03059aa35052e384a56f45f1602c48556 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-activate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, ceph=True) 2024-02-19T19:10:33.788 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:33 smithi096 podman[134978]: 2024-02-19 19:10:33.559576907 +0000 UTC m=+0.019404413 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:10:33.788 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:33 smithi096 podman[134978]: 2024-02-19 19:10:33.662072891 +0000 UTC m=+0.121900431 container create 51b70eaaa7a92f35c9b6ef094d45dfd667b821e74ba1c94ed2112ebe13a30c56 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T19:10:33.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.843+0000 7ffb48614700 1 -- 172.21.15.96:0/1998429340 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb24000bf0 con 0x7ffb2c06d8a0 2024-02-19T19:10:33.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.845+0000 7ffb377fe700 1 -- 172.21.15.96:0/1998429340 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ffb24000bf0 con 0x7ffb2c06d8a0 2024-02-19T19:10:33.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.848+0000 7ffb48614700 1 -- 172.21.15.96:0/1998429340 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ffb2c06d8a0 msgr2=0x7ffb2c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:33.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.848+0000 7ffb48614700 1 --2- 172.21.15.96:0/1998429340 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ffb2c06d8a0 0x7ffb2c06fd60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffb30005950 tx=0x7ffb30009310 comp rx=0 tx=0).stop 2024-02-19T19:10:33.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.848+0000 7ffb48614700 1 -- 172.21.15.96:0/1998429340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb40105b80 msgr2=0x7ffb4019d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:33.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.848+0000 7ffb48614700 1 --2- 172.21.15.96:0/1998429340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb40105b80 0x7ffb4019d3f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c000c00 tx=0x7ffb3c0047b0 comp rx=0 tx=0).stop 2024-02-19T19:10:33.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.848+0000 7ffb48614700 1 -- 172.21.15.96:0/1998429340 shutdown_connections 2024-02-19T19:10:33.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.848+0000 7ffb48614700 1 --2- 172.21.15.96:0/1998429340 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ffb2c06d8a0 0x7ffb2c06fd60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:33.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.848+0000 7ffb48614700 1 --2- 172.21.15.96:0/1998429340 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb40068ac0 0x7ffb4019ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:33.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.848+0000 7ffb48614700 1 --2- 172.21.15.96:0/1998429340 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb40105b80 0x7ffb4019d3f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:33.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.848+0000 7ffb48614700 1 -- 172.21.15.96:0/1998429340 >> 172.21.15.96:0/1998429340 conn(0x7ffb40075670 msgr2=0x7ffb401016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:33.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.848+0000 7ffb48614700 1 -- 172.21.15.96:0/1998429340 shutdown_connections 2024-02-19T19:10:33.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.848+0000 7ffb48614700 1 -- 172.21.15.96:0/1998429340 wait complete. 2024-02-19T19:10:33.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.963+0000 7fed96da4700 1 -- 172.21.15.96:0/3312196856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed901006b0 msgr2=0x7fed90100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:33.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.963+0000 7fed96da4700 1 --2- 172.21.15.96:0/3312196856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed901006b0 0x7fed90100a90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fed84009910 tx=0x7fed84009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:33.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.963+0000 7fed96da4700 1 -- 172.21.15.96:0/3312196856 shutdown_connections 2024-02-19T19:10:33.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.963+0000 7fed96da4700 1 --2- 172.21.15.96:0/3312196856 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed90101060 0x7fed901047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:33.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.963+0000 7fed96da4700 1 --2- 172.21.15.96:0/3312196856 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed901006b0 0x7fed90100a90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:33.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.963+0000 7fed96da4700 1 -- 172.21.15.96:0/3312196856 >> 172.21.15.96:0/3312196856 conn(0x7fed90074e30 msgr2=0x7fed90075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:33.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.964+0000 7fed96da4700 1 -- 172.21.15.96:0/3312196856 shutdown_connections 2024-02-19T19:10:33.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.964+0000 7fed96da4700 1 -- 172.21.15.96:0/3312196856 wait complete. 2024-02-19T19:10:33.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.964+0000 7fed96da4700 1 Processor -- start 2024-02-19T19:10:33.986 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.964+0000 7fed96da4700 1 -- start start 2024-02-19T19:10:33.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.965+0000 7fed96da4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed901006b0 0x7fed90194670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:33.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.965+0000 7fed96da4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed90101060 0x7fed90194bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:33.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.965+0000 7fed96da4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed90195290 con 0x7fed901006b0 2024-02-19T19:10:33.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.965+0000 7fed96da4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed90199020 con 0x7fed90101060 2024-02-19T19:10:33.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.965+0000 7fed94b40700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed901006b0 0x7fed90194670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:33.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.965+0000 7fed94b40700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed901006b0 0x7fed90194670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46882/0 (socket says 172.21.15.96:46882) 2024-02-19T19:10:33.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.965+0000 7fed94b40700 1 -- 172.21.15.96:0/1135664059 learned_addr learned my addr 172.21.15.96:0/1135664059 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:10:33.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.965+0000 7fed8ffff700 1 --2- 172.21.15.96:0/1135664059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed90101060 0x7fed90194bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:33.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.965+0000 7fed94b40700 1 -- 172.21.15.96:0/1135664059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed90101060 msgr2=0x7fed90194bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:33.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.965+0000 7fed94b40700 1 --2- 172.21.15.96:0/1135664059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed90101060 0x7fed90194bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:33.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.965+0000 7fed94b40700 1 -- 172.21.15.96:0/1135664059 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed840095f0 con 0x7fed901006b0 2024-02-19T19:10:33.988 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.966+0000 7fed94b40700 1 --2- 172.21.15.96:0/1135664059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed901006b0 0x7fed90194670 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fed8400b5c0 tx=0x7fed8400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:33.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.966+0000 7fed8dffb700 1 -- 172.21.15.96:0/1135664059 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed8401d070 con 0x7fed901006b0 2024-02-19T19:10:33.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.966+0000 7fed96da4700 1 -- 172.21.15.96:0/1135664059 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed901992a0 con 0x7fed901006b0 2024-02-19T19:10:33.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.966+0000 7fed96da4700 1 -- 172.21.15.96:0/1135664059 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed90199790 con 0x7fed901006b0 2024-02-19T19:10:33.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.966+0000 7fed8dffb700 1 -- 172.21.15.96:0/1135664059 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed84005e00 con 0x7fed901006b0 2024-02-19T19:10:33.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.966+0000 7fed8dffb700 1 -- 172.21.15.96:0/1135664059 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed8400fdb0 con 0x7fed901006b0 2024-02-19T19:10:33.989 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.967+0000 7fed96da4700 1 -- 172.21.15.96:0/1135664059 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed74005320 con 0x7fed901006b0 2024-02-19T19:10:33.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.968+0000 7fed8dffb700 1 -- 172.21.15.96:0/1135664059 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fed8402b440 con 0x7fed901006b0 2024-02-19T19:10:33.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.968+0000 7fed8dffb700 1 --2- 172.21.15.96:0/1135664059 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fed8006fab0 0x7fed80071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:33.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.968+0000 7fed8dffb700 1 -- 172.21.15.96:0/1135664059 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fed8408e7c0 con 0x7fed901006b0 2024-02-19T19:10:33.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.968+0000 7fed8ffff700 1 --2- 172.21.15.96:0/1135664059 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fed8006fab0 0x7fed80071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:33.990 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.969+0000 7fed8ffff700 1 --2- 172.21.15.96:0/1135664059 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fed8006fab0 0x7fed80071f70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fed90195c90 tx=0x7fed7c0073d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:33.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:33.973+0000 7fed8dffb700 1 -- 172.21.15.96:0/1135664059 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fed840580a0 con 0x7fed901006b0 2024-02-19T19:10:34.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.250+0000 7fed96da4700 1 -- 172.21.15.96:0/1135664059 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fed74000bf0 con 0x7fed8006fab0 2024-02-19T19:10:34.272 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:33 smithi096 podman[134978]: 2024-02-19 19:10:33.898139808 +0000 UTC m=+0.357967320 container init 51b70eaaa7a92f35c9b6ef094d45dfd667b821e74ba1c94ed2112ebe13a30c56 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-02-19T19:10:34.272 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:33 smithi096 podman[134978]: 2024-02-19 19:10:33.902797359 +0000 UTC m=+0.362624868 container start 51b70eaaa7a92f35c9b6ef094d45dfd667b821e74ba1c94ed2112ebe13a30c56 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-02-19T19:10:34.272 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:33 smithi096 ceph-osd[134998]: -- 172.21.15.96:0/2168081746 <== mon.0 v2:172.21.15.96:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5647f13c91e0 con 0x5647f139ac00 2024-02-19T19:10:34.272 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:33 smithi096 bash[134978]: 51b70eaaa7a92f35c9b6ef094d45dfd667b821e74ba1c94ed2112ebe13a30c56 2024-02-19T19:10:34.272 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:33 smithi096 systemd[1]: Started Ceph osd.2 for 06580d2c-cf58-11ee-95bb-87774f69a715. 2024-02-19T19:10:34.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.266+0000 7fed8dffb700 1 -- 172.21.15.96:0/1135664059 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fed74000bf0 con 0x7fed8006fab0 2024-02-19T19:10:34.288 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:10:34.288 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (4m) 17s ago 14m 24.9M - 0.25.0 c8568f914cd2 bbaf83a1e476 2024-02-19T19:10:34.288 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (14m) 17s ago 14m 8430k - 18.2.1 94eadd990e0a b41bff2e0043 2024-02-19T19:10:34.289 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (13m) 79s ago 13m 8044k - 18.2.1 94eadd990e0a 254ab7e7a040 2024-02-19T19:10:34.289 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (88s) 17s ago 14m 6669k - 19.0.0-1450-gf78a58c0 f081f847070a deea0ffefa0f 2024-02-19T19:10:34.289 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (82s) 79s ago 13m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 3421965dc5b0 2024-02-19T19:10:34.289 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4m) 17s ago 14m 87.1M - 9.4.12 a0ea5e3c46d9 0102d90938e4 2024-02-19T19:10:34.289 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (8m) 17s ago 8m 27.6M - 18.2.1 94eadd990e0a 0a61d9cd40d1 2024-02-19T19:10:34.289 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (8m) 17s ago 8m 24.6M - 18.2.1 94eadd990e0a 58db3e7a7d75 2024-02-19T19:10:34.289 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (8m) 79s ago 8m 28.4M - 18.2.1 94eadd990e0a 211d64de8a63 2024-02-19T19:10:34.289 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (8m) 79s ago 8m 26.5M - 18.2.1 94eadd990e0a 2a04b5a8eaf4 2024-02-19T19:10:34.289 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:8443,9283,8765 running (6m) 17s ago 15m 499M - 19.0.0-1450-gf78a58c0 f081f847070a a86fbe94fe3f 2024-02-19T19:10:34.289 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (5m) 79s ago 13m 448M - 19.0.0-1450-gf78a58c0 f081f847070a e250486d572d 2024-02-19T19:10:34.289 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (2m) 17s ago 16m 49.2M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d70090d516e3 2024-02-19T19:10:34.289 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (2m) 79s ago 13m 36.7M 2048M 19.0.0-1450-gf78a58c0 f081f847070a f56b17bdc9a0 2024-02-19T19:10:34.289 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (5m) 17s ago 14m 15.5M - 1.5.0 0da6a335fe13 51f622ea33d6 2024-02-19T19:10:34.289 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (5m) 79s ago 13m 17.2M - 1.5.0 0da6a335fe13 464e076a52a1 2024-02-19T19:10:34.289 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (60s) 17s ago 12m 46.9M 1216M 19.0.0-1450-gf78a58c0 f081f847070a b3dffd6a3fb2 2024-02-19T19:10:34.290 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (23s) 17s ago 11m 12.6M 1216M 19.0.0-1450-gf78a58c0 f081f847070a f0dd6d8f952f 2024-02-19T19:10:34.290 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 starting - - - 1216M 2024-02-19T19:10:34.290 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (11m) 79s ago 11m 51.9M 2240M 18.2.1 94eadd990e0a 4746b79351fc 2024-02-19T19:10:34.290 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (10m) 79s ago 10m 51.2M 2240M 18.2.1 94eadd990e0a 2b3f0088f6b2 2024-02-19T19:10:34.290 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (10m) 79s ago 10m 48.0M 2240M 18.2.1 94eadd990e0a e5731974b46a 2024-02-19T19:10:34.290 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (5m) 17s ago 13m 64.8M - 2.43.0 a07b618ecd1d a4edcf6ed669 2024-02-19T19:10:34.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.269+0000 7fed96da4700 1 -- 172.21.15.96:0/1135664059 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fed8006fab0 msgr2=0x7fed80071f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:34.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.269+0000 7fed96da4700 1 --2- 172.21.15.96:0/1135664059 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fed8006fab0 0x7fed80071f70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fed90195c90 tx=0x7fed7c0073d0 comp rx=0 tx=0).stop 2024-02-19T19:10:34.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.269+0000 7fed96da4700 1 -- 172.21.15.96:0/1135664059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed901006b0 msgr2=0x7fed90194670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:34.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.269+0000 7fed96da4700 1 --2- 172.21.15.96:0/1135664059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed901006b0 0x7fed90194670 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fed8400b5c0 tx=0x7fed8400bd70 comp rx=0 tx=0).stop 2024-02-19T19:10:34.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.269+0000 7fed96da4700 1 -- 172.21.15.96:0/1135664059 shutdown_connections 2024-02-19T19:10:34.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.269+0000 7fed96da4700 1 --2- 172.21.15.96:0/1135664059 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fed8006fab0 0x7fed80071f70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:34.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.269+0000 7fed96da4700 1 --2- 172.21.15.96:0/1135664059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fed901006b0 0x7fed90194670 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:34.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.269+0000 7fed96da4700 1 --2- 172.21.15.96:0/1135664059 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed90101060 0x7fed90194bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:34.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.269+0000 7fed96da4700 1 -- 172.21.15.96:0/1135664059 >> 172.21.15.96:0/1135664059 conn(0x7fed90074e30 msgr2=0x7fed900fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:34.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.269+0000 7fed96da4700 1 -- 172.21.15.96:0/1135664059 shutdown_connections 2024-02-19T19:10:34.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.269+0000 7fed96da4700 1 -- 172.21.15.96:0/1135664059 wait complete. 2024-02-19T19:10:34.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.418+0000 7fdde744f700 1 -- 172.21.15.96:0/1198333126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdde00ffc20 msgr2=0x7fdde0100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:34.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.418+0000 7fdde744f700 1 --2- 172.21.15.96:0/1198333126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdde00ffc20 0x7fdde0100080 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009910 tx=0x7fddd0009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:34.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.418+0000 7fdde744f700 1 -- 172.21.15.96:0/1198333126 shutdown_connections 2024-02-19T19:10:34.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.418+0000 7fdde744f700 1 --2- 172.21.15.96:0/1198333126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdde00ffc20 0x7fdde0100080 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:34.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.418+0000 7fdde744f700 1 --2- 172.21.15.96:0/1198333126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdde0105bd0 0x7fdde0105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:34.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.418+0000 7fdde744f700 1 -- 172.21.15.96:0/1198333126 >> 172.21.15.96:0/1198333126 conn(0x7fdde0075670 msgr2=0x7fdde0075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:34.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.418+0000 7fdde744f700 1 -- 172.21.15.96:0/1198333126 shutdown_connections 2024-02-19T19:10:34.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.418+0000 7fdde744f700 1 -- 172.21.15.96:0/1198333126 wait complete. 2024-02-19T19:10:34.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.418+0000 7fdde744f700 1 Processor -- start 2024-02-19T19:10:34.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.419+0000 7fdde744f700 1 -- start start 2024-02-19T19:10:34.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.419+0000 7fdde744f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdde0105bd0 0x7fdde0194720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:34.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.419+0000 7fdde744f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdde0194c60 0x7fdde01950e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:34.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.419+0000 7fdde744f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde01987a0 con 0x7fdde0105bd0 2024-02-19T19:10:34.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.419+0000 7fdde744f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde0198910 con 0x7fdde0194c60 2024-02-19T19:10:34.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.419+0000 7fdde51eb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdde0105bd0 0x7fdde0194720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:34.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.419+0000 7fdde51eb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdde0105bd0 0x7fdde0194720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46894/0 (socket says 172.21.15.96:46894) 2024-02-19T19:10:34.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.419+0000 7fdde51eb700 1 -- 172.21.15.96:0/2603089761 learned_addr learned my addr 172.21.15.96:0/2603089761 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:10:34.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.419+0000 7fdde49ea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdde0194c60 0x7fdde01950e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:34.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.419+0000 7fdde51eb700 1 -- 172.21.15.96:0/2603089761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdde0194c60 msgr2=0x7fdde01950e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:34.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.419+0000 7fdde51eb700 1 --2- 172.21.15.96:0/2603089761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdde0194c60 0x7fdde01950e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:34.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.419+0000 7fdde51eb700 1 -- 172.21.15.96:0/2603089761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd00095f0 con 0x7fdde0105bd0 2024-02-19T19:10:34.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.419+0000 7fdde49ea700 1 --2- 172.21.15.96:0/2603089761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdde0194c60 0x7fdde01950e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:10:34.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.420+0000 7fdde51eb700 1 --2- 172.21.15.96:0/2603089761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdde0105bd0 0x7fdde0194720 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00e920 tx=0x7fdddc00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:34.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.420+0000 7fddd67fc700 1 -- 172.21.15.96:0/2603089761 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdddc00c9d0 con 0x7fdde0105bd0 2024-02-19T19:10:34.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.420+0000 7fdde744f700 1 -- 172.21.15.96:0/2603089761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde01a7370 con 0x7fdde0105bd0 2024-02-19T19:10:34.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.420+0000 7fddd67fc700 1 -- 172.21.15.96:0/2603089761 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdddc010430 con 0x7fdde0105bd0 2024-02-19T19:10:34.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.420+0000 7fddd67fc700 1 -- 172.21.15.96:0/2603089761 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdddc00c9d0 con 0x7fdde0105bd0 2024-02-19T19:10:34.443 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.420+0000 7fdde744f700 1 -- 172.21.15.96:0/2603089761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde01a7890 con 0x7fdde0105bd0 2024-02-19T19:10:34.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.422+0000 7fdde744f700 1 -- 172.21.15.96:0/2603089761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde01080d0 con 0x7fdde0105bd0 2024-02-19T19:10:34.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.422+0000 7fddd67fc700 1 -- 172.21.15.96:0/2603089761 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fdddc0105a0 con 0x7fdde0105bd0 2024-02-19T19:10:34.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.422+0000 7fddd67fc700 1 --2- 172.21.15.96:0/2603089761 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fddcc06d960 0x7fddcc06fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:34.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.423+0000 7fdde49ea700 1 --2- 172.21.15.96:0/2603089761 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fddcc06d960 0x7fddcc06fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:34.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.423+0000 7fddd67fc700 1 -- 172.21.15.96:0/2603089761 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdddc014070 con 0x7fdde0105bd0 2024-02-19T19:10:34.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.423+0000 7fdde49ea700 1 --2- 172.21.15.96:0/2603089761 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fddcc06d960 0x7fddcc06fe20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fddd0006010 tx=0x7fddd0005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:34.449 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.428+0000 7fddd67fc700 1 -- 172.21.15.96:0/2603089761 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdddc052d20 con 0x7fdde0105bd0 2024-02-19T19:10:34.538 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:34 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2[134991]: 2024-02-19T19:10:34.460+0000 7f2b9dd257c0 -1 Falling back to public interface 2024-02-19T19:10:34.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:34 smithi096 ceph-mon[112483]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:34.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:34 smithi096 ceph-mon[112483]: pgmap v89: 65 pgs: 7 active+undersized+degraded, 8 peering, 12 active+undersized, 38 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 14/129 objects degraded (10.853%) 2024-02-19T19:10:34.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:34 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:34.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:34 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:34.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:34 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:10:34.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:34 smithi125 ceph-mon[86115]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:34.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:34 smithi125 ceph-mon[86115]: pgmap v89: 65 pgs: 7 active+undersized+degraded, 8 peering, 12 active+undersized, 38 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 14/129 objects degraded (10.853%) 2024-02-19T19:10:34.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:34 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:34.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:34 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:34.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:34 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:10:34.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.761+0000 7fdde744f700 1 -- 172.21.15.96:0/2603089761 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdde004f2e0 con 0x7fdde0105bd0 2024-02-19T19:10:34.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.762+0000 7fddd67fc700 1 -- 172.21.15.96:0/2603089761 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fdddc056b90 con 0x7fdde0105bd0 2024-02-19T19:10:34.783 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:10:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:10:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:10:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:10:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:10:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:10:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:10:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:10:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 3, 2024-02-19T19:10:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:10:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:10:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:10:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-19T19:10:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:10:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:10:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 7, 2024-02-19T19:10:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-19T19:10:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:10:34.785 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:10:34.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.765+0000 7fdde744f700 1 -- 172.21.15.96:0/2603089761 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fddcc06d960 msgr2=0x7fddcc06fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:34.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.765+0000 7fdde744f700 1 --2- 172.21.15.96:0/2603089761 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fddcc06d960 0x7fddcc06fe20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fddd0006010 tx=0x7fddd0005a90 comp rx=0 tx=0).stop 2024-02-19T19:10:34.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.765+0000 7fdde744f700 1 -- 172.21.15.96:0/2603089761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdde0105bd0 msgr2=0x7fdde0194720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:34.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.765+0000 7fdde744f700 1 --2- 172.21.15.96:0/2603089761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdde0105bd0 0x7fdde0194720 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdddc00e920 tx=0x7fdddc00ec30 comp rx=0 tx=0).stop 2024-02-19T19:10:34.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.765+0000 7fdde744f700 1 -- 172.21.15.96:0/2603089761 shutdown_connections 2024-02-19T19:10:34.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.765+0000 7fdde744f700 1 --2- 172.21.15.96:0/2603089761 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fddcc06d960 0x7fddcc06fe20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:34.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.765+0000 7fdde744f700 1 --2- 172.21.15.96:0/2603089761 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdde0105bd0 0x7fdde0194720 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:34.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.765+0000 7fdde744f700 1 --2- 172.21.15.96:0/2603089761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdde0194c60 0x7fdde01950e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:34.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.765+0000 7fdde744f700 1 -- 172.21.15.96:0/2603089761 >> 172.21.15.96:0/2603089761 conn(0x7fdde0075670 msgr2=0x7fdde0104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:34.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.765+0000 7fdde744f700 1 -- 172.21.15.96:0/2603089761 shutdown_connections 2024-02-19T19:10:34.787 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.765+0000 7fdde744f700 1 -- 172.21.15.96:0/2603089761 wait complete. 2024-02-19T19:10:34.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.899+0000 7fdd6a8d0700 1 -- 172.21.15.96:0/2821661441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd64101830 msgr2=0x7fdd64105880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:34.921 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.899+0000 7fdd6a8d0700 1 --2- 172.21.15.96:0/2821661441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd64101830 0x7fdd64105880 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdd58009910 tx=0x7fdd58009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:34.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.900+0000 7fdd6a8d0700 1 -- 172.21.15.96:0/2821661441 shutdown_connections 2024-02-19T19:10:34.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.900+0000 7fdd6a8d0700 1 --2- 172.21.15.96:0/2821661441 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd64101830 0x7fdd64105880 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdd58009910 tx=0x7fdd58009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:34.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.900+0000 7fdd6a8d0700 1 --2- 172.21.15.96:0/2821661441 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd64100e80 0x7fdd64101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:34.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.900+0000 7fdd6a8d0700 1 -- 172.21.15.96:0/2821661441 >> 172.21.15.96:0/2821661441 conn(0x7fdd640fc730 msgr2=0x7fdd640feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:34.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.900+0000 7fdd6a8d0700 1 -- 172.21.15.96:0/2821661441 shutdown_connections 2024-02-19T19:10:34.922 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.900+0000 7fdd6a8d0700 1 -- 172.21.15.96:0/2821661441 wait complete. 2024-02-19T19:10:34.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.901+0000 7fdd6a8d0700 1 Processor -- start 2024-02-19T19:10:34.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.901+0000 7fdd6a8d0700 1 -- start start 2024-02-19T19:10:34.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.901+0000 7fdd6a8d0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd64100e80 0x7fdd6419c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:34.923 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.901+0000 7fdd6a8d0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd6419cdb0 0x7fdd641968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:34.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.901+0000 7fdd6a8d0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6419d380 con 0x7fdd64100e80 2024-02-19T19:10:34.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.901+0000 7fdd6a8d0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd64196e30 con 0x7fdd6419cdb0 2024-02-19T19:10:34.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.901+0000 7fdd63fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd64100e80 0x7fdd6419c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:34.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.901+0000 7fdd63fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd64100e80 0x7fdd6419c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46914/0 (socket says 172.21.15.96:46914) 2024-02-19T19:10:34.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.901+0000 7fdd63fff700 1 -- 172.21.15.96:0/1591062257 learned_addr learned my addr 172.21.15.96:0/1591062257 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:10:34.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.901+0000 7fdd637fe700 1 --2- 172.21.15.96:0/1591062257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd6419cdb0 0x7fdd641968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:34.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.902+0000 7fdd63fff700 1 -- 172.21.15.96:0/1591062257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd6419cdb0 msgr2=0x7fdd641968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:34.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.902+0000 7fdd63fff700 1 --2- 172.21.15.96:0/1591062257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd6419cdb0 0x7fdd641968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:34.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.902+0000 7fdd63fff700 1 -- 172.21.15.96:0/1591062257 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd580095f0 con 0x7fdd64100e80 2024-02-19T19:10:34.924 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.902+0000 7fdd63fff700 1 --2- 172.21.15.96:0/1591062257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd64100e80 0x7fdd6419c870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdd54011ce0 tx=0x7fdd5400bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:34.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.902+0000 7fdd617fa700 1 -- 172.21.15.96:0/1591062257 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd54009c80 con 0x7fdd64100e80 2024-02-19T19:10:34.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.902+0000 7fdd617fa700 1 -- 172.21.15.96:0/1591062257 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd54009de0 con 0x7fdd64100e80 2024-02-19T19:10:34.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.902+0000 7fdd6a8d0700 1 -- 172.21.15.96:0/1591062257 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd641970b0 con 0x7fdd64100e80 2024-02-19T19:10:34.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.902+0000 7fdd617fa700 1 -- 172.21.15.96:0/1591062257 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd5401a900 con 0x7fdd64100e80 2024-02-19T19:10:34.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.902+0000 7fdd6a8d0700 1 -- 172.21.15.96:0/1591062257 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd64197600 con 0x7fdd64100e80 2024-02-19T19:10:34.925 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.903+0000 7fdd6a8d0700 1 -- 172.21.15.96:0/1591062257 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd64109280 con 0x7fdd64100e80 2024-02-19T19:10:34.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.905+0000 7fdd617fa700 1 -- 172.21.15.96:0/1591062257 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fdd5401aa60 con 0x7fdd64100e80 2024-02-19T19:10:34.926 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.905+0000 7fdd617fa700 1 --2- 172.21.15.96:0/1591062257 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fdd4c06d8a0 0x7fdd4c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:34.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.905+0000 7fdd617fa700 1 -- 172.21.15.96:0/1591062257 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdd54091240 con 0x7fdd64100e80 2024-02-19T19:10:34.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.905+0000 7fdd637fe700 1 --2- 172.21.15.96:0/1591062257 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fdd4c06d8a0 0x7fdd4c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:34.927 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.906+0000 7fdd637fe700 1 --2- 172.21.15.96:0/1591062257 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fdd4c06d8a0 0x7fdd4c06fd60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdd58005e00 tx=0x7fdd5801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:34.936 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:34.914+0000 7fdd617fa700 1 -- 172.21.15.96:0/1591062257 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdd5405e650 con 0x7fdd64100e80 2024-02-19T19:10:35.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.178+0000 7fdd6a8d0700 1 -- 172.21.15.96:0/1591062257 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdd64197e00 con 0x7fdd64100e80 2024-02-19T19:10:35.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.179+0000 7fdd617fa700 1 -- 172.21.15.96:0/1591062257 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1869 (secure 0 0 0) 0x7fdd5405e1e0 con 0x7fdd64100e80 2024-02-19T19:10:35.202 INFO:teuthology.orchestra.run.smithi096.stdout:e19 2024-02-19T19:10:35.203 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:10:35.203 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:10:35.203 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2024-02-19T19:10:35.203 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:10:35.203 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:10:35.203 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2024-02-19T19:10:35.203 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 19 2024-02-19T19:10:35.203 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-19T19:10:35.203 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-02-19T19:01:42.881136+0000 2024-02-19T19:10:35.203 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2024-02-19T19:02:02.873590+0000 2024-02-19T19:10:35.203 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2024-02-19T19:10:35.203 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2024-02-19T19:10:35.203 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2024-02-19T19:10:35.203 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2024-02-19T19:10:35.203 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2024-02-19T19:10:35.203 INFO:teuthology.orchestra.run.smithi096.stdout:max_xattr_size 65536 2024-02-19T19:10:35.204 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2024-02-19T19:10:35.204 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2024-02-19T19:10:35.204 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 46 2024-02-19T19:10:35.204 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:10:35.204 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2024-02-19T19:10:35.204 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2024-02-19T19:10:35.204 INFO:teuthology.orchestra.run.smithi096.stdout:up {0=14490,1=24267} 2024-02-19T19:10:35.204 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2024-02-19T19:10:35.204 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2024-02-19T19:10:35.204 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2024-02-19T19:10:35.204 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2024-02-19T19:10:35.204 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2024-02-19T19:10:35.204 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data enabled 2024-02-19T19:10:35.204 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2024-02-19T19:10:35.204 INFO:teuthology.orchestra.run.smithi096.stdout:bal_rank_mask -1 2024-02-19T19:10:35.204 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2024-02-19T19:10:35.204 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pccmys{0:14490} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:10:35.205 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.usrmcg{0:14502} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/413113741,v1:172.21.15.96:6827/413113741] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:10:35.205 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.srnlol{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.125:6824/3084054986,v1:172.21.15.125:6825/3084054986] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:10:35.205 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.pwyuga{1:24275} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.125:6826/3098247423,v1:172.21.15.125:6827/3098247423] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:10:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:10:35.205 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:10:35.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.181+0000 7fdd6a8d0700 1 -- 172.21.15.96:0/1591062257 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fdd4c06d8a0 msgr2=0x7fdd4c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:35.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.181+0000 7fdd6a8d0700 1 --2- 172.21.15.96:0/1591062257 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fdd4c06d8a0 0x7fdd4c06fd60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdd58005e00 tx=0x7fdd5801a040 comp rx=0 tx=0).stop 2024-02-19T19:10:35.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.181+0000 7fdd6a8d0700 1 -- 172.21.15.96:0/1591062257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd64100e80 msgr2=0x7fdd6419c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:35.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.181+0000 7fdd6a8d0700 1 --2- 172.21.15.96:0/1591062257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd64100e80 0x7fdd6419c870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdd54011ce0 tx=0x7fdd5400bf20 comp rx=0 tx=0).stop 2024-02-19T19:10:35.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.181+0000 7fdd6a8d0700 1 -- 172.21.15.96:0/1591062257 shutdown_connections 2024-02-19T19:10:35.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.181+0000 7fdd6a8d0700 1 --2- 172.21.15.96:0/1591062257 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fdd4c06d8a0 0x7fdd4c06fd60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:35.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.181+0000 7fdd6a8d0700 1 --2- 172.21.15.96:0/1591062257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd64100e80 0x7fdd6419c870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:35.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.181+0000 7fdd6a8d0700 1 --2- 172.21.15.96:0/1591062257 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd6419cdb0 0x7fdd641968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:35.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.181+0000 7fdd6a8d0700 1 -- 172.21.15.96:0/1591062257 >> 172.21.15.96:0/1591062257 conn(0x7fdd640fc730 msgr2=0x7fdd640fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:35.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.182+0000 7fdd6a8d0700 1 -- 172.21.15.96:0/1591062257 shutdown_connections 2024-02-19T19:10:35.206 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.182+0000 7fdd6a8d0700 1 -- 172.21.15.96:0/1591062257 wait complete. 2024-02-19T19:10:35.206 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 19 2024-02-19T19:10:35.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.302+0000 7f350d194700 1 -- 172.21.15.96:0/2356138180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35080ffc20 msgr2=0x7f3508100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:35.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.302+0000 7f350d194700 1 --2- 172.21.15.96:0/2356138180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35080ffc20 0x7f3508100080 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009910 tx=0x7f34fc009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:35.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.302+0000 7f350d194700 1 -- 172.21.15.96:0/2356138180 shutdown_connections 2024-02-19T19:10:35.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.302+0000 7f350d194700 1 --2- 172.21.15.96:0/2356138180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35080ffc20 0x7f3508100080 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:35.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.302+0000 7f350d194700 1 --2- 172.21.15.96:0/2356138180 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3508105bd0 0x7f3508105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:35.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.302+0000 7f350d194700 1 -- 172.21.15.96:0/2356138180 >> 172.21.15.96:0/2356138180 conn(0x7f3508075670 msgr2=0x7f3508075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:35.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.302+0000 7f350d194700 1 -- 172.21.15.96:0/2356138180 shutdown_connections 2024-02-19T19:10:35.324 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.302+0000 7f350d194700 1 -- 172.21.15.96:0/2356138180 wait complete. 2024-02-19T19:10:35.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.304+0000 7f350d194700 1 Processor -- start 2024-02-19T19:10:35.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.304+0000 7f350d194700 1 -- start start 2024-02-19T19:10:35.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.304+0000 7f350d194700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3508105bd0 0x7f350819c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:35.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.305+0000 7f350d194700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f350819cde0 0x7f3508196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:35.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.305+0000 7f3506d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3508105bd0 0x7f350819c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:35.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.305+0000 7f3506d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3508105bd0 0x7f350819c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.96:42320/0 (socket says 172.21.15.96:42320) 2024-02-19T19:10:35.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.305+0000 7f3506d9d700 1 -- 172.21.15.96:0/790495666 learned_addr learned my addr 172.21.15.96:0/790495666 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:10:35.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.305+0000 7f350d194700 1 -- 172.21.15.96:0/790495666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350819d3b0 con 0x7f350819cde0 2024-02-19T19:10:35.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.306+0000 7f350d194700 1 -- 172.21.15.96:0/790495666 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3508196e60 con 0x7f3508105bd0 2024-02-19T19:10:35.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.306+0000 7f350659c700 1 --2- 172.21.15.96:0/790495666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f350819cde0 0x7f3508196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:35.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.307+0000 7f350659c700 1 -- 172.21.15.96:0/790495666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3508105bd0 msgr2=0x7f350819c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:35.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.307+0000 7f350659c700 1 --2- 172.21.15.96:0/790495666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3508105bd0 0x7f350819c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:35.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.307+0000 7f350659c700 1 -- 172.21.15.96:0/790495666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc0095f0 con 0x7f350819cde0 2024-02-19T19:10:35.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.308+0000 7f3506d9d700 1 --2- 172.21.15.96:0/790495666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3508105bd0 0x7f350819c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:10:35.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.308+0000 7f350659c700 1 --2- 172.21.15.96:0/790495666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f350819cde0 0x7f3508196920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f34fc008000 tx=0x7f34fc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:35.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.308+0000 7f34effff700 1 -- 172.21.15.96:0/790495666 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34fc01d070 con 0x7f350819cde0 2024-02-19T19:10:35.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.308+0000 7f350d194700 1 -- 172.21.15.96:0/790495666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35081970e0 con 0x7f350819cde0 2024-02-19T19:10:35.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.308+0000 7f350d194700 1 -- 172.21.15.96:0/790495666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3508197510 con 0x7f350819cde0 2024-02-19T19:10:35.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.308+0000 7f34effff700 1 -- 172.21.15.96:0/790495666 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f34fc005dc0 con 0x7f350819cde0 2024-02-19T19:10:35.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.309+0000 7f34effff700 1 -- 172.21.15.96:0/790495666 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34fc00fe50 con 0x7f350819cde0 2024-02-19T19:10:35.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.310+0000 7f350d194700 1 -- 172.21.15.96:0/790495666 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350804f2e0 con 0x7f350819cde0 2024-02-19T19:10:35.332 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.311+0000 7f34effff700 1 -- 172.21.15.96:0/790495666 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f34fc02b460 con 0x7f350819cde0 2024-02-19T19:10:35.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.311+0000 7f34effff700 1 --2- 172.21.15.96:0/790495666 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f34f006d8f0 0x7f34f006fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:35.333 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.312+0000 7f3506d9d700 1 --2- 172.21.15.96:0/790495666 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f34f006d8f0 0x7f34f006fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:35.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.312+0000 7f34effff700 1 -- 172.21.15.96:0/790495666 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f34fc08e780 con 0x7f350819cde0 2024-02-19T19:10:35.334 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.313+0000 7f3506d9d700 1 --2- 172.21.15.96:0/790495666 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f34f006d8f0 0x7f34f006fdb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009c90 tx=0x7f34f80092a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:35.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.316+0000 7f34effff700 1 -- 172.21.15.96:0/790495666 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f34fc05bb60 con 0x7f350819cde0 2024-02-19T19:10:35.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.661+0000 7f350d194700 1 -- 172.21.15.96:0/790495666 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3508197e30 con 0x7f34f006d8f0 2024-02-19T19:10:35.683 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:35 smithi096 ceph-mon[112483]: from='client.44175 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:35.683 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:35 smithi096 ceph-mon[112483]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:35.683 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:35 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/2603089761' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:35.683 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:35 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/1591062257' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:10:35.684 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:35.684 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:10:35.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.663+0000 7f34effff700 1 -- 172.21.15.96:0/790495666 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3508197e30 con 0x7f34f006d8f0 2024-02-19T19:10:35.684 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:10:35.684 INFO:teuthology.orchestra.run.smithi096.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:10:35.684 INFO:teuthology.orchestra.run.smithi096.stdout: "in_progress": true, 2024-02-19T19:10:35.685 INFO:teuthology.orchestra.run.smithi096.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:10:35.685 INFO:teuthology.orchestra.run.smithi096.stdout: "services_complete": [ 2024-02-19T19:10:35.685 INFO:teuthology.orchestra.run.smithi096.stdout: "crash", 2024-02-19T19:10:35.685 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr", 2024-02-19T19:10:35.685 INFO:teuthology.orchestra.run.smithi096.stdout: "mon" 2024-02-19T19:10:35.685 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-02-19T19:10:35.685 INFO:teuthology.orchestra.run.smithi096.stdout: "progress": "8/23 daemons upgraded", 2024-02-19T19:10:35.685 INFO:teuthology.orchestra.run.smithi096.stdout: "message": "Currently upgrading osd daemons", 2024-02-19T19:10:35.685 INFO:teuthology.orchestra.run.smithi096.stdout: "is_paused": false 2024-02-19T19:10:35.685 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:10:35.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.666+0000 7f350d194700 1 -- 172.21.15.96:0/790495666 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f34f006d8f0 msgr2=0x7f34f006fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:35.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.666+0000 7f350d194700 1 --2- 172.21.15.96:0/790495666 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f34f006d8f0 0x7f34f006fdb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009c90 tx=0x7f34f80092a0 comp rx=0 tx=0).stop 2024-02-19T19:10:35.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.666+0000 7f350d194700 1 -- 172.21.15.96:0/790495666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f350819cde0 msgr2=0x7f3508196920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:35.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.666+0000 7f350d194700 1 --2- 172.21.15.96:0/790495666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f350819cde0 0x7f3508196920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f34fc008000 tx=0x7f34fc00be20 comp rx=0 tx=0).stop 2024-02-19T19:10:35.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.666+0000 7f350d194700 1 -- 172.21.15.96:0/790495666 shutdown_connections 2024-02-19T19:10:35.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.666+0000 7f350d194700 1 --2- 172.21.15.96:0/790495666 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f34f006d8f0 0x7f34f006fdb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:35.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.666+0000 7f350d194700 1 --2- 172.21.15.96:0/790495666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3508105bd0 0x7f350819c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:35.688 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.666+0000 7f350d194700 1 --2- 172.21.15.96:0/790495666 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f350819cde0 0x7f3508196920 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:35.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.666+0000 7f350d194700 1 -- 172.21.15.96:0/790495666 >> 172.21.15.96:0/790495666 conn(0x7f3508075670 msgr2=0x7f35080fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:35.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.666+0000 7f350d194700 1 -- 172.21.15.96:0/790495666 shutdown_connections 2024-02-19T19:10:35.689 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.666+0000 7f350d194700 1 -- 172.21.15.96:0/790495666 wait complete. 2024-02-19T19:10:35.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:35 smithi125 ceph-mon[86115]: from='client.44175 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:35.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:35 smithi125 ceph-mon[86115]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:35.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:35 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/2603089761' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:35.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:35 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/1591062257' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:10:35.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:35.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:10:35.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.806+0000 7f82f00b5700 1 -- 172.21.15.96:0/2101246166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e8100e90 msgr2=0x7f82e8101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:35.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.806+0000 7f82f00b5700 1 --2- 172.21.15.96:0/2101246166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e8100e90 0x7f82e8101270 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f82e4009910 tx=0x7f82e4009c20 comp rx=0 tx=0).stop 2024-02-19T19:10:35.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.806+0000 7f82f00b5700 1 -- 172.21.15.96:0/2101246166 shutdown_connections 2024-02-19T19:10:35.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.806+0000 7f82f00b5700 1 --2- 172.21.15.96:0/2101246166 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82e8101840 0x7f82e8105890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:35.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.806+0000 7f82f00b5700 1 --2- 172.21.15.96:0/2101246166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e8100e90 0x7f82e8101270 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:35.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.806+0000 7f82f00b5700 1 -- 172.21.15.96:0/2101246166 >> 172.21.15.96:0/2101246166 conn(0x7f82e80fc740 msgr2=0x7f82e80feb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:35.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.806+0000 7f82f00b5700 1 -- 172.21.15.96:0/2101246166 shutdown_connections 2024-02-19T19:10:35.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.806+0000 7f82f00b5700 1 -- 172.21.15.96:0/2101246166 wait complete. 2024-02-19T19:10:35.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.807+0000 7f82f00b5700 1 Processor -- start 2024-02-19T19:10:35.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.807+0000 7f82f00b5700 1 -- start start 2024-02-19T19:10:35.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.807+0000 7f82f00b5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e8100e90 0x7f82e819e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:35.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.808+0000 7f82f00b5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82e8101840 0x7f82e819ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:35.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.808+0000 7f82f00b5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e819f410 con 0x7f82e8100e90 2024-02-19T19:10:35.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.808+0000 7f82f00b5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e81988c0 con 0x7f82e8101840 2024-02-19T19:10:35.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.808+0000 7f82ede51700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e8100e90 0x7f82e819e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:35.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.808+0000 7f82ede51700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e8100e90 0x7f82e819e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46946/0 (socket says 172.21.15.96:46946) 2024-02-19T19:10:35.830 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.808+0000 7f82ede51700 1 -- 172.21.15.96:0/3732061035 learned_addr learned my addr 172.21.15.96:0/3732061035 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:10:35.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.808+0000 7f82ed650700 1 --2- 172.21.15.96:0/3732061035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82e8101840 0x7f82e819ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:35.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.808+0000 7f82ede51700 1 -- 172.21.15.96:0/3732061035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82e8101840 msgr2=0x7f82e819ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:35.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.808+0000 7f82ede51700 1 --2- 172.21.15.96:0/3732061035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82e8101840 0x7f82e819ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:35.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.808+0000 7f82ede51700 1 -- 172.21.15.96:0/3732061035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e40095f0 con 0x7f82e8100e90 2024-02-19T19:10:35.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.808+0000 7f82ede51700 1 --2- 172.21.15.96:0/3732061035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e8100e90 0x7f82e819e840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f82e40092e0 tx=0x7f82e400f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:35.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.808+0000 7f82deffd700 1 -- 172.21.15.96:0/3732061035 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82e401d070 con 0x7f82e8100e90 2024-02-19T19:10:35.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.809+0000 7f82f00b5700 1 -- 172.21.15.96:0/3732061035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e8198b40 con 0x7f82e8100e90 2024-02-19T19:10:35.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.809+0000 7f82deffd700 1 -- 172.21.15.96:0/3732061035 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f82e40052a0 con 0x7f82e8100e90 2024-02-19T19:10:35.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.809+0000 7f82deffd700 1 -- 172.21.15.96:0/3732061035 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82e4017630 con 0x7f82e8100e90 2024-02-19T19:10:35.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.809+0000 7f82f00b5700 1 -- 172.21.15.96:0/3732061035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e8199030 con 0x7f82e8100e90 2024-02-19T19:10:35.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.810+0000 7f82f00b5700 1 -- 172.21.15.96:0/3732061035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e8105010 con 0x7f82e8100e90 2024-02-19T19:10:35.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.812+0000 7f82deffd700 1 -- 172.21.15.96:0/3732061035 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f82e40178f0 con 0x7f82e8100e90 2024-02-19T19:10:35.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.812+0000 7f82deffd700 1 --2- 172.21.15.96:0/3732061035 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f82d406d8a0 0x7f82d406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:35.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.812+0000 7f82deffd700 1 -- 172.21.15.96:0/3732061035 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f82e40600c0 con 0x7f82e8100e90 2024-02-19T19:10:35.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.813+0000 7f82ed650700 1 --2- 172.21.15.96:0/3732061035 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f82d406d8a0 0x7f82d406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:35.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.813+0000 7f82ed650700 1 --2- 172.21.15.96:0/3732061035 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f82d406d8a0 0x7f82d406fd60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f82e8105af0 tx=0x7f82d8009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:35.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:35.818+0000 7f82deffd700 1 -- 172.21.15.96:0/3732061035 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f82e40589a0 con 0x7f82e8100e90 2024-02-19T19:10:36.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:36.249+0000 7f82f00b5700 1 -- 172.21.15.96:0/3732061035 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f82e804f2e0 con 0x7f82e8100e90 2024-02-19T19:10:36.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:36.249+0000 7f82deffd700 1 -- 172.21.15.96:0/3732061035 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+962 (secure 0 0 0) 0x7f82e4003e60 con 0x7f82e8100e90 2024-02-19T19:10:36.272 INFO:teuthology.orchestra.run.smithi096.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 18/129 objects degraded (13.953%), 9 pgs degraded 2024-02-19T19:10:36.272 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-19T19:10:36.272 INFO:teuthology.orchestra.run.smithi096.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-19T19:10:36.272 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-19T19:10:36.272 INFO:teuthology.orchestra.run.smithi096.stdout: osd.2 (root=default,host=smithi096) is down 2024-02-19T19:10:36.272 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 18/129 objects degraded (13.953%), 9 pgs degraded 2024-02-19T19:10:36.272 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-02-19T19:10:36.272 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-02-19T19:10:36.272 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-02-19T19:10:36.273 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-02-19T19:10:36.273 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-02-19T19:10:36.273 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-02-19T19:10:36.273 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-02-19T19:10:36.273 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.17 is active+undersized+degraded, acting [5,1] 2024-02-19T19:10:36.273 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-02-19T19:10:36.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:36.252+0000 7f82f00b5700 1 -- 172.21.15.96:0/3732061035 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f82d406d8a0 msgr2=0x7f82d406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:36.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:36.252+0000 7f82f00b5700 1 --2- 172.21.15.96:0/3732061035 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f82d406d8a0 0x7f82d406fd60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f82e8105af0 tx=0x7f82d8009260 comp rx=0 tx=0).stop 2024-02-19T19:10:36.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:36.252+0000 7f82f00b5700 1 -- 172.21.15.96:0/3732061035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e8100e90 msgr2=0x7f82e819e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:36.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:36.252+0000 7f82f00b5700 1 --2- 172.21.15.96:0/3732061035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e8100e90 0x7f82e819e840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f82e40092e0 tx=0x7f82e400f460 comp rx=0 tx=0).stop 2024-02-19T19:10:36.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:36.252+0000 7f82f00b5700 1 -- 172.21.15.96:0/3732061035 shutdown_connections 2024-02-19T19:10:36.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:36.252+0000 7f82f00b5700 1 --2- 172.21.15.96:0/3732061035 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f82d406d8a0 0x7f82d406fd60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:36.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:36.252+0000 7f82f00b5700 1 --2- 172.21.15.96:0/3732061035 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f82e8100e90 0x7f82e819e840 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:36.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:36.252+0000 7f82f00b5700 1 --2- 172.21.15.96:0/3732061035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82e8101840 0x7f82e819ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:36.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:36.252+0000 7f82f00b5700 1 -- 172.21.15.96:0/3732061035 >> 172.21.15.96:0/3732061035 conn(0x7f82e80fc740 msgr2=0x7f82e80fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:36.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:36.252+0000 7f82f00b5700 1 -- 172.21.15.96:0/3732061035 shutdown_connections 2024-02-19T19:10:36.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:36.252+0000 7f82f00b5700 1 -- 172.21.15.96:0/3732061035 wait complete. 2024-02-19T19:10:36.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:36 smithi125 ceph-mon[86115]: pgmap v90: 65 pgs: 9 active+undersized+degraded, 18 active+undersized, 38 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 18/129 objects degraded (13.953%) 2024-02-19T19:10:36.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:36 smithi125 ceph-mon[86115]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2024-02-19T19:10:36.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:36 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/3732061035' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:10:36.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:36 smithi096 ceph-mon[112483]: pgmap v90: 65 pgs: 9 active+undersized+degraded, 18 active+undersized, 38 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 18/129 objects degraded (13.953%) 2024-02-19T19:10:36.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:36 smithi096 ceph-mon[112483]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 2 pgs peering) 2024-02-19T19:10:36.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:36 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/3732061035' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:10:37.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:37 smithi125 ceph-mon[86115]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:37.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:37 smithi125 ceph-mon[86115]: Health check update: Degraded data redundancy: 18/129 objects degraded (13.953%), 9 pgs degraded (PG_DEGRADED) 2024-02-19T19:10:37.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:37 smithi096 ceph-mon[112483]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:10:37.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:37 smithi096 ceph-mon[112483]: Health check update: Degraded data redundancy: 18/129 objects degraded (13.953%), 9 pgs degraded (PG_DEGRADED) 2024-02-19T19:10:38.282 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:37 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2[134991]: 2024-02-19T19:10:37.938+0000 7f2b9dd257c0 -1 osd.2 0 read_superblock omap replica is missing. 2024-02-19T19:10:38.282 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:37 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2[134991]: 2024-02-19T19:10:37.960+0000 7f2b9dd257c0 -1 osd.2 59 log_to_monitors true 2024-02-19T19:10:38.442 INFO:tasks.workunit.client.0.smithi096.stderr:Note: switching to '1ce7ea8877c709fa862eac608550374bd96e166e'. 2024-02-19T19:10:38.442 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-02-19T19:10:38.442 INFO:tasks.workunit.client.0.smithi096.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-19T19:10:38.442 INFO:tasks.workunit.client.0.smithi096.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-19T19:10:38.442 INFO:tasks.workunit.client.0.smithi096.stderr:state without impacting any branches by switching back to a branch. 2024-02-19T19:10:38.443 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-02-19T19:10:38.443 INFO:tasks.workunit.client.0.smithi096.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-19T19:10:38.443 INFO:tasks.workunit.client.0.smithi096.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-19T19:10:38.443 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-02-19T19:10:38.443 INFO:tasks.workunit.client.0.smithi096.stderr: git switch -c 2024-02-19T19:10:38.443 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-02-19T19:10:38.443 INFO:tasks.workunit.client.0.smithi096.stderr:Or undo this operation with: 2024-02-19T19:10:38.443 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-02-19T19:10:38.443 INFO:tasks.workunit.client.0.smithi096.stderr: git switch - 2024-02-19T19:10:38.443 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-02-19T19:10:38.443 INFO:tasks.workunit.client.0.smithi096.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-19T19:10:38.443 INFO:tasks.workunit.client.0.smithi096.stderr: 2024-02-19T19:10:38.443 INFO:tasks.workunit.client.0.smithi096.stderr:HEAD is now at 1ce7ea8877c fix 2024-02-19T19:10:38.448 DEBUG:teuthology.orchestra.run.smithi096:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-19T19:10:38.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:38 smithi096 ceph-mon[112483]: pgmap v91: 65 pgs: 9 active+undersized+degraded, 18 active+undersized, 38 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 18/129 objects degraded (13.953%) 2024-02-19T19:10:38.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:38 smithi096 ceph-mon[112483]: from='osd.2 [v2:172.21.15.96:6818/1975344907,v1:172.21.15.96:6819/1975344907]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-19T19:10:38.590 INFO:tasks.workunit.client.0.smithi096.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-19T19:10:38.593 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-19T19:10:38.593 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-19T19:10:38.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:38 smithi125 ceph-mon[86115]: pgmap v91: 65 pgs: 9 active+undersized+degraded, 18 active+undersized, 38 active+clean; 595 KiB data, 164 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 18/129 objects degraded (13.953%) 2024-02-19T19:10:38.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:38 smithi125 ceph-mon[86115]: from='osd.2 [v2:172.21.15.96:6818/1975344907,v1:172.21.15.96:6819/1975344907]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-19T19:10:40.106 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:39 smithi096 ceph-mon[112483]: from='osd.2 [v2:172.21.15.96:6818/1975344907,v1:172.21.15.96:6819/1975344907]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-19T19:10:40.106 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:39 smithi096 ceph-mon[112483]: osdmap e62: 6 total, 5 up, 6 in 2024-02-19T19:10:40.107 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:39 smithi096 ceph-mon[112483]: from='osd.2 [v2:172.21.15.96:6818/1975344907,v1:172.21.15.96:6819/1975344907]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2024-02-19T19:10:40.107 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:39 smithi096 ceph-mon[112483]: pgmap v93: 65 pgs: 9 active+undersized+degraded, 18 active+undersized, 38 active+clean; 595 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 18/129 objects degraded (13.953%) 2024-02-19T19:10:40.107 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:39 smithi096 ceph-mon[112483]: from='osd.2 [v2:172.21.15.96:6818/1975344907,v1:172.21.15.96:6819/1975344907]' entity='osd.2' 2024-02-19T19:10:40.107 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 19:10:39 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2[134991]: 2024-02-19T19:10:39.785+0000 7f2b8b175700 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T19:10:40.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:39 smithi125 ceph-mon[86115]: from='osd.2 [v2:172.21.15.96:6818/1975344907,v1:172.21.15.96:6819/1975344907]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-19T19:10:40.202 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:39 smithi125 ceph-mon[86115]: osdmap e62: 6 total, 5 up, 6 in 2024-02-19T19:10:40.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:39 smithi125 ceph-mon[86115]: from='osd.2 [v2:172.21.15.96:6818/1975344907,v1:172.21.15.96:6819/1975344907]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2024-02-19T19:10:40.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:39 smithi125 ceph-mon[86115]: pgmap v93: 65 pgs: 9 active+undersized+degraded, 18 active+undersized, 38 active+clean; 595 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 18/129 objects degraded (13.953%) 2024-02-19T19:10:40.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:39 smithi125 ceph-mon[86115]: from='osd.2 [v2:172.21.15.96:6818/1975344907,v1:172.21.15.96:6819/1975344907]' entity='osd.2' 2024-02-19T19:10:40.480 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-19T19:10:40.541 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-19T19:10:40.581 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-19T19:10:40.583 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-19T19:10:40.583 INFO:tasks.workunit.client.0.smithi096.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-19T19:10:40.625 INFO:tasks.workunit.client.0.smithi096.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-19T19:10:40.628 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-02-19T19:10:40.628 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-19T19:10:40.643 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-02-19T19:10:40.644 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-19T19:10:40.645 DEBUG:teuthology.orchestra.run.smithi096:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1ce7ea8877c709fa862eac608550374bd96e166e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-02-19T19:10:40.702 INFO:tasks.workunit.client.0.smithi096.stderr:+ mkdir -p fsstress 2024-02-19T19:10:40.704 INFO:tasks.workunit.client.0.smithi096.stderr:+ pushd fsstress 2024-02-19T19:10:40.704 INFO:tasks.workunit.client.0.smithi096.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-19T19:10:40.704 INFO:tasks.workunit.client.0.smithi096.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-19T19:10:41.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:41 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:41.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:41 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:41.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:41 smithi125 ceph-mon[86115]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:10:41.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:41 smithi125 ceph-mon[86115]: osd.2 [v2:172.21.15.96:6818/1975344907,v1:172.21.15.96:6819/1975344907] boot 2024-02-19T19:10:41.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:41 smithi125 ceph-mon[86115]: osdmap e63: 6 total, 6 up, 6 in 2024-02-19T19:10:41.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:41 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T19:10:41.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:41 smithi125 ceph-mon[86115]: pgmap v95: 65 pgs: 10 peering, 4 active+undersized+degraded, 13 active+undersized, 38 active+clean; 595 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 10/129 objects degraded (7.752%) 2024-02-19T19:10:42.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:41 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:42.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:41 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:42.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:41 smithi096 ceph-mon[112483]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:10:42.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:41 smithi096 ceph-mon[112483]: osd.2 [v2:172.21.15.96:6818/1975344907,v1:172.21.15.96:6819/1975344907] boot 2024-02-19T19:10:42.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:41 smithi096 ceph-mon[112483]: osdmap e63: 6 total, 6 up, 6 in 2024-02-19T19:10:42.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:41 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-19T19:10:42.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:41 smithi096 ceph-mon[112483]: pgmap v95: 65 pgs: 10 peering, 4 active+undersized+degraded, 13 active+undersized, 38 active+clean; 595 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 10/129 objects degraded (7.752%) 2024-02-19T19:10:42.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:42 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:42.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:42 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:42.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:42 smithi125 ceph-mon[86115]: osdmap e64: 6 total, 6 up, 6 in 2024-02-19T19:10:42.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:42 smithi125 ceph-mon[86115]: Health check update: Degraded data redundancy: 10/129 objects degraded (7.752%), 4 pgs degraded (PG_DEGRADED) 2024-02-19T19:10:43.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:42 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:43.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:42 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:43.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:42 smithi096 ceph-mon[112483]: osdmap e64: 6 total, 6 up, 6 in 2024-02-19T19:10:43.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:42 smithi096 ceph-mon[112483]: Health check update: Degraded data redundancy: 10/129 objects degraded (7.752%), 4 pgs degraded (PG_DEGRADED) 2024-02-19T19:10:43.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:43 smithi125 ceph-mon[86115]: pgmap v97: 65 pgs: 10 peering, 4 active+undersized+degraded, 13 active+undersized, 38 active+clean; 595 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 10/129 objects degraded (7.752%) 2024-02-19T19:10:43.978 INFO:tasks.workunit.client.0.smithi096.stderr:+ tar xzf ltp-full.tgz 2024-02-19T19:10:44.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:43 smithi096 ceph-mon[112483]: pgmap v97: 65 pgs: 10 peering, 4 active+undersized+degraded, 13 active+undersized, 38 active+clean; 595 KiB data, 165 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 10/129 objects degraded (7.752%) 2024-02-19T19:10:45.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:45 smithi125 ceph-mon[86115]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/129 objects degraded (7.752%), 4 pgs degraded) 2024-02-19T19:10:45.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:45 smithi096 ceph-mon[112483]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/129 objects degraded (7.752%), 4 pgs degraded) 2024-02-19T19:10:46.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:46 smithi125 ceph-mon[86115]: pgmap v98: 65 pgs: 10 peering, 55 active+clean; 595 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 160 B/s wr, 3 op/s 2024-02-19T19:10:46.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:46 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:46.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:46 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:46.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:46 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:10:46.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:46 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:10:46.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:46 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:46.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:46 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:10:46.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:46 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:46.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:46 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:46.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:46 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:46.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:46 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-19T19:10:46.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:46 smithi096 ceph-mon[112483]: pgmap v98: 65 pgs: 10 peering, 55 active+clean; 595 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 160 B/s wr, 3 op/s 2024-02-19T19:10:46.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:46 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:46.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:46 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:46.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:46 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:10:46.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:46 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:10:46.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:46 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:46.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:46 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:10:46.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:46 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:46.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:46 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:46.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:46 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:10:46.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:46 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-19T19:10:47.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:47 smithi125 ceph-mon[86115]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-19T19:10:47.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:47 smithi125 ceph-mon[86115]: Upgrade: unsafe to stop osd(s) at this time (5 PGs are or would become offline) 2024-02-19T19:10:47.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:47 smithi096 ceph-mon[112483]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-19T19:10:47.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:47 smithi096 ceph-mon[112483]: Upgrade: unsafe to stop osd(s) at this time (5 PGs are or would become offline) 2024-02-19T19:10:48.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:48 smithi125 ceph-mon[86115]: pgmap v99: 65 pgs: 65 active+clean; 14 MiB data, 184 MiB used, 536 GiB / 536 GiB avail; 513 KiB/s rd, 1.8 MiB/s wr, 127 op/s 2024-02-19T19:10:48.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:48 smithi096 ceph-mon[112483]: pgmap v99: 65 pgs: 65 active+clean; 14 MiB data, 184 MiB used, 536 GiB / 536 GiB avail; 513 KiB/s rd, 1.8 MiB/s wr, 127 op/s 2024-02-19T19:10:49.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:49 smithi125 ceph-mon[86115]: pgmap v100: 65 pgs: 65 active+clean; 21 MiB data, 209 MiB used, 536 GiB / 536 GiB avail; 481 KiB/s rd, 2.5 MiB/s wr, 197 op/s 2024-02-19T19:10:49.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:49 smithi096 ceph-mon[112483]: pgmap v100: 65 pgs: 65 active+clean; 21 MiB data, 209 MiB used, 536 GiB / 536 GiB avail; 481 KiB/s rd, 2.5 MiB/s wr, 197 op/s 2024-02-19T19:10:51.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:51.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:10:51.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:51.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:10:52.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:52 smithi096 ceph-mon[112483]: pgmap v101: 65 pgs: 65 active+clean; 32 MiB data, 287 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 222 op/s 2024-02-19T19:10:52.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:52 smithi125 ceph-mon[86115]: pgmap v101: 65 pgs: 65 active+clean; 32 MiB data, 287 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 222 op/s 2024-02-19T19:10:54.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:54 smithi125 ceph-mon[86115]: pgmap v102: 65 pgs: 65 active+clean; 32 MiB data, 287 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 192 op/s 2024-02-19T19:10:54.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:54 smithi096 ceph-mon[112483]: pgmap v102: 65 pgs: 65 active+clean; 32 MiB data, 287 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 192 op/s 2024-02-19T19:10:55.565 INFO:tasks.workunit.client.0.smithi096.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-19T19:10:55.571 INFO:tasks.workunit.client.0.smithi096.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-19T19:10:55.571 INFO:tasks.workunit.client.0.smithi096.stderr:+ make 2024-02-19T19:10:55.719 INFO:tasks.workunit.client.0.smithi096.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-19T19:10:56.170 INFO:tasks.workunit.client.0.smithi096.stderr:++ readlink -f fsstress 2024-02-19T19:10:56.171 INFO:tasks.workunit.client.0.smithi096.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-19T19:10:56.172 INFO:tasks.workunit.client.0.smithi096.stderr:+ popd 2024-02-19T19:10:56.172 INFO:tasks.workunit.client.0.smithi096.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-19T19:10:56.172 INFO:tasks.workunit.client.0.smithi096.stdout:~/cephtest/mnt.0/client.0/tmp 2024-02-19T19:10:56.172 INFO:tasks.workunit.client.0.smithi096.stderr:+ popd 2024-02-19T19:10:56.172 INFO:tasks.workunit.client.0.smithi096.stderr:++ mktemp -d -p . 2024-02-19T19:10:56.174 INFO:tasks.workunit.client.0.smithi096.stderr:+ T=./tmp.V1nsKrhMy2 2024-02-19T19:10:56.174 INFO:tasks.workunit.client.0.smithi096.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.V1nsKrhMy2 -l 1 -n 1000 -p 10 -v 2024-02-19T19:10:56.179 DEBUG:teuthology.orchestra.run:got remote process result: 126 2024-02-19T19:10:56.179 INFO:tasks.workunit.client.0.smithi096.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh: line 16: /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress: cannot execute binary file: Exec format error 2024-02-19T19:10:56.179 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-02-19T19:10:56.179 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-19T19:10:56.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:56 smithi096 ceph-mon[112483]: pgmap v103: 65 pgs: 65 active+clean; 40 MiB data, 296 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 187 op/s 2024-02-19T19:10:56.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:56 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:56.700 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_batrick_ceph_1ce7ea8877c709fa862eac608550374bd96e166e/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_batrick_ceph_1ce7ea8877c709fa862eac608550374bd96e166e/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_batrick_ceph_1ce7ea8877c709fa862eac608550374bd96e166e/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsstress.sh) on smithi096 with status 126: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1ce7ea8877c709fa862eac608550374bd96e166e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh' 2024-02-19T19:10:56.911 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=be1d0e5ca65b4e01906097c8da08a82b Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/parallel.py", line 56, in task p.spawn(_run_spawned, ctx, confg, taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/parallel.py", line 64, in _run_spawned mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/sequential.py", line 47, in task mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_batrick_ceph_1ce7ea8877c709fa862eac608550374bd96e166e/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_batrick_ceph_1ce7ea8877c709fa862eac608550374bd96e166e/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_batrick_ceph_1ce7ea8877c709fa862eac608550374bd96e166e/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/fsstress.sh) on smithi096 with status 126: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1ce7ea8877c709fa862eac608550374bd96e166e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh' 2024-02-19T19:10:56.915 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-02-19T19:10:56.926 INFO:tasks.kclient:Unmounting kernel clients... 2024-02-19T19:10:56.927 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-02-19T19:10:56.927 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T19:10:56.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:56 smithi125 ceph-mon[86115]: pgmap v103: 65 pgs: 65 active+clean; 40 MiB data, 296 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.5 MiB/s wr, 187 op/s 2024-02-19T19:10:56.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:56 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:10:56.980 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-02-19T19:10:56.980 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T19:10:57.051 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T19:10:57.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.252+0000 7f7ac3fff640 1 -- 172.21.15.96:0/4274559174 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ac40ff970 msgr2=0x7f7ac41039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:57.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.252+0000 7f7ac3fff640 1 --2- 172.21.15.96:0/4274559174 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ac40ff970 0x7f7ac41039b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4009880 tx=0x7f7ab402bd10 comp rx=0 tx=0).stop 2024-02-19T19:10:57.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.253+0000 7f7ac3fff640 1 -- 172.21.15.96:0/4274559174 shutdown_connections 2024-02-19T19:10:57.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.253+0000 7f7ac3fff640 1 --2- 172.21.15.96:0/4274559174 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ac40ff970 0x7f7ac41039b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:57.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.253+0000 7f7ac3fff640 1 --2- 172.21.15.96:0/4274559174 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ac40fefc0 0x7f7ac40ff3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:57.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.253+0000 7f7ac3fff640 1 -- 172.21.15.96:0/4274559174 >> 172.21.15.96:0/4274559174 conn(0x7f7ac40fadb0 msgr2=0x7f7ac40fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:57.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.253+0000 7f7ac3fff640 1 -- 172.21.15.96:0/4274559174 shutdown_connections 2024-02-19T19:10:57.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.254+0000 7f7ac3fff640 1 -- 172.21.15.96:0/4274559174 wait complete. 2024-02-19T19:10:57.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.255+0000 7f7ac3fff640 1 Processor -- start 2024-02-19T19:10:57.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.255+0000 7f7ac3fff640 1 -- start start 2024-02-19T19:10:57.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.256+0000 7f7ac3fff640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ac40fefc0 0x7f7ac419c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:57.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.256+0000 7f7ac3fff640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ac419c6f0 0x7f7ac41a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:57.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.256+0000 7f7ac3fff640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac419ccf0 con 0x7f7ac40fefc0 2024-02-19T19:10:57.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.256+0000 7f7ac3fff640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac419ce60 con 0x7f7ac419c6f0 2024-02-19T19:10:57.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.257+0000 7f7ac2ffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ac40fefc0 0x7f7ac419c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:57.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.257+0000 7f7ac27fc640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ac419c6f0 0x7f7ac41a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:57.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.257+0000 7f7ac27fc640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ac419c6f0 0x7f7ac41a0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.96:55440/0 (socket says 172.21.15.96:55440) 2024-02-19T19:10:57.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.257+0000 7f7ac27fc640 1 -- 172.21.15.96:0/2200496571 learned_addr learned my addr 172.21.15.96:0/2200496571 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:10:57.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.257+0000 7f7ac2ffd640 1 -- 172.21.15.96:0/2200496571 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ac419c6f0 msgr2=0x7f7ac41a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:57.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.257+0000 7f7ac2ffd640 1 --2- 172.21.15.96:0/2200496571 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ac419c6f0 0x7f7ac41a0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:57.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.257+0000 7f7ac2ffd640 1 -- 172.21.15.96:0/2200496571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab4009560 con 0x7f7ac40fefc0 2024-02-19T19:10:57.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.258+0000 7f7ac2ffd640 1 --2- 172.21.15.96:0/2200496571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ac40fefc0 0x7f7ac419c1b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7abc00bd20 tx=0x7f7abc00be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:57.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.260+0000 7f7aabfff640 1 -- 172.21.15.96:0/2200496571 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7abc00ce40 con 0x7f7ac40fefc0 2024-02-19T19:10:57.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.260+0000 7f7aabfff640 1 -- 172.21.15.96:0/2200496571 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7abc014900 con 0x7f7ac40fefc0 2024-02-19T19:10:57.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.260+0000 7f7aabfff640 1 -- 172.21.15.96:0/2200496571 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7abc012ac0 con 0x7f7ac40fefc0 2024-02-19T19:10:57.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.260+0000 7f7ac3fff640 1 -- 172.21.15.96:0/2200496571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac41a1150 con 0x7f7ac40fefc0 2024-02-19T19:10:57.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.260+0000 7f7ac3fff640 1 -- 172.21.15.96:0/2200496571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac41a16b0 con 0x7f7ac40fefc0 2024-02-19T19:10:57.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.264+0000 7f7ac3fff640 1 -- 172.21.15.96:0/2200496571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab0005280 con 0x7f7ac40fefc0 2024-02-19T19:10:57.289 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.267+0000 7f7aabfff640 1 -- 172.21.15.96:0/2200496571 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f7abc012340 con 0x7f7ac40fefc0 2024-02-19T19:10:57.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.267+0000 7f7aabfff640 1 --2- 172.21.15.96:0/2200496571 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7aac06da60 0x7f7aac06ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:57.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.267+0000 7f7aabfff640 1 -- 172.21.15.96:0/2200496571 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7abc08cf60 con 0x7f7ac40fefc0 2024-02-19T19:10:57.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.269+0000 7f7ac27fc640 1 --2- 172.21.15.96:0/2200496571 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7aac06da60 0x7f7aac06ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:57.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.275+0000 7f7ac27fc640 1 --2- 172.21.15.96:0/2200496571 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7aac06da60 0x7f7aac06ff20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4000c00 tx=0x7f7ab4005730 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:57.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.276+0000 7f7aabfff640 1 -- 172.21.15.96:0/2200496571 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7abc056850 con 0x7f7ac40fefc0 2024-02-19T19:10:57.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.654+0000 7f7ac3fff640 1 -- 172.21.15.96:0/2200496571 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ab00050f0 con 0x7f7ac40fefc0 2024-02-19T19:10:57.678 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.656+0000 7f7aabfff640 1 -- 172.21.15.96:0/2200496571 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16499 (secure 0 0 0) 0x7f7abc019090 con 0x7f7ac40fefc0 2024-02-19T19:10:57.678 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:10:57.678 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":64,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","created":"2024-02-19T18:54:33.002577+0000","modified":"2024-02-19T19:10:41.781632+0000","last_up_change":"2024-02-19T19:10:40.779768+0000","last_in_change":"2024-02-19T19:00:08.695793+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":17,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T18:59:14.096877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-19T19:01:41.207788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-19T19:01:42.116300+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c8d3e948-3736-431e-9ccd-18d3d1af342a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":63,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":56546766},{"type":"v1","addr":"172.21.15.96:6803","nonce":56546766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":56546766},{"type":"v1","addr":"172.21.15.96:6805","nonce":56546766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":56546766},{"type":"v1","addr":"172.21.15.96:6809","nonce":56546766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":56546766},{"type":"v1","addr":"172.21.15.96:6807","nonce":56546766}]},"public_addr":"172.21.15.96:6803/56546766","cluster_addr":"172.21.15.96:6805/56546766","heartbeat_back_addr":"172.21.15.96:6809/56546766","heartbeat_front_addr":"172.21.15.96:6807/56546766","state":["exists","up"]},{"osd":1,"uuid":"012aa0e0-d3ed-4b27-9e5e-fd667e4523ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":63,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3087706183},{"type":"v1","addr":"172.21.15.96:6811","nonce":3087706183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3087706183},{"type":"v1","addr":"172.21.15.96:6813","nonce":3087706183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3087706183},{"type":"v1","addr":"172.21.15.96:6817","nonce":3087706183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3087706183},{"type":"v1","addr":"172.21.15.96:6815","nonce":3087706183}]},"public_addr":"172.21.15.96:6811/3087706183","cluster_addr":"172.21.15.96:6813/3087706183","heartbeat_back_addr":"172.21.15.96:6817/3087706183","heartbeat_front_addr":"172.21.15.96:6815/3087706183","state":["exists","up"]},{"osd":2,"uuid":"3bf17dab-3c04-4ed0-8edf-45a217a52d0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":63,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1975344907},{"type":"v1","addr":"172.21.15.96:6819","nonce":1975344907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1975344907},{"type":"v1","addr":"172.21.15.96:6821","nonce":1975344907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1975344907},{"type":"v1","addr":"172.21.15.96:6825","nonce":1975344907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1975344907},{"type":"v1","addr":"172.21.15.96:6823","nonce":1975344907}]},"public_addr":"172.21.15.96:6819/1975344907","cluster_addr":"172.21.15.96:6821/1975344907","heartbeat_back_addr":"172.21.15.96:6825/1975344907","heartbeat_front_addr":"172.21.15.96:6823/1975344907","state":["exists","up"]},{"osd":3,"uuid":"fa80c0e4-7d1a-4e41-9455-b576cbcac572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6801","nonce":3311295426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6803","nonce":3311295426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6807","nonce":3311295426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6805","nonce":3311295426}]},"public_addr":"172.21.15.125:6801/3311295426","cluster_addr":"172.21.15.125:6803/3311295426","heartbeat_back_addr":"172.21.15.125:6807/3311295426","heartbeat_front_addr":"172.21.15.125:6805/3311295426","state":["exists","up"]},{"osd":4,"uuid":"9363cacc-c727-4282-a50f-e123f625e13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6809","nonce":1210532750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6811","nonce":1210532750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6815","nonce":1210532750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6813","nonce":1210532750}]},"public_addr":"172.21.15.125:6809/1210532750","cluster_addr":"172.21.15.125:6811/1210532750","heartbeat_back_addr":"172.21.15.125:6815/1210532750","heartbeat_front_addr":"172.21.15.125:6813/1210532750","state":["exists","up"]},{"osd":5,"uuid":"93d869ce-2537-4913-8373-1db93ffdd67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6817","nonce":2708085722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6819","nonce":2708085722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6823","nonce":2708085722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6821","nonce":2708085722}]},"public_addr":"172.21.15.125:6817/2708085722","cluster_addr":"172.21.15.125:6819/2708085722","heartbeat_back_addr":"172.21.15.125:6823/2708085722","heartbeat_front_addr":"172.21.15.125:6821/2708085722","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:58:16.075448+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:58:43.787873+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:59:11.561163+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:59:35.893197+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T19:00:00.837738+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T19:00:25.890961+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/2306653686":"2024-02-20T19:08:05.264847+0000","172.21.15.125:6829/1031992411":"2024-02-20T19:04:30.007542+0000","172.21.15.96:0/782865038":"2024-02-20T18:55:03.067702+0000","172.21.15.96:0/3107913807":"2024-02-20T19:03:48.973809+0000","172.21.15.96:0/2093229384":"2024-02-20T18:55:36.280962+0000","172.21.15.125:0/1183575069":"2024-02-20T19:04:30.007542+0000","172.21.15.96:0/1504142982":"2024-02-20T19:03:48.973809+0000","172.21.15.96:6800/3697355606":"2024-02-20T18:55:36.280962+0000","172.21.15.96:0/580326503":"2024-02-20T19:03:48.973809+0000","172.21.15.96:0/561831206":"2024-02-20T18:56:57.759773+0000","172.21.15.96:6800/3628131135":"2024-02-20T18:56:57.759773+0000","172.21.15.96:6800/664869387":"2024-02-20T19:03:48.973809+0000","172.21.15.96:0/1844984401":"2024-02-20T18:55:36.280962+0000","172.21.15.96:0/1619105804":"2024-02-20T19:08:05.264847+0000","172.21.15.96:6801/3697355606":"2024-02-20T18:55:36.280962+0000","172.21.15.125:0/535273135":"2024-02-20T19:04:30.007542+0000","172.21.15.125:0/3378132019":"2024-02-20T19:04:30.007542+0000","172.21.15.125:6828/1031992411":"2024-02-20T19:04:30.007542+0000","172.21.15.96:6801/664869387":"2024-02-20T19:03:48.973809+0000","172.21.15.96:0/1723107272":"2024-02-20T19:03:48.973809+0000","172.21.15.96:0/4153792828":"2024-02-20T18:56:57.759773+0000","172.21.15.125:0/1782639588":"2024-02-20T19:04:30.007542+0000","172.21.15.96:6800/967937024":"2024-02-20T19:08:05.264847+0000","172.21.15.96:6827/3917487208":"2024-02-20T19:01:58.847298+0000","172.21.15.96:6800/1286321532":"2024-02-20T18:55:03.067702+0000","172.21.15.125:0/3569163597":"2024-02-20T19:04:30.007542+0000","172.21.15.96:0/3018792068":"2024-02-20T18:56:57.759773+0000","172.21.15.125:0/2630461593":"2024-02-20T19:04:30.007542+0000","172.21.15.96:6801/1286321532":"2024-02-20T18:55:03.067702+0000","172.21.15.96:0/2493593498":"2024-02-20T18:55:36.280962+0000","172.21.15.96:0/3563912069":"2024-02-20T18:55:03.067702+0000","172.21.15.96:0/2915208892":"2024-02-20T19:08:05.264847+0000","172.21.15.96:0/1543256561":"2024-02-20T18:55:03.067702+0000","172.21.15.96:6801/3628131135":"2024-02-20T18:56:57.759773+0000","172.21.15.96:6826/3917487208":"2024-02-20T19:01:58.847298+0000","172.21.15.96:6801/967937024":"2024-02-20T19:08:05.264847+0000","172.21.15.96:0/3083828427":"2024-02-20T19:08:05.264847+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T19:10:57.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.660+0000 7f7ac3fff640 1 -- 172.21.15.96:0/2200496571 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7aac06da60 msgr2=0x7f7aac06ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:57.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.660+0000 7f7ac3fff640 1 --2- 172.21.15.96:0/2200496571 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7aac06da60 0x7f7aac06ff20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4000c00 tx=0x7f7ab4005730 comp rx=0 tx=0).stop 2024-02-19T19:10:57.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.660+0000 7f7ac3fff640 1 -- 172.21.15.96:0/2200496571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ac40fefc0 msgr2=0x7f7ac419c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:57.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.660+0000 7f7ac3fff640 1 --2- 172.21.15.96:0/2200496571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ac40fefc0 0x7f7ac419c1b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7abc00bd20 tx=0x7f7abc00be10 comp rx=0 tx=0).stop 2024-02-19T19:10:57.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.660+0000 7f7ac3fff640 1 -- 172.21.15.96:0/2200496571 shutdown_connections 2024-02-19T19:10:57.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.660+0000 7f7ac3fff640 1 --2- 172.21.15.96:0/2200496571 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7aac06da60 0x7f7aac06ff20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:57.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.660+0000 7f7ac3fff640 1 --2- 172.21.15.96:0/2200496571 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7ac419c6f0 0x7f7ac41a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:57.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.660+0000 7f7ac3fff640 1 --2- 172.21.15.96:0/2200496571 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ac40fefc0 0x7f7ac419c1b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:57.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.660+0000 7f7ac3fff640 1 -- 172.21.15.96:0/2200496571 >> 172.21.15.96:0/2200496571 conn(0x7f7ac40fadb0 msgr2=0x7f7ac40fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:57.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.660+0000 7f7ac3fff640 1 -- 172.21.15.96:0/2200496571 shutdown_connections 2024-02-19T19:10:57.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.660+0000 7f7ac3fff640 1 -- 172.21.15.96:0/2200496571 wait complete. 2024-02-19T19:10:57.701 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T18:59:14.096877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-19T19:01:41.207788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-19T19:01:42.116300+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T19:10:57.702 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T19:10:57.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.869+0000 7f75bd684640 1 -- 172.21.15.96:0/1691842774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75b8104b70 msgr2=0x7f75b80fe790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:57.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.869+0000 7f75bd684640 1 --2- 172.21.15.96:0/1691842774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75b8104b70 0x7f75b80fe790 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009880 tx=0x7f75a802bd10 comp rx=0 tx=0).stop 2024-02-19T19:10:57.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.870+0000 7f75bd684640 1 -- 172.21.15.96:0/1691842774 shutdown_connections 2024-02-19T19:10:57.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.870+0000 7f75bd684640 1 --2- 172.21.15.96:0/1691842774 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75b8104b70 0x7f75b80fe790 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:57.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.870+0000 7f75bd684640 1 --2- 172.21.15.96:0/1691842774 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75b8066b50 0x7f75b8104630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:57.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.870+0000 7f75bd684640 1 -- 172.21.15.96:0/1691842774 >> 172.21.15.96:0/1691842774 conn(0x7f75b80752c0 msgr2=0x7f75b80756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:57.893 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.870+0000 7f75bd684640 1 -- 172.21.15.96:0/1691842774 shutdown_connections 2024-02-19T19:10:57.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.870+0000 7f75bd684640 1 -- 172.21.15.96:0/1691842774 wait complete. 2024-02-19T19:10:57.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.871+0000 7f75bd684640 1 Processor -- start 2024-02-19T19:10:57.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.871+0000 7f75bd684640 1 -- start start 2024-02-19T19:10:57.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.871+0000 7f75bd684640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75b8066b50 0x7f75b8113ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:57.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.871+0000 7f75bd684640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75b8104b70 0x7f75b81143e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:57.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.871+0000 7f75bd684640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b810ef40 con 0x7f75b8066b50 2024-02-19T19:10:57.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.871+0000 7f75bd684640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b810f0b0 con 0x7f75b8104b70 2024-02-19T19:10:57.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.872+0000 7f75b67fc640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75b8104b70 0x7f75b81143e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:57.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.872+0000 7f75b67fc640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75b8104b70 0x7f75b81143e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.96:55452/0 (socket says 172.21.15.96:55452) 2024-02-19T19:10:57.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.872+0000 7f75b67fc640 1 -- 172.21.15.96:0/1708442570 learned_addr learned my addr 172.21.15.96:0/1708442570 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:10:57.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.872+0000 7f75b6ffd640 1 --2- 172.21.15.96:0/1708442570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75b8066b50 0x7f75b8113ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:57.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.873+0000 7f75b67fc640 1 -- 172.21.15.96:0/1708442570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75b8066b50 msgr2=0x7f75b8113ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:57.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.873+0000 7f75b67fc640 1 --2- 172.21.15.96:0/1708442570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75b8066b50 0x7f75b8113ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:57.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.873+0000 7f75b67fc640 1 -- 172.21.15.96:0/1708442570 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a8009560 con 0x7f75b8104b70 2024-02-19T19:10:57.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.873+0000 7f75b67fc640 1 --2- 172.21.15.96:0/1708442570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75b8104b70 0x7f75b81143e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f75a8036040 tx=0x7f75a8004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:57.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.874+0000 7f759ffff640 1 -- 172.21.15.96:0/1708442570 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75a80037c0 con 0x7f75b8104b70 2024-02-19T19:10:57.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.874+0000 7f759ffff640 1 -- 172.21.15.96:0/1708442570 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f75a8003de0 con 0x7f75b8104b70 2024-02-19T19:10:57.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.874+0000 7f759ffff640 1 -- 172.21.15.96:0/1708442570 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f75a8034440 con 0x7f75b8104b70 2024-02-19T19:10:57.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.874+0000 7f75bd684640 1 -- 172.21.15.96:0/1708442570 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b810f330 con 0x7f75b8104b70 2024-02-19T19:10:57.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.874+0000 7f75bd684640 1 -- 172.21.15.96:0/1708442570 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b810f830 con 0x7f75b8104b70 2024-02-19T19:10:57.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.878+0000 7f759ffff640 1 -- 172.21.15.96:0/1708442570 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f75a8003920 con 0x7f75b8104b70 2024-02-19T19:10:57.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.878+0000 7f759ffff640 1 --2- 172.21.15.96:0/1708442570 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f75a006d980 0x7f75a006fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:57.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.878+0000 7f759ffff640 1 -- 172.21.15.96:0/1708442570 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f75a80af710 con 0x7f75b8104b70 2024-02-19T19:10:57.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.879+0000 7f75bd684640 1 -- 172.21.15.96:0/1708442570 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a4005280 con 0x7f75b8104b70 2024-02-19T19:10:57.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.880+0000 7f75b6ffd640 1 --2- 172.21.15.96:0/1708442570 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f75a006d980 0x7f75a006fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:57.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.881+0000 7f75b6ffd640 1 --2- 172.21.15.96:0/1708442570 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f75a006d980 0x7f75a006fe40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f75ac006fd0 tx=0x7f75ac008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:57.912 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:57.890+0000 7f759ffff640 1 -- 172.21.15.96:0/1708442570 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f75a8078fd0 con 0x7f75b8104b70 2024-02-19T19:10:58.290 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.269+0000 7f75bd684640 1 -- 172.21.15.96:0/1708442570 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f75a4005ab0 con 0x7f75b8104b70 2024-02-19T19:10:58.291 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.269+0000 7f759ffff640 1 -- 172.21.15.96:0/1708442570 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f75a804b0a0 con 0x7f75b8104b70 2024-02-19T19:10:58.291 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-02-19T19:10:58.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.272+0000 7f75bd684640 1 -- 172.21.15.96:0/1708442570 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f75a006d980 msgr2=0x7f75a006fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:58.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.272+0000 7f75bd684640 1 --2- 172.21.15.96:0/1708442570 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f75a006d980 0x7f75a006fe40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f75ac006fd0 tx=0x7f75ac008040 comp rx=0 tx=0).stop 2024-02-19T19:10:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.273+0000 7f75bd684640 1 -- 172.21.15.96:0/1708442570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75b8104b70 msgr2=0x7f75b81143e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.273+0000 7f75bd684640 1 --2- 172.21.15.96:0/1708442570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75b8104b70 0x7f75b81143e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f75a8036040 tx=0x7f75a8004270 comp rx=0 tx=0).stop 2024-02-19T19:10:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.273+0000 7f75bd684640 1 -- 172.21.15.96:0/1708442570 shutdown_connections 2024-02-19T19:10:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.273+0000 7f75bd684640 1 --2- 172.21.15.96:0/1708442570 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f75a006d980 0x7f75a006fe40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.273+0000 7f75bd684640 1 --2- 172.21.15.96:0/1708442570 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75b8104b70 0x7f75b81143e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.273+0000 7f75bd684640 1 --2- 172.21.15.96:0/1708442570 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75b8066b50 0x7f75b8113ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:58.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.273+0000 7f75bd684640 1 -- 172.21.15.96:0/1708442570 >> 172.21.15.96:0/1708442570 conn(0x7f75b80752c0 msgr2=0x7f75b8102080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:58.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.273+0000 7f75bd684640 1 -- 172.21.15.96:0/1708442570 shutdown_connections 2024-02-19T19:10:58.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.273+0000 7f75bd684640 1 -- 172.21.15.96:0/1708442570 wait complete. 2024-02-19T19:10:58.307 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-19T19:10:58.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.405+0000 7f4f52084640 1 -- 172.21.15.96:0/3174543542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f4c1002e0 msgr2=0x7f4f4c1006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:58.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.405+0000 7f4f52084640 1 --2- 172.21.15.96:0/3174543542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f4c1002e0 0x7f4f4c1006c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4f40009880 tx=0x7f4f4002bce0 comp rx=0 tx=0).stop 2024-02-19T19:10:58.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.405+0000 7f4f52084640 1 -- 172.21.15.96:0/3174543542 shutdown_connections 2024-02-19T19:10:58.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.405+0000 7f4f52084640 1 --2- 172.21.15.96:0/3174543542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f4c100c90 0x7f4f4c104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:58.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.405+0000 7f4f52084640 1 --2- 172.21.15.96:0/3174543542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f4c1002e0 0x7f4f4c1006c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:58.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.405+0000 7f4f52084640 1 -- 172.21.15.96:0/3174543542 >> 172.21.15.96:0/3174543542 conn(0x7f4f4c0fbb80 msgr2=0x7f4f4c0fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:58.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.405+0000 7f4f52084640 1 -- 172.21.15.96:0/3174543542 shutdown_connections 2024-02-19T19:10:58.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.405+0000 7f4f52084640 1 -- 172.21.15.96:0/3174543542 wait complete. 2024-02-19T19:10:58.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.406+0000 7f4f52084640 1 Processor -- start 2024-02-19T19:10:58.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.406+0000 7f4f52084640 1 -- start start 2024-02-19T19:10:58.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.406+0000 7f4f52084640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f4c1002e0 0x7f4f4c195e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:58.431 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.406+0000 7f4f52084640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f4c196360 0x7f4f4c19a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:58.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.406+0000 7f4f52084640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c196960 con 0x7f4f4c196360 2024-02-19T19:10:58.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.406+0000 7f4f52084640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4c196ad0 con 0x7f4f4c1002e0 2024-02-19T19:10:58.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.406+0000 7f4f4affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f4c196360 0x7f4f4c19a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:58.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.407+0000 7f4f4affd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f4c196360 0x7f4f4c19a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42354/0 (socket says 172.21.15.96:42354) 2024-02-19T19:10:58.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.407+0000 7f4f4affd640 1 -- 172.21.15.96:0/3357404827 learned_addr learned my addr 172.21.15.96:0/3357404827 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:10:58.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.407+0000 7f4f4b7fe640 1 --2- 172.21.15.96:0/3357404827 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f4c1002e0 0x7f4f4c195e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:58.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.407+0000 7f4f4affd640 1 -- 172.21.15.96:0/3357404827 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f4c1002e0 msgr2=0x7f4f4c195e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:58.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.407+0000 7f4f4affd640 1 --2- 172.21.15.96:0/3357404827 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f4c1002e0 0x7f4f4c195e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:58.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.407+0000 7f4f4affd640 1 -- 172.21.15.96:0/3357404827 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f40009560 con 0x7f4f4c196360 2024-02-19T19:10:58.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.407+0000 7f4f4b7fe640 1 --2- 172.21.15.96:0/3357404827 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f4c1002e0 0x7f4f4c195e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:10:58.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.407+0000 7f4f4affd640 1 --2- 172.21.15.96:0/3357404827 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f4c196360 0x7f4f4c19a7c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c00e970 tx=0x7f4f3c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:58.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.407+0000 7f4f48ff9640 1 -- 172.21.15.96:0/3357404827 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f3c009700 con 0x7f4f4c196360 2024-02-19T19:10:58.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.407+0000 7f4f52084640 1 -- 172.21.15.96:0/3357404827 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4c19adc0 con 0x7f4f4c196360 2024-02-19T19:10:58.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.407+0000 7f4f48ff9640 1 -- 172.21.15.96:0/3357404827 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f3c0054e0 con 0x7f4f4c196360 2024-02-19T19:10:58.433 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.407+0000 7f4f48ff9640 1 -- 172.21.15.96:0/3357404827 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f3c010430 con 0x7f4f4c196360 2024-02-19T19:10:58.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.407+0000 7f4f52084640 1 -- 172.21.15.96:0/3357404827 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4c19b320 con 0x7f4f4c196360 2024-02-19T19:10:58.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.408+0000 7f4f52084640 1 -- 172.21.15.96:0/3357404827 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f4c19b600 con 0x7f4f4c196360 2024-02-19T19:10:58.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.409+0000 7f4f48ff9640 1 -- 172.21.15.96:0/3357404827 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f4f3c00cc90 con 0x7f4f4c196360 2024-02-19T19:10:58.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.410+0000 7f4f48ff9640 1 --2- 172.21.15.96:0/3357404827 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f4f3406d810 0x7f4f3406fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:58.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.410+0000 7f4f48ff9640 1 -- 172.21.15.96:0/3357404827 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4f3c014070 con 0x7f4f4c196360 2024-02-19T19:10:58.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.410+0000 7f4f4b7fe640 1 --2- 172.21.15.96:0/3357404827 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f4f3406d810 0x7f4f3406fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:58.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.410+0000 7f4f4b7fe640 1 --2- 172.21.15.96:0/3357404827 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f4f3406d810 0x7f4f3406fcd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4f40000c00 tx=0x7f4f4002cb40 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:58.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.414+0000 7f4f48ff9640 1 -- 172.21.15.96:0/3357404827 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4f3c0572a0 con 0x7f4f4c196360 2024-02-19T19:10:58.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.665+0000 7f4f52084640 1 -- 172.21.15.96:0/3357404827 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f4f4c197260 con 0x7f4f4c196360 2024-02-19T19:10:58.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.665+0000 7f4f48ff9640 1 -- 172.21.15.96:0/3357404827 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v64) v1 ==== 107+0+11 (secure 0 0 0) 0x7f4f3c05a960 con 0x7f4f4c196360 2024-02-19T19:10:58.687 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-02-19T19:10:58.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.668+0000 7f4f52084640 1 -- 172.21.15.96:0/3357404827 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f4f3406d810 msgr2=0x7f4f3406fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:58.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.668+0000 7f4f52084640 1 --2- 172.21.15.96:0/3357404827 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f4f3406d810 0x7f4f3406fcd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4f40000c00 tx=0x7f4f4002cb40 comp rx=0 tx=0).stop 2024-02-19T19:10:58.690 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.668+0000 7f4f52084640 1 -- 172.21.15.96:0/3357404827 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f4c196360 msgr2=0x7f4f4c19a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:58.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.668+0000 7f4f52084640 1 --2- 172.21.15.96:0/3357404827 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f4c196360 0x7f4f4c19a7c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c00e970 tx=0x7f4f3c00ee30 comp rx=0 tx=0).stop 2024-02-19T19:10:58.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.668+0000 7f4f52084640 1 -- 172.21.15.96:0/3357404827 shutdown_connections 2024-02-19T19:10:58.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.668+0000 7f4f52084640 1 --2- 172.21.15.96:0/3357404827 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f4f3406d810 0x7f4f3406fcd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:58.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.668+0000 7f4f52084640 1 --2- 172.21.15.96:0/3357404827 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4f4c196360 0x7f4f4c19a7c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:58.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.668+0000 7f4f52084640 1 --2- 172.21.15.96:0/3357404827 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f4c1002e0 0x7f4f4c195e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:58.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.668+0000 7f4f52084640 1 -- 172.21.15.96:0/3357404827 >> 172.21.15.96:0/3357404827 conn(0x7f4f4c0fbb80 msgr2=0x7f4f4c0fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:58.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.669+0000 7f4f52084640 1 -- 172.21.15.96:0/3357404827 shutdown_connections 2024-02-19T19:10:58.691 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.669+0000 7f4f52084640 1 -- 172.21.15.96:0/3357404827 wait complete. 2024-02-19T19:10:58.701 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:58 smithi096 ceph-mon[112483]: pgmap v104: 65 pgs: 65 active+clean; 48 MiB data, 322 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 220 op/s 2024-02-19T19:10:58.702 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:58 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/2200496571' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T19:10:58.702 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:58 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/1708442570' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-19T19:10:58.703 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-19T19:10:58.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:58 smithi125 ceph-mon[86115]: pgmap v104: 65 pgs: 65 active+clean; 48 MiB data, 322 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 4.2 MiB/s wr, 220 op/s 2024-02-19T19:10:58.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:58 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/2200496571' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T19:10:58.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:58 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/1708442570' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-19T19:10:58.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.792+0000 7f404fff3640 1 -- 172.21.15.96:0/3393366044 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40480ff260 msgr2=0x7f40480ff640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:58.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.792+0000 7f404fff3640 1 --2- 172.21.15.96:0/3393366044 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40480ff260 0x7f40480ff640 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4044009880 tx=0x7f404402bce0 comp rx=0 tx=0).stop 2024-02-19T19:10:58.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.792+0000 7f404fff3640 1 -- 172.21.15.96:0/3393366044 shutdown_connections 2024-02-19T19:10:58.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.792+0000 7f404fff3640 1 --2- 172.21.15.96:0/3393366044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40480ffc10 0x7f4048103b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:58.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.792+0000 7f404fff3640 1 --2- 172.21.15.96:0/3393366044 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40480ff260 0x7f40480ff640 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:58.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.792+0000 7f404fff3640 1 -- 172.21.15.96:0/3393366044 >> 172.21.15.96:0/3393366044 conn(0x7f4048074a50 msgr2=0x7f4048074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:58.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.792+0000 7f404fff3640 1 -- 172.21.15.96:0/3393366044 shutdown_connections 2024-02-19T19:10:58.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.792+0000 7f404fff3640 1 -- 172.21.15.96:0/3393366044 wait complete. 2024-02-19T19:10:58.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.793+0000 7f404fff3640 1 Processor -- start 2024-02-19T19:10:58.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.793+0000 7f404fff3640 1 -- start start 2024-02-19T19:10:58.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.793+0000 7f404fff3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40480ff260 0x7f4048194cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:58.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.793+0000 7f404fff3640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40481951f0 0x7f40481985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:58.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.793+0000 7f404fff3640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40481957f0 con 0x7f40480ff260 2024-02-19T19:10:58.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.793+0000 7f404fff3640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4048195930 con 0x7f40481951f0 2024-02-19T19:10:58.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.793+0000 7f404dd8f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40480ff260 0x7f4048194cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:58.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.793+0000 7f404dd8f640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40480ff260 0x7f4048194cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42370/0 (socket says 172.21.15.96:42370) 2024-02-19T19:10:58.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.793+0000 7f404dd8f640 1 -- 172.21.15.96:0/3281362686 learned_addr learned my addr 172.21.15.96:0/3281362686 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:10:58.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.793+0000 7f404d58e640 1 --2- 172.21.15.96:0/3281362686 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40481951f0 0x7f40481985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:58.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.793+0000 7f404dd8f640 1 -- 172.21.15.96:0/3281362686 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40481951f0 msgr2=0x7f40481985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:58.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.793+0000 7f404dd8f640 1 --2- 172.21.15.96:0/3281362686 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40481951f0 0x7f40481985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:58.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.793+0000 7f404dd8f640 1 -- 172.21.15.96:0/3281362686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4044009560 con 0x7f40480ff260 2024-02-19T19:10:58.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.793+0000 7f404dd8f640 1 --2- 172.21.15.96:0/3281362686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40480ff260 0x7f4048194cb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4044009230 tx=0x7f4044005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:58.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.794+0000 7f403effd640 1 -- 172.21.15.96:0/3281362686 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40440044a0 con 0x7f40480ff260 2024-02-19T19:10:58.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.794+0000 7f403effd640 1 -- 172.21.15.96:0/3281362686 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4044003ab0 con 0x7f40480ff260 2024-02-19T19:10:58.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.794+0000 7f404fff3640 1 -- 172.21.15.96:0/3281362686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4048198b40 con 0x7f40480ff260 2024-02-19T19:10:58.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.794+0000 7f403effd640 1 -- 172.21.15.96:0/3281362686 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40440055f0 con 0x7f40480ff260 2024-02-19T19:10:58.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.794+0000 7f404fff3640 1 -- 172.21.15.96:0/3281362686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40481990a0 con 0x7f40480ff260 2024-02-19T19:10:58.820 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.795+0000 7f404fff3640 1 -- 172.21.15.96:0/3281362686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f404804e040 con 0x7f40480ff260 2024-02-19T19:10:58.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.796+0000 7f403effd640 1 -- 172.21.15.96:0/3281362686 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f4044004e60 con 0x7f40480ff260 2024-02-19T19:10:58.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.796+0000 7f403effd640 1 --2- 172.21.15.96:0/3281362686 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f403406d810 0x7f403406fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:58.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.796+0000 7f403effd640 1 -- 172.21.15.96:0/3281362686 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f40440af7c0 con 0x7f40480ff260 2024-02-19T19:10:58.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.796+0000 7f404d58e640 1 --2- 172.21.15.96:0/3281362686 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f403406d810 0x7f403406fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:58.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.797+0000 7f404d58e640 1 --2- 172.21.15.96:0/3281362686 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f403406d810 0x7f403406fcd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4048072e40 tx=0x7f4038005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:58.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:58.801+0000 7f403effd640 1 -- 172.21.15.96:0/3281362686 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f40440790d0 con 0x7f40480ff260 2024-02-19T19:10:59.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.048+0000 7f404fff3640 1 -- 172.21.15.96:0/3281362686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f4048107480 con 0x7f40480ff260 2024-02-19T19:10:59.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.048+0000 7f403effd640 1 -- 172.21.15.96:0/3281362686 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v64) v1 ==== 107+0+11 (secure 0 0 0) 0x7f404407c790 con 0x7f40480ff260 2024-02-19T19:10:59.071 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-02-19T19:10:59.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.051+0000 7f404fff3640 1 -- 172.21.15.96:0/3281362686 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f403406d810 msgr2=0x7f403406fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:59.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.051+0000 7f404fff3640 1 --2- 172.21.15.96:0/3281362686 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f403406d810 0x7f403406fcd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4048072e40 tx=0x7f4038005f90 comp rx=0 tx=0).stop 2024-02-19T19:10:59.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.051+0000 7f404fff3640 1 -- 172.21.15.96:0/3281362686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40480ff260 msgr2=0x7f4048194cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:59.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.051+0000 7f404fff3640 1 --2- 172.21.15.96:0/3281362686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40480ff260 0x7f4048194cb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4044009230 tx=0x7f4044005e50 comp rx=0 tx=0).stop 2024-02-19T19:10:59.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.051+0000 7f404fff3640 1 -- 172.21.15.96:0/3281362686 shutdown_connections 2024-02-19T19:10:59.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.051+0000 7f404fff3640 1 --2- 172.21.15.96:0/3281362686 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f403406d810 0x7f403406fcd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:59.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.051+0000 7f404fff3640 1 --2- 172.21.15.96:0/3281362686 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40481951f0 0x7f40481985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:59.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.051+0000 7f404fff3640 1 --2- 172.21.15.96:0/3281362686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40480ff260 0x7f4048194cb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:59.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.051+0000 7f404fff3640 1 -- 172.21.15.96:0/3281362686 >> 172.21.15.96:0/3281362686 conn(0x7f4048074a50 msgr2=0x7f40480fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:59.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.051+0000 7f404fff3640 1 -- 172.21.15.96:0/3281362686 shutdown_connections 2024-02-19T19:10:59.074 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.051+0000 7f404fff3640 1 -- 172.21.15.96:0/3281362686 wait complete. 2024-02-19T19:10:59.084 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-19T19:10:59.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.171+0000 7f7e4fe37640 1 -- 172.21.15.96:0/3291978736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e48072670 msgr2=0x7f7e48072a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:59.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.171+0000 7f7e4fe37640 1 --2- 172.21.15.96:0/3291978736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e48072670 0x7f7e48072a50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7e44009880 tx=0x7f7e4402bdc0 comp rx=0 tx=0).stop 2024-02-19T19:10:59.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.171+0000 7f7e4fe37640 1 -- 172.21.15.96:0/3291978736 shutdown_connections 2024-02-19T19:10:59.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.171+0000 7f7e4fe37640 1 --2- 172.21.15.96:0/3291978736 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e48072f90 0x7f7e4810c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:59.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.171+0000 7f7e4fe37640 1 --2- 172.21.15.96:0/3291978736 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e48072670 0x7f7e48072a50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:59.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.171+0000 7f7e4fe37640 1 -- 172.21.15.96:0/3291978736 >> 172.21.15.96:0/3291978736 conn(0x7f7e480fbba0 msgr2=0x7f7e480fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:59.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.171+0000 7f7e4fe37640 1 -- 172.21.15.96:0/3291978736 shutdown_connections 2024-02-19T19:10:59.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.171+0000 7f7e4fe37640 1 -- 172.21.15.96:0/3291978736 wait complete. 2024-02-19T19:10:59.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.171+0000 7f7e4fe37640 1 Processor -- start 2024-02-19T19:10:59.194 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.172+0000 7f7e4fe37640 1 -- start start 2024-02-19T19:10:59.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.172+0000 7f7e4fe37640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e48072670 0x7f7e48197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:59.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.172+0000 7f7e4fe37640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e48072f90 0x7f7e481983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:59.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.172+0000 7f7e4fe37640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e48198a30 con 0x7f7e48072670 2024-02-19T19:10:59.197 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.172+0000 7f7e4fe37640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4819c7b0 con 0x7f7e48072f90 2024-02-19T19:10:59.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.172+0000 7f7e4dbd3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e48072670 0x7f7e48197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:59.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.172+0000 7f7e4dbd3640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e48072670 0x7f7e48197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:42382/0 (socket says 172.21.15.96:42382) 2024-02-19T19:10:59.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.172+0000 7f7e4dbd3640 1 -- 172.21.15.96:0/2973820486 learned_addr learned my addr 172.21.15.96:0/2973820486 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:10:59.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.172+0000 7f7e4d3d2640 1 --2- 172.21.15.96:0/2973820486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e48072f90 0x7f7e481983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:59.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.172+0000 7f7e4dbd3640 1 -- 172.21.15.96:0/2973820486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e48072f90 msgr2=0x7f7e481983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:59.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.172+0000 7f7e4dbd3640 1 --2- 172.21.15.96:0/2973820486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e48072f90 0x7f7e481983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:59.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.172+0000 7f7e4dbd3640 1 -- 172.21.15.96:0/2973820486 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e44009560 con 0x7f7e48072670 2024-02-19T19:10:59.198 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.172+0000 7f7e4dbd3640 1 --2- 172.21.15.96:0/2973820486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e48072670 0x7f7e48197e60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7e440099a0 tx=0x7f7e44004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:59.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.173+0000 7f7e3effd640 1 -- 172.21.15.96:0/2973820486 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e440035f0 con 0x7f7e48072670 2024-02-19T19:10:59.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.173+0000 7f7e3effd640 1 -- 172.21.15.96:0/2973820486 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e44003c10 con 0x7f7e48072670 2024-02-19T19:10:59.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.173+0000 7f7e4fe37640 1 -- 172.21.15.96:0/2973820486 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e4819ca30 con 0x7f7e48072670 2024-02-19T19:10:59.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.173+0000 7f7e3effd640 1 -- 172.21.15.96:0/2973820486 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e44005690 con 0x7f7e48072670 2024-02-19T19:10:59.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.173+0000 7f7e4fe37640 1 -- 172.21.15.96:0/2973820486 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e4819cf90 con 0x7f7e48072670 2024-02-19T19:10:59.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.174+0000 7f7e4fe37640 1 -- 172.21.15.96:0/2973820486 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e4804e040 con 0x7f7e48072670 2024-02-19T19:10:59.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.174+0000 7f7e3effd640 1 -- 172.21.15.96:0/2973820486 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f7e44004ed0 con 0x7f7e48072670 2024-02-19T19:10:59.199 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.175+0000 7f7e3effd640 1 --2- 172.21.15.96:0/2973820486 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7e3406d870 0x7f7e3406fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:10:59.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.175+0000 7f7e3effd640 1 -- 172.21.15.96:0/2973820486 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7e440aff30 con 0x7f7e48072670 2024-02-19T19:10:59.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.175+0000 7f7e4d3d2640 1 --2- 172.21.15.96:0/2973820486 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7e3406d870 0x7f7e3406fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:10:59.200 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.175+0000 7f7e4d3d2640 1 --2- 172.21.15.96:0/2973820486 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7e3406d870 0x7f7e3406fd30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7e48199420 tx=0x7f7e3800b390 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:10:59.201 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.179+0000 7f7e3effd640 1 -- 172.21.15.96:0/2973820486 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7e440e3d20 con 0x7f7e48072670 2024-02-19T19:10:59.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.398+0000 7f7e4fe37640 1 -- 172.21.15.96:0/2973820486 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7e4810f4e0 con 0x7f7e48072670 2024-02-19T19:10:59.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.398+0000 7f7e3effd640 1 -- 172.21.15.96:0/2973820486 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v64) v1 ==== 81+0+2188 (secure 0 0 0) 0x7f7e440438a0 con 0x7f7e48072670 2024-02-19T19:10:59.420 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/2306653686 2024-02-20T19:08:05.264847+0000 2024-02-19T19:10:59.420 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.125:6829/1031992411 2024-02-20T19:04:30.007542+0000 2024-02-19T19:10:59.421 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/782865038 2024-02-20T18:55:03.067702+0000 2024-02-19T19:10:59.421 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/3107913807 2024-02-20T19:03:48.973809+0000 2024-02-19T19:10:59.421 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/2093229384 2024-02-20T18:55:36.280962+0000 2024-02-19T19:10:59.421 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.125:0/1183575069 2024-02-20T19:04:30.007542+0000 2024-02-19T19:10:59.421 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/1504142982 2024-02-20T19:03:48.973809+0000 2024-02-19T19:10:59.421 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6800/3697355606 2024-02-20T18:55:36.280962+0000 2024-02-19T19:10:59.421 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/580326503 2024-02-20T19:03:48.973809+0000 2024-02-19T19:10:59.421 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/561831206 2024-02-20T18:56:57.759773+0000 2024-02-19T19:10:59.422 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6800/3628131135 2024-02-20T18:56:57.759773+0000 2024-02-19T19:10:59.422 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6800/664869387 2024-02-20T19:03:48.973809+0000 2024-02-19T19:10:59.422 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/1844984401 2024-02-20T18:55:36.280962+0000 2024-02-19T19:10:59.422 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/1619105804 2024-02-20T19:08:05.264847+0000 2024-02-19T19:10:59.422 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6801/3697355606 2024-02-20T18:55:36.280962+0000 2024-02-19T19:10:59.422 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.125:0/535273135 2024-02-20T19:04:30.007542+0000 2024-02-19T19:10:59.422 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.125:0/3378132019 2024-02-20T19:04:30.007542+0000 2024-02-19T19:10:59.422 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.125:6828/1031992411 2024-02-20T19:04:30.007542+0000 2024-02-19T19:10:59.423 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6801/664869387 2024-02-20T19:03:48.973809+0000 2024-02-19T19:10:59.423 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/1723107272 2024-02-20T19:03:48.973809+0000 2024-02-19T19:10:59.423 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/4153792828 2024-02-20T18:56:57.759773+0000 2024-02-19T19:10:59.423 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.125:0/1782639588 2024-02-20T19:04:30.007542+0000 2024-02-19T19:10:59.423 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6800/967937024 2024-02-20T19:08:05.264847+0000 2024-02-19T19:10:59.423 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6827/3917487208 2024-02-20T19:01:58.847298+0000 2024-02-19T19:10:59.423 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6800/1286321532 2024-02-20T18:55:03.067702+0000 2024-02-19T19:10:59.424 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.125:0/3569163597 2024-02-20T19:04:30.007542+0000 2024-02-19T19:10:59.424 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/3018792068 2024-02-20T18:56:57.759773+0000 2024-02-19T19:10:59.424 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.125:0/2630461593 2024-02-20T19:04:30.007542+0000 2024-02-19T19:10:59.424 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6801/1286321532 2024-02-20T18:55:03.067702+0000 2024-02-19T19:10:59.424 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/2493593498 2024-02-20T18:55:36.280962+0000 2024-02-19T19:10:59.424 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/3563912069 2024-02-20T18:55:03.067702+0000 2024-02-19T19:10:59.425 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/2915208892 2024-02-20T19:08:05.264847+0000 2024-02-19T19:10:59.425 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/1543256561 2024-02-20T18:55:03.067702+0000 2024-02-19T19:10:59.425 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6801/3628131135 2024-02-20T18:56:57.759773+0000 2024-02-19T19:10:59.425 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6826/3917487208 2024-02-20T19:01:58.847298+0000 2024-02-19T19:10:59.425 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6801/967937024 2024-02-20T19:08:05.264847+0000 2024-02-19T19:10:59.425 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/3083828427 2024-02-20T19:08:05.264847+0000 2024-02-19T19:10:59.426 INFO:teuthology.orchestra.run.smithi096.stderr:listed 37 entries 2024-02-19T19:10:59.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.400+0000 7f7e4fe37640 1 -- 172.21.15.96:0/2973820486 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7e3406d870 msgr2=0x7f7e3406fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:59.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.400+0000 7f7e4fe37640 1 --2- 172.21.15.96:0/2973820486 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7e3406d870 0x7f7e3406fd30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7e48199420 tx=0x7f7e3800b390 comp rx=0 tx=0).stop 2024-02-19T19:10:59.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.400+0000 7f7e4fe37640 1 -- 172.21.15.96:0/2973820486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e48072670 msgr2=0x7f7e48197e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:10:59.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.400+0000 7f7e4fe37640 1 --2- 172.21.15.96:0/2973820486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e48072670 0x7f7e48197e60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7e440099a0 tx=0x7f7e44004270 comp rx=0 tx=0).stop 2024-02-19T19:10:59.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.400+0000 7f7e4fe37640 1 -- 172.21.15.96:0/2973820486 shutdown_connections 2024-02-19T19:10:59.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.400+0000 7f7e4fe37640 1 --2- 172.21.15.96:0/2973820486 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7e3406d870 0x7f7e3406fd30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:59.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.400+0000 7f7e4fe37640 1 --2- 172.21.15.96:0/2973820486 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7e48072f90 0x7f7e481983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:59.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.400+0000 7f7e4fe37640 1 --2- 172.21.15.96:0/2973820486 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e48072670 0x7f7e48197e60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:10:59.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.401+0000 7f7e4fe37640 1 -- 172.21.15.96:0/2973820486 >> 172.21.15.96:0/2973820486 conn(0x7f7e480fbba0 msgr2=0x7f7e48106c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:10:59.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.401+0000 7f7e4fe37640 1 -- 172.21.15.96:0/2973820486 shutdown_connections 2024-02-19T19:10:59.428 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:10:59.401+0000 7f7e4fe37640 1 -- 172.21.15.96:0/2973820486 wait complete. 2024-02-19T19:10:59.438 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-02-19T19:10:59.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:10:59.438 DEBUG:teuthology.orchestra.run.smithi096:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-02-19T19:10:59.467 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi096.front.sepia.ceph.com 2024-02-19T19:10:59.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:10:59.467 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-02-19T19:10:59.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:59 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/3357404827' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-19T19:10:59.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:10:59 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/3281362686' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-19T19:10:59.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:59 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/3357404827' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-19T19:10:59.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:10:59 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/3281362686' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-19T19:11:00.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:00 smithi125 ceph-mon[86115]: pgmap v105: 65 pgs: 65 active+clean; 62 MiB data, 390 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 366 op/s 2024-02-19T19:11:00.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:00 smithi125 ceph-mon[86115]: fsmap cephfs:2 {0=cephfs.smithi096.pccmys=up:active,1=cephfs.smithi125.srnlol=up:active} 2 up:standby-replay 2024-02-19T19:11:00.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:00 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/2973820486' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-19T19:11:00.777 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:00 smithi096 ceph-mon[112483]: pgmap v105: 65 pgs: 65 active+clean; 62 MiB data, 390 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 366 op/s 2024-02-19T19:11:00.778 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:00 smithi096 ceph-mon[112483]: fsmap cephfs:2 {0=cephfs.smithi096.pccmys=up:active,1=cephfs.smithi125.srnlol=up:active} 2 up:standby-replay 2024-02-19T19:11:00.778 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:00 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/2973820486' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-19T19:11:01.469 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:01 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-19T19:11:01.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:01 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-19T19:11:02.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:02 smithi125 ceph-mon[86115]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-19T19:11:02.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:02 smithi125 ceph-mon[86115]: Upgrade: osd.3 is safe to restart 2024-02-19T19:11:02.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:02 smithi125 ceph-mon[86115]: pgmap v106: 65 pgs: 65 active+clean; 71 MiB data, 438 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 419 op/s 2024-02-19T19:11:02.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:02 smithi096 ceph-mon[112483]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-19T19:11:02.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:02 smithi096 ceph-mon[112483]: Upgrade: osd.3 is safe to restart 2024-02-19T19:11:02.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:02 smithi096 ceph-mon[112483]: pgmap v106: 65 pgs: 65 active+clean; 71 MiB data, 438 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.5 MiB/s wr, 419 op/s 2024-02-19T19:11:03.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:03 smithi125 ceph-mon[86115]: Upgrade: Updating osd.3 2024-02-19T19:11:03.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:03 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:03.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:03 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-19T19:11:03.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:03 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:11:03.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:03 smithi125 ceph-mon[86115]: Deploying daemon osd.3 on smithi125 2024-02-19T19:11:03.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:03 smithi125 ceph-mon[86115]: pgmap v107: 65 pgs: 65 active+clean; 103 MiB data, 578 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 6.3 MiB/s wr, 733 op/s 2024-02-19T19:11:03.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:03 smithi096 ceph-mon[112483]: Upgrade: Updating osd.3 2024-02-19T19:11:03.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:03 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:03.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:03 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-19T19:11:03.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:03 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:11:03.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:03 smithi096 ceph-mon[112483]: Deploying daemon osd.3 on smithi125 2024-02-19T19:11:03.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:03 smithi096 ceph-mon[112483]: pgmap v107: 65 pgs: 65 active+clean; 103 MiB data, 578 MiB used, 536 GiB / 536 GiB avail; 1.9 MiB/s rd, 6.3 MiB/s wr, 733 op/s 2024-02-19T19:11:05.598 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-02-19T19:11:05.598 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T19:11:05.617 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-02-19T19:11:05.617 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-19T19:11:05.674 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-19T19:11:05.698 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:11:05.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:11:05.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.755+0000 7ff8906c0640 1 -- 172.21.15.96:0/3383426576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8880fefe0 msgr2=0x7ff8880ff440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:05.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.755+0000 7ff8906c0640 1 --2- 172.21.15.96:0/3383426576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8880fefe0 0x7ff8880ff440 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff878009880 tx=0x7ff87802bce0 comp rx=0 tx=0).stop 2024-02-19T19:11:05.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.756+0000 7ff8906c0640 1 -- 172.21.15.96:0/3383426576 shutdown_connections 2024-02-19T19:11:05.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.756+0000 7ff8906c0640 1 --2- 172.21.15.96:0/3383426576 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8880fefe0 0x7ff8880ff440 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:05.782 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.756+0000 7ff8906c0640 1 --2- 172.21.15.96:0/3383426576 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff888103f20 0x7ff888104300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:05.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.756+0000 7ff8906c0640 1 -- 172.21.15.96:0/3383426576 >> 172.21.15.96:0/3383426576 conn(0x7ff888075b40 msgr2=0x7ff888075f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:05.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.756+0000 7ff8906c0640 1 -- 172.21.15.96:0/3383426576 shutdown_connections 2024-02-19T19:11:05.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.756+0000 7ff8906c0640 1 -- 172.21.15.96:0/3383426576 wait complete. 2024-02-19T19:11:05.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.756+0000 7ff8906c0640 1 Processor -- start 2024-02-19T19:11:05.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.756+0000 7ff8906c0640 1 -- start start 2024-02-19T19:11:05.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.756+0000 7ff8906c0640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8880fefe0 0x7ff888194930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:05.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.756+0000 7ff8906c0640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff888103f20 0x7ff888194e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:05.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.756+0000 7ff8906c0640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8881953b0 con 0x7ff8880fefe0 2024-02-19T19:11:05.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.756+0000 7ff8906c0640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff888195520 con 0x7ff888103f20 2024-02-19T19:11:05.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.756+0000 7ff88e45c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8880fefe0 0x7ff888194930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:05.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.756+0000 7ff88e45c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8880fefe0 0x7ff888194930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58588/0 (socket says 172.21.15.96:58588) 2024-02-19T19:11:05.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.756+0000 7ff88e45c640 1 -- 172.21.15.96:0/1653690262 learned_addr learned my addr 172.21.15.96:0/1653690262 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:11:05.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.757+0000 7ff88dc5b640 1 --2- 172.21.15.96:0/1653690262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff888103f20 0x7ff888194e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:05.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.757+0000 7ff88e45c640 1 -- 172.21.15.96:0/1653690262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff888103f20 msgr2=0x7ff888194e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:05.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.757+0000 7ff88e45c640 1 --2- 172.21.15.96:0/1653690262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff888103f20 0x7ff888194e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:05.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.757+0000 7ff88e45c640 1 -- 172.21.15.96:0/1653690262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff878009560 con 0x7ff8880fefe0 2024-02-19T19:11:05.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.757+0000 7ff88e45c640 1 --2- 172.21.15.96:0/1653690262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8880fefe0 0x7ff888194930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff88400d8d0 tx=0x7ff88400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:05.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.757+0000 7ff87f7fe640 1 -- 172.21.15.96:0/1653690262 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff884009c00 con 0x7ff8880fefe0 2024-02-19T19:11:05.784 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.757+0000 7ff8906c0640 1 -- 172.21.15.96:0/1653690262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8881957a0 con 0x7ff8880fefe0 2024-02-19T19:11:05.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.757+0000 7ff87f7fe640 1 -- 172.21.15.96:0/1653690262 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff884009d60 con 0x7ff8880fefe0 2024-02-19T19:11:05.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.757+0000 7ff87f7fe640 1 -- 172.21.15.96:0/1653690262 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8840049d0 con 0x7ff8880fefe0 2024-02-19T19:11:05.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.757+0000 7ff8906c0640 1 -- 172.21.15.96:0/1653690262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8881a2290 con 0x7ff8880fefe0 2024-02-19T19:11:05.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.758+0000 7ff8906c0640 1 -- 172.21.15.96:0/1653690262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff88804e040 con 0x7ff8880fefe0 2024-02-19T19:11:05.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.759+0000 7ff87f7fe640 1 -- 172.21.15.96:0/1653690262 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7ff884004c90 con 0x7ff8880fefe0 2024-02-19T19:11:05.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.759+0000 7ff87f7fe640 1 --2- 172.21.15.96:0/1653690262 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff87406d8d0 0x7ff87406fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:05.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.759+0000 7ff87f7fe640 1 -- 172.21.15.96:0/1653690262 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff88408cf90 con 0x7ff8880fefe0 2024-02-19T19:11:05.785 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.759+0000 7ff88dc5b640 1 --2- 172.21.15.96:0/1653690262 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff87406d8d0 0x7ff87406fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:05.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.760+0000 7ff88dc5b640 1 --2- 172.21.15.96:0/1653690262 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff87406d8d0 0x7ff87406fd90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff878006010 tx=0x7ff878005dd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:05.786 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.764+0000 7ff87f7fe640 1 -- 172.21.15.96:0/1653690262 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff8840567f0 con 0x7ff8880fefe0 2024-02-19T19:11:05.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.974+0000 7ff8906c0640 1 -- 172.21.15.96:0/1653690262 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff888067940 con 0x7ff8880fefe0 2024-02-19T19:11:05.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.975+0000 7ff87f7fe640 1 -- 172.21.15.96:0/1653690262 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16499 (secure 0 0 0) 0x7ff884059eb0 con 0x7ff8880fefe0 2024-02-19T19:11:05.997 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:11:05.997 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":64,"fsid":"06580d2c-cf58-11ee-95bb-87774f69a715","created":"2024-02-19T18:54:33.002577+0000","modified":"2024-02-19T19:10:41.781632+0000","last_up_change":"2024-02-19T19:10:40.779768+0000","last_in_change":"2024-02-19T19:00:08.695793+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":17,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-19T18:59:14.096877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-19T19:01:41.207788+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-19T19:01:42.116300+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c8d3e948-3736-431e-9ccd-18d3d1af342a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":63,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":56546766},{"type":"v1","addr":"172.21.15.96:6803","nonce":56546766}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":56546766},{"type":"v1","addr":"172.21.15.96:6805","nonce":56546766}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":56546766},{"type":"v1","addr":"172.21.15.96:6809","nonce":56546766}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":56546766},{"type":"v1","addr":"172.21.15.96:6807","nonce":56546766}]},"public_addr":"172.21.15.96:6803/56546766","cluster_addr":"172.21.15.96:6805/56546766","heartbeat_back_addr":"172.21.15.96:6809/56546766","heartbeat_front_addr":"172.21.15.96:6807/56546766","state":["exists","up"]},{"osd":1,"uuid":"012aa0e0-d3ed-4b27-9e5e-fd667e4523ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":63,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":3087706183},{"type":"v1","addr":"172.21.15.96:6811","nonce":3087706183}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":3087706183},{"type":"v1","addr":"172.21.15.96:6813","nonce":3087706183}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3087706183},{"type":"v1","addr":"172.21.15.96:6817","nonce":3087706183}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":3087706183},{"type":"v1","addr":"172.21.15.96:6815","nonce":3087706183}]},"public_addr":"172.21.15.96:6811/3087706183","cluster_addr":"172.21.15.96:6813/3087706183","heartbeat_back_addr":"172.21.15.96:6817/3087706183","heartbeat_front_addr":"172.21.15.96:6815/3087706183","state":["exists","up"]},{"osd":2,"uuid":"3bf17dab-3c04-4ed0-8edf-45a217a52d0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":63,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1975344907},{"type":"v1","addr":"172.21.15.96:6819","nonce":1975344907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1975344907},{"type":"v1","addr":"172.21.15.96:6821","nonce":1975344907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1975344907},{"type":"v1","addr":"172.21.15.96:6825","nonce":1975344907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1975344907},{"type":"v1","addr":"172.21.15.96:6823","nonce":1975344907}]},"public_addr":"172.21.15.96:6819/1975344907","cluster_addr":"172.21.15.96:6821/1975344907","heartbeat_back_addr":"172.21.15.96:6825/1975344907","heartbeat_front_addr":"172.21.15.96:6823/1975344907","state":["exists","up"]},{"osd":3,"uuid":"fa80c0e4-7d1a-4e41-9455-b576cbcac572","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6801","nonce":3311295426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6803","nonce":3311295426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6806","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6807","nonce":3311295426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":3311295426},{"type":"v1","addr":"172.21.15.125:6805","nonce":3311295426}]},"public_addr":"172.21.15.125:6801/3311295426","cluster_addr":"172.21.15.125:6803/3311295426","heartbeat_back_addr":"172.21.15.125:6807/3311295426","heartbeat_front_addr":"172.21.15.125:6805/3311295426","state":["exists","up"]},{"osd":4,"uuid":"9363cacc-c727-4282-a50f-e123f625e13e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6808","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6809","nonce":1210532750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6811","nonce":1210532750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6814","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6815","nonce":1210532750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":1210532750},{"type":"v1","addr":"172.21.15.125:6813","nonce":1210532750}]},"public_addr":"172.21.15.125:6809/1210532750","cluster_addr":"172.21.15.125:6811/1210532750","heartbeat_back_addr":"172.21.15.125:6815/1210532750","heartbeat_front_addr":"172.21.15.125:6813/1210532750","state":["exists","up"]},{"osd":5,"uuid":"93d869ce-2537-4913-8373-1db93ffdd67f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6816","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6817","nonce":2708085722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6819","nonce":2708085722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6822","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6823","nonce":2708085722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":2708085722},{"type":"v1","addr":"172.21.15.125:6821","nonce":2708085722}]},"public_addr":"172.21.15.125:6817/2708085722","cluster_addr":"172.21.15.125:6819/2708085722","heartbeat_back_addr":"172.21.15.125:6823/2708085722","heartbeat_front_addr":"172.21.15.125:6821/2708085722","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:58:16.075448+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:58:43.787873+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:59:11.561163+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T18:59:35.893197+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T19:00:00.837738+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-19T19:00:25.890961+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:0/2306653686":"2024-02-20T19:08:05.264847+0000","172.21.15.125:6829/1031992411":"2024-02-20T19:04:30.007542+0000","172.21.15.96:0/782865038":"2024-02-20T18:55:03.067702+0000","172.21.15.96:0/3107913807":"2024-02-20T19:03:48.973809+0000","172.21.15.96:0/2093229384":"2024-02-20T18:55:36.280962+0000","172.21.15.125:0/1183575069":"2024-02-20T19:04:30.007542+0000","172.21.15.96:0/1504142982":"2024-02-20T19:03:48.973809+0000","172.21.15.96:6800/3697355606":"2024-02-20T18:55:36.280962+0000","172.21.15.96:0/580326503":"2024-02-20T19:03:48.973809+0000","172.21.15.96:0/561831206":"2024-02-20T18:56:57.759773+0000","172.21.15.96:6800/3628131135":"2024-02-20T18:56:57.759773+0000","172.21.15.96:6800/664869387":"2024-02-20T19:03:48.973809+0000","172.21.15.96:0/1844984401":"2024-02-20T18:55:36.280962+0000","172.21.15.96:0/1619105804":"2024-02-20T19:08:05.264847+0000","172.21.15.96:6801/3697355606":"2024-02-20T18:55:36.280962+0000","172.21.15.125:0/535273135":"2024-02-20T19:04:30.007542+0000","172.21.15.125:0/3378132019":"2024-02-20T19:04:30.007542+0000","172.21.15.125:6828/1031992411":"2024-02-20T19:04:30.007542+0000","172.21.15.96:6801/664869387":"2024-02-20T19:03:48.973809+0000","172.21.15.96:0/1723107272":"2024-02-20T19:03:48.973809+0000","172.21.15.96:0/4153792828":"2024-02-20T18:56:57.759773+0000","172.21.15.125:0/1782639588":"2024-02-20T19:04:30.007542+0000","172.21.15.96:6800/967937024":"2024-02-20T19:08:05.264847+0000","172.21.15.96:6827/3917487208":"2024-02-20T19:01:58.847298+0000","172.21.15.96:6800/1286321532":"2024-02-20T18:55:03.067702+0000","172.21.15.125:0/3569163597":"2024-02-20T19:04:30.007542+0000","172.21.15.96:0/3018792068":"2024-02-20T18:56:57.759773+0000","172.21.15.125:0/2630461593":"2024-02-20T19:04:30.007542+0000","172.21.15.96:6801/1286321532":"2024-02-20T18:55:03.067702+0000","172.21.15.96:0/2493593498":"2024-02-20T18:55:36.280962+0000","172.21.15.96:0/3563912069":"2024-02-20T18:55:03.067702+0000","172.21.15.96:0/2915208892":"2024-02-20T19:08:05.264847+0000","172.21.15.96:0/1543256561":"2024-02-20T18:55:03.067702+0000","172.21.15.96:6801/3628131135":"2024-02-20T18:56:57.759773+0000","172.21.15.96:6826/3917487208":"2024-02-20T19:01:58.847298+0000","172.21.15.96:6801/967937024":"2024-02-20T19:08:05.264847+0000","172.21.15.96:0/3083828427":"2024-02-20T19:08:05.264847+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-19T19:11:05.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.977+0000 7ff8906c0640 1 -- 172.21.15.96:0/1653690262 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff87406d8d0 msgr2=0x7ff87406fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:05.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.977+0000 7ff8906c0640 1 --2- 172.21.15.96:0/1653690262 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff87406d8d0 0x7ff87406fd90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff878006010 tx=0x7ff878005dd0 comp rx=0 tx=0).stop 2024-02-19T19:11:05.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.977+0000 7ff8906c0640 1 -- 172.21.15.96:0/1653690262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8880fefe0 msgr2=0x7ff888194930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:05.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.977+0000 7ff8906c0640 1 --2- 172.21.15.96:0/1653690262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8880fefe0 0x7ff888194930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff88400d8d0 tx=0x7ff88400dd90 comp rx=0 tx=0).stop 2024-02-19T19:11:06.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.977+0000 7ff8906c0640 1 -- 172.21.15.96:0/1653690262 shutdown_connections 2024-02-19T19:11:06.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.977+0000 7ff8906c0640 1 --2- 172.21.15.96:0/1653690262 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff87406d8d0 0x7ff87406fd90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.977+0000 7ff8906c0640 1 --2- 172.21.15.96:0/1653690262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff888103f20 0x7ff888194e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.977+0000 7ff8906c0640 1 --2- 172.21.15.96:0/1653690262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff8880fefe0 0x7ff888194930 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.977+0000 7ff8906c0640 1 -- 172.21.15.96:0/1653690262 >> 172.21.15.96:0/1653690262 conn(0x7ff888075b40 msgr2=0x7ff8880fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:06.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.977+0000 7ff8906c0640 1 -- 172.21.15.96:0/1653690262 shutdown_connections 2024-02-19T19:11:06.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:05.977+0000 7ff8906c0640 1 -- 172.21.15.96:0/1653690262 wait complete. 2024-02-19T19:11:06.010 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-19T18:59:14.096877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-19T19:01:41.207788+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-19T19:01:42.116300+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-19T19:11:06.010 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-19T19:11:06.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.133+0000 7f698a9fd640 1 -- 172.21.15.96:0/2467455474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6984067f70 msgr2=0x7f6984104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:06.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.133+0000 7f698a9fd640 1 --2- 172.21.15.96:0/2467455474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6984067f70 0x7f6984104c70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6978009880 tx=0x7f697802bce0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.133+0000 7f698a9fd640 1 -- 172.21.15.96:0/2467455474 shutdown_connections 2024-02-19T19:11:06.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.133+0000 7f698a9fd640 1 --2- 172.21.15.96:0/2467455474 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6984067f70 0x7f6984104c70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.133+0000 7f698a9fd640 1 --2- 172.21.15.96:0/2467455474 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69840675c0 0x7f69840679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.157 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.133+0000 7f698a9fd640 1 -- 172.21.15.96:0/2467455474 >> 172.21.15.96:0/2467455474 conn(0x7f6984074a50 msgr2=0x7f6984074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:06.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.133+0000 7f698a9fd640 1 -- 172.21.15.96:0/2467455474 shutdown_connections 2024-02-19T19:11:06.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.133+0000 7f698a9fd640 1 -- 172.21.15.96:0/2467455474 wait complete. 2024-02-19T19:11:06.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.133+0000 7f698a9fd640 1 Processor -- start 2024-02-19T19:11:06.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.133+0000 7f698a9fd640 1 -- start start 2024-02-19T19:11:06.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.133+0000 7f698a9fd640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69840675c0 0x7f6984195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:06.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.134+0000 7f698a9fd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69841962c0 0x7f698419a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:06.158 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.134+0000 7f698a9fd640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69841968c0 con 0x7f69841962c0 2024-02-19T19:11:06.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.134+0000 7f698a9fd640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6984196a30 con 0x7f69840675c0 2024-02-19T19:11:06.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.134+0000 7f69837fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69841962c0 0x7f698419a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:06.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.134+0000 7f6983fff640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69840675c0 0x7f6984195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:06.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.134+0000 7f69837fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69841962c0 0x7f698419a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58610/0 (socket says 172.21.15.96:58610) 2024-02-19T19:11:06.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.134+0000 7f6983fff640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69840675c0 0x7f6984195d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.96:52918/0 (socket says 172.21.15.96:52918) 2024-02-19T19:11:06.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.134+0000 7f69837fe640 1 -- 172.21.15.96:0/2505796590 learned_addr learned my addr 172.21.15.96:0/2505796590 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:11:06.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.134+0000 7f69837fe640 1 -- 172.21.15.96:0/2505796590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69840675c0 msgr2=0x7f6984195d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:06.159 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.134+0000 7f69837fe640 1 --2- 172.21.15.96:0/2505796590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69840675c0 0x7f6984195d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.134+0000 7f69837fe640 1 -- 172.21.15.96:0/2505796590 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6978009560 con 0x7f69841962c0 2024-02-19T19:11:06.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.134+0000 7f6983fff640 1 --2- 172.21.15.96:0/2505796590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69840675c0 0x7f6984195d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:11:06.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.134+0000 7f69837fe640 1 --2- 172.21.15.96:0/2505796590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69841962c0 0x7f698419a720 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6978036040 tx=0x7f697802c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:06.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.134+0000 7f69817fa640 1 -- 172.21.15.96:0/2505796590 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69780035f0 con 0x7f69841962c0 2024-02-19T19:11:06.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.134+0000 7f69817fa640 1 -- 172.21.15.96:0/2505796590 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6978003c10 con 0x7f69841962c0 2024-02-19T19:11:06.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.134+0000 7f698a9fd640 1 -- 172.21.15.96:0/2505796590 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698419acc0 con 0x7f69841962c0 2024-02-19T19:11:06.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.134+0000 7f69817fa640 1 -- 172.21.15.96:0/2505796590 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6978005630 con 0x7f69841962c0 2024-02-19T19:11:06.160 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.134+0000 7f698a9fd640 1 -- 172.21.15.96:0/2505796590 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698419b220 con 0x7f69841962c0 2024-02-19T19:11:06.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.135+0000 7f698a9fd640 1 -- 172.21.15.96:0/2505796590 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f698404e040 con 0x7f69841962c0 2024-02-19T19:11:06.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.136+0000 7f69817fa640 1 -- 172.21.15.96:0/2505796590 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f6978003750 con 0x7f69841962c0 2024-02-19T19:11:06.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.137+0000 7f69817fa640 1 --2- 172.21.15.96:0/2505796590 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f696c06d810 0x7f696c06fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:06.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.137+0000 7f69817fa640 1 -- 172.21.15.96:0/2505796590 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f69780af7a0 con 0x7f69841962c0 2024-02-19T19:11:06.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.137+0000 7f6983fff640 1 --2- 172.21.15.96:0/2505796590 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f696c06d810 0x7f696c06fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:06.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.137+0000 7f6983fff640 1 --2- 172.21.15.96:0/2505796590 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f696c06d810 0x7f696c06fcd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6974009fc0 tx=0x7f6974005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:06.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.141+0000 7f69817fa640 1 -- 172.21.15.96:0/2505796590 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f69780790b0 con 0x7f69841962c0 2024-02-19T19:11:06.418 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.394+0000 7f906b09a700 1 -- 172.21.15.96:0/4063363383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9064100750 msgr2=0x7f90641047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:06.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.394+0000 7f906b09a700 1 --2- 172.21.15.96:0/4063363383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9064100750 0x7f90641047a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9050009910 tx=0x7f9050009c20 comp rx=0 tx=0).stop 2024-02-19T19:11:06.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.394+0000 7f906b09a700 1 -- 172.21.15.96:0/4063363383 shutdown_connections 2024-02-19T19:11:06.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.394+0000 7f906b09a700 1 --2- 172.21.15.96:0/4063363383 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9064100750 0x7f90641047a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.394+0000 7f906b09a700 1 --2- 172.21.15.96:0/4063363383 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90640ffda0 0x7f9064100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.394+0000 7f906b09a700 1 -- 172.21.15.96:0/4063363383 >> 172.21.15.96:0/4063363383 conn(0x7f90640fb650 msgr2=0x7f90640fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:06.419 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.394+0000 7f906b09a700 1 -- 172.21.15.96:0/4063363383 shutdown_connections 2024-02-19T19:11:06.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.394+0000 7f906b09a700 1 -- 172.21.15.96:0/4063363383 wait complete. 2024-02-19T19:11:06.420 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.396+0000 7f906b09a700 1 Processor -- start 2024-02-19T19:11:06.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.397+0000 7f906b09a700 1 -- start start 2024-02-19T19:11:06.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.397+0000 7f906b09a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90640ffda0 0x7f906410f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:06.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.397+0000 7f906b09a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9064100750 0x7f906419e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:06.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.397+0000 7f906b09a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906410fef0 con 0x7f90640ffda0 2024-02-19T19:11:06.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.397+0000 7f906b09a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9064110030 con 0x7f9064100750 2024-02-19T19:11:06.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.397+0000 7f9063fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9064100750 0x7f906419e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:06.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.397+0000 7f9063fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9064100750 0x7f906419e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.96:52934/0 (socket says 172.21.15.96:52934) 2024-02-19T19:11:06.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.397+0000 7f9063fff700 1 -- 172.21.15.96:0/1875043928 learned_addr learned my addr 172.21.15.96:0/1875043928 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:11:06.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.397+0000 7f9068e36700 1 --2- 172.21.15.96:0/1875043928 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90640ffda0 0x7f906410f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:06.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.398+0000 7f9063fff700 1 -- 172.21.15.96:0/1875043928 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90640ffda0 msgr2=0x7f906410f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:06.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.398+0000 7f9063fff700 1 --2- 172.21.15.96:0/1875043928 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90640ffda0 0x7f906410f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.398+0000 7f9063fff700 1 -- 172.21.15.96:0/1875043928 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90500095f0 con 0x7f9064100750 2024-02-19T19:11:06.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.398+0000 7f9068e36700 1 --2- 172.21.15.96:0/1875043928 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90640ffda0 0x7f906410f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:11:06.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.398+0000 7f9063fff700 1 --2- 172.21.15.96:0/1875043928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9064100750 0x7f906419e360 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f905000bda0 tx=0x7f905000bdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:06.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.398+0000 7f9061ffb700 1 -- 172.21.15.96:0/1875043928 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f905001d070 con 0x7f9064100750 2024-02-19T19:11:06.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.398+0000 7f9061ffb700 1 -- 172.21.15.96:0/1875043928 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9050005dc0 con 0x7f9064100750 2024-02-19T19:11:06.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.398+0000 7f9061ffb700 1 -- 172.21.15.96:0/1875043928 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9050017400 con 0x7f9064100750 2024-02-19T19:11:06.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.399+0000 7f906b09a700 1 -- 172.21.15.96:0/1875043928 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90641101d0 con 0x7f9064100750 2024-02-19T19:11:06.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.399+0000 7f906b09a700 1 -- 172.21.15.96:0/1875043928 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9064110640 con 0x7f9064100750 2024-02-19T19:11:06.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.400+0000 7f906b09a700 1 -- 172.21.15.96:0/1875043928 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f906404f2e0 con 0x7f9064100750 2024-02-19T19:11:06.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.401+0000 7f9061ffb700 1 -- 172.21.15.96:0/1875043928 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f905000f460 con 0x7f9064100750 2024-02-19T19:11:06.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.401+0000 7f9061ffb700 1 --2- 172.21.15.96:0/1875043928 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f905406d8a0 0x7f905406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:06.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.401+0000 7f9061ffb700 1 -- 172.21.15.96:0/1875043928 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f905008e900 con 0x7f9064100750 2024-02-19T19:11:06.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.401+0000 7f9068e36700 1 --2- 172.21.15.96:0/1875043928 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f905406d8a0 0x7f905406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:06.427 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.402+0000 7f9068e36700 1 --2- 172.21.15.96:0/1875043928 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f905406d8a0 0x7f905406fd60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9058005950 tx=0x7f905800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:06.432 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.410+0000 7f9061ffb700 1 -- 172.21.15.96:0/1875043928 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9050058100 con 0x7f9064100750 2024-02-19T19:11:06.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.493+0000 7f698a9fd640 1 -- 172.21.15.96:0/2505796590 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f698419b470 con 0x7f69841962c0 2024-02-19T19:11:06.515 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.494+0000 7f69817fa640 1 -- 172.21.15.96:0/2505796590 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f697807c770 con 0x7f69841962c0 2024-02-19T19:11:06.516 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-02-19T19:11:06.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.496+0000 7f698a9fd640 1 -- 172.21.15.96:0/2505796590 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f696c06d810 msgr2=0x7f696c06fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:06.517 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.496+0000 7f698a9fd640 1 --2- 172.21.15.96:0/2505796590 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f696c06d810 0x7f696c06fcd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6974009fc0 tx=0x7f6974005f90 comp rx=0 tx=0).stop 2024-02-19T19:11:06.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.496+0000 7f698a9fd640 1 -- 172.21.15.96:0/2505796590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69841962c0 msgr2=0x7f698419a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:06.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.496+0000 7f698a9fd640 1 --2- 172.21.15.96:0/2505796590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69841962c0 0x7f698419a720 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6978036040 tx=0x7f697802c750 comp rx=0 tx=0).stop 2024-02-19T19:11:06.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.496+0000 7f698a9fd640 1 -- 172.21.15.96:0/2505796590 shutdown_connections 2024-02-19T19:11:06.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.496+0000 7f698a9fd640 1 --2- 172.21.15.96:0/2505796590 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f696c06d810 0x7f696c06fcd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.496+0000 7f698a9fd640 1 --2- 172.21.15.96:0/2505796590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69841962c0 0x7f698419a720 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.496+0000 7f698a9fd640 1 --2- 172.21.15.96:0/2505796590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69840675c0 0x7f6984195d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.496+0000 7f698a9fd640 1 -- 172.21.15.96:0/2505796590 >> 172.21.15.96:0/2505796590 conn(0x7f6984074a50 msgr2=0x7f69840fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:06.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.496+0000 7f698a9fd640 1 -- 172.21.15.96:0/2505796590 shutdown_connections 2024-02-19T19:11:06.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.496+0000 7f698a9fd640 1 -- 172.21.15.96:0/2505796590 wait complete. 2024-02-19T19:11:06.533 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-19T19:11:06.646 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.624+0000 7fb5f22f2640 1 -- 172.21.15.96:0/3434316177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5ec067f70 msgr2=0x7fb5ec104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:06.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.624+0000 7fb5f22f2640 1 --2- 172.21.15.96:0/3434316177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5ec067f70 0x7fb5ec104c70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009880 tx=0x7fb5e002bce0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.624+0000 7fb5f22f2640 1 -- 172.21.15.96:0/3434316177 shutdown_connections 2024-02-19T19:11:06.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.624+0000 7fb5f22f2640 1 --2- 172.21.15.96:0/3434316177 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5ec067f70 0x7fb5ec104c70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.624+0000 7fb5f22f2640 1 --2- 172.21.15.96:0/3434316177 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5ec0675c0 0x7fb5ec0679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.624+0000 7fb5f22f2640 1 -- 172.21.15.96:0/3434316177 >> 172.21.15.96:0/3434316177 conn(0x7fb5ec074a50 msgr2=0x7fb5ec074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:06.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.624+0000 7fb5f22f2640 1 -- 172.21.15.96:0/3434316177 shutdown_connections 2024-02-19T19:11:06.647 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.624+0000 7fb5f22f2640 1 -- 172.21.15.96:0/3434316177 wait complete. 2024-02-19T19:11:06.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.625+0000 7fb5f22f2640 1 Processor -- start 2024-02-19T19:11:06.648 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.625+0000 7fb5f22f2640 1 -- start start 2024-02-19T19:11:06.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.625+0000 7fb5f22f2640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5ec0675c0 0x7fb5ec195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:06.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.625+0000 7fb5f22f2640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5ec1962c0 0x7fb5ec19a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:06.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.625+0000 7fb5f22f2640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec1968c0 con 0x7fb5ec1962c0 2024-02-19T19:11:06.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.625+0000 7fb5f22f2640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec196a30 con 0x7fb5ec0675c0 2024-02-19T19:11:06.650 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.625+0000 7fb5eb7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5ec1962c0 0x7fb5ec19a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:06.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.625+0000 7fb5eb7fe640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5ec1962c0 0x7fb5ec19a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58626/0 (socket says 172.21.15.96:58626) 2024-02-19T19:11:06.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.625+0000 7fb5eb7fe640 1 -- 172.21.15.96:0/3765510251 learned_addr learned my addr 172.21.15.96:0/3765510251 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:11:06.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.625+0000 7fb5ebfff640 1 --2- 172.21.15.96:0/3765510251 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5ec0675c0 0x7fb5ec195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:06.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.626+0000 7fb5eb7fe640 1 -- 172.21.15.96:0/3765510251 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5ec0675c0 msgr2=0x7fb5ec195d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:06.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.626+0000 7fb5eb7fe640 1 --2- 172.21.15.96:0/3765510251 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5ec0675c0 0x7fb5ec195d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.626+0000 7fb5eb7fe640 1 -- 172.21.15.96:0/3765510251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e0009560 con 0x7fb5ec1962c0 2024-02-19T19:11:06.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.626+0000 7fb5eb7fe640 1 --2- 172.21.15.96:0/3765510251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5ec1962c0 0x7fb5ec19a720 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0036040 tx=0x7fb5e002c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:06.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.626+0000 7fb5e97fa640 1 -- 172.21.15.96:0/3765510251 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5e00035f0 con 0x7fb5ec1962c0 2024-02-19T19:11:06.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.626+0000 7fb5e97fa640 1 -- 172.21.15.96:0/3765510251 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb5e0003c10 con 0x7fb5ec1962c0 2024-02-19T19:11:06.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.626+0000 7fb5e97fa640 1 -- 172.21.15.96:0/3765510251 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5e0005630 con 0x7fb5ec1962c0 2024-02-19T19:11:06.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.626+0000 7fb5f22f2640 1 -- 172.21.15.96:0/3765510251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ec19acc0 con 0x7fb5ec1962c0 2024-02-19T19:11:06.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.626+0000 7fb5f22f2640 1 -- 172.21.15.96:0/3765510251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ec19b1d0 con 0x7fb5ec1962c0 2024-02-19T19:11:06.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.627+0000 7fb5f22f2640 1 -- 172.21.15.96:0/3765510251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ec04e040 con 0x7fb5ec1962c0 2024-02-19T19:11:06.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.628+0000 7fb5e97fa640 1 -- 172.21.15.96:0/3765510251 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb5e0003750 con 0x7fb5ec1962c0 2024-02-19T19:11:06.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.628+0000 7fb5e97fa640 1 --2- 172.21.15.96:0/3765510251 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb5d406d810 0x7fb5d406fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:06.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.628+0000 7fb5e97fa640 1 -- 172.21.15.96:0/3765510251 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb5e00af7a0 con 0x7fb5ec1962c0 2024-02-19T19:11:06.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.628+0000 7fb5ebfff640 1 --2- 172.21.15.96:0/3765510251 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb5d406d810 0x7fb5d406fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:06.653 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.629+0000 7fb5ebfff640 1 --2- 172.21.15.96:0/3765510251 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb5d406d810 0x7fb5d406fcd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc009bd0 tx=0x7fb5dc005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:06.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.634+0000 7fb5e97fa640 1 -- 172.21.15.96:0/3765510251 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb5e00790b0 con 0x7fb5ec1962c0 2024-02-19T19:11:06.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:06 smithi125 ceph-mon[86115]: pgmap v108: 65 pgs: 65 active+clean; 112 MiB data, 622 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 7.0 MiB/s wr, 736 op/s 2024-02-19T19:11:06.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:06 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/1653690262' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T19:11:06.707 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.682+0000 7f906b09a700 1 -- 172.21.15.96:0/1875043928 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f90640fd560 con 0x7f905406d8a0 2024-02-19T19:11:06.708 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:06 smithi096 ceph-mon[112483]: pgmap v108: 65 pgs: 65 active+clean; 112 MiB data, 622 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 7.0 MiB/s wr, 736 op/s 2024-02-19T19:11:06.708 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:06 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/1653690262' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-19T19:11:06.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.687+0000 7f9061ffb700 1 -- 172.21.15.96:0/1875043928 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f90640fd560 con 0x7f905406d8a0 2024-02-19T19:11:06.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.689+0000 7f906b09a700 1 -- 172.21.15.96:0/1875043928 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f905406d8a0 msgr2=0x7f905406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:06.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.689+0000 7f906b09a700 1 --2- 172.21.15.96:0/1875043928 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f905406d8a0 0x7f905406fd60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9058005950 tx=0x7f905800b410 comp rx=0 tx=0).stop 2024-02-19T19:11:06.711 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.689+0000 7f906b09a700 1 -- 172.21.15.96:0/1875043928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9064100750 msgr2=0x7f906419e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:06.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.689+0000 7f906b09a700 1 --2- 172.21.15.96:0/1875043928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9064100750 0x7f906419e360 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f905000bda0 tx=0x7f905000bdd0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.689+0000 7f906b09a700 1 -- 172.21.15.96:0/1875043928 shutdown_connections 2024-02-19T19:11:06.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.689+0000 7f906b09a700 1 --2- 172.21.15.96:0/1875043928 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f905406d8a0 0x7f905406fd60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.689+0000 7f906b09a700 1 --2- 172.21.15.96:0/1875043928 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90640ffda0 0x7f906410f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.689+0000 7f906b09a700 1 --2- 172.21.15.96:0/1875043928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9064100750 0x7f906419e360 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.690+0000 7f906b09a700 1 -- 172.21.15.96:0/1875043928 >> 172.21.15.96:0/1875043928 conn(0x7f90640fb650 msgr2=0x7f90640fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:06.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.690+0000 7f906b09a700 1 -- 172.21.15.96:0/1875043928 shutdown_connections 2024-02-19T19:11:06.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.690+0000 7f906b09a700 1 -- 172.21.15.96:0/1875043928 wait complete. 2024-02-19T19:11:06.722 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:11:06.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.796+0000 7fc6c238d700 1 -- 172.21.15.96:0/2888355594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6bc0ffc20 msgr2=0x7fc6bc100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:06.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.796+0000 7fc6c238d700 1 --2- 172.21.15.96:0/2888355594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6bc0ffc20 0x7fc6bc100080 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0009910 tx=0x7fc6b0009c20 comp rx=0 tx=0).stop 2024-02-19T19:11:06.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.796+0000 7fc6c238d700 1 -- 172.21.15.96:0/2888355594 shutdown_connections 2024-02-19T19:11:06.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.796+0000 7fc6c238d700 1 --2- 172.21.15.96:0/2888355594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6bc0ffc20 0x7fc6bc100080 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.796+0000 7fc6c238d700 1 --2- 172.21.15.96:0/2888355594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6bc105bd0 0x7fc6bc105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.796+0000 7fc6c238d700 1 -- 172.21.15.96:0/2888355594 >> 172.21.15.96:0/2888355594 conn(0x7fc6bc075670 msgr2=0x7fc6bc075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:06.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.796+0000 7fc6c238d700 1 -- 172.21.15.96:0/2888355594 shutdown_connections 2024-02-19T19:11:06.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.796+0000 7fc6c238d700 1 -- 172.21.15.96:0/2888355594 wait complete. 2024-02-19T19:11:06.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.796+0000 7fc6c238d700 1 Processor -- start 2024-02-19T19:11:06.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.796+0000 7fc6c238d700 1 -- start start 2024-02-19T19:11:06.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.797+0000 7fc6c238d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6bc0ffc20 0x7fc6bc197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:06.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.797+0000 7fc6c238d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6bc105bd0 0x7fc6bc197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:06.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.797+0000 7fc6c238d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc198380 con 0x7fc6bc105bd0 2024-02-19T19:11:06.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.797+0000 7fc6c238d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6bc1984f0 con 0x7fc6bc0ffc20 2024-02-19T19:11:06.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.797+0000 7fc6bb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6bc105bd0 0x7fc6bc197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:06.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.797+0000 7fc6bb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6bc105bd0 0x7fc6bc197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58642/0 (socket says 172.21.15.96:58642) 2024-02-19T19:11:06.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.797+0000 7fc6bb7fe700 1 -- 172.21.15.96:0/1898626265 learned_addr learned my addr 172.21.15.96:0/1898626265 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:11:06.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.797+0000 7fc6bbfff700 1 --2- 172.21.15.96:0/1898626265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6bc0ffc20 0x7fc6bc197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:06.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.797+0000 7fc6bb7fe700 1 -- 172.21.15.96:0/1898626265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6bc0ffc20 msgr2=0x7fc6bc197760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:06.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.797+0000 7fc6bb7fe700 1 --2- 172.21.15.96:0/1898626265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6bc0ffc20 0x7fc6bc197760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.797+0000 7fc6bb7fe700 1 -- 172.21.15.96:0/1898626265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b00095f0 con 0x7fc6bc105bd0 2024-02-19T19:11:06.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.797+0000 7fc6bbfff700 1 --2- 172.21.15.96:0/1898626265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6bc0ffc20 0x7fc6bc197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:11:06.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.797+0000 7fc6bb7fe700 1 --2- 172.21.15.96:0/1898626265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6bc105bd0 0x7fc6bc197ca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0005f50 tx=0x7fc6b000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:06.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.798+0000 7fc6b97fa700 1 -- 172.21.15.96:0/1898626265 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6b001d070 con 0x7fc6bc105bd0 2024-02-19T19:11:06.822 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.798+0000 7fc6b97fa700 1 -- 172.21.15.96:0/1898626265 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc6b000b610 con 0x7fc6bc105bd0 2024-02-19T19:11:06.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.798+0000 7fc6c238d700 1 -- 172.21.15.96:0/1898626265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6bc1a07d0 con 0x7fc6bc105bd0 2024-02-19T19:11:06.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.798+0000 7fc6b97fa700 1 -- 172.21.15.96:0/1898626265 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6b0022470 con 0x7fc6bc105bd0 2024-02-19T19:11:06.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.798+0000 7fc6c238d700 1 -- 172.21.15.96:0/1898626265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6bc1a0c40 con 0x7fc6bc105bd0 2024-02-19T19:11:06.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.799+0000 7fc6c238d700 1 -- 172.21.15.96:0/1898626265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6bc1080d0 con 0x7fc6bc105bd0 2024-02-19T19:11:06.823 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.799+0000 7fc6b97fa700 1 -- 172.21.15.96:0/1898626265 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fc6b0003780 con 0x7fc6bc105bd0 2024-02-19T19:11:06.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.800+0000 7fc6b97fa700 1 --2- 172.21.15.96:0/1898626265 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc6a406d8a0 0x7fc6a406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:06.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.800+0000 7fc6b97fa700 1 -- 172.21.15.96:0/1898626265 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc6b008e850 con 0x7fc6bc105bd0 2024-02-19T19:11:06.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.800+0000 7fc6bbfff700 1 --2- 172.21.15.96:0/1898626265 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc6a406d8a0 0x7fc6a406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:06.824 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.800+0000 7fc6bbfff700 1 --2- 172.21.15.96:0/1898626265 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc6a406d8a0 0x7fc6a406fd60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009480 tx=0x7fc6b400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:06.826 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.804+0000 7fc6b97fa700 1 -- 172.21.15.96:0/1898626265 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc6b00580b0 con 0x7fc6bc105bd0 2024-02-19T19:11:06.840 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.818+0000 7fb5f22f2640 1 -- 172.21.15.96:0/3765510251 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fb5ec108580 con 0x7fb5ec1962c0 2024-02-19T19:11:06.841 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.819+0000 7fb5e97fa640 1 -- 172.21.15.96:0/3765510251 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v64) v1 ==== 107+0+11 (secure 0 0 0) 0x7fb5e007c770 con 0x7fb5ec1962c0 2024-02-19T19:11:06.841 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-02-19T19:11:06.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.821+0000 7fb5f22f2640 1 -- 172.21.15.96:0/3765510251 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb5d406d810 msgr2=0x7fb5d406fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:06.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.821+0000 7fb5f22f2640 1 --2- 172.21.15.96:0/3765510251 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb5d406d810 0x7fb5d406fcd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc009bd0 tx=0x7fb5dc005f90 comp rx=0 tx=0).stop 2024-02-19T19:11:06.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.821+0000 7fb5f22f2640 1 -- 172.21.15.96:0/3765510251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5ec1962c0 msgr2=0x7fb5ec19a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:06.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.821+0000 7fb5f22f2640 1 --2- 172.21.15.96:0/3765510251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5ec1962c0 0x7fb5ec19a720 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0036040 tx=0x7fb5e002c750 comp rx=0 tx=0).stop 2024-02-19T19:11:06.843 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.821+0000 7fb5f22f2640 1 -- 172.21.15.96:0/3765510251 shutdown_connections 2024-02-19T19:11:06.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.821+0000 7fb5f22f2640 1 --2- 172.21.15.96:0/3765510251 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb5d406d810 0x7fb5d406fcd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.821+0000 7fb5f22f2640 1 --2- 172.21.15.96:0/3765510251 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5ec1962c0 0x7fb5ec19a720 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.821+0000 7fb5f22f2640 1 --2- 172.21.15.96:0/3765510251 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb5ec0675c0 0x7fb5ec195d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.821+0000 7fb5f22f2640 1 -- 172.21.15.96:0/3765510251 >> 172.21.15.96:0/3765510251 conn(0x7fb5ec074a50 msgr2=0x7fb5ec0fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:06.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.821+0000 7fb5f22f2640 1 -- 172.21.15.96:0/3765510251 shutdown_connections 2024-02-19T19:11:06.844 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.821+0000 7fb5f22f2640 1 -- 172.21.15.96:0/3765510251 wait complete. 2024-02-19T19:11:06.853 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-19T19:11:06.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.936+0000 7f1cd52ae640 1 -- 172.21.15.96:0/1100783315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cd01002b0 msgr2=0x7f1cd0100690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:06.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.936+0000 7f1cd52ae640 1 --2- 172.21.15.96:0/1100783315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cd01002b0 0x7f1cd0100690 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009880 tx=0x7f1cb802bce0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.960 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.936+0000 7f1cd52ae640 1 -- 172.21.15.96:0/1100783315 shutdown_connections 2024-02-19T19:11:06.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.936+0000 7f1cd52ae640 1 --2- 172.21.15.96:0/1100783315 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1cd0100c60 0x7f1cd0104ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.936+0000 7f1cd52ae640 1 --2- 172.21.15.96:0/1100783315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cd01002b0 0x7f1cd0100690 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.936+0000 7f1cd52ae640 1 -- 172.21.15.96:0/1100783315 >> 172.21.15.96:0/1100783315 conn(0x7f1cd00fbb30 msgr2=0x7f1cd00fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:06.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.936+0000 7f1cd52ae640 1 -- 172.21.15.96:0/1100783315 shutdown_connections 2024-02-19T19:11:06.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.936+0000 7f1cd52ae640 1 -- 172.21.15.96:0/1100783315 wait complete. 2024-02-19T19:11:06.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.937+0000 7f1cd52ae640 1 Processor -- start 2024-02-19T19:11:06.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.937+0000 7f1cd52ae640 1 -- start start 2024-02-19T19:11:06.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.937+0000 7f1cd52ae640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cd01002b0 0x7f1cd0195e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:06.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.937+0000 7f1cd52ae640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1cd01963a0 0x7f1cd019a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:06.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.937+0000 7f1cd52ae640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd01969a0 con 0x7f1cd01002b0 2024-02-19T19:11:06.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.937+0000 7f1cd52ae640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd0196b10 con 0x7f1cd01963a0 2024-02-19T19:11:06.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.937+0000 7f1cceffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cd01002b0 0x7f1cd0195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:06.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.937+0000 7f1cceffd640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cd01002b0 0x7f1cd0195e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58656/0 (socket says 172.21.15.96:58656) 2024-02-19T19:11:06.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.937+0000 7f1cceffd640 1 -- 172.21.15.96:0/3906309792 learned_addr learned my addr 172.21.15.96:0/3906309792 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:11:06.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.938+0000 7f1cce7fc640 1 --2- 172.21.15.96:0/3906309792 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1cd01963a0 0x7f1cd019a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:06.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.938+0000 7f1cceffd640 1 -- 172.21.15.96:0/3906309792 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1cd01963a0 msgr2=0x7f1cd019a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:06.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.938+0000 7f1cceffd640 1 --2- 172.21.15.96:0/3906309792 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1cd01963a0 0x7f1cd019a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:06.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.938+0000 7f1cceffd640 1 -- 172.21.15.96:0/3906309792 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb8009560 con 0x7f1cd01002b0 2024-02-19T19:11:06.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.938+0000 7f1cceffd640 1 --2- 172.21.15.96:0/3906309792 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cd01002b0 0x7f1cd0195e60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009430 tx=0x7f1cb8005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:06.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.938+0000 7f1cc7fff640 1 -- 172.21.15.96:0/3906309792 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cb80044a0 con 0x7f1cd01002b0 2024-02-19T19:11:06.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.938+0000 7f1cc7fff640 1 -- 172.21.15.96:0/3906309792 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1cb8003ab0 con 0x7f1cd01002b0 2024-02-19T19:11:06.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.938+0000 7f1cd52ae640 1 -- 172.21.15.96:0/3906309792 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd019ada0 con 0x7f1cd01002b0 2024-02-19T19:11:06.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.938+0000 7f1cc7fff640 1 -- 172.21.15.96:0/3906309792 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1cb80055f0 con 0x7f1cd01002b0 2024-02-19T19:11:06.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.938+0000 7f1cd52ae640 1 -- 172.21.15.96:0/3906309792 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd019b300 con 0x7f1cd01002b0 2024-02-19T19:11:06.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.939+0000 7f1cd52ae640 1 -- 172.21.15.96:0/3906309792 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd004e040 con 0x7f1cd01002b0 2024-02-19T19:11:06.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.940+0000 7f1cc7fff640 1 -- 172.21.15.96:0/3906309792 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f1cb8004e60 con 0x7f1cd01002b0 2024-02-19T19:11:06.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.940+0000 7f1cc7fff640 1 --2- 172.21.15.96:0/3906309792 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f1cbc06d810 0x7f1cbc06fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:06.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.940+0000 7f1cc7fff640 1 -- 172.21.15.96:0/3906309792 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1cb80af7d0 con 0x7f1cd01002b0 2024-02-19T19:11:06.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.940+0000 7f1cce7fc640 1 --2- 172.21.15.96:0/3906309792 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f1cbc06d810 0x7f1cbc06fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:06.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.941+0000 7f1cce7fc640 1 --2- 172.21.15.96:0/3906309792 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f1cbc06d810 0x7f1cbc06fcd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00694a0 tx=0x7f1cc0005f90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:06.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:06.945+0000 7f1cc7fff640 1 -- 172.21.15.96:0/3906309792 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1cb80790e0 con 0x7f1cd01002b0 2024-02-19T19:11:07.007 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:06 smithi125 systemd[1]: Stopping Ceph osd.3 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T19:11:07.051 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.029+0000 7fc6c238d700 1 -- 172.21.15.96:0/1898626265 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6bc068c30 con 0x7fc6a406d8a0 2024-02-19T19:11:07.052 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.030+0000 7fc6b97fa700 1 -- 172.21.15.96:0/1898626265 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fc6bc068c30 con 0x7fc6a406d8a0 2024-02-19T19:11:07.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.032+0000 7fc6c238d700 1 -- 172.21.15.96:0/1898626265 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc6a406d8a0 msgr2=0x7fc6a406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:07.054 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.032+0000 7fc6c238d700 1 --2- 172.21.15.96:0/1898626265 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc6a406d8a0 0x7fc6a406fd60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009480 tx=0x7fc6b400b040 comp rx=0 tx=0).stop 2024-02-19T19:11:07.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.032+0000 7fc6c238d700 1 -- 172.21.15.96:0/1898626265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6bc105bd0 msgr2=0x7fc6bc197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:07.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.032+0000 7fc6c238d700 1 --2- 172.21.15.96:0/1898626265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6bc105bd0 0x7fc6bc197ca0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0005f50 tx=0x7fc6b000f690 comp rx=0 tx=0).stop 2024-02-19T19:11:07.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.032+0000 7fc6c238d700 1 -- 172.21.15.96:0/1898626265 shutdown_connections 2024-02-19T19:11:07.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.032+0000 7fc6c238d700 1 --2- 172.21.15.96:0/1898626265 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc6a406d8a0 0x7fc6a406fd60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.032+0000 7fc6c238d700 1 --2- 172.21.15.96:0/1898626265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc6bc0ffc20 0x7fc6bc197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.032+0000 7fc6c238d700 1 --2- 172.21.15.96:0/1898626265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6bc105bd0 0x7fc6bc197ca0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.032+0000 7fc6c238d700 1 -- 172.21.15.96:0/1898626265 >> 172.21.15.96:0/1898626265 conn(0x7fc6bc075670 msgr2=0x7fc6bc0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:07.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.032+0000 7fc6c238d700 1 -- 172.21.15.96:0/1898626265 shutdown_connections 2024-02-19T19:11:07.055 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.032+0000 7fc6c238d700 1 -- 172.21.15.96:0/1898626265 wait complete. 2024-02-19T19:11:07.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.124+0000 7f1cd52ae640 1 -- 172.21.15.96:0/3906309792 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f1cd019b610 con 0x7f1cd01002b0 2024-02-19T19:11:07.146 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.124+0000 7f1cc7fff640 1 -- 172.21.15.96:0/3906309792 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v64) v1 ==== 107+0+11 (secure 0 0 0) 0x7f1cb80ade60 con 0x7f1cd01002b0 2024-02-19T19:11:07.146 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-02-19T19:11:07.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.126+0000 7f1cd52ae640 1 -- 172.21.15.96:0/3906309792 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f1cbc06d810 msgr2=0x7f1cbc06fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:07.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.126+0000 7f1cd52ae640 1 --2- 172.21.15.96:0/3906309792 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f1cbc06d810 0x7f1cbc06fcd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00694a0 tx=0x7f1cc0005f90 comp rx=0 tx=0).stop 2024-02-19T19:11:07.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.126+0000 7f1cd52ae640 1 -- 172.21.15.96:0/3906309792 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cd01002b0 msgr2=0x7f1cd0195e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:07.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.126+0000 7f1cd52ae640 1 --2- 172.21.15.96:0/3906309792 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cd01002b0 0x7f1cd0195e60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009430 tx=0x7f1cb8005e50 comp rx=0 tx=0).stop 2024-02-19T19:11:07.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.126+0000 7f1cd52ae640 1 -- 172.21.15.96:0/3906309792 shutdown_connections 2024-02-19T19:11:07.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.126+0000 7f1cd52ae640 1 --2- 172.21.15.96:0/3906309792 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f1cbc06d810 0x7f1cbc06fcd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.126+0000 7f1cd52ae640 1 --2- 172.21.15.96:0/3906309792 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1cd01963a0 0x7f1cd019a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.126+0000 7f1cd52ae640 1 --2- 172.21.15.96:0/3906309792 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1cd01002b0 0x7f1cd0195e60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.126+0000 7f1cd52ae640 1 -- 172.21.15.96:0/3906309792 >> 172.21.15.96:0/3906309792 conn(0x7f1cd00fbb30 msgr2=0x7f1cd00fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:07.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.127+0000 7f1cd52ae640 1 -- 172.21.15.96:0/3906309792 shutdown_connections 2024-02-19T19:11:07.150 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.127+0000 7f1cd52ae640 1 -- 172.21.15.96:0/3906309792 wait complete. 2024-02-19T19:11:07.159 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-19T19:11:07.161 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.137+0000 7f27931df700 1 -- 172.21.15.96:0/1708059587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f278c0ff340 msgr2=0x7f278c0ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:07.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.137+0000 7f27931df700 1 --2- 172.21.15.96:0/1708059587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f278c0ff340 0x7f278c0ff7c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2778009910 tx=0x7f2778009c20 comp rx=0 tx=0).stop 2024-02-19T19:11:07.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.137+0000 7f27931df700 1 -- 172.21.15.96:0/1708059587 shutdown_connections 2024-02-19T19:11:07.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.137+0000 7f27931df700 1 --2- 172.21.15.96:0/1708059587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f278c0ff340 0x7f278c0ff7c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.137+0000 7f27931df700 1 --2- 172.21.15.96:0/1708059587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f278c101bb0 0x7f278c101f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.137+0000 7f27931df700 1 -- 172.21.15.96:0/1708059587 >> 172.21.15.96:0/1708059587 conn(0x7f278c074e30 msgr2=0x7f278c075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:07.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.137+0000 7f27931df700 1 -- 172.21.15.96:0/1708059587 shutdown_connections 2024-02-19T19:11:07.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.137+0000 7f27931df700 1 -- 172.21.15.96:0/1708059587 wait complete. 2024-02-19T19:11:07.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.138+0000 7f27931df700 1 Processor -- start 2024-02-19T19:11:07.162 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.138+0000 7f27931df700 1 -- start start 2024-02-19T19:11:07.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.138+0000 7f27931df700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f278c0ff340 0x7f278c19e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:07.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.138+0000 7f27931df700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f278c101bb0 0x7f278c19ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:07.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.138+0000 7f27931df700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c19f3d0 con 0x7f278c0ff340 2024-02-19T19:11:07.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.138+0000 7f27931df700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c198880 con 0x7f278c101bb0 2024-02-19T19:11:07.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.138+0000 7f2790f7b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f278c0ff340 0x7f278c19e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:07.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.138+0000 7f2790f7b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f278c0ff340 0x7f278c19e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58684/0 (socket says 172.21.15.96:58684) 2024-02-19T19:11:07.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.138+0000 7f2790f7b700 1 -- 172.21.15.96:0/15885302 learned_addr learned my addr 172.21.15.96:0/15885302 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:11:07.163 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.139+0000 7f278bfff700 1 --2- 172.21.15.96:0/15885302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f278c101bb0 0x7f278c19ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:07.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.139+0000 7f2790f7b700 1 -- 172.21.15.96:0/15885302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f278c101bb0 msgr2=0x7f278c19ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:07.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.139+0000 7f2790f7b700 1 --2- 172.21.15.96:0/15885302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f278c101bb0 0x7f278c19ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.139+0000 7f2790f7b700 1 -- 172.21.15.96:0/15885302 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27780095f0 con 0x7f278c0ff340 2024-02-19T19:11:07.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.139+0000 7f278bfff700 1 --2- 172.21.15.96:0/15885302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f278c101bb0 0x7f278c19ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:11:07.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.139+0000 7f2790f7b700 1 --2- 172.21.15.96:0/15885302 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f278c0ff340 0x7f278c19e800 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f278000d900 tx=0x7f278000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:07.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.139+0000 7f2789ffb700 1 -- 172.21.15.96:0/15885302 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27800041f0 con 0x7f278c0ff340 2024-02-19T19:11:07.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.139+0000 7f2789ffb700 1 -- 172.21.15.96:0/15885302 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2780004cf0 con 0x7f278c0ff340 2024-02-19T19:11:07.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.139+0000 7f2789ffb700 1 -- 172.21.15.96:0/15885302 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f278000b750 con 0x7f278c0ff340 2024-02-19T19:11:07.164 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.139+0000 7f27931df700 1 -- 172.21.15.96:0/15885302 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278c198b60 con 0x7f278c0ff340 2024-02-19T19:11:07.165 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.139+0000 7f27931df700 1 -- 172.21.15.96:0/15885302 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f278c1990b0 con 0x7f278c0ff340 2024-02-19T19:11:07.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.140+0000 7f27931df700 1 -- 172.21.15.96:0/15885302 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278c10b230 con 0x7f278c0ff340 2024-02-19T19:11:07.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.141+0000 7f2789ffb700 1 -- 172.21.15.96:0/15885302 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f2780004350 con 0x7f278c0ff340 2024-02-19T19:11:07.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.141+0000 7f2789ffb700 1 --2- 172.21.15.96:0/15885302 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f277c06d8a0 0x7f277c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:07.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.141+0000 7f2789ffb700 1 -- 172.21.15.96:0/15885302 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f278008d500 con 0x7f278c0ff340 2024-02-19T19:11:07.166 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.141+0000 7f278bfff700 1 --2- 172.21.15.96:0/15885302 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f277c06d8a0 0x7f277c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:07.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.142+0000 7f278bfff700 1 --2- 172.21.15.96:0/15885302 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f277c06d8a0 0x7f277c06fd60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2778005b40 tx=0x7f277801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:07.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.147+0000 7f2789ffb700 1 -- 172.21.15.96:0/15885302 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f278005a910 con 0x7f278c0ff340 2024-02-19T19:11:07.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.242+0000 7fcba4c6a640 1 -- 172.21.15.96:0/634627051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcba00fefe0 msgr2=0x7fcba00ff440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:07.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.242+0000 7fcba4c6a640 1 --2- 172.21.15.96:0/634627051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcba00fefe0 0x7fcba00ff440 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcb90009880 tx=0x7fcb9002bce0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.242+0000 7fcba4c6a640 1 -- 172.21.15.96:0/634627051 shutdown_connections 2024-02-19T19:11:07.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.242+0000 7fcba4c6a640 1 --2- 172.21.15.96:0/634627051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcba00fefe0 0x7fcba00ff440 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.242+0000 7fcba4c6a640 1 --2- 172.21.15.96:0/634627051 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcba0103f20 0x7fcba0104300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.264 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.242+0000 7fcba4c6a640 1 -- 172.21.15.96:0/634627051 >> 172.21.15.96:0/634627051 conn(0x7fcba0075b40 msgr2=0x7fcba0075f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:07.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.242+0000 7fcba4c6a640 1 -- 172.21.15.96:0/634627051 shutdown_connections 2024-02-19T19:11:07.265 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.242+0000 7fcba4c6a640 1 -- 172.21.15.96:0/634627051 wait complete. 2024-02-19T19:11:07.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.242+0000 7fcba4c6a640 1 Processor -- start 2024-02-19T19:11:07.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.242+0000 7fcba4c6a640 1 -- start start 2024-02-19T19:11:07.267 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.243+0000 7fcba4c6a640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcba00fefe0 0x7fcba00fcd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.243+0000 7fcba4c6a640 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcba0103f20 0x7fcba00fd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.243+0000 7fcba4c6a640 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba00fd870 con 0x7fcba00fefe0 2024-02-19T19:11:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.243+0000 7fcba4c6a640 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba00fd9b0 con 0x7fcba0103f20 2024-02-19T19:11:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.243+0000 7fcb9e59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcba00fefe0 0x7fcba00fcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.243+0000 7fcb9e59c640 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcba00fefe0 0x7fcba00fcd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58700/0 (socket says 172.21.15.96:58700) 2024-02-19T19:11:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.243+0000 7fcb9e59c640 1 -- 172.21.15.96:0/1693259852 learned_addr learned my addr 172.21.15.96:0/1693259852 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:11:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.243+0000 7fcb9dd9b640 1 --2- 172.21.15.96:0/1693259852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcba0103f20 0x7fcba00fd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:07.268 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.243+0000 7fcb9e59c640 1 -- 172.21.15.96:0/1693259852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcba0103f20 msgr2=0x7fcba00fd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:07.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.243+0000 7fcb9e59c640 1 --2- 172.21.15.96:0/1693259852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcba0103f20 0x7fcba00fd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.243+0000 7fcb9e59c640 1 -- 172.21.15.96:0/1693259852 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb90009560 con 0x7fcba00fefe0 2024-02-19T19:11:07.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.243+0000 7fcb9e59c640 1 --2- 172.21.15.96:0/1693259852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcba00fefe0 0x7fcba00fcd60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400d8d0 tx=0x7fcb9400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:07.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.243+0000 7fcb8f7fe640 1 -- 172.21.15.96:0/1693259852 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb94009c00 con 0x7fcba00fefe0 2024-02-19T19:11:07.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.243+0000 7fcb8f7fe640 1 -- 172.21.15.96:0/1693259852 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcb94009d60 con 0x7fcba00fefe0 2024-02-19T19:11:07.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.243+0000 7fcba4c6a640 1 -- 172.21.15.96:0/1693259852 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba01a1f20 con 0x7fcba00fefe0 2024-02-19T19:11:07.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.243+0000 7fcb8f7fe640 1 -- 172.21.15.96:0/1693259852 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb940049d0 con 0x7fcba00fefe0 2024-02-19T19:11:07.269 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.244+0000 7fcba4c6a640 1 -- 172.21.15.96:0/1693259852 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba01a2340 con 0x7fcba00fefe0 2024-02-19T19:11:07.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.245+0000 7fcba4c6a640 1 -- 172.21.15.96:0/1693259852 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba004e040 con 0x7fcba00fefe0 2024-02-19T19:11:07.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.245+0000 7fcb8f7fe640 1 -- 172.21.15.96:0/1693259852 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fcb94004c90 con 0x7fcba00fefe0 2024-02-19T19:11:07.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.245+0000 7fcb8f7fe640 1 --2- 172.21.15.96:0/1693259852 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fcb8806d8d0 0x7fcb8806fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:07.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.246+0000 7fcb9dd9b640 1 --2- 172.21.15.96:0/1693259852 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fcb8806d8d0 0x7fcb8806fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:07.270 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.246+0000 7fcb8f7fe640 1 -- 172.21.15.96:0/1693259852 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fcb9408d0e0 con 0x7fcba00fefe0 2024-02-19T19:11:07.271 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.246+0000 7fcb9dd9b640 1 --2- 172.21.15.96:0/1693259852 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fcb8806d8d0 0x7fcb8806fd90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcb90006010 tx=0x7fcb90005dd0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:07.272 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.250+0000 7fcb8f7fe640 1 -- 172.21.15.96:0/1693259852 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcb94056940 con 0x7fcba00fefe0 2024-02-19T19:11:07.379 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.357+0000 7f27931df700 1 -- 172.21.15.96:0/15885302 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f278c199320 con 0x7f277c06d8a0 2024-02-19T19:11:07.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.368+0000 7f2789ffb700 1 -- 172.21.15.96:0/15885302 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f278c199320 con 0x7f277c06d8a0 2024-02-19T19:11:07.390 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:11:07.390 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (5m) 26s ago 14m 24.9M - 0.25.0 c8568f914cd2 bbaf83a1e476 2024-02-19T19:11:07.391 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (15m) 26s ago 15m 8652k - 18.2.1 94eadd990e0a b41bff2e0043 2024-02-19T19:11:07.391 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (13m) 112s ago 13m 8044k - 18.2.1 94eadd990e0a 254ab7e7a040 2024-02-19T19:11:07.391 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2m) 26s ago 15m 6669k - 19.0.0-1450-gf78a58c0 f081f847070a deea0ffefa0f 2024-02-19T19:11:07.391 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (116s) 112s ago 13m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 3421965dc5b0 2024-02-19T19:11:07.391 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (4m) 26s ago 14m 86.6M - 9.4.12 a0ea5e3c46d9 0102d90938e4 2024-02-19T19:11:07.391 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (9m) 26s ago 9m 27.6M - 18.2.1 94eadd990e0a 0a61d9cd40d1 2024-02-19T19:11:07.391 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (9m) 26s ago 9m 24.6M - 18.2.1 94eadd990e0a 58db3e7a7d75 2024-02-19T19:11:07.391 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (9m) 112s ago 9m 28.4M - 18.2.1 94eadd990e0a 211d64de8a63 2024-02-19T19:11:07.391 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (9m) 112s ago 9m 26.5M - 18.2.1 94eadd990e0a 2a04b5a8eaf4 2024-02-19T19:11:07.392 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:8443,9283,8765 running (6m) 26s ago 16m 500M - 19.0.0-1450-gf78a58c0 f081f847070a a86fbe94fe3f 2024-02-19T19:11:07.392 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (6m) 112s ago 13m 448M - 19.0.0-1450-gf78a58c0 f081f847070a e250486d572d 2024-02-19T19:11:07.392 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3m) 26s ago 16m 50.6M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d70090d516e3 2024-02-19T19:11:07.392 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (2m) 112s ago 13m 36.7M 2048M 19.0.0-1450-gf78a58c0 f081f847070a f56b17bdc9a0 2024-02-19T19:11:07.432 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (6m) 26s ago 15m 15.1M - 1.5.0 0da6a335fe13 51f622ea33d6 2024-02-19T19:11:07.433 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (5m) 112s ago 13m 17.2M - 1.5.0 0da6a335fe13 464e076a52a1 2024-02-19T19:11:07.433 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (94s) 26s ago 12m 46.9M 1216M 19.0.0-1450-gf78a58c0 f081f847070a b3dffd6a3fb2 2024-02-19T19:11:07.433 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (57s) 26s ago 12m 44.4M 1216M 19.0.0-1450-gf78a58c0 f081f847070a f0dd6d8f952f 2024-02-19T19:11:07.433 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (33s) 26s ago 12m 14.8M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 51b70eaaa7a9 2024-02-19T19:11:07.433 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (11m) 112s ago 11m 51.9M 2240M 18.2.1 94eadd990e0a 4746b79351fc 2024-02-19T19:11:07.433 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (11m) 112s ago 11m 51.2M 2240M 18.2.1 94eadd990e0a 2b3f0088f6b2 2024-02-19T19:11:07.433 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (10m) 112s ago 10m 48.0M 2240M 18.2.1 94eadd990e0a e5731974b46a 2024-02-19T19:11:07.433 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (5m) 26s ago 14m 64.9M - 2.43.0 a07b618ecd1d a4edcf6ed669 2024-02-19T19:11:07.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.370+0000 7f27931df700 1 -- 172.21.15.96:0/15885302 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f277c06d8a0 msgr2=0x7f277c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:07.434 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.370+0000 7f27931df700 1 --2- 172.21.15.96:0/15885302 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f277c06d8a0 0x7f277c06fd60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2778005b40 tx=0x7f277801a040 comp rx=0 tx=0).stop 2024-02-19T19:11:07.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.370+0000 7f27931df700 1 -- 172.21.15.96:0/15885302 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f278c0ff340 msgr2=0x7f278c19e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:07.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.370+0000 7f27931df700 1 --2- 172.21.15.96:0/15885302 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f278c0ff340 0x7f278c19e800 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f278000d900 tx=0x7f278000dcc0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.370+0000 7f27931df700 1 -- 172.21.15.96:0/15885302 shutdown_connections 2024-02-19T19:11:07.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.370+0000 7f27931df700 1 --2- 172.21.15.96:0/15885302 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f277c06d8a0 0x7f277c06fd60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.370+0000 7f27931df700 1 --2- 172.21.15.96:0/15885302 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f278c0ff340 0x7f278c19e800 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.370+0000 7f27931df700 1 --2- 172.21.15.96:0/15885302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f278c101bb0 0x7f278c19ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.370+0000 7f27931df700 1 -- 172.21.15.96:0/15885302 >> 172.21.15.96:0/15885302 conn(0x7f278c074e30 msgr2=0x7f278c0fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:07.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.370+0000 7f27931df700 1 -- 172.21.15.96:0/15885302 shutdown_connections 2024-02-19T19:11:07.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.370+0000 7f27931df700 1 -- 172.21.15.96:0/15885302 wait complete. 2024-02-19T19:11:07.438 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:06 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3[43637]: 2024-02-19T19:11:06.985+0000 7f5b7ee86700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T19:11:07.438 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:06 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3[43637]: 2024-02-19T19:11:06.985+0000 7f5b7ee86700 -1 osd.3 64 *** Got signal Terminated *** 2024-02-19T19:11:07.438 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:06 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3[43637]: 2024-02-19T19:11:06.985+0000 7f5b7ee86700 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T19:11:07.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.454+0000 7fcba4c6a640 1 -- 172.21.15.96:0/1693259852 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcba0108440 con 0x7fcba00fefe0 2024-02-19T19:11:07.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.455+0000 7fcb8f7fe640 1 -- 172.21.15.96:0/1693259852 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v65) v1 ==== 81+0+2188 (secure 0 0 0) 0x7fcb9405a000 con 0x7fcba00fefe0 2024-02-19T19:11:07.477 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/2306653686 2024-02-20T19:08:05.264847+0000 2024-02-19T19:11:07.477 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.125:6829/1031992411 2024-02-20T19:04:30.007542+0000 2024-02-19T19:11:07.477 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/782865038 2024-02-20T18:55:03.067702+0000 2024-02-19T19:11:07.477 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/3107913807 2024-02-20T19:03:48.973809+0000 2024-02-19T19:11:07.477 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/2093229384 2024-02-20T18:55:36.280962+0000 2024-02-19T19:11:07.477 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.125:0/1183575069 2024-02-20T19:04:30.007542+0000 2024-02-19T19:11:07.478 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/1504142982 2024-02-20T19:03:48.973809+0000 2024-02-19T19:11:07.478 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6800/3697355606 2024-02-20T18:55:36.280962+0000 2024-02-19T19:11:07.478 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/580326503 2024-02-20T19:03:48.973809+0000 2024-02-19T19:11:07.478 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/561831206 2024-02-20T18:56:57.759773+0000 2024-02-19T19:11:07.478 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6800/3628131135 2024-02-20T18:56:57.759773+0000 2024-02-19T19:11:07.478 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6800/664869387 2024-02-20T19:03:48.973809+0000 2024-02-19T19:11:07.478 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/1844984401 2024-02-20T18:55:36.280962+0000 2024-02-19T19:11:07.478 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/1619105804 2024-02-20T19:08:05.264847+0000 2024-02-19T19:11:07.479 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6801/3697355606 2024-02-20T18:55:36.280962+0000 2024-02-19T19:11:07.479 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.125:0/535273135 2024-02-20T19:04:30.007542+0000 2024-02-19T19:11:07.479 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.125:0/3378132019 2024-02-20T19:04:30.007542+0000 2024-02-19T19:11:07.479 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.125:6828/1031992411 2024-02-20T19:04:30.007542+0000 2024-02-19T19:11:07.479 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6801/664869387 2024-02-20T19:03:48.973809+0000 2024-02-19T19:11:07.479 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/1723107272 2024-02-20T19:03:48.973809+0000 2024-02-19T19:11:07.479 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/4153792828 2024-02-20T18:56:57.759773+0000 2024-02-19T19:11:07.479 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.125:0/1782639588 2024-02-20T19:04:30.007542+0000 2024-02-19T19:11:07.480 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6800/967937024 2024-02-20T19:08:05.264847+0000 2024-02-19T19:11:07.480 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6827/3917487208 2024-02-20T19:01:58.847298+0000 2024-02-19T19:11:07.480 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6800/1286321532 2024-02-20T18:55:03.067702+0000 2024-02-19T19:11:07.480 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.125:0/3569163597 2024-02-20T19:04:30.007542+0000 2024-02-19T19:11:07.480 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/3018792068 2024-02-20T18:56:57.759773+0000 2024-02-19T19:11:07.480 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.125:0/2630461593 2024-02-20T19:04:30.007542+0000 2024-02-19T19:11:07.480 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6801/1286321532 2024-02-20T18:55:03.067702+0000 2024-02-19T19:11:07.480 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/2493593498 2024-02-20T18:55:36.280962+0000 2024-02-19T19:11:07.480 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/3563912069 2024-02-20T18:55:03.067702+0000 2024-02-19T19:11:07.481 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/2915208892 2024-02-20T19:08:05.264847+0000 2024-02-19T19:11:07.481 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/1543256561 2024-02-20T18:55:03.067702+0000 2024-02-19T19:11:07.481 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6801/3628131135 2024-02-20T18:56:57.759773+0000 2024-02-19T19:11:07.481 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6826/3917487208 2024-02-20T19:01:58.847298+0000 2024-02-19T19:11:07.481 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:6801/967937024 2024-02-20T19:08:05.264847+0000 2024-02-19T19:11:07.481 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96:0/3083828427 2024-02-20T19:08:05.264847+0000 2024-02-19T19:11:07.482 INFO:teuthology.orchestra.run.smithi096.stderr:listed 37 entries 2024-02-19T19:11:07.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.457+0000 7fcba4c6a640 1 -- 172.21.15.96:0/1693259852 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fcb8806d8d0 msgr2=0x7fcb8806fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:07.482 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.457+0000 7fcba4c6a640 1 --2- 172.21.15.96:0/1693259852 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fcb8806d8d0 0x7fcb8806fd90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcb90006010 tx=0x7fcb90005dd0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.457+0000 7fcba4c6a640 1 -- 172.21.15.96:0/1693259852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcba00fefe0 msgr2=0x7fcba00fcd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:07.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.457+0000 7fcba4c6a640 1 --2- 172.21.15.96:0/1693259852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcba00fefe0 0x7fcba00fcd60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcb9400d8d0 tx=0x7fcb9400dd90 comp rx=0 tx=0).stop 2024-02-19T19:11:07.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.457+0000 7fcba4c6a640 1 -- 172.21.15.96:0/1693259852 shutdown_connections 2024-02-19T19:11:07.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.457+0000 7fcba4c6a640 1 --2- 172.21.15.96:0/1693259852 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fcb8806d8d0 0x7fcb8806fd90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.457+0000 7fcba4c6a640 1 --2- 172.21.15.96:0/1693259852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcba0103f20 0x7fcba00fd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.457+0000 7fcba4c6a640 1 --2- 172.21.15.96:0/1693259852 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcba00fefe0 0x7fcba00fcd60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.457+0000 7fcba4c6a640 1 -- 172.21.15.96:0/1693259852 >> 172.21.15.96:0/1693259852 conn(0x7fcba0075b40 msgr2=0x7fcba0067530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:07.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.457+0000 7fcba4c6a640 1 -- 172.21.15.96:0/1693259852 shutdown_connections 2024-02-19T19:11:07.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.457+0000 7fcba4c6a640 1 -- 172.21.15.96:0/1693259852 wait complete. 2024-02-19T19:11:07.490 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-02-19T19:11:07.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:11:07.490 DEBUG:teuthology.orchestra.run.smithi125:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-02-19T19:11:07.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.483+0000 7fdac33f6700 1 -- 172.21.15.96:0/1662783090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdabc101850 msgr2=0x7fdabc1058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:07.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.483+0000 7fdac33f6700 1 --2- 172.21.15.96:0/1662783090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdabc101850 0x7fdabc1058a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdab0009910 tx=0x7fdab0009c20 comp rx=0 tx=0).stop 2024-02-19T19:11:07.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.483+0000 7fdac33f6700 1 -- 172.21.15.96:0/1662783090 shutdown_connections 2024-02-19T19:11:07.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.483+0000 7fdac33f6700 1 --2- 172.21.15.96:0/1662783090 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdabc101850 0x7fdabc1058a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.505 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.483+0000 7fdac33f6700 1 --2- 172.21.15.96:0/1662783090 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdabc100ea0 0x7fdabc101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.483+0000 7fdac33f6700 1 -- 172.21.15.96:0/1662783090 >> 172.21.15.96:0/1662783090 conn(0x7fdabc0fc750 msgr2=0x7fdabc0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:07.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.483+0000 7fdac33f6700 1 -- 172.21.15.96:0/1662783090 shutdown_connections 2024-02-19T19:11:07.506 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.483+0000 7fdac33f6700 1 -- 172.21.15.96:0/1662783090 wait complete. 2024-02-19T19:11:07.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.484+0000 7fdac33f6700 1 Processor -- start 2024-02-19T19:11:07.507 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.484+0000 7fdac33f6700 1 -- start start 2024-02-19T19:11:07.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.484+0000 7fdac33f6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdabc100ea0 0x7fdabc19c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:07.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.484+0000 7fdac33f6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdabc101850 0x7fdabc19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:07.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.484+0000 7fdac33f6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc19d2d0 con 0x7fdabc101850 2024-02-19T19:11:07.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.484+0000 7fdac33f6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc196780 con 0x7fdabc100ea0 2024-02-19T19:11:07.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.484+0000 7fdac0991700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdabc101850 0x7fdabc19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:07.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.484+0000 7fdac0991700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdabc101850 0x7fdabc19cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58726/0 (socket says 172.21.15.96:58726) 2024-02-19T19:11:07.508 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.484+0000 7fdac0991700 1 -- 172.21.15.96:0/2562134763 learned_addr learned my addr 172.21.15.96:0/2562134763 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:11:07.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.484+0000 7fdac1192700 1 --2- 172.21.15.96:0/2562134763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdabc100ea0 0x7fdabc19c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:07.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.485+0000 7fdac0991700 1 -- 172.21.15.96:0/2562134763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdabc100ea0 msgr2=0x7fdabc19c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:07.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.485+0000 7fdac0991700 1 --2- 172.21.15.96:0/2562134763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdabc100ea0 0x7fdabc19c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.485+0000 7fdac0991700 1 -- 172.21.15.96:0/2562134763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab00095f0 con 0x7fdabc101850 2024-02-19T19:11:07.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.485+0000 7fdac0991700 1 --2- 172.21.15.96:0/2562134763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdabc101850 0x7fdabc19cc40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdab00059d0 tx=0x7fdab000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:07.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.485+0000 7fdaba7fc700 1 -- 172.21.15.96:0/2562134763 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdab001d070 con 0x7fdabc101850 2024-02-19T19:11:07.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.485+0000 7fdac33f6700 1 -- 172.21.15.96:0/2562134763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdabc196a00 con 0x7fdabc101850 2024-02-19T19:11:07.509 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.485+0000 7fdaba7fc700 1 -- 172.21.15.96:0/2562134763 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdab000b610 con 0x7fdabc101850 2024-02-19T19:11:07.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.485+0000 7fdac33f6700 1 -- 172.21.15.96:0/2562134763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdabc196ef0 con 0x7fdabc101850 2024-02-19T19:11:07.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.485+0000 7fdaba7fc700 1 -- 172.21.15.96:0/2562134763 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdab0022470 con 0x7fdabc101850 2024-02-19T19:11:07.510 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.486+0000 7fdac33f6700 1 -- 172.21.15.96:0/2562134763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdabc1092a0 con 0x7fdabc101850 2024-02-19T19:11:07.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.486+0000 7fdaba7fc700 1 -- 172.21.15.96:0/2562134763 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fdab0003710 con 0x7fdabc101850 2024-02-19T19:11:07.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.487+0000 7fdaba7fc700 1 --2- 172.21.15.96:0/2562134763 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fdaa406d8a0 0x7fdaa406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:07.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.487+0000 7fdac1192700 1 --2- 172.21.15.96:0/2562134763 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fdaa406d8a0 0x7fdaa406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:07.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.487+0000 7fdaba7fc700 1 -- 172.21.15.96:0/2562134763 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fdab008e8f0 con 0x7fdabc101850 2024-02-19T19:11:07.511 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.487+0000 7fdac1192700 1 --2- 172.21.15.96:0/2562134763 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fdaa406d8a0 0x7fdaa406fd60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdab400f540 tx=0x7fdab400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:07.513 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.491+0000 7fdaba7fc700 1 -- 172.21.15.96:0/2562134763 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdab005bc80 con 0x7fdabc101850 2024-02-19T19:11:07.521 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2024-02-19T19:11:07.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:11:07.522 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-02-19T19:11:07.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:07 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/2505796590' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-19T19:11:07.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:07 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/3765510251' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-19T19:11:07.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:07 smithi125 ceph-mon[86115]: osd.3 marked itself down and dead 2024-02-19T19:11:07.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:07 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/3906309792' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-19T19:11:07.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:07 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/2505796590' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-19T19:11:07.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:07 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/3765510251' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-19T19:11:07.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:07 smithi096 ceph-mon[112483]: osd.3 marked itself down and dead 2024-02-19T19:11:07.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:07 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/3906309792' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-19T19:11:07.789 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.768+0000 7fdac33f6700 1 -- 172.21.15.96:0/2562134763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdabc197cc0 con 0x7fdabc101850 2024-02-19T19:11:07.790 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.768+0000 7fdaba7fc700 1 -- 172.21.15.96:0/2562134763 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fdab005b810 con 0x7fdabc101850 2024-02-19T19:11:07.790 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:11:07.790 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:11:07.790 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:11:07.791 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:11:07.791 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:11:07.791 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:11:07.791 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:11:07.791 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:11:07.791 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2, 2024-02-19T19:11:07.791 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 3 2024-02-19T19:11:07.791 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:11:07.792 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:11:07.792 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-19T19:11:07.792 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:11:07.792 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:11:07.792 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6, 2024-02-19T19:11:07.792 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 7 2024-02-19T19:11:07.792 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:11:07.792 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:11:07.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.771+0000 7fdac33f6700 1 -- 172.21.15.96:0/2562134763 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fdaa406d8a0 msgr2=0x7fdaa406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:07.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.771+0000 7fdac33f6700 1 --2- 172.21.15.96:0/2562134763 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fdaa406d8a0 0x7fdaa406fd60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdab400f540 tx=0x7fdab400b040 comp rx=0 tx=0).stop 2024-02-19T19:11:07.793 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.771+0000 7fdac33f6700 1 -- 172.21.15.96:0/2562134763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdabc101850 msgr2=0x7fdabc19cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:07.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.771+0000 7fdac33f6700 1 --2- 172.21.15.96:0/2562134763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdabc101850 0x7fdabc19cc40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdab00059d0 tx=0x7fdab000f690 comp rx=0 tx=0).stop 2024-02-19T19:11:07.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.771+0000 7fdac33f6700 1 -- 172.21.15.96:0/2562134763 shutdown_connections 2024-02-19T19:11:07.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.771+0000 7fdac33f6700 1 --2- 172.21.15.96:0/2562134763 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fdaa406d8a0 0x7fdaa406fd60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.771+0000 7fdac33f6700 1 --2- 172.21.15.96:0/2562134763 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdabc100ea0 0x7fdabc19c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.771+0000 7fdac33f6700 1 --2- 172.21.15.96:0/2562134763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdabc101850 0x7fdabc19cc40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.771+0000 7fdac33f6700 1 -- 172.21.15.96:0/2562134763 >> 172.21.15.96:0/2562134763 conn(0x7fdabc0fc750 msgr2=0x7fdabc0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:07.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.771+0000 7fdac33f6700 1 -- 172.21.15.96:0/2562134763 shutdown_connections 2024-02-19T19:11:07.794 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.771+0000 7fdac33f6700 1 -- 172.21.15.96:0/2562134763 wait complete. 2024-02-19T19:11:07.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.873+0000 7f7302297700 1 -- 172.21.15.96:0/81257321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72fc101850 msgr2=0x7f72fc1058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:07.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.873+0000 7f7302297700 1 --2- 172.21.15.96:0/81257321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72fc101850 0x7f72fc1058a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009910 tx=0x7f72f0009c20 comp rx=0 tx=0).stop 2024-02-19T19:11:07.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.873+0000 7f7302297700 1 -- 172.21.15.96:0/81257321 shutdown_connections 2024-02-19T19:11:07.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.873+0000 7f7302297700 1 --2- 172.21.15.96:0/81257321 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72fc101850 0x7f72fc1058a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.873+0000 7f7302297700 1 --2- 172.21.15.96:0/81257321 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72fc100ea0 0x7f72fc101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.873+0000 7f7302297700 1 -- 172.21.15.96:0/81257321 >> 172.21.15.96:0/81257321 conn(0x7f72fc0fc750 msgr2=0x7f72fc0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:07.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.873+0000 7f7302297700 1 -- 172.21.15.96:0/81257321 shutdown_connections 2024-02-19T19:11:07.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.874+0000 7f7302297700 1 -- 172.21.15.96:0/81257321 wait complete. 2024-02-19T19:11:07.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.874+0000 7f7302297700 1 Processor -- start 2024-02-19T19:11:07.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.874+0000 7f7302297700 1 -- start start 2024-02-19T19:11:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.874+0000 7f7302297700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72fc100ea0 0x7f72fc19c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.874+0000 7f7302297700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72fc101850 0x7f72fc19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.874+0000 7f7302297700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc19d2d0 con 0x7f72fc100ea0 2024-02-19T19:11:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.874+0000 7f7302297700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc196780 con 0x7f72fc101850 2024-02-19T19:11:07.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.875+0000 7f72fbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72fc100ea0 0x7f72fc19c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:07.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.875+0000 7f72fbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72fc100ea0 0x7f72fc19c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58734/0 (socket says 172.21.15.96:58734) 2024-02-19T19:11:07.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.875+0000 7f72fbfff700 1 -- 172.21.15.96:0/3133833461 learned_addr learned my addr 172.21.15.96:0/3133833461 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:11:07.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.875+0000 7f72fb7fe700 1 --2- 172.21.15.96:0/3133833461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72fc101850 0x7f72fc19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:07.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.875+0000 7f72fbfff700 1 -- 172.21.15.96:0/3133833461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72fc101850 msgr2=0x7f72fc19cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:07.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.875+0000 7f72fbfff700 1 --2- 172.21.15.96:0/3133833461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72fc101850 0x7f72fc19cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:07.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.875+0000 7f72fbfff700 1 -- 172.21.15.96:0/3133833461 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f00095f0 con 0x7f72fc100ea0 2024-02-19T19:11:07.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.875+0000 7f72fbfff700 1 --2- 172.21.15.96:0/3133833461 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72fc100ea0 0x7f72fc19c700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f72ec00d8d0 tx=0x7f72ec00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:07.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.875+0000 7f72f97fa700 1 -- 172.21.15.96:0/3133833461 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72ec0098a0 con 0x7f72fc100ea0 2024-02-19T19:11:07.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.875+0000 7f7302297700 1 -- 172.21.15.96:0/3133833461 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72fc196a60 con 0x7f72fc100ea0 2024-02-19T19:11:07.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.875+0000 7f72f97fa700 1 -- 172.21.15.96:0/3133833461 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f72ec010460 con 0x7f72fc100ea0 2024-02-19T19:11:07.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.875+0000 7f72f97fa700 1 -- 172.21.15.96:0/3133833461 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72ec00f5f0 con 0x7f72fc100ea0 2024-02-19T19:11:07.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.875+0000 7f7302297700 1 -- 172.21.15.96:0/3133833461 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72fc196fb0 con 0x7f72fc100ea0 2024-02-19T19:11:07.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.876+0000 7f7302297700 1 -- 172.21.15.96:0/3133833461 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72fc1092a0 con 0x7f72fc100ea0 2024-02-19T19:11:07.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.877+0000 7f72f97fa700 1 -- 172.21.15.96:0/3133833461 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f72ec009a00 con 0x7f72fc100ea0 2024-02-19T19:11:07.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.877+0000 7f72f97fa700 1 --2- 172.21.15.96:0/3133833461 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f72e406d8a0 0x7f72e406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:07.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.877+0000 7f72f97fa700 1 -- 172.21.15.96:0/3133833461 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f72ec08d380 con 0x7f72fc100ea0 2024-02-19T19:11:07.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.877+0000 7f72fb7fe700 1 --2- 172.21.15.96:0/3133833461 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f72e406d8a0 0x7f72e406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:07.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.878+0000 7f72fb7fe700 1 --2- 172.21.15.96:0/3133833461 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f72e406d8a0 0x7f72e406fd60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f72fc197bf0 tx=0x7f72f001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:07.903 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:07.882+0000 7f72f97fa700 1 -- 172.21.15.96:0/3133833461 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f72ec05a710 con 0x7f72fc100ea0 2024-02-19T19:11:08.141 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.119+0000 7f7302297700 1 -- 172.21.15.96:0/3133833461 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f72fc04f2e0 con 0x7f72fc100ea0 2024-02-19T19:11:08.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.120+0000 7f72f97fa700 1 -- 172.21.15.96:0/3133833461 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1886 (secure 0 0 0) 0x7f72ec05a2a0 con 0x7f72fc100ea0 2024-02-19T19:11:08.142 INFO:teuthology.orchestra.run.smithi096.stdout:e20 2024-02-19T19:11:08.142 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:11:08.142 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:11:08.143 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2024-02-19T19:11:08.143 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:11:08.143 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:11:08.143 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2024-02-19T19:11:08.143 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 20 2024-02-19T19:11:08.143 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-19T19:11:08.143 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-02-19T19:01:42.881136+0000 2024-02-19T19:11:08.143 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2024-02-19T19:10:58.917735+0000 2024-02-19T19:11:08.143 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2024-02-19T19:11:08.144 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2024-02-19T19:11:08.144 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2024-02-19T19:11:08.144 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2024-02-19T19:11:08.144 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2024-02-19T19:11:08.144 INFO:teuthology.orchestra.run.smithi096.stdout:max_xattr_size 65536 2024-02-19T19:11:08.144 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2024-02-19T19:11:08.144 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2024-02-19T19:11:08.144 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 46 2024-02-19T19:11:08.145 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:11:08.145 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2024-02-19T19:11:08.145 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2024-02-19T19:11:08.145 INFO:teuthology.orchestra.run.smithi096.stdout:up {0=14490,1=24267} 2024-02-19T19:11:08.145 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2024-02-19T19:11:08.145 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2024-02-19T19:11:08.145 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2024-02-19T19:11:08.145 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2024-02-19T19:11:08.146 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2024-02-19T19:11:08.146 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data enabled 2024-02-19T19:11:08.146 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2024-02-19T19:11:08.146 INFO:teuthology.orchestra.run.smithi096.stdout:bal_rank_mask -1 2024-02-19T19:11:08.146 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2024-02-19T19:11:08.146 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pccmys{0:14490} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:11:08.146 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.usrmcg{0:14502} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/413113741,v1:172.21.15.96:6827/413113741] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:11:08.146 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.srnlol{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.125:6824/3084054986,v1:172.21.15.125:6825/3084054986] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:11:08.147 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.pwyuga{1:24275} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.125:6826/3098247423,v1:172.21.15.125:6827/3098247423] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:11:08.147 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:11:08.147 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:11:08.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.122+0000 7f7302297700 1 -- 172.21.15.96:0/3133833461 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f72e406d8a0 msgr2=0x7f72e406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:08.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.122+0000 7f7302297700 1 --2- 172.21.15.96:0/3133833461 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f72e406d8a0 0x7f72e406fd60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f72fc197bf0 tx=0x7f72f001a040 comp rx=0 tx=0).stop 2024-02-19T19:11:08.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.122+0000 7f7302297700 1 -- 172.21.15.96:0/3133833461 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72fc100ea0 msgr2=0x7f72fc19c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:08.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.122+0000 7f7302297700 1 --2- 172.21.15.96:0/3133833461 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72fc100ea0 0x7f72fc19c700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f72ec00d8d0 tx=0x7f72ec00dbe0 comp rx=0 tx=0).stop 2024-02-19T19:11:08.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.122+0000 7f7302297700 1 -- 172.21.15.96:0/3133833461 shutdown_connections 2024-02-19T19:11:08.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.122+0000 7f7302297700 1 --2- 172.21.15.96:0/3133833461 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f72e406d8a0 0x7f72e406fd60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:08.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.122+0000 7f7302297700 1 --2- 172.21.15.96:0/3133833461 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72fc100ea0 0x7f72fc19c700 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:08.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.122+0000 7f7302297700 1 --2- 172.21.15.96:0/3133833461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72fc101850 0x7f72fc19cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:08.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.122+0000 7f7302297700 1 -- 172.21.15.96:0/3133833461 >> 172.21.15.96:0/3133833461 conn(0x7f72fc0fc750 msgr2=0x7f72fc0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:08.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.122+0000 7f7302297700 1 -- 172.21.15.96:0/3133833461 shutdown_connections 2024-02-19T19:11:08.149 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.122+0000 7f7302297700 1 -- 172.21.15.96:0/3133833461 wait complete. 2024-02-19T19:11:08.149 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 20 2024-02-19T19:11:08.202 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:07 smithi125 podman[94854]: 2024-02-19 19:11:07.913403932 +0000 UTC m=+1.050628404 container died 4746b79351fc35bfd477e3cfdb312149edf85a33379c7616f8c5107455a11731 (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.1, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T19:11:08.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.227+0000 7fe3a6f4d700 1 -- 172.21.15.96:0/1313272976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3a0100ea0 msgr2=0x7fe3a0101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:08.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.227+0000 7fe3a6f4d700 1 --2- 172.21.15.96:0/1313272976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3a0100ea0 0x7fe3a0101280 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe394009910 tx=0x7fe394009c20 comp rx=0 tx=0).stop 2024-02-19T19:11:08.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.227+0000 7fe3a6f4d700 1 -- 172.21.15.96:0/1313272976 shutdown_connections 2024-02-19T19:11:08.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.227+0000 7fe3a6f4d700 1 --2- 172.21.15.96:0/1313272976 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3a0101850 0x7fe3a01058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:08.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.227+0000 7fe3a6f4d700 1 --2- 172.21.15.96:0/1313272976 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3a0100ea0 0x7fe3a0101280 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:08.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.227+0000 7fe3a6f4d700 1 -- 172.21.15.96:0/1313272976 >> 172.21.15.96:0/1313272976 conn(0x7fe3a00fc750 msgr2=0x7fe3a00feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:08.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.227+0000 7fe3a6f4d700 1 -- 172.21.15.96:0/1313272976 shutdown_connections 2024-02-19T19:11:08.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.227+0000 7fe3a6f4d700 1 -- 172.21.15.96:0/1313272976 wait complete. 2024-02-19T19:11:08.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.228+0000 7fe3a6f4d700 1 Processor -- start 2024-02-19T19:11:08.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.228+0000 7fe3a6f4d700 1 -- start start 2024-02-19T19:11:08.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.228+0000 7fe3a6f4d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3a0100ea0 0x7fe3a019c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:08.252 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.228+0000 7fe3a6f4d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3a0101850 0x7fe3a019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:08.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.228+0000 7fe3a6f4d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a019d230 con 0x7fe3a0101850 2024-02-19T19:11:08.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.228+0000 7fe3a6f4d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a0196770 con 0x7fe3a0100ea0 2024-02-19T19:11:08.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.228+0000 7fe39ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3a0101850 0x7fe3a019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:08.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.228+0000 7fe39ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3a0101850 0x7fe3a019cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58754/0 (socket says 172.21.15.96:58754) 2024-02-19T19:11:08.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.228+0000 7fe39ffff700 1 -- 172.21.15.96:0/1774745573 learned_addr learned my addr 172.21.15.96:0/1774745573 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:11:08.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.229+0000 7fe3a4ce9700 1 --2- 172.21.15.96:0/1774745573 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3a0100ea0 0x7fe3a019c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:08.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.229+0000 7fe39ffff700 1 -- 172.21.15.96:0/1774745573 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3a0100ea0 msgr2=0x7fe3a019c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:08.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.229+0000 7fe39ffff700 1 --2- 172.21.15.96:0/1774745573 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3a0100ea0 0x7fe3a019c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:08.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.229+0000 7fe39ffff700 1 -- 172.21.15.96:0/1774745573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3940095f0 con 0x7fe3a0101850 2024-02-19T19:11:08.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.229+0000 7fe39ffff700 1 --2- 172.21.15.96:0/1774745573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3a0101850 0x7fe3a019cc30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00c960 tx=0x7fe38c00cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:08.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.229+0000 7fe39dffb700 1 -- 172.21.15.96:0/1774745573 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe38c007a70 con 0x7fe3a0101850 2024-02-19T19:11:08.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.229+0000 7fe39dffb700 1 -- 172.21.15.96:0/1774745573 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe38c007bd0 con 0x7fe3a0101850 2024-02-19T19:11:08.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.229+0000 7fe3a6f4d700 1 -- 172.21.15.96:0/1774745573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a0196a50 con 0x7fe3a0101850 2024-02-19T19:11:08.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.229+0000 7fe39dffb700 1 -- 172.21.15.96:0/1774745573 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe38c0186c0 con 0x7fe3a0101850 2024-02-19T19:11:08.254 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.229+0000 7fe3a6f4d700 1 -- 172.21.15.96:0/1774745573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a0196fa0 con 0x7fe3a0101850 2024-02-19T19:11:08.255 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.230+0000 7fe3a6f4d700 1 -- 172.21.15.96:0/1774745573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a0109240 con 0x7fe3a0101850 2024-02-19T19:11:08.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.231+0000 7fe39dffb700 1 -- 172.21.15.96:0/1774745573 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fe38c00faa0 con 0x7fe3a0101850 2024-02-19T19:11:08.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.231+0000 7fe39dffb700 1 --2- 172.21.15.96:0/1774745573 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe39006d8a0 0x7fe39006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:08.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.231+0000 7fe39dffb700 1 -- 172.21.15.96:0/1774745573 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe38c08d4b0 con 0x7fe3a0101850 2024-02-19T19:11:08.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.231+0000 7fe3a4ce9700 1 --2- 172.21.15.96:0/1774745573 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe39006d8a0 0x7fe39006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:08.256 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.232+0000 7fe3a4ce9700 1 --2- 172.21.15.96:0/1774745573 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe39006d8a0 0x7fe39006fd60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe39400b5c0 tx=0x7fe39401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:08.257 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.236+0000 7fe39dffb700 1 -- 172.21.15.96:0/1774745573 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe38c05a5b0 con 0x7fe3a0101850 2024-02-19T19:11:08.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:11:08.458 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2024-02-19T19:11:08.472 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-02-19T19:11:08.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:11:08.473 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-19T19:11:08.483 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.461+0000 7fe3a6f4d700 1 -- 172.21.15.96:0/1774745573 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe3a0197cf0 con 0x7fe39006d8a0 2024-02-19T19:11:08.485 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:11:08.485 INFO:teuthology.orchestra.run.smithi096.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:11:08.486 INFO:teuthology.orchestra.run.smithi096.stdout: "in_progress": true, 2024-02-19T19:11:08.486 INFO:teuthology.orchestra.run.smithi096.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:11:08.486 INFO:teuthology.orchestra.run.smithi096.stdout: "services_complete": [ 2024-02-19T19:11:08.486 INFO:teuthology.orchestra.run.smithi096.stdout: "crash", 2024-02-19T19:11:08.486 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr", 2024-02-19T19:11:08.486 INFO:teuthology.orchestra.run.smithi096.stdout: "mon" 2024-02-19T19:11:08.486 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-02-19T19:11:08.486 INFO:teuthology.orchestra.run.smithi096.stdout: "progress": "9/23 daemons upgraded", 2024-02-19T19:11:08.487 INFO:teuthology.orchestra.run.smithi096.stdout: "message": "Currently upgrading osd daemons", 2024-02-19T19:11:08.487 INFO:teuthology.orchestra.run.smithi096.stdout: "is_paused": false 2024-02-19T19:11:08.487 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:11:08.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.463+0000 7fe39dffb700 1 -- 172.21.15.96:0/1774745573 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe3a0197cf0 con 0x7fe39006d8a0 2024-02-19T19:11:08.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.465+0000 7fe3a6f4d700 1 -- 172.21.15.96:0/1774745573 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe39006d8a0 msgr2=0x7fe39006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:08.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.465+0000 7fe3a6f4d700 1 --2- 172.21.15.96:0/1774745573 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe39006d8a0 0x7fe39006fd60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe39400b5c0 tx=0x7fe39401a040 comp rx=0 tx=0).stop 2024-02-19T19:11:08.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.465+0000 7fe3a6f4d700 1 -- 172.21.15.96:0/1774745573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3a0101850 msgr2=0x7fe3a019cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:08.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.465+0000 7fe3a6f4d700 1 --2- 172.21.15.96:0/1774745573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3a0101850 0x7fe3a019cc30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00c960 tx=0x7fe38c00cd20 comp rx=0 tx=0).stop 2024-02-19T19:11:08.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.465+0000 7fe3a6f4d700 1 -- 172.21.15.96:0/1774745573 shutdown_connections 2024-02-19T19:11:08.488 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.465+0000 7fe3a6f4d700 1 --2- 172.21.15.96:0/1774745573 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe39006d8a0 0x7fe39006fd60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:08.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.465+0000 7fe3a6f4d700 1 --2- 172.21.15.96:0/1774745573 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe3a0100ea0 0x7fe3a019c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:08.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.465+0000 7fe3a6f4d700 1 --2- 172.21.15.96:0/1774745573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe3a0101850 0x7fe3a019cc30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:08.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.465+0000 7fe3a6f4d700 1 -- 172.21.15.96:0/1774745573 >> 172.21.15.96:0/1774745573 conn(0x7fe3a00fc750 msgr2=0x7fe3a00fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:08.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.465+0000 7fe3a6f4d700 1 -- 172.21.15.96:0/1774745573 shutdown_connections 2024-02-19T19:11:08.489 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.465+0000 7fe3a6f4d700 1 -- 172.21.15.96:0/1774745573 wait complete. 2024-02-19T19:11:08.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:11:08.511 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link delete ceph-brx 2024-02-19T19:11:08.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.577+0000 7f00f4d24700 1 -- 172.21.15.96:0/2183638395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00f0068ac0 msgr2=0x7f00f0068f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:08.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.577+0000 7f00f4d24700 1 --2- 172.21.15.96:0/2183638395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00f0068ac0 0x7f00f0068f20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009910 tx=0x7f00e4009c20 comp rx=0 tx=0).stop 2024-02-19T19:11:08.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.577+0000 7f00f4d24700 1 -- 172.21.15.96:0/2183638395 shutdown_connections 2024-02-19T19:11:08.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.577+0000 7f00f4d24700 1 --2- 172.21.15.96:0/2183638395 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00f0068ac0 0x7f00f0068f20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:08.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.577+0000 7f00f4d24700 1 --2- 172.21.15.96:0/2183638395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00f0105b80 0x7f00f0068580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:08.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.578+0000 7f00f4d24700 1 -- 172.21.15.96:0/2183638395 >> 172.21.15.96:0/2183638395 conn(0x7f00f0075670 msgr2=0x7f00f0075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:08.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.578+0000 7f00f4d24700 1 -- 172.21.15.96:0/2183638395 shutdown_connections 2024-02-19T19:11:08.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.578+0000 7f00f4d24700 1 -- 172.21.15.96:0/2183638395 wait complete. 2024-02-19T19:11:08.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.578+0000 7f00f4d24700 1 Processor -- start 2024-02-19T19:11:08.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.578+0000 7f00f4d24700 1 -- start start 2024-02-19T19:11:08.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.578+0000 7f00f4d24700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00f0068ac0 0x7f00f019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:08.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.578+0000 7f00f4d24700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00f0105b80 0x7f00f019d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:08.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.578+0000 7f00f4d24700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f019da90 con 0x7f00f0105b80 2024-02-19T19:11:08.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.578+0000 7f00f4d24700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f01a1820 con 0x7f00f0068ac0 2024-02-19T19:11:08.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.579+0000 7f00edd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00f0105b80 0x7f00f019d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:08.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.579+0000 7f00edd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00f0105b80 0x7f00f019d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:58778/0 (socket says 172.21.15.96:58778) 2024-02-19T19:11:08.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.579+0000 7f00ee59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00f0068ac0 0x7f00f019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:08.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.579+0000 7f00edd9b700 1 -- 172.21.15.96:0/1502726791 learned_addr learned my addr 172.21.15.96:0/1502726791 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:11:08.603 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.579+0000 7f00edd9b700 1 -- 172.21.15.96:0/1502726791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00f0068ac0 msgr2=0x7f00f019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:08.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.579+0000 7f00edd9b700 1 --2- 172.21.15.96:0/1502726791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00f0068ac0 0x7f00f019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:08.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.579+0000 7f00edd9b700 1 -- 172.21.15.96:0/1502726791 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e40095f0 con 0x7f00f0105b80 2024-02-19T19:11:08.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.579+0000 7f00edd9b700 1 --2- 172.21.15.96:0/1502726791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00f0105b80 0x7f00f019d3b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f00e4006010 tx=0x7f00e400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:08.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.579+0000 7f00df7fe700 1 -- 172.21.15.96:0/1502726791 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00e401d070 con 0x7f00f0105b80 2024-02-19T19:11:08.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.579+0000 7f00df7fe700 1 -- 172.21.15.96:0/1502726791 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f00e4005dc0 con 0x7f00f0105b80 2024-02-19T19:11:08.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.579+0000 7f00f4d24700 1 -- 172.21.15.96:0/1502726791 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f01a1aa0 con 0x7f00f0105b80 2024-02-19T19:11:08.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.579+0000 7f00df7fe700 1 -- 172.21.15.96:0/1502726791 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00e4017400 con 0x7f00f0105b80 2024-02-19T19:11:08.604 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.579+0000 7f00f4d24700 1 -- 172.21.15.96:0/1502726791 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f01a1f90 con 0x7f00f0105b80 2024-02-19T19:11:08.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.580+0000 7f00f4d24700 1 -- 172.21.15.96:0/1502726791 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f01101f0 con 0x7f00f0105b80 2024-02-19T19:11:08.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.581+0000 7f00df7fe700 1 -- 172.21.15.96:0/1502726791 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f00e4003a60 con 0x7f00f0105b80 2024-02-19T19:11:08.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.581+0000 7f00df7fe700 1 --2- 172.21.15.96:0/1502726791 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f00d806d8a0 0x7f00d806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:08.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.581+0000 7f00df7fe700 1 -- 172.21.15.96:0/1502726791 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f00e408e920 con 0x7f00f0105b80 2024-02-19T19:11:08.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.581+0000 7f00ee59c700 1 --2- 172.21.15.96:0/1502726791 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f00d806d8a0 0x7f00d806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:08.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.582+0000 7f00ee59c700 1 --2- 172.21.15.96:0/1502726791 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f00d806d8a0 0x7f00d806fd60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f00e0005950 tx=0x7f00e000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:08.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.586+0000 7f00df7fe700 1 -- 172.21.15.96:0/1502726791 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f00e4058180 con 0x7f00f0105b80 2024-02-19T19:11:08.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:11:08.663 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2024-02-19T19:11:08.664 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:08 smithi125 podman[94854]: 2024-02-19 19:11:08.301931709 +0000 UTC m=+1.439156178 container cleanup 4746b79351fc35bfd477e3cfdb312149edf85a33379c7616f8c5107455a11731 (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-19T19:11:08.664 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:08 smithi125 bash[94854]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3 2024-02-19T19:11:08.665 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:08 smithi125 ceph-mon[86115]: from='client.44221 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:08.665 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:08 smithi125 ceph-mon[86115]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:08.665 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:08 smithi125 ceph-mon[86115]: pgmap v109: 65 pgs: 65 active+clean; 125 MiB data, 651 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 7.4 MiB/s wr, 742 op/s 2024-02-19T19:11:08.665 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:08 smithi125 ceph-mon[86115]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:08.665 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:08 smithi125 ceph-mon[86115]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:11:08.665 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:08 smithi125 ceph-mon[86115]: osdmap e65: 6 total, 5 up, 6 in 2024-02-19T19:11:08.665 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:08 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/1693259852' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-19T19:11:08.666 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:08 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/2562134763' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:08.666 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:08 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/3133833461' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:11:08.681 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-02-19T19:11:08.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:11:08.682 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-19T19:11:08.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-19T19:11:08.750 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link delete ceph-brx 2024-02-19T19:11:08.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:08 smithi096 ceph-mon[112483]: from='client.44221 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:08.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:08 smithi096 ceph-mon[112483]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:08.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:08 smithi096 ceph-mon[112483]: pgmap v109: 65 pgs: 65 active+clean; 125 MiB data, 651 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 7.4 MiB/s wr, 742 op/s 2024-02-19T19:11:08.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:08 smithi096 ceph-mon[112483]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:08.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:08 smithi096 ceph-mon[112483]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:11:08.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:08 smithi096 ceph-mon[112483]: osdmap e65: 6 total, 5 up, 6 in 2024-02-19T19:11:08.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:08 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/1693259852' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-19T19:11:08.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:08 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/2562134763' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:08.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:08 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/3133833461' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:11:08.849 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-02-19T19:11:08.863 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task sleep... 2024-02-19T19:11:08.864 INFO:teuthology.task.sleep:Sleeping for 3600 seconds 2024-02-19T19:11:08.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.866+0000 7f00f4d24700 1 -- 172.21.15.96:0/1502726791 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f00f004f2e0 con 0x7f00f0105b80 2024-02-19T19:11:08.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.866+0000 7f00df7fe700 1 -- 172.21.15.96:0/1502726791 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+290 (secure 0 0 0) 0x7f00e405b840 con 0x7f00f0105b80 2024-02-19T19:11:08.889 INFO:teuthology.orchestra.run.smithi096.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down 2024-02-19T19:11:08.889 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-19T19:11:08.889 INFO:teuthology.orchestra.run.smithi096.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-19T19:11:08.889 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-19T19:11:08.889 INFO:teuthology.orchestra.run.smithi096.stdout: osd.3 (root=default,host=smithi125) is down 2024-02-19T19:11:08.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.868+0000 7f00f4d24700 1 -- 172.21.15.96:0/1502726791 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f00d806d8a0 msgr2=0x7f00d806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:08.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.868+0000 7f00f4d24700 1 --2- 172.21.15.96:0/1502726791 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f00d806d8a0 0x7f00d806fd60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f00e0005950 tx=0x7f00e000b410 comp rx=0 tx=0).stop 2024-02-19T19:11:08.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.868+0000 7f00f4d24700 1 -- 172.21.15.96:0/1502726791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00f0105b80 msgr2=0x7f00f019d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:08.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.868+0000 7f00f4d24700 1 --2- 172.21.15.96:0/1502726791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00f0105b80 0x7f00f019d3b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f00e4006010 tx=0x7f00e400bd70 comp rx=0 tx=0).stop 2024-02-19T19:11:08.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.868+0000 7f00f4d24700 1 -- 172.21.15.96:0/1502726791 shutdown_connections 2024-02-19T19:11:08.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.868+0000 7f00f4d24700 1 --2- 172.21.15.96:0/1502726791 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f00d806d8a0 0x7f00d806fd60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:08.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.868+0000 7f00f4d24700 1 --2- 172.21.15.96:0/1502726791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00f0068ac0 0x7f00f019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:08.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.868+0000 7f00f4d24700 1 --2- 172.21.15.96:0/1502726791 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00f0105b80 0x7f00f019d3b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:08.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.868+0000 7f00f4d24700 1 -- 172.21.15.96:0/1502726791 >> 172.21.15.96:0/1502726791 conn(0x7f00f0075670 msgr2=0x7f00f0101630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:08.891 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.869+0000 7f00f4d24700 1 -- 172.21.15.96:0/1502726791 shutdown_connections 2024-02-19T19:11:08.892 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:08.869+0000 7f00f4d24700 1 -- 172.21.15.96:0/1502726791 wait complete. 2024-02-19T19:11:08.953 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:08 smithi125 podman[94907]: 2024-02-19 19:11:08.604120164 +0000 UTC m=+0.689263122 container remove 4746b79351fc35bfd477e3cfdb312149edf85a33379c7616f8c5107455a11731 (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3, RELEASE=HEAD, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=-18.2.1, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-02-19T19:11:09.280 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:08 smithi125 podman[95065]: 2024-02-19 19:11:08.86871049 +0000 UTC m=+0.017943566 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:11:09.280 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:08 smithi125 podman[95065]: 2024-02-19 19:11:08.98111217 +0000 UTC m=+0.130345238 container create 83b2caea90660aa84ebbcf67b30ebdd560a914a8ad46a1785bd1c7edbc0f1609 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-02-19T19:11:09.280 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:09 smithi125 podman[95065]: 2024-02-19 19:11:09.258871896 +0000 UTC m=+0.408104965 container init 83b2caea90660aa84ebbcf67b30ebdd560a914a8ad46a1785bd1c7edbc0f1609 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5) 2024-02-19T19:11:09.574 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:09 smithi125 ceph-mon[86115]: osdmap e66: 6 total, 5 up, 6 in 2024-02-19T19:11:09.574 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:09 smithi125 ceph-mon[86115]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:09.574 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:09 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/1502726791' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:11:09.575 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:09 smithi125 ceph-mon[86115]: pgmap v112: 65 pgs: 4 activating+undersized, 3 active+undersized+degraded, 3 activating+undersized+degraded, 12 stale+active+clean, 1 active+undersized, 42 active+clean; 128 MiB data, 671 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 7.4 MiB/s wr, 568 op/s; 1956/32073 objects degraded (6.099%) 2024-02-19T19:11:09.575 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:09 smithi125 podman[95065]: 2024-02-19 19:11:09.262197281 +0000 UTC m=+0.411430358 container start 83b2caea90660aa84ebbcf67b30ebdd560a914a8ad46a1785bd1c7edbc0f1609 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-02-19T19:11:09.575 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:09 smithi125 podman[95065]: 2024-02-19 19:11:09.350369159 +0000 UTC m=+0.499602235 container attach 83b2caea90660aa84ebbcf67b30ebdd560a914a8ad46a1785bd1c7edbc0f1609 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-02-19T19:11:09.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:09 smithi096 ceph-mon[112483]: osdmap e66: 6 total, 5 up, 6 in 2024-02-19T19:11:09.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:09 smithi096 ceph-mon[112483]: from='client.34344 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:09.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:09 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/1502726791' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:11:09.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:09 smithi096 ceph-mon[112483]: pgmap v112: 65 pgs: 4 activating+undersized, 3 active+undersized+degraded, 3 activating+undersized+degraded, 12 stale+active+clean, 1 active+undersized, 42 active+clean; 128 MiB data, 671 MiB used, 536 GiB / 536 GiB avail; 3.6 MiB/s rd, 7.4 MiB/s wr, 568 op/s; 1956/32073 objects degraded (6.099%) 2024-02-19T19:11:09.916 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:09 smithi125 podman[95065]: 2024-02-19 19:11:09.553159672 +0000 UTC m=+0.702392756 container died 83b2caea90660aa84ebbcf67b30ebdd560a914a8ad46a1785bd1c7edbc0f1609 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-19T19:11:10.450 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:10 smithi125 podman[95090]: 2024-02-19 19:11:10.146213863 +0000 UTC m=+0.587475668 container remove 83b2caea90660aa84ebbcf67b30ebdd560a914a8ad46a1785bd1c7edbc0f1609 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, ceph=True) 2024-02-19T19:11:10.450 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:10 smithi125 systemd[1]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.3.service: Deactivated successfully. 2024-02-19T19:11:10.450 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:10 smithi125 systemd[1]: Stopped Ceph osd.3 for 06580d2c-cf58-11ee-95bb-87774f69a715. 2024-02-19T19:11:10.450 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:10 smithi125 systemd[1]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.3.service: Consumed 12.348s CPU time. 2024-02-19T19:11:10.451 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:10 smithi125 systemd[1]: Starting Ceph osd.3 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T19:11:10.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:10 smithi125 ceph-mon[86115]: Health check failed: Degraded data redundancy: 1956/32073 objects degraded (6.099%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T19:11:10.703 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:10 smithi125 podman[95189]: 2024-02-19 19:11:10.495023696 +0000 UTC m=+0.017439884 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:11:10.703 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:10 smithi125 podman[95189]: 2024-02-19 19:11:10.63101099 +0000 UTC m=+0.153427177 container create 8996bbb26466c4244e1553f6c4a10c3b4960433f3e6f0661c204e62f0cdaff26 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-02-19T19:11:10.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:10 smithi096 ceph-mon[112483]: Health check failed: Degraded data redundancy: 1956/32073 objects degraded (6.099%), 6 pgs degraded (PG_DEGRADED) 2024-02-19T19:11:11.021 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:10 smithi125 podman[95189]: 2024-02-19 19:11:10.858907747 +0000 UTC m=+0.381323940 container init 8996bbb26466c4244e1553f6c4a10c3b4960433f3e6f0661c204e62f0cdaff26 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-activate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240214, io.buildah.version=1.33.5) 2024-02-19T19:11:11.022 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:10 smithi125 podman[95189]: 2024-02-19 19:11:10.862412617 +0000 UTC m=+0.384828807 container start 8996bbb26466c4244e1553f6c4a10c3b4960433f3e6f0661c204e62f0cdaff26 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux ) 2024-02-19T19:11:11.022 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:10 smithi125 podman[95189]: 2024-02-19 19:11:10.950403939 +0000 UTC m=+0.472820144 container attach 8996bbb26466c4244e1553f6c4a10c3b4960433f3e6f0661c204e62f0cdaff26 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-activate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T19:11:11.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:11 smithi096 ceph-mon[112483]: pgmap v113: 65 pgs: 4 activating+undersized, 12 active+undersized+degraded, 3 activating+undersized+degraded, 10 stale+active+clean, 1 active+undersized, 35 active+clean; 128 MiB data, 673 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 29 op/s; 2950/32073 objects degraded (9.198%) 2024-02-19T19:11:11.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:11 smithi125 ceph-mon[86115]: pgmap v113: 65 pgs: 4 activating+undersized, 12 active+undersized+degraded, 3 activating+undersized+degraded, 10 stale+active+clean, 1 active+undersized, 35 active+clean; 128 MiB data, 673 MiB used, 536 GiB / 536 GiB avail; 2.6 MiB/s rd, 3.1 MiB/s wr, 29 op/s; 2950/32073 objects degraded (9.198%) 2024-02-19T19:11:11.703 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:11 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-activate[95204]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-19T19:11:11.703 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:11 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-activate[95204]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-19T19:11:11.703 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:11 smithi125 bash[95189]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-19T19:11:11.703 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:11 smithi125 bash[95189]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-19T19:11:11.704 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:11 smithi125 bash[95189]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-19T19:11:11.704 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:11 smithi125 bash[95189]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-19T19:11:11.704 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:11 smithi125 bash[95189]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-19T19:11:11.704 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:11 smithi125 bash[95189]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-19T19:11:11.704 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:11 smithi125 bash[95189]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-19T19:11:11.704 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:11 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-activate[95204]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-19T19:11:11.704 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:11 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-activate[95204]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-19T19:11:11.704 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:11 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-activate[95204]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-19T19:11:11.705 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:11 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-activate[95204]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-19T19:11:11.705 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:11 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-activate[95204]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-19T19:11:11.705 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:11 smithi125 podman[95189]: 2024-02-19 19:11:11.339539765 +0000 UTC m=+0.861955965 container died 8996bbb26466c4244e1553f6c4a10c3b4960433f3e6f0661c204e62f0cdaff26 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-activate, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-02-19T19:11:13.393 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:13 smithi125 podman[95322]: 2024-02-19 19:11:13.014094792 +0000 UTC m=+1.669348715 container remove 8996bbb26466c4244e1553f6c4a10c3b4960433f3e6f0661c204e62f0cdaff26 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-activate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-02-19T19:11:13.393 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:13 smithi125 podman[95387]: 2024-02-19 19:11:13.13956783 +0000 UTC m=+0.018152908 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:11:13.393 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:13 smithi125 podman[95387]: 2024-02-19 19:11:13.248433741 +0000 UTC m=+0.127018820 container create 73b832b7b2432f3a367935e9fcf11f7e4e81dae64bf50fbd0346eb06446946e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-02-19T19:11:13.953 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:13 smithi125 podman[95387]: 2024-02-19 19:11:13.501237622 +0000 UTC m=+0.379822705 container init 73b832b7b2432f3a367935e9fcf11f7e4e81dae64bf50fbd0346eb06446946e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True) 2024-02-19T19:11:13.953 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:13 smithi125 podman[95387]: 2024-02-19 19:11:13.504532108 +0000 UTC m=+0.383117174 container start 73b832b7b2432f3a367935e9fcf11f7e4e81dae64bf50fbd0346eb06446946e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-19T19:11:13.953 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:13 smithi125 ceph-osd[95406]: -- 172.21.15.125:0/2841000558 <== mon.1 v2:172.21.15.125:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5571f85331e0 con 0x5571f8505000 2024-02-19T19:11:13.953 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:13 smithi125 bash[95387]: 73b832b7b2432f3a367935e9fcf11f7e4e81dae64bf50fbd0346eb06446946e0 2024-02-19T19:11:13.953 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:13 smithi125 systemd[1]: Started Ceph osd.3 for 06580d2c-cf58-11ee-95bb-87774f69a715. 2024-02-19T19:11:14.390 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:14 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3[95402]: 2024-02-19T19:11:14.060+0000 7f4096e067c0 -1 Falling back to public interface 2024-02-19T19:11:14.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:14 smithi125 ceph-mon[86115]: pgmap v114: 65 pgs: 4 activating+undersized, 29 active+undersized+degraded, 3 activating+undersized+degraded, 2 active+undersized, 27 active+clean; 128 MiB data, 673 MiB used, 536 GiB / 536 GiB avail; 169 KiB/s rd, 2.0 MiB/s wr, 23 op/s; 6010/32073 objects degraded (18.739%) 2024-02-19T19:11:14.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:14 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:14.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:14 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:14.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:14 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:11:14.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:14 smithi096 ceph-mon[112483]: pgmap v114: 65 pgs: 4 activating+undersized, 29 active+undersized+degraded, 3 activating+undersized+degraded, 2 active+undersized, 27 active+clean; 128 MiB data, 673 MiB used, 536 GiB / 536 GiB avail; 169 KiB/s rd, 2.0 MiB/s wr, 23 op/s; 6010/32073 objects degraded (18.739%) 2024-02-19T19:11:14.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:14 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:14.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:14 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:14.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:14 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:11:15.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:15 smithi125 ceph-mon[86115]: Health check update: Degraded data redundancy: 6010/32076 objects degraded (18.737%), 36 pgs degraded (PG_DEGRADED) 2024-02-19T19:11:15.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:15 smithi096 ceph-mon[112483]: Health check update: Degraded data redundancy: 6010/32076 objects degraded (18.737%), 36 pgs degraded (PG_DEGRADED) 2024-02-19T19:11:16.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:16 smithi125 ceph-mon[86115]: pgmap v115: 65 pgs: 36 active+undersized+degraded, 2 active+undersized, 27 active+clean; 128 MiB data, 673 MiB used, 536 GiB / 536 GiB avail; 451 KiB/s wr, 18 op/s; 6010/32076 objects degraded (18.737%) 2024-02-19T19:11:16.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:16 smithi096 ceph-mon[112483]: pgmap v115: 65 pgs: 36 active+undersized+degraded, 2 active+undersized, 27 active+clean; 128 MiB data, 673 MiB used, 536 GiB / 536 GiB avail; 451 KiB/s wr, 18 op/s; 6010/32076 objects degraded (18.737%) 2024-02-19T19:11:17.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:17 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:17.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:17 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:17.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:17 smithi125 ceph-mon[86115]: pgmap v116: 65 pgs: 36 active+undersized+degraded, 2 active+undersized, 27 active+clean; 128 MiB data, 673 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 385 KiB/s wr, 24 op/s; 6010/32076 objects degraded (18.737%) 2024-02-19T19:11:17.953 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:17 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3[95402]: 2024-02-19T19:11:17.594+0000 7f4096e067c0 -1 osd.3 0 read_superblock omap replica is missing. 2024-02-19T19:11:17.954 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:17 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3[95402]: 2024-02-19T19:11:17.813+0000 7f4096e067c0 -1 osd.3 64 log_to_monitors true 2024-02-19T19:11:18.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:18.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:18.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:17 smithi096 ceph-mon[112483]: pgmap v116: 65 pgs: 36 active+undersized+degraded, 2 active+undersized, 27 active+clean; 128 MiB data, 673 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 385 KiB/s wr, 24 op/s; 6010/32076 objects degraded (18.737%) 2024-02-19T19:11:18.781 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 19:11:18 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3[95402]: 2024-02-19T19:11:18.740+0000 7f408825e700 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T19:11:18.781 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:18 smithi125 ceph-mon[86115]: from='osd.3 [v2:172.21.15.125:6800/918706315,v1:172.21.15.125:6801/918706315]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-19T19:11:18.782 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:18 smithi125 ceph-mon[86115]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-19T19:11:18.782 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:18 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:18.782 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:18 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:19.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:18 smithi096 ceph-mon[112483]: from='osd.3 [v2:172.21.15.125:6800/918706315,v1:172.21.15.125:6801/918706315]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-19T19:11:19.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:18 smithi096 ceph-mon[112483]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-19T19:11:19.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:18 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:19.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:18 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:19.834 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:19 smithi125 ceph-mon[86115]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-19T19:11:19.834 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:19 smithi125 ceph-mon[86115]: from='osd.3 [v2:172.21.15.125:6800/918706315,v1:172.21.15.125:6801/918706315]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2024-02-19T19:11:19.834 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:19 smithi125 ceph-mon[86115]: osdmap e67: 6 total, 5 up, 6 in 2024-02-19T19:11:19.834 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:19 smithi125 ceph-mon[86115]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2024-02-19T19:11:19.835 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:19 smithi125 ceph-mon[86115]: pgmap v118: 65 pgs: 36 active+undersized+degraded, 2 active+undersized, 27 active+clean; 128 MiB data, 679 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 51 KiB/s wr, 15 op/s; 6010/32076 objects degraded (18.737%) 2024-02-19T19:11:20.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:19 smithi096 ceph-mon[112483]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-19T19:11:20.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:19 smithi096 ceph-mon[112483]: from='osd.3 [v2:172.21.15.125:6800/918706315,v1:172.21.15.125:6801/918706315]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2024-02-19T19:11:20.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:19 smithi096 ceph-mon[112483]: osdmap e67: 6 total, 5 up, 6 in 2024-02-19T19:11:20.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:19 smithi096 ceph-mon[112483]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2024-02-19T19:11:20.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:19 smithi096 ceph-mon[112483]: pgmap v118: 65 pgs: 36 active+undersized+degraded, 2 active+undersized, 27 active+clean; 128 MiB data, 679 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 51 KiB/s wr, 15 op/s; 6010/32076 objects degraded (18.737%) 2024-02-19T19:11:21.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:20 smithi096 ceph-mon[112483]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:11:21.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:20 smithi096 ceph-mon[112483]: osd.3 [v2:172.21.15.125:6800/918706315,v1:172.21.15.125:6801/918706315] boot 2024-02-19T19:11:21.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:20 smithi096 ceph-mon[112483]: osdmap e68: 6 total, 6 up, 6 in 2024-02-19T19:11:21.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T19:11:21.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:21.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:11:21.037 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:20 smithi096 ceph-mon[112483]: osdmap e69: 6 total, 6 up, 6 in 2024-02-19T19:11:21.115 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:20 smithi125 ceph-mon[86115]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:11:21.115 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:20 smithi125 ceph-mon[86115]: osd.3 [v2:172.21.15.125:6800/918706315,v1:172.21.15.125:6801/918706315] boot 2024-02-19T19:11:21.116 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:20 smithi125 ceph-mon[86115]: osdmap e68: 6 total, 6 up, 6 in 2024-02-19T19:11:21.116 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-19T19:11:21.116 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:21.116 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:11:21.116 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:20 smithi125 ceph-mon[86115]: osdmap e69: 6 total, 6 up, 6 in 2024-02-19T19:11:22.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:21 smithi096 ceph-mon[112483]: pgmap v121: 65 pgs: 7 peering, 29 active+undersized+degraded, 2 active+undersized, 27 active+clean; 128 MiB data, 679 MiB used, 536 GiB / 536 GiB avail; 29 KiB/s rd, 34 KiB/s wr, 19 op/s; 5019/32076 objects degraded (15.647%) 2024-02-19T19:11:22.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:22.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:22.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:11:22.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:11:22.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:22.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:11:22.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:22.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:22.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:22.040 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-19T19:11:22.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:21 smithi125 ceph-mon[86115]: pgmap v121: 65 pgs: 7 peering, 29 active+undersized+degraded, 2 active+undersized, 27 active+clean; 128 MiB data, 679 MiB used, 536 GiB / 536 GiB avail; 29 KiB/s rd, 34 KiB/s wr, 19 op/s; 5019/32076 objects degraded (15.647%) 2024-02-19T19:11:22.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:22.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:22.204 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:11:22.204 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:11:22.204 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:22.204 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:11:22.204 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:22.204 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:22.204 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:22.204 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-19T19:11:23.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:22 smithi096 ceph-mon[112483]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-19T19:11:23.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:22 smithi096 ceph-mon[112483]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-02-19T19:11:23.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:22 smithi096 ceph-mon[112483]: Health check update: Degraded data redundancy: 5019/32076 objects degraded (15.647%), 29 pgs degraded (PG_DEGRADED) 2024-02-19T19:11:23.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:22 smithi125 ceph-mon[86115]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-19T19:11:23.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:22 smithi125 ceph-mon[86115]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-02-19T19:11:23.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:22 smithi125 ceph-mon[86115]: Health check update: Degraded data redundancy: 5019/32076 objects degraded (15.647%), 29 pgs degraded (PG_DEGRADED) 2024-02-19T19:11:24.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:23 smithi096 ceph-mon[112483]: pgmap v122: 65 pgs: 7 peering, 22 active+undersized+degraded, 1 active+undersized, 35 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 3 op/s; 3323/32076 objects degraded (10.360%) 2024-02-19T19:11:24.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:23 smithi125 ceph-mon[86115]: pgmap v122: 65 pgs: 7 peering, 22 active+undersized+degraded, 1 active+undersized, 35 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 3 op/s; 3323/32076 objects degraded (10.360%) 2024-02-19T19:11:25.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:25 smithi125 ceph-mon[86115]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3323/32076 objects degraded (10.360%), 22 pgs degraded) 2024-02-19T19:11:25.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:25 smithi096 ceph-mon[112483]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3323/32076 objects degraded (10.360%), 22 pgs degraded) 2024-02-19T19:11:26.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:26 smithi125 ceph-mon[86115]: pgmap v123: 65 pgs: 65 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.1 KiB/s wr, 3 op/s; 31 KiB/s, 421 keys/s, 0 objects/s recovering 2024-02-19T19:11:26.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:26 smithi096 ceph-mon[112483]: pgmap v123: 65 pgs: 65 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.1 KiB/s wr, 3 op/s; 31 KiB/s, 421 keys/s, 0 objects/s recovering 2024-02-19T19:11:27.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:27 smithi096 ceph-mon[112483]: pgmap v124: 65 pgs: 65 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.4 KiB/s wr, 3 op/s; 25 KiB/s, 347 keys/s, 0 objects/s recovering 2024-02-19T19:11:27.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:27 smithi125 ceph-mon[86115]: pgmap v124: 65 pgs: 65 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.4 KiB/s wr, 3 op/s; 25 KiB/s, 347 keys/s, 0 objects/s recovering 2024-02-19T19:11:30.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:30 smithi125 ceph-mon[86115]: pgmap v125: 65 pgs: 65 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 7.0 KiB/s wr, 5 op/s; 21 KiB/s, 290 keys/s, 0 objects/s recovering 2024-02-19T19:11:30.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:30 smithi096 ceph-mon[112483]: pgmap v125: 65 pgs: 65 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 7.0 KiB/s wr, 5 op/s; 21 KiB/s, 290 keys/s, 0 objects/s recovering 2024-02-19T19:11:31.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:31 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:31.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:31 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:32.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:32 smithi125 ceph-mon[86115]: pgmap v126: 65 pgs: 65 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 6.7 KiB/s wr, 4 op/s; 19 KiB/s, 262 keys/s, 0 objects/s recovering 2024-02-19T19:11:32.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:32 smithi096 ceph-mon[112483]: pgmap v126: 65 pgs: 65 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 6.7 KiB/s wr, 4 op/s; 19 KiB/s, 262 keys/s, 0 objects/s recovering 2024-02-19T19:11:34.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:34 smithi125 ceph-mon[86115]: pgmap v127: 65 pgs: 65 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 5.9 KiB/s wr, 4 op/s; 17 KiB/s, 231 keys/s, 0 objects/s recovering 2024-02-19T19:11:34.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:34 smithi096 ceph-mon[112483]: pgmap v127: 65 pgs: 65 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 5.9 KiB/s wr, 4 op/s; 17 KiB/s, 231 keys/s, 0 objects/s recovering 2024-02-19T19:11:36.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:36 smithi096 ceph-mon[112483]: pgmap v128: 65 pgs: 65 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 6.7 KiB/s wr, 5 op/s; 17 KiB/s, 231 keys/s, 0 objects/s recovering 2024-02-19T19:11:36.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:36.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:11:36.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:36 smithi125 ceph-mon[86115]: pgmap v128: 65 pgs: 65 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 6.7 KiB/s wr, 5 op/s; 17 KiB/s, 231 keys/s, 0 objects/s recovering 2024-02-19T19:11:36.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:36.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:11:37.655 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:37 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-19T19:11:37.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:37 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-19T19:11:38.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:38 smithi125 ceph-mon[86115]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-19T19:11:38.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:38 smithi125 ceph-mon[86115]: Upgrade: osd.4 is safe to restart 2024-02-19T19:11:38.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:38 smithi125 ceph-mon[86115]: pgmap v129: 65 pgs: 65 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 4.6 KiB/s wr, 5 op/s 2024-02-19T19:11:38.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:38 smithi096 ceph-mon[112483]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-19T19:11:38.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:38 smithi096 ceph-mon[112483]: Upgrade: osd.4 is safe to restart 2024-02-19T19:11:38.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:38 smithi096 ceph-mon[112483]: pgmap v129: 65 pgs: 65 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 6.2 KiB/s rd, 4.6 KiB/s wr, 5 op/s 2024-02-19T19:11:39.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.986+0000 7f58f2b47700 1 -- 172.21.15.96:0/2982413619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58ec0ff5a0 msgr2=0x7f58ec0ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:39.010 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.986+0000 7f58f2b47700 1 --2- 172.21.15.96:0/2982413619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58ec0ff5a0 0x7f58ec0ff980 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f58e0009910 tx=0x7f58e0009c20 comp rx=0 tx=0).stop 2024-02-19T19:11:39.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.986+0000 7f58f2b47700 1 -- 172.21.15.96:0/2982413619 shutdown_connections 2024-02-19T19:11:39.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.986+0000 7f58f2b47700 1 --2- 172.21.15.96:0/2982413619 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58ec0fff50 0x7f58ec105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:39.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.986+0000 7f58f2b47700 1 --2- 172.21.15.96:0/2982413619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58ec0ff5a0 0x7f58ec0ff980 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:39.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.986+0000 7f58f2b47700 1 -- 172.21.15.96:0/2982413619 >> 172.21.15.96:0/2982413619 conn(0x7f58ec074e30 msgr2=0x7f58ec075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:39.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.986+0000 7f58f2b47700 1 -- 172.21.15.96:0/2982413619 shutdown_connections 2024-02-19T19:11:39.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.987+0000 7f58f2b47700 1 -- 172.21.15.96:0/2982413619 wait complete. 2024-02-19T19:11:39.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.987+0000 7f58f2b47700 1 Processor -- start 2024-02-19T19:11:39.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.987+0000 7f58f2b47700 1 -- start start 2024-02-19T19:11:39.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.987+0000 7f58f2b47700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58ec0ff5a0 0x7f58ec19c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:39.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.987+0000 7f58f2b47700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58ec0fff50 0x7f58ec19cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:39.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.987+0000 7f58f2b47700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec19d250 con 0x7f58ec0ff5a0 2024-02-19T19:11:39.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.987+0000 7f58f2b47700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec196700 con 0x7f58ec0fff50 2024-02-19T19:11:39.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.987+0000 7f58f08e3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58ec0ff5a0 0x7f58ec19c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:39.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.987+0000 7f58f08e3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58ec0ff5a0 0x7f58ec19c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35056/0 (socket says 172.21.15.96:35056) 2024-02-19T19:11:39.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.987+0000 7f58f08e3700 1 -- 172.21.15.96:0/3486549742 learned_addr learned my addr 172.21.15.96:0/3486549742 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:11:39.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.988+0000 7f58ebfff700 1 --2- 172.21.15.96:0/3486549742 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58ec0fff50 0x7f58ec19cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:39.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.988+0000 7f58f08e3700 1 -- 172.21.15.96:0/3486549742 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58ec0fff50 msgr2=0x7f58ec19cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:39.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.988+0000 7f58f08e3700 1 --2- 172.21.15.96:0/3486549742 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58ec0fff50 0x7f58ec19cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:39.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.988+0000 7f58f08e3700 1 -- 172.21.15.96:0/3486549742 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e00095f0 con 0x7f58ec0ff5a0 2024-02-19T19:11:39.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.988+0000 7f58f08e3700 1 --2- 172.21.15.96:0/3486549742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58ec0ff5a0 0x7f58ec19c680 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f58e00092e0 tx=0x7f58e000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:39.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.988+0000 7f58e9ffb700 1 -- 172.21.15.96:0/3486549742 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58e001d070 con 0x7f58ec0ff5a0 2024-02-19T19:11:39.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.988+0000 7f58f2b47700 1 -- 172.21.15.96:0/3486549742 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ec196980 con 0x7f58ec0ff5a0 2024-02-19T19:11:39.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.988+0000 7f58e9ffb700 1 -- 172.21.15.96:0/3486549742 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f58e0005e00 con 0x7f58ec0ff5a0 2024-02-19T19:11:39.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.988+0000 7f58e9ffb700 1 -- 172.21.15.96:0/3486549742 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58e0017400 con 0x7f58ec0ff5a0 2024-02-19T19:11:39.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.988+0000 7f58f2b47700 1 -- 172.21.15.96:0/3486549742 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ec196e70 con 0x7f58ec0ff5a0 2024-02-19T19:11:39.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.989+0000 7f58f2b47700 1 -- 172.21.15.96:0/3486549742 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58ec109270 con 0x7f58ec0ff5a0 2024-02-19T19:11:39.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.990+0000 7f58e9ffb700 1 -- 172.21.15.96:0/3486549742 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f58e000f460 con 0x7f58ec0ff5a0 2024-02-19T19:11:39.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.990+0000 7f58e9ffb700 1 --2- 172.21.15.96:0/3486549742 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f58dc06d8a0 0x7f58dc06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:39.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.990+0000 7f58e9ffb700 1 -- 172.21.15.96:0/3486549742 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f58e008e9c0 con 0x7f58ec0ff5a0 2024-02-19T19:11:39.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.990+0000 7f58ebfff700 1 --2- 172.21.15.96:0/3486549742 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f58dc06d8a0 0x7f58dc06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:39.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.991+0000 7f58ebfff700 1 --2- 172.21.15.96:0/3486549742 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f58dc06d8a0 0x7f58dc06fd60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f58d8005950 tx=0x7f58d80058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:39.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:38.995+0000 7f58e9ffb700 1 -- 172.21.15.96:0/3486549742 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f58e005bd50 con 0x7f58ec0ff5a0 2024-02-19T19:11:39.229 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.207+0000 7f58f2b47700 1 -- 172.21.15.96:0/3486549742 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f58ec197cb0 con 0x7f58dc06d8a0 2024-02-19T19:11:39.231 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.209+0000 7f58e9ffb700 1 -- 172.21.15.96:0/3486549742 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f58ec197cb0 con 0x7f58dc06d8a0 2024-02-19T19:11:39.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.211+0000 7f58f2b47700 1 -- 172.21.15.96:0/3486549742 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f58dc06d8a0 msgr2=0x7f58dc06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:39.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.211+0000 7f58f2b47700 1 --2- 172.21.15.96:0/3486549742 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f58dc06d8a0 0x7f58dc06fd60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f58d8005950 tx=0x7f58d80058e0 comp rx=0 tx=0).stop 2024-02-19T19:11:39.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.211+0000 7f58f2b47700 1 -- 172.21.15.96:0/3486549742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58ec0ff5a0 msgr2=0x7f58ec19c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:39.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.211+0000 7f58f2b47700 1 --2- 172.21.15.96:0/3486549742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58ec0ff5a0 0x7f58ec19c680 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f58e00092e0 tx=0x7f58e000be20 comp rx=0 tx=0).stop 2024-02-19T19:11:39.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.211+0000 7f58f2b47700 1 -- 172.21.15.96:0/3486549742 shutdown_connections 2024-02-19T19:11:39.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.211+0000 7f58f2b47700 1 --2- 172.21.15.96:0/3486549742 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f58dc06d8a0 0x7f58dc06fd60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:39.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.211+0000 7f58f2b47700 1 --2- 172.21.15.96:0/3486549742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f58ec0ff5a0 0x7f58ec19c680 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:39.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.211+0000 7f58f2b47700 1 --2- 172.21.15.96:0/3486549742 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58ec0fff50 0x7f58ec19cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:39.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.211+0000 7f58f2b47700 1 -- 172.21.15.96:0/3486549742 >> 172.21.15.96:0/3486549742 conn(0x7f58ec074e30 msgr2=0x7f58ec0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:39.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.211+0000 7f58f2b47700 1 -- 172.21.15.96:0/3486549742 shutdown_connections 2024-02-19T19:11:39.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.211+0000 7f58f2b47700 1 -- 172.21.15.96:0/3486549742 wait complete. 2024-02-19T19:11:39.244 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:11:39.337 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.315+0000 7fde7f900700 1 -- 172.21.15.96:0/955701562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde78100750 msgr2=0x7fde781047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:39.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.315+0000 7fde7f900700 1 --2- 172.21.15.96:0/955701562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde78100750 0x7fde781047a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde68009910 tx=0x7fde68009c20 comp rx=0 tx=0).stop 2024-02-19T19:11:39.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.316+0000 7fde7f900700 1 -- 172.21.15.96:0/955701562 shutdown_connections 2024-02-19T19:11:39.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.316+0000 7fde7f900700 1 --2- 172.21.15.96:0/955701562 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde78100750 0x7fde781047a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:39.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.316+0000 7fde7f900700 1 --2- 172.21.15.96:0/955701562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde780ffda0 0x7fde78100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:39.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.316+0000 7fde7f900700 1 -- 172.21.15.96:0/955701562 >> 172.21.15.96:0/955701562 conn(0x7fde780fb650 msgr2=0x7fde780fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:39.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.316+0000 7fde7f900700 1 -- 172.21.15.96:0/955701562 shutdown_connections 2024-02-19T19:11:39.338 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.316+0000 7fde7f900700 1 -- 172.21.15.96:0/955701562 wait complete. 2024-02-19T19:11:39.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.316+0000 7fde7f900700 1 Processor -- start 2024-02-19T19:11:39.340 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.316+0000 7fde7f900700 1 -- start start 2024-02-19T19:11:39.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.316+0000 7fde7f900700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde780ffda0 0x7fde78196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:39.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.316+0000 7fde7f900700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde78100750 0x7fde78196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:39.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.316+0000 7fde7f900700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde78197520 con 0x7fde78100750 2024-02-19T19:11:39.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.316+0000 7fde7f900700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7819b330 con 0x7fde780ffda0 2024-02-19T19:11:39.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.317+0000 7fde7ce9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde78100750 0x7fde78196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:39.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.317+0000 7fde7ce9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde78100750 0x7fde78196e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35082/0 (socket says 172.21.15.96:35082) 2024-02-19T19:11:39.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.317+0000 7fde7ce9b700 1 -- 172.21.15.96:0/673018751 learned_addr learned my addr 172.21.15.96:0/673018751 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:11:39.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.317+0000 7fde7d69c700 1 --2- 172.21.15.96:0/673018751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde780ffda0 0x7fde78196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:39.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.317+0000 7fde7ce9b700 1 -- 172.21.15.96:0/673018751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde780ffda0 msgr2=0x7fde78196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:39.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.317+0000 7fde7ce9b700 1 --2- 172.21.15.96:0/673018751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde780ffda0 0x7fde78196950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:39.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.317+0000 7fde7ce9b700 1 -- 172.21.15.96:0/673018751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde680095f0 con 0x7fde78100750 2024-02-19T19:11:39.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.317+0000 7fde7ce9b700 1 --2- 172.21.15.96:0/673018751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde78100750 0x7fde78196e90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fde680092e0 tx=0x7fde6800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:39.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.317+0000 7fde6e7fc700 1 -- 172.21.15.96:0/673018751 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde6801d070 con 0x7fde78100750 2024-02-19T19:11:39.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.317+0000 7fde6e7fc700 1 -- 172.21.15.96:0/673018751 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde68005dc0 con 0x7fde78100750 2024-02-19T19:11:39.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.317+0000 7fde7f900700 1 -- 172.21.15.96:0/673018751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7819b5b0 con 0x7fde78100750 2024-02-19T19:11:39.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.317+0000 7fde6e7fc700 1 -- 172.21.15.96:0/673018751 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde68017400 con 0x7fde78100750 2024-02-19T19:11:39.342 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.317+0000 7fde7f900700 1 -- 172.21.15.96:0/673018751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7819baa0 con 0x7fde78100750 2024-02-19T19:11:39.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.318+0000 7fde7f900700 1 -- 172.21.15.96:0/673018751 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7804f2e0 con 0x7fde78100750 2024-02-19T19:11:39.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.319+0000 7fde6e7fc700 1 -- 172.21.15.96:0/673018751 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fde6800f6f0 con 0x7fde78100750 2024-02-19T19:11:39.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.319+0000 7fde6e7fc700 1 --2- 172.21.15.96:0/673018751 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fde6406d8a0 0x7fde6406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:39.343 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.319+0000 7fde6e7fc700 1 -- 172.21.15.96:0/673018751 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fde6808e790 con 0x7fde78100750 2024-02-19T19:11:39.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.319+0000 7fde7d69c700 1 --2- 172.21.15.96:0/673018751 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fde6406d8a0 0x7fde6406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:39.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.319+0000 7fde7d69c700 1 --2- 172.21.15.96:0/673018751 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fde6406d8a0 0x7fde6406fd60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fde74005950 tx=0x7fde7400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:39.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.323+0000 7fde6e7fc700 1 -- 172.21.15.96:0/673018751 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fde6805bba0 con 0x7fde78100750 2024-02-19T19:11:39.561 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.539+0000 7fde7f900700 1 -- 172.21.15.96:0/673018751 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fde7819bd10 con 0x7fde6406d8a0 2024-02-19T19:11:39.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.540+0000 7fde6e7fc700 1 -- 172.21.15.96:0/673018751 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fde7819bd10 con 0x7fde6406d8a0 2024-02-19T19:11:39.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.542+0000 7fde7f900700 1 -- 172.21.15.96:0/673018751 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fde6406d8a0 msgr2=0x7fde6406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:39.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.542+0000 7fde7f900700 1 --2- 172.21.15.96:0/673018751 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fde6406d8a0 0x7fde6406fd60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fde74005950 tx=0x7fde7400b410 comp rx=0 tx=0).stop 2024-02-19T19:11:39.564 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.542+0000 7fde7f900700 1 -- 172.21.15.96:0/673018751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde78100750 msgr2=0x7fde78196e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:39.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.542+0000 7fde7f900700 1 --2- 172.21.15.96:0/673018751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde78100750 0x7fde78196e90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fde680092e0 tx=0x7fde6800bd70 comp rx=0 tx=0).stop 2024-02-19T19:11:39.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.542+0000 7fde7f900700 1 -- 172.21.15.96:0/673018751 shutdown_connections 2024-02-19T19:11:39.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.542+0000 7fde7f900700 1 --2- 172.21.15.96:0/673018751 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fde6406d8a0 0x7fde6406fd60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:39.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.542+0000 7fde7f900700 1 --2- 172.21.15.96:0/673018751 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde780ffda0 0x7fde78196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:39.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.542+0000 7fde7f900700 1 --2- 172.21.15.96:0/673018751 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fde78100750 0x7fde78196e90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:39.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.542+0000 7fde7f900700 1 -- 172.21.15.96:0/673018751 >> 172.21.15.96:0/673018751 conn(0x7fde780fb650 msgr2=0x7fde78103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:39.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.542+0000 7fde7f900700 1 -- 172.21.15.96:0/673018751 shutdown_connections 2024-02-19T19:11:39.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.542+0000 7fde7f900700 1 -- 172.21.15.96:0/673018751 wait complete. 2024-02-19T19:11:39.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.645+0000 7fe2d01f4700 1 -- 172.21.15.96:0/729247949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2c80ff5a0 msgr2=0x7fe2c80ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:39.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.645+0000 7fe2d01f4700 1 --2- 172.21.15.96:0/729247949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2c80ff5a0 0x7fe2c80ff980 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4009910 tx=0x7fe2c4009c20 comp rx=0 tx=0).stop 2024-02-19T19:11:39.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.645+0000 7fe2d01f4700 1 -- 172.21.15.96:0/729247949 shutdown_connections 2024-02-19T19:11:39.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.645+0000 7fe2d01f4700 1 --2- 172.21.15.96:0/729247949 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c80fff50 0x7fe2c8105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:39.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.645+0000 7fe2d01f4700 1 --2- 172.21.15.96:0/729247949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2c80ff5a0 0x7fe2c80ff980 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:39.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.645+0000 7fe2d01f4700 1 -- 172.21.15.96:0/729247949 >> 172.21.15.96:0/729247949 conn(0x7fe2c8074e30 msgr2=0x7fe2c8075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:39.669 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:39 smithi096 ceph-mon[112483]: Upgrade: Updating osd.4 2024-02-19T19:11:39.669 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:39 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:39.670 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:39 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-19T19:11:39.670 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:39 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:11:39.670 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:39 smithi096 ceph-mon[112483]: Deploying daemon osd.4 on smithi125 2024-02-19T19:11:39.670 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:39 smithi096 ceph-mon[112483]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:39.670 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:39 smithi096 ceph-mon[112483]: pgmap v130: 65 pgs: 65 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 7.0 KiB/s rd, 5.4 KiB/s wr, 6 op/s 2024-02-19T19:11:39.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.646+0000 7fe2d01f4700 1 -- 172.21.15.96:0/729247949 shutdown_connections 2024-02-19T19:11:39.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.646+0000 7fe2d01f4700 1 -- 172.21.15.96:0/729247949 wait complete. 2024-02-19T19:11:39.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.646+0000 7fe2d01f4700 1 Processor -- start 2024-02-19T19:11:39.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.646+0000 7fe2d01f4700 1 -- start start 2024-02-19T19:11:39.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.646+0000 7fe2d01f4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2c80ff5a0 0x7fe2c8100520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:39.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.646+0000 7fe2d01f4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c80fff50 0x7fe2c8100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:39.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.646+0000 7fe2d01f4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c8100fa0 con 0x7fe2c80ff5a0 2024-02-19T19:11:39.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.646+0000 7fe2d01f4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c81010e0 con 0x7fe2c80fff50 2024-02-19T19:11:39.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.646+0000 7fe2cdf90700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2c80ff5a0 0x7fe2c8100520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:39.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.647+0000 7fe2cdf90700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2c80ff5a0 0x7fe2c8100520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35104/0 (socket says 172.21.15.96:35104) 2024-02-19T19:11:39.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.647+0000 7fe2cdf90700 1 -- 172.21.15.96:0/2387327513 learned_addr learned my addr 172.21.15.96:0/2387327513 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:11:39.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.647+0000 7fe2cd78f700 1 --2- 172.21.15.96:0/2387327513 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c80fff50 0x7fe2c8100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:39.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.647+0000 7fe2cdf90700 1 -- 172.21.15.96:0/2387327513 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c80fff50 msgr2=0x7fe2c8100a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:39.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.647+0000 7fe2cdf90700 1 --2- 172.21.15.96:0/2387327513 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c80fff50 0x7fe2c8100a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:39.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.647+0000 7fe2cdf90700 1 -- 172.21.15.96:0/2387327513 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c40095f0 con 0x7fe2c80ff5a0 2024-02-19T19:11:39.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.647+0000 7fe2cdf90700 1 --2- 172.21.15.96:0/2387327513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2c80ff5a0 0x7fe2c8100520 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4006010 tx=0x7fe2c400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:39.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.647+0000 7fe2beffd700 1 -- 172.21.15.96:0/2387327513 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2c401d070 con 0x7fe2c80ff5a0 2024-02-19T19:11:39.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.647+0000 7fe2beffd700 1 -- 172.21.15.96:0/2387327513 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe2c4005dc0 con 0x7fe2c80ff5a0 2024-02-19T19:11:39.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.647+0000 7fe2d01f4700 1 -- 172.21.15.96:0/2387327513 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c8101360 con 0x7fe2c80ff5a0 2024-02-19T19:11:39.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.647+0000 7fe2beffd700 1 -- 172.21.15.96:0/2387327513 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe2c4017400 con 0x7fe2c80ff5a0 2024-02-19T19:11:39.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.647+0000 7fe2d01f4700 1 -- 172.21.15.96:0/2387327513 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c81a2e30 con 0x7fe2c80ff5a0 2024-02-19T19:11:39.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.648+0000 7fe2d01f4700 1 -- 172.21.15.96:0/2387327513 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c8109270 con 0x7fe2c80ff5a0 2024-02-19T19:11:39.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.649+0000 7fe2beffd700 1 -- 172.21.15.96:0/2387327513 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fe2c4003a60 con 0x7fe2c80ff5a0 2024-02-19T19:11:39.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.649+0000 7fe2beffd700 1 --2- 172.21.15.96:0/2387327513 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe2b406d8a0 0x7fe2b406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:39.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.649+0000 7fe2beffd700 1 -- 172.21.15.96:0/2387327513 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe2c408e850 con 0x7fe2c80ff5a0 2024-02-19T19:11:39.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.649+0000 7fe2cd78f700 1 --2- 172.21.15.96:0/2387327513 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe2b406d8a0 0x7fe2b406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:39.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.650+0000 7fe2cd78f700 1 --2- 172.21.15.96:0/2387327513 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe2b406d8a0 0x7fe2b406fd60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8101d10 tx=0x7fe2b800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:39.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.654+0000 7fe2beffd700 1 -- 172.21.15.96:0/2387327513 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe2c4058130 con 0x7fe2c80ff5a0 2024-02-19T19:11:39.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:39 smithi125 ceph-mon[86115]: Upgrade: Updating osd.4 2024-02-19T19:11:39.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:39 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:39.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:39 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-19T19:11:39.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:39 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:11:39.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:39 smithi125 ceph-mon[86115]: Deploying daemon osd.4 on smithi125 2024-02-19T19:11:39.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:39 smithi125 ceph-mon[86115]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:39.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:39 smithi125 ceph-mon[86115]: pgmap v130: 65 pgs: 65 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 7.0 KiB/s rd, 5.4 KiB/s wr, 6 op/s 2024-02-19T19:11:39.880 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.858+0000 7fe2d01f4700 1 -- 172.21.15.96:0/2387327513 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe2c80611d0 con 0x7fe2b406d8a0 2024-02-19T19:11:39.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.868+0000 7fe2beffd700 1 -- 172.21.15.96:0/2387327513 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fe2c80611d0 con 0x7fe2b406d8a0 2024-02-19T19:11:39.890 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:11:39.890 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (5m) 59s ago 15m 24.9M - 0.25.0 c8568f914cd2 bbaf83a1e476 2024-02-19T19:11:39.891 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (15m) 59s ago 15m 8652k - 18.2.1 94eadd990e0a b41bff2e0043 2024-02-19T19:11:39.891 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (14m) 23s ago 14m 8204k - 18.2.1 94eadd990e0a 254ab7e7a040 2024-02-19T19:11:39.891 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (2m) 59s ago 15m 6669k - 19.0.0-1450-gf78a58c0 f081f847070a deea0ffefa0f 2024-02-19T19:11:39.891 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (2m) 23s ago 14m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 3421965dc5b0 2024-02-19T19:11:39.891 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (5m) 59s ago 15m 86.6M - 9.4.12 a0ea5e3c46d9 0102d90938e4 2024-02-19T19:11:39.891 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (9m) 59s ago 9m 27.6M - 18.2.1 94eadd990e0a 0a61d9cd40d1 2024-02-19T19:11:39.891 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (9m) 59s ago 9m 24.6M - 18.2.1 94eadd990e0a 58db3e7a7d75 2024-02-19T19:11:39.891 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (9m) 23s ago 9m 53.9M - 18.2.1 94eadd990e0a 211d64de8a63 2024-02-19T19:11:39.892 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (9m) 23s ago 9m 75.3M - 18.2.1 94eadd990e0a 2a04b5a8eaf4 2024-02-19T19:11:39.892 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:8443,9283,8765 running (7m) 59s ago 16m 500M - 19.0.0-1450-gf78a58c0 f081f847070a a86fbe94fe3f 2024-02-19T19:11:39.892 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (6m) 23s ago 14m 449M - 19.0.0-1450-gf78a58c0 f081f847070a e250486d572d 2024-02-19T19:11:39.892 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (3m) 59s ago 17m 50.6M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d70090d516e3 2024-02-19T19:11:39.892 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (3m) 23s ago 14m 42.9M 2048M 19.0.0-1450-gf78a58c0 f081f847070a f56b17bdc9a0 2024-02-19T19:11:39.892 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (6m) 59s ago 15m 15.1M - 1.5.0 0da6a335fe13 51f622ea33d6 2024-02-19T19:11:39.892 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (6m) 23s ago 14m 17.2M - 1.5.0 0da6a335fe13 464e076a52a1 2024-02-19T19:11:39.893 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2m) 59s ago 13m 46.9M 1216M 19.0.0-1450-gf78a58c0 f081f847070a b3dffd6a3fb2 2024-02-19T19:11:39.893 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (89s) 59s ago 13m 44.4M 1216M 19.0.0-1450-gf78a58c0 f081f847070a f0dd6d8f952f 2024-02-19T19:11:39.893 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (66s) 59s ago 12m 14.8M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 51b70eaaa7a9 2024-02-19T19:11:39.893 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (26s) 23s ago 12m 12.6M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 73b832b7b243 2024-02-19T19:11:39.893 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (11m) 23s ago 11m 107M 2240M 18.2.1 94eadd990e0a 2b3f0088f6b2 2024-02-19T19:11:39.893 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (11m) 23s ago 11m 96.8M 2240M 18.2.1 94eadd990e0a e5731974b46a 2024-02-19T19:11:39.893 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (6m) 59s ago 14m 64.9M - 2.43.0 a07b618ecd1d a4edcf6ed669 2024-02-19T19:11:39.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.871+0000 7fe2d01f4700 1 -- 172.21.15.96:0/2387327513 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe2b406d8a0 msgr2=0x7fe2b406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:39.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.871+0000 7fe2d01f4700 1 --2- 172.21.15.96:0/2387327513 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe2b406d8a0 0x7fe2b406fd60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8101d10 tx=0x7fe2b800b410 comp rx=0 tx=0).stop 2024-02-19T19:11:39.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.871+0000 7fe2d01f4700 1 -- 172.21.15.96:0/2387327513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2c80ff5a0 msgr2=0x7fe2c8100520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:39.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.871+0000 7fe2d01f4700 1 --2- 172.21.15.96:0/2387327513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2c80ff5a0 0x7fe2c8100520 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4006010 tx=0x7fe2c400bd70 comp rx=0 tx=0).stop 2024-02-19T19:11:39.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.871+0000 7fe2d01f4700 1 -- 172.21.15.96:0/2387327513 shutdown_connections 2024-02-19T19:11:39.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.871+0000 7fe2d01f4700 1 --2- 172.21.15.96:0/2387327513 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe2b406d8a0 0x7fe2b406fd60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:39.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.871+0000 7fe2d01f4700 1 --2- 172.21.15.96:0/2387327513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2c80ff5a0 0x7fe2c8100520 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:39.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.871+0000 7fe2d01f4700 1 --2- 172.21.15.96:0/2387327513 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c80fff50 0x7fe2c8100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:39.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.871+0000 7fe2d01f4700 1 -- 172.21.15.96:0/2387327513 >> 172.21.15.96:0/2387327513 conn(0x7fe2c8074e30 msgr2=0x7fe2c80fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:39.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.871+0000 7fe2d01f4700 1 -- 172.21.15.96:0/2387327513 shutdown_connections 2024-02-19T19:11:39.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.871+0000 7fe2d01f4700 1 -- 172.21.15.96:0/2387327513 wait complete. 2024-02-19T19:11:39.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.972+0000 7f4e48073700 1 -- 172.21.15.96:0/2041305775 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e40100ea0 msgr2=0x7f4e40101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:39.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.972+0000 7f4e48073700 1 --2- 172.21.15.96:0/2041305775 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e40100ea0 0x7f4e40101280 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c009910 tx=0x7f4e3c009c20 comp rx=0 tx=0).stop 2024-02-19T19:11:39.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.972+0000 7f4e48073700 1 -- 172.21.15.96:0/2041305775 shutdown_connections 2024-02-19T19:11:39.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.972+0000 7f4e48073700 1 --2- 172.21.15.96:0/2041305775 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e40101850 0x7f4e401058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:39.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.972+0000 7f4e48073700 1 --2- 172.21.15.96:0/2041305775 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e40100ea0 0x7f4e40101280 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:39.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.972+0000 7f4e48073700 1 -- 172.21.15.96:0/2041305775 >> 172.21.15.96:0/2041305775 conn(0x7f4e400fc750 msgr2=0x7f4e400feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:39.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.972+0000 7f4e48073700 1 -- 172.21.15.96:0/2041305775 shutdown_connections 2024-02-19T19:11:39.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.972+0000 7f4e48073700 1 -- 172.21.15.96:0/2041305775 wait complete. 2024-02-19T19:11:39.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.973+0000 7f4e48073700 1 Processor -- start 2024-02-19T19:11:39.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.973+0000 7f4e48073700 1 -- start start 2024-02-19T19:11:39.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.973+0000 7f4e48073700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e40100ea0 0x7f4e40073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:39.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.973+0000 7f4e48073700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e40101850 0x7f4e400735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:39.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.973+0000 7f4e48073700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e40073b10 con 0x7f4e40101850 2024-02-19T19:11:39.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.973+0000 7f4e48073700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e40073c50 con 0x7f4e40100ea0 2024-02-19T19:11:39.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.974+0000 7f4e4560e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e40101850 0x7f4e400735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:39.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.974+0000 7f4e4560e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e40101850 0x7f4e400735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35126/0 (socket says 172.21.15.96:35126) 2024-02-19T19:11:39.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.974+0000 7f4e4560e700 1 -- 172.21.15.96:0/1038044583 learned_addr learned my addr 172.21.15.96:0/1038044583 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:11:39.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.974+0000 7f4e45e0f700 1 --2- 172.21.15.96:0/1038044583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e40100ea0 0x7f4e40073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:39.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.974+0000 7f4e4560e700 1 -- 172.21.15.96:0/1038044583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e40100ea0 msgr2=0x7f4e40073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:39.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.974+0000 7f4e4560e700 1 --2- 172.21.15.96:0/1038044583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e40100ea0 0x7f4e40073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:39.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.974+0000 7f4e4560e700 1 -- 172.21.15.96:0/1038044583 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c0095f0 con 0x7f4e40101850 2024-02-19T19:11:39.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.974+0000 7f4e4560e700 1 --2- 172.21.15.96:0/1038044583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e40101850 0x7f4e400735d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000d900 tx=0x7f4e3000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:39.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.974+0000 7f4e36ffd700 1 -- 172.21.15.96:0/1038044583 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e30009900 con 0x7f4e40101850 2024-02-19T19:11:39.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.974+0000 7f4e48073700 1 -- 172.21.15.96:0/1038044583 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e401a2af0 con 0x7f4e40101850 2024-02-19T19:11:39.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.974+0000 7f4e36ffd700 1 -- 172.21.15.96:0/1038044583 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4e30010460 con 0x7f4e40101850 2024-02-19T19:11:39.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.974+0000 7f4e48073700 1 -- 172.21.15.96:0/1038044583 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e401a2f00 con 0x7f4e40101850 2024-02-19T19:11:39.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.974+0000 7f4e36ffd700 1 -- 172.21.15.96:0/1038044583 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e3000f5f0 con 0x7f4e40101850 2024-02-19T19:11:40.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.975+0000 7f4e48073700 1 -- 172.21.15.96:0/1038044583 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e24005320 con 0x7f4e40101850 2024-02-19T19:11:40.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.976+0000 7f4e36ffd700 1 -- 172.21.15.96:0/1038044583 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f4e30009a60 con 0x7f4e40101850 2024-02-19T19:11:40.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.976+0000 7f4e36ffd700 1 --2- 172.21.15.96:0/1038044583 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f4e2c06d8a0 0x7f4e2c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:40.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.976+0000 7f4e36ffd700 1 -- 172.21.15.96:0/1038044583 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4e3008ceb0 con 0x7f4e40101850 2024-02-19T19:11:40.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.976+0000 7f4e45e0f700 1 --2- 172.21.15.96:0/1038044583 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f4e2c06d8a0 0x7f4e2c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:40.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.977+0000 7f4e45e0f700 1 --2- 172.21.15.96:0/1038044583 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f4e2c06d8a0 0x7f4e2c06fd60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c006010 tx=0x7f4e3c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:40.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:39.982+0000 7f4e36ffd700 1 -- 172.21.15.96:0/1038044583 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4e30056790 con 0x7f4e40101850 2024-02-19T19:11:40.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.258+0000 7f4e48073700 1 -- 172.21.15.96:0/1038044583 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4e24006200 con 0x7f4e40101850 2024-02-19T19:11:40.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.258+0000 7f4e36ffd700 1 -- 172.21.15.96:0/1038044583 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f4e30017330 con 0x7f4e40101850 2024-02-19T19:11:40.281 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:11:40.281 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:11:40.281 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:11:40.281 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:11:40.281 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:11:40.281 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:11:40.281 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:11:40.282 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:11:40.282 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2, 2024-02-19T19:11:40.282 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-19T19:11:40.282 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:11:40.282 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:11:40.282 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-19T19:11:40.282 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:11:40.282 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:11:40.282 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6, 2024-02-19T19:11:40.282 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 8 2024-02-19T19:11:40.283 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:11:40.283 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:11:40.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.260+0000 7f4e48073700 1 -- 172.21.15.96:0/1038044583 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f4e2c06d8a0 msgr2=0x7f4e2c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:40.283 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.260+0000 7f4e48073700 1 --2- 172.21.15.96:0/1038044583 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f4e2c06d8a0 0x7f4e2c06fd60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c006010 tx=0x7f4e3c01a040 comp rx=0 tx=0).stop 2024-02-19T19:11:40.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.260+0000 7f4e48073700 1 -- 172.21.15.96:0/1038044583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e40101850 msgr2=0x7f4e400735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:40.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.260+0000 7f4e48073700 1 --2- 172.21.15.96:0/1038044583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e40101850 0x7f4e400735d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000d900 tx=0x7f4e3000dc10 comp rx=0 tx=0).stop 2024-02-19T19:11:40.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.260+0000 7f4e48073700 1 -- 172.21.15.96:0/1038044583 shutdown_connections 2024-02-19T19:11:40.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.260+0000 7f4e48073700 1 --2- 172.21.15.96:0/1038044583 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f4e2c06d8a0 0x7f4e2c06fd60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:40.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.260+0000 7f4e48073700 1 --2- 172.21.15.96:0/1038044583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e40100ea0 0x7f4e40073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:40.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.260+0000 7f4e48073700 1 --2- 172.21.15.96:0/1038044583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e40101850 0x7f4e400735d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:40.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.260+0000 7f4e48073700 1 -- 172.21.15.96:0/1038044583 >> 172.21.15.96:0/1038044583 conn(0x7f4e400fc750 msgr2=0x7f4e400fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:40.284 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.260+0000 7f4e48073700 1 -- 172.21.15.96:0/1038044583 shutdown_connections 2024-02-19T19:11:40.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.261+0000 7f4e48073700 1 -- 172.21.15.96:0/1038044583 wait complete. 2024-02-19T19:11:40.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.363+0000 7f09c1a3d700 1 -- 172.21.15.96:0/2091922021 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09bc101e00 msgr2=0x7f09bc1021e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:40.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.363+0000 7f09c1a3d700 1 --2- 172.21.15.96:0/2091922021 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09bc101e00 0x7f09bc1021e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f09ac009910 tx=0x7f09ac009c20 comp rx=0 tx=0).stop 2024-02-19T19:11:40.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.363+0000 7f09c1a3d700 1 -- 172.21.15.96:0/2091922021 shutdown_connections 2024-02-19T19:11:40.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.363+0000 7f09c1a3d700 1 --2- 172.21.15.96:0/2091922021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09bc102720 0x7f09bc10ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:40.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.363+0000 7f09c1a3d700 1 --2- 172.21.15.96:0/2091922021 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09bc101e00 0x7f09bc1021e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:40.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.363+0000 7f09c1a3d700 1 -- 172.21.15.96:0/2091922021 >> 172.21.15.96:0/2091922021 conn(0x7f09bc0fb650 msgr2=0x7f09bc0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:40.386 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.363+0000 7f09c1a3d700 1 -- 172.21.15.96:0/2091922021 shutdown_connections 2024-02-19T19:11:40.387 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.364+0000 7f09c1a3d700 1 -- 172.21.15.96:0/2091922021 wait complete. 2024-02-19T19:11:40.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.364+0000 7f09c1a3d700 1 Processor -- start 2024-02-19T19:11:40.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.364+0000 7f09c1a3d700 1 -- start start 2024-02-19T19:11:40.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.365+0000 7f09c1a3d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09bc101e00 0x7f09bc19c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:40.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.365+0000 7f09c1a3d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09bc102720 0x7f09bc19cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:40.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.365+0000 7f09c1a3d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc19d260 con 0x7f09bc101e00 2024-02-19T19:11:40.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.365+0000 7f09c1a3d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc196710 con 0x7f09bc102720 2024-02-19T19:11:40.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.365+0000 7f09baffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09bc101e00 0x7f09bc19c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:40.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.365+0000 7f09baffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09bc101e00 0x7f09bc19c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35150/0 (socket says 172.21.15.96:35150) 2024-02-19T19:11:40.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.365+0000 7f09baffd700 1 -- 172.21.15.96:0/227881419 learned_addr learned my addr 172.21.15.96:0/227881419 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:11:40.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.365+0000 7f09ba7fc700 1 --2- 172.21.15.96:0/227881419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09bc102720 0x7f09bc19cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:40.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.365+0000 7f09baffd700 1 -- 172.21.15.96:0/227881419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09bc102720 msgr2=0x7f09bc19cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:40.389 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.365+0000 7f09baffd700 1 --2- 172.21.15.96:0/227881419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09bc102720 0x7f09bc19cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:40.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.365+0000 7f09baffd700 1 -- 172.21.15.96:0/227881419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ac0095f0 con 0x7f09bc101e00 2024-02-19T19:11:40.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.365+0000 7f09baffd700 1 --2- 172.21.15.96:0/227881419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09bc101e00 0x7f09bc19c690 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f09ac006010 tx=0x7f09ac00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:40.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.365+0000 7f09c0a3b700 1 -- 172.21.15.96:0/227881419 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09ac01d070 con 0x7f09bc101e00 2024-02-19T19:11:40.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.365+0000 7f09c0a3b700 1 -- 172.21.15.96:0/227881419 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f09ac005dc0 con 0x7f09bc101e00 2024-02-19T19:11:40.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.365+0000 7f09c1a3d700 1 -- 172.21.15.96:0/227881419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09bc196990 con 0x7f09bc101e00 2024-02-19T19:11:40.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.365+0000 7f09c0a3b700 1 -- 172.21.15.96:0/227881419 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09ac017400 con 0x7f09bc101e00 2024-02-19T19:11:40.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.365+0000 7f09c1a3d700 1 -- 172.21.15.96:0/227881419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09bc196e80 con 0x7f09bc101e00 2024-02-19T19:11:40.390 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.367+0000 7f09c1a3d700 1 -- 172.21.15.96:0/227881419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09bc108310 con 0x7f09bc101e00 2024-02-19T19:11:40.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.367+0000 7f09c0a3b700 1 -- 172.21.15.96:0/227881419 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f09ac003a60 con 0x7f09bc101e00 2024-02-19T19:11:40.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.367+0000 7f09c0a3b700 1 --2- 172.21.15.96:0/227881419 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f09a406d8a0 0x7f09a406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:40.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.367+0000 7f09c0a3b700 1 -- 172.21.15.96:0/227881419 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f09ac08e920 con 0x7f09bc101e00 2024-02-19T19:11:40.391 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.367+0000 7f09ba7fc700 1 --2- 172.21.15.96:0/227881419 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f09a406d8a0 0x7f09a406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:40.392 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.368+0000 7f09ba7fc700 1 --2- 172.21.15.96:0/227881419 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f09a406d8a0 0x7f09a406fd60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f09bc197b80 tx=0x7f09b000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:40.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.372+0000 7f09c0a3b700 1 -- 172.21.15.96:0/227881419 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f09ac05bcb0 con 0x7f09bc101e00 2024-02-19T19:11:40.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:40 smithi096 ceph-mon[112483]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:40.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:40 smithi096 ceph-mon[112483]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:40.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:40 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/1038044583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:40.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.612+0000 7f09c1a3d700 1 -- 172.21.15.96:0/227881419 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f09bc04f2e0 con 0x7f09bc101e00 2024-02-19T19:11:40.635 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.613+0000 7f09c0a3b700 1 -- 172.21.15.96:0/227881419 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1886 (secure 0 0 0) 0x7f09ac05b840 con 0x7f09bc101e00 2024-02-19T19:11:40.635 INFO:teuthology.orchestra.run.smithi096.stdout:e20 2024-02-19T19:11:40.635 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:11:40.635 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:11:40.635 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2024-02-19T19:11:40.635 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:11:40.636 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:11:40.636 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2024-02-19T19:11:40.636 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 20 2024-02-19T19:11:40.636 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-19T19:11:40.636 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-02-19T19:01:42.881136+0000 2024-02-19T19:11:40.636 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2024-02-19T19:10:58.917735+0000 2024-02-19T19:11:40.636 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2024-02-19T19:11:40.636 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2024-02-19T19:11:40.636 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2024-02-19T19:11:40.637 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2024-02-19T19:11:40.637 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2024-02-19T19:11:40.637 INFO:teuthology.orchestra.run.smithi096.stdout:max_xattr_size 65536 2024-02-19T19:11:40.637 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2024-02-19T19:11:40.637 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2024-02-19T19:11:40.637 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 46 2024-02-19T19:11:40.637 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:11:40.637 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2024-02-19T19:11:40.638 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2024-02-19T19:11:40.638 INFO:teuthology.orchestra.run.smithi096.stdout:up {0=14490,1=24267} 2024-02-19T19:11:40.638 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2024-02-19T19:11:40.638 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2024-02-19T19:11:40.638 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2024-02-19T19:11:40.638 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2024-02-19T19:11:40.638 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2024-02-19T19:11:40.638 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data enabled 2024-02-19T19:11:40.638 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2024-02-19T19:11:40.639 INFO:teuthology.orchestra.run.smithi096.stdout:bal_rank_mask -1 2024-02-19T19:11:40.639 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2024-02-19T19:11:40.639 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pccmys{0:14490} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:11:40.639 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.usrmcg{0:14502} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/413113741,v1:172.21.15.96:6827/413113741] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:11:40.639 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.srnlol{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.125:6824/3084054986,v1:172.21.15.125:6825/3084054986] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:11:40.639 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.pwyuga{1:24275} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.125:6826/3098247423,v1:172.21.15.125:6827/3098247423] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:11:40.639 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:11:40.639 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:11:40.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.615+0000 7f09c1a3d700 1 -- 172.21.15.96:0/227881419 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f09a406d8a0 msgr2=0x7f09a406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:40.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.615+0000 7f09c1a3d700 1 --2- 172.21.15.96:0/227881419 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f09a406d8a0 0x7f09a406fd60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f09bc197b80 tx=0x7f09b000b410 comp rx=0 tx=0).stop 2024-02-19T19:11:40.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.615+0000 7f09c1a3d700 1 -- 172.21.15.96:0/227881419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09bc101e00 msgr2=0x7f09bc19c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:40.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.615+0000 7f09c1a3d700 1 --2- 172.21.15.96:0/227881419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09bc101e00 0x7f09bc19c690 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f09ac006010 tx=0x7f09ac00bd70 comp rx=0 tx=0).stop 2024-02-19T19:11:40.640 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.615+0000 7f09c1a3d700 1 -- 172.21.15.96:0/227881419 shutdown_connections 2024-02-19T19:11:40.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.615+0000 7f09c1a3d700 1 --2- 172.21.15.96:0/227881419 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f09a406d8a0 0x7f09a406fd60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:40.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.615+0000 7f09c1a3d700 1 --2- 172.21.15.96:0/227881419 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09bc101e00 0x7f09bc19c690 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:40.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.615+0000 7f09c1a3d700 1 --2- 172.21.15.96:0/227881419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09bc102720 0x7f09bc19cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:40.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.615+0000 7f09c1a3d700 1 -- 172.21.15.96:0/227881419 >> 172.21.15.96:0/227881419 conn(0x7f09bc0fb650 msgr2=0x7f09bc105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:40.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.615+0000 7f09c1a3d700 1 -- 172.21.15.96:0/227881419 shutdown_connections 2024-02-19T19:11:40.641 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.615+0000 7f09c1a3d700 1 -- 172.21.15.96:0/227881419 wait complete. 2024-02-19T19:11:40.641 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 20 2024-02-19T19:11:40.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:40 smithi125 ceph-mon[86115]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:40.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:40 smithi125 ceph-mon[86115]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:40.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:40 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/1038044583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:40.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.719+0000 7fb98686a700 1 -- 172.21.15.96:0/1390180050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9800ff5a0 msgr2=0x7fb9800ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:40.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.719+0000 7fb98686a700 1 --2- 172.21.15.96:0/1390180050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9800ff5a0 0x7fb9800ff980 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb974009910 tx=0x7fb974009c20 comp rx=0 tx=0).stop 2024-02-19T19:11:40.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.719+0000 7fb98686a700 1 -- 172.21.15.96:0/1390180050 shutdown_connections 2024-02-19T19:11:40.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.719+0000 7fb98686a700 1 --2- 172.21.15.96:0/1390180050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9800fff50 0x7fb980105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:40.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.719+0000 7fb98686a700 1 --2- 172.21.15.96:0/1390180050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9800ff5a0 0x7fb9800ff980 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:40.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.719+0000 7fb98686a700 1 -- 172.21.15.96:0/1390180050 >> 172.21.15.96:0/1390180050 conn(0x7fb980074e30 msgr2=0x7fb980075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:40.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.719+0000 7fb98686a700 1 -- 172.21.15.96:0/1390180050 shutdown_connections 2024-02-19T19:11:40.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.719+0000 7fb98686a700 1 -- 172.21.15.96:0/1390180050 wait complete. 2024-02-19T19:11:40.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.720+0000 7fb98686a700 1 Processor -- start 2024-02-19T19:11:40.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.720+0000 7fb98686a700 1 -- start start 2024-02-19T19:11:40.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.720+0000 7fb98686a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9800ff5a0 0x7fb98019e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:40.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.720+0000 7fb98686a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9800fff50 0x7fb98019edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:40.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.720+0000 7fb98686a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98019f440 con 0x7fb9800ff5a0 2024-02-19T19:11:40.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.720+0000 7fb98686a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9801988f0 con 0x7fb9800fff50 2024-02-19T19:11:40.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.720+0000 7fb97ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9800ff5a0 0x7fb98019e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:40.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.720+0000 7fb97ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9800ff5a0 0x7fb98019e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35166/0 (socket says 172.21.15.96:35166) 2024-02-19T19:11:40.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.720+0000 7fb97ffff700 1 -- 172.21.15.96:0/2791986760 learned_addr learned my addr 172.21.15.96:0/2791986760 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:11:40.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.720+0000 7fb97f7fe700 1 --2- 172.21.15.96:0/2791986760 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9800fff50 0x7fb98019edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:40.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.721+0000 7fb97ffff700 1 -- 172.21.15.96:0/2791986760 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9800fff50 msgr2=0x7fb98019edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:40.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.721+0000 7fb97ffff700 1 --2- 172.21.15.96:0/2791986760 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9800fff50 0x7fb98019edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:40.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.721+0000 7fb97ffff700 1 -- 172.21.15.96:0/2791986760 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9740095f0 con 0x7fb9800ff5a0 2024-02-19T19:11:40.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.721+0000 7fb97ffff700 1 --2- 172.21.15.96:0/2791986760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9800ff5a0 0x7fb98019e870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb974006010 tx=0x7fb97400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:40.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.721+0000 7fb97d7fa700 1 -- 172.21.15.96:0/2791986760 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb97401d070 con 0x7fb9800ff5a0 2024-02-19T19:11:40.745 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.721+0000 7fb98686a700 1 -- 172.21.15.96:0/2791986760 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb980198b70 con 0x7fb9800ff5a0 2024-02-19T19:11:40.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.721+0000 7fb97d7fa700 1 -- 172.21.15.96:0/2791986760 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb974005dc0 con 0x7fb9800ff5a0 2024-02-19T19:11:40.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.721+0000 7fb97d7fa700 1 -- 172.21.15.96:0/2791986760 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb974017400 con 0x7fb9800ff5a0 2024-02-19T19:11:40.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.721+0000 7fb98686a700 1 -- 172.21.15.96:0/2791986760 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb980199060 con 0x7fb9800ff5a0 2024-02-19T19:11:40.746 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.722+0000 7fb98686a700 1 -- 172.21.15.96:0/2791986760 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb980104fc0 con 0x7fb9800ff5a0 2024-02-19T19:11:40.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.722+0000 7fb97d7fa700 1 -- 172.21.15.96:0/2791986760 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb974003a60 con 0x7fb9800ff5a0 2024-02-19T19:11:40.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.723+0000 7fb97d7fa700 1 --2- 172.21.15.96:0/2791986760 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb96806d8a0 0x7fb96806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:40.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.723+0000 7fb97d7fa700 1 -- 172.21.15.96:0/2791986760 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb97408e920 con 0x7fb9800ff5a0 2024-02-19T19:11:40.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.723+0000 7fb97f7fe700 1 --2- 172.21.15.96:0/2791986760 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb96806d8a0 0x7fb96806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:40.747 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.723+0000 7fb97f7fe700 1 --2- 172.21.15.96:0/2791986760 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb96806d8a0 0x7fb96806fd60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb9801076f0 tx=0x7fb97000b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:40.749 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.727+0000 7fb97d7fa700 1 -- 172.21.15.96:0/2791986760 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb97405bcb0 con 0x7fb9800ff5a0 2024-02-19T19:11:40.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.939+0000 7fb98686a700 1 -- 172.21.15.96:0/2791986760 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb980199280 con 0x7fb96806d8a0 2024-02-19T19:11:40.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.940+0000 7fb97d7fa700 1 -- 172.21.15.96:0/2791986760 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fb980199280 con 0x7fb96806d8a0 2024-02-19T19:11:40.963 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:11:40.963 INFO:teuthology.orchestra.run.smithi096.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:11:40.963 INFO:teuthology.orchestra.run.smithi096.stdout: "in_progress": true, 2024-02-19T19:11:40.963 INFO:teuthology.orchestra.run.smithi096.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:11:40.963 INFO:teuthology.orchestra.run.smithi096.stdout: "services_complete": [ 2024-02-19T19:11:40.963 INFO:teuthology.orchestra.run.smithi096.stdout: "crash", 2024-02-19T19:11:40.963 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr", 2024-02-19T19:11:40.963 INFO:teuthology.orchestra.run.smithi096.stdout: "mon" 2024-02-19T19:11:40.964 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-02-19T19:11:40.964 INFO:teuthology.orchestra.run.smithi096.stdout: "progress": "10/23 daemons upgraded", 2024-02-19T19:11:40.964 INFO:teuthology.orchestra.run.smithi096.stdout: "message": "Currently upgrading osd daemons", 2024-02-19T19:11:40.964 INFO:teuthology.orchestra.run.smithi096.stdout: "is_paused": false 2024-02-19T19:11:40.964 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:11:40.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.942+0000 7fb98686a700 1 -- 172.21.15.96:0/2791986760 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb96806d8a0 msgr2=0x7fb96806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:40.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.942+0000 7fb98686a700 1 --2- 172.21.15.96:0/2791986760 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb96806d8a0 0x7fb96806fd60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb9801076f0 tx=0x7fb97000b410 comp rx=0 tx=0).stop 2024-02-19T19:11:40.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.942+0000 7fb98686a700 1 -- 172.21.15.96:0/2791986760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9800ff5a0 msgr2=0x7fb98019e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:40.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.942+0000 7fb98686a700 1 --2- 172.21.15.96:0/2791986760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9800ff5a0 0x7fb98019e870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb974006010 tx=0x7fb97400bd70 comp rx=0 tx=0).stop 2024-02-19T19:11:40.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.943+0000 7fb98686a700 1 -- 172.21.15.96:0/2791986760 shutdown_connections 2024-02-19T19:11:40.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.943+0000 7fb98686a700 1 --2- 172.21.15.96:0/2791986760 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb96806d8a0 0x7fb96806fd60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:40.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.943+0000 7fb98686a700 1 --2- 172.21.15.96:0/2791986760 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9800ff5a0 0x7fb98019e870 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:40.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.943+0000 7fb98686a700 1 --2- 172.21.15.96:0/2791986760 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb9800fff50 0x7fb98019edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:40.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.943+0000 7fb98686a700 1 -- 172.21.15.96:0/2791986760 >> 172.21.15.96:0/2791986760 conn(0x7fb980074e30 msgr2=0x7fb9800fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:40.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.943+0000 7fb98686a700 1 -- 172.21.15.96:0/2791986760 shutdown_connections 2024-02-19T19:11:40.966 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:40.943+0000 7fb98686a700 1 -- 172.21.15.96:0/2791986760 wait complete. 2024-02-19T19:11:41.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.045+0000 7f91ccfde700 1 -- 172.21.15.96:0/1372523559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91c8105bd0 msgr2=0x7f91c8105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:41.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.045+0000 7f91ccfde700 1 --2- 172.21.15.96:0/1372523559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91c8105bd0 0x7f91c8105fb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f91b8009910 tx=0x7f91b8009c20 comp rx=0 tx=0).stop 2024-02-19T19:11:41.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.045+0000 7f91ccfde700 1 -- 172.21.15.96:0/1372523559 shutdown_connections 2024-02-19T19:11:41.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.045+0000 7f91ccfde700 1 --2- 172.21.15.96:0/1372523559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91c80ffc20 0x7f91c8100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:41.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.045+0000 7f91ccfde700 1 --2- 172.21.15.96:0/1372523559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91c8105bd0 0x7f91c8105fb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:41.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.045+0000 7f91ccfde700 1 -- 172.21.15.96:0/1372523559 >> 172.21.15.96:0/1372523559 conn(0x7f91c8075670 msgr2=0x7f91c8075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:41.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.045+0000 7f91ccfde700 1 -- 172.21.15.96:0/1372523559 shutdown_connections 2024-02-19T19:11:41.068 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.045+0000 7f91ccfde700 1 -- 172.21.15.96:0/1372523559 wait complete. 2024-02-19T19:11:41.069 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.046+0000 7f91ccfde700 1 Processor -- start 2024-02-19T19:11:41.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.046+0000 7f91ccfde700 1 -- start start 2024-02-19T19:11:41.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.046+0000 7f91ccfde700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91c80ffc20 0x7f91c8197670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:41.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.046+0000 7f91ccfde700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91c8105bd0 0x7f91c8197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:41.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.046+0000 7f91ccfde700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c8198290 con 0x7f91c8105bd0 2024-02-19T19:11:41.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.046+0000 7f91ccfde700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c81983d0 con 0x7f91c80ffc20 2024-02-19T19:11:41.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.046+0000 7f91c5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91c8105bd0 0x7f91c8197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:41.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.046+0000 7f91c5d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91c8105bd0 0x7f91c8197bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35178/0 (socket says 172.21.15.96:35178) 2024-02-19T19:11:41.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.046+0000 7f91c5d9b700 1 -- 172.21.15.96:0/177199296 learned_addr learned my addr 172.21.15.96:0/177199296 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:11:41.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.047+0000 7f91c659c700 1 --2- 172.21.15.96:0/177199296 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91c80ffc20 0x7f91c8197670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:41.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.047+0000 7f91c5d9b700 1 -- 172.21.15.96:0/177199296 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91c80ffc20 msgr2=0x7f91c8197670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:41.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.047+0000 7f91c5d9b700 1 --2- 172.21.15.96:0/177199296 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91c80ffc20 0x7f91c8197670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:41.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.047+0000 7f91c5d9b700 1 -- 172.21.15.96:0/177199296 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b80095f0 con 0x7f91c8105bd0 2024-02-19T19:11:41.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.047+0000 7f91c5d9b700 1 --2- 172.21.15.96:0/177199296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91c8105bd0 0x7f91c8197bb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f91bc00d8d0 tx=0x7f91bc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:41.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.047+0000 7f91b77fe700 1 -- 172.21.15.96:0/177199296 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91bc0098a0 con 0x7f91c8105bd0 2024-02-19T19:11:41.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.047+0000 7f91ccfde700 1 -- 172.21.15.96:0/177199296 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c81a0740 con 0x7f91c8105bd0 2024-02-19T19:11:41.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.047+0000 7f91b77fe700 1 -- 172.21.15.96:0/177199296 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f91bc010460 con 0x7f91c8105bd0 2024-02-19T19:11:41.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.047+0000 7f91b77fe700 1 -- 172.21.15.96:0/177199296 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f91bc00f5f0 con 0x7f91c8105bd0 2024-02-19T19:11:41.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.047+0000 7f91ccfde700 1 -- 172.21.15.96:0/177199296 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c81a0c60 con 0x7f91c8105bd0 2024-02-19T19:11:41.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.048+0000 7f91ccfde700 1 -- 172.21.15.96:0/177199296 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c81080d0 con 0x7f91c8105bd0 2024-02-19T19:11:41.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.049+0000 7f91b77fe700 1 -- 172.21.15.96:0/177199296 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f91bc009a00 con 0x7f91c8105bd0 2024-02-19T19:11:41.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.049+0000 7f91b77fe700 1 --2- 172.21.15.96:0/177199296 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f91b006d8a0 0x7f91b006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:11:41.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.049+0000 7f91c659c700 1 --2- 172.21.15.96:0/177199296 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f91b006d8a0 0x7f91b006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:11:41.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.049+0000 7f91b77fe700 1 -- 172.21.15.96:0/177199296 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f91bc08d350 con 0x7f91c8105bd0 2024-02-19T19:11:41.073 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.050+0000 7f91c659c700 1 --2- 172.21.15.96:0/177199296 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f91b006d8a0 0x7f91b006fd60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f91b800b5c0 tx=0x7f91b801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:11:41.076 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.054+0000 7f91b77fe700 1 -- 172.21.15.96:0/177199296 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f91bc056bb0 con 0x7f91c8105bd0 2024-02-19T19:11:41.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.328+0000 7f91ccfde700 1 -- 172.21.15.96:0/177199296 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f91c804f2e0 con 0x7f91c8105bd0 2024-02-19T19:11:41.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.329+0000 7f91b77fe700 1 -- 172.21.15.96:0/177199296 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f91bc05a270 con 0x7f91c8105bd0 2024-02-19T19:11:41.351 INFO:teuthology.orchestra.run.smithi096.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T19:11:41.351 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-19T19:11:41.351 INFO:teuthology.orchestra.run.smithi096.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-19T19:11:41.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.331+0000 7f91ccfde700 1 -- 172.21.15.96:0/177199296 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f91b006d8a0 msgr2=0x7f91b006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:41.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.331+0000 7f91ccfde700 1 --2- 172.21.15.96:0/177199296 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f91b006d8a0 0x7f91b006fd60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f91b800b5c0 tx=0x7f91b801a040 comp rx=0 tx=0).stop 2024-02-19T19:11:41.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.331+0000 7f91ccfde700 1 -- 172.21.15.96:0/177199296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91c8105bd0 msgr2=0x7f91c8197bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:11:41.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.331+0000 7f91ccfde700 1 --2- 172.21.15.96:0/177199296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91c8105bd0 0x7f91c8197bb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f91bc00d8d0 tx=0x7f91bc00dbe0 comp rx=0 tx=0).stop 2024-02-19T19:11:41.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.331+0000 7f91ccfde700 1 -- 172.21.15.96:0/177199296 shutdown_connections 2024-02-19T19:11:41.353 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.331+0000 7f91ccfde700 1 --2- 172.21.15.96:0/177199296 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f91b006d8a0 0x7f91b006fd60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:41.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.331+0000 7f91ccfde700 1 --2- 172.21.15.96:0/177199296 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91c80ffc20 0x7f91c8197670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:41.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.331+0000 7f91ccfde700 1 --2- 172.21.15.96:0/177199296 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91c8105bd0 0x7f91c8197bb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:11:41.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.331+0000 7f91ccfde700 1 -- 172.21.15.96:0/177199296 >> 172.21.15.96:0/177199296 conn(0x7f91c8075670 msgr2=0x7f91c80feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:11:41.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.331+0000 7f91ccfde700 1 -- 172.21.15.96:0/177199296 shutdown_connections 2024-02-19T19:11:41.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:11:41.331+0000 7f91ccfde700 1 -- 172.21.15.96:0/177199296 wait complete. 2024-02-19T19:11:41.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:41 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/227881419' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:11:41.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:41 smithi096 ceph-mon[112483]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:41.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:41 smithi096 ceph-mon[112483]: pgmap v131: 65 pgs: 65 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 3.8 KiB/s rd, 2.2 KiB/s wr, 4 op/s 2024-02-19T19:11:41.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:41 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/177199296' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:11:41.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:41 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/227881419' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:11:41.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:41 smithi125 ceph-mon[86115]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:11:41.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:41 smithi125 ceph-mon[86115]: pgmap v131: 65 pgs: 65 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 3.8 KiB/s rd, 2.2 KiB/s wr, 4 op/s 2024-02-19T19:11:41.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:41 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/177199296' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:11:42.203 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:41 smithi125 systemd[1]: Stopping Ceph osd.4 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T19:11:42.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:42 smithi125 ceph-mon[86115]: osd.4 marked itself down and dead 2024-02-19T19:11:42.704 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:42 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4[50534]: 2024-02-19T19:11:42.225+0000 7fba082d5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T19:11:42.704 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:42 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4[50534]: 2024-02-19T19:11:42.225+0000 7fba082d5700 -1 osd.4 69 *** Got signal Terminated *** 2024-02-19T19:11:42.704 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:42 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4[50534]: 2024-02-19T19:11:42.225+0000 7fba082d5700 -1 osd.4 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T19:11:42.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:42 smithi096 ceph-mon[112483]: osd.4 marked itself down and dead 2024-02-19T19:11:43.293 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:42 smithi125 podman[100176]: 2024-02-19 19:11:42.948761159 +0000 UTC m=+0.840126855 container died 2b3f0088f6b206315bb91ba0fc6c995ec1221e5d27b8edd4b1dcdf97f92c2a03 (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.build-date=20240214) 2024-02-19T19:11:43.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:43 smithi125 ceph-mon[86115]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:11:43.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:43 smithi125 ceph-mon[86115]: osdmap e70: 6 total, 5 up, 6 in 2024-02-19T19:11:43.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:43 smithi125 ceph-mon[86115]: pgmap v133: 65 pgs: 6 stale+active+clean, 59 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s rd, 2.3 KiB/s wr, 5 op/s 2024-02-19T19:11:43.704 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:43 smithi125 podman[100176]: 2024-02-19 19:11:43.271180049 +0000 UTC m=+1.162545742 container cleanup 2b3f0088f6b206315bb91ba0fc6c995ec1221e5d27b8edd4b1dcdf97f92c2a03 (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4, ceph=True, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-19T19:11:43.704 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:43 smithi125 bash[100176]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4 2024-02-19T19:11:43.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:43 smithi096 ceph-mon[112483]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:11:43.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:43 smithi096 ceph-mon[112483]: osdmap e70: 6 total, 5 up, 6 in 2024-02-19T19:11:43.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:43 smithi096 ceph-mon[112483]: pgmap v133: 65 pgs: 6 stale+active+clean, 59 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s rd, 2.3 KiB/s wr, 5 op/s 2024-02-19T19:11:44.203 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:43 smithi125 podman[100203]: 2024-02-19 19:11:43.756269201 +0000 UTC m=+0.809561501 container remove 2b3f0088f6b206315bb91ba0fc6c995ec1221e5d27b8edd4b1dcdf97f92c2a03 (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, GIT_CLEAN=True, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.schema-version=1.0, RELEASE=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-19T19:11:44.638 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:44 smithi125 ceph-mon[86115]: osdmap e71: 6 total, 5 up, 6 in 2024-02-19T19:11:44.638 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:44 smithi125 podman[100284]: 2024-02-19 19:11:44.261085573 +0000 UTC m=+0.018922805 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:11:44.638 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:44 smithi125 podman[100284]: 2024-02-19 19:11:44.457264411 +0000 UTC m=+0.215101686 container create 0feaf29703c5a9a5543e3d284cf868d034740ad794506cb39cc6ddbfb8a47b3d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=) 2024-02-19T19:11:44.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:44 smithi096 ceph-mon[112483]: osdmap e71: 6 total, 5 up, 6 in 2024-02-19T19:11:45.074 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:44 smithi125 podman[100284]: 2024-02-19 19:11:44.693615178 +0000 UTC m=+0.451452426 container init 0feaf29703c5a9a5543e3d284cf868d034740ad794506cb39cc6ddbfb8a47b3d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-deactivate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214) 2024-02-19T19:11:45.074 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:44 smithi125 podman[100284]: 2024-02-19 19:11:44.698599948 +0000 UTC m=+0.456437185 container start 0feaf29703c5a9a5543e3d284cf868d034740ad794506cb39cc6ddbfb8a47b3d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-02-19T19:11:45.074 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:44 smithi125 podman[100284]: 2024-02-19 19:11:44.793437353 +0000 UTC m=+0.551274597 container attach 0feaf29703c5a9a5543e3d284cf868d034740ad794506cb39cc6ddbfb8a47b3d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-deactivate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214) 2024-02-19T19:11:45.453 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:45 smithi125 podman[100284]: 2024-02-19 19:11:45.05243728 +0000 UTC m=+0.810274518 container died 0feaf29703c5a9a5543e3d284cf868d034740ad794506cb39cc6ddbfb8a47b3d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD) 2024-02-19T19:11:45.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:45 smithi096 ceph-mon[112483]: pgmap v135: 65 pgs: 19 active+undersized+degraded, 8 peering, 1 stale+active+clean, 2 active+undersized, 35 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 2.4 KiB/s wr, 4 op/s; 3647/32076 objects degraded (11.370%) 2024-02-19T19:11:45.953 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:45 smithi125 podman[100310]: 2024-02-19 19:11:45.630071247 +0000 UTC m=+0.571290099 container remove 0feaf29703c5a9a5543e3d284cf868d034740ad794506cb39cc6ddbfb8a47b3d (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-02-19T19:11:45.954 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:45 smithi125 systemd[1]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.4.service: Deactivated successfully. 2024-02-19T19:11:45.954 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:45 smithi125 systemd[1]: Stopped Ceph osd.4 for 06580d2c-cf58-11ee-95bb-87774f69a715. 2024-02-19T19:11:45.954 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:45 smithi125 systemd[1]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.4.service: Consumed 10.651s CPU time. 2024-02-19T19:11:45.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:45 smithi125 ceph-mon[86115]: pgmap v135: 65 pgs: 19 active+undersized+degraded, 8 peering, 1 stale+active+clean, 2 active+undersized, 35 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 2.4 KiB/s wr, 4 op/s; 3647/32076 objects degraded (11.370%) 2024-02-19T19:11:46.253 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:45 smithi125 systemd[1]: Starting Ceph osd.4 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T19:11:46.253 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:46 smithi125 podman[100403]: 2024-02-19 19:11:46.11946876 +0000 UTC m=+0.026321786 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:11:46.589 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:46 smithi125 ceph-mon[86115]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-19T19:11:46.589 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:46 smithi125 ceph-mon[86115]: Health check failed: Degraded data redundancy: 3647/32076 objects degraded (11.370%), 19 pgs degraded (PG_DEGRADED) 2024-02-19T19:11:46.590 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:46 smithi125 podman[100403]: 2024-02-19 19:11:46.231435885 +0000 UTC m=+0.138288895 container create 1f05fd442c0d6bde527c9f58f5ca5af671f512ca2d8ffd4e20530194ec9c96b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-activate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-19T19:11:46.590 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:46 smithi125 podman[100403]: 2024-02-19 19:11:46.468354197 +0000 UTC m=+0.375207207 container init 1f05fd442c0d6bde527c9f58f5ca5af671f512ca2d8ffd4e20530194ec9c96b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-activate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T19:11:46.590 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:46 smithi125 podman[100403]: 2024-02-19 19:11:46.473497323 +0000 UTC m=+0.380350330 container start 1f05fd442c0d6bde527c9f58f5ca5af671f512ca2d8ffd4e20530194ec9c96b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-activate, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T19:11:46.590 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:46 smithi125 podman[100403]: 2024-02-19 19:11:46.567733456 +0000 UTC m=+0.474586467 container attach 1f05fd442c0d6bde527c9f58f5ca5af671f512ca2d8ffd4e20530194ec9c96b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-activate, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-19T19:11:46.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:46 smithi096 ceph-mon[112483]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-19T19:11:46.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:46 smithi096 ceph-mon[112483]: Health check failed: Degraded data redundancy: 3647/32076 objects degraded (11.370%), 19 pgs degraded (PG_DEGRADED) 2024-02-19T19:11:47.335 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:46 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-activate[100418]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-19T19:11:47.335 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:46 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-activate[100418]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-19T19:11:47.335 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:46 smithi125 bash[100403]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-19T19:11:47.335 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:46 smithi125 bash[100403]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-19T19:11:47.335 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:46 smithi125 bash[100403]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-19T19:11:47.336 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:46 smithi125 bash[100403]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-19T19:11:47.336 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:46 smithi125 bash[100403]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-19T19:11:47.336 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:46 smithi125 bash[100403]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-19T19:11:47.336 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:46 smithi125 bash[100403]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-19T19:11:47.336 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:46 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-activate[100418]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-19T19:11:47.336 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:46 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-activate[100418]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-19T19:11:47.336 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:46 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-activate[100418]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-19T19:11:47.336 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:46 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-activate[100418]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-19T19:11:47.336 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:46 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-activate[100418]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-19T19:11:47.337 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:47 smithi125 podman[100403]: 2024-02-19 19:11:47.017869286 +0000 UTC m=+0.924722290 container died 1f05fd442c0d6bde527c9f58f5ca5af671f512ca2d8ffd4e20530194ec9c96b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-activate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2) 2024-02-19T19:11:47.601 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:47 smithi125 ceph-mon[86115]: pgmap v136: 65 pgs: 24 active+undersized+degraded, 8 peering, 2 active+undersized, 31 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s; 4575/32076 objects degraded (14.263%) 2024-02-19T19:11:47.601 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:47 smithi125 podman[100535]: 2024-02-19 19:11:47.579525525 +0000 UTC m=+0.554370550 container remove 1f05fd442c0d6bde527c9f58f5ca5af671f512ca2d8ffd4e20530194ec9c96b3 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-activate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-02-19T19:11:47.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:47 smithi096 ceph-mon[112483]: pgmap v136: 65 pgs: 24 active+undersized+degraded, 8 peering, 2 active+undersized, 31 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s; 4575/32076 objects degraded (14.263%) 2024-02-19T19:11:47.953 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:47 smithi125 podman[100587]: 2024-02-19 19:11:47.706382434 +0000 UTC m=+0.018202923 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:11:47.953 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:47 smithi125 podman[100587]: 2024-02-19 19:11:47.822124969 +0000 UTC m=+0.133945459 container create 1309ffc459f9768d149c0e6d3975120f388dce3366f4c6e3e5aab8992941f893 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True) 2024-02-19T19:11:48.453 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:48 smithi125 podman[100587]: 2024-02-19 19:11:48.032600815 +0000 UTC m=+0.344421304 container init 1309ffc459f9768d149c0e6d3975120f388dce3366f4c6e3e5aab8992941f893 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-02-19T19:11:48.454 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:48 smithi125 podman[100587]: 2024-02-19 19:11:48.03729273 +0000 UTC m=+0.349113227 container start 1309ffc459f9768d149c0e6d3975120f388dce3366f4c6e3e5aab8992941f893 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD) 2024-02-19T19:11:48.454 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:48 smithi125 ceph-osd[100606]: -- 172.21.15.125:0/2485460675 <== mon.1 v2:172.21.15.125:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f4b08071e0 con 0x55f4b07d8c00 2024-02-19T19:11:48.454 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:48 smithi125 bash[100587]: 1309ffc459f9768d149c0e6d3975120f388dce3366f4c6e3e5aab8992941f893 2024-02-19T19:11:48.454 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:48 smithi125 systemd[1]: Started Ceph osd.4 for 06580d2c-cf58-11ee-95bb-87774f69a715. 2024-02-19T19:11:48.953 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:48 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4[100602]: 2024-02-19T19:11:48.588+0000 7fadb24107c0 -1 Falling back to public interface 2024-02-19T19:11:49.453 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:49.453 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:49.453 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:11:49.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:49.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:49.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:11:50.503 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:50 smithi125 ceph-mon[86115]: pgmap v137: 65 pgs: 31 active+undersized+degraded, 3 active+undersized, 31 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 1.7 KiB/s wr, 3 op/s; 5972/32076 objects degraded (18.618%) 2024-02-19T19:11:50.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:50 smithi096 ceph-mon[112483]: pgmap v137: 65 pgs: 31 active+undersized+degraded, 3 active+undersized, 31 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 1.7 KiB/s wr, 3 op/s; 5972/32076 objects degraded (18.618%) 2024-02-19T19:11:51.523 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:51 smithi125 ceph-mon[86115]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-19T19:11:51.524 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:51.524 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:11:51.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:51 smithi096 ceph-mon[112483]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-19T19:11:51.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:51.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:11:52.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:52 smithi125 ceph-mon[86115]: pgmap v138: 65 pgs: 31 active+undersized+degraded, 3 active+undersized, 31 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s; 5972/32076 objects degraded (18.618%) 2024-02-19T19:11:52.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:52 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:52.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:52 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:52.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:52 smithi125 ceph-mon[86115]: Health check update: Degraded data redundancy: 5972/32076 objects degraded (18.618%), 31 pgs degraded (PG_DEGRADED) 2024-02-19T19:11:52.705 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:52 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4[100602]: 2024-02-19T19:11:52.425+0000 7fadb24107c0 -1 osd.4 0 read_superblock omap replica is missing. 2024-02-19T19:11:52.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:52 smithi096 ceph-mon[112483]: pgmap v138: 65 pgs: 31 active+undersized+degraded, 3 active+undersized, 31 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s; 5972/32076 objects degraded (18.618%) 2024-02-19T19:11:52.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:52 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:52.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:52 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:52.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:52 smithi096 ceph-mon[112483]: Health check update: Degraded data redundancy: 5972/32076 objects degraded (18.618%), 31 pgs degraded (PG_DEGRADED) 2024-02-19T19:11:53.203 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:52 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4[100602]: 2024-02-19T19:11:52.747+0000 7fadb24107c0 -1 osd.4 69 log_to_monitors true 2024-02-19T19:11:53.665 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:53 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:53.665 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:53 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:53.665 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:53 smithi125 ceph-mon[86115]: from='osd.4 [v2:172.21.15.125:6808/3490195923,v1:172.21.15.125:6809/3490195923]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T19:11:53.665 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:53 smithi125 ceph-mon[86115]: pgmap v139: 65 pgs: 31 active+undersized+degraded, 3 active+undersized, 31 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s; 5972/32076 objects degraded (18.618%) 2024-02-19T19:11:54.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:53 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:54.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:53 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:54.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:53 smithi096 ceph-mon[112483]: from='osd.4 [v2:172.21.15.125:6808/3490195923,v1:172.21.15.125:6809/3490195923]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-19T19:11:54.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:53 smithi096 ceph-mon[112483]: pgmap v139: 65 pgs: 31 active+undersized+degraded, 3 active+undersized, 31 active+clean; 128 MiB data, 680 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s; 5972/32076 objects degraded (18.618%) 2024-02-19T19:11:54.935 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:54 smithi125 ceph-mon[86115]: from='osd.4 [v2:172.21.15.125:6808/3490195923,v1:172.21.15.125:6809/3490195923]' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-19T19:11:54.935 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:54 smithi125 ceph-mon[86115]: osdmap e72: 6 total, 5 up, 6 in 2024-02-19T19:11:54.935 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:54 smithi125 ceph-mon[86115]: from='osd.4 [v2:172.21.15.125:6808/3490195923,v1:172.21.15.125:6809/3490195923]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2024-02-19T19:11:54.936 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 19:11:54 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4[100602]: 2024-02-19T19:11:54.668+0000 7fad9f860700 -1 osd.4 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T19:11:55.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:54 smithi096 ceph-mon[112483]: from='osd.4 [v2:172.21.15.125:6808/3490195923,v1:172.21.15.125:6809/3490195923]' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-19T19:11:55.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:54 smithi096 ceph-mon[112483]: osdmap e72: 6 total, 5 up, 6 in 2024-02-19T19:11:55.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:54 smithi096 ceph-mon[112483]: from='osd.4 [v2:172.21.15.125:6808/3490195923,v1:172.21.15.125:6809/3490195923]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2024-02-19T19:11:55.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:55 smithi125 ceph-mon[86115]: from='osd.4 [v2:172.21.15.125:6808/3490195923,v1:172.21.15.125:6809/3490195923]' entity='osd.4' 2024-02-19T19:11:55.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:55 smithi125 ceph-mon[86115]: pgmap v141: 65 pgs: 31 active+undersized+degraded, 3 active+undersized, 31 active+clean; 128 MiB data, 686 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 818 B/s wr, 3 op/s; 5972/32076 objects degraded (18.618%) 2024-02-19T19:11:56.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:55 smithi096 ceph-mon[112483]: from='osd.4 [v2:172.21.15.125:6808/3490195923,v1:172.21.15.125:6809/3490195923]' entity='osd.4' 2024-02-19T19:11:56.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:55 smithi096 ceph-mon[112483]: pgmap v141: 65 pgs: 31 active+undersized+degraded, 3 active+undersized, 31 active+clean; 128 MiB data, 686 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 818 B/s wr, 3 op/s; 5972/32076 objects degraded (18.618%) 2024-02-19T19:11:56.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:56 smithi096 ceph-mon[112483]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:11:56.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:56 smithi096 ceph-mon[112483]: osd.4 [v2:172.21.15.125:6808/3490195923,v1:172.21.15.125:6809/3490195923] boot 2024-02-19T19:11:56.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:56 smithi096 ceph-mon[112483]: osdmap e73: 6 total, 6 up, 6 in 2024-02-19T19:11:56.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:56 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:11:56.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:56 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:56.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:56 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:56.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:56 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:11:56.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:56 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:11:56.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:56 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:56.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:56 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:11:56.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:56 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:56.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:56 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:56.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:56 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:56.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:56 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-19T19:11:56.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:56 smithi125 ceph-mon[86115]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:11:56.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:56 smithi125 ceph-mon[86115]: osd.4 [v2:172.21.15.125:6808/3490195923,v1:172.21.15.125:6809/3490195923] boot 2024-02-19T19:11:56.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:56 smithi125 ceph-mon[86115]: osdmap e73: 6 total, 6 up, 6 in 2024-02-19T19:11:56.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:56 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-19T19:11:56.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:56 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:56.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:56 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:56.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:56 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:11:56.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:56 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:11:56.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:56 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:11:56.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:56 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:11:56.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:56 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:56.955 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:56 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:56.955 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:56 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:11:56.955 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:56 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-19T19:11:58.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:57 smithi096 ceph-mon[112483]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-19T19:11:58.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:57 smithi096 ceph-mon[112483]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-19T19:11:58.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:57 smithi096 ceph-mon[112483]: osdmap e74: 6 total, 6 up, 6 in 2024-02-19T19:11:58.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:57 smithi096 ceph-mon[112483]: pgmap v144: 65 pgs: 4 peering, 27 active+undersized+degraded, 3 active+undersized, 31 active+clean; 128 MiB data, 686 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 5045/32076 objects degraded (15.728%) 2024-02-19T19:11:58.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:57 smithi125 ceph-mon[86115]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-19T19:11:58.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:57 smithi125 ceph-mon[86115]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-02-19T19:11:58.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:57 smithi125 ceph-mon[86115]: osdmap e74: 6 total, 6 up, 6 in 2024-02-19T19:11:58.204 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:57 smithi125 ceph-mon[86115]: pgmap v144: 65 pgs: 4 peering, 27 active+undersized+degraded, 3 active+undersized, 31 active+clean; 128 MiB data, 686 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 5045/32076 objects degraded (15.728%) 2024-02-19T19:11:59.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:58 smithi096 ceph-mon[112483]: Health check update: Degraded data redundancy: 5045/32076 objects degraded (15.728%), 27 pgs degraded (PG_DEGRADED) 2024-02-19T19:11:59.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:58 smithi125 ceph-mon[86115]: Health check update: Degraded data redundancy: 5045/32076 objects degraded (15.728%), 27 pgs degraded (PG_DEGRADED) 2024-02-19T19:11:59.563 INFO:tasks.workunit.client.1.smithi125.stderr:Note: switching to '1ce7ea8877c709fa862eac608550374bd96e166e'. 2024-02-19T19:11:59.563 INFO:tasks.workunit.client.1.smithi125.stderr: 2024-02-19T19:11:59.563 INFO:tasks.workunit.client.1.smithi125.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-19T19:11:59.563 INFO:tasks.workunit.client.1.smithi125.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-19T19:11:59.564 INFO:tasks.workunit.client.1.smithi125.stderr:state without impacting any branches by switching back to a branch. 2024-02-19T19:11:59.564 INFO:tasks.workunit.client.1.smithi125.stderr: 2024-02-19T19:11:59.564 INFO:tasks.workunit.client.1.smithi125.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-19T19:11:59.564 INFO:tasks.workunit.client.1.smithi125.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-19T19:11:59.564 INFO:tasks.workunit.client.1.smithi125.stderr: 2024-02-19T19:11:59.564 INFO:tasks.workunit.client.1.smithi125.stderr: git switch -c 2024-02-19T19:11:59.564 INFO:tasks.workunit.client.1.smithi125.stderr: 2024-02-19T19:11:59.564 INFO:tasks.workunit.client.1.smithi125.stderr:Or undo this operation with: 2024-02-19T19:11:59.564 INFO:tasks.workunit.client.1.smithi125.stderr: 2024-02-19T19:11:59.565 INFO:tasks.workunit.client.1.smithi125.stderr: git switch - 2024-02-19T19:11:59.565 INFO:tasks.workunit.client.1.smithi125.stderr: 2024-02-19T19:11:59.565 INFO:tasks.workunit.client.1.smithi125.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-19T19:11:59.565 INFO:tasks.workunit.client.1.smithi125.stderr: 2024-02-19T19:11:59.565 INFO:tasks.workunit.client.1.smithi125.stderr:HEAD is now at 1ce7ea8877c fix 2024-02-19T19:11:59.569 DEBUG:teuthology.orchestra.run.smithi125:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-02-19T19:11:59.594 INFO:tasks.workunit.client.1.smithi125.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-19T19:11:59.596 INFO:tasks.workunit.client.1.smithi125.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-19T19:11:59.596 INFO:tasks.workunit.client.1.smithi125.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-19T19:11:59.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:11:59 smithi125 ceph-mon[86115]: pgmap v145: 65 pgs: 4 peering, 6 active+undersized+degraded, 1 active+undersized, 54 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 3.0 KiB/s rd, 1023 B/s wr, 5 op/s; 989/32076 objects degraded (3.083%); 14 B/s, 0 objects/s recovering 2024-02-19T19:12:00.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:11:59 smithi096 ceph-mon[112483]: pgmap v145: 65 pgs: 4 peering, 6 active+undersized+degraded, 1 active+undersized, 54 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 3.0 KiB/s rd, 1023 B/s wr, 5 op/s; 989/32076 objects degraded (3.083%); 14 B/s, 0 objects/s recovering 2024-02-19T19:12:00.479 INFO:tasks.workunit.client.1.smithi125.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-19T19:12:00.543 INFO:tasks.workunit.client.1.smithi125.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-19T19:12:00.584 INFO:tasks.workunit.client.1.smithi125.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-19T19:12:00.586 INFO:tasks.workunit.client.1.smithi125.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-19T19:12:00.586 INFO:tasks.workunit.client.1.smithi125.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-19T19:12:00.625 INFO:tasks.workunit.client.1.smithi125.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-19T19:12:00.628 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2024-02-19T19:12:00.628 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-02-19T19:12:00.684 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-02-19T19:12:00.685 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-19T19:12:00.686 DEBUG:teuthology.orchestra.run.smithi125:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1ce7ea8877c709fa862eac608550374bd96e166e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-02-19T19:12:00.742 INFO:tasks.workunit.client.1.smithi125.stderr:+ mkdir -p fsstress 2024-02-19T19:12:00.743 INFO:tasks.workunit.client.1.smithi125.stderr:+ pushd fsstress 2024-02-19T19:12:00.743 INFO:tasks.workunit.client.1.smithi125.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-19T19:12:00.744 INFO:tasks.workunit.client.1.smithi125.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-19T19:12:01.718 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:01 smithi125 ceph-mon[86115]: pgmap v146: 65 pgs: 4 peering, 61 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 800 B/s wr, 4 op/s; 11 B/s, 0 objects/s recovering 2024-02-19T19:12:01.718 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:01 smithi125 ceph-mon[86115]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 989/32076 objects degraded (3.083%), 6 pgs degraded) 2024-02-19T19:12:01.724 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:01 smithi096 ceph-mon[112483]: pgmap v146: 65 pgs: 4 peering, 61 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 800 B/s wr, 4 op/s; 11 B/s, 0 objects/s recovering 2024-02-19T19:12:01.724 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:01 smithi096 ceph-mon[112483]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 989/32076 objects degraded (3.083%), 6 pgs degraded) 2024-02-19T19:12:02.241 INFO:tasks.workunit.client.1.smithi125.stderr:+ tar xzf ltp-full.tgz 2024-02-19T19:12:02.605 INFO:tasks.workunit.client.1.smithi125.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-19T19:12:02.605 INFO:tasks.workunit.client.1.smithi125.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-19T19:12:02.606 INFO:tasks.workunit.client.1.smithi125.stderr:+ make 2024-02-19T19:12:02.607 INFO:tasks.workunit.client.1.smithi125.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-19T19:12:02.778 INFO:tasks.workunit.client.1.smithi125.stderr:++ readlink -f fsstress 2024-02-19T19:12:02.779 INFO:tasks.workunit.client.1.smithi125.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-19T19:12:02.779 INFO:tasks.workunit.client.1.smithi125.stderr:+ popd 2024-02-19T19:12:02.779 INFO:tasks.workunit.client.1.smithi125.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-19T19:12:02.780 INFO:tasks.workunit.client.1.smithi125.stderr:+ popd 2024-02-19T19:12:02.780 INFO:tasks.workunit.client.1.smithi125.stdout:~/cephtest/mnt.1/client.1/tmp 2024-02-19T19:12:02.781 INFO:tasks.workunit.client.1.smithi125.stderr:++ mktemp -d -p . 2024-02-19T19:12:02.781 INFO:tasks.workunit.client.1.smithi125.stderr:+ T=./tmp.b5cgBkzP6r 2024-02-19T19:12:02.781 INFO:tasks.workunit.client.1.smithi125.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.b5cgBkzP6r -l 1 -n 1000 -p 10 -v 2024-02-19T19:12:02.787 INFO:tasks.workunit.client.1.smithi125.stdout:seed = 1708670609 2024-02-19T19:12:02.788 INFO:tasks.workunit.client.1.smithi125.stdout:0/0: creat f0 x:0 0 0 2024-02-19T19:12:02.788 INFO:tasks.workunit.client.1.smithi125.stdout:1/0: dwrite - no filename 2024-02-19T19:12:02.788 INFO:tasks.workunit.client.1.smithi125.stdout:1/1: truncate - no filename 2024-02-19T19:12:02.788 INFO:tasks.workunit.client.1.smithi125.stdout:1/2: chown . 27781 1 2024-02-19T19:12:02.788 INFO:tasks.workunit.client.1.smithi125.stdout:0/1: write f0 [594683,15078] 0 2024-02-19T19:12:02.788 INFO:tasks.workunit.client.1.smithi125.stdout:1/3: creat f0 x:0 0 0 2024-02-19T19:12:02.788 INFO:tasks.workunit.client.1.smithi125.stdout:1/4: chown f0 49845 1 2024-02-19T19:12:02.788 INFO:tasks.workunit.client.1.smithi125.stdout:3/0: readlink - no filename 2024-02-19T19:12:02.789 INFO:tasks.workunit.client.1.smithi125.stdout:0/2: read f0 [23026,92793] 0 2024-02-19T19:12:02.789 INFO:tasks.workunit.client.1.smithi125.stdout:0/3: dread f0 [311296,94208] 0 2024-02-19T19:12:02.789 INFO:tasks.workunit.client.1.smithi125.stdout:3/1: mkdir d0 0 2024-02-19T19:12:02.789 INFO:tasks.workunit.client.1.smithi125.stdout:0/4: dread f0 [77824,94208] 0 2024-02-19T19:12:02.789 INFO:tasks.workunit.client.1.smithi125.stdout:2/0: mknod c0 0 2024-02-19T19:12:02.789 INFO:tasks.workunit.client.1.smithi125.stdout:0/5: dread f0 [270336,69632] 0 2024-02-19T19:12:02.789 INFO:tasks.workunit.client.1.smithi125.stdout:2/1: dread - no filename 2024-02-19T19:12:02.789 INFO:tasks.workunit.client.1.smithi125.stdout:3/2: mkdir d0/d1 0 2024-02-19T19:12:02.790 INFO:tasks.workunit.client.1.smithi125.stdout:0/6: rename f0 to f1 0 2024-02-19T19:12:02.790 INFO:tasks.workunit.client.1.smithi125.stdout:3/3: chown d0 2876 1 2024-02-19T19:12:02.790 INFO:tasks.workunit.client.1.smithi125.stdout:3/4: dwrite - no filename 2024-02-19T19:12:02.790 INFO:tasks.workunit.client.1.smithi125.stdout:4/0: mkdir d0 0 2024-02-19T19:12:02.790 INFO:tasks.workunit.client.1.smithi125.stdout:5/0: truncate - no filename 2024-02-19T19:12:02.790 INFO:tasks.workunit.client.1.smithi125.stdout:5/1: dread - no filename 2024-02-19T19:12:02.790 INFO:tasks.workunit.client.1.smithi125.stdout:4/1: dread - no filename 2024-02-19T19:12:02.790 INFO:tasks.workunit.client.1.smithi125.stdout:4/2: link - no file 2024-02-19T19:12:02.791 INFO:tasks.workunit.client.1.smithi125.stdout:3/5: stat d0 0 2024-02-19T19:12:02.791 INFO:tasks.workunit.client.1.smithi125.stdout:3/6: dread - no filename 2024-02-19T19:12:02.791 INFO:tasks.workunit.client.1.smithi125.stdout:3/7: fdatasync - no filename 2024-02-19T19:12:02.791 INFO:tasks.workunit.client.1.smithi125.stdout:0/7: dread f1 [180224,81920] 0 2024-02-19T19:12:02.791 INFO:tasks.workunit.client.1.smithi125.stdout:5/2: chown . 694952910 1 2024-02-19T19:12:02.791 INFO:tasks.workunit.client.1.smithi125.stdout:2/2: mkdir d1 0 2024-02-19T19:12:02.791 INFO:tasks.workunit.client.1.smithi125.stdout:4/3: mknod d0/c1 0 2024-02-19T19:12:02.791 INFO:tasks.workunit.client.1.smithi125.stdout:4/4: truncate - no filename 2024-02-19T19:12:02.791 INFO:tasks.workunit.client.1.smithi125.stdout:0/8: creat f2 x:0 0 0 2024-02-19T19:12:02.792 INFO:tasks.workunit.client.1.smithi125.stdout:0/9: dread - f2 zero size 2024-02-19T19:12:02.792 INFO:tasks.workunit.client.1.smithi125.stdout:3/8: symlink d0/d1/l2 0 2024-02-19T19:12:02.792 INFO:tasks.workunit.client.1.smithi125.stdout:2/3: creat d1/f2 x:0 0 0 2024-02-19T19:12:02.792 INFO:tasks.workunit.client.1.smithi125.stdout:5/3: symlink l0 0 2024-02-19T19:12:02.792 INFO:tasks.workunit.client.1.smithi125.stdout:4/5: mkdir d0/d2 0 2024-02-19T19:12:02.792 INFO:tasks.workunit.client.1.smithi125.stdout:4/6: link d0/c1 d0/c3 0 2024-02-19T19:12:02.792 INFO:tasks.workunit.client.1.smithi125.stdout:0/10: read f1 [392970,58877] 0 2024-02-19T19:12:02.792 INFO:tasks.workunit.client.1.smithi125.stdout:5/4: creat f1 x:0 0 0 2024-02-19T19:12:02.793 INFO:tasks.workunit.client.1.smithi125.stdout:3/9: unlink d0/d1/l2 0 2024-02-19T19:12:02.793 INFO:tasks.workunit.client.1.smithi125.stdout:3/10: dwrite - no filename 2024-02-19T19:12:02.793 INFO:tasks.workunit.client.1.smithi125.stdout:0/11: read - f2 zero size 2024-02-19T19:12:02.793 INFO:tasks.workunit.client.1.smithi125.stdout:5/5: read - f1 zero size 2024-02-19T19:12:02.793 INFO:tasks.workunit.client.1.smithi125.stdout:6/0: creat f0 x:0 0 0 2024-02-19T19:12:02.794 INFO:tasks.workunit.client.1.smithi125.stdout:4/7: mkdir d0/d4 0 2024-02-19T19:12:02.794 INFO:tasks.workunit.client.1.smithi125.stdout:6/1: dread - f0 zero size 2024-02-19T19:12:02.794 INFO:tasks.workunit.client.1.smithi125.stdout:4/8: rename d0/c3 to d0/d2/c5 0 2024-02-19T19:12:02.794 INFO:tasks.workunit.client.1.smithi125.stdout:2/4: write d1/f2 [699193,35820] 0 2024-02-19T19:12:02.794 INFO:tasks.workunit.client.1.smithi125.stdout:2/5: dread d1/f2 [290816,73728] 0 2024-02-19T19:12:02.794 INFO:tasks.workunit.client.1.smithi125.stdout:2/6: dread d1/f2 [475136,4096] 0 2024-02-19T19:12:02.794 INFO:tasks.workunit.client.1.smithi125.stdout:2/7: read d1/f2 [514445,23050] 0 2024-02-19T19:12:02.794 INFO:tasks.workunit.client.1.smithi125.stdout:6/2: write f0 [917419,112722] 0 2024-02-19T19:12:02.795 INFO:tasks.workunit.client.1.smithi125.stdout:1/5: dwrite f0 [921600,61440] 0 2024-02-19T19:12:02.795 INFO:tasks.workunit.client.1.smithi125.stdout:5/6: dwrite f1 [512000,40960] 0 2024-02-19T19:12:02.795 INFO:tasks.workunit.client.1.smithi125.stdout:5/7: dread f1 [348160,126976] 0 2024-02-19T19:12:02.795 INFO:tasks.workunit.client.1.smithi125.stdout:2/8: dwrite d1/f2 [790528,24576] 0 2024-02-19T19:12:02.795 INFO:tasks.workunit.client.1.smithi125.stdout:1/6: dwrite f0 [495616,126976] 0 2024-02-19T19:12:02.795 INFO:tasks.workunit.client.1.smithi125.stdout:4/9: creat d0/d2/f6 x:0 0 0 2024-02-19T19:12:02.795 INFO:tasks.workunit.client.1.smithi125.stdout:1/7: mkdir d1 0 2024-02-19T19:12:02.795 INFO:tasks.workunit.client.1.smithi125.stdout:5/8: symlink l2 0 2024-02-19T19:12:02.796 INFO:tasks.workunit.client.1.smithi125.stdout:2/9: mkdir d1/d3 0 2024-02-19T19:12:02.796 INFO:tasks.workunit.client.1.smithi125.stdout:1/8: readlink - no filename 2024-02-19T19:12:02.796 INFO:tasks.workunit.client.1.smithi125.stdout:3/11: symlink d0/l3 0 2024-02-19T19:12:02.796 INFO:tasks.workunit.client.1.smithi125.stdout:3/12: stat d0/d1 0 2024-02-19T19:12:02.796 INFO:tasks.workunit.client.1.smithi125.stdout:5/9: link f1 f3 0 2024-02-19T19:12:02.796 INFO:tasks.workunit.client.1.smithi125.stdout:5/10: chown l2 96 1 2024-02-19T19:12:02.796 INFO:tasks.workunit.client.1.smithi125.stdout:5/11: truncate f1 1036366 0 2024-02-19T19:12:02.796 INFO:tasks.workunit.client.1.smithi125.stdout:3/13: mknod d0/c4 0 2024-02-19T19:12:02.796 INFO:tasks.workunit.client.1.smithi125.stdout:3/14: dwrite - no filename 2024-02-19T19:12:02.797 INFO:tasks.workunit.client.1.smithi125.stdout:3/15: stat d0/l3 0 2024-02-19T19:12:02.797 INFO:tasks.workunit.client.1.smithi125.stdout:6/3: symlink l1 0 2024-02-19T19:12:02.797 INFO:tasks.workunit.client.1.smithi125.stdout:3/16: unlink d0/c4 0 2024-02-19T19:12:02.797 INFO:tasks.workunit.client.1.smithi125.stdout:7/0: dread - no filename 2024-02-19T19:12:02.797 INFO:tasks.workunit.client.1.smithi125.stdout:3/17: read - no filename 2024-02-19T19:12:02.797 INFO:tasks.workunit.client.1.smithi125.stdout:5/12: write f3 [1830149,25149] 0 2024-02-19T19:12:02.797 INFO:tasks.workunit.client.1.smithi125.stdout:3/18: rename d0 to d0/d1/d5 22 2024-02-19T19:12:02.797 INFO:tasks.workunit.client.1.smithi125.stdout:3/19: dwrite - no filename 2024-02-19T19:12:02.798 INFO:tasks.workunit.client.1.smithi125.stdout:7/1: chown . 3 1 2024-02-19T19:12:02.798 INFO:tasks.workunit.client.1.smithi125.stdout:3/20: dread - no filename 2024-02-19T19:12:02.798 INFO:tasks.workunit.client.1.smithi125.stdout:7/2: chown . 651563033 1 2024-02-19T19:12:02.798 INFO:tasks.workunit.client.1.smithi125.stdout:7/3: truncate - no filename 2024-02-19T19:12:02.798 INFO:tasks.workunit.client.1.smithi125.stdout:3/21: rename d0 to d0/d6 22 2024-02-19T19:12:02.798 INFO:tasks.workunit.client.1.smithi125.stdout:3/22: dread - no filename 2024-02-19T19:12:02.798 INFO:tasks.workunit.client.1.smithi125.stdout:5/13: symlink l4 0 2024-02-19T19:12:02.799 INFO:tasks.workunit.client.1.smithi125.stdout:3/23: creat d0/f7 x:0 0 0 2024-02-19T19:12:02.799 INFO:tasks.workunit.client.1.smithi125.stdout:7/4: symlink l0 0 2024-02-19T19:12:02.799 INFO:tasks.workunit.client.1.smithi125.stdout:5/14: truncate f3 615295 0 2024-02-19T19:12:02.799 INFO:tasks.workunit.client.1.smithi125.stdout:7/5: dwrite - no filename 2024-02-19T19:12:02.799 INFO:tasks.workunit.client.1.smithi125.stdout:9/0: dread - no filename 2024-02-19T19:12:02.799 INFO:tasks.workunit.client.1.smithi125.stdout:9/1: unlink - no file 2024-02-19T19:12:02.799 INFO:tasks.workunit.client.1.smithi125.stdout:9/2: rmdir - no directory 2024-02-19T19:12:02.799 INFO:tasks.workunit.client.1.smithi125.stdout:9/3: write - no filename 2024-02-19T19:12:02.799 INFO:tasks.workunit.client.1.smithi125.stdout:9/4: stat - no entries 2024-02-19T19:12:02.800 INFO:tasks.workunit.client.1.smithi125.stdout:9/5: write - no filename 2024-02-19T19:12:02.800 INFO:tasks.workunit.client.1.smithi125.stdout:9/6: read - no filename 2024-02-19T19:12:02.800 INFO:tasks.workunit.client.1.smithi125.stdout:9/7: link - no file 2024-02-19T19:12:02.800 INFO:tasks.workunit.client.1.smithi125.stdout:7/6: creat f1 x:0 0 0 2024-02-19T19:12:02.800 INFO:tasks.workunit.client.1.smithi125.stdout:5/15: dread f1 [61440,86016] 0 2024-02-19T19:12:02.800 INFO:tasks.workunit.client.1.smithi125.stdout:7/7: truncate f1 453300 0 2024-02-19T19:12:02.800 INFO:tasks.workunit.client.1.smithi125.stdout:9/8: creat f0 x:0 0 0 2024-02-19T19:12:02.800 INFO:tasks.workunit.client.1.smithi125.stdout:7/8: dread f1 [36864,28672] 0 2024-02-19T19:12:02.801 INFO:tasks.workunit.client.1.smithi125.stdout:7/9: chown l0 320 1 2024-02-19T19:12:02.801 INFO:tasks.workunit.client.1.smithi125.stdout:5/16: write f3 [1410324,73654] 0 2024-02-19T19:12:02.801 INFO:tasks.workunit.client.1.smithi125.stdout:7/10: creat f2 x:0 0 0 2024-02-19T19:12:02.801 INFO:tasks.workunit.client.1.smithi125.stdout:8/0: symlink l0 0 2024-02-19T19:12:02.801 INFO:tasks.workunit.client.1.smithi125.stdout:4/10: read - d0/d2/f6 zero size 2024-02-19T19:12:02.801 INFO:tasks.workunit.client.1.smithi125.stdout:4/11: chown d0/c1 15795521 1 2024-02-19T19:12:02.801 INFO:tasks.workunit.client.1.smithi125.stdout:8/1: rename l0 to l1 0 2024-02-19T19:12:02.801 INFO:tasks.workunit.client.1.smithi125.stdout:5/17: symlink l5 0 2024-02-19T19:12:02.801 INFO:tasks.workunit.client.1.smithi125.stdout:8/2: write - no filename 2024-02-19T19:12:02.802 INFO:tasks.workunit.client.1.smithi125.stdout:5/18: dread f1 [126976,69632] 0 2024-02-19T19:12:02.802 INFO:tasks.workunit.client.1.smithi125.stdout:4/12: rename d0/d2 to d0/d7 0 2024-02-19T19:12:02.802 INFO:tasks.workunit.client.1.smithi125.stdout:5/19: unlink f3 0 2024-02-19T19:12:02.802 INFO:tasks.workunit.client.1.smithi125.stdout:4/13: truncate d0/d7/f6 318216 0 2024-02-19T19:12:02.802 INFO:tasks.workunit.client.1.smithi125.stdout:5/20: write f1 [192164,439] 0 2024-02-19T19:12:02.802 INFO:tasks.workunit.client.1.smithi125.stdout:8/3: symlink l2 0 2024-02-19T19:12:02.802 INFO:tasks.workunit.client.1.smithi125.stdout:4/14: dread d0/d7/f6 [61440,32768] 0 2024-02-19T19:12:02.802 INFO:tasks.workunit.client.1.smithi125.stdout:4/15: write d0/d7/f6 [926328,64763] 0 2024-02-19T19:12:02.803 INFO:tasks.workunit.client.1.smithi125.stdout:4/16: symlink d0/d7/l8 0 2024-02-19T19:12:02.803 INFO:tasks.workunit.client.1.smithi125.stdout:4/17: creat d0/d4/f9 x:0 0 0 2024-02-19T19:12:02.803 INFO:tasks.workunit.client.1.smithi125.stdout:4/18: stat d0/d7/l8 0 2024-02-19T19:12:02.803 INFO:tasks.workunit.client.1.smithi125.stdout:4/19: dread - d0/d4/f9 zero size 2024-02-19T19:12:02.803 INFO:tasks.workunit.client.1.smithi125.stdout:4/20: getdents d0/d7 0 2024-02-19T19:12:02.803 INFO:tasks.workunit.client.1.smithi125.stdout:4/21: rename d0/d7/f6 to d0/fa 0 2024-02-19T19:12:02.803 INFO:tasks.workunit.client.1.smithi125.stdout:4/22: chown d0/fa 6942 1 2024-02-19T19:12:02.803 INFO:tasks.workunit.client.1.smithi125.stdout:4/23: rename d0/d7/c5 to d0/d7/cb 0 2024-02-19T19:12:02.804 INFO:tasks.workunit.client.1.smithi125.stdout:4/24: rename d0/d4 to d0/d7/dc 0 2024-02-19T19:12:02.804 INFO:tasks.workunit.client.1.smithi125.stdout:4/25: stat d0/d7/cb 0 2024-02-19T19:12:02.804 INFO:tasks.workunit.client.1.smithi125.stdout:4/26: write d0/d7/dc/f9 [760322,50897] 0 2024-02-19T19:12:02.804 INFO:tasks.workunit.client.1.smithi125.stdout:4/27: write d0/d7/dc/f9 [465975,74589] 0 2024-02-19T19:12:02.804 INFO:tasks.workunit.client.1.smithi125.stdout:4/28: creat d0/d7/dc/fd x:0 0 0 2024-02-19T19:12:02.804 INFO:tasks.workunit.client.1.smithi125.stdout:4/29: mknod d0/d7/ce 0 2024-02-19T19:12:02.804 INFO:tasks.workunit.client.1.smithi125.stdout:4/30: mkdir d0/df 0 2024-02-19T19:12:02.806 INFO:tasks.workunit.client.1.smithi125.stdout:1/9: dwrite f0 [524288,45056] 0 2024-02-19T19:12:02.806 INFO:tasks.workunit.client.1.smithi125.stdout:6/4: dwrite f0 [1622016,53248] 0 2024-02-19T19:12:02.806 INFO:tasks.workunit.client.1.smithi125.stdout:6/5: symlink l2 0 2024-02-19T19:12:02.806 INFO:tasks.workunit.client.1.smithi125.stdout:9/9: dwrite f0 [995328,8192] 0 2024-02-19T19:12:02.806 INFO:tasks.workunit.client.1.smithi125.stdout:9/10: chown f0 4393862 1 2024-02-19T19:12:02.806 INFO:tasks.workunit.client.1.smithi125.stdout:9/11: creat f1 x:0 0 0 2024-02-19T19:12:02.807 INFO:tasks.workunit.client.1.smithi125.stdout:9/12: creat f2 x:0 0 0 2024-02-19T19:12:02.807 INFO:tasks.workunit.client.1.smithi125.stdout:5/21: dwrite f1 [1507328,49152] 0 2024-02-19T19:12:02.807 INFO:tasks.workunit.client.1.smithi125.stdout:5/22: chown l4 1581987 1 2024-02-19T19:12:02.807 INFO:tasks.workunit.client.1.smithi125.stdout:5/23: write f1 [594948,120159] 0 2024-02-19T19:12:02.807 INFO:tasks.workunit.client.1.smithi125.stdout:5/24: creat f6 x:0 0 0 2024-02-19T19:12:02.807 INFO:tasks.workunit.client.1.smithi125.stdout:5/25: chown l4 1692025 1 2024-02-19T19:12:02.808 INFO:tasks.workunit.client.1.smithi125.stdout:7/11: dwrite f2 [446464,45056] 0 2024-02-19T19:12:02.809 INFO:tasks.workunit.client.1.smithi125.stdout:1/10: dwrite f0 [40960,45056] 0 2024-02-19T19:12:02.810 INFO:tasks.workunit.client.1.smithi125.stdout:1/11: stat d1 0 2024-02-19T19:12:02.810 INFO:tasks.workunit.client.1.smithi125.stdout:1/12: dread f0 [303104,86016] 0 2024-02-19T19:12:02.810 INFO:tasks.workunit.client.1.smithi125.stdout:1/13: mknod d1/c2 0 2024-02-19T19:12:02.810 INFO:tasks.workunit.client.1.smithi125.stdout:1/14: symlink d1/l3 0 2024-02-19T19:12:02.810 INFO:tasks.workunit.client.1.smithi125.stdout:1/15: truncate f0 139546 0 2024-02-19T19:12:02.810 INFO:tasks.workunit.client.1.smithi125.stdout:9/13: dwrite f1 [974848,94208] 0 2024-02-19T19:12:02.810 INFO:tasks.workunit.client.1.smithi125.stdout:9/14: rename f0 to f3 0 2024-02-19T19:12:02.810 INFO:tasks.workunit.client.1.smithi125.stdout:5/26: dwrite f6 [540672,12288] 0 2024-02-19T19:12:02.811 INFO:tasks.workunit.client.1.smithi125.stdout:5/27: symlink l7 0 2024-02-19T19:12:02.811 INFO:tasks.workunit.client.1.smithi125.stdout:5/28: mknod c8 0 2024-02-19T19:12:02.811 INFO:tasks.workunit.client.1.smithi125.stdout:5/29: mknod c9 0 2024-02-19T19:12:02.811 INFO:tasks.workunit.client.1.smithi125.stdout:5/30: creat fa x:0 0 0 2024-02-19T19:12:02.811 INFO:tasks.workunit.client.1.smithi125.stdout:5/31: dread - fa zero size 2024-02-19T19:12:02.811 INFO:tasks.workunit.client.1.smithi125.stdout:7/12: dwrite f1 [999424,16384] 0 2024-02-19T19:12:02.811 INFO:tasks.workunit.client.1.smithi125.stdout:7/13: getdents . 0 2024-02-19T19:12:02.811 INFO:tasks.workunit.client.1.smithi125.stdout:7/14: creat f3 x:0 0 0 2024-02-19T19:12:02.812 INFO:tasks.workunit.client.1.smithi125.stdout:7/15: readlink l0 0 2024-02-19T19:12:03.319 INFO:tasks.workunit.client.1.smithi125.stdout:0/12: fsync f2 0 2024-02-19T19:12:03.323 INFO:tasks.workunit.client.1.smithi125.stdout:0/13: rename f1 to f3 0 2024-02-19T19:12:03.323 INFO:tasks.workunit.client.1.smithi125.stdout:0/14: rename f3 to f4 0 2024-02-19T19:12:03.380 INFO:tasks.workunit.client.1.smithi125.stdout:0/15: mkdir d5 0 2024-02-19T19:12:03.380 INFO:tasks.workunit.client.1.smithi125.stdout:0/16: truncate f4 77404 0 2024-02-19T19:12:03.380 INFO:tasks.workunit.client.1.smithi125.stdout:0/17: mknod d5/c6 0 2024-02-19T19:12:03.380 INFO:tasks.workunit.client.1.smithi125.stdout:0/18: write f2 [115539,22864] 0 2024-02-19T19:12:03.381 INFO:tasks.workunit.client.1.smithi125.stdout:0/19: rmdir d5 39 2024-02-19T19:12:03.381 INFO:tasks.workunit.client.1.smithi125.stdout:0/20: chown f2 320840 1 2024-02-19T19:12:03.381 INFO:tasks.workunit.client.1.smithi125.stdout:0/21: symlink d5/l7 0 2024-02-19T19:12:03.381 INFO:tasks.workunit.client.1.smithi125.stdout:0/22: dread f4 [20480,20480] 0 2024-02-19T19:12:03.381 INFO:tasks.workunit.client.1.smithi125.stdout:0/23: write f2 [300601,62924] 0 2024-02-19T19:12:03.614 INFO:tasks.workunit.client.1.smithi125.stdout:3/24: fsync d0/f7 0 2024-02-19T19:12:03.614 INFO:tasks.workunit.client.1.smithi125.stdout:2/10: fsync d1/f2 0 2024-02-19T19:12:03.614 INFO:tasks.workunit.client.1.smithi125.stdout:6/6: fdatasync f0 0 2024-02-19T19:12:03.614 INFO:tasks.workunit.client.1.smithi125.stdout:9/15: fsync f1 0 2024-02-19T19:12:03.614 INFO:tasks.workunit.client.1.smithi125.stdout:1/16: fsync f0 0 2024-02-19T19:12:03.615 INFO:tasks.workunit.client.1.smithi125.stdout:5/32: fdatasync f6 0 2024-02-19T19:12:03.615 INFO:tasks.workunit.client.1.smithi125.stdout:9/16: dread - f2 zero size 2024-02-19T19:12:03.615 INFO:tasks.workunit.client.1.smithi125.stdout:3/25: rename d0/d1 to d0/d1/d8 22 2024-02-19T19:12:03.615 INFO:tasks.workunit.client.1.smithi125.stdout:6/7: creat f3 x:0 0 0 2024-02-19T19:12:03.615 INFO:tasks.workunit.client.1.smithi125.stdout:9/17: write f2 [422014,10392] 0 2024-02-19T19:12:03.615 INFO:tasks.workunit.client.1.smithi125.stdout:6/8: dread f0 [1060864,24576] 0 2024-02-19T19:12:03.615 INFO:tasks.workunit.client.1.smithi125.stdout:6/9: dread - f3 zero size 2024-02-19T19:12:03.615 INFO:tasks.workunit.client.1.smithi125.stdout:7/16: fdatasync f1 0 2024-02-19T19:12:03.615 INFO:tasks.workunit.client.1.smithi125.stdout:9/18: truncate f1 61511 0 2024-02-19T19:12:03.616 INFO:tasks.workunit.client.1.smithi125.stdout:2/11: write d1/f2 [1150666,71275] 0 2024-02-19T19:12:03.616 INFO:tasks.workunit.client.1.smithi125.stdout:9/19: chown f2 21163 1 2024-02-19T19:12:03.616 INFO:tasks.workunit.client.1.smithi125.stdout:6/10: creat f4 x:0 0 0 2024-02-19T19:12:03.616 INFO:tasks.workunit.client.1.smithi125.stdout:2/12: dread d1/f2 [352256,20480] 0 2024-02-19T19:12:03.616 INFO:tasks.workunit.client.1.smithi125.stdout:6/11: chown f4 636428 1 2024-02-19T19:12:03.616 INFO:tasks.workunit.client.1.smithi125.stdout:7/17: unlink l0 0 2024-02-19T19:12:03.616 INFO:tasks.workunit.client.1.smithi125.stdout:2/13: mknod d1/c4 0 2024-02-19T19:12:03.616 INFO:tasks.workunit.client.1.smithi125.stdout:2/14: unlink d1/c4 0 2024-02-19T19:12:03.617 INFO:tasks.workunit.client.1.smithi125.stdout:7/18: dread f1 [32768,86016] 0 2024-02-19T19:12:03.617 INFO:tasks.workunit.client.1.smithi125.stdout:9/20: write f3 [755403,109927] 0 2024-02-19T19:12:03.617 INFO:tasks.workunit.client.1.smithi125.stdout:2/15: symlink d1/d3/l5 0 2024-02-19T19:12:03.617 INFO:tasks.workunit.client.1.smithi125.stdout:7/19: symlink l4 0 2024-02-19T19:12:03.617 INFO:tasks.workunit.client.1.smithi125.stdout:7/20: rmdir - no directory 2024-02-19T19:12:03.617 INFO:tasks.workunit.client.1.smithi125.stdout:9/21: symlink l4 0 2024-02-19T19:12:03.617 INFO:tasks.workunit.client.1.smithi125.stdout:9/22: getdents . 0 2024-02-19T19:12:03.617 INFO:tasks.workunit.client.1.smithi125.stdout:9/23: symlink l5 0 2024-02-19T19:12:03.618 INFO:tasks.workunit.client.1.smithi125.stdout:9/24: creat f6 x:0 0 0 2024-02-19T19:12:03.618 INFO:tasks.workunit.client.1.smithi125.stdout:9/25: rmdir - no directory 2024-02-19T19:12:03.621 INFO:tasks.workunit.client.1.smithi125.stdout:6/12: dwrite f0 [339968,77824] 0 2024-02-19T19:12:03.621 INFO:tasks.workunit.client.1.smithi125.stdout:6/13: chown f4 12 1 2024-02-19T19:12:03.622 INFO:tasks.workunit.client.1.smithi125.stdout:6/14: unlink f3 0 2024-02-19T19:12:03.622 INFO:tasks.workunit.client.1.smithi125.stdout:6/15: getdents . 0 2024-02-19T19:12:03.622 INFO:tasks.workunit.client.1.smithi125.stdout:6/16: creat f5 x:0 0 0 2024-02-19T19:12:03.622 INFO:tasks.workunit.client.1.smithi125.stdout:1/17: dwrite f0 [860160,65536] 0 2024-02-19T19:12:03.622 INFO:tasks.workunit.client.1.smithi125.stdout:6/17: write f5 [975055,95105] 0 2024-02-19T19:12:03.622 INFO:tasks.workunit.client.1.smithi125.stdout:6/18: read - f4 zero size 2024-02-19T19:12:03.622 INFO:tasks.workunit.client.1.smithi125.stdout:1/18: dread f0 [118784,57344] 0 2024-02-19T19:12:03.622 INFO:tasks.workunit.client.1.smithi125.stdout:6/19: dread f5 [344064,16384] 0 2024-02-19T19:12:03.623 INFO:tasks.workunit.client.1.smithi125.stdout:1/19: creat d1/f4 x:0 0 0 2024-02-19T19:12:03.623 INFO:tasks.workunit.client.1.smithi125.stdout:6/20: mkdir d6 0 2024-02-19T19:12:03.623 INFO:tasks.workunit.client.1.smithi125.stdout:1/20: symlink d1/l5 0 2024-02-19T19:12:03.623 INFO:tasks.workunit.client.1.smithi125.stdout:1/21: chown f0 13 1 2024-02-19T19:12:03.623 INFO:tasks.workunit.client.1.smithi125.stdout:2/16: dwrite d1/f2 [2019328,24576] 0 2024-02-19T19:12:03.623 INFO:tasks.workunit.client.1.smithi125.stdout:2/17: write d1/f2 [1799534,41477] 0 2024-02-19T19:12:03.623 INFO:tasks.workunit.client.1.smithi125.stdout:1/22: write d1/f4 [13725,97345] 0 2024-02-19T19:12:03.623 INFO:tasks.workunit.client.1.smithi125.stdout:1/23: truncate d1/f4 174856 0 2024-02-19T19:12:03.623 INFO:tasks.workunit.client.1.smithi125.stdout:1/24: rename d1 to d1/d6 22 2024-02-19T19:12:03.624 INFO:tasks.workunit.client.1.smithi125.stdout:2/18: mkdir d1/d6 0 2024-02-19T19:12:03.624 INFO:tasks.workunit.client.1.smithi125.stdout:1/25: symlink d1/l7 0 2024-02-19T19:12:03.624 INFO:tasks.workunit.client.1.smithi125.stdout:1/26: link d1/l3 d1/l8 0 2024-02-19T19:12:03.624 INFO:tasks.workunit.client.1.smithi125.stdout:1/27: rename d1/f4 to d1/f9 0 2024-02-19T19:12:03.624 INFO:tasks.workunit.client.1.smithi125.stdout:1/28: write d1/f9 [705584,11003] 0 2024-02-19T19:12:03.624 INFO:tasks.workunit.client.1.smithi125.stdout:1/29: creat d1/fa x:0 0 0 2024-02-19T19:12:03.624 INFO:tasks.workunit.client.1.smithi125.stdout:6/21: dwrite f5 [1372160,61440] 0 2024-02-19T19:12:03.624 INFO:tasks.workunit.client.1.smithi125.stdout:6/22: rename d6 to d6/d7 22 2024-02-19T19:12:03.625 INFO:tasks.workunit.client.1.smithi125.stdout:6/23: rename d6 to d6/d8 22 2024-02-19T19:12:03.625 INFO:tasks.workunit.client.1.smithi125.stdout:6/24: dwrite f5 [2375680,36864] 0 2024-02-19T19:12:03.625 INFO:tasks.workunit.client.1.smithi125.stdout:6/25: dread f5 [90112,12288] 0 2024-02-19T19:12:03.625 INFO:tasks.workunit.client.1.smithi125.stdout:6/26: stat d6 0 2024-02-19T19:12:03.625 INFO:tasks.workunit.client.1.smithi125.stdout:6/27: unlink f0 0 2024-02-19T19:12:03.625 INFO:tasks.workunit.client.1.smithi125.stdout:6/28: read f5 [1217829,47930] 0 2024-02-19T19:12:03.625 INFO:tasks.workunit.client.1.smithi125.stdout:6/29: rename f5 to d6/f9 0 2024-02-19T19:12:03.625 INFO:tasks.workunit.client.1.smithi125.stdout:6/30: mknod d6/ca 0 2024-02-19T19:12:03.625 INFO:tasks.workunit.client.1.smithi125.stdout:6/31: mkdir d6/db 0 2024-02-19T19:12:03.626 INFO:tasks.workunit.client.1.smithi125.stdout:6/32: truncate f4 372687 0 2024-02-19T19:12:03.626 INFO:tasks.workunit.client.1.smithi125.stdout:6/33: dwrite f4 [831488,110592] 0 2024-02-19T19:12:03.626 INFO:tasks.workunit.client.1.smithi125.stdout:6/34: write f4 [1841112,17218] 0 2024-02-19T19:12:03.822 INFO:tasks.workunit.client.1.smithi125.stdout:3/26: fdatasync d0/f7 0 2024-02-19T19:12:03.822 INFO:tasks.workunit.client.1.smithi125.stdout:3/27: chown d0/d1 4067 1 2024-02-19T19:12:03.822 INFO:tasks.workunit.client.1.smithi125.stdout:3/28: write d0/f7 [425182,86594] 0 2024-02-19T19:12:03.822 INFO:tasks.workunit.client.1.smithi125.stdout:3/29: write d0/f7 [951403,59563] 0 2024-02-19T19:12:03.829 INFO:tasks.workunit.client.1.smithi125.stdout:3/30: dwrite d0/f7 [1175552,16384] 0 2024-02-19T19:12:03.829 INFO:tasks.workunit.client.1.smithi125.stdout:3/31: symlink d0/d1/l9 0 2024-02-19T19:12:03.829 INFO:tasks.workunit.client.1.smithi125.stdout:3/32: mknod d0/ca 0 2024-02-19T19:12:03.829 INFO:tasks.workunit.client.1.smithi125.stdout:3/33: chown d0/d1/l9 51090460 1 2024-02-19T19:12:03.833 INFO:tasks.workunit.client.1.smithi125.stdout:3/34: dwrite d0/f7 [245760,12288] 0 2024-02-19T19:12:03.834 INFO:tasks.workunit.client.1.smithi125.stdout:3/35: rename d0/f7 to d0/d1/fb 0 2024-02-19T19:12:03.834 INFO:tasks.workunit.client.1.smithi125.stdout:3/36: getdents d0/d1 0 2024-02-19T19:12:03.834 INFO:tasks.workunit.client.1.smithi125.stdout:3/37: creat d0/d1/fc x:0 0 0 2024-02-19T19:12:03.834 INFO:tasks.workunit.client.1.smithi125.stdout:3/38: write d0/d1/fb [1695,94519] 0 2024-02-19T19:12:03.834 INFO:tasks.workunit.client.1.smithi125.stdout:3/39: rename d0 to d0/dd 22 2024-02-19T19:12:03.837 INFO:tasks.workunit.client.1.smithi125.stdout:3/40: dwrite d0/d1/fb [245760,65536] 0 2024-02-19T19:12:03.838 INFO:tasks.workunit.client.1.smithi125.stdout:3/41: chown d0/l3 8145 1 2024-02-19T19:12:03.838 INFO:tasks.workunit.client.1.smithi125.stdout:3/42: dwrite d0/d1/fb [794624,16384] 0 2024-02-19T19:12:03.838 INFO:tasks.workunit.client.1.smithi125.stdout:3/43: truncate d0/d1/fc 339101 0 2024-02-19T19:12:03.838 INFO:tasks.workunit.client.1.smithi125.stdout:3/44: truncate d0/d1/fc 787806 0 2024-02-19T19:12:03.838 INFO:tasks.workunit.client.1.smithi125.stdout:3/45: dread d0/d1/fc [155648,24576] 0 2024-02-19T19:12:03.838 INFO:tasks.workunit.client.1.smithi125.stdout:3/46: chown d0/l3 14 1 2024-02-19T19:12:03.838 INFO:tasks.workunit.client.1.smithi125.stdout:3/47: dread d0/d1/fc [651264,126976] 0 2024-02-19T19:12:03.838 INFO:tasks.workunit.client.1.smithi125.stdout:3/48: mkdir d0/de 0 2024-02-19T19:12:03.839 INFO:tasks.workunit.client.1.smithi125.stdout:3/49: getdents d0 0 2024-02-19T19:12:03.839 INFO:tasks.workunit.client.1.smithi125.stdout:3/50: dwrite d0/d1/fb [2064384,57344] 0 2024-02-19T19:12:03.839 INFO:tasks.workunit.client.1.smithi125.stdout:3/51: unlink d0/l3 0 2024-02-19T19:12:03.839 INFO:tasks.workunit.client.1.smithi125.stdout:3/52: dread d0/d1/fc [40960,65536] 0 2024-02-19T19:12:03.841 INFO:tasks.workunit.client.1.smithi125.stdout:3/53: dwrite d0/d1/fc [339968,126976] 0 2024-02-19T19:12:03.842 INFO:tasks.workunit.client.1.smithi125.stdout:3/54: creat d0/ff x:0 0 0 2024-02-19T19:12:03.842 INFO:tasks.workunit.client.1.smithi125.stdout:3/55: dread d0/d1/fc [16384,73728] 0 2024-02-19T19:12:04.182 INFO:tasks.workunit.client.1.smithi125.stdout:0/24: fsync f4 0 2024-02-19T19:12:04.183 INFO:tasks.workunit.client.1.smithi125.stdout:0/25: truncate f4 328101 0 2024-02-19T19:12:04.183 INFO:tasks.workunit.client.1.smithi125.stdout:0/26: getdents d5 0 2024-02-19T19:12:04.212 INFO:tasks.workunit.client.1.smithi125.stdout:0/27: dwrite f2 [356352,81920] 0 2024-02-19T19:12:04.214 INFO:tasks.workunit.client.1.smithi125.stdout:0/28: creat d5/f8 x:0 0 0 2024-02-19T19:12:04.214 INFO:tasks.workunit.client.1.smithi125.stdout:0/29: mkdir d5/d9 0 2024-02-19T19:12:04.214 INFO:tasks.workunit.client.1.smithi125.stdout:0/30: chown d5/d9 818 1 2024-02-19T19:12:04.215 INFO:tasks.workunit.client.1.smithi125.stdout:0/31: dread - d5/f8 zero size 2024-02-19T19:12:04.215 INFO:tasks.workunit.client.1.smithi125.stdout:0/32: truncate f2 326998 0 2024-02-19T19:12:04.215 INFO:tasks.workunit.client.1.smithi125.stdout:0/33: creat d5/d9/fa x:0 0 0 2024-02-19T19:12:04.215 INFO:tasks.workunit.client.1.smithi125.stdout:0/34: rename f4 to d5/d9/fb 0 2024-02-19T19:12:04.237 INFO:tasks.workunit.client.1.smithi125.stdout:0/35: dwrite d5/d9/fa [290816,110592] 0 2024-02-19T19:12:04.237 INFO:tasks.workunit.client.1.smithi125.stdout:0/36: rmdir d5 39 2024-02-19T19:12:04.498 INFO:tasks.workunit.client.1.smithi125.stdout:1/30: fsync f0 0 2024-02-19T19:12:04.498 INFO:tasks.workunit.client.1.smithi125.stdout:2/19: fdatasync d1/f2 0 2024-02-19T19:12:04.584 INFO:tasks.workunit.client.1.smithi125.stdout:2/20: dread d1/f2 [811008,49152] 0 2024-02-19T19:12:04.584 INFO:tasks.workunit.client.1.smithi125.stdout:2/21: rmdir d1/d3 39 2024-02-19T19:12:04.585 INFO:tasks.workunit.client.1.smithi125.stdout:2/22: creat d1/d3/f7 x:0 0 0 2024-02-19T19:12:04.585 INFO:tasks.workunit.client.1.smithi125.stdout:2/23: rename d1/d3/f7 to d1/d6/f8 0 2024-02-19T19:12:04.585 INFO:tasks.workunit.client.1.smithi125.stdout:2/24: dread - d1/d6/f8 zero size 2024-02-19T19:12:04.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:04 smithi125 ceph-mon[86115]: pgmap v147: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 3 op/s; 11 B/s, 0 objects/s recovering 2024-02-19T19:12:04.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:04 smithi096 ceph-mon[112483]: pgmap v147: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 3 op/s; 11 B/s, 0 objects/s recovering 2024-02-19T19:12:04.805 INFO:tasks.workunit.client.1.smithi125.stdout:0/37: fdatasync d5/d9/fa 0 2024-02-19T19:12:04.940 INFO:tasks.workunit.client.1.smithi125.stdout:0/38: dwrite f2 [65536,94208] 0 2024-02-19T19:12:04.940 INFO:tasks.workunit.client.1.smithi125.stdout:0/39: write d5/f8 [988458,14733] 0 2024-02-19T19:12:04.940 INFO:tasks.workunit.client.1.smithi125.stdout:0/40: chown d5/d9/fb 0 1 2024-02-19T19:12:05.086 INFO:tasks.workunit.client.1.smithi125.stdout:1/31: fsync d1/f9 0 2024-02-19T19:12:05.086 INFO:tasks.workunit.client.1.smithi125.stdout:2/25: fsync d1/d6/f8 0 2024-02-19T19:12:05.087 INFO:tasks.workunit.client.1.smithi125.stdout:2/26: dread - d1/d6/f8 zero size 2024-02-19T19:12:05.087 INFO:tasks.workunit.client.1.smithi125.stdout:2/27: symlink d1/d3/l9 0 2024-02-19T19:12:05.087 INFO:tasks.workunit.client.1.smithi125.stdout:0/41: fsync d5/d9/fb 0 2024-02-19T19:12:05.087 INFO:tasks.workunit.client.1.smithi125.stdout:2/28: dread d1/f2 [782336,8192] 0 2024-02-19T19:12:05.087 INFO:tasks.workunit.client.1.smithi125.stdout:0/42: mknod d5/cc 0 2024-02-19T19:12:05.087 INFO:tasks.workunit.client.1.smithi125.stdout:2/29: mknod d1/d6/ca 0 2024-02-19T19:12:05.087 INFO:tasks.workunit.client.1.smithi125.stdout:0/43: rename d5/d9/fa to d5/d9/fd 0 2024-02-19T19:12:05.087 INFO:tasks.workunit.client.1.smithi125.stdout:0/44: write d5/d9/fb [914753,21111] 0 2024-02-19T19:12:05.088 INFO:tasks.workunit.client.1.smithi125.stdout:0/45: symlink d5/le 0 2024-02-19T19:12:05.088 INFO:tasks.workunit.client.1.smithi125.stdout:0/46: creat d5/ff x:0 0 0 2024-02-19T19:12:05.088 INFO:tasks.workunit.client.1.smithi125.stdout:0/47: symlink d5/l10 0 2024-02-19T19:12:05.088 INFO:tasks.workunit.client.1.smithi125.stdout:0/48: chown d5/cc 10985 1 2024-02-19T19:12:05.088 INFO:tasks.workunit.client.1.smithi125.stdout:0/49: symlink d5/d9/l11 0 2024-02-19T19:12:05.088 INFO:tasks.workunit.client.1.smithi125.stdout:0/50: symlink d5/d9/l12 0 2024-02-19T19:12:05.088 INFO:tasks.workunit.client.1.smithi125.stdout:0/51: read d5/f8 [538840,63030] 0 2024-02-19T19:12:05.088 INFO:tasks.workunit.client.1.smithi125.stdout:0/52: rename d5/d9/l12 to d5/l13 0 2024-02-19T19:12:05.094 INFO:tasks.workunit.client.1.smithi125.stdout:1/32: dwrite d1/f9 [1540096,81920] 0 2024-02-19T19:12:05.094 INFO:tasks.workunit.client.1.smithi125.stdout:2/30: dwrite d1/f2 [2109440,81920] 0 2024-02-19T19:12:05.094 INFO:tasks.workunit.client.1.smithi125.stdout:2/31: write d1/d6/f8 [897509,17786] 0 2024-02-19T19:12:05.094 INFO:tasks.workunit.client.1.smithi125.stdout:2/32: unlink d1/d3/l5 0 2024-02-19T19:12:05.094 INFO:tasks.workunit.client.1.smithi125.stdout:2/33: rename d1/d6/ca to d1/d6/cb 0 2024-02-19T19:12:05.094 INFO:tasks.workunit.client.1.smithi125.stdout:0/53: dwrite d5/d9/fd [847872,28672] 0 2024-02-19T19:12:05.094 INFO:tasks.workunit.client.1.smithi125.stdout:2/34: write d1/f2 [919878,4224] 0 2024-02-19T19:12:05.094 INFO:tasks.workunit.client.1.smithi125.stdout:0/54: write f2 [366278,70619] 0 2024-02-19T19:12:05.095 INFO:tasks.workunit.client.1.smithi125.stdout:0/55: symlink d5/d9/l14 0 2024-02-19T19:12:05.095 INFO:tasks.workunit.client.1.smithi125.stdout:0/56: mkdir d5/d15 0 2024-02-19T19:12:05.197 INFO:tasks.workunit.client.1.smithi125.stdout:1/33: dwrite f0 [745472,86016] 0 2024-02-19T19:12:05.198 INFO:tasks.workunit.client.1.smithi125.stdout:2/35: read d1/f2 [720354,105751] 0 2024-02-19T19:12:05.198 INFO:tasks.workunit.client.1.smithi125.stdout:1/34: mkdir d1/db 0 2024-02-19T19:12:05.198 INFO:tasks.workunit.client.1.smithi125.stdout:1/35: read - d1/fa zero size 2024-02-19T19:12:05.198 INFO:tasks.workunit.client.1.smithi125.stdout:1/36: write f0 [176325,121839] 0 2024-02-19T19:12:05.198 INFO:tasks.workunit.client.1.smithi125.stdout:1/37: dread - d1/fa zero size 2024-02-19T19:12:05.198 INFO:tasks.workunit.client.1.smithi125.stdout:1/38: chown d1/l8 823 1 2024-02-19T19:12:05.198 INFO:tasks.workunit.client.1.smithi125.stdout:1/39: rmdir d1/db 0 2024-02-19T19:12:05.232 INFO:tasks.workunit.client.1.smithi125.stdout:2/36: dwrite d1/d6/f8 [376832,4096] 0 2024-02-19T19:12:05.233 INFO:tasks.workunit.client.1.smithi125.stdout:2/37: truncate d1/f2 2475109 0 2024-02-19T19:12:05.233 INFO:tasks.workunit.client.1.smithi125.stdout:2/38: rename d1 to d1/d3/dc 22 2024-02-19T19:12:05.233 INFO:tasks.workunit.client.1.smithi125.stdout:2/39: write d1/f2 [2847005,14530] 0 2024-02-19T19:12:05.233 INFO:tasks.workunit.client.1.smithi125.stdout:2/40: truncate d1/d6/f8 1364782 0 2024-02-19T19:12:05.233 INFO:tasks.workunit.client.1.smithi125.stdout:2/41: dread d1/d6/f8 [237568,69632] 0 2024-02-19T19:12:05.233 INFO:tasks.workunit.client.1.smithi125.stdout:2/42: dread d1/d6/f8 [1286144,16384] 0 2024-02-19T19:12:05.235 INFO:tasks.workunit.client.1.smithi125.stdout:1/40: truncate f0 487484 0 2024-02-19T19:12:05.235 INFO:tasks.workunit.client.1.smithi125.stdout:1/41: mkdir d1/dc 0 2024-02-19T19:12:05.235 INFO:tasks.workunit.client.1.smithi125.stdout:1/42: write d1/fa [481028,3655] 0 2024-02-19T19:12:05.235 INFO:tasks.workunit.client.1.smithi125.stdout:1/43: creat d1/dc/fd x:0 0 0 2024-02-19T19:12:05.235 INFO:tasks.workunit.client.1.smithi125.stdout:1/44: truncate d1/dc/fd 64620 0 2024-02-19T19:12:05.235 INFO:tasks.workunit.client.1.smithi125.stdout:2/43: dwrite d1/d6/f8 [217088,102400] 0 2024-02-19T19:12:05.235 INFO:tasks.workunit.client.1.smithi125.stdout:2/44: creat d1/fd x:0 0 0 2024-02-19T19:12:05.236 INFO:tasks.workunit.client.1.smithi125.stdout:2/45: chown c0 29879931 1 2024-02-19T19:12:05.236 INFO:tasks.workunit.client.1.smithi125.stdout:2/46: chown d1/d6/f8 36 1 2024-02-19T19:12:05.236 INFO:tasks.workunit.client.1.smithi125.stdout:2/47: truncate d1/fd 966032 0 2024-02-19T19:12:05.236 INFO:tasks.workunit.client.1.smithi125.stdout:2/48: mknod d1/d3/ce 0 2024-02-19T19:12:05.236 INFO:tasks.workunit.client.1.smithi125.stdout:2/49: stat d1/d3/l9 0 2024-02-19T19:12:05.236 INFO:tasks.workunit.client.1.smithi125.stdout:2/50: write d1/fd [802206,718] 0 2024-02-19T19:12:05.236 INFO:tasks.workunit.client.1.smithi125.stdout:2/51: truncate d1/fd 1776442 0 2024-02-19T19:12:05.327 INFO:tasks.workunit.client.1.smithi125.stdout:2/52: dwrite d1/fd [2052096,69632] 0 2024-02-19T19:12:05.462 INFO:tasks.workunit.client.1.smithi125.stdout:0/57: fdatasync d5/ff 0 2024-02-19T19:12:05.462 INFO:tasks.workunit.client.1.smithi125.stdout:0/58: write f2 [717641,87629] 0 2024-02-19T19:12:05.462 INFO:tasks.workunit.client.1.smithi125.stdout:0/59: link d5/f8 d5/f16 0 2024-02-19T19:12:05.462 INFO:tasks.workunit.client.1.smithi125.stdout:0/60: symlink d5/d9/l17 0 2024-02-19T19:12:05.462 INFO:tasks.workunit.client.1.smithi125.stdout:0/61: creat d5/f18 x:0 0 0 2024-02-19T19:12:05.462 INFO:tasks.workunit.client.1.smithi125.stdout:0/62: stat d5/c6 0 2024-02-19T19:12:05.833 INFO:tasks.workunit.client.1.smithi125.stdout:1/45: fsync d1/fa 0 2024-02-19T19:12:05.833 INFO:tasks.workunit.client.1.smithi125.stdout:1/46: mknod d1/ce 0 2024-02-19T19:12:05.834 INFO:tasks.workunit.client.1.smithi125.stdout:1/47: chown d1/l3 34887 1 2024-02-19T19:12:05.834 INFO:tasks.workunit.client.1.smithi125.stdout:1/48: stat d1/l5 0 2024-02-19T19:12:05.838 INFO:tasks.workunit.client.1.smithi125.stdout:1/49: dwrite f0 [729088,8192] 0 2024-02-19T19:12:05.838 INFO:tasks.workunit.client.1.smithi125.stdout:1/50: stat f0 0 2024-02-19T19:12:05.838 INFO:tasks.workunit.client.1.smithi125.stdout:1/51: mknod d1/cf 0 2024-02-19T19:12:05.838 INFO:tasks.workunit.client.1.smithi125.stdout:1/52: symlink d1/dc/l10 0 2024-02-19T19:12:05.839 INFO:tasks.workunit.client.1.smithi125.stdout:1/53: mknod d1/dc/c11 0 2024-02-19T19:12:06.248 INFO:tasks.workunit.client.1.smithi125.stdout:2/53: fdatasync d1/d6/f8 0 2024-02-19T19:12:06.253 INFO:tasks.workunit.client.1.smithi125.stdout:2/54: dwrite d1/f2 [2494464,57344] 0 2024-02-19T19:12:06.253 INFO:tasks.workunit.client.1.smithi125.stdout:2/55: read d1/d6/f8 [1072851,16019] 0 2024-02-19T19:12:06.253 INFO:tasks.workunit.client.1.smithi125.stdout:2/56: creat d1/ff x:0 0 0 2024-02-19T19:12:06.253 INFO:tasks.workunit.client.1.smithi125.stdout:2/57: read - d1/ff zero size 2024-02-19T19:12:06.256 INFO:tasks.workunit.client.1.smithi125.stdout:2/58: write d1/fd [2104687,95873] 0 2024-02-19T19:12:06.256 INFO:tasks.workunit.client.1.smithi125.stdout:2/59: unlink c0 0 2024-02-19T19:12:06.331 INFO:tasks.workunit.client.1.smithi125.stdout:2/60: dwrite d1/d6/f8 [1409024,122880] 0 2024-02-19T19:12:06.331 INFO:tasks.workunit.client.1.smithi125.stdout:2/61: write d1/fd [2204128,106516] 0 2024-02-19T19:12:06.341 INFO:tasks.workunit.client.1.smithi125.stdout:2/62: dwrite d1/d6/f8 [774144,94208] 0 2024-02-19T19:12:06.349 INFO:tasks.workunit.client.1.smithi125.stdout:8/4: sync 2024-02-19T19:12:06.349 INFO:tasks.workunit.client.1.smithi125.stdout:8/5: truncate - no filename 2024-02-19T19:12:06.349 INFO:tasks.workunit.client.1.smithi125.stdout:8/6: mknod c3 0 2024-02-19T19:12:06.349 INFO:tasks.workunit.client.1.smithi125.stdout:8/7: creat f4 x:0 0 0 2024-02-19T19:12:06.436 INFO:tasks.workunit.client.1.smithi125.stdout:0/63: sync 2024-02-19T19:12:06.437 INFO:tasks.workunit.client.1.smithi125.stdout:9/26: sync 2024-02-19T19:12:06.437 INFO:tasks.workunit.client.1.smithi125.stdout:3/56: sync 2024-02-19T19:12:06.437 INFO:tasks.workunit.client.1.smithi125.stdout:1/54: sync 2024-02-19T19:12:06.437 INFO:tasks.workunit.client.1.smithi125.stdout:7/21: sync 2024-02-19T19:12:06.437 INFO:tasks.workunit.client.1.smithi125.stdout:6/35: sync 2024-02-19T19:12:06.437 INFO:tasks.workunit.client.1.smithi125.stdout:4/31: sync 2024-02-19T19:12:06.437 INFO:tasks.workunit.client.1.smithi125.stdout:1/55: dread d1/fa [86016,28672] 0 2024-02-19T19:12:06.437 INFO:tasks.workunit.client.1.smithi125.stdout:7/22: unlink l4 0 2024-02-19T19:12:06.438 INFO:tasks.workunit.client.1.smithi125.stdout:5/33: sync 2024-02-19T19:12:06.438 INFO:tasks.workunit.client.1.smithi125.stdout:6/36: truncate f4 1275185 0 2024-02-19T19:12:06.438 INFO:tasks.workunit.client.1.smithi125.stdout:6/37: chown l1 0 1 2024-02-19T19:12:06.503 INFO:tasks.workunit.client.1.smithi125.stdout:6/38: dwrite d6/f9 [2035712,114688] 0 2024-02-19T19:12:06.503 INFO:tasks.workunit.client.1.smithi125.stdout:6/39: mknod d6/cc 0 2024-02-19T19:12:06.503 INFO:tasks.workunit.client.1.smithi125.stdout:6/40: symlink d6/ld 0 2024-02-19T19:12:06.503 INFO:tasks.workunit.client.1.smithi125.stdout:6/41: mkdir d6/de 0 2024-02-19T19:12:06.503 INFO:tasks.workunit.client.1.smithi125.stdout:6/42: mkdir d6/db/df 0 2024-02-19T19:12:06.503 INFO:tasks.workunit.client.1.smithi125.stdout:6/43: dread d6/f9 [839680,110592] 0 2024-02-19T19:12:06.503 INFO:tasks.workunit.client.1.smithi125.stdout:7/23: dwrite f3 [12288,110592] 0 2024-02-19T19:12:06.503 INFO:tasks.workunit.client.1.smithi125.stdout:6/44: readlink d6/ld 0 2024-02-19T19:12:06.504 INFO:tasks.workunit.client.1.smithi125.stdout:7/24: chown f1 2629379 1 2024-02-19T19:12:06.504 INFO:tasks.workunit.client.1.smithi125.stdout:6/45: creat d6/de/f10 x:0 0 0 2024-02-19T19:12:06.504 INFO:tasks.workunit.client.1.smithi125.stdout:5/34: dwrite f6 [61440,114688] 0 2024-02-19T19:12:06.504 INFO:tasks.workunit.client.1.smithi125.stdout:5/35: mkdir db 0 2024-02-19T19:12:06.505 INFO:tasks.workunit.client.1.smithi125.stdout:5/36: unlink l0 0 2024-02-19T19:12:06.505 INFO:tasks.workunit.client.1.smithi125.stdout:5/37: symlink db/lc 0 2024-02-19T19:12:06.506 INFO:tasks.workunit.client.1.smithi125.stdout:5/38: unlink l4 0 2024-02-19T19:12:06.506 INFO:tasks.workunit.client.1.smithi125.stdout:5/39: mknod db/cd 0 2024-02-19T19:12:06.506 INFO:tasks.workunit.client.1.smithi125.stdout:5/40: mkdir db/de 0 2024-02-19T19:12:06.506 INFO:tasks.workunit.client.1.smithi125.stdout:5/41: rename fa to db/de/ff 0 2024-02-19T19:12:06.506 INFO:tasks.workunit.client.1.smithi125.stdout:3/57: dwrite d0/ff [667648,110592] 0 2024-02-19T19:12:06.506 INFO:tasks.workunit.client.1.smithi125.stdout:5/42: write f6 [882744,76185] 0 2024-02-19T19:12:06.506 INFO:tasks.workunit.client.1.smithi125.stdout:3/58: creat d0/de/f10 x:0 0 0 2024-02-19T19:12:06.506 INFO:tasks.workunit.client.1.smithi125.stdout:5/43: creat db/f10 x:0 0 0 2024-02-19T19:12:06.506 INFO:tasks.workunit.client.1.smithi125.stdout:3/59: write d0/d1/fc [1807629,59812] 0 2024-02-19T19:12:06.542 INFO:tasks.workunit.client.1.smithi125.stdout:4/32: fsync d0/d7/dc/f9 0 2024-02-19T19:12:06.542 INFO:tasks.workunit.client.1.smithi125.stdout:9/27: fsync f2 0 2024-02-19T19:12:06.542 INFO:tasks.workunit.client.1.smithi125.stdout:1/56: fdatasync d1/fa 0 2024-02-19T19:12:06.542 INFO:tasks.workunit.client.1.smithi125.stdout:8/8: fdatasync f4 0 2024-02-19T19:12:06.542 INFO:tasks.workunit.client.1.smithi125.stdout:8/9: read - f4 zero size 2024-02-19T19:12:06.543 INFO:tasks.workunit.client.1.smithi125.stdout:4/33: write d0/d7/dc/fd [453572,36643] 0 2024-02-19T19:12:06.548 INFO:tasks.workunit.client.1.smithi125.stdout:7/25: dread f2 [471040,45056] 0 2024-02-19T19:12:06.575 INFO:tasks.workunit.client.1.smithi125.stdout:8/10: fdatasync f4 0 2024-02-19T19:12:06.576 INFO:tasks.workunit.client.1.smithi125.stdout:9/28: dwrite f2 [225280,86016] 0 2024-02-19T19:12:06.577 INFO:tasks.workunit.client.1.smithi125.stdout:7/26: dread f3 [61440,102400] 0 2024-02-19T19:12:06.577 INFO:tasks.workunit.client.1.smithi125.stdout:7/27: dread f1 [712704,94208] 0 2024-02-19T19:12:06.577 INFO:tasks.workunit.client.1.smithi125.stdout:2/63: sync 2024-02-19T19:12:06.577 INFO:tasks.workunit.client.1.smithi125.stdout:2/64: chown d1/d6 443852846 1 2024-02-19T19:12:06.578 INFO:tasks.workunit.client.1.smithi125.stdout:2/65: write d1/d6/f8 [1771134,45516] 0 2024-02-19T19:12:06.578 INFO:tasks.workunit.client.1.smithi125.stdout:2/66: chown d1/d6/cb 1 1 2024-02-19T19:12:06.582 INFO:tasks.workunit.client.1.smithi125.stdout:5/44: dread f1 [700416,118784] 0 2024-02-19T19:12:06.582 INFO:tasks.workunit.client.1.smithi125.stdout:3/60: dwrite d0/ff [1273856,28672] 0 2024-02-19T19:12:06.582 INFO:tasks.workunit.client.1.smithi125.stdout:2/67: link d1/d6/f8 d1/d6/f10 0 2024-02-19T19:12:06.582 INFO:tasks.workunit.client.1.smithi125.stdout:6/46: dwrite d6/f9 [1826816,45056] 0 2024-02-19T19:12:06.582 INFO:tasks.workunit.client.1.smithi125.stdout:5/45: getdents db/de 0 2024-02-19T19:12:06.583 INFO:tasks.workunit.client.1.smithi125.stdout:1/57: creat d1/dc/f12 x:0 0 0 2024-02-19T19:12:06.583 INFO:tasks.workunit.client.1.smithi125.stdout:3/61: rename d0/d1/fb to d0/de/f11 0 2024-02-19T19:12:06.583 INFO:tasks.workunit.client.1.smithi125.stdout:1/58: dread f0 [561152,4096] 0 2024-02-19T19:12:06.583 INFO:tasks.workunit.client.1.smithi125.stdout:3/62: read - d0/de/f10 zero size 2024-02-19T19:12:06.583 INFO:tasks.workunit.client.1.smithi125.stdout:1/59: stat d1/cf 0 2024-02-19T19:12:06.583 INFO:tasks.workunit.client.1.smithi125.stdout:6/47: creat d6/db/f11 x:0 0 0 2024-02-19T19:12:06.583 INFO:tasks.workunit.client.1.smithi125.stdout:3/63: creat d0/f12 x:0 0 0 2024-02-19T19:12:06.583 INFO:tasks.workunit.client.1.smithi125.stdout:1/60: symlink d1/l13 0 2024-02-19T19:12:06.583 INFO:tasks.workunit.client.1.smithi125.stdout:1/61: link f0 d1/f14 0 2024-02-19T19:12:06.583 INFO:tasks.workunit.client.1.smithi125.stdout:1/62: stat d1/fa 0 2024-02-19T19:12:06.584 INFO:tasks.workunit.client.1.smithi125.stdout:6/48: write d6/f9 [896363,46067] 0 2024-02-19T19:12:06.584 INFO:tasks.workunit.client.1.smithi125.stdout:8/11: symlink l5 0 2024-02-19T19:12:06.584 INFO:tasks.workunit.client.1.smithi125.stdout:8/12: truncate f4 1012436 0 2024-02-19T19:12:06.584 INFO:tasks.workunit.client.1.smithi125.stdout:6/49: truncate d6/f9 2205139 0 2024-02-19T19:12:06.584 INFO:tasks.workunit.client.1.smithi125.stdout:6/50: rmdir d6/db 39 2024-02-19T19:12:06.584 INFO:tasks.workunit.client.1.smithi125.stdout:6/51: truncate d6/db/f11 484309 0 2024-02-19T19:12:06.584 INFO:tasks.workunit.client.1.smithi125.stdout:8/13: mknod c6 0 2024-02-19T19:12:06.584 INFO:tasks.workunit.client.1.smithi125.stdout:9/29: write f6 [887799,108130] 0 2024-02-19T19:12:06.585 INFO:tasks.workunit.client.1.smithi125.stdout:8/14: rename c3 to c7 0 2024-02-19T19:12:06.585 INFO:tasks.workunit.client.1.smithi125.stdout:9/30: readlink l4 0 2024-02-19T19:12:06.585 INFO:tasks.workunit.client.1.smithi125.stdout:6/52: truncate d6/f9 1256779 0 2024-02-19T19:12:06.585 INFO:tasks.workunit.client.1.smithi125.stdout:1/63: dread d1/f14 [495616,126976] 0 2024-02-19T19:12:06.585 INFO:tasks.workunit.client.1.smithi125.stdout:1/64: stat d1/l13 0 2024-02-19T19:12:06.585 INFO:tasks.workunit.client.1.smithi125.stdout:6/53: truncate d6/f9 1068731 0 2024-02-19T19:12:06.585 INFO:tasks.workunit.client.1.smithi125.stdout:9/31: creat f7 x:0 0 0 2024-02-19T19:12:06.585 INFO:tasks.workunit.client.1.smithi125.stdout:9/32: mkdir d8 0 2024-02-19T19:12:06.585 INFO:tasks.workunit.client.1.smithi125.stdout:6/54: write d6/f9 [574734,77963] 0 2024-02-19T19:12:06.585 INFO:tasks.workunit.client.1.smithi125.stdout:9/33: creat d8/f9 x:0 0 0 2024-02-19T19:12:06.586 INFO:tasks.workunit.client.1.smithi125.stdout:6/55: getdents d6/de 0 2024-02-19T19:12:06.586 INFO:tasks.workunit.client.1.smithi125.stdout:9/34: chown f3 15406 1 2024-02-19T19:12:06.586 INFO:tasks.workunit.client.1.smithi125.stdout:6/56: creat d6/db/df/f12 x:0 0 0 2024-02-19T19:12:06.586 INFO:tasks.workunit.client.1.smithi125.stdout:6/57: chown f4 2 1 2024-02-19T19:12:06.586 INFO:tasks.workunit.client.1.smithi125.stdout:9/35: symlink d8/la 0 2024-02-19T19:12:06.586 INFO:tasks.workunit.client.1.smithi125.stdout:8/15: read f4 [10340,119317] 0 2024-02-19T19:12:06.586 INFO:tasks.workunit.client.1.smithi125.stdout:6/58: rename d6/ld to d6/l13 0 2024-02-19T19:12:06.586 INFO:tasks.workunit.client.1.smithi125.stdout:6/59: stat d6/ca 0 2024-02-19T19:12:06.586 INFO:tasks.workunit.client.1.smithi125.stdout:9/36: link l5 d8/lb 0 2024-02-19T19:12:06.587 INFO:tasks.workunit.client.1.smithi125.stdout:8/16: chown l2 27682273 1 2024-02-19T19:12:06.587 INFO:tasks.workunit.client.1.smithi125.stdout:9/37: chown l4 11 1 2024-02-19T19:12:06.587 INFO:tasks.workunit.client.1.smithi125.stdout:9/38: truncate f2 760041 0 2024-02-19T19:12:06.587 INFO:tasks.workunit.client.1.smithi125.stdout:8/17: unlink l1 0 2024-02-19T19:12:06.587 INFO:tasks.workunit.client.1.smithi125.stdout:9/39: read f6 [138290,32155] 0 2024-02-19T19:12:06.587 INFO:tasks.workunit.client.1.smithi125.stdout:8/18: rename l2 to l8 0 2024-02-19T19:12:06.587 INFO:tasks.workunit.client.1.smithi125.stdout:8/19: read f4 [893941,109682] 0 2024-02-19T19:12:06.587 INFO:tasks.workunit.client.1.smithi125.stdout:7/28: dwrite f1 [1593344,45056] 0 2024-02-19T19:12:06.587 INFO:tasks.workunit.client.1.smithi125.stdout:9/40: write f2 [841456,84685] 0 2024-02-19T19:12:06.588 INFO:tasks.workunit.client.1.smithi125.stdout:9/41: mknod d8/cc 0 2024-02-19T19:12:06.588 INFO:tasks.workunit.client.1.smithi125.stdout:7/29: creat f5 x:0 0 0 2024-02-19T19:12:06.588 INFO:tasks.workunit.client.1.smithi125.stdout:8/20: write f4 [1837937,115377] 0 2024-02-19T19:12:06.588 INFO:tasks.workunit.client.1.smithi125.stdout:9/42: write f7 [780409,70364] 0 2024-02-19T19:12:06.588 INFO:tasks.workunit.client.1.smithi125.stdout:8/21: unlink c6 0 2024-02-19T19:12:06.588 INFO:tasks.workunit.client.1.smithi125.stdout:9/43: write f3 [1356421,39452] 0 2024-02-19T19:12:06.588 INFO:tasks.workunit.client.1.smithi125.stdout:8/22: write f4 [603195,22619] 0 2024-02-19T19:12:06.588 INFO:tasks.workunit.client.1.smithi125.stdout:8/23: chown l5 71876422 1 2024-02-19T19:12:06.588 INFO:tasks.workunit.client.1.smithi125.stdout:9/44: symlink d8/ld 0 2024-02-19T19:12:06.589 INFO:tasks.workunit.client.1.smithi125.stdout:8/24: truncate f4 1109347 0 2024-02-19T19:12:06.589 INFO:tasks.workunit.client.1.smithi125.stdout:8/25: unlink c7 0 2024-02-19T19:12:06.589 INFO:tasks.workunit.client.1.smithi125.stdout:9/45: write f7 [1800821,42673] 0 2024-02-19T19:12:06.589 INFO:tasks.workunit.client.1.smithi125.stdout:9/46: readlink d8/lb 0 2024-02-19T19:12:06.589 INFO:tasks.workunit.client.1.smithi125.stdout:4/34: dwrite d0/fa [1941504,106496] 0 2024-02-19T19:12:06.589 INFO:tasks.workunit.client.1.smithi125.stdout:8/26: write f4 [1589884,47990] 0 2024-02-19T19:12:06.589 INFO:tasks.workunit.client.1.smithi125.stdout:4/35: mknod d0/d7/dc/c10 0 2024-02-19T19:12:06.589 INFO:tasks.workunit.client.1.smithi125.stdout:4/36: dread d0/fa [1765376,77824] 0 2024-02-19T19:12:06.590 INFO:tasks.workunit.client.1.smithi125.stdout:4/37: stat d0 0 2024-02-19T19:12:06.590 INFO:tasks.workunit.client.1.smithi125.stdout:5/46: dwrite f1 [917504,81920] 0 2024-02-19T19:12:06.590 INFO:tasks.workunit.client.1.smithi125.stdout:5/47: creat db/de/f11 x:0 0 0 2024-02-19T19:12:06.590 INFO:tasks.workunit.client.1.smithi125.stdout:5/48: dread - db/de/ff zero size 2024-02-19T19:12:06.590 INFO:tasks.workunit.client.1.smithi125.stdout:5/49: mknod db/de/c12 0 2024-02-19T19:12:06.591 INFO:tasks.workunit.client.1.smithi125.stdout:2/68: dread d1/f2 [1986560,81920] 0 2024-02-19T19:12:06.591 INFO:tasks.workunit.client.1.smithi125.stdout:2/69: chown d1/f2 61393 1 2024-02-19T19:12:06.591 INFO:tasks.workunit.client.1.smithi125.stdout:2/70: creat d1/d6/f11 x:0 0 0 2024-02-19T19:12:06.591 INFO:tasks.workunit.client.1.smithi125.stdout:2/71: creat d1/f12 x:0 0 0 2024-02-19T19:12:06.591 INFO:tasks.workunit.client.1.smithi125.stdout:2/72: chown d1/d6/f10 1973677418 1 2024-02-19T19:12:06.591 INFO:tasks.workunit.client.1.smithi125.stdout:2/73: write d1/d6/f11 [176030,103265] 0 2024-02-19T19:12:06.592 INFO:tasks.workunit.client.1.smithi125.stdout:2/74: mknod d1/d6/c13 0 2024-02-19T19:12:06.592 INFO:tasks.workunit.client.1.smithi125.stdout:2/75: link d1/d6/cb d1/d6/c14 0 2024-02-19T19:12:06.637 INFO:tasks.workunit.client.1.smithi125.stdout:7/30: dwrite f1 [1867776,45056] 0 2024-02-19T19:12:06.637 INFO:tasks.workunit.client.1.smithi125.stdout:7/31: symlink l6 0 2024-02-19T19:12:06.637 INFO:tasks.workunit.client.1.smithi125.stdout:7/32: creat f7 x:0 0 0 2024-02-19T19:12:06.638 INFO:tasks.workunit.client.1.smithi125.stdout:7/33: chown f7 0 1 2024-02-19T19:12:06.638 INFO:tasks.workunit.client.1.smithi125.stdout:6/60: dwrite d6/de/f10 [8192,40960] 0 2024-02-19T19:12:06.639 INFO:tasks.workunit.client.1.smithi125.stdout:6/61: truncate d6/de/f10 1002849 0 2024-02-19T19:12:06.639 INFO:tasks.workunit.client.1.smithi125.stdout:6/62: write d6/db/f11 [164878,90224] 0 2024-02-19T19:12:06.639 INFO:tasks.workunit.client.1.smithi125.stdout:6/63: creat d6/db/df/f14 x:0 0 0 2024-02-19T19:12:06.641 INFO:tasks.workunit.client.1.smithi125.stdout:2/76: dwrite d1/f2 [2465792,90112] 0 2024-02-19T19:12:06.641 INFO:tasks.workunit.client.1.smithi125.stdout:2/77: rmdir d1/d6 39 2024-02-19T19:12:06.641 INFO:tasks.workunit.client.1.smithi125.stdout:8/27: dwrite f4 [643072,86016] 0 2024-02-19T19:12:06.641 INFO:tasks.workunit.client.1.smithi125.stdout:8/28: readlink l5 0 2024-02-19T19:12:06.641 INFO:tasks.workunit.client.1.smithi125.stdout:8/29: write f4 [1443402,108523] 0 2024-02-19T19:12:06.641 INFO:tasks.workunit.client.1.smithi125.stdout:8/30: getdents . 0 2024-02-19T19:12:06.641 INFO:tasks.workunit.client.1.smithi125.stdout:5/50: dwrite f6 [1462272,122880] 0 2024-02-19T19:12:06.641 INFO:tasks.workunit.client.1.smithi125.stdout:7/34: dwrite f3 [475136,45056] 0 2024-02-19T19:12:06.642 INFO:tasks.workunit.client.1.smithi125.stdout:7/35: rmdir - no directory 2024-02-19T19:12:06.642 INFO:tasks.workunit.client.1.smithi125.stdout:7/36: dread - f7 zero size 2024-02-19T19:12:06.642 INFO:tasks.workunit.client.1.smithi125.stdout:7/37: truncate f3 1083576 0 2024-02-19T19:12:06.642 INFO:tasks.workunit.client.1.smithi125.stdout:7/38: creat f8 x:0 0 0 2024-02-19T19:12:06.642 INFO:tasks.workunit.client.1.smithi125.stdout:7/39: write f7 [48129,69915] 0 2024-02-19T19:12:06.642 INFO:tasks.workunit.client.1.smithi125.stdout:7/40: rename f3 to f9 0 2024-02-19T19:12:06.642 INFO:tasks.workunit.client.1.smithi125.stdout:7/41: creat fa x:0 0 0 2024-02-19T19:12:06.695 INFO:tasks.workunit.client.1.smithi125.stdout:8/31: dwrite f4 [2568192,4096] 0 2024-02-19T19:12:06.695 INFO:tasks.workunit.client.1.smithi125.stdout:8/32: mknod c9 0 2024-02-19T19:12:06.696 INFO:tasks.workunit.client.1.smithi125.stdout:8/33: write f4 [322862,107310] 0 2024-02-19T19:12:06.696 INFO:tasks.workunit.client.1.smithi125.stdout:8/34: mknod ca 0 2024-02-19T19:12:06.696 INFO:tasks.workunit.client.1.smithi125.stdout:8/35: write f4 [2124069,1840] 0 2024-02-19T19:12:06.696 INFO:tasks.workunit.client.1.smithi125.stdout:5/51: dwrite f1 [2338816,73728] 0 2024-02-19T19:12:06.696 INFO:tasks.workunit.client.1.smithi125.stdout:8/36: unlink c9 0 2024-02-19T19:12:06.696 INFO:tasks.workunit.client.1.smithi125.stdout:5/52: chown db/cd 20751 1 2024-02-19T19:12:06.696 INFO:tasks.workunit.client.1.smithi125.stdout:8/37: mkdir db 0 2024-02-19T19:12:06.697 INFO:tasks.workunit.client.1.smithi125.stdout:5/53: mknod db/c13 0 2024-02-19T19:12:06.697 INFO:tasks.workunit.client.1.smithi125.stdout:8/38: write f4 [146292,20105] 0 2024-02-19T19:12:06.697 INFO:tasks.workunit.client.1.smithi125.stdout:8/39: chown l8 1 1 2024-02-19T19:12:06.697 INFO:tasks.workunit.client.1.smithi125.stdout:5/54: getdents db/de 0 2024-02-19T19:12:06.697 INFO:tasks.workunit.client.1.smithi125.stdout:8/40: creat db/fc x:0 0 0 2024-02-19T19:12:06.697 INFO:tasks.workunit.client.1.smithi125.stdout:8/41: symlink db/ld 0 2024-02-19T19:12:06.697 INFO:tasks.workunit.client.1.smithi125.stdout:5/55: rename l2 to db/de/l14 0 2024-02-19T19:12:06.698 INFO:tasks.workunit.client.1.smithi125.stdout:5/56: chown db/de/l14 54057954 1 2024-02-19T19:12:06.698 INFO:tasks.workunit.client.1.smithi125.stdout:8/42: creat db/fe x:0 0 0 2024-02-19T19:12:06.698 INFO:tasks.workunit.client.1.smithi125.stdout:5/57: creat db/de/f15 x:0 0 0 2024-02-19T19:12:06.698 INFO:tasks.workunit.client.1.smithi125.stdout:8/43: symlink db/lf 0 2024-02-19T19:12:06.698 INFO:tasks.workunit.client.1.smithi125.stdout:5/58: dread - db/de/ff zero size 2024-02-19T19:12:06.698 INFO:tasks.workunit.client.1.smithi125.stdout:5/59: unlink c8 0 2024-02-19T19:12:06.698 INFO:tasks.workunit.client.1.smithi125.stdout:5/60: write f6 [1166347,28195] 0 2024-02-19T19:12:06.698 INFO:tasks.workunit.client.1.smithi125.stdout:5/61: symlink db/l16 0 2024-02-19T19:12:06.698 INFO:tasks.workunit.client.1.smithi125.stdout:5/62: write db/f10 [1017580,48981] 0 2024-02-19T19:12:06.699 INFO:tasks.workunit.client.1.smithi125.stdout:5/63: write db/de/ff [1012109,98358] 0 2024-02-19T19:12:06.699 INFO:tasks.workunit.client.1.smithi125.stdout:5/64: chown db 5244 1 2024-02-19T19:12:06.699 INFO:tasks.workunit.client.1.smithi125.stdout:5/65: write db/de/ff [530113,9303] 0 2024-02-19T19:12:06.699 INFO:tasks.workunit.client.1.smithi125.stdout:5/66: dread db/f10 [208896,4096] 0 2024-02-19T19:12:06.699 INFO:tasks.workunit.client.1.smithi125.stdout:5/67: mkdir db/d17 0 2024-02-19T19:12:06.699 INFO:tasks.workunit.client.1.smithi125.stdout:2/78: write d1/d6/f10 [247997,64272] 0 2024-02-19T19:12:06.700 INFO:tasks.workunit.client.1.smithi125.stdout:0/64: sync 2024-02-19T19:12:06.701 INFO:tasks.workunit.client.1.smithi125.stdout:0/65: mkdir d5/d19 0 2024-02-19T19:12:06.701 INFO:tasks.workunit.client.1.smithi125.stdout:2/79: link d1/d6/cb d1/d3/c15 0 2024-02-19T19:12:06.701 INFO:tasks.workunit.client.1.smithi125.stdout:2/80: readlink d1/d3/l9 0 2024-02-19T19:12:06.701 INFO:tasks.workunit.client.1.smithi125.stdout:8/44: dwrite f4 [245760,94208] 0 2024-02-19T19:12:06.701 INFO:tasks.workunit.client.1.smithi125.stdout:8/45: read f4 [1688797,36539] 0 2024-02-19T19:12:06.701 INFO:tasks.workunit.client.1.smithi125.stdout:8/46: creat db/f10 x:0 0 0 2024-02-19T19:12:06.701 INFO:tasks.workunit.client.1.smithi125.stdout:8/47: dread - db/f10 zero size 2024-02-19T19:12:06.701 INFO:tasks.workunit.client.1.smithi125.stdout:8/48: read - db/fe zero size 2024-02-19T19:12:06.702 INFO:tasks.workunit.client.1.smithi125.stdout:8/49: symlink db/l11 0 2024-02-19T19:12:06.702 INFO:tasks.workunit.client.1.smithi125.stdout:8/50: dread - db/fc zero size 2024-02-19T19:12:06.702 INFO:tasks.workunit.client.1.smithi125.stdout:8/51: unlink ca 0 2024-02-19T19:12:06.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:06 smithi125 ceph-mon[86115]: pgmap v148: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 636 B/s wr, 4 op/s; 9 B/s, 0 objects/s recovering 2024-02-19T19:12:06.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:06.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:12:06.776 INFO:tasks.workunit.client.1.smithi125.stdout:2/81: read d1/fd [2068622,50827] 0 2024-02-19T19:12:06.776 INFO:tasks.workunit.client.1.smithi125.stdout:2/82: truncate d1/ff 788820 0 2024-02-19T19:12:06.776 INFO:tasks.workunit.client.1.smithi125.stdout:2/83: mkdir d1/d3/d16 0 2024-02-19T19:12:06.777 INFO:tasks.workunit.client.1.smithi125.stdout:2/84: symlink d1/l17 0 2024-02-19T19:12:06.777 INFO:tasks.workunit.client.1.smithi125.stdout:2/85: truncate d1/fd 398522 0 2024-02-19T19:12:06.777 INFO:tasks.workunit.client.1.smithi125.stdout:2/86: symlink d1/l18 0 2024-02-19T19:12:06.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:06 smithi096 ceph-mon[112483]: pgmap v148: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 636 B/s wr, 4 op/s; 9 B/s, 0 objects/s recovering 2024-02-19T19:12:06.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:06.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:12:06.801 INFO:tasks.workunit.client.1.smithi125.stdout:6/64: fsync d6/db/df/f12 0 2024-02-19T19:12:06.801 INFO:tasks.workunit.client.1.smithi125.stdout:7/42: fdatasync f8 0 2024-02-19T19:12:06.801 INFO:tasks.workunit.client.1.smithi125.stdout:3/64: fdatasync d0/ff 0 2024-02-19T19:12:06.801 INFO:tasks.workunit.client.1.smithi125.stdout:7/43: chown f2 9 1 2024-02-19T19:12:06.807 INFO:tasks.workunit.client.1.smithi125.stdout:3/65: truncate d0/ff 303282 0 2024-02-19T19:12:06.807 INFO:tasks.workunit.client.1.smithi125.stdout:6/65: write d6/f9 [1130778,102122] 0 2024-02-19T19:12:06.807 INFO:tasks.workunit.client.1.smithi125.stdout:6/66: readlink d6/l13 0 2024-02-19T19:12:06.832 INFO:tasks.workunit.client.1.smithi125.stdout:7/44: fsync f9 0 2024-02-19T19:12:06.832 INFO:tasks.workunit.client.1.smithi125.stdout:7/45: stat f7 0 2024-02-19T19:12:06.833 INFO:tasks.workunit.client.1.smithi125.stdout:7/46: getdents . 0 2024-02-19T19:12:06.833 INFO:tasks.workunit.client.1.smithi125.stdout:6/67: fsync f4 0 2024-02-19T19:12:06.833 INFO:tasks.workunit.client.1.smithi125.stdout:6/68: rename d6 to d6/d15 22 2024-02-19T19:12:06.833 INFO:tasks.workunit.client.1.smithi125.stdout:6/69: truncate d6/f9 958553 0 2024-02-19T19:12:06.833 INFO:tasks.workunit.client.1.smithi125.stdout:6/70: getdents d6/de 0 2024-02-19T19:12:06.834 INFO:tasks.workunit.client.1.smithi125.stdout:7/47: read f7 [7407,29923] 0 2024-02-19T19:12:06.834 INFO:tasks.workunit.client.1.smithi125.stdout:7/48: stat l6 0 2024-02-19T19:12:06.834 INFO:tasks.workunit.client.1.smithi125.stdout:7/49: rmdir - no directory 2024-02-19T19:12:06.835 INFO:tasks.workunit.client.1.smithi125.stdout:7/50: rename f9 to fb 0 2024-02-19T19:12:06.835 INFO:tasks.workunit.client.1.smithi125.stdout:7/51: chown f1 87 1 2024-02-19T19:12:06.835 INFO:tasks.workunit.client.1.smithi125.stdout:7/52: creat fc x:0 0 0 2024-02-19T19:12:06.835 INFO:tasks.workunit.client.1.smithi125.stdout:7/53: truncate fb 717588 0 2024-02-19T19:12:06.835 INFO:tasks.workunit.client.1.smithi125.stdout:7/54: readlink l6 0 2024-02-19T19:12:06.835 INFO:tasks.workunit.client.1.smithi125.stdout:7/55: dread - f8 zero size 2024-02-19T19:12:06.864 INFO:tasks.workunit.client.1.smithi125.stdout:3/66: dwrite d0/d1/fc [2297856,12288] 0 2024-02-19T19:12:06.864 INFO:tasks.workunit.client.1.smithi125.stdout:3/67: dread - d0/f12 zero size 2024-02-19T19:12:06.868 INFO:tasks.workunit.client.1.smithi125.stdout:7/56: dwrite f5 [905216,28672] 0 2024-02-19T19:12:06.975 INFO:tasks.workunit.client.1.smithi125.stdout:2/87: fsync d1/d6/f10 0 2024-02-19T19:12:06.976 INFO:tasks.workunit.client.1.smithi125.stdout:9/47: fdatasync f6 0 2024-02-19T19:12:06.976 INFO:tasks.workunit.client.1.smithi125.stdout:5/68: fdatasync db/f10 0 2024-02-19T19:12:06.976 INFO:tasks.workunit.client.1.smithi125.stdout:2/88: read - d1/f12 zero size 2024-02-19T19:12:06.976 INFO:tasks.workunit.client.1.smithi125.stdout:7/57: dread f7 [69632,94208] 0 2024-02-19T19:12:06.976 INFO:tasks.workunit.client.1.smithi125.stdout:2/89: readlink d1/l18 0 2024-02-19T19:12:06.976 INFO:tasks.workunit.client.1.smithi125.stdout:5/69: unlink db/de/f11 0 2024-02-19T19:12:06.976 INFO:tasks.workunit.client.1.smithi125.stdout:5/70: rmdir db/de 39 2024-02-19T19:12:06.977 INFO:tasks.workunit.client.1.smithi125.stdout:5/71: mknod db/de/c18 0 2024-02-19T19:12:06.977 INFO:tasks.workunit.client.1.smithi125.stdout:9/48: creat d8/fe x:0 0 0 2024-02-19T19:12:06.978 INFO:tasks.workunit.client.1.smithi125.stdout:7/58: mknod cd 0 2024-02-19T19:12:06.979 INFO:tasks.workunit.client.1.smithi125.stdout:2/90: mknod d1/c19 0 2024-02-19T19:12:06.979 INFO:tasks.workunit.client.1.smithi125.stdout:7/59: mknod ce 0 2024-02-19T19:12:06.979 INFO:tasks.workunit.client.1.smithi125.stdout:7/60: rmdir - no directory 2024-02-19T19:12:06.979 INFO:tasks.workunit.client.1.smithi125.stdout:7/61: truncate f1 1792648 0 2024-02-19T19:12:06.979 INFO:tasks.workunit.client.1.smithi125.stdout:9/49: write f6 [1273140,73545] 0 2024-02-19T19:12:06.979 INFO:tasks.workunit.client.1.smithi125.stdout:9/50: truncate f1 632455 0 2024-02-19T19:12:06.979 INFO:tasks.workunit.client.1.smithi125.stdout:9/51: symlink d8/lf 0 2024-02-19T19:12:06.979 INFO:tasks.workunit.client.1.smithi125.stdout:9/52: stat f6 0 2024-02-19T19:12:06.980 INFO:tasks.workunit.client.1.smithi125.stdout:7/62: write f7 [1029344,103955] 0 2024-02-19T19:12:06.980 INFO:tasks.workunit.client.1.smithi125.stdout:9/53: dread f6 [618496,126976] 0 2024-02-19T19:12:06.980 INFO:tasks.workunit.client.1.smithi125.stdout:7/63: chown f8 89090481 1 2024-02-19T19:12:06.980 INFO:tasks.workunit.client.1.smithi125.stdout:7/64: mknod cf 0 2024-02-19T19:12:06.980 INFO:tasks.workunit.client.1.smithi125.stdout:7/65: dread fb [241664,90112] 0 2024-02-19T19:12:06.980 INFO:tasks.workunit.client.1.smithi125.stdout:7/66: creat f10 x:0 0 0 2024-02-19T19:12:07.012 INFO:tasks.workunit.client.1.smithi125.stdout:9/54: dwrite d8/fe [1024000,77824] 0 2024-02-19T19:12:07.012 INFO:tasks.workunit.client.1.smithi125.stdout:9/55: rename l5 to d8/l10 0 2024-02-19T19:12:07.062 INFO:tasks.workunit.client.1.smithi125.stdout:2/91: fsync d1/fd 0 2024-02-19T19:12:07.062 INFO:tasks.workunit.client.1.smithi125.stdout:6/71: fsync d6/f9 0 2024-02-19T19:12:07.062 INFO:tasks.workunit.client.1.smithi125.stdout:5/72: fdatasync db/de/ff 0 2024-02-19T19:12:07.063 INFO:tasks.workunit.client.1.smithi125.stdout:5/73: chown db/cd 928120 1 2024-02-19T19:12:07.063 INFO:tasks.workunit.client.1.smithi125.stdout:8/52: fsync f4 0 2024-02-19T19:12:07.063 INFO:tasks.workunit.client.1.smithi125.stdout:1/65: sync 2024-02-19T19:12:07.064 INFO:tasks.workunit.client.1.smithi125.stdout:8/53: mknod db/c12 0 2024-02-19T19:12:07.065 INFO:tasks.workunit.client.1.smithi125.stdout:5/74: creat db/d17/f19 x:0 0 0 2024-02-19T19:12:07.065 INFO:tasks.workunit.client.1.smithi125.stdout:2/92: truncate d1/d6/f10 176280 0 2024-02-19T19:12:07.065 INFO:tasks.workunit.client.1.smithi125.stdout:8/54: mknod db/c13 0 2024-02-19T19:12:07.065 INFO:tasks.workunit.client.1.smithi125.stdout:5/75: link db/de/l14 db/l1a 0 2024-02-19T19:12:07.065 INFO:tasks.workunit.client.1.smithi125.stdout:6/72: write d6/db/f11 [1357379,74205] 0 2024-02-19T19:12:07.065 INFO:tasks.workunit.client.1.smithi125.stdout:2/93: symlink d1/d3/d16/l1a 0 2024-02-19T19:12:07.065 INFO:tasks.workunit.client.1.smithi125.stdout:6/73: mkdir d6/db/df/d16 0 2024-02-19T19:12:07.065 INFO:tasks.workunit.client.1.smithi125.stdout:2/94: unlink d1/d6/c13 0 2024-02-19T19:12:07.066 INFO:tasks.workunit.client.1.smithi125.stdout:6/74: dread - d6/db/df/f14 zero size 2024-02-19T19:12:07.066 INFO:tasks.workunit.client.1.smithi125.stdout:6/75: chown d6/db/df/f14 26671301 1 2024-02-19T19:12:07.066 INFO:tasks.workunit.client.1.smithi125.stdout:8/55: write db/f10 [881675,107375] 0 2024-02-19T19:12:07.066 INFO:tasks.workunit.client.1.smithi125.stdout:2/95: dread d1/d6/f8 [143360,110592] 0 2024-02-19T19:12:07.066 INFO:tasks.workunit.client.1.smithi125.stdout:2/96: dread - d1/f12 zero size 2024-02-19T19:12:07.105 INFO:tasks.workunit.client.1.smithi125.stdout:8/56: dwrite db/f10 [397312,20480] 0 2024-02-19T19:12:07.105 INFO:tasks.workunit.client.1.smithi125.stdout:8/57: truncate db/fc 912398 0 2024-02-19T19:12:07.105 INFO:tasks.workunit.client.1.smithi125.stdout:8/58: dread - db/fe zero size 2024-02-19T19:12:07.105 INFO:tasks.workunit.client.1.smithi125.stdout:8/59: truncate db/fc 1652217 0 2024-02-19T19:12:07.124 INFO:tasks.workunit.client.1.smithi125.stdout:5/76: fdatasync db/de/ff 0 2024-02-19T19:12:07.124 INFO:tasks.workunit.client.1.smithi125.stdout:2/97: fsync d1/f2 0 2024-02-19T19:12:07.124 INFO:tasks.workunit.client.1.smithi125.stdout:5/77: creat db/d17/f1b x:0 0 0 2024-02-19T19:12:07.130 INFO:tasks.workunit.client.1.smithi125.stdout:5/78: fsync f6 0 2024-02-19T19:12:07.134 INFO:tasks.workunit.client.1.smithi125.stdout:9/56: sync 2024-02-19T19:12:07.134 INFO:tasks.workunit.client.1.smithi125.stdout:3/68: sync 2024-02-19T19:12:07.135 INFO:tasks.workunit.client.1.smithi125.stdout:7/67: sync 2024-02-19T19:12:07.135 INFO:tasks.workunit.client.1.smithi125.stdout:4/38: sync 2024-02-19T19:12:07.135 INFO:tasks.workunit.client.1.smithi125.stdout:0/66: sync 2024-02-19T19:12:07.135 INFO:tasks.workunit.client.1.smithi125.stdout:0/67: chown d5/l10 0 1 2024-02-19T19:12:07.135 INFO:tasks.workunit.client.1.smithi125.stdout:8/60: dwrite db/f10 [1003520,94208] 0 2024-02-19T19:12:07.135 INFO:tasks.workunit.client.1.smithi125.stdout:5/79: creat db/de/f1c x:0 0 0 2024-02-19T19:12:07.135 INFO:tasks.workunit.client.1.smithi125.stdout:9/57: creat d8/f11 x:0 0 0 2024-02-19T19:12:07.136 INFO:tasks.workunit.client.1.smithi125.stdout:0/68: mkdir d5/d1a 0 2024-02-19T19:12:07.136 INFO:tasks.workunit.client.1.smithi125.stdout:7/68: creat f11 x:0 0 0 2024-02-19T19:12:07.136 INFO:tasks.workunit.client.1.smithi125.stdout:5/80: chown c9 63249501 1 2024-02-19T19:12:07.136 INFO:tasks.workunit.client.1.smithi125.stdout:7/69: chown cf 13591 1 2024-02-19T19:12:07.136 INFO:tasks.workunit.client.1.smithi125.stdout:7/70: rmdir - no directory 2024-02-19T19:12:07.136 INFO:tasks.workunit.client.1.smithi125.stdout:5/81: dread - db/de/f15 zero size 2024-02-19T19:12:07.136 INFO:tasks.workunit.client.1.smithi125.stdout:5/82: chown db/de/ff 53688290 1 2024-02-19T19:12:07.136 INFO:tasks.workunit.client.1.smithi125.stdout:5/83: chown db/de/ff 11714525 1 2024-02-19T19:12:07.136 INFO:tasks.workunit.client.1.smithi125.stdout:7/71: unlink f2 0 2024-02-19T19:12:07.137 INFO:tasks.workunit.client.1.smithi125.stdout:9/58: mkdir d8/d12 0 2024-02-19T19:12:07.137 INFO:tasks.workunit.client.1.smithi125.stdout:5/84: creat db/f1d x:0 0 0 2024-02-19T19:12:07.137 INFO:tasks.workunit.client.1.smithi125.stdout:5/85: rename db/d17/f19 to db/d17/f1e 0 2024-02-19T19:12:07.137 INFO:tasks.workunit.client.1.smithi125.stdout:7/72: mkdir d12 0 2024-02-19T19:12:07.137 INFO:tasks.workunit.client.1.smithi125.stdout:9/59: write d8/fe [17536,32362] 0 2024-02-19T19:12:07.137 INFO:tasks.workunit.client.1.smithi125.stdout:7/73: write f7 [688255,20980] 0 2024-02-19T19:12:07.137 INFO:tasks.workunit.client.1.smithi125.stdout:5/86: read db/f10 [839205,52968] 0 2024-02-19T19:12:07.137 INFO:tasks.workunit.client.1.smithi125.stdout:8/61: write db/fe [751248,114142] 0 2024-02-19T19:12:07.137 INFO:tasks.workunit.client.1.smithi125.stdout:7/74: rename f10 to d12/f13 0 2024-02-19T19:12:07.138 INFO:tasks.workunit.client.1.smithi125.stdout:5/87: rename db/de/f15 to db/de/f1f 0 2024-02-19T19:12:07.138 INFO:tasks.workunit.client.1.smithi125.stdout:5/88: chown db/cd 32375 1 2024-02-19T19:12:07.138 INFO:tasks.workunit.client.1.smithi125.stdout:8/62: rename l5 to db/l14 0 2024-02-19T19:12:07.138 INFO:tasks.workunit.client.1.smithi125.stdout:8/63: rmdir db 39 2024-02-19T19:12:07.138 INFO:tasks.workunit.client.1.smithi125.stdout:7/75: write f5 [761917,57149] 0 2024-02-19T19:12:07.138 INFO:tasks.workunit.client.1.smithi125.stdout:8/64: write db/f10 [57728,31] 0 2024-02-19T19:12:07.138 INFO:tasks.workunit.client.1.smithi125.stdout:8/65: mknod db/c15 0 2024-02-19T19:12:07.174 INFO:tasks.workunit.client.1.smithi125.stdout:3/69: fdatasync d0/de/f10 0 2024-02-19T19:12:07.175 INFO:tasks.workunit.client.1.smithi125.stdout:9/60: fsync f2 0 2024-02-19T19:12:07.175 INFO:tasks.workunit.client.1.smithi125.stdout:2/98: dwrite d1/ff [57344,4096] 0 2024-02-19T19:12:07.176 INFO:tasks.workunit.client.1.smithi125.stdout:2/99: dread d1/fd [131072,98304] 0 2024-02-19T19:12:07.176 INFO:tasks.workunit.client.1.smithi125.stdout:2/100: mkdir d1/d3/d1b 0 2024-02-19T19:12:07.176 INFO:tasks.workunit.client.1.smithi125.stdout:2/101: creat d1/d6/f1c x:0 0 0 2024-02-19T19:12:07.176 INFO:tasks.workunit.client.1.smithi125.stdout:2/102: rename d1/d3 to d1/d6/d1d 0 2024-02-19T19:12:07.179 INFO:tasks.workunit.client.1.smithi125.stdout:7/76: dwrite f8 [176128,16384] 0 2024-02-19T19:12:07.180 INFO:tasks.workunit.client.1.smithi125.stdout:4/39: dwrite d0/d7/dc/f9 [1019904,110592] 0 2024-02-19T19:12:07.180 INFO:tasks.workunit.client.1.smithi125.stdout:4/40: dread d0/d7/dc/fd [339968,86016] 0 2024-02-19T19:12:07.180 INFO:tasks.workunit.client.1.smithi125.stdout:4/41: getdents d0/df 0 2024-02-19T19:12:07.180 INFO:tasks.workunit.client.1.smithi125.stdout:7/77: truncate f5 315310 0 2024-02-19T19:12:07.180 INFO:tasks.workunit.client.1.smithi125.stdout:7/78: mknod d12/c14 0 2024-02-19T19:12:07.180 INFO:tasks.workunit.client.1.smithi125.stdout:7/79: dread - fc zero size 2024-02-19T19:12:07.180 INFO:tasks.workunit.client.1.smithi125.stdout:7/80: dread - fa zero size 2024-02-19T19:12:07.180 INFO:tasks.workunit.client.1.smithi125.stdout:7/81: dread f8 [61440,81920] 0 2024-02-19T19:12:07.181 INFO:tasks.workunit.client.1.smithi125.stdout:7/82: write f8 [350989,12988] 0 2024-02-19T19:12:07.181 INFO:tasks.workunit.client.1.smithi125.stdout:7/83: symlink d12/l15 0 2024-02-19T19:12:07.181 INFO:tasks.workunit.client.1.smithi125.stdout:8/66: dwrite f4 [712704,65536] 0 2024-02-19T19:12:07.181 INFO:tasks.workunit.client.1.smithi125.stdout:3/70: dwrite d0/de/f11 [438272,102400] 0 2024-02-19T19:12:07.181 INFO:tasks.workunit.client.1.smithi125.stdout:3/71: chown d0/de/f10 293 1 2024-02-19T19:12:07.181 INFO:tasks.workunit.client.1.smithi125.stdout:3/72: dread d0/ff [0,4096] 0 2024-02-19T19:12:07.181 INFO:tasks.workunit.client.1.smithi125.stdout:3/73: link d0/d1/fc d0/de/f13 0 2024-02-19T19:12:07.181 INFO:tasks.workunit.client.1.smithi125.stdout:3/74: creat d0/de/f14 x:0 0 0 2024-02-19T19:12:07.181 INFO:tasks.workunit.client.1.smithi125.stdout:0/69: dwrite d5/ff [1003520,8192] 0 2024-02-19T19:12:07.182 INFO:tasks.workunit.client.1.smithi125.stdout:0/70: symlink d5/d15/l1b 0 2024-02-19T19:12:07.182 INFO:tasks.workunit.client.1.smithi125.stdout:0/71: mknod d5/d1a/c1c 0 2024-02-19T19:12:07.182 INFO:tasks.workunit.client.1.smithi125.stdout:0/72: creat d5/d9/f1d x:0 0 0 2024-02-19T19:12:07.182 INFO:tasks.workunit.client.1.smithi125.stdout:0/73: truncate d5/d9/f1d 214235 0 2024-02-19T19:12:07.182 INFO:tasks.workunit.client.1.smithi125.stdout:0/74: symlink d5/d9/l1e 0 2024-02-19T19:12:07.182 INFO:tasks.workunit.client.1.smithi125.stdout:0/75: dread d5/d9/fb [708608,28672] 0 2024-02-19T19:12:07.182 INFO:tasks.workunit.client.1.smithi125.stdout:0/76: stat d5/le 0 2024-02-19T19:12:07.182 INFO:tasks.workunit.client.1.smithi125.stdout:0/77: readlink d5/le 0 2024-02-19T19:12:07.183 INFO:tasks.workunit.client.1.smithi125.stdout:0/78: creat d5/f1f x:0 0 0 2024-02-19T19:12:07.183 INFO:tasks.workunit.client.1.smithi125.stdout:0/79: rename f2 to d5/d1a/f20 0 2024-02-19T19:12:07.183 INFO:tasks.workunit.client.1.smithi125.stdout:0/80: rename d5 to d5/d21 22 2024-02-19T19:12:07.247 INFO:tasks.workunit.client.1.smithi125.stdout:9/61: fsync f2 0 2024-02-19T19:12:07.248 INFO:tasks.workunit.client.1.smithi125.stdout:2/103: fsync d1/f2 0 2024-02-19T19:12:07.248 INFO:tasks.workunit.client.1.smithi125.stdout:6/76: fdatasync d6/db/f11 0 2024-02-19T19:12:07.248 INFO:tasks.workunit.client.1.smithi125.stdout:9/62: truncate f1 687945 0 2024-02-19T19:12:07.248 INFO:tasks.workunit.client.1.smithi125.stdout:2/104: link d1/f12 d1/d6/f1e 0 2024-02-19T19:12:07.248 INFO:tasks.workunit.client.1.smithi125.stdout:2/105: stat d1 0 2024-02-19T19:12:07.248 INFO:tasks.workunit.client.1.smithi125.stdout:9/63: stat d8/f9 0 2024-02-19T19:12:07.249 INFO:tasks.workunit.client.1.smithi125.stdout:6/77: dread - d6/db/df/f14 zero size 2024-02-19T19:12:07.249 INFO:tasks.workunit.client.1.smithi125.stdout:2/106: dread - d1/f12 zero size 2024-02-19T19:12:07.251 INFO:tasks.workunit.client.1.smithi125.stdout:6/78: dread d6/de/f10 [278528,57344] 0 2024-02-19T19:12:07.251 INFO:tasks.workunit.client.1.smithi125.stdout:6/79: dread - d6/db/df/f14 zero size 2024-02-19T19:12:07.252 INFO:tasks.workunit.client.1.smithi125.stdout:1/66: sync 2024-02-19T19:12:07.283 INFO:tasks.workunit.client.1.smithi125.stdout:2/107: fsync d1/d6/f8 0 2024-02-19T19:12:07.285 INFO:tasks.workunit.client.1.smithi125.stdout:4/42: dwrite d0/d7/dc/f9 [1875968,81920] 0 2024-02-19T19:12:07.286 INFO:tasks.workunit.client.1.smithi125.stdout:1/67: readlink d1/l13 0 2024-02-19T19:12:07.286 INFO:tasks.workunit.client.1.smithi125.stdout:7/84: dwrite d12/f13 [36864,86016] 0 2024-02-19T19:12:07.286 INFO:tasks.workunit.client.1.smithi125.stdout:0/81: dread d5/d1a/f20 [352256,77824] 0 2024-02-19T19:12:07.286 INFO:tasks.workunit.client.1.smithi125.stdout:0/82: chown d5/l7 628763 1 2024-02-19T19:12:07.286 INFO:tasks.workunit.client.1.smithi125.stdout:7/85: mknod d12/c16 0 2024-02-19T19:12:07.286 INFO:tasks.workunit.client.1.smithi125.stdout:0/83: dread d5/ff [724992,45056] 0 2024-02-19T19:12:07.286 INFO:tasks.workunit.client.1.smithi125.stdout:3/75: dwrite d0/de/f14 [602112,65536] 0 2024-02-19T19:12:07.287 INFO:tasks.workunit.client.1.smithi125.stdout:8/67: dread db/f10 [397312,61440] 0 2024-02-19T19:12:07.287 INFO:tasks.workunit.client.1.smithi125.stdout:8/68: chown db/lf 826071 1 2024-02-19T19:12:07.287 INFO:tasks.workunit.client.1.smithi125.stdout:0/84: write d5/f16 [1973583,26646] 0 2024-02-19T19:12:07.287 INFO:tasks.workunit.client.1.smithi125.stdout:0/85: truncate d5/f1f 918434 0 2024-02-19T19:12:07.287 INFO:tasks.workunit.client.1.smithi125.stdout:0/86: write d5/f8 [1034790,14579] 0 2024-02-19T19:12:07.287 INFO:tasks.workunit.client.1.smithi125.stdout:2/108: dwrite d1/f12 [544768,28672] 0 2024-02-19T19:12:07.287 INFO:tasks.workunit.client.1.smithi125.stdout:0/87: dread d5/f1f [831488,102400] 0 2024-02-19T19:12:07.287 INFO:tasks.workunit.client.1.smithi125.stdout:0/88: dread d5/d9/fd [532480,98304] 0 2024-02-19T19:12:07.288 INFO:tasks.workunit.client.1.smithi125.stdout:4/43: write d0/d7/dc/fd [666522,128721] 0 2024-02-19T19:12:07.288 INFO:tasks.workunit.client.1.smithi125.stdout:4/44: chown d0/c1 385 1 2024-02-19T19:12:07.288 INFO:tasks.workunit.client.1.smithi125.stdout:0/89: dread d5/d9/fb [581632,98304] 0 2024-02-19T19:12:07.288 INFO:tasks.workunit.client.1.smithi125.stdout:4/45: write d0/d7/dc/f9 [2203801,105191] 0 2024-02-19T19:12:07.288 INFO:tasks.workunit.client.1.smithi125.stdout:4/46: creat d0/df/f11 x:0 0 0 2024-02-19T19:12:07.288 INFO:tasks.workunit.client.1.smithi125.stdout:4/47: truncate d0/df/f11 773308 0 2024-02-19T19:12:07.288 INFO:tasks.workunit.client.1.smithi125.stdout:4/48: read d0/d7/dc/f9 [763786,115548] 0 2024-02-19T19:12:07.289 INFO:tasks.workunit.client.1.smithi125.stdout:4/49: creat d0/f12 x:0 0 0 2024-02-19T19:12:07.289 INFO:tasks.workunit.client.1.smithi125.stdout:4/50: dread - d0/f12 zero size 2024-02-19T19:12:07.318 INFO:tasks.workunit.client.1.smithi125.stdout:6/80: dwrite d6/f9 [909312,61440] 0 2024-02-19T19:12:07.318 INFO:tasks.workunit.client.1.smithi125.stdout:6/81: creat d6/db/f17 x:0 0 0 2024-02-19T19:12:07.318 INFO:tasks.workunit.client.1.smithi125.stdout:6/82: chown d6/de/f10 17249953 1 2024-02-19T19:12:07.318 INFO:tasks.workunit.client.1.smithi125.stdout:6/83: stat d6/db/df/f12 0 2024-02-19T19:12:07.318 INFO:tasks.workunit.client.1.smithi125.stdout:6/84: dread - d6/db/df/f12 zero size 2024-02-19T19:12:07.318 INFO:tasks.workunit.client.1.smithi125.stdout:6/85: getdents d6/db/df/d16 0 2024-02-19T19:12:07.319 INFO:tasks.workunit.client.1.smithi125.stdout:6/86: dread d6/de/f10 [819200,73728] 0 2024-02-19T19:12:07.319 INFO:tasks.workunit.client.1.smithi125.stdout:6/87: write d6/db/df/f14 [218566,44892] 0 2024-02-19T19:12:07.319 INFO:tasks.workunit.client.1.smithi125.stdout:6/88: write d6/db/df/f12 [60571,16324] 0 2024-02-19T19:12:07.319 INFO:tasks.workunit.client.1.smithi125.stdout:6/89: symlink d6/l18 0 2024-02-19T19:12:07.319 INFO:tasks.workunit.client.1.smithi125.stdout:6/90: truncate d6/f9 521472 0 2024-02-19T19:12:07.319 INFO:tasks.workunit.client.1.smithi125.stdout:6/91: write d6/de/f10 [661802,7482] 0 2024-02-19T19:12:07.319 INFO:tasks.workunit.client.1.smithi125.stdout:3/76: dwrite d0/de/f13 [372736,28672] 0 2024-02-19T19:12:07.319 INFO:tasks.workunit.client.1.smithi125.stdout:3/77: truncate d0/ff 137343 0 2024-02-19T19:12:07.320 INFO:tasks.workunit.client.1.smithi125.stdout:3/78: creat d0/f15 x:0 0 0 2024-02-19T19:12:07.320 INFO:tasks.workunit.client.1.smithi125.stdout:3/79: write d0/de/f10 [42422,108539] 0 2024-02-19T19:12:07.320 INFO:tasks.workunit.client.1.smithi125.stdout:3/80: symlink d0/d1/l16 0 2024-02-19T19:12:07.320 INFO:tasks.workunit.client.1.smithi125.stdout:3/81: truncate d0/de/f10 51762 0 2024-02-19T19:12:07.320 INFO:tasks.workunit.client.1.smithi125.stdout:3/82: write d0/ff [1033354,117380] 0 2024-02-19T19:12:07.320 INFO:tasks.workunit.client.1.smithi125.stdout:3/83: chown d0/de 1 1 2024-02-19T19:12:07.320 INFO:tasks.workunit.client.1.smithi125.stdout:0/90: dwrite d5/f16 [1290240,118784] 0 2024-02-19T19:12:07.320 INFO:tasks.workunit.client.1.smithi125.stdout:0/91: mknod d5/d19/c22 0 2024-02-19T19:12:07.321 INFO:tasks.workunit.client.1.smithi125.stdout:0/92: write d5/f18 [348913,130075] 0 2024-02-19T19:12:07.321 INFO:tasks.workunit.client.1.smithi125.stdout:0/93: rmdir d5/d15 39 2024-02-19T19:12:07.321 INFO:tasks.workunit.client.1.smithi125.stdout:1/68: dwrite f0 [1662976,20480] 0 2024-02-19T19:12:07.321 INFO:tasks.workunit.client.1.smithi125.stdout:1/69: dread f0 [1187840,45056] 0 2024-02-19T19:12:07.321 INFO:tasks.workunit.client.1.smithi125.stdout:1/70: readlink d1/dc/l10 0 2024-02-19T19:12:07.321 INFO:tasks.workunit.client.1.smithi125.stdout:1/71: read d1/f9 [1124976,113171] 0 2024-02-19T19:12:07.321 INFO:tasks.workunit.client.1.smithi125.stdout:1/72: write f0 [2605617,84656] 0 2024-02-19T19:12:07.321 INFO:tasks.workunit.client.1.smithi125.stdout:1/73: symlink d1/dc/l15 0 2024-02-19T19:12:07.322 INFO:tasks.workunit.client.1.smithi125.stdout:4/51: dwrite d0/df/f11 [1609728,126976] 0 2024-02-19T19:12:07.322 INFO:tasks.workunit.client.1.smithi125.stdout:4/52: rmdir d0 39 2024-02-19T19:12:07.322 INFO:tasks.workunit.client.1.smithi125.stdout:4/53: rename d0/f12 to d0/d7/f13 0 2024-02-19T19:12:07.322 INFO:tasks.workunit.client.1.smithi125.stdout:4/54: dread d0/df/f11 [901120,16384] 0 2024-02-19T19:12:07.322 INFO:tasks.workunit.client.1.smithi125.stdout:7/86: dread f7 [671744,49152] 0 2024-02-19T19:12:07.322 INFO:tasks.workunit.client.1.smithi125.stdout:7/87: creat d12/f17 x:0 0 0 2024-02-19T19:12:07.322 INFO:tasks.workunit.client.1.smithi125.stdout:7/88: dread f7 [761856,4096] 0 2024-02-19T19:12:07.322 INFO:tasks.workunit.client.1.smithi125.stdout:7/89: dread - fa zero size 2024-02-19T19:12:07.323 INFO:tasks.workunit.client.1.smithi125.stdout:7/90: dread - f11 zero size 2024-02-19T19:12:07.323 INFO:tasks.workunit.client.1.smithi125.stdout:7/91: mkdir d12/d18 0 2024-02-19T19:12:07.356 INFO:tasks.workunit.client.1.smithi125.stdout:2/109: fsync d1/d6/f10 0 2024-02-19T19:12:07.356 INFO:tasks.workunit.client.1.smithi125.stdout:2/110: truncate d1/fd 1234092 0 2024-02-19T19:12:07.356 INFO:tasks.workunit.client.1.smithi125.stdout:2/111: mknod d1/d6/c1f 0 2024-02-19T19:12:07.356 INFO:tasks.workunit.client.1.smithi125.stdout:7/92: fsync f1 0 2024-02-19T19:12:07.356 INFO:tasks.workunit.client.1.smithi125.stdout:7/93: dread f7 [851968,28672] 0 2024-02-19T19:12:07.359 INFO:tasks.workunit.client.1.smithi125.stdout:3/84: dwrite d0/de/f13 [2162688,20480] 0 2024-02-19T19:12:07.362 INFO:tasks.workunit.client.1.smithi125.stdout:0/94: dwrite d5/f18 [1159168,20480] 0 2024-02-19T19:12:07.362 INFO:tasks.workunit.client.1.smithi125.stdout:7/94: mknod d12/d18/c19 0 2024-02-19T19:12:07.363 INFO:tasks.workunit.client.1.smithi125.stdout:1/74: dwrite f0 [2719744,53248] 0 2024-02-19T19:12:07.363 INFO:tasks.workunit.client.1.smithi125.stdout:7/95: rmdir d12 39 2024-02-19T19:12:07.363 INFO:tasks.workunit.client.1.smithi125.stdout:1/75: dread - d1/dc/f12 zero size 2024-02-19T19:12:07.363 INFO:tasks.workunit.client.1.smithi125.stdout:4/55: dread d0/d7/dc/fd [638976,86016] 0 2024-02-19T19:12:07.363 INFO:tasks.workunit.client.1.smithi125.stdout:1/76: dread d1/f14 [2367488,114688] 0 2024-02-19T19:12:07.363 INFO:tasks.workunit.client.1.smithi125.stdout:1/77: chown d1/l13 73801972 1 2024-02-19T19:12:07.363 INFO:tasks.workunit.client.1.smithi125.stdout:4/56: creat d0/d7/f14 x:0 0 0 2024-02-19T19:12:07.363 INFO:tasks.workunit.client.1.smithi125.stdout:4/57: readlink d0/d7/l8 0 2024-02-19T19:12:07.364 INFO:tasks.workunit.client.1.smithi125.stdout:4/58: truncate d0/df/f11 1336681 0 2024-02-19T19:12:07.364 INFO:tasks.workunit.client.1.smithi125.stdout:4/59: creat d0/d7/f15 x:0 0 0 2024-02-19T19:12:07.364 INFO:tasks.workunit.client.1.smithi125.stdout:0/95: rename d5/d1a/c1c to d5/d15/c23 0 2024-02-19T19:12:07.364 INFO:tasks.workunit.client.1.smithi125.stdout:0/96: write d5/d1a/f20 [339484,82885] 0 2024-02-19T19:12:07.364 INFO:tasks.workunit.client.1.smithi125.stdout:0/97: rename d5/l7 to d5/d9/l24 0 2024-02-19T19:12:07.364 INFO:tasks.workunit.client.1.smithi125.stdout:5/89: sync 2024-02-19T19:12:07.364 INFO:tasks.workunit.client.1.smithi125.stdout:5/90: dread f6 [458752,36864] 0 2024-02-19T19:12:07.364 INFO:tasks.workunit.client.1.smithi125.stdout:5/91: chown db/f1d 562 1 2024-02-19T19:12:07.365 INFO:tasks.workunit.client.1.smithi125.stdout:5/92: stat db/de/f1c 0 2024-02-19T19:12:07.365 INFO:tasks.workunit.client.1.smithi125.stdout:5/93: write db/de/f1c [389813,54220] 0 2024-02-19T19:12:07.365 INFO:tasks.workunit.client.1.smithi125.stdout:2/112: dwrite d1/d6/f1c [331776,49152] 0 2024-02-19T19:12:07.365 INFO:tasks.workunit.client.1.smithi125.stdout:2/113: rmdir d1/d6/d1d/d16 39 2024-02-19T19:12:07.365 INFO:tasks.workunit.client.1.smithi125.stdout:2/114: symlink d1/l20 0 2024-02-19T19:12:07.365 INFO:tasks.workunit.client.1.smithi125.stdout:2/115: symlink d1/d6/d1d/l21 0 2024-02-19T19:12:07.365 INFO:tasks.workunit.client.1.smithi125.stdout:2/116: read d1/ff [706692,37032] 0 2024-02-19T19:12:07.365 INFO:tasks.workunit.client.1.smithi125.stdout:2/117: write d1/fd [313462,13291] 0 2024-02-19T19:12:07.365 INFO:tasks.workunit.client.1.smithi125.stdout:3/85: dwrite d0/f12 [860160,61440] 0 2024-02-19T19:12:07.366 INFO:tasks.workunit.client.1.smithi125.stdout:2/118: read d1/ff [579982,9870] 0 2024-02-19T19:12:07.366 INFO:tasks.workunit.client.1.smithi125.stdout:2/119: truncate d1/d6/f1c 893054 0 2024-02-19T19:12:07.366 INFO:tasks.workunit.client.1.smithi125.stdout:2/120: link d1/ff d1/d6/f22 0 2024-02-19T19:12:07.432 INFO:tasks.workunit.client.1.smithi125.stdout:7/96: dwrite d12/f13 [561152,12288] 0 2024-02-19T19:12:07.432 INFO:tasks.workunit.client.1.smithi125.stdout:7/97: rename d12/l15 to d12/l1a 0 2024-02-19T19:12:07.432 INFO:tasks.workunit.client.1.smithi125.stdout:7/98: chown d12/d18/c19 11370116 1 2024-02-19T19:12:07.436 INFO:tasks.workunit.client.1.smithi125.stdout:1/78: dwrite d1/dc/fd [57344,40960] 0 2024-02-19T19:12:07.436 INFO:tasks.workunit.client.1.smithi125.stdout:1/79: chown d1/l13 1977 1 2024-02-19T19:12:07.436 INFO:tasks.workunit.client.1.smithi125.stdout:1/80: read d1/fa [246650,79719] 0 2024-02-19T19:12:07.436 INFO:tasks.workunit.client.1.smithi125.stdout:1/81: write f0 [1558747,78710] 0 2024-02-19T19:12:07.436 INFO:tasks.workunit.client.1.smithi125.stdout:1/82: write d1/dc/f12 [260478,123525] 0 2024-02-19T19:12:07.436 INFO:tasks.workunit.client.1.smithi125.stdout:1/83: getdents d1 0 2024-02-19T19:12:07.437 INFO:tasks.workunit.client.1.smithi125.stdout:1/84: rmdir d1 39 2024-02-19T19:12:07.437 INFO:tasks.workunit.client.1.smithi125.stdout:1/85: mknod d1/c16 0 2024-02-19T19:12:07.437 INFO:tasks.workunit.client.1.smithi125.stdout:1/86: rename d1/fa to d1/dc/f17 0 2024-02-19T19:12:07.437 INFO:tasks.workunit.client.1.smithi125.stdout:1/87: rename d1/cf to d1/dc/c18 0 2024-02-19T19:12:07.437 INFO:tasks.workunit.client.1.smithi125.stdout:0/98: dwrite d5/f8 [581632,73728] 0 2024-02-19T19:12:07.437 INFO:tasks.workunit.client.1.smithi125.stdout:0/99: rename d5/l10 to d5/d9/l25 0 2024-02-19T19:12:07.437 INFO:tasks.workunit.client.1.smithi125.stdout:0/100: rename d5/f18 to d5/d9/f26 0 2024-02-19T19:12:07.437 INFO:tasks.workunit.client.1.smithi125.stdout:0/101: mkdir d5/d19/d27 0 2024-02-19T19:12:07.437 INFO:tasks.workunit.client.1.smithi125.stdout:4/60: dwrite d0/d7/f14 [765952,40960] 0 2024-02-19T19:12:07.438 INFO:tasks.workunit.client.1.smithi125.stdout:5/94: dwrite db/f10 [1269760,65536] 0 2024-02-19T19:12:07.438 INFO:tasks.workunit.client.1.smithi125.stdout:3/86: dwrite d0/de/f10 [1060864,73728] 0 2024-02-19T19:12:07.438 INFO:tasks.workunit.client.1.smithi125.stdout:3/87: readlink d0/d1/l9 0 2024-02-19T19:12:07.438 INFO:tasks.workunit.client.1.smithi125.stdout:3/88: readlink d0/d1/l9 0 2024-02-19T19:12:07.438 INFO:tasks.workunit.client.1.smithi125.stdout:7/99: dread fb [479232,53248] 0 2024-02-19T19:12:07.438 INFO:tasks.workunit.client.1.smithi125.stdout:7/100: creat d12/f1b x:0 0 0 2024-02-19T19:12:07.490 INFO:tasks.workunit.client.1.smithi125.stdout:6/92: fdatasync d6/db/f17 0 2024-02-19T19:12:07.490 INFO:tasks.workunit.client.1.smithi125.stdout:4/61: dread d0/d7/dc/fd [692224,90112] 0 2024-02-19T19:12:07.491 INFO:tasks.workunit.client.1.smithi125.stdout:4/62: dread d0/d7/dc/fd [176128,24576] 0 2024-02-19T19:12:07.491 INFO:tasks.workunit.client.1.smithi125.stdout:4/63: read d0/fa [1750008,9532] 0 2024-02-19T19:12:07.498 INFO:tasks.workunit.client.1.smithi125.stdout:6/93: link d6/f9 d6/de/f19 0 2024-02-19T19:12:07.498 INFO:tasks.workunit.client.1.smithi125.stdout:6/94: truncate d6/db/df/f14 783005 0 2024-02-19T19:12:07.498 INFO:tasks.workunit.client.1.smithi125.stdout:3/89: dwrite d0/d1/fc [2555904,118784] 0 2024-02-19T19:12:07.498 INFO:tasks.workunit.client.1.smithi125.stdout:7/101: dwrite d12/f1b [495616,94208] 0 2024-02-19T19:12:07.498 INFO:tasks.workunit.client.1.smithi125.stdout:6/95: getdents d6 0 2024-02-19T19:12:07.498 INFO:tasks.workunit.client.1.smithi125.stdout:5/95: dwrite db/de/f1c [831488,40960] 0 2024-02-19T19:12:07.498 INFO:tasks.workunit.client.1.smithi125.stdout:7/102: dread - fc zero size 2024-02-19T19:12:07.499 INFO:tasks.workunit.client.1.smithi125.stdout:3/90: creat d0/d1/f17 x:0 0 0 2024-02-19T19:12:07.499 INFO:tasks.workunit.client.1.smithi125.stdout:3/91: chown d0/de 1075 1 2024-02-19T19:12:07.499 INFO:tasks.workunit.client.1.smithi125.stdout:3/92: dread d0/de/f13 [1904640,8192] 0 2024-02-19T19:12:07.499 INFO:tasks.workunit.client.1.smithi125.stdout:6/96: dread d6/f9 [462848,122880] 0 2024-02-19T19:12:07.499 INFO:tasks.workunit.client.1.smithi125.stdout:6/97: mknod d6/db/df/d16/c1a 0 2024-02-19T19:12:07.499 INFO:tasks.workunit.client.1.smithi125.stdout:3/93: truncate d0/de/f13 1067188 0 2024-02-19T19:12:07.499 INFO:tasks.workunit.client.1.smithi125.stdout:3/94: truncate d0/f15 24400 0 2024-02-19T19:12:07.500 INFO:tasks.workunit.client.1.smithi125.stdout:6/98: write d6/f9 [101290,70946] 0 2024-02-19T19:12:07.500 INFO:tasks.workunit.client.1.smithi125.stdout:3/95: symlink d0/de/l18 0 2024-02-19T19:12:07.500 INFO:tasks.workunit.client.1.smithi125.stdout:6/99: write d6/f9 [1365981,53370] 0 2024-02-19T19:12:07.500 INFO:tasks.workunit.client.1.smithi125.stdout:6/100: read d6/de/f19 [154594,27046] 0 2024-02-19T19:12:07.500 INFO:tasks.workunit.client.1.smithi125.stdout:3/96: creat d0/f19 x:0 0 0 2024-02-19T19:12:07.500 INFO:tasks.workunit.client.1.smithi125.stdout:6/101: getdents d6/db/df/d16 0 2024-02-19T19:12:07.500 INFO:tasks.workunit.client.1.smithi125.stdout:6/102: rename d6/de to d6/db/df/d1b 0 2024-02-19T19:12:07.501 INFO:tasks.workunit.client.1.smithi125.stdout:9/64: sync 2024-02-19T19:12:07.501 INFO:tasks.workunit.client.1.smithi125.stdout:8/69: sync 2024-02-19T19:12:07.501 INFO:tasks.workunit.client.1.smithi125.stdout:8/70: stat db/c15 0 2024-02-19T19:12:07.501 INFO:tasks.workunit.client.1.smithi125.stdout:8/71: readlink db/lf 0 2024-02-19T19:12:07.501 INFO:tasks.workunit.client.1.smithi125.stdout:9/65: mknod d8/c13 0 2024-02-19T19:12:07.501 INFO:tasks.workunit.client.1.smithi125.stdout:8/72: creat db/f16 x:0 0 0 2024-02-19T19:12:07.501 INFO:tasks.workunit.client.1.smithi125.stdout:8/73: symlink db/l17 0 2024-02-19T19:12:07.501 INFO:tasks.workunit.client.1.smithi125.stdout:8/74: mkdir db/d18 0 2024-02-19T19:12:07.501 INFO:tasks.workunit.client.1.smithi125.stdout:8/75: mknod db/d18/c19 0 2024-02-19T19:12:07.502 INFO:tasks.workunit.client.1.smithi125.stdout:4/64: dwrite d0/d7/dc/fd [966656,77824] 0 2024-02-19T19:12:07.502 INFO:tasks.workunit.client.1.smithi125.stdout:4/65: link d0/d7/ce d0/c16 0 2024-02-19T19:12:07.502 INFO:tasks.workunit.client.1.smithi125.stdout:4/66: dread d0/d7/f14 [532480,106496] 0 2024-02-19T19:12:07.502 INFO:tasks.workunit.client.1.smithi125.stdout:4/67: dread - d0/d7/f15 zero size 2024-02-19T19:12:07.502 INFO:tasks.workunit.client.1.smithi125.stdout:4/68: getdents d0 0 2024-02-19T19:12:07.502 INFO:tasks.workunit.client.1.smithi125.stdout:4/69: creat d0/f17 x:0 0 0 2024-02-19T19:12:07.503 INFO:tasks.workunit.client.1.smithi125.stdout:0/102: dread d5/f16 [1384448,61440] 0 2024-02-19T19:12:07.503 INFO:tasks.workunit.client.1.smithi125.stdout:0/103: dread d5/ff [684032,61440] 0 2024-02-19T19:12:07.504 INFO:tasks.workunit.client.1.smithi125.stdout:0/104: symlink d5/d19/l28 0 2024-02-19T19:12:07.504 INFO:tasks.workunit.client.1.smithi125.stdout:0/105: rename d5/le to d5/d9/l29 0 2024-02-19T19:12:07.504 INFO:tasks.workunit.client.1.smithi125.stdout:0/106: rmdir d5/d1a 39 2024-02-19T19:12:07.504 INFO:tasks.workunit.client.1.smithi125.stdout:0/107: chown d5/cc 37261226 1 2024-02-19T19:12:07.504 INFO:tasks.workunit.client.1.smithi125.stdout:0/108: write d5/d9/f1d [1258735,40287] 0 2024-02-19T19:12:07.504 INFO:tasks.workunit.client.1.smithi125.stdout:0/109: rename d5/d9/l17 to d5/d1a/l2a 0 2024-02-19T19:12:07.504 INFO:tasks.workunit.client.1.smithi125.stdout:0/110: mkdir d5/d19/d2b 0 2024-02-19T19:12:07.504 INFO:tasks.workunit.client.1.smithi125.stdout:0/111: dread d5/d9/fb [200704,24576] 0 2024-02-19T19:12:07.505 INFO:tasks.workunit.client.1.smithi125.stdout:0/112: write d5/ff [1945602,12217] 0 2024-02-19T19:12:07.567 INFO:tasks.workunit.client.1.smithi125.stdout:5/96: dwrite db/de/f1f [397312,57344] 0 2024-02-19T19:12:07.567 INFO:tasks.workunit.client.1.smithi125.stdout:5/97: dread f1 [1630208,45056] 0 2024-02-19T19:12:07.567 INFO:tasks.workunit.client.1.smithi125.stdout:5/98: getdents db 0 2024-02-19T19:12:07.567 INFO:tasks.workunit.client.1.smithi125.stdout:5/99: link db/d17/f1b db/d17/f20 0 2024-02-19T19:12:07.568 INFO:tasks.workunit.client.1.smithi125.stdout:5/100: creat db/f21 x:0 0 0 2024-02-19T19:12:07.570 INFO:tasks.workunit.client.1.smithi125.stdout:3/97: dwrite d0/ff [1413120,16384] 0 2024-02-19T19:12:07.570 INFO:tasks.workunit.client.1.smithi125.stdout:3/98: unlink d0/de/f11 0 2024-02-19T19:12:07.571 INFO:tasks.workunit.client.1.smithi125.stdout:7/103: dread d12/f13 [65536,86016] 0 2024-02-19T19:12:07.571 INFO:tasks.workunit.client.1.smithi125.stdout:7/104: link d12/c16 d12/c1c 0 2024-02-19T19:12:07.571 INFO:tasks.workunit.client.1.smithi125.stdout:3/99: symlink d0/l1a 0 2024-02-19T19:12:07.571 INFO:tasks.workunit.client.1.smithi125.stdout:6/103: dwrite d6/f9 [438272,20480] 0 2024-02-19T19:12:07.571 INFO:tasks.workunit.client.1.smithi125.stdout:7/105: write d12/f17 [490486,70051] 0 2024-02-19T19:12:07.571 INFO:tasks.workunit.client.1.smithi125.stdout:3/100: write d0/de/f13 [1709231,126189] 0 2024-02-19T19:12:07.571 INFO:tasks.workunit.client.1.smithi125.stdout:7/106: write d12/f1b [159079,25371] 0 2024-02-19T19:12:07.572 INFO:tasks.workunit.client.1.smithi125.stdout:7/107: truncate d12/f13 1374807 0 2024-02-19T19:12:07.572 INFO:tasks.workunit.client.1.smithi125.stdout:3/101: dread d0/f12 [614400,73728] 0 2024-02-19T19:12:07.572 INFO:tasks.workunit.client.1.smithi125.stdout:7/108: chown cd 70974 1 2024-02-19T19:12:07.572 INFO:tasks.workunit.client.1.smithi125.stdout:3/102: dread d0/d1/fc [1007616,4096] 0 2024-02-19T19:12:07.572 INFO:tasks.workunit.client.1.smithi125.stdout:7/109: link d12/l1a d12/d18/l1d 0 2024-02-19T19:12:07.572 INFO:tasks.workunit.client.1.smithi125.stdout:8/76: dwrite db/fc [139264,65536] 0 2024-02-19T19:12:07.572 INFO:tasks.workunit.client.1.smithi125.stdout:5/101: dwrite db/f10 [671744,28672] 0 2024-02-19T19:12:07.573 INFO:tasks.workunit.client.1.smithi125.stdout:5/102: creat db/d17/f22 x:0 0 0 2024-02-19T19:12:07.573 INFO:tasks.workunit.client.1.smithi125.stdout:5/103: unlink db/f10 0 2024-02-19T19:12:07.573 INFO:tasks.workunit.client.1.smithi125.stdout:5/104: getdents db 0 2024-02-19T19:12:07.573 INFO:tasks.workunit.client.1.smithi125.stdout:5/105: write f1 [697523,32840] 0 2024-02-19T19:12:07.573 INFO:tasks.workunit.client.1.smithi125.stdout:5/106: creat db/de/f23 x:0 0 0 2024-02-19T19:12:07.573 INFO:tasks.workunit.client.1.smithi125.stdout:5/107: getdents db/d17 0 2024-02-19T19:12:07.618 INFO:tasks.workunit.client.1.smithi125.stdout:9/66: fdatasync f6 0 2024-02-19T19:12:07.618 INFO:tasks.workunit.client.1.smithi125.stdout:1/88: fsync d1/dc/fd 0 2024-02-19T19:12:07.618 INFO:tasks.workunit.client.1.smithi125.stdout:9/67: mknod d8/c14 0 2024-02-19T19:12:07.618 INFO:tasks.workunit.client.1.smithi125.stdout:9/68: write f2 [839255,5973] 0 2024-02-19T19:12:07.618 INFO:tasks.workunit.client.1.smithi125.stdout:1/89: getdents d1 0 2024-02-19T19:12:07.618 INFO:tasks.workunit.client.1.smithi125.stdout:9/69: stat f7 0 2024-02-19T19:12:07.620 INFO:tasks.workunit.client.1.smithi125.stdout:5/108: dwrite db/f21 [176128,122880] 0 2024-02-19T19:12:07.620 INFO:tasks.workunit.client.1.smithi125.stdout:1/90: read d1/dc/f17 [186904,89020] 0 2024-02-19T19:12:07.620 INFO:tasks.workunit.client.1.smithi125.stdout:3/103: dwrite d0/d1/f17 [651264,86016] 0 2024-02-19T19:12:07.620 INFO:tasks.workunit.client.1.smithi125.stdout:9/70: mkdir d8/d15 0 2024-02-19T19:12:07.621 INFO:tasks.workunit.client.1.smithi125.stdout:1/91: creat d1/dc/f19 x:0 0 0 2024-02-19T19:12:07.621 INFO:tasks.workunit.client.1.smithi125.stdout:9/71: mknod d8/d12/c16 0 2024-02-19T19:12:07.621 INFO:tasks.workunit.client.1.smithi125.stdout:9/72: link d8/c14 d8/c17 0 2024-02-19T19:12:07.621 INFO:tasks.workunit.client.1.smithi125.stdout:3/104: symlink d0/l1b 0 2024-02-19T19:12:07.621 INFO:tasks.workunit.client.1.smithi125.stdout:1/92: mkdir d1/d1a 0 2024-02-19T19:12:07.621 INFO:tasks.workunit.client.1.smithi125.stdout:9/73: creat d8/f18 x:0 0 0 2024-02-19T19:12:07.621 INFO:tasks.workunit.client.1.smithi125.stdout:9/74: chown d8/c17 46920364 1 2024-02-19T19:12:07.648 INFO:tasks.workunit.client.1.smithi125.stdout:5/109: dread f1 [929792,94208] 0 2024-02-19T19:12:07.648 INFO:tasks.workunit.client.1.smithi125.stdout:5/110: creat db/de/f24 x:0 0 0 2024-02-19T19:12:07.648 INFO:tasks.workunit.client.1.smithi125.stdout:5/111: mkdir db/de/d25 0 2024-02-19T19:12:07.648 INFO:tasks.workunit.client.1.smithi125.stdout:5/112: write db/de/f1f [980001,129909] 0 2024-02-19T19:12:07.649 INFO:tasks.workunit.client.1.smithi125.stdout:5/113: mkdir db/d26 0 2024-02-19T19:12:07.649 INFO:tasks.workunit.client.1.smithi125.stdout:5/114: dread - db/d17/f1b zero size 2024-02-19T19:12:07.649 INFO:tasks.workunit.client.1.smithi125.stdout:5/115: write db/de/f24 [880717,112146] 0 2024-02-19T19:12:07.649 INFO:tasks.workunit.client.1.smithi125.stdout:5/116: rename db/de to db/d26/d27 0 2024-02-19T19:12:07.649 INFO:tasks.workunit.client.1.smithi125.stdout:5/117: write db/f21 [462110,64598] 0 2024-02-19T19:12:07.649 INFO:tasks.workunit.client.1.smithi125.stdout:5/118: mknod db/d26/d27/c28 0 2024-02-19T19:12:07.649 INFO:tasks.workunit.client.1.smithi125.stdout:5/119: dread db/d26/d27/f24 [12288,102400] 0 2024-02-19T19:12:07.652 INFO:tasks.workunit.client.1.smithi125.stdout:1/93: dwrite d1/dc/f19 [638976,122880] 0 2024-02-19T19:12:07.652 INFO:tasks.workunit.client.1.smithi125.stdout:1/94: creat d1/dc/f1b x:0 0 0 2024-02-19T19:12:07.653 INFO:tasks.workunit.client.1.smithi125.stdout:1/95: readlink d1/l13 0 2024-02-19T19:12:07.653 INFO:tasks.workunit.client.1.smithi125.stdout:1/96: readlink d1/l3 0 2024-02-19T19:12:07.653 INFO:tasks.workunit.client.1.smithi125.stdout:1/97: link d1/c2 d1/d1a/c1c 0 2024-02-19T19:12:07.653 INFO:tasks.workunit.client.1.smithi125.stdout:3/105: dwrite d0/de/f13 [2150400,36864] 0 2024-02-19T19:12:07.653 INFO:tasks.workunit.client.1.smithi125.stdout:3/106: chown d0/d1/f17 1276461202 1 2024-02-19T19:12:07.653 INFO:tasks.workunit.client.1.smithi125.stdout:3/107: chown d0/de/l18 1009667079 1 2024-02-19T19:12:07.653 INFO:tasks.workunit.client.1.smithi125.stdout:3/108: dread d0/f12 [36864,61440] 0 2024-02-19T19:12:07.654 INFO:tasks.workunit.client.1.smithi125.stdout:3/109: readlink d0/de/l18 0 2024-02-19T19:12:07.654 INFO:tasks.workunit.client.1.smithi125.stdout:3/110: creat d0/de/f1c x:0 0 0 2024-02-19T19:12:07.654 INFO:tasks.workunit.client.1.smithi125.stdout:3/111: symlink d0/l1d 0 2024-02-19T19:12:07.654 INFO:tasks.workunit.client.1.smithi125.stdout:5/120: dwrite db/d26/d27/f24 [1822720,69632] 0 2024-02-19T19:12:07.654 INFO:tasks.workunit.client.1.smithi125.stdout:5/121: rmdir db/d26 39 2024-02-19T19:12:07.654 INFO:tasks.workunit.client.1.smithi125.stdout:3/112: write d0/de/f13 [1271774,115810] 0 2024-02-19T19:12:07.717 INFO:tasks.workunit.client.1.smithi125.stdout:7/110: fsync d12/f13 0 2024-02-19T19:12:07.717 INFO:tasks.workunit.client.1.smithi125.stdout:8/77: fsync db/f16 0 2024-02-19T19:12:07.717 INFO:tasks.workunit.client.1.smithi125.stdout:6/104: fsync d6/db/df/f14 0 2024-02-19T19:12:07.723 INFO:tasks.workunit.client.1.smithi125.stdout:3/113: dwrite d0/f15 [663552,81920] 0 2024-02-19T19:12:07.723 INFO:tasks.workunit.client.1.smithi125.stdout:5/122: dwrite db/d17/f1b [487424,4096] 0 2024-02-19T19:12:07.723 INFO:tasks.workunit.client.1.smithi125.stdout:3/114: write d0/d1/fc [99117,7305] 0 2024-02-19T19:12:07.724 INFO:tasks.workunit.client.1.smithi125.stdout:3/115: rmdir d0 39 2024-02-19T19:12:07.724 INFO:tasks.workunit.client.1.smithi125.stdout:5/123: chown db/l1a 0 1 2024-02-19T19:12:07.724 INFO:tasks.workunit.client.1.smithi125.stdout:3/116: mkdir d0/d1/d1e 0 2024-02-19T19:12:07.724 INFO:tasks.workunit.client.1.smithi125.stdout:3/117: chown d0 0 1 2024-02-19T19:12:07.724 INFO:tasks.workunit.client.1.smithi125.stdout:3/118: unlink d0/l1d 0 2024-02-19T19:12:07.724 INFO:tasks.workunit.client.1.smithi125.stdout:5/124: write db/d17/f1b [977704,91914] 0 2024-02-19T19:12:07.724 INFO:tasks.workunit.client.1.smithi125.stdout:5/125: chown db/f1d 2515806 1 2024-02-19T19:12:07.724 INFO:tasks.workunit.client.1.smithi125.stdout:5/126: stat c9 0 2024-02-19T19:12:07.725 INFO:tasks.workunit.client.1.smithi125.stdout:5/127: readlink l5 0 2024-02-19T19:12:07.725 INFO:tasks.workunit.client.1.smithi125.stdout:6/105: symlink d6/db/df/d16/l1c 0 2024-02-19T19:12:07.725 INFO:tasks.workunit.client.1.smithi125.stdout:6/106: rmdir d6 39 2024-02-19T19:12:07.725 INFO:tasks.workunit.client.1.smithi125.stdout:5/128: symlink db/d26/l29 0 2024-02-19T19:12:07.725 INFO:tasks.workunit.client.1.smithi125.stdout:5/129: symlink db/d26/d27/l2a 0 2024-02-19T19:12:07.725 INFO:tasks.workunit.client.1.smithi125.stdout:5/130: truncate db/f1d 882343 0 2024-02-19T19:12:07.725 INFO:tasks.workunit.client.1.smithi125.stdout:5/131: chown db/d17/f20 865 1 2024-02-19T19:12:07.725 INFO:tasks.workunit.client.1.smithi125.stdout:5/132: getdents db/d17 0 2024-02-19T19:12:07.725 INFO:tasks.workunit.client.1.smithi125.stdout:7/111: creat d12/d18/f1e x:0 0 0 2024-02-19T19:12:07.726 INFO:tasks.workunit.client.1.smithi125.stdout:5/133: write db/d26/d27/f23 [825614,85494] 0 2024-02-19T19:12:07.726 INFO:tasks.workunit.client.1.smithi125.stdout:5/134: chown db/l1a 0 1 2024-02-19T19:12:07.726 INFO:tasks.workunit.client.1.smithi125.stdout:7/112: write f8 [427497,75850] 0 2024-02-19T19:12:07.726 INFO:tasks.workunit.client.1.smithi125.stdout:7/113: chown d12/d18/c19 748 1 2024-02-19T19:12:07.726 INFO:tasks.workunit.client.1.smithi125.stdout:6/107: write f4 [2032294,111850] 0 2024-02-19T19:12:07.726 INFO:tasks.workunit.client.1.smithi125.stdout:7/114: unlink d12/f1b 0 2024-02-19T19:12:07.726 INFO:tasks.workunit.client.1.smithi125.stdout:6/108: dread d6/db/f11 [720896,106496] 0 2024-02-19T19:12:07.726 INFO:tasks.workunit.client.1.smithi125.stdout:6/109: dread d6/db/df/f14 [327680,16384] 0 2024-02-19T19:12:07.727 INFO:tasks.workunit.client.1.smithi125.stdout:6/110: chown l1 0 1 2024-02-19T19:12:07.727 INFO:tasks.workunit.client.1.smithi125.stdout:2/121: sync 2024-02-19T19:12:07.727 INFO:tasks.workunit.client.1.smithi125.stdout:6/111: mknod d6/db/c1d 0 2024-02-19T19:12:07.727 INFO:tasks.workunit.client.1.smithi125.stdout:2/122: chown d1/d6/d1d/d16/l1a 6141 1 2024-02-19T19:12:07.727 INFO:tasks.workunit.client.1.smithi125.stdout:2/123: chown d1/d6 23921473 1 2024-02-19T19:12:07.727 INFO:tasks.workunit.client.1.smithi125.stdout:6/112: dread d6/db/df/f14 [540672,40960] 0 2024-02-19T19:12:07.727 INFO:tasks.workunit.client.1.smithi125.stdout:6/113: getdents d6/db 0 2024-02-19T19:12:07.727 INFO:tasks.workunit.client.1.smithi125.stdout:6/114: read - d6/db/f17 zero size 2024-02-19T19:12:07.727 INFO:tasks.workunit.client.1.smithi125.stdout:6/115: dread d6/f9 [221184,94208] 0 2024-02-19T19:12:07.728 INFO:tasks.workunit.client.1.smithi125.stdout:6/116: readlink d6/l18 0 2024-02-19T19:12:07.778 INFO:tasks.workunit.client.1.smithi125.stdout:3/119: dwrite d0/de/f14 [393216,94208] 0 2024-02-19T19:12:07.778 INFO:tasks.workunit.client.1.smithi125.stdout:3/120: creat d0/d1/d1e/f1f x:0 0 0 2024-02-19T19:12:07.778 INFO:tasks.workunit.client.1.smithi125.stdout:3/121: creat d0/de/f20 x:0 0 0 2024-02-19T19:12:07.778 INFO:tasks.workunit.client.1.smithi125.stdout:3/122: dread - d0/de/f20 zero size 2024-02-19T19:12:07.778 INFO:tasks.workunit.client.1.smithi125.stdout:3/123: write d0/de/f1c [746005,905] 0 2024-02-19T19:12:07.778 INFO:tasks.workunit.client.1.smithi125.stdout:3/124: symlink d0/de/l21 0 2024-02-19T19:12:07.778 INFO:tasks.workunit.client.1.smithi125.stdout:3/125: truncate d0/de/f14 336370 0 2024-02-19T19:12:07.779 INFO:tasks.workunit.client.1.smithi125.stdout:3/126: write d0/d1/d1e/f1f [978504,56004] 0 2024-02-19T19:12:07.779 INFO:tasks.workunit.client.1.smithi125.stdout:3/127: symlink d0/de/l22 0 2024-02-19T19:12:07.779 INFO:tasks.workunit.client.1.smithi125.stdout:8/78: dwrite db/fc [569344,61440] 0 2024-02-19T19:12:07.779 INFO:tasks.workunit.client.1.smithi125.stdout:7/115: dwrite d12/d18/f1e [782336,36864] 0 2024-02-19T19:12:07.818 INFO:tasks.workunit.client.1.smithi125.stdout:5/135: fsync f6 0 2024-02-19T19:12:07.818 INFO:tasks.workunit.client.1.smithi125.stdout:2/124: fdatasync d1/fd 0 2024-02-19T19:12:07.819 INFO:tasks.workunit.client.1.smithi125.stdout:2/125: chown d1/c19 3115127 1 2024-02-19T19:12:07.819 INFO:tasks.workunit.client.1.smithi125.stdout:0/113: fdatasync d5/ff 0 2024-02-19T19:12:07.819 INFO:tasks.workunit.client.1.smithi125.stdout:1/98: fdatasync d1/dc/f1b 0 2024-02-19T19:12:07.819 INFO:tasks.workunit.client.1.smithi125.stdout:5/136: creat db/d26/d27/f2b x:0 0 0 2024-02-19T19:12:07.819 INFO:tasks.workunit.client.1.smithi125.stdout:5/137: rmdir db 39 2024-02-19T19:12:07.819 INFO:tasks.workunit.client.1.smithi125.stdout:2/126: mknod d1/d6/c23 0 2024-02-19T19:12:07.819 INFO:tasks.workunit.client.1.smithi125.stdout:5/138: write db/d26/d27/f1f [1767559,52605] 0 2024-02-19T19:12:07.819 INFO:tasks.workunit.client.1.smithi125.stdout:2/127: dread d1/f12 [352256,126976] 0 2024-02-19T19:12:07.868 INFO:tasks.workunit.client.1.smithi125.stdout:6/117: fdatasync d6/db/df/d1b/f19 0 2024-02-19T19:12:07.883 INFO:tasks.workunit.client.1.smithi125.stdout:1/99: fdatasync f0 0 2024-02-19T19:12:07.883 INFO:tasks.workunit.client.1.smithi125.stdout:1/100: chown d1/dc/l10 7915 1 2024-02-19T19:12:07.883 INFO:tasks.workunit.client.1.smithi125.stdout:1/101: write d1/f9 [2056451,89853] 0 2024-02-19T19:12:07.885 INFO:tasks.workunit.client.1.smithi125.stdout:2/128: creat d1/d6/d1d/f24 x:0 0 0 2024-02-19T19:12:07.885 INFO:tasks.workunit.client.1.smithi125.stdout:5/139: write f1 [2543328,37066] 0 2024-02-19T19:12:07.885 INFO:tasks.workunit.client.1.smithi125.stdout:0/114: read d5/ff [137367,98127] 0 2024-02-19T19:12:07.885 INFO:tasks.workunit.client.1.smithi125.stdout:6/118: rename f4 to d6/f1e 0 2024-02-19T19:12:07.885 INFO:tasks.workunit.client.1.smithi125.stdout:2/129: chown d1/d6/d1d/l21 0 1 2024-02-19T19:12:07.885 INFO:tasks.workunit.client.1.smithi125.stdout:2/130: chown d1/d6/d1d/l9 3399994 1 2024-02-19T19:12:07.885 INFO:tasks.workunit.client.1.smithi125.stdout:2/131: dread d1/f2 [2732032,114688] 0 2024-02-19T19:12:07.886 INFO:tasks.workunit.client.1.smithi125.stdout:9/75: sync 2024-02-19T19:12:07.886 INFO:tasks.workunit.client.1.smithi125.stdout:4/70: sync 2024-02-19T19:12:07.886 INFO:tasks.workunit.client.1.smithi125.stdout:4/71: creat d0/d7/dc/f18 x:0 0 0 2024-02-19T19:12:07.887 INFO:tasks.workunit.client.1.smithi125.stdout:1/102: truncate d1/dc/f19 1341347 0 2024-02-19T19:12:07.887 INFO:tasks.workunit.client.1.smithi125.stdout:6/119: dread d6/db/df/d1b/f10 [507904,69632] 0 2024-02-19T19:12:07.888 INFO:tasks.workunit.client.1.smithi125.stdout:9/76: mknod d8/c19 0 2024-02-19T19:12:07.888 INFO:tasks.workunit.client.1.smithi125.stdout:6/120: readlink d6/l13 0 2024-02-19T19:12:07.888 INFO:tasks.workunit.client.1.smithi125.stdout:0/115: mkdir d5/d15/d2c 0 2024-02-19T19:12:07.888 INFO:tasks.workunit.client.1.smithi125.stdout:9/77: dread f1 [274432,49152] 0 2024-02-19T19:12:07.888 INFO:tasks.workunit.client.1.smithi125.stdout:7/116: dwrite f11 [233472,122880] 0 2024-02-19T19:12:07.888 INFO:tasks.workunit.client.1.smithi125.stdout:9/78: creat d8/f1a x:0 0 0 2024-02-19T19:12:07.888 INFO:tasks.workunit.client.1.smithi125.stdout:7/117: creat d12/f1f x:0 0 0 2024-02-19T19:12:07.889 INFO:tasks.workunit.client.1.smithi125.stdout:9/79: dread - d8/f9 zero size 2024-02-19T19:12:07.889 INFO:tasks.workunit.client.1.smithi125.stdout:9/80: link d8/f18 d8/d12/f1b 0 2024-02-19T19:12:07.889 INFO:tasks.workunit.client.1.smithi125.stdout:1/103: truncate f0 195042 0 2024-02-19T19:12:07.889 INFO:tasks.workunit.client.1.smithi125.stdout:2/132: rename d1/d6/d1d/d1b to d1/d6/d1d/d25 0 2024-02-19T19:12:07.889 INFO:tasks.workunit.client.1.smithi125.stdout:9/81: write d8/f9 [478162,49588] 0 2024-02-19T19:12:07.889 INFO:tasks.workunit.client.1.smithi125.stdout:1/104: mkdir d1/dc/d1d 0 2024-02-19T19:12:07.889 INFO:tasks.workunit.client.1.smithi125.stdout:2/133: symlink d1/d6/d1d/l26 0 2024-02-19T19:12:07.890 INFO:tasks.workunit.client.1.smithi125.stdout:9/82: getdents d8 0 2024-02-19T19:12:07.890 INFO:tasks.workunit.client.1.smithi125.stdout:2/134: truncate d1/d6/d1d/f24 262216 0 2024-02-19T19:12:07.890 INFO:tasks.workunit.client.1.smithi125.stdout:1/105: dread d1/dc/f12 [61440,81920] 0 2024-02-19T19:12:07.890 INFO:tasks.workunit.client.1.smithi125.stdout:9/83: creat d8/d15/f1c x:0 0 0 2024-02-19T19:12:07.890 INFO:tasks.workunit.client.1.smithi125.stdout:1/106: getdents d1 0 2024-02-19T19:12:07.890 INFO:tasks.workunit.client.1.smithi125.stdout:1/107: symlink d1/dc/l1e 0 2024-02-19T19:12:07.890 INFO:tasks.workunit.client.1.smithi125.stdout:9/84: write f7 [2584407,63281] 0 2024-02-19T19:12:07.890 INFO:tasks.workunit.client.1.smithi125.stdout:1/108: creat d1/dc/f1f x:0 0 0 2024-02-19T19:12:07.891 INFO:tasks.workunit.client.1.smithi125.stdout:1/109: symlink d1/l20 0 2024-02-19T19:12:07.891 INFO:tasks.workunit.client.1.smithi125.stdout:1/110: write d1/f14 [1199457,63721] 0 2024-02-19T19:12:07.912 INFO:tasks.workunit.client.1.smithi125.stdout:4/72: fsync d0/d7/f14 0 2024-02-19T19:12:07.912 INFO:tasks.workunit.client.1.smithi125.stdout:4/73: stat d0/d7/dc/f9 0 2024-02-19T19:12:07.912 INFO:tasks.workunit.client.1.smithi125.stdout:4/74: mknod d0/d7/dc/c19 0 2024-02-19T19:12:07.912 INFO:tasks.workunit.client.1.smithi125.stdout:5/140: dwrite db/f21 [987136,4096] 0 2024-02-19T19:12:07.912 INFO:tasks.workunit.client.1.smithi125.stdout:5/141: mknod db/c2c 0 2024-02-19T19:12:07.912 INFO:tasks.workunit.client.1.smithi125.stdout:5/142: creat db/d26/f2d x:0 0 0 2024-02-19T19:12:07.913 INFO:tasks.workunit.client.1.smithi125.stdout:5/143: mknod db/d26/c2e 0 2024-02-19T19:12:07.913 INFO:tasks.workunit.client.1.smithi125.stdout:5/144: link db/l1a db/d26/d27/l2f 0 2024-02-19T19:12:07.913 INFO:tasks.workunit.client.1.smithi125.stdout:5/145: creat db/f30 x:0 0 0 2024-02-19T19:12:07.913 INFO:tasks.workunit.client.1.smithi125.stdout:5/146: chown db/d26/d27/l2a 2 1 2024-02-19T19:12:07.913 INFO:tasks.workunit.client.1.smithi125.stdout:5/147: link db/d26/l29 db/d26/d27/d25/l31 0 2024-02-19T19:12:07.913 INFO:tasks.workunit.client.1.smithi125.stdout:5/148: dread db/d26/d27/ff [315392,126976] 0 2024-02-19T19:12:07.913 INFO:tasks.workunit.client.1.smithi125.stdout:5/149: chown db/d26/d27/c18 35677 1 2024-02-19T19:12:07.913 INFO:tasks.workunit.client.1.smithi125.stdout:5/150: chown db/d26/d27/l2f 3023 1 2024-02-19T19:12:07.916 INFO:tasks.workunit.client.1.smithi125.stdout:6/121: dwrite d6/db/f17 [249856,118784] 0 2024-02-19T19:12:07.916 INFO:tasks.workunit.client.1.smithi125.stdout:6/122: creat d6/db/df/f1f x:0 0 0 2024-02-19T19:12:07.916 INFO:tasks.workunit.client.1.smithi125.stdout:6/123: chown d6/db/f11 11409536 1 2024-02-19T19:12:07.916 INFO:tasks.workunit.client.1.smithi125.stdout:0/116: dwrite d5/d1a/f20 [1835008,45056] 0 2024-02-19T19:12:07.916 INFO:tasks.workunit.client.1.smithi125.stdout:0/117: dread d5/d9/f26 [602112,77824] 0 2024-02-19T19:12:07.916 INFO:tasks.workunit.client.1.smithi125.stdout:2/135: dwrite d1/ff [749568,24576] 0 2024-02-19T19:12:07.917 INFO:tasks.workunit.client.1.smithi125.stdout:2/136: getdents d1/d6/d1d 0 2024-02-19T19:12:07.917 INFO:tasks.workunit.client.1.smithi125.stdout:2/137: rename d1/d6 to d1/d27 0 2024-02-19T19:12:07.917 INFO:tasks.workunit.client.1.smithi125.stdout:9/85: dwrite d8/f1a [12288,98304] 0 2024-02-19T19:12:07.917 INFO:tasks.workunit.client.1.smithi125.stdout:9/86: chown d8/la 269091443 1 2024-02-19T19:12:07.917 INFO:tasks.workunit.client.1.smithi125.stdout:9/87: symlink d8/d15/l1d 0 2024-02-19T19:12:07.917 INFO:tasks.workunit.client.1.smithi125.stdout:9/88: symlink d8/d12/l1e 0 2024-02-19T19:12:07.917 INFO:tasks.workunit.client.1.smithi125.stdout:9/89: write f6 [1014032,60039] 0 2024-02-19T19:12:07.918 INFO:tasks.workunit.client.1.smithi125.stdout:7/118: dwrite d12/f17 [1564672,57344] 0 2024-02-19T19:12:07.918 INFO:tasks.workunit.client.1.smithi125.stdout:9/90: rename d8/d15/l1d to d8/d15/l1f 0 2024-02-19T19:12:07.918 INFO:tasks.workunit.client.1.smithi125.stdout:7/119: creat d12/d18/f20 x:0 0 0 2024-02-19T19:12:07.918 INFO:tasks.workunit.client.1.smithi125.stdout:4/75: dwrite d0/d7/dc/fd [1056768,90112] 0 2024-02-19T19:12:07.918 INFO:tasks.workunit.client.1.smithi125.stdout:4/76: chown d0/d7/cb 168923332 1 2024-02-19T19:12:07.918 INFO:tasks.workunit.client.1.smithi125.stdout:5/151: dwrite db/d26/d27/f1c [1409024,8192] 0 2024-02-19T19:12:07.957 INFO:tasks.workunit.client.1.smithi125.stdout:8/79: fsync db/fc 0 2024-02-19T19:12:07.957 INFO:tasks.workunit.client.1.smithi125.stdout:6/124: fdatasync d6/db/df/d1b/f19 0 2024-02-19T19:12:07.958 INFO:tasks.workunit.client.1.smithi125.stdout:0/118: write d5/f16 [587042,87221] 0 2024-02-19T19:12:07.960 INFO:tasks.workunit.client.1.smithi125.stdout:4/77: dwrite d0/fa [1691648,16384] 0 2024-02-19T19:12:07.960 INFO:tasks.workunit.client.1.smithi125.stdout:7/120: dwrite fa [614400,16384] 0 2024-02-19T19:12:07.960 INFO:tasks.workunit.client.1.smithi125.stdout:2/138: dwrite d1/d27/d1d/f24 [761856,86016] 0 2024-02-19T19:12:07.960 INFO:tasks.workunit.client.1.smithi125.stdout:5/152: dwrite db/d26/d27/f1c [1249280,49152] 0 2024-02-19T19:12:07.960 INFO:tasks.workunit.client.1.smithi125.stdout:0/119: unlink d5/d9/l24 0 2024-02-19T19:12:07.960 INFO:tasks.workunit.client.1.smithi125.stdout:6/125: write d6/db/df/f1f [707701,36013] 0 2024-02-19T19:12:07.961 INFO:tasks.workunit.client.1.smithi125.stdout:7/121: chown d12/d18/l1d 34 1 2024-02-19T19:12:07.961 INFO:tasks.workunit.client.1.smithi125.stdout:8/80: mknod db/d18/c1a 0 2024-02-19T19:12:07.961 INFO:tasks.workunit.client.1.smithi125.stdout:7/122: chown d12/f1f 660310 1 2024-02-19T19:12:07.961 INFO:tasks.workunit.client.1.smithi125.stdout:5/153: readlink db/l1a 0 2024-02-19T19:12:07.961 INFO:tasks.workunit.client.1.smithi125.stdout:0/120: mknod d5/d1a/c2d 0 2024-02-19T19:12:07.961 INFO:tasks.workunit.client.1.smithi125.stdout:8/81: link db/fe db/d18/f1b 0 2024-02-19T19:12:07.961 INFO:tasks.workunit.client.1.smithi125.stdout:6/126: creat d6/db/df/d16/f20 x:0 0 0 2024-02-19T19:12:07.961 INFO:tasks.workunit.client.1.smithi125.stdout:7/123: dread f1 [1675264,69632] 0 2024-02-19T19:12:07.962 INFO:tasks.workunit.client.1.smithi125.stdout:0/121: truncate d5/f16 2988379 0 2024-02-19T19:12:07.962 INFO:tasks.workunit.client.1.smithi125.stdout:0/122: readlink d5/d9/l14 0 2024-02-19T19:12:07.962 INFO:tasks.workunit.client.1.smithi125.stdout:6/127: truncate d6/db/f17 221049 0 2024-02-19T19:12:07.962 INFO:tasks.workunit.client.1.smithi125.stdout:6/128: stat d6/db/f17 0 2024-02-19T19:12:07.962 INFO:tasks.workunit.client.1.smithi125.stdout:0/123: dread d5/f16 [2428928,118784] 0 2024-02-19T19:12:07.962 INFO:tasks.workunit.client.1.smithi125.stdout:6/129: creat d6/db/df/f21 x:0 0 0 2024-02-19T19:12:07.962 INFO:tasks.workunit.client.1.smithi125.stdout:6/130: write d6/db/df/d1b/f10 [1813966,16215] 0 2024-02-19T19:12:07.962 INFO:tasks.workunit.client.1.smithi125.stdout:0/124: write d5/d9/fb [415963,100028] 0 2024-02-19T19:12:07.987 INFO:tasks.workunit.client.1.smithi125.stdout:2/139: dwrite d1/d27/d1d/f24 [1400832,57344] 0 2024-02-19T19:12:07.988 INFO:tasks.workunit.client.1.smithi125.stdout:8/82: dread db/fc [131072,28672] 0 2024-02-19T19:12:07.989 INFO:tasks.workunit.client.1.smithi125.stdout:6/131: dwrite d6/db/df/d16/f20 [372736,77824] 0 2024-02-19T19:12:07.989 INFO:tasks.workunit.client.1.smithi125.stdout:6/132: chown d6/db 219048 1 2024-02-19T19:12:07.989 INFO:tasks.workunit.client.1.smithi125.stdout:6/133: creat d6/f22 x:0 0 0 2024-02-19T19:12:07.989 INFO:tasks.workunit.client.1.smithi125.stdout:6/134: chown d6/db/df/f21 188 1 2024-02-19T19:12:07.989 INFO:tasks.workunit.client.1.smithi125.stdout:7/124: dwrite d12/f1f [12288,106496] 0 2024-02-19T19:12:07.989 INFO:tasks.workunit.client.1.smithi125.stdout:2/140: dread d1/f12 [552960,61440] 0 2024-02-19T19:12:07.989 INFO:tasks.workunit.client.1.smithi125.stdout:2/141: getdents d1/d27/d1d 0 2024-02-19T19:12:08.018 INFO:tasks.workunit.client.1.smithi125.stdout:4/78: fsync d0/df/f11 0 2024-02-19T19:12:08.018 INFO:tasks.workunit.client.1.smithi125.stdout:5/154: fdatasync db/f1d 0 2024-02-19T19:12:08.018 INFO:tasks.workunit.client.1.smithi125.stdout:9/91: fsync d8/f18 0 2024-02-19T19:12:08.018 INFO:tasks.workunit.client.1.smithi125.stdout:1/111: fsync d1/dc/f19 0 2024-02-19T19:12:08.018 INFO:tasks.workunit.client.1.smithi125.stdout:9/92: creat d8/f20 x:0 0 0 2024-02-19T19:12:08.018 INFO:tasks.workunit.client.1.smithi125.stdout:1/112: truncate d1/dc/fd 241038 0 2024-02-19T19:12:08.018 INFO:tasks.workunit.client.1.smithi125.stdout:4/79: symlink d0/d7/dc/l1a 0 2024-02-19T19:12:08.019 INFO:tasks.workunit.client.1.smithi125.stdout:9/93: dread f6 [667648,126976] 0 2024-02-19T19:12:08.019 INFO:tasks.workunit.client.1.smithi125.stdout:4/80: write d0/fa [2981423,106538] 0 2024-02-19T19:12:08.019 INFO:tasks.workunit.client.1.smithi125.stdout:4/81: creat d0/f1b x:0 0 0 2024-02-19T19:12:08.019 INFO:tasks.workunit.client.1.smithi125.stdout:9/94: write d8/f18 [990942,130507] 0 2024-02-19T19:12:08.019 INFO:tasks.workunit.client.1.smithi125.stdout:8/83: dwrite db/f10 [65536,61440] 0 2024-02-19T19:12:08.019 INFO:tasks.workunit.client.1.smithi125.stdout:8/84: creat db/f1c x:0 0 0 2024-02-19T19:12:08.019 INFO:tasks.workunit.client.1.smithi125.stdout:8/85: write db/fe [1855988,47876] 0 2024-02-19T19:12:08.019 INFO:tasks.workunit.client.1.smithi125.stdout:8/86: rmdir db/d18 39 2024-02-19T19:12:08.019 INFO:tasks.workunit.client.1.smithi125.stdout:8/87: write db/f1c [5132,116057] 0 2024-02-19T19:12:08.020 INFO:tasks.workunit.client.1.smithi125.stdout:6/135: dwrite d6/f9 [876544,118784] 0 2024-02-19T19:12:08.020 INFO:tasks.workunit.client.1.smithi125.stdout:6/136: stat d6/f1e 0 2024-02-19T19:12:08.020 INFO:tasks.workunit.client.1.smithi125.stdout:6/137: write d6/db/df/d1b/f19 [2128938,28302] 0 2024-02-19T19:12:08.020 INFO:tasks.workunit.client.1.smithi125.stdout:6/138: mknod d6/db/c23 0 2024-02-19T19:12:08.020 INFO:tasks.workunit.client.1.smithi125.stdout:6/139: creat d6/db/df/d1b/f24 x:0 0 0 2024-02-19T19:12:08.020 INFO:tasks.workunit.client.1.smithi125.stdout:6/140: creat d6/db/df/d16/f25 x:0 0 0 2024-02-19T19:12:08.020 INFO:tasks.workunit.client.1.smithi125.stdout:6/141: write d6/db/f17 [935802,86497] 0 2024-02-19T19:12:08.020 INFO:tasks.workunit.client.1.smithi125.stdout:5/155: dwrite db/d17/f1b [2105344,122880] 0 2024-02-19T19:12:08.021 INFO:tasks.workunit.client.1.smithi125.stdout:5/156: chown db/f1d 44 1 2024-02-19T19:12:08.021 INFO:tasks.workunit.client.1.smithi125.stdout:5/157: chown db/d26/l29 2981 1 2024-02-19T19:12:08.021 INFO:tasks.workunit.client.1.smithi125.stdout:5/158: rmdir db 39 2024-02-19T19:12:08.021 INFO:tasks.workunit.client.1.smithi125.stdout:9/95: dwrite d8/f18 [294912,86016] 0 2024-02-19T19:12:08.021 INFO:tasks.workunit.client.1.smithi125.stdout:9/96: stat d8/ld 0 2024-02-19T19:12:08.021 INFO:tasks.workunit.client.1.smithi125.stdout:8/88: dwrite db/f1c [1036288,69632] 0 2024-02-19T19:12:08.058 INFO:tasks.workunit.client.1.smithi125.stdout:4/82: fdatasync d0/d7/f13 0 2024-02-19T19:12:08.058 INFO:tasks.workunit.client.1.smithi125.stdout:4/83: truncate d0/f1b 872458 0 2024-02-19T19:12:08.058 INFO:tasks.workunit.client.1.smithi125.stdout:4/84: rmdir d0/d7 39 2024-02-19T19:12:08.060 INFO:tasks.workunit.client.1.smithi125.stdout:1/113: dwrite d1/f9 [1114112,8192] 0 2024-02-19T19:12:08.062 INFO:tasks.workunit.client.1.smithi125.stdout:9/97: symlink d8/d15/l21 0 2024-02-19T19:12:08.062 INFO:tasks.workunit.client.1.smithi125.stdout:9/98: chown d8/la 860 1 2024-02-19T19:12:08.062 INFO:tasks.workunit.client.1.smithi125.stdout:9/99: write d8/f18 [8513,14452] 0 2024-02-19T19:12:08.062 INFO:tasks.workunit.client.1.smithi125.stdout:9/100: mkdir d8/d15/d22 0 2024-02-19T19:12:08.062 INFO:tasks.workunit.client.1.smithi125.stdout:8/89: unlink db/d18/c1a 0 2024-02-19T19:12:08.062 INFO:tasks.workunit.client.1.smithi125.stdout:4/85: write d0/d7/dc/f18 [823327,109763] 0 2024-02-19T19:12:08.062 INFO:tasks.workunit.client.1.smithi125.stdout:4/86: dread d0/fa [1220608,86016] 0 2024-02-19T19:12:08.063 INFO:tasks.workunit.client.1.smithi125.stdout:4/87: unlink d0/d7/cb 0 2024-02-19T19:12:08.063 INFO:tasks.workunit.client.1.smithi125.stdout:4/88: creat d0/df/f1c x:0 0 0 2024-02-19T19:12:08.064 INFO:tasks.workunit.client.1.smithi125.stdout:1/114: dwrite d1/f14 [548864,69632] 0 2024-02-19T19:12:08.064 INFO:tasks.workunit.client.1.smithi125.stdout:1/115: dread d1/f9 [1687552,69632] 0 2024-02-19T19:12:08.064 INFO:tasks.workunit.client.1.smithi125.stdout:9/101: dwrite d8/f20 [524288,98304] 0 2024-02-19T19:12:08.064 INFO:tasks.workunit.client.1.smithi125.stdout:9/102: dread - d8/d15/f1c zero size 2024-02-19T19:12:08.064 INFO:tasks.workunit.client.1.smithi125.stdout:9/103: symlink d8/d15/l23 0 2024-02-19T19:12:08.064 INFO:tasks.workunit.client.1.smithi125.stdout:9/104: unlink d8/d12/f1b 0 2024-02-19T19:12:08.125 INFO:tasks.workunit.client.1.smithi125.stdout:5/159: link db/f1d db/d26/d27/d25/f32 0 2024-02-19T19:12:08.125 INFO:tasks.workunit.client.1.smithi125.stdout:5/160: dread db/f21 [126976,49152] 0 2024-02-19T19:12:08.126 INFO:tasks.workunit.client.1.smithi125.stdout:5/161: mkdir db/d26/d27/d33 0 2024-02-19T19:12:08.126 INFO:tasks.workunit.client.1.smithi125.stdout:5/162: write db/d17/f20 [169288,71545] 0 2024-02-19T19:12:08.126 INFO:tasks.workunit.client.1.smithi125.stdout:5/163: creat db/f34 x:0 0 0 2024-02-19T19:12:08.127 INFO:tasks.workunit.client.1.smithi125.stdout:3/128: sync 2024-02-19T19:12:08.127 INFO:tasks.workunit.client.1.smithi125.stdout:8/90: dwrite db/f16 [303104,90112] 0 2024-02-19T19:12:08.128 INFO:tasks.workunit.client.1.smithi125.stdout:1/116: dwrite f0 [1732608,12288] 0 2024-02-19T19:12:08.128 INFO:tasks.workunit.client.1.smithi125.stdout:9/105: dwrite f1 [1667072,118784] 0 2024-02-19T19:12:08.128 INFO:tasks.workunit.client.1.smithi125.stdout:9/106: creat d8/d15/d22/f24 x:0 0 0 2024-02-19T19:12:08.128 INFO:tasks.workunit.client.1.smithi125.stdout:9/107: truncate d8/f11 572717 0 2024-02-19T19:12:08.136 INFO:tasks.workunit.client.1.smithi125.stdout:5/164: read f6 [488968,91358] 0 2024-02-19T19:12:08.172 INFO:tasks.workunit.client.1.smithi125.stdout:0/125: fsync d5/d9/fb 0 2024-02-19T19:12:08.172 INFO:tasks.workunit.client.1.smithi125.stdout:4/89: fdatasync d0/df/f11 0 2024-02-19T19:12:08.172 INFO:tasks.workunit.client.1.smithi125.stdout:0/126: symlink d5/d15/l2e 0 2024-02-19T19:12:08.172 INFO:tasks.workunit.client.1.smithi125.stdout:0/127: truncate d5/f16 2778040 0 2024-02-19T19:12:08.172 INFO:tasks.workunit.client.1.smithi125.stdout:0/128: rename d5/f16 to d5/d19/f2f 0 2024-02-19T19:12:08.172 INFO:tasks.workunit.client.1.smithi125.stdout:0/129: mknod d5/d19/c30 0 2024-02-19T19:12:08.173 INFO:tasks.workunit.client.1.smithi125.stdout:0/130: symlink d5/d19/l31 0 2024-02-19T19:12:08.173 INFO:tasks.workunit.client.1.smithi125.stdout:0/131: mkdir d5/d19/d27/d32 0 2024-02-19T19:12:08.173 INFO:tasks.workunit.client.1.smithi125.stdout:0/132: write d5/d19/f2f [2806162,29908] 0 2024-02-19T19:12:08.173 INFO:tasks.workunit.client.1.smithi125.stdout:0/133: mkdir d5/d33 0 2024-02-19T19:12:08.173 INFO:tasks.workunit.client.1.smithi125.stdout:3/129: dwrite d0/d1/f17 [1261568,4096] 0 2024-02-19T19:12:08.173 INFO:tasks.workunit.client.1.smithi125.stdout:3/130: creat d0/d1/f23 x:0 0 0 2024-02-19T19:12:08.173 INFO:tasks.workunit.client.1.smithi125.stdout:3/131: dread d0/ff [770048,45056] 0 2024-02-19T19:12:08.173 INFO:tasks.workunit.client.1.smithi125.stdout:3/132: write d0/de/f13 [3081457,53927] 0 2024-02-19T19:12:08.174 INFO:tasks.workunit.client.1.smithi125.stdout:3/133: rename d0/de/f20 to d0/f24 0 2024-02-19T19:12:08.178 INFO:tasks.workunit.client.1.smithi125.stdout:5/165: dwrite db/f34 [425984,12288] 0 2024-02-19T19:12:08.178 INFO:tasks.workunit.client.1.smithi125.stdout:5/166: link db/lc db/l35 0 2024-02-19T19:12:08.178 INFO:tasks.workunit.client.1.smithi125.stdout:5/167: symlink db/d26/d27/d33/l36 0 2024-02-19T19:12:08.179 INFO:tasks.workunit.client.1.smithi125.stdout:5/168: creat db/d26/d27/f37 x:0 0 0 2024-02-19T19:12:08.179 INFO:tasks.workunit.client.1.smithi125.stdout:5/169: symlink db/l38 0 2024-02-19T19:12:08.179 INFO:tasks.workunit.client.1.smithi125.stdout:1/117: truncate f0 674258 0 2024-02-19T19:12:08.179 INFO:tasks.workunit.client.1.smithi125.stdout:5/170: write db/d26/d27/d25/f32 [966824,112076] 0 2024-02-19T19:12:08.179 INFO:tasks.workunit.client.1.smithi125.stdout:5/171: write db/f1d [1375396,28286] 0 2024-02-19T19:12:08.179 INFO:tasks.workunit.client.1.smithi125.stdout:5/172: unlink db/cd 0 2024-02-19T19:12:08.179 INFO:tasks.workunit.client.1.smithi125.stdout:5/173: creat db/d26/d27/d25/f39 x:0 0 0 2024-02-19T19:12:08.179 INFO:tasks.workunit.client.1.smithi125.stdout:5/174: dread db/d26/d27/f1f [679936,20480] 0 2024-02-19T19:12:08.180 INFO:tasks.workunit.client.1.smithi125.stdout:5/175: truncate db/d26/f2d 881078 0 2024-02-19T19:12:08.180 INFO:tasks.workunit.client.1.smithi125.stdout:1/118: write d1/dc/f1b [544134,125660] 0 2024-02-19T19:12:08.180 INFO:tasks.workunit.client.1.smithi125.stdout:5/176: creat db/d26/d27/f3a x:0 0 0 2024-02-19T19:12:08.180 INFO:tasks.workunit.client.1.smithi125.stdout:5/177: creat db/d26/d27/f3b x:0 0 0 2024-02-19T19:12:08.180 INFO:tasks.workunit.client.1.smithi125.stdout:5/178: rmdir db/d26/d27/d25 39 2024-02-19T19:12:08.180 INFO:tasks.workunit.client.1.smithi125.stdout:5/179: creat db/d26/d27/d25/f3c x:0 0 0 2024-02-19T19:12:08.180 INFO:tasks.workunit.client.1.smithi125.stdout:5/180: mknod db/d26/c3d 0 2024-02-19T19:12:08.181 INFO:tasks.workunit.client.1.smithi125.stdout:5/181: chown db/l38 1094 1 2024-02-19T19:12:08.181 INFO:tasks.workunit.client.1.smithi125.stdout:5/182: dread - db/d17/f1e zero size 2024-02-19T19:12:08.181 INFO:tasks.workunit.client.1.smithi125.stdout:1/119: unlink d1/dc/f12 0 2024-02-19T19:12:08.181 INFO:tasks.workunit.client.1.smithi125.stdout:5/183: rmdir db/d26/d27/d25 39 2024-02-19T19:12:08.181 INFO:tasks.workunit.client.1.smithi125.stdout:9/108: dwrite d8/f20 [860160,110592] 0 2024-02-19T19:12:08.181 INFO:tasks.workunit.client.1.smithi125.stdout:1/120: write d1/dc/f1b [665972,94434] 0 2024-02-19T19:12:08.181 INFO:tasks.workunit.client.1.smithi125.stdout:9/109: symlink d8/d15/l25 0 2024-02-19T19:12:08.181 INFO:tasks.workunit.client.1.smithi125.stdout:5/184: write db/d26/f2d [774170,123614] 0 2024-02-19T19:12:08.182 INFO:tasks.workunit.client.1.smithi125.stdout:9/110: truncate d8/d15/f1c 27800 0 2024-02-19T19:12:08.182 INFO:tasks.workunit.client.1.smithi125.stdout:5/185: chown db/d17 7724969 1 2024-02-19T19:12:08.182 INFO:tasks.workunit.client.1.smithi125.stdout:5/186: stat db/d26/d27 0 2024-02-19T19:12:08.182 INFO:tasks.workunit.client.1.smithi125.stdout:5/187: chown db/d26/d27/d25/f39 14 1 2024-02-19T19:12:08.182 INFO:tasks.workunit.client.1.smithi125.stdout:5/188: rmdir db/d26/d27 39 2024-02-19T19:12:08.182 INFO:tasks.workunit.client.1.smithi125.stdout:9/111: creat d8/f26 x:0 0 0 2024-02-19T19:12:08.182 INFO:tasks.workunit.client.1.smithi125.stdout:9/112: mknod d8/d15/c27 0 2024-02-19T19:12:08.182 INFO:tasks.workunit.client.1.smithi125.stdout:9/113: write d8/f9 [1341536,12710] 0 2024-02-19T19:12:08.182 INFO:tasks.workunit.client.1.smithi125.stdout:9/114: dread f2 [20480,126976] 0 2024-02-19T19:12:08.183 INFO:tasks.workunit.client.1.smithi125.stdout:9/115: truncate d8/fe 990041 0 2024-02-19T19:12:08.183 INFO:tasks.workunit.client.1.smithi125.stdout:4/90: dread d0/d7/dc/fd [405504,77824] 0 2024-02-19T19:12:08.183 INFO:tasks.workunit.client.1.smithi125.stdout:0/134: dwrite d5/d9/fb [966656,45056] 0 2024-02-19T19:12:08.183 INFO:tasks.workunit.client.1.smithi125.stdout:0/135: creat d5/d1a/f34 x:0 0 0 2024-02-19T19:12:08.183 INFO:tasks.workunit.client.1.smithi125.stdout:0/136: rename d5/d9/l25 to d5/l35 0 2024-02-19T19:12:08.183 INFO:tasks.workunit.client.1.smithi125.stdout:3/134: dwrite d0/d1/fc [1269760,16384] 0 2024-02-19T19:12:08.183 INFO:tasks.workunit.client.1.smithi125.stdout:0/137: dread d5/d19/f2f [1429504,126976] 0 2024-02-19T19:12:08.183 INFO:tasks.workunit.client.1.smithi125.stdout:3/135: symlink d0/de/l25 0 2024-02-19T19:12:08.184 INFO:tasks.workunit.client.1.smithi125.stdout:3/136: write d0/d1/d1e/f1f [939629,121455] 0 2024-02-19T19:12:08.184 INFO:tasks.workunit.client.1.smithi125.stdout:1/121: dwrite d1/dc/f1f [135168,122880] 0 2024-02-19T19:12:08.184 INFO:tasks.workunit.client.1.smithi125.stdout:1/122: getdents d1/dc/d1d 0 2024-02-19T19:12:08.184 INFO:tasks.workunit.client.1.smithi125.stdout:1/123: symlink d1/dc/d1d/l21 0 2024-02-19T19:12:08.184 INFO:tasks.workunit.client.1.smithi125.stdout:1/124: creat d1/f22 x:0 0 0 2024-02-19T19:12:08.184 INFO:tasks.workunit.client.1.smithi125.stdout:1/125: mkdir d1/dc/d1d/d23 0 2024-02-19T19:12:08.184 INFO:tasks.workunit.client.1.smithi125.stdout:1/126: mkdir d1/d24 0 2024-02-19T19:12:08.184 INFO:tasks.workunit.client.1.smithi125.stdout:1/127: chown d1/d1a/c1c 32833461 1 2024-02-19T19:12:08.185 INFO:tasks.workunit.client.1.smithi125.stdout:1/128: rename d1/dc/l15 to d1/d1a/l25 0 2024-02-19T19:12:08.237 INFO:tasks.workunit.client.1.smithi125.stdout:0/138: fdatasync d5/ff 0 2024-02-19T19:12:08.241 INFO:tasks.workunit.client.1.smithi125.stdout:1/129: dwrite d1/dc/f1f [1163264,32768] 0 2024-02-19T19:12:08.241 INFO:tasks.workunit.client.1.smithi125.stdout:4/91: dwrite d0/d7/dc/fd [819200,98304] 0 2024-02-19T19:12:08.241 INFO:tasks.workunit.client.1.smithi125.stdout:1/130: write d1/dc/f17 [1314944,24395] 0 2024-02-19T19:12:08.241 INFO:tasks.workunit.client.1.smithi125.stdout:4/92: creat d0/df/f1d x:0 0 0 2024-02-19T19:12:08.241 INFO:tasks.workunit.client.1.smithi125.stdout:4/93: truncate d0/d7/dc/f9 2660099 0 2024-02-19T19:12:08.241 INFO:tasks.workunit.client.1.smithi125.stdout:4/94: rename d0/d7/f14 to d0/d7/dc/f1e 0 2024-02-19T19:12:08.241 INFO:tasks.workunit.client.1.smithi125.stdout:4/95: mknod d0/d7/dc/c1f 0 2024-02-19T19:12:08.241 INFO:tasks.workunit.client.1.smithi125.stdout:0/139: write d5/d1a/f20 [1863033,28898] 0 2024-02-19T19:12:08.242 INFO:tasks.workunit.client.1.smithi125.stdout:4/96: chown d0/df 118100 1 2024-02-19T19:12:08.242 INFO:tasks.workunit.client.1.smithi125.stdout:4/97: getdents d0/d7 0 2024-02-19T19:12:08.242 INFO:tasks.workunit.client.1.smithi125.stdout:4/98: mknod d0/df/c20 0 2024-02-19T19:12:08.242 INFO:tasks.workunit.client.1.smithi125.stdout:0/140: write d5/ff [1406690,79699] 0 2024-02-19T19:12:08.242 INFO:tasks.workunit.client.1.smithi125.stdout:0/141: symlink d5/d33/l36 0 2024-02-19T19:12:08.242 INFO:tasks.workunit.client.1.smithi125.stdout:0/142: link d5/ff d5/d19/d27/d32/f37 0 2024-02-19T19:12:08.242 INFO:tasks.workunit.client.1.smithi125.stdout:0/143: dread d5/f1f [577536,81920] 0 2024-02-19T19:12:08.242 INFO:tasks.workunit.client.1.smithi125.stdout:0/144: symlink d5/d19/l38 0 2024-02-19T19:12:08.242 INFO:tasks.workunit.client.1.smithi125.stdout:0/145: chown d5/d19 3648799 1 2024-02-19T19:12:08.272 INFO:tasks.workunit.client.1.smithi125.stdout:0/146: dwrite d5/d9/f26 [1912832,4096] 0 2024-02-19T19:12:08.272 INFO:tasks.workunit.client.1.smithi125.stdout:0/147: symlink d5/d1a/l39 0 2024-02-19T19:12:08.272 INFO:tasks.workunit.client.1.smithi125.stdout:0/148: getdents d5 0 2024-02-19T19:12:08.273 INFO:tasks.workunit.client.1.smithi125.stdout:0/149: creat d5/d19/d27/d32/f3a x:0 0 0 2024-02-19T19:12:08.273 INFO:tasks.workunit.client.1.smithi125.stdout:0/150: truncate d5/d9/fd 570924 0 2024-02-19T19:12:08.273 INFO:tasks.workunit.client.1.smithi125.stdout:0/151: chown d5/d9/f26 7866 1 2024-02-19T19:12:08.273 INFO:tasks.workunit.client.1.smithi125.stdout:0/152: link d5/d19/l31 d5/d15/l3b 0 2024-02-19T19:12:08.273 INFO:tasks.workunit.client.1.smithi125.stdout:0/153: link d5/d19/d27/d32/f3a d5/d19/d27/d32/f3c 0 2024-02-19T19:12:08.273 INFO:tasks.workunit.client.1.smithi125.stdout:0/154: mkdir d5/d1a/d3d 0 2024-02-19T19:12:08.273 INFO:tasks.workunit.client.1.smithi125.stdout:0/155: rmdir d5/d1a/d3d 0 2024-02-19T19:12:08.300 INFO:tasks.workunit.client.1.smithi125.stdout:5/189: fsync db/d26/f2d 0 2024-02-19T19:12:08.366 INFO:tasks.workunit.client.1.smithi125.stdout:0/156: fsync d5/d9/fb 0 2024-02-19T19:12:08.368 INFO:tasks.workunit.client.1.smithi125.stdout:5/190: creat db/d26/d27/d33/f3e x:0 0 0 2024-02-19T19:12:08.368 INFO:tasks.workunit.client.1.smithi125.stdout:5/191: mknod db/d26/c3f 0 2024-02-19T19:12:08.368 INFO:tasks.workunit.client.1.smithi125.stdout:5/192: getdents db/d26 0 2024-02-19T19:12:08.368 INFO:tasks.workunit.client.1.smithi125.stdout:5/193: getdents db/d26 0 2024-02-19T19:12:08.368 INFO:tasks.workunit.client.1.smithi125.stdout:5/194: read db/d26/d27/f23 [872029,87687] 0 2024-02-19T19:12:08.368 INFO:tasks.workunit.client.1.smithi125.stdout:5/195: chown db/c2c 515130 1 2024-02-19T19:12:08.368 INFO:tasks.workunit.client.1.smithi125.stdout:5/196: write db/d17/f1e [463096,68802] 0 2024-02-19T19:12:08.374 INFO:tasks.workunit.client.1.smithi125.stdout:0/157: dwrite d5/ff [1404928,49152] 0 2024-02-19T19:12:08.390 INFO:tasks.workunit.client.1.smithi125.stdout:5/197: fsync db/d26/d27/ff 0 2024-02-19T19:12:08.391 INFO:tasks.workunit.client.1.smithi125.stdout:5/198: stat f6 0 2024-02-19T19:12:08.391 INFO:tasks.workunit.client.1.smithi125.stdout:0/158: fdatasync d5/d1a/f34 0 2024-02-19T19:12:08.391 INFO:tasks.workunit.client.1.smithi125.stdout:9/116: fdatasync d8/f9 0 2024-02-19T19:12:08.391 INFO:tasks.workunit.client.1.smithi125.stdout:4/99: fsync d0/fa 0 2024-02-19T19:12:08.391 INFO:tasks.workunit.client.1.smithi125.stdout:4/100: stat d0/d7/l8 0 2024-02-19T19:12:08.391 INFO:tasks.workunit.client.1.smithi125.stdout:5/199: fsync db/d26/d27/f1f 0 2024-02-19T19:12:08.391 INFO:tasks.workunit.client.1.smithi125.stdout:0/159: dwrite d5/d19/f2f [1699840,4096] 0 2024-02-19T19:12:08.394 INFO:tasks.workunit.client.1.smithi125.stdout:9/117: creat d8/f28 x:0 0 0 2024-02-19T19:12:08.394 INFO:tasks.workunit.client.1.smithi125.stdout:4/101: dwrite d0/d7/dc/fd [798720,24576] 0 2024-02-19T19:12:08.394 INFO:tasks.workunit.client.1.smithi125.stdout:5/200: truncate db/d26/d27/f1f 229285 0 2024-02-19T19:12:08.394 INFO:tasks.workunit.client.1.smithi125.stdout:4/102: truncate d0/fa 1892339 0 2024-02-19T19:12:08.394 INFO:tasks.workunit.client.1.smithi125.stdout:0/160: dwrite d5/d1a/f34 [454656,4096] 0 2024-02-19T19:12:08.394 INFO:tasks.workunit.client.1.smithi125.stdout:4/103: mknod d0/df/c21 0 2024-02-19T19:12:08.395 INFO:tasks.workunit.client.1.smithi125.stdout:4/104: dread - d0/df/f1d zero size 2024-02-19T19:12:08.395 INFO:tasks.workunit.client.1.smithi125.stdout:0/161: creat d5/d15/d2c/f3e x:0 0 0 2024-02-19T19:12:08.395 INFO:tasks.workunit.client.1.smithi125.stdout:5/201: write db/d26/d27/d25/f3c [198954,118011] 0 2024-02-19T19:12:08.395 INFO:tasks.workunit.client.1.smithi125.stdout:4/105: mknod d0/c22 0 2024-02-19T19:12:08.395 INFO:tasks.workunit.client.1.smithi125.stdout:4/106: stat d0/c22 0 2024-02-19T19:12:08.395 INFO:tasks.workunit.client.1.smithi125.stdout:0/162: unlink d5/d19/l38 0 2024-02-19T19:12:08.395 INFO:tasks.workunit.client.1.smithi125.stdout:4/107: getdents d0/d7 0 2024-02-19T19:12:08.395 INFO:tasks.workunit.client.1.smithi125.stdout:5/202: mkdir db/d26/d27/d25/d40 0 2024-02-19T19:12:08.395 INFO:tasks.workunit.client.1.smithi125.stdout:5/203: link db/d26/d27/ff db/d17/f41 0 2024-02-19T19:12:08.396 INFO:tasks.workunit.client.1.smithi125.stdout:0/163: write d5/d19/d27/d32/f3c [868387,46337] 0 2024-02-19T19:12:08.396 INFO:tasks.workunit.client.1.smithi125.stdout:5/204: mkdir db/d17/d42 0 2024-02-19T19:12:08.396 INFO:tasks.workunit.client.1.smithi125.stdout:4/108: truncate d0/d7/dc/f9 1166944 0 2024-02-19T19:12:08.396 INFO:tasks.workunit.client.1.smithi125.stdout:5/205: dread - db/f30 zero size 2024-02-19T19:12:08.396 INFO:tasks.workunit.client.1.smithi125.stdout:5/206: unlink db/f1d 0 2024-02-19T19:12:08.396 INFO:tasks.workunit.client.1.smithi125.stdout:5/207: creat db/d17/f43 x:0 0 0 2024-02-19T19:12:08.396 INFO:tasks.workunit.client.1.smithi125.stdout:4/109: creat d0/df/f23 x:0 0 0 2024-02-19T19:12:08.396 INFO:tasks.workunit.client.1.smithi125.stdout:5/208: write db/d26/d27/f2b [199512,101241] 0 2024-02-19T19:12:08.396 INFO:tasks.workunit.client.1.smithi125.stdout:5/209: unlink db/d26/d27/f2b 0 2024-02-19T19:12:08.397 INFO:tasks.workunit.client.1.smithi125.stdout:5/210: dread db/d17/f20 [1155072,118784] 0 2024-02-19T19:12:08.397 INFO:tasks.workunit.client.1.smithi125.stdout:5/211: truncate db/d26/d27/d33/f3e 345945 0 2024-02-19T19:12:08.397 INFO:tasks.workunit.client.1.smithi125.stdout:5/212: unlink db/d26/c2e 0 2024-02-19T19:12:08.397 INFO:tasks.workunit.client.1.smithi125.stdout:5/213: dread db/d26/d27/ff [839680,110592] 0 2024-02-19T19:12:08.397 INFO:tasks.workunit.client.1.smithi125.stdout:5/214: link db/d26/d27/c28 db/d26/d27/d33/c44 0 2024-02-19T19:12:08.397 INFO:tasks.workunit.client.1.smithi125.stdout:5/215: write db/d17/f1e [1445054,70831] 0 2024-02-19T19:12:08.397 INFO:tasks.workunit.client.1.smithi125.stdout:5/216: rename db/d17/f1b to db/d17/f45 0 2024-02-19T19:12:08.397 INFO:tasks.workunit.client.1.smithi125.stdout:5/217: getdents db/d26/d27/d25 0 2024-02-19T19:12:08.426 INFO:tasks.workunit.client.1.smithi125.stdout:9/118: dwrite d8/f9 [1794048,45056] 0 2024-02-19T19:12:08.427 INFO:tasks.workunit.client.1.smithi125.stdout:9/119: read d8/f18 [663831,10028] 0 2024-02-19T19:12:08.427 INFO:tasks.workunit.client.1.smithi125.stdout:9/120: creat d8/d15/f29 x:0 0 0 2024-02-19T19:12:08.427 INFO:tasks.workunit.client.1.smithi125.stdout:9/121: write f1 [764924,106784] 0 2024-02-19T19:12:08.427 INFO:tasks.workunit.client.1.smithi125.stdout:5/218: dwrite db/d17/f20 [3231744,45056] 0 2024-02-19T19:12:08.427 INFO:tasks.workunit.client.1.smithi125.stdout:5/219: mknod db/d26/d27/d33/c46 0 2024-02-19T19:12:08.427 INFO:tasks.workunit.client.1.smithi125.stdout:5/220: rmdir db/d26/d27/d25 39 2024-02-19T19:12:08.427 INFO:tasks.workunit.client.1.smithi125.stdout:4/110: dwrite d0/df/f1c [110592,16384] 0 2024-02-19T19:12:08.427 INFO:tasks.workunit.client.1.smithi125.stdout:5/221: mkdir db/d47 0 2024-02-19T19:12:08.428 INFO:tasks.workunit.client.1.smithi125.stdout:5/222: write db/d26/f2d [776423,73810] 0 2024-02-19T19:12:08.428 INFO:tasks.workunit.client.1.smithi125.stdout:0/164: dread d5/d1a/f34 [413696,45056] 0 2024-02-19T19:12:08.428 INFO:tasks.workunit.client.1.smithi125.stdout:0/165: getdents d5/d19/d27 0 2024-02-19T19:12:08.428 INFO:tasks.workunit.client.1.smithi125.stdout:5/223: write db/d26/d27/d33/f3e [827813,37869] 0 2024-02-19T19:12:08.428 INFO:tasks.workunit.client.1.smithi125.stdout:5/224: chown db/d47 0 1 2024-02-19T19:12:08.428 INFO:tasks.workunit.client.1.smithi125.stdout:0/166: mknod d5/d9/c3f 0 2024-02-19T19:12:08.428 INFO:tasks.workunit.client.1.smithi125.stdout:5/225: getdents db/d26 0 2024-02-19T19:12:08.428 INFO:tasks.workunit.client.1.smithi125.stdout:4/111: write d0/df/f11 [1449157,90102] 0 2024-02-19T19:12:08.429 INFO:tasks.workunit.client.1.smithi125.stdout:0/167: write d5/d9/fb [1023087,94512] 0 2024-02-19T19:12:08.429 INFO:tasks.workunit.client.1.smithi125.stdout:4/112: write d0/d7/dc/f18 [1658054,77957] 0 2024-02-19T19:12:08.429 INFO:tasks.workunit.client.1.smithi125.stdout:9/122: dwrite f2 [1855488,110592] 0 2024-02-19T19:12:08.429 INFO:tasks.workunit.client.1.smithi125.stdout:4/113: creat d0/d7/dc/f24 x:0 0 0 2024-02-19T19:12:08.429 INFO:tasks.workunit.client.1.smithi125.stdout:4/114: symlink d0/d7/l25 0 2024-02-19T19:12:08.429 INFO:tasks.workunit.client.1.smithi125.stdout:9/123: write d8/f9 [647158,127215] 0 2024-02-19T19:12:08.429 INFO:tasks.workunit.client.1.smithi125.stdout:4/115: rename d0/df/f11 to d0/d7/f26 0 2024-02-19T19:12:08.429 INFO:tasks.workunit.client.1.smithi125.stdout:4/116: truncate d0/df/f1c 935559 0 2024-02-19T19:12:08.429 INFO:tasks.workunit.client.1.smithi125.stdout:4/117: mknod d0/c27 0 2024-02-19T19:12:08.430 INFO:tasks.workunit.client.1.smithi125.stdout:4/118: chown d0/d7/f13 122 1 2024-02-19T19:12:08.430 INFO:tasks.workunit.client.1.smithi125.stdout:4/119: creat d0/d7/dc/f28 x:0 0 0 2024-02-19T19:12:08.430 INFO:tasks.workunit.client.1.smithi125.stdout:4/120: chown d0/df/c20 0 1 2024-02-19T19:12:08.430 INFO:tasks.workunit.client.1.smithi125.stdout:4/121: dread d0/fa [352256,81920] 0 2024-02-19T19:12:08.454 INFO:tasks.workunit.client.1.smithi125.stdout:9/124: fdatasync d8/f1a 0 2024-02-19T19:12:08.455 INFO:tasks.workunit.client.1.smithi125.stdout:5/226: dwrite f6 [147456,24576] 0 2024-02-19T19:12:08.458 INFO:tasks.workunit.client.1.smithi125.stdout:9/125: read f7 [337966,13461] 0 2024-02-19T19:12:08.458 INFO:tasks.workunit.client.1.smithi125.stdout:0/168: dwrite d5/d9/fd [229376,77824] 0 2024-02-19T19:12:08.458 INFO:tasks.workunit.client.1.smithi125.stdout:9/126: chown f7 3921 1 2024-02-19T19:12:08.458 INFO:tasks.workunit.client.1.smithi125.stdout:0/169: getdents d5 0 2024-02-19T19:12:08.462 INFO:tasks.workunit.client.1.smithi125.stdout:0/170: mknod d5/c40 0 2024-02-19T19:12:08.462 INFO:tasks.workunit.client.1.smithi125.stdout:0/171: dread d5/d19/d27/d32/f37 [790528,20480] 0 2024-02-19T19:12:08.462 INFO:tasks.workunit.client.1.smithi125.stdout:0/172: link d5/d1a/c2d d5/d19/c41 0 2024-02-19T19:12:08.462 INFO:tasks.workunit.client.1.smithi125.stdout:0/173: rmdir d5/d15/d2c 39 2024-02-19T19:12:08.462 INFO:tasks.workunit.client.1.smithi125.stdout:0/174: dread d5/d1a/f20 [819200,45056] 0 2024-02-19T19:12:08.463 INFO:tasks.workunit.client.1.smithi125.stdout:0/175: mkdir d5/d33/d42 0 2024-02-19T19:12:08.463 INFO:tasks.workunit.client.1.smithi125.stdout:0/176: truncate d5/d19/f2f 688111 0 2024-02-19T19:12:08.463 INFO:tasks.workunit.client.1.smithi125.stdout:5/227: dwrite f6 [1327104,45056] 0 2024-02-19T19:12:08.463 INFO:tasks.workunit.client.1.smithi125.stdout:9/127: dwrite d8/fe [1777664,4096] 0 2024-02-19T19:12:08.463 INFO:tasks.workunit.client.1.smithi125.stdout:5/228: creat db/d26/d27/f48 x:0 0 0 2024-02-19T19:12:08.463 INFO:tasks.workunit.client.1.smithi125.stdout:5/229: mknod db/d17/c49 0 2024-02-19T19:12:08.463 INFO:tasks.workunit.client.1.smithi125.stdout:9/128: creat d8/d12/f2a x:0 0 0 2024-02-19T19:12:08.463 INFO:tasks.workunit.client.1.smithi125.stdout:5/230: chown db/d26/d27/f3b 30218 1 2024-02-19T19:12:08.463 INFO:tasks.workunit.client.1.smithi125.stdout:9/129: mknod d8/d12/c2b 0 2024-02-19T19:12:08.464 INFO:tasks.workunit.client.1.smithi125.stdout:9/130: truncate d8/f1a 644067 0 2024-02-19T19:12:08.464 INFO:tasks.workunit.client.1.smithi125.stdout:9/131: creat d8/d15/f2c x:0 0 0 2024-02-19T19:12:08.464 INFO:tasks.workunit.client.1.smithi125.stdout:0/177: dwrite d5/f1f [647168,114688] 0 2024-02-19T19:12:08.464 INFO:tasks.workunit.client.1.smithi125.stdout:0/178: rmdir d5/d15 39 2024-02-19T19:12:08.464 INFO:tasks.workunit.client.1.smithi125.stdout:0/179: creat d5/d15/d2c/f43 x:0 0 0 2024-02-19T19:12:08.464 INFO:tasks.workunit.client.1.smithi125.stdout:0/180: chown d5/d19 7 1 2024-02-19T19:12:08.464 INFO:tasks.workunit.client.1.smithi125.stdout:0/181: truncate d5/d9/fd 514629 0 2024-02-19T19:12:08.464 INFO:tasks.workunit.client.1.smithi125.stdout:0/182: write d5/d19/d27/d32/f3a [903695,65614] 0 2024-02-19T19:12:08.465 INFO:tasks.workunit.client.1.smithi125.stdout:0/183: creat d5/d19/f44 x:0 0 0 2024-02-19T19:12:08.465 INFO:tasks.workunit.client.1.smithi125.stdout:0/184: link d5/d15/d2c/f3e d5/d33/d42/f45 0 2024-02-19T19:12:08.465 INFO:tasks.workunit.client.1.smithi125.stdout:0/185: chown d5/d15/l2e 52 1 2024-02-19T19:12:08.465 INFO:tasks.workunit.client.1.smithi125.stdout:0/186: mkdir d5/d33/d46 0 2024-02-19T19:12:08.465 INFO:tasks.workunit.client.1.smithi125.stdout:0/187: creat d5/d19/f47 x:0 0 0 2024-02-19T19:12:08.465 INFO:tasks.workunit.client.1.smithi125.stdout:0/188: mkdir d5/d19/d48 0 2024-02-19T19:12:08.465 INFO:tasks.workunit.client.1.smithi125.stdout:0/189: dread d5/d19/d27/d32/f37 [495616,98304] 0 2024-02-19T19:12:08.465 INFO:tasks.workunit.client.1.smithi125.stdout:0/190: dread d5/f8 [679936,81920] 0 2024-02-19T19:12:08.465 INFO:tasks.workunit.client.1.smithi125.stdout:0/191: mknod d5/d19/d48/c49 0 2024-02-19T19:12:08.466 INFO:tasks.workunit.client.1.smithi125.stdout:0/192: mkdir d5/d19/d4a 0 2024-02-19T19:12:08.535 INFO:tasks.workunit.client.1.smithi125.stdout:9/132: mknod d8/d15/d22/c2d 0 2024-02-19T19:12:08.535 INFO:tasks.workunit.client.1.smithi125.stdout:9/133: read - d8/d15/d22/f24 zero size 2024-02-19T19:12:08.536 INFO:tasks.workunit.client.1.smithi125.stdout:9/134: read f1 [506767,17182] 0 2024-02-19T19:12:08.537 INFO:tasks.workunit.client.1.smithi125.stdout:2/142: sync 2024-02-19T19:12:08.537 INFO:tasks.workunit.client.1.smithi125.stdout:7/125: sync 2024-02-19T19:12:08.538 INFO:tasks.workunit.client.1.smithi125.stdout:1/131: sync 2024-02-19T19:12:08.538 INFO:tasks.workunit.client.1.smithi125.stdout:3/137: sync 2024-02-19T19:12:08.538 INFO:tasks.workunit.client.1.smithi125.stdout:6/142: sync 2024-02-19T19:12:08.538 INFO:tasks.workunit.client.1.smithi125.stdout:8/91: sync 2024-02-19T19:12:08.538 INFO:tasks.workunit.client.1.smithi125.stdout:2/143: symlink d1/l28 0 2024-02-19T19:12:08.538 INFO:tasks.workunit.client.1.smithi125.stdout:1/132: read d1/dc/f1b [421289,8946] 0 2024-02-19T19:12:08.538 INFO:tasks.workunit.client.1.smithi125.stdout:8/92: rename db/d18 to db/d18/d1d 22 2024-02-19T19:12:08.538 INFO:tasks.workunit.client.1.smithi125.stdout:1/133: getdents d1/dc/d1d/d23 0 2024-02-19T19:12:08.539 INFO:tasks.workunit.client.1.smithi125.stdout:3/138: read d0/d1/d1e/f1f [1028255,85145] 0 2024-02-19T19:12:08.539 INFO:tasks.workunit.client.1.smithi125.stdout:1/134: chown d1/f14 430341 1 2024-02-19T19:12:08.539 INFO:tasks.workunit.client.1.smithi125.stdout:1/135: chown d1/c2 663 1 2024-02-19T19:12:08.539 INFO:tasks.workunit.client.1.smithi125.stdout:8/93: truncate db/fc 1371142 0 2024-02-19T19:12:08.539 INFO:tasks.workunit.client.1.smithi125.stdout:2/144: write d1/d27/d1d/f24 [1263455,19571] 0 2024-02-19T19:12:08.539 INFO:tasks.workunit.client.1.smithi125.stdout:7/126: write f5 [514656,28622] 0 2024-02-19T19:12:08.539 INFO:tasks.workunit.client.1.smithi125.stdout:1/136: rename d1/dc/d1d to d1/d26 0 2024-02-19T19:12:08.539 INFO:tasks.workunit.client.1.smithi125.stdout:1/137: rename d1/dc/l10 to d1/d26/l27 0 2024-02-19T19:12:08.539 INFO:tasks.workunit.client.1.smithi125.stdout:1/138: mknod d1/d26/d23/c28 0 2024-02-19T19:12:08.540 INFO:tasks.workunit.client.1.smithi125.stdout:8/94: write f4 [3194231,66902] 0 2024-02-19T19:12:08.540 INFO:tasks.workunit.client.1.smithi125.stdout:8/95: chown db 111133125 1 2024-02-19T19:12:08.540 INFO:tasks.workunit.client.1.smithi125.stdout:7/127: unlink f7 0 2024-02-19T19:12:08.540 INFO:tasks.workunit.client.1.smithi125.stdout:8/96: creat db/f1e x:0 0 0 2024-02-19T19:12:08.540 INFO:tasks.workunit.client.1.smithi125.stdout:6/143: symlink d6/db/df/d16/l26 0 2024-02-19T19:12:08.540 INFO:tasks.workunit.client.1.smithi125.stdout:8/97: symlink db/l1f 0 2024-02-19T19:12:08.540 INFO:tasks.workunit.client.1.smithi125.stdout:8/98: readlink db/l17 0 2024-02-19T19:12:08.541 INFO:tasks.workunit.client.1.smithi125.stdout:6/144: unlink d6/db/df/d1b/f10 0 2024-02-19T19:12:08.541 INFO:tasks.workunit.client.1.smithi125.stdout:8/99: rename db/l14 to db/d18/l20 0 2024-02-19T19:12:08.541 INFO:tasks.workunit.client.1.smithi125.stdout:8/100: creat db/d18/f21 x:0 0 0 2024-02-19T19:12:08.585 INFO:tasks.workunit.client.1.smithi125.stdout:4/122: fsync d0/d7/dc/f24 0 2024-02-19T19:12:08.585 INFO:tasks.workunit.client.1.smithi125.stdout:4/123: dread - d0/d7/dc/f24 zero size 2024-02-19T19:12:08.585 INFO:tasks.workunit.client.1.smithi125.stdout:4/124: truncate d0/d7/dc/fd 204311 0 2024-02-19T19:12:08.585 INFO:tasks.workunit.client.1.smithi125.stdout:4/125: creat d0/d7/dc/f29 x:0 0 0 2024-02-19T19:12:08.585 INFO:tasks.workunit.client.1.smithi125.stdout:4/126: chown d0/d7/f15 35818322 1 2024-02-19T19:12:08.585 INFO:tasks.workunit.client.1.smithi125.stdout:4/127: truncate d0/d7/dc/fd 144145 0 2024-02-19T19:12:08.585 INFO:tasks.workunit.client.1.smithi125.stdout:4/128: dread d0/f1b [32768,40960] 0 2024-02-19T19:12:08.585 INFO:tasks.workunit.client.1.smithi125.stdout:4/129: stat d0/d7/l8 0 2024-02-19T19:12:08.586 INFO:tasks.workunit.client.1.smithi125.stdout:4/130: creat d0/df/f2a x:0 0 0 2024-02-19T19:12:08.586 INFO:tasks.workunit.client.1.smithi125.stdout:4/131: creat d0/d7/dc/f2b x:0 0 0 2024-02-19T19:12:08.588 INFO:tasks.workunit.client.1.smithi125.stdout:5/231: dwrite db/d26/f2d [815104,57344] 0 2024-02-19T19:12:08.588 INFO:tasks.workunit.client.1.smithi125.stdout:5/232: symlink db/d26/d27/d25/l4a 0 2024-02-19T19:12:08.588 INFO:tasks.workunit.client.1.smithi125.stdout:5/233: readlink db/d26/d27/l14 0 2024-02-19T19:12:08.589 INFO:tasks.workunit.client.1.smithi125.stdout:5/234: creat db/d26/d27/d25/d40/f4b x:0 0 0 2024-02-19T19:12:08.589 INFO:tasks.workunit.client.1.smithi125.stdout:5/235: rename db/d26/d27/d33/l36 to db/d26/d27/l4c 0 2024-02-19T19:12:08.589 INFO:tasks.workunit.client.1.smithi125.stdout:5/236: chown db/d26/c3d 972 1 2024-02-19T19:12:08.589 INFO:tasks.workunit.client.1.smithi125.stdout:5/237: dread - db/d26/d27/d25/f39 zero size 2024-02-19T19:12:08.589 INFO:tasks.workunit.client.1.smithi125.stdout:5/238: chown db/d26/d27/d33/f3e 112867 1 2024-02-19T19:12:08.589 INFO:tasks.workunit.client.1.smithi125.stdout:5/239: write db/f34 [366766,53834] 0 2024-02-19T19:12:08.589 INFO:tasks.workunit.client.1.smithi125.stdout:1/139: dwrite d1/dc/fd [1024000,94208] 0 2024-02-19T19:12:08.589 INFO:tasks.workunit.client.1.smithi125.stdout:1/140: mkdir d1/d26/d29 0 2024-02-19T19:12:08.590 INFO:tasks.workunit.client.1.smithi125.stdout:1/141: creat d1/d1a/f2a x:0 0 0 2024-02-19T19:12:08.590 INFO:tasks.workunit.client.1.smithi125.stdout:8/101: dwrite db/fc [847872,65536] 0 2024-02-19T19:12:08.590 INFO:tasks.workunit.client.1.smithi125.stdout:8/102: getdents db/d18 0 2024-02-19T19:12:08.590 INFO:tasks.workunit.client.1.smithi125.stdout:3/139: dwrite d0/de/f1c [962560,24576] 0 2024-02-19T19:12:08.590 INFO:tasks.workunit.client.1.smithi125.stdout:3/140: mknod d0/c26 0 2024-02-19T19:12:08.590 INFO:tasks.workunit.client.1.smithi125.stdout:3/141: readlink d0/l1b 0 2024-02-19T19:12:08.590 INFO:tasks.workunit.client.1.smithi125.stdout:8/103: write db/fc [1424529,80754] 0 2024-02-19T19:12:08.590 INFO:tasks.workunit.client.1.smithi125.stdout:8/104: rename db/l17 to db/d18/l22 0 2024-02-19T19:12:08.590 INFO:tasks.workunit.client.1.smithi125.stdout:8/105: rmdir db/d18 39 2024-02-19T19:12:08.591 INFO:tasks.workunit.client.1.smithi125.stdout:8/106: symlink db/l23 0 2024-02-19T19:12:08.591 INFO:tasks.workunit.client.1.smithi125.stdout:3/142: dread d0/d1/fc [1720320,53248] 0 2024-02-19T19:12:08.591 INFO:tasks.workunit.client.1.smithi125.stdout:3/143: creat d0/d1/d1e/f27 x:0 0 0 2024-02-19T19:12:08.592 INFO:tasks.workunit.client.1.smithi125.stdout:9/135: dread f2 [917504,65536] 0 2024-02-19T19:12:08.592 INFO:tasks.workunit.client.1.smithi125.stdout:9/136: rmdir d8/d15 39 2024-02-19T19:12:08.592 INFO:tasks.workunit.client.1.smithi125.stdout:9/137: mkdir d8/d2e 0 2024-02-19T19:12:08.592 INFO:tasks.workunit.client.1.smithi125.stdout:9/138: dread d8/d15/f1c [16384,77824] 0 2024-02-19T19:12:08.592 INFO:tasks.workunit.client.1.smithi125.stdout:9/139: truncate d8/f28 963006 0 2024-02-19T19:12:08.660 INFO:tasks.workunit.client.1.smithi125.stdout:7/128: fsync f11 0 2024-02-19T19:12:08.660 INFO:tasks.workunit.client.1.smithi125.stdout:1/142: fdatasync d1/dc/f1f 0 2024-02-19T19:12:08.660 INFO:tasks.workunit.client.1.smithi125.stdout:4/132: fdatasync d0/d7/dc/f9 0 2024-02-19T19:12:08.686 INFO:tasks.workunit.client.1.smithi125.stdout:1/143: fsync f0 0 2024-02-19T19:12:08.689 INFO:tasks.workunit.client.1.smithi125.stdout:5/240: dwrite db/d26/d27/d33/f3e [761856,110592] 0 2024-02-19T19:12:08.689 INFO:tasks.workunit.client.1.smithi125.stdout:3/144: dwrite d0/f24 [512000,53248] 0 2024-02-19T19:12:08.689 INFO:tasks.workunit.client.1.smithi125.stdout:4/133: symlink d0/l2c 0 2024-02-19T19:12:08.690 INFO:tasks.workunit.client.1.smithi125.stdout:4/134: dread d0/d7/dc/f9 [630784,53248] 0 2024-02-19T19:12:08.690 INFO:tasks.workunit.client.1.smithi125.stdout:3/145: creat d0/de/f28 x:0 0 0 2024-02-19T19:12:08.690 INFO:tasks.workunit.client.1.smithi125.stdout:5/241: read db/d26/d27/f23 [431146,105846] 0 2024-02-19T19:12:08.690 INFO:tasks.workunit.client.1.smithi125.stdout:4/135: write d0/df/f1c [695448,84928] 0 2024-02-19T19:12:08.690 INFO:tasks.workunit.client.1.smithi125.stdout:4/136: chown d0/d7/dc/fd 498257 1 2024-02-19T19:12:08.690 INFO:tasks.workunit.client.1.smithi125.stdout:3/146: symlink d0/d1/l29 0 2024-02-19T19:12:08.690 INFO:tasks.workunit.client.1.smithi125.stdout:4/137: creat d0/d7/dc/f2d x:0 0 0 2024-02-19T19:12:08.690 INFO:tasks.workunit.client.1.smithi125.stdout:5/242: write db/d26/d27/d25/d40/f4b [307745,48985] 0 2024-02-19T19:12:08.691 INFO:tasks.workunit.client.1.smithi125.stdout:3/147: creat d0/d1/f2a x:0 0 0 2024-02-19T19:12:08.691 INFO:tasks.workunit.client.1.smithi125.stdout:4/138: write d0/d7/f26 [1604465,37160] 0 2024-02-19T19:12:08.691 INFO:tasks.workunit.client.1.smithi125.stdout:3/148: chown d0/f19 709143757 1 2024-02-19T19:12:08.691 INFO:tasks.workunit.client.1.smithi125.stdout:4/139: unlink d0/c1 0 2024-02-19T19:12:08.691 INFO:tasks.workunit.client.1.smithi125.stdout:3/149: read d0/d1/fc [3076814,91054] 0 2024-02-19T19:12:08.691 INFO:tasks.workunit.client.1.smithi125.stdout:3/150: dread - d0/d1/f23 zero size 2024-02-19T19:12:08.691 INFO:tasks.workunit.client.1.smithi125.stdout:5/243: symlink db/d26/l4d 0 2024-02-19T19:12:08.691 INFO:tasks.workunit.client.1.smithi125.stdout:3/151: creat d0/de/f2b x:0 0 0 2024-02-19T19:12:08.691 INFO:tasks.workunit.client.1.smithi125.stdout:5/244: rename db/d26/f2d to db/d17/d42/f4e 0 2024-02-19T19:12:08.692 INFO:tasks.workunit.client.1.smithi125.stdout:3/152: rename d0/f12 to d0/d1/d1e/f2c 0 2024-02-19T19:12:08.692 INFO:tasks.workunit.client.1.smithi125.stdout:3/153: dread - d0/d1/f23 zero size 2024-02-19T19:12:08.692 INFO:tasks.workunit.client.1.smithi125.stdout:5/245: mkdir db/d26/d27/d4f 0 2024-02-19T19:12:08.692 INFO:tasks.workunit.client.1.smithi125.stdout:5/246: chown c9 0 1 2024-02-19T19:12:08.692 INFO:tasks.workunit.client.1.smithi125.stdout:5/247: stat db/l1a 0 2024-02-19T19:12:08.692 INFO:tasks.workunit.client.1.smithi125.stdout:5/248: mkdir db/d26/d27/d50 0 2024-02-19T19:12:08.692 INFO:tasks.workunit.client.1.smithi125.stdout:5/249: write db/d17/f43 [1006126,22670] 0 2024-02-19T19:12:08.692 INFO:tasks.workunit.client.1.smithi125.stdout:5/250: rmdir db/d26/d27/d50 0 2024-02-19T19:12:08.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:08 smithi125 ceph-mon[86115]: pgmap v149: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 576 B/s wr, 3 op/s; 8 B/s, 0 objects/s recovering 2024-02-19T19:12:08.710 INFO:tasks.workunit.client.1.smithi125.stdout:1/144: fdatasync f0 0 2024-02-19T19:12:08.710 INFO:tasks.workunit.client.1.smithi125.stdout:1/145: chown d1/dc/l1e 7689186 1 2024-02-19T19:12:08.711 INFO:tasks.workunit.client.1.smithi125.stdout:7/129: dwrite f5 [643072,98304] 0 2024-02-19T19:12:08.711 INFO:tasks.workunit.client.1.smithi125.stdout:7/130: mknod d12/d18/c21 0 2024-02-19T19:12:08.711 INFO:tasks.workunit.client.1.smithi125.stdout:7/131: write fb [1539451,130667] 0 2024-02-19T19:12:08.711 INFO:tasks.workunit.client.1.smithi125.stdout:7/132: rename d12/d18/c19 to d12/c22 0 2024-02-19T19:12:08.711 INFO:tasks.workunit.client.1.smithi125.stdout:7/133: write fb [639125,106864] 0 2024-02-19T19:12:08.712 INFO:tasks.workunit.client.1.smithi125.stdout:7/134: truncate fb 2188562 0 2024-02-19T19:12:08.712 INFO:tasks.workunit.client.1.smithi125.stdout:7/135: write f8 [467740,21801] 0 2024-02-19T19:12:08.712 INFO:tasks.workunit.client.1.smithi125.stdout:7/136: write f5 [216130,120705] 0 2024-02-19T19:12:08.712 INFO:tasks.workunit.client.1.smithi125.stdout:7/137: creat d12/d18/f23 x:0 0 0 2024-02-19T19:12:08.712 INFO:tasks.workunit.client.1.smithi125.stdout:7/138: symlink d12/d18/l24 0 2024-02-19T19:12:08.715 INFO:tasks.workunit.client.1.smithi125.stdout:5/251: dread db/d17/f20 [962560,77824] 0 2024-02-19T19:12:08.715 INFO:tasks.workunit.client.1.smithi125.stdout:5/252: mkdir db/d26/d51 0 2024-02-19T19:12:08.716 INFO:tasks.workunit.client.1.smithi125.stdout:4/140: dwrite d0/d7/f15 [761856,90112] 0 2024-02-19T19:12:08.716 INFO:tasks.workunit.client.1.smithi125.stdout:4/141: chown d0/d7/dc/c10 2633104 1 2024-02-19T19:12:08.716 INFO:tasks.workunit.client.1.smithi125.stdout:3/154: dwrite d0/d1/f23 [872448,69632] 0 2024-02-19T19:12:08.716 INFO:tasks.workunit.client.1.smithi125.stdout:3/155: chown d0/de/f10 61 1 2024-02-19T19:12:08.716 INFO:tasks.workunit.client.1.smithi125.stdout:7/139: dwrite f8 [16384,122880] 0 2024-02-19T19:12:08.785 INFO:tasks.workunit.client.1.smithi125.stdout:9/140: fsync f7 0 2024-02-19T19:12:08.786 INFO:tasks.workunit.client.1.smithi125.stdout:5/253: fdatasync db/d17/d42/f4e 0 2024-02-19T19:12:08.786 INFO:tasks.workunit.client.1.smithi125.stdout:5/254: read db/f34 [254279,82043] 0 2024-02-19T19:12:08.786 INFO:tasks.workunit.client.1.smithi125.stdout:5/255: unlink db/d26/d27/l2f 0 2024-02-19T19:12:08.786 INFO:tasks.workunit.client.1.smithi125.stdout:4/142: fsync d0/d7/dc/f29 0 2024-02-19T19:12:08.786 INFO:tasks.workunit.client.1.smithi125.stdout:1/146: fsync d1/d1a/f2a 0 2024-02-19T19:12:08.786 INFO:tasks.workunit.client.1.smithi125.stdout:4/143: chown d0/df/c20 0 1 2024-02-19T19:12:08.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:08 smithi096 ceph-mon[112483]: pgmap v149: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 576 B/s wr, 3 op/s; 8 B/s, 0 objects/s recovering 2024-02-19T19:12:08.789 INFO:tasks.workunit.client.1.smithi125.stdout:3/156: dwrite d0/d1/f2a [815104,28672] 0 2024-02-19T19:12:08.789 INFO:tasks.workunit.client.1.smithi125.stdout:3/157: dread d0/f24 [8192,118784] 0 2024-02-19T19:12:08.789 INFO:tasks.workunit.client.1.smithi125.stdout:3/158: write d0/f24 [144955,61011] 0 2024-02-19T19:12:08.789 INFO:tasks.workunit.client.1.smithi125.stdout:3/159: dread d0/d1/fc [208896,86016] 0 2024-02-19T19:12:08.790 INFO:tasks.workunit.client.1.smithi125.stdout:9/141: dwrite d8/f11 [212992,114688] 0 2024-02-19T19:12:08.790 INFO:tasks.workunit.client.1.smithi125.stdout:4/144: dwrite d0/df/f2a [417792,4096] 0 2024-02-19T19:12:08.790 INFO:tasks.workunit.client.1.smithi125.stdout:9/142: dwrite d8/f20 [1298432,12288] 0 2024-02-19T19:12:08.863 INFO:tasks.workunit.client.1.smithi125.stdout:1/147: fdatasync d1/dc/f1b 0 2024-02-19T19:12:08.866 INFO:tasks.workunit.client.1.smithi125.stdout:7/140: dread f5 [655360,102400] 0 2024-02-19T19:12:08.866 INFO:tasks.workunit.client.1.smithi125.stdout:1/148: write d1/f22 [183339,123585] 0 2024-02-19T19:12:08.892 INFO:tasks.workunit.client.1.smithi125.stdout:7/141: dwrite d12/f13 [1134592,65536] 0 2024-02-19T19:12:08.892 INFO:tasks.workunit.client.1.smithi125.stdout:9/143: mknod d8/d15/d22/c2f 0 2024-02-19T19:12:08.893 INFO:tasks.workunit.client.1.smithi125.stdout:7/142: read d12/f13 [861822,58866] 0 2024-02-19T19:12:08.893 INFO:tasks.workunit.client.1.smithi125.stdout:9/144: getdents d8 0 2024-02-19T19:12:08.893 INFO:tasks.workunit.client.1.smithi125.stdout:9/145: truncate f3 1414637 0 2024-02-19T19:12:08.893 INFO:tasks.workunit.client.1.smithi125.stdout:9/146: write d8/f9 [1420280,19872] 0 2024-02-19T19:12:08.893 INFO:tasks.workunit.client.1.smithi125.stdout:7/143: mkdir d12/d25 0 2024-02-19T19:12:08.893 INFO:tasks.workunit.client.1.smithi125.stdout:7/144: dread d12/d18/f1e [286720,4096] 0 2024-02-19T19:12:08.893 INFO:tasks.workunit.client.1.smithi125.stdout:7/145: stat d12 0 2024-02-19T19:12:08.893 INFO:tasks.workunit.client.1.smithi125.stdout:9/147: write d8/d15/d22/f24 [54533,74359] 0 2024-02-19T19:12:08.894 INFO:tasks.workunit.client.1.smithi125.stdout:9/148: readlink d8/d15/l21 0 2024-02-19T19:12:08.894 INFO:tasks.workunit.client.1.smithi125.stdout:1/149: symlink d1/d26/d23/l2b 0 2024-02-19T19:12:08.894 INFO:tasks.workunit.client.1.smithi125.stdout:1/150: chown d1/ce 878 1 2024-02-19T19:12:08.894 INFO:tasks.workunit.client.1.smithi125.stdout:1/151: dread f0 [237568,20480] 0 2024-02-19T19:12:08.894 INFO:tasks.workunit.client.1.smithi125.stdout:9/149: creat d8/d12/f30 x:0 0 0 2024-02-19T19:12:08.894 INFO:tasks.workunit.client.1.smithi125.stdout:9/150: read f2 [1707517,680] 0 2024-02-19T19:12:08.894 INFO:tasks.workunit.client.1.smithi125.stdout:7/146: write f5 [1251940,123207] 0 2024-02-19T19:12:08.894 INFO:tasks.workunit.client.1.smithi125.stdout:9/151: creat d8/f31 x:0 0 0 2024-02-19T19:12:08.894 INFO:tasks.workunit.client.1.smithi125.stdout:9/152: stat d8/d12/c2b 0 2024-02-19T19:12:08.895 INFO:tasks.workunit.client.1.smithi125.stdout:9/153: rename d8/d12 to d8/d15/d32 0 2024-02-19T19:12:08.895 INFO:tasks.workunit.client.1.smithi125.stdout:1/152: write d1/dc/fd [1565205,89921] 0 2024-02-19T19:12:08.895 INFO:tasks.workunit.client.1.smithi125.stdout:9/154: dread d8/f1a [598016,4096] 0 2024-02-19T19:12:08.895 INFO:tasks.workunit.client.1.smithi125.stdout:9/155: dread f6 [155648,65536] 0 2024-02-19T19:12:08.895 INFO:tasks.workunit.client.1.smithi125.stdout:9/156: chown d8/d15/d32 4 1 2024-02-19T19:12:08.895 INFO:tasks.workunit.client.1.smithi125.stdout:1/153: rmdir d1/d24 0 2024-02-19T19:12:08.895 INFO:tasks.workunit.client.1.smithi125.stdout:1/154: creat d1/dc/f2c x:0 0 0 2024-02-19T19:12:08.895 INFO:tasks.workunit.client.1.smithi125.stdout:9/157: symlink d8/d15/d32/l33 0 2024-02-19T19:12:08.895 INFO:tasks.workunit.client.1.smithi125.stdout:9/158: unlink d8/lf 0 2024-02-19T19:12:08.896 INFO:tasks.workunit.client.1.smithi125.stdout:1/155: write d1/f9 [2681090,18245] 0 2024-02-19T19:12:08.896 INFO:tasks.workunit.client.1.smithi125.stdout:9/159: dread f2 [1728512,114688] 0 2024-02-19T19:12:08.896 INFO:tasks.workunit.client.1.smithi125.stdout:9/160: chown d8/c13 1522245546 1 2024-02-19T19:12:08.896 INFO:tasks.workunit.client.1.smithi125.stdout:1/156: creat d1/d26/d23/f2d x:0 0 0 2024-02-19T19:12:08.896 INFO:tasks.workunit.client.1.smithi125.stdout:9/161: chown d8/d15/d32/f30 14476624 1 2024-02-19T19:12:08.896 INFO:tasks.workunit.client.1.smithi125.stdout:9/162: dread - d8/f31 zero size 2024-02-19T19:12:08.896 INFO:tasks.workunit.client.1.smithi125.stdout:1/157: getdents d1/d26 0 2024-02-19T19:12:08.896 INFO:tasks.workunit.client.1.smithi125.stdout:1/158: link d1/d26/d23/f2d d1/d1a/f2e 0 2024-02-19T19:12:08.897 INFO:tasks.workunit.client.1.smithi125.stdout:1/159: link d1/ce d1/c2f 0 2024-02-19T19:12:08.897 INFO:tasks.workunit.client.1.smithi125.stdout:1/160: write d1/dc/fd [2145948,101060] 0 2024-02-19T19:12:08.951 INFO:tasks.workunit.client.1.smithi125.stdout:3/160: fsync d0/d1/f23 0 2024-02-19T19:12:08.951 INFO:tasks.workunit.client.1.smithi125.stdout:3/161: getdents d0 0 2024-02-19T19:12:08.951 INFO:tasks.workunit.client.1.smithi125.stdout:1/161: dread f0 [614400,28672] 0 2024-02-19T19:12:08.958 INFO:tasks.workunit.client.1.smithi125.stdout:1/162: rename d1/f22 to d1/f30 0 2024-02-19T19:12:08.958 INFO:tasks.workunit.client.1.smithi125.stdout:7/147: dwrite f5 [20480,4096] 0 2024-02-19T19:12:08.958 INFO:tasks.workunit.client.1.smithi125.stdout:3/162: dread d0/de/f1c [57344,126976] 0 2024-02-19T19:12:08.958 INFO:tasks.workunit.client.1.smithi125.stdout:7/148: chown d12/c1c 1510 1 2024-02-19T19:12:08.959 INFO:tasks.workunit.client.1.smithi125.stdout:7/149: mkdir d12/d25/d26 0 2024-02-19T19:12:08.959 INFO:tasks.workunit.client.1.smithi125.stdout:9/163: dread d8/d15/d22/f24 [69632,61440] 0 2024-02-19T19:12:08.959 INFO:tasks.workunit.client.1.smithi125.stdout:9/164: symlink d8/d15/d22/l34 0 2024-02-19T19:12:08.959 INFO:tasks.workunit.client.1.smithi125.stdout:9/165: rename d8/f18 to d8/d15/f35 0 2024-02-19T19:12:08.959 INFO:tasks.workunit.client.1.smithi125.stdout:0/193: sync 2024-02-19T19:12:08.959 INFO:tasks.workunit.client.1.smithi125.stdout:9/166: getdents d8/d15/d22 0 2024-02-19T19:12:08.959 INFO:tasks.workunit.client.1.smithi125.stdout:9/167: mknod d8/d15/c36 0 2024-02-19T19:12:08.959 INFO:tasks.workunit.client.1.smithi125.stdout:0/194: read d5/d19/d27/d32/f3c [393494,6093] 0 2024-02-19T19:12:08.959 INFO:tasks.workunit.client.1.smithi125.stdout:9/168: getdents d8/d15/d22 0 2024-02-19T19:12:08.959 INFO:tasks.workunit.client.1.smithi125.stdout:0/195: chown d5/d19/d4a 3617920 1 2024-02-19T19:12:08.960 INFO:tasks.workunit.client.1.smithi125.stdout:9/169: mkdir d8/d37 0 2024-02-19T19:12:08.960 INFO:tasks.workunit.client.1.smithi125.stdout:9/170: chown d8/d15/d22/c2f 103746 1 2024-02-19T19:12:08.960 INFO:tasks.workunit.client.1.smithi125.stdout:9/171: readlink d8/l10 0 2024-02-19T19:12:08.960 INFO:tasks.workunit.client.1.smithi125.stdout:9/172: dread d8/f9 [1691648,16384] 0 2024-02-19T19:12:08.960 INFO:tasks.workunit.client.1.smithi125.stdout:9/173: truncate d8/d15/f1c 1035735 0 2024-02-19T19:12:08.960 INFO:tasks.workunit.client.1.smithi125.stdout:9/174: truncate d8/d15/d32/f2a 706988 0 2024-02-19T19:12:08.960 INFO:tasks.workunit.client.1.smithi125.stdout:9/175: mknod d8/d15/c38 0 2024-02-19T19:12:08.960 INFO:tasks.workunit.client.1.smithi125.stdout:9/176: symlink d8/d2e/l39 0 2024-02-19T19:12:08.961 INFO:tasks.workunit.client.1.smithi125.stdout:9/177: symlink d8/d15/l3a 0 2024-02-19T19:12:08.961 INFO:tasks.workunit.client.1.smithi125.stdout:9/178: write d8/d15/d32/f30 [114372,130863] 0 2024-02-19T19:12:08.961 INFO:tasks.workunit.client.1.smithi125.stdout:9/179: dread d8/f28 [864256,45056] 0 2024-02-19T19:12:08.961 INFO:tasks.workunit.client.1.smithi125.stdout:9/180: rename f7 to d8/d37/f3b 0 2024-02-19T19:12:08.961 INFO:tasks.workunit.client.1.smithi125.stdout:9/181: read d8/fe [1472578,89844] 0 2024-02-19T19:12:08.961 INFO:tasks.workunit.client.1.smithi125.stdout:9/182: mkdir d8/d15/d3c 0 2024-02-19T19:12:08.961 INFO:tasks.workunit.client.1.smithi125.stdout:9/183: rename d8/f20 to d8/d2e/f3d 0 2024-02-19T19:12:08.961 INFO:tasks.workunit.client.1.smithi125.stdout:9/184: dread f6 [1105920,73728] 0 2024-02-19T19:12:09.036 INFO:tasks.workunit.client.1.smithi125.stdout:1/163: dwrite f0 [1695744,65536] 0 2024-02-19T19:12:09.036 INFO:tasks.workunit.client.1.smithi125.stdout:1/164: dread f0 [1548288,81920] 0 2024-02-19T19:12:09.036 INFO:tasks.workunit.client.1.smithi125.stdout:1/165: chown d1/dc/c11 64570 1 2024-02-19T19:12:09.036 INFO:tasks.workunit.client.1.smithi125.stdout:1/166: stat d1/dc/f2c 0 2024-02-19T19:12:09.036 INFO:tasks.workunit.client.1.smithi125.stdout:1/167: chown d1/dc/c11 685013829 1 2024-02-19T19:12:09.037 INFO:tasks.workunit.client.1.smithi125.stdout:1/168: symlink d1/d26/d29/l31 0 2024-02-19T19:12:09.037 INFO:tasks.workunit.client.1.smithi125.stdout:1/169: rename d1/ce to d1/d26/d29/c32 0 2024-02-19T19:12:09.038 INFO:tasks.workunit.client.1.smithi125.stdout:0/196: dwrite d5/d9/f1d [1413120,53248] 0 2024-02-19T19:12:09.039 INFO:tasks.workunit.client.1.smithi125.stdout:0/197: creat d5/d33/d46/f4b x:0 0 0 2024-02-19T19:12:09.039 INFO:tasks.workunit.client.1.smithi125.stdout:0/198: dread d5/d9/fd [53248,20480] 0 2024-02-19T19:12:09.039 INFO:tasks.workunit.client.1.smithi125.stdout:0/199: mkdir d5/d1a/d4c 0 2024-02-19T19:12:09.039 INFO:tasks.workunit.client.1.smithi125.stdout:3/163: dwrite d0/ff [1855488,45056] 0 2024-02-19T19:12:09.039 INFO:tasks.workunit.client.1.smithi125.stdout:3/164: link d0/f15 d0/d1/f2d 0 2024-02-19T19:12:09.039 INFO:tasks.workunit.client.1.smithi125.stdout:3/165: rename d0/de/f10 to d0/de/f2e 0 2024-02-19T19:12:09.039 INFO:tasks.workunit.client.1.smithi125.stdout:9/185: dwrite d8/d15/f35 [90112,110592] 0 2024-02-19T19:12:09.039 INFO:tasks.workunit.client.1.smithi125.stdout:9/186: mknod d8/d37/c3e 0 2024-02-19T19:12:09.040 INFO:tasks.workunit.client.1.smithi125.stdout:9/187: stat d8/d15/c27 0 2024-02-19T19:12:09.040 INFO:tasks.workunit.client.1.smithi125.stdout:9/188: chown d8/d15/d32/c2b 10 1 2024-02-19T19:12:09.040 INFO:tasks.workunit.client.1.smithi125.stdout:9/189: truncate d8/f1a 432343 0 2024-02-19T19:12:09.040 INFO:tasks.workunit.client.1.smithi125.stdout:9/190: write d8/f1a [544212,111228] 0 2024-02-19T19:12:09.040 INFO:tasks.workunit.client.1.smithi125.stdout:9/191: unlink d8/cc 0 2024-02-19T19:12:09.053 INFO:tasks.workunit.client.1.smithi125.stdout:7/150: dread f5 [540672,94208] 0 2024-02-19T19:12:09.053 INFO:tasks.workunit.client.1.smithi125.stdout:7/151: mkdir d12/d27 0 2024-02-19T19:12:09.090 INFO:tasks.workunit.client.1.smithi125.stdout:7/152: dread f11 [237568,122880] 0 2024-02-19T19:12:09.090 INFO:tasks.workunit.client.1.smithi125.stdout:7/153: creat d12/d25/d26/f28 x:0 0 0 2024-02-19T19:12:09.090 INFO:tasks.workunit.client.1.smithi125.stdout:3/166: dread d0/d1/fc [1208320,114688] 0 2024-02-19T19:12:09.090 INFO:tasks.workunit.client.1.smithi125.stdout:7/154: write f8 [1297381,14805] 0 2024-02-19T19:12:09.090 INFO:tasks.workunit.client.1.smithi125.stdout:1/170: dread d1/dc/fd [2093056,81920] 0 2024-02-19T19:12:09.091 INFO:tasks.workunit.client.1.smithi125.stdout:1/171: mknod d1/d26/c33 0 2024-02-19T19:12:09.091 INFO:tasks.workunit.client.1.smithi125.stdout:1/172: getdents d1/d26/d23 0 2024-02-19T19:12:09.091 INFO:tasks.workunit.client.1.smithi125.stdout:2/145: sync 2024-02-19T19:12:09.092 INFO:tasks.workunit.client.1.smithi125.stdout:5/256: sync 2024-02-19T19:12:09.092 INFO:tasks.workunit.client.1.smithi125.stdout:4/145: sync 2024-02-19T19:12:09.092 INFO:tasks.workunit.client.1.smithi125.stdout:6/145: sync 2024-02-19T19:12:09.092 INFO:tasks.workunit.client.1.smithi125.stdout:8/107: sync 2024-02-19T19:12:09.092 INFO:tasks.workunit.client.1.smithi125.stdout:6/146: dread - d6/db/df/d16/f25 zero size 2024-02-19T19:12:09.102 INFO:tasks.workunit.client.1.smithi125.stdout:0/200: dread d5/d9/fd [262144,61440] 0 2024-02-19T19:12:09.133 INFO:tasks.workunit.client.1.smithi125.stdout:3/167: fsync d0/de/f28 0 2024-02-19T19:12:09.133 INFO:tasks.workunit.client.1.smithi125.stdout:2/146: fsync d1/d27/f8 0 2024-02-19T19:12:09.133 INFO:tasks.workunit.client.1.smithi125.stdout:5/257: fdatasync db/d26/d27/f37 0 2024-02-19T19:12:09.136 INFO:tasks.workunit.client.1.smithi125.stdout:0/201: rename d5/d1a/l39 to d5/d33/d46/l4d 0 2024-02-19T19:12:09.137 INFO:tasks.workunit.client.1.smithi125.stdout:3/168: rename d0/d1/f2a to d0/d1/f2f 0 2024-02-19T19:12:09.137 INFO:tasks.workunit.client.1.smithi125.stdout:3/169: stat d0/l1b 0 2024-02-19T19:12:09.137 INFO:tasks.workunit.client.1.smithi125.stdout:5/258: unlink db/d26/l29 0 2024-02-19T19:12:09.137 INFO:tasks.workunit.client.1.smithi125.stdout:0/202: dread d5/f8 [446464,81920] 0 2024-02-19T19:12:09.137 INFO:tasks.workunit.client.1.smithi125.stdout:3/170: getdents d0/d1/d1e 0 2024-02-19T19:12:09.137 INFO:tasks.workunit.client.1.smithi125.stdout:2/147: mknod d1/d27/c29 0 2024-02-19T19:12:09.137 INFO:tasks.workunit.client.1.smithi125.stdout:5/259: rmdir db/d26/d27 39 2024-02-19T19:12:09.137 INFO:tasks.workunit.client.1.smithi125.stdout:4/146: creat d0/f2e x:0 0 0 2024-02-19T19:12:09.138 INFO:tasks.workunit.client.1.smithi125.stdout:3/171: rmdir d0/d1 39 2024-02-19T19:12:09.138 INFO:tasks.workunit.client.1.smithi125.stdout:1/173: dwrite f0 [2015232,73728] 0 2024-02-19T19:12:09.138 INFO:tasks.workunit.client.1.smithi125.stdout:8/108: write db/f1c [871564,59393] 0 2024-02-19T19:12:09.138 INFO:tasks.workunit.client.1.smithi125.stdout:2/148: unlink d1/d27/c29 0 2024-02-19T19:12:09.138 INFO:tasks.workunit.client.1.smithi125.stdout:0/203: creat d5/d19/d2b/f4e x:0 0 0 2024-02-19T19:12:09.138 INFO:tasks.workunit.client.1.smithi125.stdout:1/174: getdents d1/dc 0 2024-02-19T19:12:09.138 INFO:tasks.workunit.client.1.smithi125.stdout:8/109: mknod db/c24 0 2024-02-19T19:12:09.138 INFO:tasks.workunit.client.1.smithi125.stdout:3/172: write d0/de/f2b [1026805,15304] 0 2024-02-19T19:12:09.138 INFO:tasks.workunit.client.1.smithi125.stdout:8/110: rmdir db 39 2024-02-19T19:12:09.139 INFO:tasks.workunit.client.1.smithi125.stdout:0/204: creat d5/d19/d4a/f4f x:0 0 0 2024-02-19T19:12:09.139 INFO:tasks.workunit.client.1.smithi125.stdout:7/155: dwrite f11 [626688,102400] 0 2024-02-19T19:12:09.139 INFO:tasks.workunit.client.1.smithi125.stdout:3/173: truncate d0/f19 896554 0 2024-02-19T19:12:09.139 INFO:tasks.workunit.client.1.smithi125.stdout:2/149: mkdir d1/d27/d1d/d25/d2a 0 2024-02-19T19:12:09.139 INFO:tasks.workunit.client.1.smithi125.stdout:1/175: write d1/dc/f17 [1517109,13632] 0 2024-02-19T19:12:09.139 INFO:tasks.workunit.client.1.smithi125.stdout:3/174: readlink d0/d1/l16 0 2024-02-19T19:12:09.139 INFO:tasks.workunit.client.1.smithi125.stdout:2/150: chown d1/ff 271 1 2024-02-19T19:12:09.139 INFO:tasks.workunit.client.1.smithi125.stdout:0/205: mknod d5/d33/d46/c50 0 2024-02-19T19:12:09.139 INFO:tasks.workunit.client.1.smithi125.stdout:3/175: truncate d0/d1/d1e/f2c 1958430 0 2024-02-19T19:12:09.140 INFO:tasks.workunit.client.1.smithi125.stdout:8/111: symlink db/d18/l25 0 2024-02-19T19:12:09.140 INFO:tasks.workunit.client.1.smithi125.stdout:3/176: dread d0/d1/f2d [86016,86016] 0 2024-02-19T19:12:09.140 INFO:tasks.workunit.client.1.smithi125.stdout:2/151: rename d1/f12 to d1/d27/d1d/f2b 0 2024-02-19T19:12:09.140 INFO:tasks.workunit.client.1.smithi125.stdout:1/176: symlink d1/d26/d23/l34 0 2024-02-19T19:12:09.140 INFO:tasks.workunit.client.1.smithi125.stdout:2/152: truncate d1/d27/d1d/f24 2262402 0 2024-02-19T19:12:09.140 INFO:tasks.workunit.client.1.smithi125.stdout:0/206: symlink d5/d19/d2b/l51 0 2024-02-19T19:12:09.140 INFO:tasks.workunit.client.1.smithi125.stdout:6/147: unlink d6/db/df/d16/f25 0 2024-02-19T19:12:09.140 INFO:tasks.workunit.client.1.smithi125.stdout:2/153: dread d1/d27/f8 [45056,53248] 0 2024-02-19T19:12:09.141 INFO:tasks.workunit.client.1.smithi125.stdout:5/260: write db/d26/d27/d25/f32 [456743,116490] 0 2024-02-19T19:12:09.141 INFO:tasks.workunit.client.1.smithi125.stdout:1/177: read d1/dc/f1f [744080,61327] 0 2024-02-19T19:12:09.141 INFO:tasks.workunit.client.1.smithi125.stdout:0/207: write d5/d9/fd [887095,20107] 0 2024-02-19T19:12:09.141 INFO:tasks.workunit.client.1.smithi125.stdout:6/148: creat d6/db/df/f27 x:0 0 0 2024-02-19T19:12:09.141 INFO:tasks.workunit.client.1.smithi125.stdout:5/261: write db/d17/f20 [369157,12123] 0 2024-02-19T19:12:09.141 INFO:tasks.workunit.client.1.smithi125.stdout:0/208: dread - d5/d19/f44 zero size 2024-02-19T19:12:09.141 INFO:tasks.workunit.client.1.smithi125.stdout:1/178: creat d1/d26/d29/f35 x:0 0 0 2024-02-19T19:12:09.142 INFO:tasks.workunit.client.1.smithi125.stdout:1/179: chown d1/dc/f19 4 1 2024-02-19T19:12:09.142 INFO:tasks.workunit.client.1.smithi125.stdout:1/180: chown d1/dc/f19 352878590 1 2024-02-19T19:12:09.142 INFO:tasks.workunit.client.1.smithi125.stdout:1/181: chown d1/dc/f1f 418 1 2024-02-19T19:12:09.142 INFO:tasks.workunit.client.1.smithi125.stdout:1/182: chown d1/dc/c18 92775 1 2024-02-19T19:12:09.142 INFO:tasks.workunit.client.1.smithi125.stdout:1/183: unlink d1/l20 0 2024-02-19T19:12:09.142 INFO:tasks.workunit.client.1.smithi125.stdout:0/209: write d5/d9/f1d [609754,105372] 0 2024-02-19T19:12:09.142 INFO:tasks.workunit.client.1.smithi125.stdout:1/184: mkdir d1/dc/d36 0 2024-02-19T19:12:09.142 INFO:tasks.workunit.client.1.smithi125.stdout:0/210: creat d5/d15/f52 x:0 0 0 2024-02-19T19:12:09.143 INFO:tasks.workunit.client.1.smithi125.stdout:1/185: mknod d1/d26/d29/c37 0 2024-02-19T19:12:09.143 INFO:tasks.workunit.client.1.smithi125.stdout:1/186: write d1/dc/f1b [1168131,757] 0 2024-02-19T19:12:09.143 INFO:tasks.workunit.client.1.smithi125.stdout:1/187: chown d1/l8 113 1 2024-02-19T19:12:09.143 INFO:tasks.workunit.client.1.smithi125.stdout:1/188: rename d1/d26/l27 to d1/d26/l38 0 2024-02-19T19:12:09.143 INFO:tasks.workunit.client.1.smithi125.stdout:0/211: symlink d5/d19/d4a/l53 0 2024-02-19T19:12:09.143 INFO:tasks.workunit.client.1.smithi125.stdout:0/212: stat d5/d33/d46 0 2024-02-19T19:12:09.143 INFO:tasks.workunit.client.1.smithi125.stdout:1/189: mkdir d1/dc/d36/d39 0 2024-02-19T19:12:09.143 INFO:tasks.workunit.client.1.smithi125.stdout:1/190: creat d1/dc/d36/d39/f3a x:0 0 0 2024-02-19T19:12:09.143 INFO:tasks.workunit.client.1.smithi125.stdout:1/191: creat d1/d26/f3b x:0 0 0 2024-02-19T19:12:09.144 INFO:tasks.workunit.client.1.smithi125.stdout:0/213: symlink d5/d33/d42/l54 0 2024-02-19T19:12:09.144 INFO:tasks.workunit.client.1.smithi125.stdout:1/192: mkdir d1/d26/d3c 0 2024-02-19T19:12:09.144 INFO:tasks.workunit.client.1.smithi125.stdout:1/193: mkdir d1/d1a/d3d 0 2024-02-19T19:12:09.144 INFO:tasks.workunit.client.1.smithi125.stdout:1/194: symlink d1/d26/d29/l3e 0 2024-02-19T19:12:09.144 INFO:tasks.workunit.client.1.smithi125.stdout:0/214: write d5/d19/d2b/f4e [343929,47739] 0 2024-02-19T19:12:09.144 INFO:tasks.workunit.client.1.smithi125.stdout:0/215: creat d5/d1a/f55 x:0 0 0 2024-02-19T19:12:09.144 INFO:tasks.workunit.client.1.smithi125.stdout:0/216: truncate d5/d15/f52 167191 0 2024-02-19T19:12:09.145 INFO:tasks.workunit.client.1.smithi125.stdout:0/217: dread d5/d1a/f20 [1175552,106496] 0 2024-02-19T19:12:09.164 INFO:tasks.workunit.client.1.smithi125.stdout:4/147: dwrite d0/d7/f26 [1228800,106496] 0 2024-02-19T19:12:09.164 INFO:tasks.workunit.client.1.smithi125.stdout:4/148: creat d0/d7/f2f x:0 0 0 2024-02-19T19:12:09.164 INFO:tasks.workunit.client.1.smithi125.stdout:4/149: dread - d0/d7/dc/f29 zero size 2024-02-19T19:12:09.165 INFO:tasks.workunit.client.1.smithi125.stdout:4/150: mkdir d0/d7/d30 0 2024-02-19T19:12:09.169 INFO:tasks.workunit.client.1.smithi125.stdout:3/177: dwrite d0/d1/d1e/f1f [729088,90112] 0 2024-02-19T19:12:09.169 INFO:tasks.workunit.client.1.smithi125.stdout:3/178: readlink d0/d1/l29 0 2024-02-19T19:12:09.169 INFO:tasks.workunit.client.1.smithi125.stdout:3/179: getdents d0/d1 0 2024-02-19T19:12:09.169 INFO:tasks.workunit.client.1.smithi125.stdout:5/262: dwrite db/d26/d27/f37 [503808,49152] 0 2024-02-19T19:12:09.169 INFO:tasks.workunit.client.1.smithi125.stdout:3/180: rename d0/d1/l9 to d0/d1/d1e/l30 0 2024-02-19T19:12:09.169 INFO:tasks.workunit.client.1.smithi125.stdout:3/181: chown d0/d1/f17 116 1 2024-02-19T19:12:09.170 INFO:tasks.workunit.client.1.smithi125.stdout:3/182: creat d0/d1/f31 x:0 0 0 2024-02-19T19:12:09.170 INFO:tasks.workunit.client.1.smithi125.stdout:3/183: creat d0/f32 x:0 0 0 2024-02-19T19:12:09.170 INFO:tasks.workunit.client.1.smithi125.stdout:3/184: rename d0/d1/f2f to d0/f33 0 2024-02-19T19:12:09.170 INFO:tasks.workunit.client.1.smithi125.stdout:3/185: rename d0/f15 to d0/d1/d1e/f34 0 2024-02-19T19:12:09.170 INFO:tasks.workunit.client.1.smithi125.stdout:3/186: rename d0/d1/fc to d0/d1/d1e/f35 0 2024-02-19T19:12:09.170 INFO:tasks.workunit.client.1.smithi125.stdout:5/263: truncate db/d17/f45 622841 0 2024-02-19T19:12:09.170 INFO:tasks.workunit.client.1.smithi125.stdout:3/187: chown d0/de/f28 69506 1 2024-02-19T19:12:09.170 INFO:tasks.workunit.client.1.smithi125.stdout:3/188: creat d0/d1/d1e/f36 x:0 0 0 2024-02-19T19:12:09.170 INFO:tasks.workunit.client.1.smithi125.stdout:1/195: dwrite d1/dc/f17 [483328,86016] 0 2024-02-19T19:12:09.171 INFO:tasks.workunit.client.1.smithi125.stdout:5/264: rename db/d17/d42 to db/d47/d52 0 2024-02-19T19:12:09.171 INFO:tasks.workunit.client.1.smithi125.stdout:1/196: truncate d1/dc/d36/d39/f3a 1023400 0 2024-02-19T19:12:09.171 INFO:tasks.workunit.client.1.smithi125.stdout:3/189: symlink d0/d1/l37 0 2024-02-19T19:12:09.171 INFO:tasks.workunit.client.1.smithi125.stdout:3/190: dread d0/de/f2b [561152,8192] 0 2024-02-19T19:12:09.171 INFO:tasks.workunit.client.1.smithi125.stdout:3/191: stat d0/de/l25 0 2024-02-19T19:12:09.171 INFO:tasks.workunit.client.1.smithi125.stdout:3/192: rmdir d0 39 2024-02-19T19:12:09.171 INFO:tasks.workunit.client.1.smithi125.stdout:3/193: read - d0/d1/f31 zero size 2024-02-19T19:12:09.171 INFO:tasks.workunit.client.1.smithi125.stdout:5/265: mkdir db/d26/d27/d33/d53 0 2024-02-19T19:12:09.172 INFO:tasks.workunit.client.1.smithi125.stdout:5/266: write db/d26/d27/f48 [1025319,88107] 0 2024-02-19T19:12:09.172 INFO:tasks.workunit.client.1.smithi125.stdout:5/267: write f6 [771147,91029] 0 2024-02-19T19:12:09.172 INFO:tasks.workunit.client.1.smithi125.stdout:5/268: rename db/d26/d27/d33/c44 to db/d47/c54 0 2024-02-19T19:12:09.172 INFO:tasks.workunit.client.1.smithi125.stdout:5/269: unlink db/d26/d27/f23 0 2024-02-19T19:12:09.172 INFO:tasks.workunit.client.1.smithi125.stdout:6/149: dwrite d6/db/df/f14 [1331200,110592] 0 2024-02-19T19:12:09.172 INFO:tasks.workunit.client.1.smithi125.stdout:6/150: readlink l1 0 2024-02-19T19:12:09.172 INFO:tasks.workunit.client.1.smithi125.stdout:5/270: dread db/f34 [184320,126976] 0 2024-02-19T19:12:09.172 INFO:tasks.workunit.client.1.smithi125.stdout:2/154: write d1/d27/d1d/f2b [526465,42094] 0 2024-02-19T19:12:09.173 INFO:tasks.workunit.client.1.smithi125.stdout:5/271: link db/d17/f41 db/d17/f55 0 2024-02-19T19:12:09.173 INFO:tasks.workunit.client.1.smithi125.stdout:2/155: mkdir d1/d27/d1d/d2c 0 2024-02-19T19:12:09.173 INFO:tasks.workunit.client.1.smithi125.stdout:4/151: dwrite d0/d7/dc/f24 [253952,20480] 0 2024-02-19T19:12:09.173 INFO:tasks.workunit.client.1.smithi125.stdout:2/156: creat d1/d27/d1d/d25/f2d x:0 0 0 2024-02-19T19:12:09.173 INFO:tasks.workunit.client.1.smithi125.stdout:4/152: rename d0/d7/ce to d0/d7/d30/c31 0 2024-02-19T19:12:09.173 INFO:tasks.workunit.client.1.smithi125.stdout:2/157: mkdir d1/d27/d1d/d2c/d2e 0 2024-02-19T19:12:09.173 INFO:tasks.workunit.client.1.smithi125.stdout:2/158: dread d1/d27/f8 [122880,40960] 0 2024-02-19T19:12:09.173 INFO:tasks.workunit.client.1.smithi125.stdout:4/153: mkdir d0/d32 0 2024-02-19T19:12:09.173 INFO:tasks.workunit.client.1.smithi125.stdout:4/154: chown d0/df/f23 1328 1 2024-02-19T19:12:09.174 INFO:tasks.workunit.client.1.smithi125.stdout:4/155: readlink d0/d7/l25 0 2024-02-19T19:12:09.174 INFO:tasks.workunit.client.1.smithi125.stdout:2/159: mkdir d1/d27/d1d/d2c/d2e/d2f 0 2024-02-19T19:12:09.174 INFO:tasks.workunit.client.1.smithi125.stdout:4/156: creat d0/df/f33 x:0 0 0 2024-02-19T19:12:09.174 INFO:tasks.workunit.client.1.smithi125.stdout:4/157: dread - d0/df/f33 zero size 2024-02-19T19:12:09.174 INFO:tasks.workunit.client.1.smithi125.stdout:4/158: chown d0 6345606 1 2024-02-19T19:12:09.174 INFO:tasks.workunit.client.1.smithi125.stdout:2/160: write d1/d27/f8 [745194,19931] 0 2024-02-19T19:12:09.174 INFO:tasks.workunit.client.1.smithi125.stdout:4/159: write d0/f2e [171997,85447] 0 2024-02-19T19:12:09.174 INFO:tasks.workunit.client.1.smithi125.stdout:2/161: write d1/ff [324880,86711] 0 2024-02-19T19:12:09.174 INFO:tasks.workunit.client.1.smithi125.stdout:4/160: read d0/df/f1c [282371,8098] 0 2024-02-19T19:12:09.175 INFO:tasks.workunit.client.1.smithi125.stdout:4/161: rmdir d0 39 2024-02-19T19:12:09.175 INFO:tasks.workunit.client.1.smithi125.stdout:4/162: stat d0/df/c20 0 2024-02-19T19:12:09.175 INFO:tasks.workunit.client.1.smithi125.stdout:4/163: symlink d0/l34 0 2024-02-19T19:12:09.175 INFO:tasks.workunit.client.1.smithi125.stdout:4/164: mknod d0/d7/dc/c35 0 2024-02-19T19:12:09.230 INFO:tasks.workunit.client.1.smithi125.stdout:8/112: fsync db/f16 0 2024-02-19T19:12:09.230 INFO:tasks.workunit.client.1.smithi125.stdout:9/192: fsync d8/f1a 0 2024-02-19T19:12:09.230 INFO:tasks.workunit.client.1.smithi125.stdout:9/193: chown d8/l10 145423 1 2024-02-19T19:12:09.231 INFO:tasks.workunit.client.1.smithi125.stdout:9/194: write d8/d2e/f3d [1458721,69327] 0 2024-02-19T19:12:09.247 INFO:tasks.workunit.client.1.smithi125.stdout:5/272: fdatasync db/d26/d27/d25/d40/f4b 0 2024-02-19T19:12:09.250 INFO:tasks.workunit.client.1.smithi125.stdout:6/151: dwrite d6/f22 [131072,86016] 0 2024-02-19T19:12:09.250 INFO:tasks.workunit.client.1.smithi125.stdout:8/113: dwrite db/d18/f21 [786432,4096] 0 2024-02-19T19:12:09.251 INFO:tasks.workunit.client.1.smithi125.stdout:1/197: dwrite d1/d1a/f2e [0,98304] 0 2024-02-19T19:12:09.251 INFO:tasks.workunit.client.1.smithi125.stdout:3/194: dwrite d0/de/f14 [1372160,20480] 0 2024-02-19T19:12:09.251 INFO:tasks.workunit.client.1.smithi125.stdout:1/198: truncate d1/dc/d36/d39/f3a 1308635 0 2024-02-19T19:12:09.251 INFO:tasks.workunit.client.1.smithi125.stdout:3/195: chown d0/de/l22 4048790 1 2024-02-19T19:12:09.251 INFO:tasks.workunit.client.1.smithi125.stdout:8/114: dread db/fe [913408,98304] 0 2024-02-19T19:12:09.251 INFO:tasks.workunit.client.1.smithi125.stdout:5/273: unlink db/f21 0 2024-02-19T19:12:09.251 INFO:tasks.workunit.client.1.smithi125.stdout:1/199: truncate d1/dc/f19 1239171 0 2024-02-19T19:12:09.251 INFO:tasks.workunit.client.1.smithi125.stdout:5/274: dread db/d26/d27/d25/f32 [663552,49152] 0 2024-02-19T19:12:09.252 INFO:tasks.workunit.client.1.smithi125.stdout:5/275: readlink db/l16 0 2024-02-19T19:12:09.252 INFO:tasks.workunit.client.1.smithi125.stdout:8/115: read db/f1c [156494,48489] 0 2024-02-19T19:12:09.252 INFO:tasks.workunit.client.1.smithi125.stdout:5/276: creat db/d26/d27/d4f/f56 x:0 0 0 2024-02-19T19:12:09.252 INFO:tasks.workunit.client.1.smithi125.stdout:8/116: creat db/f26 x:0 0 0 2024-02-19T19:12:09.290 INFO:tasks.workunit.client.1.smithi125.stdout:6/152: dwrite d6/db/df/f1f [1228800,32768] 0 2024-02-19T19:12:09.292 INFO:tasks.workunit.client.1.smithi125.stdout:5/277: dwrite db/d26/d27/d33/f3e [659456,53248] 0 2024-02-19T19:12:09.292 INFO:tasks.workunit.client.1.smithi125.stdout:5/278: getdents db/d26/d27/d33 0 2024-02-19T19:12:09.292 INFO:tasks.workunit.client.1.smithi125.stdout:5/279: creat db/d17/f57 x:0 0 0 2024-02-19T19:12:09.295 INFO:tasks.workunit.client.1.smithi125.stdout:5/280: write db/d26/d27/f48 [1223083,49429] 0 2024-02-19T19:12:09.295 INFO:tasks.workunit.client.1.smithi125.stdout:5/281: getdents db/d26/d27/d25/d40 0 2024-02-19T19:12:09.296 INFO:tasks.workunit.client.1.smithi125.stdout:8/117: dwrite db/fe [2195456,81920] 0 2024-02-19T19:12:09.296 INFO:tasks.workunit.client.1.smithi125.stdout:8/118: dread f4 [2691072,98304] 0 2024-02-19T19:12:09.296 INFO:tasks.workunit.client.1.smithi125.stdout:6/153: dwrite d6/db/df/f1f [1576960,126976] 0 2024-02-19T19:12:09.297 INFO:tasks.workunit.client.1.smithi125.stdout:6/154: chown d6/f22 0 1 2024-02-19T19:12:09.343 INFO:tasks.workunit.client.1.smithi125.stdout:7/156: fsync f11 0 2024-02-19T19:12:09.347 INFO:tasks.workunit.client.1.smithi125.stdout:8/119: dread db/f16 [286720,49152] 0 2024-02-19T19:12:09.347 INFO:tasks.workunit.client.1.smithi125.stdout:5/282: dwrite db/d26/d27/d25/d40/f4b [348160,12288] 0 2024-02-19T19:12:09.347 INFO:tasks.workunit.client.1.smithi125.stdout:8/120: chown db/c15 894224136 1 2024-02-19T19:12:09.348 INFO:tasks.workunit.client.1.smithi125.stdout:5/283: unlink db/d26/d27/f3b 0 2024-02-19T19:12:09.348 INFO:tasks.workunit.client.1.smithi125.stdout:5/284: rename db/d26/d27 to db/d17/d58 0 2024-02-19T19:12:09.348 INFO:tasks.workunit.client.1.smithi125.stdout:8/121: write db/d18/f21 [1674944,101043] 0 2024-02-19T19:12:09.348 INFO:tasks.workunit.client.1.smithi125.stdout:8/122: stat db/d18/f21 0 2024-02-19T19:12:09.348 INFO:tasks.workunit.client.1.smithi125.stdout:8/123: creat db/d18/f27 x:0 0 0 2024-02-19T19:12:09.348 INFO:tasks.workunit.client.1.smithi125.stdout:8/124: write db/f16 [733006,40960] 0 2024-02-19T19:12:09.348 INFO:tasks.workunit.client.1.smithi125.stdout:8/125: write db/f16 [85109,37184] 0 2024-02-19T19:12:09.349 INFO:tasks.workunit.client.1.smithi125.stdout:8/126: write db/d18/f21 [2275131,84630] 0 2024-02-19T19:12:09.349 INFO:tasks.workunit.client.1.smithi125.stdout:8/127: symlink db/l28 0 2024-02-19T19:12:09.349 INFO:tasks.workunit.client.1.smithi125.stdout:8/128: symlink db/l29 0 2024-02-19T19:12:09.349 INFO:tasks.workunit.client.1.smithi125.stdout:8/129: write f4 [1159550,37017] 0 2024-02-19T19:12:09.349 INFO:tasks.workunit.client.1.smithi125.stdout:8/130: rename db/f1c to db/d18/f2a 0 2024-02-19T19:12:09.349 INFO:tasks.workunit.client.1.smithi125.stdout:8/131: symlink db/l2b 0 2024-02-19T19:12:09.349 INFO:tasks.workunit.client.1.smithi125.stdout:8/132: write f4 [2435455,55704] 0 2024-02-19T19:12:09.349 INFO:tasks.workunit.client.1.smithi125.stdout:8/133: rmdir db/d18 39 2024-02-19T19:12:09.350 INFO:tasks.workunit.client.1.smithi125.stdout:8/134: rename db/d18/l20 to db/l2c 0 2024-02-19T19:12:09.350 INFO:tasks.workunit.client.1.smithi125.stdout:8/135: link db/d18/f1b db/d18/f2d 0 2024-02-19T19:12:09.350 INFO:tasks.workunit.client.1.smithi125.stdout:8/136: symlink db/l2e 0 2024-02-19T19:12:09.350 INFO:tasks.workunit.client.1.smithi125.stdout:8/137: mkdir db/d18/d2f 0 2024-02-19T19:12:09.350 INFO:tasks.workunit.client.1.smithi125.stdout:8/138: truncate db/fe 2543272 0 2024-02-19T19:12:09.350 INFO:tasks.workunit.client.1.smithi125.stdout:7/157: dread f11 [331776,65536] 0 2024-02-19T19:12:09.350 INFO:tasks.workunit.client.1.smithi125.stdout:7/158: read fb [591237,81145] 0 2024-02-19T19:12:09.351 INFO:tasks.workunit.client.1.smithi125.stdout:7/159: chown d12/d18 39 1 2024-02-19T19:12:09.351 INFO:tasks.workunit.client.1.smithi125.stdout:7/160: link d12/c1c d12/d27/c29 0 2024-02-19T19:12:09.351 INFO:tasks.workunit.client.1.smithi125.stdout:7/161: readlink d12/d18/l1d 0 2024-02-19T19:12:09.351 INFO:tasks.workunit.client.1.smithi125.stdout:5/285: dwrite db/d17/d58/d25/f39 [745472,86016] 0 2024-02-19T19:12:09.351 INFO:tasks.workunit.client.1.smithi125.stdout:5/286: mknod db/d17/d58/d25/d40/c59 0 2024-02-19T19:12:09.351 INFO:tasks.workunit.client.1.smithi125.stdout:5/287: write db/d17/f20 [649259,47760] 0 2024-02-19T19:12:09.352 INFO:tasks.workunit.client.1.smithi125.stdout:5/288: dwrite db/d17/d58/f3a [188416,40960] 0 2024-02-19T19:12:09.352 INFO:tasks.workunit.client.1.smithi125.stdout:5/289: write db/d17/f43 [1197022,106696] 0 2024-02-19T19:12:09.353 INFO:tasks.workunit.client.1.smithi125.stdout:5/290: chown db/d17/d58/d33 1154681 1 2024-02-19T19:12:09.353 INFO:tasks.workunit.client.1.smithi125.stdout:5/291: rmdir db/d47 39 2024-02-19T19:12:09.353 INFO:tasks.workunit.client.1.smithi125.stdout:5/292: link db/d17/f45 db/d47/d52/f5a 0 2024-02-19T19:12:09.353 INFO:tasks.workunit.client.1.smithi125.stdout:5/293: link db/d17/d58/f1c db/d17/d58/d25/d40/f5b 0 2024-02-19T19:12:09.356 INFO:tasks.workunit.client.1.smithi125.stdout:6/155: dread d6/db/df/d16/f20 [434176,28672] 0 2024-02-19T19:12:09.356 INFO:tasks.workunit.client.1.smithi125.stdout:6/156: readlink d6/l18 0 2024-02-19T19:12:09.356 INFO:tasks.workunit.client.1.smithi125.stdout:6/157: truncate d6/db/df/f21 731384 0 2024-02-19T19:12:09.356 INFO:tasks.workunit.client.1.smithi125.stdout:6/158: link d6/db/c23 d6/db/df/c28 0 2024-02-19T19:12:09.357 INFO:tasks.workunit.client.1.smithi125.stdout:6/159: mkdir d6/db/df/d1b/d29 0 2024-02-19T19:12:09.357 INFO:tasks.workunit.client.1.smithi125.stdout:6/160: getdents d6/db 0 2024-02-19T19:12:09.357 INFO:tasks.workunit.client.1.smithi125.stdout:6/161: creat d6/db/df/d1b/f2a x:0 0 0 2024-02-19T19:12:09.357 INFO:tasks.workunit.client.1.smithi125.stdout:6/162: rename d6/db/df/f1f to d6/db/df/d16/f2b 0 2024-02-19T19:12:09.357 INFO:tasks.workunit.client.1.smithi125.stdout:6/163: dread d6/db/f17 [319488,126976] 0 2024-02-19T19:12:09.357 INFO:tasks.workunit.client.1.smithi125.stdout:6/164: getdents d6/db/df 0 2024-02-19T19:12:09.421 INFO:tasks.workunit.client.1.smithi125.stdout:5/294: dwrite db/d17/d58/ff [282624,8192] 0 2024-02-19T19:12:09.421 INFO:tasks.workunit.client.1.smithi125.stdout:5/295: dread f6 [262144,53248] 0 2024-02-19T19:12:09.421 INFO:tasks.workunit.client.1.smithi125.stdout:5/296: chown db/d17/d58/d25/f39 2 1 2024-02-19T19:12:09.421 INFO:tasks.workunit.client.1.smithi125.stdout:5/297: symlink db/d26/d51/l5c 0 2024-02-19T19:12:09.421 INFO:tasks.workunit.client.1.smithi125.stdout:5/298: mkdir db/d47/d52/d5d 0 2024-02-19T19:12:09.421 INFO:tasks.workunit.client.1.smithi125.stdout:5/299: write db/d17/d58/d25/d40/f4b [952249,20126] 0 2024-02-19T19:12:09.421 INFO:tasks.workunit.client.1.smithi125.stdout:5/300: readlink db/l38 0 2024-02-19T19:12:09.422 INFO:tasks.workunit.client.1.smithi125.stdout:5/301: chown db/d17/d58/l2a 680848939 1 2024-02-19T19:12:09.491 INFO:tasks.workunit.client.1.smithi125.stdout:8/139: fsync db/f16 0 2024-02-19T19:12:09.491 INFO:tasks.workunit.client.1.smithi125.stdout:5/302: fdatasync db/f30 0 2024-02-19T19:12:09.491 INFO:tasks.workunit.client.1.smithi125.stdout:8/140: dread - db/f26 zero size 2024-02-19T19:12:09.491 INFO:tasks.workunit.client.1.smithi125.stdout:8/141: write db/f10 [1504753,21594] 0 2024-02-19T19:12:09.492 INFO:tasks.workunit.client.1.smithi125.stdout:6/165: fdatasync d6/f22 0 2024-02-19T19:12:09.492 INFO:tasks.workunit.client.1.smithi125.stdout:5/303: mknod db/d47/d52/c5e 0 2024-02-19T19:12:09.493 INFO:tasks.workunit.client.1.smithi125.stdout:6/166: write d6/db/df/d1b/f24 [453691,8896] 0 2024-02-19T19:12:09.493 INFO:tasks.workunit.client.1.smithi125.stdout:8/142: mkdir db/d18/d30 0 2024-02-19T19:12:09.493 INFO:tasks.workunit.client.1.smithi125.stdout:8/143: readlink db/ld 0 2024-02-19T19:12:09.493 INFO:tasks.workunit.client.1.smithi125.stdout:5/304: creat db/d47/f5f x:0 0 0 2024-02-19T19:12:09.493 INFO:tasks.workunit.client.1.smithi125.stdout:5/305: getdents db/d17/d58 0 2024-02-19T19:12:09.493 INFO:tasks.workunit.client.1.smithi125.stdout:5/306: chown db/d26/d51/l5c 16346 1 2024-02-19T19:12:09.493 INFO:tasks.workunit.client.1.smithi125.stdout:5/307: read db/d17/d58/f37 [166749,94933] 0 2024-02-19T19:12:09.501 INFO:tasks.workunit.client.1.smithi125.stdout:6/167: dwrite d6/db/df/f27 [1024000,24576] 0 2024-02-19T19:12:09.502 INFO:tasks.workunit.client.1.smithi125.stdout:6/168: dread d6/db/df/d1b/f19 [1310720,4096] 0 2024-02-19T19:12:09.502 INFO:tasks.workunit.client.1.smithi125.stdout:6/169: symlink d6/db/df/d1b/d29/l2c 0 2024-02-19T19:12:09.503 INFO:tasks.workunit.client.1.smithi125.stdout:8/144: dwrite f4 [700416,114688] 0 2024-02-19T19:12:09.503 INFO:tasks.workunit.client.1.smithi125.stdout:8/145: write db/f10 [478940,117143] 0 2024-02-19T19:12:09.503 INFO:tasks.workunit.client.1.smithi125.stdout:6/170: dwrite d6/db/f11 [57344,40960] 0 2024-02-19T19:12:09.503 INFO:tasks.workunit.client.1.smithi125.stdout:6/171: link d6/f1e d6/db/df/d1b/d29/f2d 0 2024-02-19T19:12:09.503 INFO:tasks.workunit.client.1.smithi125.stdout:6/172: unlink d6/f22 0 2024-02-19T19:12:09.504 INFO:tasks.workunit.client.1.smithi125.stdout:6/173: rmdir d6/db/df/d1b/d29 39 2024-02-19T19:12:09.504 INFO:tasks.workunit.client.1.smithi125.stdout:8/146: symlink db/d18/l31 0 2024-02-19T19:12:09.504 INFO:tasks.workunit.client.1.smithi125.stdout:6/174: rmdir d6/db/df/d1b/d29 39 2024-02-19T19:12:09.504 INFO:tasks.workunit.client.1.smithi125.stdout:6/175: creat d6/db/df/d1b/f2e x:0 0 0 2024-02-19T19:12:09.504 INFO:tasks.workunit.client.1.smithi125.stdout:8/147: creat db/d18/f32 x:0 0 0 2024-02-19T19:12:09.504 INFO:tasks.workunit.client.1.smithi125.stdout:8/148: link db/lf db/d18/l33 0 2024-02-19T19:12:09.504 INFO:tasks.workunit.client.1.smithi125.stdout:8/149: read db/d18/f21 [940919,98156] 0 2024-02-19T19:12:09.529 INFO:tasks.workunit.client.1.smithi125.stdout:5/308: fdatasync db/d17/d58/d25/f3c 0 2024-02-19T19:12:09.530 INFO:tasks.workunit.client.1.smithi125.stdout:5/309: chown db/d17/f20 16675536 1 2024-02-19T19:12:09.532 INFO:tasks.workunit.client.1.smithi125.stdout:5/310: symlink db/d17/d58/d25/l60 0 2024-02-19T19:12:09.532 INFO:tasks.workunit.client.1.smithi125.stdout:5/311: rmdir db/d17/d58/d33 39 2024-02-19T19:12:09.532 INFO:tasks.workunit.client.1.smithi125.stdout:5/312: rename db/d26/l4d to db/d26/l61 0 2024-02-19T19:12:09.532 INFO:tasks.workunit.client.1.smithi125.stdout:5/313: chown db/d17/f55 59 1 2024-02-19T19:12:09.532 INFO:tasks.workunit.client.1.smithi125.stdout:5/314: symlink db/d47/l62 0 2024-02-19T19:12:09.532 INFO:tasks.workunit.client.1.smithi125.stdout:5/315: stat db/d17 0 2024-02-19T19:12:09.532 INFO:tasks.workunit.client.1.smithi125.stdout:5/316: chown db/d26/d51/l5c 2725 1 2024-02-19T19:12:09.537 INFO:tasks.workunit.client.1.smithi125.stdout:5/317: creat db/d17/d58/d4f/f63 x:0 0 0 2024-02-19T19:12:09.537 INFO:tasks.workunit.client.1.smithi125.stdout:5/318: rmdir db/d17/d58/d25/d40 39 2024-02-19T19:12:09.537 INFO:tasks.workunit.client.1.smithi125.stdout:5/319: chown db/d17/d58/d4f/f63 84 1 2024-02-19T19:12:09.537 INFO:tasks.workunit.client.1.smithi125.stdout:5/320: write db/d17/f55 [1265347,49265] 0 2024-02-19T19:12:09.537 INFO:tasks.workunit.client.1.smithi125.stdout:5/321: write db/d47/d52/f4e [1057608,115801] 0 2024-02-19T19:12:09.537 INFO:tasks.workunit.client.1.smithi125.stdout:5/322: mkdir db/d17/d58/d33/d64 0 2024-02-19T19:12:09.538 INFO:tasks.workunit.client.1.smithi125.stdout:5/323: truncate db/d17/d58/f48 1482833 0 2024-02-19T19:12:09.538 INFO:tasks.workunit.client.1.smithi125.stdout:5/324: stat db/d17/d58/f37 0 2024-02-19T19:12:09.538 INFO:tasks.workunit.client.1.smithi125.stdout:5/325: chown db/d17/d58/d25/l4a 951 1 2024-02-19T19:12:09.538 INFO:tasks.workunit.client.1.smithi125.stdout:5/326: chown db/d17/d58/f37 314383652 1 2024-02-19T19:12:09.538 INFO:tasks.workunit.client.1.smithi125.stdout:5/327: unlink db/d17/d58/d25/f32 0 2024-02-19T19:12:09.538 INFO:tasks.workunit.client.1.smithi125.stdout:5/328: symlink db/d47/l65 0 2024-02-19T19:12:09.538 INFO:tasks.workunit.client.1.smithi125.stdout:5/329: link db/d17/d58/d4f/f63 db/d17/d58/d25/d40/f66 0 2024-02-19T19:12:09.538 INFO:tasks.workunit.client.1.smithi125.stdout:5/330: truncate db/d17/d58/d4f/f63 777933 0 2024-02-19T19:12:09.539 INFO:tasks.workunit.client.1.smithi125.stdout:5/331: read db/d17/f41 [746607,66688] 0 2024-02-19T19:12:09.539 INFO:tasks.workunit.client.1.smithi125.stdout:5/332: mknod db/d17/d58/d33/d64/c67 0 2024-02-19T19:12:09.539 INFO:tasks.workunit.client.1.smithi125.stdout:5/333: symlink db/d17/d58/d33/d53/l68 0 2024-02-19T19:12:09.539 INFO:tasks.workunit.client.1.smithi125.stdout:5/334: creat db/f69 x:0 0 0 2024-02-19T19:12:09.539 INFO:tasks.workunit.client.1.smithi125.stdout:5/335: dread - db/d47/f5f zero size 2024-02-19T19:12:09.539 INFO:tasks.workunit.client.1.smithi125.stdout:5/336: rmdir db 39 2024-02-19T19:12:09.539 INFO:tasks.workunit.client.1.smithi125.stdout:5/337: link db/d17/d58/ff db/d47/f6a 0 2024-02-19T19:12:09.539 INFO:tasks.workunit.client.1.smithi125.stdout:5/338: chown db/d17/d58/d33/d64/c67 47457953 1 2024-02-19T19:12:09.540 INFO:tasks.workunit.client.1.smithi125.stdout:5/339: chown db/d17/f1e 1992663059 1 2024-02-19T19:12:09.540 INFO:tasks.workunit.client.1.smithi125.stdout:5/340: chown db/l35 82573346 1 2024-02-19T19:12:09.540 INFO:tasks.workunit.client.1.smithi125.stdout:5/341: symlink db/d17/l6b 0 2024-02-19T19:12:09.540 INFO:tasks.workunit.client.1.smithi125.stdout:5/342: mknod db/d17/d58/d4f/c6c 0 2024-02-19T19:12:09.540 INFO:tasks.workunit.client.1.smithi125.stdout:5/343: dwrite db/d47/d52/f4e [778240,61440] 0 2024-02-19T19:12:09.544 INFO:tasks.workunit.client.1.smithi125.stdout:1/200: sync 2024-02-19T19:12:09.544 INFO:tasks.workunit.client.1.smithi125.stdout:9/195: sync 2024-02-19T19:12:09.544 INFO:tasks.workunit.client.1.smithi125.stdout:3/196: sync 2024-02-19T19:12:09.544 INFO:tasks.workunit.client.1.smithi125.stdout:2/162: sync 2024-02-19T19:12:09.544 INFO:tasks.workunit.client.1.smithi125.stdout:7/162: sync 2024-02-19T19:12:09.544 INFO:tasks.workunit.client.1.smithi125.stdout:1/201: mkdir d1/d26/d3c/d3f 0 2024-02-19T19:12:09.545 INFO:tasks.workunit.client.1.smithi125.stdout:0/218: sync 2024-02-19T19:12:09.545 INFO:tasks.workunit.client.1.smithi125.stdout:2/163: dread d1/ff [471040,110592] 0 2024-02-19T19:12:09.545 INFO:tasks.workunit.client.1.smithi125.stdout:1/202: creat d1/d26/f40 x:0 0 0 2024-02-19T19:12:09.545 INFO:tasks.workunit.client.1.smithi125.stdout:3/197: symlink d0/de/l38 0 2024-02-19T19:12:09.545 INFO:tasks.workunit.client.1.smithi125.stdout:1/203: dread - d1/dc/f2c zero size 2024-02-19T19:12:09.545 INFO:tasks.workunit.client.1.smithi125.stdout:4/165: sync 2024-02-19T19:12:09.545 INFO:tasks.workunit.client.1.smithi125.stdout:2/164: unlink d1/d27/f1c 0 2024-02-19T19:12:09.545 INFO:tasks.workunit.client.1.smithi125.stdout:3/198: mkdir d0/d1/d39 0 2024-02-19T19:12:09.546 INFO:tasks.workunit.client.1.smithi125.stdout:4/166: creat d0/d32/f36 x:0 0 0 2024-02-19T19:12:09.546 INFO:tasks.workunit.client.1.smithi125.stdout:5/344: dwrite db/d17/d58/d25/f3c [655360,69632] 0 2024-02-19T19:12:09.546 INFO:tasks.workunit.client.1.smithi125.stdout:4/167: chown d0/d7/dc/f1e 34369571 1 2024-02-19T19:12:09.546 INFO:tasks.workunit.client.1.smithi125.stdout:3/199: dread d0/de/f14 [159744,69632] 0 2024-02-19T19:12:09.546 INFO:tasks.workunit.client.1.smithi125.stdout:5/345: getdents db/d17/d58/d25/d40 0 2024-02-19T19:12:09.546 INFO:tasks.workunit.client.1.smithi125.stdout:4/168: rename d0/df/c20 to d0/d7/d30/c37 0 2024-02-19T19:12:09.546 INFO:tasks.workunit.client.1.smithi125.stdout:2/165: write d1/fd [85549,76830] 0 2024-02-19T19:12:09.546 INFO:tasks.workunit.client.1.smithi125.stdout:3/200: creat d0/de/f3a x:0 0 0 2024-02-19T19:12:09.547 INFO:tasks.workunit.client.1.smithi125.stdout:5/346: truncate db/d17/d58/f1c 1010610 0 2024-02-19T19:12:09.547 INFO:tasks.workunit.client.1.smithi125.stdout:4/169: creat d0/f38 x:0 0 0 2024-02-19T19:12:09.547 INFO:tasks.workunit.client.1.smithi125.stdout:5/347: rename db/d17/d58/d25/d40/c59 to db/d17/d58/d33/d64/c6d 0 2024-02-19T19:12:09.547 INFO:tasks.workunit.client.1.smithi125.stdout:4/170: creat d0/d7/dc/f39 x:0 0 0 2024-02-19T19:12:09.547 INFO:tasks.workunit.client.1.smithi125.stdout:2/166: symlink d1/d27/d1d/d25/l30 0 2024-02-19T19:12:09.547 INFO:tasks.workunit.client.1.smithi125.stdout:2/167: rmdir d1/d27/d1d/d2c 39 2024-02-19T19:12:09.547 INFO:tasks.workunit.client.1.smithi125.stdout:3/201: creat d0/de/f3b x:0 0 0 2024-02-19T19:12:09.547 INFO:tasks.workunit.client.1.smithi125.stdout:2/168: creat d1/d27/d1d/d2c/f31 x:0 0 0 2024-02-19T19:12:09.548 INFO:tasks.workunit.client.1.smithi125.stdout:3/202: creat d0/f3c x:0 0 0 2024-02-19T19:12:09.548 INFO:tasks.workunit.client.1.smithi125.stdout:3/203: creat d0/de/f3d x:0 0 0 2024-02-19T19:12:09.548 INFO:tasks.workunit.client.1.smithi125.stdout:4/171: truncate d0/d7/dc/f18 179190 0 2024-02-19T19:12:09.548 INFO:tasks.workunit.client.1.smithi125.stdout:3/204: mknod d0/c3e 0 2024-02-19T19:12:09.548 INFO:tasks.workunit.client.1.smithi125.stdout:2/169: write d1/d27/d1d/d2c/f31 [540162,29542] 0 2024-02-19T19:12:09.548 INFO:tasks.workunit.client.1.smithi125.stdout:4/172: unlink d0/d7/dc/f2b 0 2024-02-19T19:12:09.548 INFO:tasks.workunit.client.1.smithi125.stdout:2/170: chown d1/c19 50881 1 2024-02-19T19:12:09.548 INFO:tasks.workunit.client.1.smithi125.stdout:5/348: creat db/d17/d58/f6e x:0 0 0 2024-02-19T19:12:09.548 INFO:tasks.workunit.client.1.smithi125.stdout:2/171: dread d1/fd [1134592,12288] 0 2024-02-19T19:12:09.549 INFO:tasks.workunit.client.1.smithi125.stdout:5/349: mknod db/d17/d58/d33/d64/c6f 0 2024-02-19T19:12:09.549 INFO:tasks.workunit.client.1.smithi125.stdout:5/350: creat db/d17/d58/d33/d64/f70 x:0 0 0 2024-02-19T19:12:09.634 INFO:tasks.workunit.client.1.smithi125.stdout:9/196: fdatasync d8/d15/f2c 0 2024-02-19T19:12:09.635 INFO:tasks.workunit.client.1.smithi125.stdout:1/204: fsync d1/d26/d23/f2d 0 2024-02-19T19:12:09.641 INFO:tasks.workunit.client.1.smithi125.stdout:7/163: dwrite fc [184320,36864] 0 2024-02-19T19:12:09.641 INFO:tasks.workunit.client.1.smithi125.stdout:9/197: readlink d8/d15/l25 0 2024-02-19T19:12:09.641 INFO:tasks.workunit.client.1.smithi125.stdout:0/219: dwrite d5/d19/d27/d32/f3c [1277952,81920] 0 2024-02-19T19:12:09.641 INFO:tasks.workunit.client.1.smithi125.stdout:0/220: rename d5/d19/d48/c49 to d5/d19/c56 0 2024-02-19T19:12:09.641 INFO:tasks.workunit.client.1.smithi125.stdout:9/198: creat d8/d15/d32/f3f x:0 0 0 2024-02-19T19:12:09.641 INFO:tasks.workunit.client.1.smithi125.stdout:7/164: mkdir d12/d25/d2a 0 2024-02-19T19:12:09.642 INFO:tasks.workunit.client.1.smithi125.stdout:9/199: unlink d8/d15/f29 0 2024-02-19T19:12:09.642 INFO:tasks.workunit.client.1.smithi125.stdout:1/205: mkdir d1/dc/d36/d41 0 2024-02-19T19:12:09.642 INFO:tasks.workunit.client.1.smithi125.stdout:7/165: symlink d12/d25/d2a/l2b 0 2024-02-19T19:12:09.642 INFO:tasks.workunit.client.1.smithi125.stdout:9/200: symlink d8/d2e/l40 0 2024-02-19T19:12:09.642 INFO:tasks.workunit.client.1.smithi125.stdout:2/172: write d1/d27/f11 [779952,116114] 0 2024-02-19T19:12:09.642 INFO:tasks.workunit.client.1.smithi125.stdout:7/166: rmdir d12/d25 39 2024-02-19T19:12:09.642 INFO:tasks.workunit.client.1.smithi125.stdout:2/173: readlink d1/l20 0 2024-02-19T19:12:09.643 INFO:tasks.workunit.client.1.smithi125.stdout:5/351: write db/d17/f1e [1950558,115001] 0 2024-02-19T19:12:09.643 INFO:tasks.workunit.client.1.smithi125.stdout:2/174: readlink d1/l28 0 2024-02-19T19:12:09.643 INFO:tasks.workunit.client.1.smithi125.stdout:9/201: getdents d8 0 2024-02-19T19:12:09.643 INFO:tasks.workunit.client.1.smithi125.stdout:5/352: chown db/l16 974114403 1 2024-02-19T19:12:09.643 INFO:tasks.workunit.client.1.smithi125.stdout:2/175: dread d1/d27/f10 [253952,118784] 0 2024-02-19T19:12:09.643 INFO:tasks.workunit.client.1.smithi125.stdout:5/353: dread db/d17/d58/d25/d40/f66 [458752,40960] 0 2024-02-19T19:12:09.643 INFO:tasks.workunit.client.1.smithi125.stdout:1/206: write d1/dc/f2c [362297,34215] 0 2024-02-19T19:12:09.643 INFO:tasks.workunit.client.1.smithi125.stdout:9/202: write f3 [635857,52573] 0 2024-02-19T19:12:09.643 INFO:tasks.workunit.client.1.smithi125.stdout:2/176: symlink d1/d27/d1d/d25/l32 0 2024-02-19T19:12:09.644 INFO:tasks.workunit.client.1.smithi125.stdout:2/177: link d1/d27/d1d/f24 d1/d27/f33 0 2024-02-19T19:12:09.644 INFO:tasks.workunit.client.1.smithi125.stdout:2/178: rename d1/d27/f1e to d1/d27/d1d/d25/d2a/f34 0 2024-02-19T19:12:09.644 INFO:tasks.workunit.client.1.smithi125.stdout:1/207: dread d1/dc/f19 [950272,106496] 0 2024-02-19T19:12:09.644 INFO:tasks.workunit.client.1.smithi125.stdout:9/203: symlink d8/d15/d32/l41 0 2024-02-19T19:12:09.644 INFO:tasks.workunit.client.1.smithi125.stdout:1/208: rmdir d1/d1a 39 2024-02-19T19:12:09.644 INFO:tasks.workunit.client.1.smithi125.stdout:2/179: symlink d1/d27/d1d/d16/l35 0 2024-02-19T19:12:09.644 INFO:tasks.workunit.client.1.smithi125.stdout:9/204: symlink d8/l42 0 2024-02-19T19:12:09.644 INFO:tasks.workunit.client.1.smithi125.stdout:9/205: rename d8/d15/f35 to d8/f43 0 2024-02-19T19:12:09.645 INFO:tasks.workunit.client.1.smithi125.stdout:1/209: read d1/dc/d36/d39/f3a [903519,101264] 0 2024-02-19T19:12:09.645 INFO:tasks.workunit.client.1.smithi125.stdout:9/206: mkdir d8/d15/d22/d44 0 2024-02-19T19:12:09.645 INFO:tasks.workunit.client.1.smithi125.stdout:1/210: truncate d1/f30 62350 0 2024-02-19T19:12:09.645 INFO:tasks.workunit.client.1.smithi125.stdout:1/211: write d1/dc/f2c [471330,19885] 0 2024-02-19T19:12:09.645 INFO:tasks.workunit.client.1.smithi125.stdout:1/212: write d1/dc/f19 [2184075,35384] 0 2024-02-19T19:12:09.645 INFO:tasks.workunit.client.1.smithi125.stdout:1/213: dread f0 [1134592,77824] 0 2024-02-19T19:12:09.645 INFO:tasks.workunit.client.1.smithi125.stdout:1/214: write d1/f9 [3286057,102377] 0 2024-02-19T19:12:09.645 INFO:tasks.workunit.client.1.smithi125.stdout:1/215: chown d1/d26/d3c 49371972 1 2024-02-19T19:12:09.646 INFO:tasks.workunit.client.1.smithi125.stdout:1/216: getdents d1/dc/d36/d41 0 2024-02-19T19:12:09.646 INFO:tasks.workunit.client.1.smithi125.stdout:1/217: mknod d1/d26/c42 0 2024-02-19T19:12:09.646 INFO:tasks.workunit.client.1.smithi125.stdout:1/218: unlink d1/c2f 0 2024-02-19T19:12:09.646 INFO:tasks.workunit.client.1.smithi125.stdout:1/219: symlink d1/dc/d36/l43 0 2024-02-19T19:12:09.646 INFO:tasks.workunit.client.1.smithi125.stdout:1/220: write d1/dc/f1b [1268245,9004] 0 2024-02-19T19:12:09.646 INFO:tasks.workunit.client.1.smithi125.stdout:1/221: creat d1/d1a/d3d/f44 x:0 0 0 2024-02-19T19:12:09.690 INFO:tasks.workunit.client.1.smithi125.stdout:3/205: dwrite d0/f24 [532480,102400] 0 2024-02-19T19:12:09.690 INFO:tasks.workunit.client.1.smithi125.stdout:3/206: dread - d0/d1/f31 zero size 2024-02-19T19:12:09.690 INFO:tasks.workunit.client.1.smithi125.stdout:3/207: symlink d0/de/l3f 0 2024-02-19T19:12:09.690 INFO:tasks.workunit.client.1.smithi125.stdout:3/208: symlink d0/l40 0 2024-02-19T19:12:09.690 INFO:tasks.workunit.client.1.smithi125.stdout:3/209: readlink d0/l40 0 2024-02-19T19:12:09.690 INFO:tasks.workunit.client.1.smithi125.stdout:3/210: write d0/d1/f23 [34957,40826] 0 2024-02-19T19:12:09.691 INFO:tasks.workunit.client.1.smithi125.stdout:9/207: dwrite f3 [1581056,4096] 0 2024-02-19T19:12:09.691 INFO:tasks.workunit.client.1.smithi125.stdout:5/354: dwrite db/d17/d58/d4f/f63 [1511424,8192] 0 2024-02-19T19:12:09.691 INFO:tasks.workunit.client.1.smithi125.stdout:5/355: link db/d17/f45 db/d17/d58/d4f/f71 0 2024-02-19T19:12:09.691 INFO:tasks.workunit.client.1.smithi125.stdout:5/356: creat db/d17/d58/f72 x:0 0 0 2024-02-19T19:12:09.692 INFO:tasks.workunit.client.1.smithi125.stdout:1/222: dwrite f0 [3088384,126976] 0 2024-02-19T19:12:09.698 INFO:tasks.workunit.client.1.smithi125.stdout:2/180: write d1/d27/f33 [717436,62682] 0 2024-02-19T19:12:09.698 INFO:tasks.workunit.client.1.smithi125.stdout:2/181: mkdir d1/d36 0 2024-02-19T19:12:09.699 INFO:tasks.workunit.client.1.smithi125.stdout:2/182: creat d1/d27/d1d/f37 x:0 0 0 2024-02-19T19:12:09.699 INFO:tasks.workunit.client.1.smithi125.stdout:2/183: unlink d1/d27/c23 0 2024-02-19T19:12:09.699 INFO:tasks.workunit.client.1.smithi125.stdout:2/184: rename d1/d27/d1d/f37 to d1/d27/d1d/d25/f38 0 2024-02-19T19:12:09.699 INFO:tasks.workunit.client.1.smithi125.stdout:2/185: truncate d1/d27/d1d/f2b 414025 0 2024-02-19T19:12:09.699 INFO:tasks.workunit.client.1.smithi125.stdout:2/186: unlink d1/d27/d1d/d25/l30 0 2024-02-19T19:12:09.699 INFO:tasks.workunit.client.1.smithi125.stdout:2/187: mkdir d1/d27/d1d/d39 0 2024-02-19T19:12:09.699 INFO:tasks.workunit.client.1.smithi125.stdout:2/188: write d1/d27/d1d/d25/d2a/f34 [683909,67172] 0 2024-02-19T19:12:09.699 INFO:tasks.workunit.client.1.smithi125.stdout:2/189: write d1/f2 [3560791,75418] 0 2024-02-19T19:12:09.700 INFO:tasks.workunit.client.1.smithi125.stdout:2/190: truncate d1/d27/f8 1450542 0 2024-02-19T19:12:09.703 INFO:tasks.workunit.client.1.smithi125.stdout:3/211: dread d0/de/f1c [741376,57344] 0 2024-02-19T19:12:09.728 INFO:tasks.workunit.client.1.smithi125.stdout:7/167: fsync fa 0 2024-02-19T19:12:09.729 INFO:tasks.workunit.client.1.smithi125.stdout:7/168: chown d12/c22 463 1 2024-02-19T19:12:09.729 INFO:tasks.workunit.client.1.smithi125.stdout:4/173: fdatasync d0/d7/dc/f18 0 2024-02-19T19:12:09.729 INFO:tasks.workunit.client.1.smithi125.stdout:4/174: mknod d0/d7/dc/c3a 0 2024-02-19T19:12:09.729 INFO:tasks.workunit.client.1.smithi125.stdout:4/175: truncate d0/d7/f26 2255926 0 2024-02-19T19:12:09.729 INFO:tasks.workunit.client.1.smithi125.stdout:4/176: read d0/f1b [365239,5674] 0 2024-02-19T19:12:09.729 INFO:tasks.workunit.client.1.smithi125.stdout:4/177: write d0/df/f23 [708839,83137] 0 2024-02-19T19:12:09.729 INFO:tasks.workunit.client.1.smithi125.stdout:4/178: rmdir d0/d7 39 2024-02-19T19:12:09.729 INFO:tasks.workunit.client.1.smithi125.stdout:4/179: stat d0/d7/dc/c1f 0 2024-02-19T19:12:09.730 INFO:tasks.workunit.client.1.smithi125.stdout:4/180: chown d0/d32/f36 16 1 2024-02-19T19:12:09.730 INFO:tasks.workunit.client.1.smithi125.stdout:4/181: dread - d0/f17 zero size 2024-02-19T19:12:09.730 INFO:tasks.workunit.client.1.smithi125.stdout:4/182: write d0/df/f33 [251505,56478] 0 2024-02-19T19:12:09.731 INFO:tasks.workunit.client.1.smithi125.stdout:1/223: dwrite d1/dc/f1f [188416,12288] 0 2024-02-19T19:12:09.731 INFO:tasks.workunit.client.1.smithi125.stdout:7/169: dwrite d12/d18/f23 [942080,94208] 0 2024-02-19T19:12:09.731 INFO:tasks.workunit.client.1.smithi125.stdout:7/170: chown d12/d18/f23 58271 1 2024-02-19T19:12:09.732 INFO:tasks.workunit.client.1.smithi125.stdout:1/224: creat d1/f45 x:0 0 0 2024-02-19T19:12:09.732 INFO:tasks.workunit.client.1.smithi125.stdout:3/212: dwrite d0/de/f2e [40960,32768] 0 2024-02-19T19:12:09.732 INFO:tasks.workunit.client.1.smithi125.stdout:5/357: dwrite db/d17/d58/f72 [884736,4096] 0 2024-02-19T19:12:09.732 INFO:tasks.workunit.client.1.smithi125.stdout:2/191: dwrite d1/d27/f22 [1654784,81920] 0 2024-02-19T19:12:09.732 INFO:tasks.workunit.client.1.smithi125.stdout:9/208: dwrite f6 [65536,61440] 0 2024-02-19T19:12:09.732 INFO:tasks.workunit.client.1.smithi125.stdout:7/171: mkdir d12/d18/d2c 0 2024-02-19T19:12:09.732 INFO:tasks.workunit.client.1.smithi125.stdout:7/172: chown f8 1978 1 2024-02-19T19:12:09.733 INFO:tasks.workunit.client.1.smithi125.stdout:1/225: dread f0 [1904640,94208] 0 2024-02-19T19:12:09.733 INFO:tasks.workunit.client.1.smithi125.stdout:5/358: truncate db/d17/d58/d4f/f71 1651649 0 2024-02-19T19:12:09.733 INFO:tasks.workunit.client.1.smithi125.stdout:2/192: rename d1/l20 to d1/d27/d1d/d16/l3a 0 2024-02-19T19:12:09.733 INFO:tasks.workunit.client.1.smithi125.stdout:2/193: rmdir d1/d27 39 2024-02-19T19:12:09.733 INFO:tasks.workunit.client.1.smithi125.stdout:7/173: dread d12/d18/f1e [24576,126976] 0 2024-02-19T19:12:09.733 INFO:tasks.workunit.client.1.smithi125.stdout:1/226: creat d1/d26/d3c/f46 x:0 0 0 2024-02-19T19:12:09.733 INFO:tasks.workunit.client.1.smithi125.stdout:2/194: mknod d1/d27/d1d/d39/c3b 0 2024-02-19T19:12:09.733 INFO:tasks.workunit.client.1.smithi125.stdout:1/227: creat d1/f47 x:0 0 0 2024-02-19T19:12:09.734 INFO:tasks.workunit.client.1.smithi125.stdout:7/174: creat d12/d18/d2c/f2d x:0 0 0 2024-02-19T19:12:09.734 INFO:tasks.workunit.client.1.smithi125.stdout:2/195: truncate d1/d27/d1d/d2c/f31 1486341 0 2024-02-19T19:12:09.734 INFO:tasks.workunit.client.1.smithi125.stdout:5/359: symlink db/d17/d58/d25/d40/l73 0 2024-02-19T19:12:09.734 INFO:tasks.workunit.client.1.smithi125.stdout:2/196: chown d1/l17 1918690269 1 2024-02-19T19:12:09.734 INFO:tasks.workunit.client.1.smithi125.stdout:4/183: dwrite d0/d7/dc/f9 [1867776,32768] 0 2024-02-19T19:12:09.734 INFO:tasks.workunit.client.1.smithi125.stdout:4/184: mkdir d0/d7/d3b 0 2024-02-19T19:12:09.734 INFO:tasks.workunit.client.1.smithi125.stdout:4/185: rename d0/d7/dc/c10 to d0/d32/c3c 0 2024-02-19T19:12:09.734 INFO:tasks.workunit.client.1.smithi125.stdout:4/186: unlink d0/d7/dc/f28 0 2024-02-19T19:12:09.734 INFO:tasks.workunit.client.1.smithi125.stdout:4/187: stat d0/df/f33 0 2024-02-19T19:12:09.735 INFO:tasks.workunit.client.1.smithi125.stdout:4/188: rmdir d0/d7/dc 39 2024-02-19T19:12:09.771 INFO:tasks.workunit.client.1.smithi125.stdout:7/175: dwrite fb [479232,36864] 0 2024-02-19T19:12:09.772 INFO:tasks.workunit.client.1.smithi125.stdout:7/176: write d12/d18/d2c/f2d [594934,104235] 0 2024-02-19T19:12:09.772 INFO:tasks.workunit.client.1.smithi125.stdout:7/177: rename d12/l1a to d12/d27/l2e 0 2024-02-19T19:12:09.774 INFO:tasks.workunit.client.1.smithi125.stdout:2/197: dwrite d1/ff [667648,45056] 0 2024-02-19T19:12:09.774 INFO:tasks.workunit.client.1.smithi125.stdout:2/198: unlink d1/d27/d1d/l9 0 2024-02-19T19:12:09.774 INFO:tasks.workunit.client.1.smithi125.stdout:2/199: rmdir d1/d27/d1d/d25 39 2024-02-19T19:12:09.774 INFO:tasks.workunit.client.1.smithi125.stdout:2/200: write d1/d27/d1d/f24 [152787,14525] 0 2024-02-19T19:12:09.775 INFO:tasks.workunit.client.1.smithi125.stdout:2/201: readlink d1/d27/d1d/d16/l1a 0 2024-02-19T19:12:09.775 INFO:tasks.workunit.client.1.smithi125.stdout:2/202: stat d1/d27/f8 0 2024-02-19T19:12:09.775 INFO:tasks.workunit.client.1.smithi125.stdout:2/203: readlink d1/d27/d1d/l21 0 2024-02-19T19:12:09.775 INFO:tasks.workunit.client.1.smithi125.stdout:2/204: mknod d1/d36/c3c 0 2024-02-19T19:12:09.775 INFO:tasks.workunit.client.1.smithi125.stdout:2/205: dread d1/fd [1220608,28672] 0 2024-02-19T19:12:09.775 INFO:tasks.workunit.client.1.smithi125.stdout:2/206: chown d1/d27/d1d/l26 14 1 2024-02-19T19:12:09.775 INFO:tasks.workunit.client.1.smithi125.stdout:2/207: dread d1/d27/f8 [409600,126976] 0 2024-02-19T19:12:09.776 INFO:tasks.workunit.client.1.smithi125.stdout:4/189: dwrite d0/f2e [217088,94208] 0 2024-02-19T19:12:09.776 INFO:tasks.workunit.client.1.smithi125.stdout:4/190: write d0/fa [2354261,77723] 0 2024-02-19T19:12:09.776 INFO:tasks.workunit.client.1.smithi125.stdout:4/191: creat d0/d7/d3b/f3d x:0 0 0 2024-02-19T19:12:09.776 INFO:tasks.workunit.client.1.smithi125.stdout:4/192: chown d0/d7/dc/f39 10386 1 2024-02-19T19:12:09.776 INFO:tasks.workunit.client.1.smithi125.stdout:4/193: stat d0/d7/f26 0 2024-02-19T19:12:09.776 INFO:tasks.workunit.client.1.smithi125.stdout:4/194: rmdir d0/d7 39 2024-02-19T19:12:09.776 INFO:tasks.workunit.client.1.smithi125.stdout:4/195: symlink d0/d7/d30/l3e 0 2024-02-19T19:12:09.776 INFO:tasks.workunit.client.1.smithi125.stdout:4/196: chown d0/df 46858 1 2024-02-19T19:12:09.777 INFO:tasks.workunit.client.1.smithi125.stdout:4/197: mknod d0/d32/c3f 0 2024-02-19T19:12:09.882 INFO:tasks.workunit.client.1.smithi125.stdout:9/209: fsync d8/d37/f3b 0 2024-02-19T19:12:09.882 INFO:tasks.workunit.client.1.smithi125.stdout:0/221: fdatasync d5/d19/d27/d32/f3a 0 2024-02-19T19:12:09.882 INFO:tasks.workunit.client.1.smithi125.stdout:9/210: dread d8/d15/f1c [540672,40960] 0 2024-02-19T19:12:09.882 INFO:tasks.workunit.client.1.smithi125.stdout:0/222: dread d5/d15/f52 [118784,36864] 0 2024-02-19T19:12:09.882 INFO:tasks.workunit.client.1.smithi125.stdout:7/178: dread f5 [225280,81920] 0 2024-02-19T19:12:09.887 INFO:tasks.workunit.client.1.smithi125.stdout:4/198: dwrite d0/d7/f15 [913408,114688] 0 2024-02-19T19:12:09.887 INFO:tasks.workunit.client.1.smithi125.stdout:0/223: truncate d5/d9/fb 1893082 0 2024-02-19T19:12:09.887 INFO:tasks.workunit.client.1.smithi125.stdout:0/224: read d5/d9/f26 [1108615,12838] 0 2024-02-19T19:12:09.887 INFO:tasks.workunit.client.1.smithi125.stdout:4/199: creat d0/f40 x:0 0 0 2024-02-19T19:12:09.887 INFO:tasks.workunit.client.1.smithi125.stdout:0/225: getdents d5/d15 0 2024-02-19T19:12:09.888 INFO:tasks.workunit.client.1.smithi125.stdout:4/200: dread d0/df/f33 [49152,106496] 0 2024-02-19T19:12:09.888 INFO:tasks.workunit.client.1.smithi125.stdout:0/226: mknod d5/d19/d2b/c57 0 2024-02-19T19:12:09.888 INFO:tasks.workunit.client.1.smithi125.stdout:0/227: mkdir d5/d1a/d58 0 2024-02-19T19:12:09.888 INFO:tasks.workunit.client.1.smithi125.stdout:0/228: chown d5/d1a/f55 559082977 1 2024-02-19T19:12:09.928 INFO:tasks.workunit.client.1.smithi125.stdout:7/179: fdatasync d12/f17 0 2024-02-19T19:12:09.928 INFO:tasks.workunit.client.1.smithi125.stdout:7/180: unlink f11 0 2024-02-19T19:12:09.928 INFO:tasks.workunit.client.1.smithi125.stdout:7/181: creat d12/d25/d26/f2f x:0 0 0 2024-02-19T19:12:09.928 INFO:tasks.workunit.client.1.smithi125.stdout:7/182: chown l6 3546 1 2024-02-19T19:12:09.928 INFO:tasks.workunit.client.1.smithi125.stdout:7/183: truncate d12/d18/f1e 677590 0 2024-02-19T19:12:09.929 INFO:tasks.workunit.client.1.smithi125.stdout:7/184: getdents d12/d18/d2c 0 2024-02-19T19:12:09.929 INFO:tasks.workunit.client.1.smithi125.stdout:9/211: dwrite d8/f11 [1503232,126976] 0 2024-02-19T19:12:09.931 INFO:tasks.workunit.client.1.smithi125.stdout:4/201: dread d0/f2e [303104,45056] 0 2024-02-19T19:12:09.931 INFO:tasks.workunit.client.1.smithi125.stdout:4/202: chown d0 120583941 1 2024-02-19T19:12:09.933 INFO:tasks.workunit.client.1.smithi125.stdout:8/150: sync 2024-02-19T19:12:09.933 INFO:tasks.workunit.client.1.smithi125.stdout:6/176: sync 2024-02-19T19:12:09.933 INFO:tasks.workunit.client.1.smithi125.stdout:6/177: truncate d6/db/df/d16/f2b 1785309 0 2024-02-19T19:12:09.934 INFO:tasks.workunit.client.1.smithi125.stdout:6/178: readlink d6/db/df/d16/l26 0 2024-02-19T19:12:09.934 INFO:tasks.workunit.client.1.smithi125.stdout:0/229: dwrite d5/d9/f26 [2670592,110592] 0 2024-02-19T19:12:09.934 INFO:tasks.workunit.client.1.smithi125.stdout:0/230: write d5/d15/d2c/f3e [94778,50561] 0 2024-02-19T19:12:09.934 INFO:tasks.workunit.client.1.smithi125.stdout:9/212: dwrite d8/f31 [409600,45056] 0 2024-02-19T19:12:09.934 INFO:tasks.workunit.client.1.smithi125.stdout:0/231: symlink d5/d19/d27/d32/l59 0 2024-02-19T19:12:09.934 INFO:tasks.workunit.client.1.smithi125.stdout:0/232: link d5/d9/l14 d5/d19/d27/l5a 0 2024-02-19T19:12:09.934 INFO:tasks.workunit.client.1.smithi125.stdout:9/213: creat d8/d2e/f45 x:0 0 0 2024-02-19T19:12:09.934 INFO:tasks.workunit.client.1.smithi125.stdout:0/233: chown d5/d19/c30 29 1 2024-02-19T19:12:09.935 INFO:tasks.workunit.client.1.smithi125.stdout:9/214: dread d8/f9 [1638400,8192] 0 2024-02-19T19:12:09.935 INFO:tasks.workunit.client.1.smithi125.stdout:9/215: mknod d8/d15/c46 0 2024-02-19T19:12:09.935 INFO:tasks.workunit.client.1.smithi125.stdout:0/234: creat d5/d15/f5b x:0 0 0 2024-02-19T19:12:09.935 INFO:tasks.workunit.client.1.smithi125.stdout:9/216: creat d8/d37/f47 x:0 0 0 2024-02-19T19:12:09.935 INFO:tasks.workunit.client.1.smithi125.stdout:9/217: rename d8/c19 to d8/d37/c48 0 2024-02-19T19:12:09.994 INFO:tasks.workunit.client.1.smithi125.stdout:7/185: fsync f8 0 2024-02-19T19:12:09.994 INFO:tasks.workunit.client.1.smithi125.stdout:7/186: chown d12/d25/d2a 336045 1 2024-02-19T19:12:09.994 INFO:tasks.workunit.client.1.smithi125.stdout:7/187: dread - d12/d18/f20 zero size 2024-02-19T19:12:09.994 INFO:tasks.workunit.client.1.smithi125.stdout:1/228: fsync f0 0 2024-02-19T19:12:09.995 INFO:tasks.workunit.client.1.smithi125.stdout:1/229: creat d1/d26/d3c/d3f/f48 x:0 0 0 2024-02-19T19:12:10.000 INFO:tasks.workunit.client.1.smithi125.stdout:1/230: rename d1/d26/c42 to d1/d26/d29/c49 0 2024-02-19T19:12:10.000 INFO:tasks.workunit.client.1.smithi125.stdout:0/235: dwrite d5/d9/fd [1589248,28672] 0 2024-02-19T19:12:10.000 INFO:tasks.workunit.client.1.smithi125.stdout:4/203: dwrite d0/d7/dc/f2d [897024,20480] 0 2024-02-19T19:12:10.000 INFO:tasks.workunit.client.1.smithi125.stdout:1/231: dread - d1/d26/f40 zero size 2024-02-19T19:12:10.001 INFO:tasks.workunit.client.1.smithi125.stdout:7/188: mkdir d12/d25/d26/d30 0 2024-02-19T19:12:10.001 INFO:tasks.workunit.client.1.smithi125.stdout:6/179: dwrite d6/f1e [499712,94208] 0 2024-02-19T19:12:10.001 INFO:tasks.workunit.client.1.smithi125.stdout:7/189: readlink l6 0 2024-02-19T19:12:10.001 INFO:tasks.workunit.client.1.smithi125.stdout:7/190: chown d12/c16 0 1 2024-02-19T19:12:10.001 INFO:tasks.workunit.client.1.smithi125.stdout:6/180: dread - d6/db/df/d1b/f2a zero size 2024-02-19T19:12:10.001 INFO:tasks.workunit.client.1.smithi125.stdout:7/191: getdents d12/d18/d2c 0 2024-02-19T19:12:10.002 INFO:tasks.workunit.client.1.smithi125.stdout:4/204: rename d0/d7/l25 to d0/d7/l41 0 2024-02-19T19:12:10.002 INFO:tasks.workunit.client.1.smithi125.stdout:1/232: symlink d1/dc/d36/l4a 0 2024-02-19T19:12:10.002 INFO:tasks.workunit.client.1.smithi125.stdout:7/192: dread f1 [368640,77824] 0 2024-02-19T19:12:10.002 INFO:tasks.workunit.client.1.smithi125.stdout:1/233: mkdir d1/dc/d36/d41/d4b 0 2024-02-19T19:12:10.002 INFO:tasks.workunit.client.1.smithi125.stdout:6/181: mkdir d6/db/df/d1b/d2f 0 2024-02-19T19:12:10.002 INFO:tasks.workunit.client.1.smithi125.stdout:1/234: dread d1/f9 [1314816,49152] 0 2024-02-19T19:12:10.002 INFO:tasks.workunit.client.1.smithi125.stdout:4/205: write d0/df/f33 [6534,85750] 0 2024-02-19T19:12:10.002 INFO:tasks.workunit.client.1.smithi125.stdout:7/193: write f5 [2364484,106759] 0 2024-02-19T19:12:10.002 INFO:tasks.workunit.client.1.smithi125.stdout:1/235: write d1/d26/d29/f35 [596183,25429] 0 2024-02-19T19:12:10.003 INFO:tasks.workunit.client.1.smithi125.stdout:1/236: mknod d1/dc/d36/d41/d4b/c4c 0 2024-02-19T19:12:10.003 INFO:tasks.workunit.client.1.smithi125.stdout:7/194: unlink d12/f13 0 2024-02-19T19:12:10.003 INFO:tasks.workunit.client.1.smithi125.stdout:4/206: mkdir d0/d7/d30/d42 0 2024-02-19T19:12:10.003 INFO:tasks.workunit.client.1.smithi125.stdout:7/195: rmdir d12/d25/d26 39 2024-02-19T19:12:10.003 INFO:tasks.workunit.client.1.smithi125.stdout:1/237: symlink d1/dc/l4d 0 2024-02-19T19:12:10.003 INFO:tasks.workunit.client.1.smithi125.stdout:1/238: readlink d1/d26/d29/l31 0 2024-02-19T19:12:10.003 INFO:tasks.workunit.client.1.smithi125.stdout:4/207: unlink d0/d7/dc/f18 0 2024-02-19T19:12:10.003 INFO:tasks.workunit.client.1.smithi125.stdout:7/196: mkdir d12/d25/d2a/d31 0 2024-02-19T19:12:10.003 INFO:tasks.workunit.client.1.smithi125.stdout:1/239: creat d1/dc/d36/d41/d4b/f4e x:0 0 0 2024-02-19T19:12:10.004 INFO:tasks.workunit.client.1.smithi125.stdout:7/197: write f1 [208232,1773] 0 2024-02-19T19:12:10.004 INFO:tasks.workunit.client.1.smithi125.stdout:4/208: creat d0/d7/d3b/f43 x:0 0 0 2024-02-19T19:12:10.004 INFO:tasks.workunit.client.1.smithi125.stdout:4/209: chown d0/df/c21 10 1 2024-02-19T19:12:10.004 INFO:tasks.workunit.client.1.smithi125.stdout:4/210: rmdir d0/d7/dc 39 2024-02-19T19:12:10.004 INFO:tasks.workunit.client.1.smithi125.stdout:7/198: creat d12/d25/d2a/d31/f32 x:0 0 0 2024-02-19T19:12:10.004 INFO:tasks.workunit.client.1.smithi125.stdout:4/211: chown d0/d7/dc/f24 9 1 2024-02-19T19:12:10.004 INFO:tasks.workunit.client.1.smithi125.stdout:7/199: truncate d12/f1f 120632 0 2024-02-19T19:12:10.004 INFO:tasks.workunit.client.1.smithi125.stdout:7/200: stat d12/f17 0 2024-02-19T19:12:10.005 INFO:tasks.workunit.client.1.smithi125.stdout:7/201: creat d12/f33 x:0 0 0 2024-02-19T19:12:10.005 INFO:tasks.workunit.client.1.smithi125.stdout:7/202: truncate fb 2788316 0 2024-02-19T19:12:10.005 INFO:tasks.workunit.client.1.smithi125.stdout:7/203: read - d12/d25/d2a/d31/f32 zero size 2024-02-19T19:12:10.005 INFO:tasks.workunit.client.1.smithi125.stdout:4/212: write d0/d7/dc/f1e [374843,66438] 0 2024-02-19T19:12:10.005 INFO:tasks.workunit.client.1.smithi125.stdout:4/213: truncate d0/f1b 27171 0 2024-02-19T19:12:10.005 INFO:tasks.workunit.client.1.smithi125.stdout:4/214: dread d0/df/f2a [200704,118784] 0 2024-02-19T19:12:10.006 INFO:tasks.workunit.client.1.smithi125.stdout:4/215: unlink d0/c16 0 2024-02-19T19:12:10.006 INFO:tasks.workunit.client.1.smithi125.stdout:4/216: symlink d0/d32/l44 0 2024-02-19T19:12:10.006 INFO:tasks.workunit.client.1.smithi125.stdout:4/217: write d0/f40 [1046864,5694] 0 2024-02-19T19:12:10.006 INFO:tasks.workunit.client.1.smithi125.stdout:4/218: unlink d0/f38 0 2024-02-19T19:12:10.006 INFO:tasks.workunit.client.1.smithi125.stdout:4/219: truncate d0/d7/f2f 575033 0 2024-02-19T19:12:10.006 INFO:tasks.workunit.client.1.smithi125.stdout:4/220: creat d0/d7/d3b/f45 x:0 0 0 2024-02-19T19:12:10.006 INFO:tasks.workunit.client.1.smithi125.stdout:4/221: dread d0/d7/dc/f1e [40960,94208] 0 2024-02-19T19:12:10.006 INFO:tasks.workunit.client.1.smithi125.stdout:4/222: readlink d0/l2c 0 2024-02-19T19:12:10.006 INFO:tasks.workunit.client.1.smithi125.stdout:4/223: write d0/f17 [326420,34717] 0 2024-02-19T19:12:10.007 INFO:tasks.workunit.client.1.smithi125.stdout:4/224: rmdir d0/d32 39 2024-02-19T19:12:10.007 INFO:tasks.workunit.client.1.smithi125.stdout:4/225: truncate d0/d7/d3b/f45 294384 0 2024-02-19T19:12:10.007 INFO:tasks.workunit.client.1.smithi125.stdout:4/226: creat d0/d32/f46 x:0 0 0 2024-02-19T19:12:10.007 INFO:tasks.workunit.client.1.smithi125.stdout:4/227: creat d0/d32/f47 x:0 0 0 2024-02-19T19:12:10.007 INFO:tasks.workunit.client.1.smithi125.stdout:4/228: truncate d0/d7/f13 690642 0 2024-02-19T19:12:10.007 INFO:tasks.workunit.client.1.smithi125.stdout:4/229: mknod d0/c48 0 2024-02-19T19:12:10.007 INFO:tasks.workunit.client.1.smithi125.stdout:4/230: mknod d0/df/c49 0 2024-02-19T19:12:10.007 INFO:tasks.workunit.client.1.smithi125.stdout:4/231: rename d0/d7/dc/c35 to d0/d7/d3b/c4a 0 2024-02-19T19:12:10.008 INFO:tasks.workunit.client.1.smithi125.stdout:8/151: dread db/d18/f2a [1081344,65536] 0 2024-02-19T19:12:10.008 INFO:tasks.workunit.client.1.smithi125.stdout:8/152: mknod db/c34 0 2024-02-19T19:12:10.049 INFO:tasks.workunit.client.1.smithi125.stdout:4/232: dwrite d0/d7/d3b/f43 [421888,32768] 0 2024-02-19T19:12:10.134 INFO:tasks.workunit.client.1.smithi125.stdout:4/233: write d0/d7/f15 [1521838,129660] 0 2024-02-19T19:12:10.134 INFO:tasks.workunit.client.1.smithi125.stdout:4/234: write d0/d7/dc/f39 [209599,84214] 0 2024-02-19T19:12:10.136 INFO:tasks.workunit.client.1.smithi125.stdout:8/153: dwrite db/d18/f21 [1867776,90112] 0 2024-02-19T19:12:10.136 INFO:tasks.workunit.client.1.smithi125.stdout:8/154: getdents db/d18 0 2024-02-19T19:12:10.136 INFO:tasks.workunit.client.1.smithi125.stdout:6/182: dwrite d6/db/df/d1b/f24 [712704,45056] 0 2024-02-19T19:12:10.136 INFO:tasks.workunit.client.1.smithi125.stdout:0/236: dwrite d5/d15/d2c/f43 [954368,81920] 0 2024-02-19T19:12:10.137 INFO:tasks.workunit.client.1.smithi125.stdout:7/204: dwrite d12/f1f [499712,94208] 0 2024-02-19T19:12:10.137 INFO:tasks.workunit.client.1.smithi125.stdout:7/205: mknod d12/c34 0 2024-02-19T19:12:10.137 INFO:tasks.workunit.client.1.smithi125.stdout:7/206: creat d12/d25/d26/d30/f35 x:0 0 0 2024-02-19T19:12:10.137 INFO:tasks.workunit.client.1.smithi125.stdout:7/207: write d12/d18/f23 [1793787,78535] 0 2024-02-19T19:12:10.137 INFO:tasks.workunit.client.1.smithi125.stdout:7/208: creat d12/d25/d2a/d31/f36 x:0 0 0 2024-02-19T19:12:10.137 INFO:tasks.workunit.client.1.smithi125.stdout:1/240: read d1/d1a/f2e [2353,95510] 0 2024-02-19T19:12:10.137 INFO:tasks.workunit.client.1.smithi125.stdout:1/241: creat d1/dc/d36/f4f x:0 0 0 2024-02-19T19:12:10.137 INFO:tasks.workunit.client.1.smithi125.stdout:1/242: chown d1/l13 1013116368 1 2024-02-19T19:12:10.137 INFO:tasks.workunit.client.1.smithi125.stdout:1/243: creat d1/d1a/f50 x:0 0 0 2024-02-19T19:12:10.138 INFO:tasks.workunit.client.1.smithi125.stdout:1/244: mknod d1/d26/c51 0 2024-02-19T19:12:10.166 INFO:tasks.workunit.client.1.smithi125.stdout:2/208: fsync d1/d27/d1d/f24 0 2024-02-19T19:12:10.170 INFO:tasks.workunit.client.1.smithi125.stdout:2/209: getdents d1/d27/d1d/d25 0 2024-02-19T19:12:10.170 INFO:tasks.workunit.client.1.smithi125.stdout:2/210: dread d1/d27/f10 [1224704,81920] 0 2024-02-19T19:12:10.172 INFO:tasks.workunit.client.1.smithi125.stdout:2/211: rename d1/d27/d1d/d16/l35 to d1/d27/d1d/d25/l3d 0 2024-02-19T19:12:10.172 INFO:tasks.workunit.client.1.smithi125.stdout:1/245: dwrite d1/dc/f17 [2576384,28672] 0 2024-02-19T19:12:10.173 INFO:tasks.workunit.client.1.smithi125.stdout:2/212: truncate d1/ff 2479181 0 2024-02-19T19:12:10.173 INFO:tasks.workunit.client.1.smithi125.stdout:0/237: dwrite d5/d9/fb [782336,40960] 0 2024-02-19T19:12:10.173 INFO:tasks.workunit.client.1.smithi125.stdout:2/213: readlink d1/l17 0 2024-02-19T19:12:10.173 INFO:tasks.workunit.client.1.smithi125.stdout:8/155: dwrite db/fe [2441216,118784] 0 2024-02-19T19:12:10.173 INFO:tasks.workunit.client.1.smithi125.stdout:6/183: dwrite d6/db/df/f14 [1404928,40960] 0 2024-02-19T19:12:10.173 INFO:tasks.workunit.client.1.smithi125.stdout:2/214: link d1/d27/d1d/d16/l1a d1/d27/d1d/d16/l3e 0 2024-02-19T19:12:10.173 INFO:tasks.workunit.client.1.smithi125.stdout:1/246: creat d1/dc/f52 x:0 0 0 2024-02-19T19:12:10.173 INFO:tasks.workunit.client.1.smithi125.stdout:0/238: getdents d5/d33 0 2024-02-19T19:12:10.174 INFO:tasks.workunit.client.1.smithi125.stdout:1/247: rename d1/dc/f19 to d1/dc/d36/d39/f53 0 2024-02-19T19:12:10.174 INFO:tasks.workunit.client.1.smithi125.stdout:2/215: write d1/d27/f10 [2060216,6190] 0 2024-02-19T19:12:10.174 INFO:tasks.workunit.client.1.smithi125.stdout:8/156: mknod db/d18/c35 0 2024-02-19T19:12:10.174 INFO:tasks.workunit.client.1.smithi125.stdout:1/248: chown d1/d26/d29/f35 0 1 2024-02-19T19:12:10.174 INFO:tasks.workunit.client.1.smithi125.stdout:8/157: creat db/f36 x:0 0 0 2024-02-19T19:12:10.174 INFO:tasks.workunit.client.1.smithi125.stdout:8/158: write db/fc [750198,78111] 0 2024-02-19T19:12:10.174 INFO:tasks.workunit.client.1.smithi125.stdout:0/239: write d5/d19/f2f [756707,111265] 0 2024-02-19T19:12:10.174 INFO:tasks.workunit.client.1.smithi125.stdout:0/240: rename d5/d9/fb to d5/d19/d27/f5c 0 2024-02-19T19:12:10.175 INFO:tasks.workunit.client.1.smithi125.stdout:0/241: rmdir d5/d33/d42 39 2024-02-19T19:12:10.175 INFO:tasks.workunit.client.1.smithi125.stdout:8/159: truncate db/f10 696190 0 2024-02-19T19:12:10.175 INFO:tasks.workunit.client.1.smithi125.stdout:8/160: chown db/d18 3480797 1 2024-02-19T19:12:10.175 INFO:tasks.workunit.client.1.smithi125.stdout:3/213: sync 2024-02-19T19:12:10.175 INFO:tasks.workunit.client.1.smithi125.stdout:5/360: sync 2024-02-19T19:12:10.175 INFO:tasks.workunit.client.1.smithi125.stdout:0/242: write d5/d19/d27/d32/f37 [2681039,22531] 0 2024-02-19T19:12:10.175 INFO:tasks.workunit.client.1.smithi125.stdout:3/214: creat d0/d1/f41 x:0 0 0 2024-02-19T19:12:10.176 INFO:tasks.workunit.client.1.smithi125.stdout:3/215: mknod d0/de/c42 0 2024-02-19T19:12:10.176 INFO:tasks.workunit.client.1.smithi125.stdout:3/216: dread - d0/f3c zero size 2024-02-19T19:12:10.176 INFO:tasks.workunit.client.1.smithi125.stdout:3/217: mknod d0/de/c43 0 2024-02-19T19:12:10.176 INFO:tasks.workunit.client.1.smithi125.stdout:3/218: creat d0/de/f44 x:0 0 0 2024-02-19T19:12:10.176 INFO:tasks.workunit.client.1.smithi125.stdout:3/219: rmdir d0/de 39 2024-02-19T19:12:10.176 INFO:tasks.workunit.client.1.smithi125.stdout:3/220: write d0/de/f14 [165925,27549] 0 2024-02-19T19:12:10.176 INFO:tasks.workunit.client.1.smithi125.stdout:3/221: chown d0 4565 1 2024-02-19T19:12:10.177 INFO:tasks.workunit.client.1.smithi125.stdout:3/222: dread d0/de/f2e [790528,94208] 0 2024-02-19T19:12:10.177 INFO:tasks.workunit.client.1.smithi125.stdout:3/223: rename d0/c3e to d0/de/c45 0 2024-02-19T19:12:10.177 INFO:tasks.workunit.client.1.smithi125.stdout:3/224: link d0/de/c45 d0/d1/c46 0 2024-02-19T19:12:10.177 INFO:tasks.workunit.client.1.smithi125.stdout:3/225: link d0/l1b d0/l47 0 2024-02-19T19:12:10.177 INFO:tasks.workunit.client.1.smithi125.stdout:0/243: write d5/d19/d4a/f4f [169565,114207] 0 2024-02-19T19:12:10.177 INFO:tasks.workunit.client.1.smithi125.stdout:0/244: rename d5/d15/d2c/f3e to d5/d1a/d4c/f5d 0 2024-02-19T19:12:10.177 INFO:tasks.workunit.client.1.smithi125.stdout:3/226: symlink d0/d1/d39/l48 0 2024-02-19T19:12:10.177 INFO:tasks.workunit.client.1.smithi125.stdout:3/227: stat d0/de/f3b 0 2024-02-19T19:12:10.178 INFO:tasks.workunit.client.1.smithi125.stdout:0/245: symlink d5/d15/l5e 0 2024-02-19T19:12:10.179 INFO:tasks.workunit.client.1.smithi125.stdout:7/209: dread f1 [983040,126976] 0 2024-02-19T19:12:10.180 INFO:tasks.workunit.client.1.smithi125.stdout:7/210: mkdir d12/d25/d26/d30/d37 0 2024-02-19T19:12:10.180 INFO:tasks.workunit.client.1.smithi125.stdout:7/211: truncate d12/d25/d26/d30/f35 78772 0 2024-02-19T19:12:10.180 INFO:tasks.workunit.client.1.smithi125.stdout:7/212: mknod d12/d25/d26/d30/c38 0 2024-02-19T19:12:10.180 INFO:tasks.workunit.client.1.smithi125.stdout:7/213: rename d12/c16 to d12/d25/d26/c39 0 2024-02-19T19:12:10.180 INFO:tasks.workunit.client.1.smithi125.stdout:7/214: write d12/d25/d2a/d31/f36 [309660,1459] 0 2024-02-19T19:12:10.180 INFO:tasks.workunit.client.1.smithi125.stdout:7/215: unlink cf 0 2024-02-19T19:12:10.180 INFO:tasks.workunit.client.1.smithi125.stdout:7/216: creat d12/d25/d26/f3a x:0 0 0 2024-02-19T19:12:10.181 INFO:tasks.workunit.client.1.smithi125.stdout:7/217: mkdir d12/d27/d3b 0 2024-02-19T19:12:10.181 INFO:tasks.workunit.client.1.smithi125.stdout:7/218: chown d12/d27/l2e 52955 1 2024-02-19T19:12:10.181 INFO:tasks.workunit.client.1.smithi125.stdout:7/219: creat d12/d18/f3c x:0 0 0 2024-02-19T19:12:10.181 INFO:tasks.workunit.client.1.smithi125.stdout:7/220: write d12/d25/d2a/d31/f32 [281368,12953] 0 2024-02-19T19:12:10.181 INFO:tasks.workunit.client.1.smithi125.stdout:7/221: mkdir d12/d3d 0 2024-02-19T19:12:10.181 INFO:tasks.workunit.client.1.smithi125.stdout:7/222: mkdir d12/d25/d3e 0 2024-02-19T19:12:10.225 INFO:tasks.workunit.client.1.smithi125.stdout:6/184: fsync d6/db/df/f21 0 2024-02-19T19:12:10.225 INFO:tasks.workunit.client.1.smithi125.stdout:6/185: chown d6/db/df/f27 0 1 2024-02-19T19:12:10.225 INFO:tasks.workunit.client.1.smithi125.stdout:6/186: symlink d6/db/df/l30 0 2024-02-19T19:12:10.225 INFO:tasks.workunit.client.1.smithi125.stdout:6/187: getdents d6/db 0 2024-02-19T19:12:10.226 INFO:tasks.workunit.client.1.smithi125.stdout:6/188: truncate d6/db/df/d1b/f19 1765564 0 2024-02-19T19:12:10.226 INFO:tasks.workunit.client.1.smithi125.stdout:6/189: chown d6/db/df 220397 1 2024-02-19T19:12:10.226 INFO:tasks.workunit.client.1.smithi125.stdout:3/228: fsync d0/d1/d1e/f36 0 2024-02-19T19:12:10.226 INFO:tasks.workunit.client.1.smithi125.stdout:7/223: fdatasync d12/d18/d2c/f2d 0 2024-02-19T19:12:10.226 INFO:tasks.workunit.client.1.smithi125.stdout:8/161: fdatasync db/d18/f32 0 2024-02-19T19:12:10.226 INFO:tasks.workunit.client.1.smithi125.stdout:3/229: creat d0/d1/d39/f49 x:0 0 0 2024-02-19T19:12:10.226 INFO:tasks.workunit.client.1.smithi125.stdout:3/230: mknod d0/c4a 0 2024-02-19T19:12:10.226 INFO:tasks.workunit.client.1.smithi125.stdout:8/162: mknod db/d18/d30/c37 0 2024-02-19T19:12:10.227 INFO:tasks.workunit.client.1.smithi125.stdout:8/163: link db/f36 db/f38 0 2024-02-19T19:12:10.227 INFO:tasks.workunit.client.1.smithi125.stdout:3/231: mkdir d0/d1/d4b 0 2024-02-19T19:12:10.227 INFO:tasks.workunit.client.1.smithi125.stdout:8/164: write db/d18/f32 [866506,10647] 0 2024-02-19T19:12:10.227 INFO:tasks.workunit.client.1.smithi125.stdout:8/165: readlink db/l1f 0 2024-02-19T19:12:10.227 INFO:tasks.workunit.client.1.smithi125.stdout:7/224: unlink fb 0 2024-02-19T19:12:10.227 INFO:tasks.workunit.client.1.smithi125.stdout:7/225: write d12/f1f [877547,121416] 0 2024-02-19T19:12:10.227 INFO:tasks.workunit.client.1.smithi125.stdout:7/226: creat d12/d25/d26/d30/d37/f3f x:0 0 0 2024-02-19T19:12:10.230 INFO:tasks.workunit.client.1.smithi125.stdout:0/246: truncate d5/d19/d27/d32/f37 1269363 0 2024-02-19T19:12:10.230 INFO:tasks.workunit.client.1.smithi125.stdout:0/247: creat d5/d33/f5f x:0 0 0 2024-02-19T19:12:10.231 INFO:tasks.workunit.client.1.smithi125.stdout:5/361: dwrite db/d17/f22 [176128,118784] 0 2024-02-19T19:12:10.231 INFO:tasks.workunit.client.1.smithi125.stdout:5/362: write db/d17/f41 [2179442,129774] 0 2024-02-19T19:12:10.231 INFO:tasks.workunit.client.1.smithi125.stdout:5/363: symlink db/d26/d51/l74 0 2024-02-19T19:12:10.231 INFO:tasks.workunit.client.1.smithi125.stdout:5/364: truncate db/f30 209882 0 2024-02-19T19:12:10.231 INFO:tasks.workunit.client.1.smithi125.stdout:5/365: getdents db/d17/d58/d25/d40 0 2024-02-19T19:12:10.231 INFO:tasks.workunit.client.1.smithi125.stdout:5/366: write db/d17/d58/d4f/f56 [1027580,19769] 0 2024-02-19T19:12:10.231 INFO:tasks.workunit.client.1.smithi125.stdout:1/249: dwrite d1/dc/f1f [753664,77824] 0 2024-02-19T19:12:10.231 INFO:tasks.workunit.client.1.smithi125.stdout:1/250: creat d1/dc/d36/f54 x:0 0 0 2024-02-19T19:12:10.232 INFO:tasks.workunit.client.1.smithi125.stdout:6/190: dwrite d6/db/df/f27 [1118208,114688] 0 2024-02-19T19:12:10.232 INFO:tasks.workunit.client.1.smithi125.stdout:6/191: dread d6/db/df/d16/f2b [233472,110592] 0 2024-02-19T19:12:10.232 INFO:tasks.workunit.client.1.smithi125.stdout:6/192: write d6/f1e [2251425,11601] 0 2024-02-19T19:12:10.232 INFO:tasks.workunit.client.1.smithi125.stdout:3/232: dwrite d0/d1/f41 [188416,69632] 0 2024-02-19T19:12:10.232 INFO:tasks.workunit.client.1.smithi125.stdout:3/233: read d0/de/f1c [117666,73755] 0 2024-02-19T19:12:10.232 INFO:tasks.workunit.client.1.smithi125.stdout:3/234: truncate d0/d1/d1e/f2c 534805 0 2024-02-19T19:12:10.232 INFO:tasks.workunit.client.1.smithi125.stdout:8/166: dwrite db/fc [499712,49152] 0 2024-02-19T19:12:10.232 INFO:tasks.workunit.client.1.smithi125.stdout:8/167: creat db/d18/d2f/f39 x:0 0 0 2024-02-19T19:12:10.233 INFO:tasks.workunit.client.1.smithi125.stdout:8/168: chown db/f38 16641 1 2024-02-19T19:12:10.233 INFO:tasks.workunit.client.1.smithi125.stdout:8/169: read db/d18/f21 [1236165,118134] 0 2024-02-19T19:12:10.233 INFO:tasks.workunit.client.1.smithi125.stdout:7/227: dwrite d12/d25/d26/f2f [163840,90112] 0 2024-02-19T19:12:10.233 INFO:tasks.workunit.client.1.smithi125.stdout:7/228: creat d12/d27/f40 x:0 0 0 2024-02-19T19:12:10.233 INFO:tasks.workunit.client.1.smithi125.stdout:7/229: dread - d12/d27/f40 zero size 2024-02-19T19:12:10.233 INFO:tasks.workunit.client.1.smithi125.stdout:7/230: readlink d12/d27/l2e 0 2024-02-19T19:12:10.233 INFO:tasks.workunit.client.1.smithi125.stdout:7/231: chown d12/f1f 482232769 1 2024-02-19T19:12:10.233 INFO:tasks.workunit.client.1.smithi125.stdout:7/232: mknod d12/d25/d3e/c41 0 2024-02-19T19:12:10.283 INFO:tasks.workunit.client.1.smithi125.stdout:3/235: fdatasync d0/de/f3b 0 2024-02-19T19:12:10.292 INFO:tasks.workunit.client.1.smithi125.stdout:6/193: dwrite d6/db/df/f27 [172032,61440] 0 2024-02-19T19:12:10.292 INFO:tasks.workunit.client.1.smithi125.stdout:5/367: dread db/d47/d52/f4e [815104,12288] 0 2024-02-19T19:12:10.292 INFO:tasks.workunit.client.1.smithi125.stdout:1/251: dwrite d1/dc/f52 [507904,45056] 0 2024-02-19T19:12:10.292 INFO:tasks.workunit.client.1.smithi125.stdout:8/170: dwrite db/f1e [761856,12288] 0 2024-02-19T19:12:10.292 INFO:tasks.workunit.client.1.smithi125.stdout:3/236: write d0/f19 [251659,36919] 0 2024-02-19T19:12:10.293 INFO:tasks.workunit.client.1.smithi125.stdout:1/252: truncate d1/dc/d36/d41/d4b/f4e 964979 0 2024-02-19T19:12:10.293 INFO:tasks.workunit.client.1.smithi125.stdout:8/171: rename db/fe to db/d18/d2f/f3a 0 2024-02-19T19:12:10.293 INFO:tasks.workunit.client.1.smithi125.stdout:3/237: dread - d0/de/f44 zero size 2024-02-19T19:12:10.293 INFO:tasks.workunit.client.1.smithi125.stdout:8/172: read - db/f36 zero size 2024-02-19T19:12:10.293 INFO:tasks.workunit.client.1.smithi125.stdout:1/253: rename d1/f9 to d1/d26/d23/f55 0 2024-02-19T19:12:10.293 INFO:tasks.workunit.client.1.smithi125.stdout:3/238: mknod d0/d1/d4b/c4c 0 2024-02-19T19:12:10.293 INFO:tasks.workunit.client.1.smithi125.stdout:8/173: truncate db/f26 310684 0 2024-02-19T19:12:10.294 INFO:tasks.workunit.client.1.smithi125.stdout:1/254: truncate d1/f47 742375 0 2024-02-19T19:12:10.294 INFO:tasks.workunit.client.1.smithi125.stdout:1/255: chown d1/d26/d23/f2d 7 1 2024-02-19T19:12:10.294 INFO:tasks.workunit.client.1.smithi125.stdout:5/368: dwrite db/f34 [1466368,8192] 0 2024-02-19T19:12:10.294 INFO:tasks.workunit.client.1.smithi125.stdout:5/369: rmdir db/d17/d58/d33 39 2024-02-19T19:12:10.295 INFO:tasks.workunit.client.1.smithi125.stdout:5/370: write db/f30 [946242,12769] 0 2024-02-19T19:12:10.295 INFO:tasks.workunit.client.1.smithi125.stdout:6/194: dwrite d6/db/df/f27 [69632,24576] 0 2024-02-19T19:12:10.295 INFO:tasks.workunit.client.1.smithi125.stdout:8/174: dwrite db/fc [1994752,69632] 0 2024-02-19T19:12:10.296 INFO:tasks.workunit.client.1.smithi125.stdout:8/175: write db/f36 [125264,47447] 0 2024-02-19T19:12:10.296 INFO:tasks.workunit.client.1.smithi125.stdout:1/256: dwrite d1/d26/f40 [94208,81920] 0 2024-02-19T19:12:10.296 INFO:tasks.workunit.client.1.smithi125.stdout:4/235: sync 2024-02-19T19:12:10.296 INFO:tasks.workunit.client.1.smithi125.stdout:9/218: sync 2024-02-19T19:12:10.298 INFO:tasks.workunit.client.1.smithi125.stdout:9/219: creat d8/d15/d32/f49 x:0 0 0 2024-02-19T19:12:10.298 INFO:tasks.workunit.client.1.smithi125.stdout:8/176: link db/c13 db/d18/c3b 0 2024-02-19T19:12:10.298 INFO:tasks.workunit.client.1.smithi125.stdout:8/177: dread f4 [1802240,28672] 0 2024-02-19T19:12:10.298 INFO:tasks.workunit.client.1.smithi125.stdout:5/371: creat db/f75 x:0 0 0 2024-02-19T19:12:10.298 INFO:tasks.workunit.client.1.smithi125.stdout:9/220: symlink d8/d2e/l4a 0 2024-02-19T19:12:10.298 INFO:tasks.workunit.client.1.smithi125.stdout:4/236: unlink d0/d7/f15 0 2024-02-19T19:12:10.298 INFO:tasks.workunit.client.1.smithi125.stdout:4/237: readlink d0/l2c 0 2024-02-19T19:12:10.299 INFO:tasks.workunit.client.1.smithi125.stdout:8/178: mkdir db/d18/d30/d3c 0 2024-02-19T19:12:10.299 INFO:tasks.workunit.client.1.smithi125.stdout:9/221: truncate d8/f1a 1127481 0 2024-02-19T19:12:10.299 INFO:tasks.workunit.client.1.smithi125.stdout:5/372: write db/d17/f22 [679572,28802] 0 2024-02-19T19:12:10.299 INFO:tasks.workunit.client.1.smithi125.stdout:9/222: link d8/d15/d32/f49 d8/d2e/f4b 0 2024-02-19T19:12:10.299 INFO:tasks.workunit.client.1.smithi125.stdout:8/179: rename db/l2c to db/l3d 0 2024-02-19T19:12:10.299 INFO:tasks.workunit.client.1.smithi125.stdout:4/238: mknod d0/d7/d30/d42/c4b 0 2024-02-19T19:12:10.299 INFO:tasks.workunit.client.1.smithi125.stdout:4/239: truncate d0/f17 209285 0 2024-02-19T19:12:10.299 INFO:tasks.workunit.client.1.smithi125.stdout:9/223: write d8/d15/f2c [739693,104763] 0 2024-02-19T19:12:10.299 INFO:tasks.workunit.client.1.smithi125.stdout:9/224: truncate d8/f11 2632255 0 2024-02-19T19:12:10.300 INFO:tasks.workunit.client.1.smithi125.stdout:9/225: mkdir d8/d2e/d4c 0 2024-02-19T19:12:10.300 INFO:tasks.workunit.client.1.smithi125.stdout:9/226: creat d8/d15/d22/d44/f4d x:0 0 0 2024-02-19T19:12:10.402 INFO:tasks.workunit.client.1.smithi125.stdout:5/373: truncate db/d17/f55 463704 0 2024-02-19T19:12:10.402 INFO:tasks.workunit.client.1.smithi125.stdout:5/374: stat db/d17/d58/d25 0 2024-02-19T19:12:10.402 INFO:tasks.workunit.client.1.smithi125.stdout:5/375: write db/d47/d52/f4e [1438063,128] 0 2024-02-19T19:12:10.402 INFO:tasks.workunit.client.1.smithi125.stdout:5/376: symlink db/d17/d58/d33/d64/l76 0 2024-02-19T19:12:10.404 INFO:tasks.workunit.client.1.smithi125.stdout:9/227: dwrite d8/f26 [147456,53248] 0 2024-02-19T19:12:10.404 INFO:tasks.workunit.client.1.smithi125.stdout:9/228: readlink d8/d15/l1f 0 2024-02-19T19:12:10.404 INFO:tasks.workunit.client.1.smithi125.stdout:9/229: chown d8/d15/d22 1590 1 2024-02-19T19:12:10.404 INFO:tasks.workunit.client.1.smithi125.stdout:9/230: write d8/f28 [1727558,107365] 0 2024-02-19T19:12:10.404 INFO:tasks.workunit.client.1.smithi125.stdout:4/240: dwrite d0/f17 [925696,110592] 0 2024-02-19T19:12:10.405 INFO:tasks.workunit.client.1.smithi125.stdout:4/241: mknod d0/d32/c4c 0 2024-02-19T19:12:10.405 INFO:tasks.workunit.client.1.smithi125.stdout:4/242: read d0/d7/dc/f1e [607332,126900] 0 2024-02-19T19:12:10.405 INFO:tasks.workunit.client.1.smithi125.stdout:8/180: write db/f16 [390834,43434] 0 2024-02-19T19:12:10.405 INFO:tasks.workunit.client.1.smithi125.stdout:8/181: rename db/l2b to db/d18/d30/l3e 0 2024-02-19T19:12:10.405 INFO:tasks.workunit.client.1.smithi125.stdout:8/182: stat db/c34 0 2024-02-19T19:12:10.405 INFO:tasks.workunit.client.1.smithi125.stdout:8/183: chown db/d18/l22 4467833 1 2024-02-19T19:12:10.405 INFO:tasks.workunit.client.1.smithi125.stdout:5/377: dwrite db/d17/d58/f3a [131072,16384] 0 2024-02-19T19:12:10.406 INFO:tasks.workunit.client.1.smithi125.stdout:8/184: dread - db/d18/f27 zero size 2024-02-19T19:12:10.406 INFO:tasks.workunit.client.1.smithi125.stdout:5/378: dread db/d17/f45 [1142784,122880] 0 2024-02-19T19:12:10.406 INFO:tasks.workunit.client.1.smithi125.stdout:5/379: creat db/d26/f77 x:0 0 0 2024-02-19T19:12:10.406 INFO:tasks.workunit.client.1.smithi125.stdout:5/380: truncate db/d17/d58/f24 2720264 0 2024-02-19T19:12:10.406 INFO:tasks.workunit.client.1.smithi125.stdout:5/381: unlink db/d17/d58/d25/l31 0 2024-02-19T19:12:10.451 INFO:tasks.workunit.client.1.smithi125.stdout:6/195: fdatasync d6/db/df/f14 0 2024-02-19T19:12:10.451 INFO:tasks.workunit.client.1.smithi125.stdout:0/248: fdatasync d5/ff 0 2024-02-19T19:12:10.451 INFO:tasks.workunit.client.1.smithi125.stdout:3/239: fsync d0/de/f14 0 2024-02-19T19:12:10.452 INFO:tasks.workunit.client.1.smithi125.stdout:9/231: fsync d8/d37/f47 0 2024-02-19T19:12:10.452 INFO:tasks.workunit.client.1.smithi125.stdout:9/232: readlink d8/d15/l1f 0 2024-02-19T19:12:10.452 INFO:tasks.workunit.client.1.smithi125.stdout:6/196: symlink d6/db/l31 0 2024-02-19T19:12:10.452 INFO:tasks.workunit.client.1.smithi125.stdout:9/233: rename d8/d37 to d8/d15/d22/d4e 0 2024-02-19T19:12:10.452 INFO:tasks.workunit.client.1.smithi125.stdout:6/197: chown d6/db/df/d1b/f2e 25822 1 2024-02-19T19:12:10.452 INFO:tasks.workunit.client.1.smithi125.stdout:6/198: creat d6/db/df/d1b/d29/f32 x:0 0 0 2024-02-19T19:12:10.452 INFO:tasks.workunit.client.1.smithi125.stdout:9/234: mkdir d8/d15/d32/d4f 0 2024-02-19T19:12:10.453 INFO:tasks.workunit.client.1.smithi125.stdout:6/199: mknod d6/c33 0 2024-02-19T19:12:10.453 INFO:tasks.workunit.client.1.smithi125.stdout:3/240: write d0/de/f3d [515487,101904] 0 2024-02-19T19:12:10.453 INFO:tasks.workunit.client.1.smithi125.stdout:9/235: getdents d8/d15/d3c 0 2024-02-19T19:12:10.453 INFO:tasks.workunit.client.1.smithi125.stdout:3/241: creat d0/d1/f4d x:0 0 0 2024-02-19T19:12:10.454 INFO:tasks.workunit.client.1.smithi125.stdout:8/185: dwrite db/d18/f27 [688128,24576] 0 2024-02-19T19:12:10.454 INFO:tasks.workunit.client.1.smithi125.stdout:6/200: dwrite d6/db/df/f12 [552960,114688] 0 2024-02-19T19:12:10.454 INFO:tasks.workunit.client.1.smithi125.stdout:8/186: dwrite db/d18/f2a [1552384,4096] 0 2024-02-19T19:12:10.505 INFO:tasks.workunit.client.1.smithi125.stdout:5/382: fsync db/d17/d58/f72 0 2024-02-19T19:12:10.509 INFO:tasks.workunit.client.1.smithi125.stdout:8/187: readlink db/lf 0 2024-02-19T19:12:10.509 INFO:tasks.workunit.client.1.smithi125.stdout:8/188: mkdir db/d18/d2f/d3f 0 2024-02-19T19:12:10.510 INFO:tasks.workunit.client.1.smithi125.stdout:8/189: dread - db/d18/d2f/f39 zero size 2024-02-19T19:12:10.510 INFO:tasks.workunit.client.1.smithi125.stdout:8/190: link db/d18/l25 db/l40 0 2024-02-19T19:12:10.510 INFO:tasks.workunit.client.1.smithi125.stdout:8/191: creat db/f41 x:0 0 0 2024-02-19T19:12:10.510 INFO:tasks.workunit.client.1.smithi125.stdout:8/192: write db/d18/f21 [2891289,116984] 0 2024-02-19T19:12:10.511 INFO:tasks.workunit.client.1.smithi125.stdout:6/201: rename d6/db/df/d1b to d6/d34 0 2024-02-19T19:12:10.511 INFO:tasks.workunit.client.1.smithi125.stdout:6/202: write d6/db/df/d16/f2b [403774,49529] 0 2024-02-19T19:12:10.513 INFO:tasks.workunit.client.1.smithi125.stdout:5/383: read f6 [1472972,113864] 0 2024-02-19T19:12:10.513 INFO:tasks.workunit.client.1.smithi125.stdout:5/384: chown db/l38 2 1 2024-02-19T19:12:10.514 INFO:tasks.workunit.client.1.smithi125.stdout:5/385: rename db/d17/d58/d33/c46 to db/d17/c78 0 2024-02-19T19:12:10.522 INFO:tasks.workunit.client.1.smithi125.stdout:8/193: dread db/fc [131072,40960] 0 2024-02-19T19:12:10.570 INFO:tasks.workunit.client.1.smithi125.stdout:2/216: sync 2024-02-19T19:12:10.570 INFO:tasks.workunit.client.1.smithi125.stdout:6/203: truncate d6/f9 603176 0 2024-02-19T19:12:10.570 INFO:tasks.workunit.client.1.smithi125.stdout:2/217: dread d1/ff [1421312,28672] 0 2024-02-19T19:12:10.570 INFO:tasks.workunit.client.1.smithi125.stdout:6/204: rename l1 to d6/db/l35 0 2024-02-19T19:12:10.571 INFO:tasks.workunit.client.1.smithi125.stdout:6/205: creat d6/d34/f36 x:0 0 0 2024-02-19T19:12:10.571 INFO:tasks.workunit.client.1.smithi125.stdout:2/218: read d1/fd [460089,54245] 0 2024-02-19T19:12:10.571 INFO:tasks.workunit.client.1.smithi125.stdout:2/219: stat d1/d27/c14 0 2024-02-19T19:12:10.571 INFO:tasks.workunit.client.1.smithi125.stdout:6/206: creat d6/d34/d29/f37 x:0 0 0 2024-02-19T19:12:10.571 INFO:tasks.workunit.client.1.smithi125.stdout:6/207: read d6/db/df/f21 [59453,130763] 0 2024-02-19T19:12:10.571 INFO:tasks.workunit.client.1.smithi125.stdout:6/208: truncate d6/db/df/f12 1189931 0 2024-02-19T19:12:10.571 INFO:tasks.workunit.client.1.smithi125.stdout:6/209: creat d6/db/df/d16/f38 x:0 0 0 2024-02-19T19:12:10.571 INFO:tasks.workunit.client.1.smithi125.stdout:6/210: unlink d6/db/l31 0 2024-02-19T19:12:10.572 INFO:tasks.workunit.client.1.smithi125.stdout:6/211: dread - d6/db/df/d16/f38 zero size 2024-02-19T19:12:10.572 INFO:tasks.workunit.client.1.smithi125.stdout:8/194: dwrite db/d18/f2d [294912,12288] 0 2024-02-19T19:12:10.572 INFO:tasks.workunit.client.1.smithi125.stdout:8/195: write db/f36 [202568,122924] 0 2024-02-19T19:12:10.572 INFO:tasks.workunit.client.1.smithi125.stdout:8/196: rmdir db 39 2024-02-19T19:12:10.630 INFO:tasks.workunit.client.1.smithi125.stdout:5/386: fdatasync db/d17/f1e 0 2024-02-19T19:12:10.630 INFO:tasks.workunit.client.1.smithi125.stdout:5/387: mknod db/d17/d58/d25/c79 0 2024-02-19T19:12:10.630 INFO:tasks.workunit.client.1.smithi125.stdout:7/233: fdatasync d12/d25/d2a/d31/f32 0 2024-02-19T19:12:10.630 INFO:tasks.workunit.client.1.smithi125.stdout:6/212: fdatasync d6/db/df/f14 0 2024-02-19T19:12:10.640 INFO:tasks.workunit.client.1.smithi125.stdout:5/388: fsync db/d17/d58/d33/f3e 0 2024-02-19T19:12:10.642 INFO:tasks.workunit.client.1.smithi125.stdout:5/389: truncate db/d17/f45 1557256 0 2024-02-19T19:12:10.642 INFO:tasks.workunit.client.1.smithi125.stdout:2/220: dwrite d1/d27/f22 [3276800,86016] 0 2024-02-19T19:12:10.642 INFO:tasks.workunit.client.1.smithi125.stdout:5/390: read - db/d17/f57 zero size 2024-02-19T19:12:10.642 INFO:tasks.workunit.client.1.smithi125.stdout:6/213: symlink d6/d34/l39 0 2024-02-19T19:12:10.642 INFO:tasks.workunit.client.1.smithi125.stdout:5/391: write db/d17/d58/f3a [814085,9022] 0 2024-02-19T19:12:10.642 INFO:tasks.workunit.client.1.smithi125.stdout:5/392: link db/d47/d52/f5a db/d17/d58/d4f/f7a 0 2024-02-19T19:12:10.642 INFO:tasks.workunit.client.1.smithi125.stdout:7/234: write fa [1590719,117542] 0 2024-02-19T19:12:10.659 INFO:tasks.workunit.client.1.smithi125.stdout:5/393: dwrite db/d26/f77 [282624,106496] 0 2024-02-19T19:12:10.663 INFO:tasks.workunit.client.1.smithi125.stdout:6/214: mknod d6/d34/d29/c3a 0 2024-02-19T19:12:10.663 INFO:tasks.workunit.client.1.smithi125.stdout:2/221: symlink d1/d27/d1d/d25/l3f 0 2024-02-19T19:12:10.664 INFO:tasks.workunit.client.1.smithi125.stdout:6/215: mkdir d6/db/df/d3b 0 2024-02-19T19:12:10.664 INFO:tasks.workunit.client.1.smithi125.stdout:6/216: getdents d6 0 2024-02-19T19:12:10.664 INFO:tasks.workunit.client.1.smithi125.stdout:6/217: creat d6/db/df/d3b/f3c x:0 0 0 2024-02-19T19:12:10.664 INFO:tasks.workunit.client.1.smithi125.stdout:6/218: creat d6/db/f3d x:0 0 0 2024-02-19T19:12:10.664 INFO:tasks.workunit.client.1.smithi125.stdout:6/219: creat d6/db/f3e x:0 0 0 2024-02-19T19:12:10.664 INFO:tasks.workunit.client.1.smithi125.stdout:6/220: creat d6/d34/d29/f3f x:0 0 0 2024-02-19T19:12:10.664 INFO:tasks.workunit.client.1.smithi125.stdout:6/221: write d6/db/f17 [988215,91192] 0 2024-02-19T19:12:10.665 INFO:tasks.workunit.client.1.smithi125.stdout:6/222: rename d6/db/df/f27 to d6/d34/f40 0 2024-02-19T19:12:10.665 INFO:tasks.workunit.client.1.smithi125.stdout:6/223: mknod d6/db/df/c41 0 2024-02-19T19:12:10.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:10 smithi125 ceph-mon[86115]: pgmap v150: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 511 B/s wr, 4 op/s; 7 B/s, 0 objects/s recovering 2024-02-19T19:12:10.705 INFO:tasks.workunit.client.1.smithi125.stdout:9/236: fsync d8/d15/f2c 0 2024-02-19T19:12:10.710 INFO:tasks.workunit.client.1.smithi125.stdout:6/224: dwrite d6/db/f3e [1007616,4096] 0 2024-02-19T19:12:10.710 INFO:tasks.workunit.client.1.smithi125.stdout:2/222: dread d1/ff [3166208,118784] 0 2024-02-19T19:12:10.710 INFO:tasks.workunit.client.1.smithi125.stdout:5/394: dwrite db/d47/f5f [368640,20480] 0 2024-02-19T19:12:10.710 INFO:tasks.workunit.client.1.smithi125.stdout:6/225: dread - d6/d34/d29/f3f zero size 2024-02-19T19:12:10.711 INFO:tasks.workunit.client.1.smithi125.stdout:2/223: write d1/d27/f10 [1489947,20919] 0 2024-02-19T19:12:10.711 INFO:tasks.workunit.client.1.smithi125.stdout:5/395: creat db/d47/d52/d5d/f7b x:0 0 0 2024-02-19T19:12:10.711 INFO:tasks.workunit.client.1.smithi125.stdout:5/396: creat db/d26/d51/f7c x:0 0 0 2024-02-19T19:12:10.711 INFO:tasks.workunit.client.1.smithi125.stdout:5/397: write db/d17/f45 [1252401,41383] 0 2024-02-19T19:12:10.712 INFO:tasks.workunit.client.1.smithi125.stdout:5/398: dread db/d17/d58/f24 [2424832,110592] 0 2024-02-19T19:12:10.713 INFO:tasks.workunit.client.1.smithi125.stdout:2/224: rename d1/d27/d1d/d2c/d2e/d2f to d1/d27/d1d/d39/d40 0 2024-02-19T19:12:10.713 INFO:tasks.workunit.client.1.smithi125.stdout:9/237: rmdir d8/d15/d3c 0 2024-02-19T19:12:10.713 INFO:tasks.workunit.client.1.smithi125.stdout:9/238: creat d8/f50 x:0 0 0 2024-02-19T19:12:10.713 INFO:tasks.workunit.client.1.smithi125.stdout:5/399: creat db/d17/f7d x:0 0 0 2024-02-19T19:12:10.713 INFO:tasks.workunit.client.1.smithi125.stdout:5/400: rename db/d17/d58/d4f/f71 to db/d47/f7e 0 2024-02-19T19:12:10.713 INFO:tasks.workunit.client.1.smithi125.stdout:5/401: creat db/d26/d51/f7f x:0 0 0 2024-02-19T19:12:10.713 INFO:tasks.workunit.client.1.smithi125.stdout:5/402: creat db/d17/d58/d33/f80 x:0 0 0 2024-02-19T19:12:10.714 INFO:tasks.workunit.client.1.smithi125.stdout:9/239: read d8/f26 [189840,19004] 0 2024-02-19T19:12:10.714 INFO:tasks.workunit.client.1.smithi125.stdout:9/240: dread f2 [1470464,118784] 0 2024-02-19T19:12:10.714 INFO:tasks.workunit.client.1.smithi125.stdout:5/403: dwrite db/d17/f41 [167936,49152] 0 2024-02-19T19:12:10.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:10 smithi096 ceph-mon[112483]: pgmap v150: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 511 B/s wr, 4 op/s; 7 B/s, 0 objects/s recovering 2024-02-19T19:12:10.808 INFO:tasks.workunit.client.1.smithi125.stdout:1/257: sync 2024-02-19T19:12:10.808 INFO:tasks.workunit.client.1.smithi125.stdout:1/258: symlink d1/d26/d3c/l56 0 2024-02-19T19:12:10.808 INFO:tasks.workunit.client.1.smithi125.stdout:1/259: readlink d1/l13 0 2024-02-19T19:12:10.809 INFO:tasks.workunit.client.1.smithi125.stdout:5/404: dwrite db/d17/f43 [139264,28672] 0 2024-02-19T19:12:10.876 INFO:tasks.workunit.client.1.smithi125.stdout:9/241: fdatasync d8/d2e/f45 0 2024-02-19T19:12:10.876 INFO:tasks.workunit.client.1.smithi125.stdout:9/242: rename d8/d15/d22/l34 to d8/d2e/l51 0 2024-02-19T19:12:10.880 INFO:tasks.workunit.client.1.smithi125.stdout:1/260: dwrite d1/dc/d36/f54 [806912,57344] 0 2024-02-19T19:12:10.881 INFO:tasks.workunit.client.1.smithi125.stdout:9/243: write f2 [798466,72458] 0 2024-02-19T19:12:10.881 INFO:tasks.workunit.client.1.smithi125.stdout:1/261: truncate d1/d26/f40 1127577 0 2024-02-19T19:12:10.881 INFO:tasks.workunit.client.1.smithi125.stdout:9/244: read - d8/d15/d22/d4e/f47 zero size 2024-02-19T19:12:10.881 INFO:tasks.workunit.client.1.smithi125.stdout:9/245: chown d8/f1a 103426760 1 2024-02-19T19:12:10.881 INFO:tasks.workunit.client.1.smithi125.stdout:9/246: mknod d8/d15/c52 0 2024-02-19T19:12:10.881 INFO:tasks.workunit.client.1.smithi125.stdout:9/247: rename l4 to d8/d15/l53 0 2024-02-19T19:12:10.881 INFO:tasks.workunit.client.1.smithi125.stdout:9/248: write d8/d2e/f3d [1456632,109998] 0 2024-02-19T19:12:10.881 INFO:tasks.workunit.client.1.smithi125.stdout:9/249: creat d8/d15/d22/d4e/f54 x:0 0 0 2024-02-19T19:12:10.882 INFO:tasks.workunit.client.1.smithi125.stdout:9/250: creat d8/d15/d22/d4e/f55 x:0 0 0 2024-02-19T19:12:10.882 INFO:tasks.workunit.client.1.smithi125.stdout:4/243: sync 2024-02-19T19:12:10.882 INFO:tasks.workunit.client.1.smithi125.stdout:0/249: sync 2024-02-19T19:12:10.882 INFO:tasks.workunit.client.1.smithi125.stdout:3/242: sync 2024-02-19T19:12:10.882 INFO:tasks.workunit.client.1.smithi125.stdout:8/197: sync 2024-02-19T19:12:10.882 INFO:tasks.workunit.client.1.smithi125.stdout:3/243: stat d0/de/f28 0 2024-02-19T19:12:10.882 INFO:tasks.workunit.client.1.smithi125.stdout:8/198: dread - db/f41 zero size 2024-02-19T19:12:10.882 INFO:tasks.workunit.client.1.smithi125.stdout:4/244: truncate d0/f1b 833483 0 2024-02-19T19:12:10.882 INFO:tasks.workunit.client.1.smithi125.stdout:0/250: rename d5/cc to d5/d19/d48/c60 0 2024-02-19T19:12:10.883 INFO:tasks.workunit.client.1.smithi125.stdout:8/199: truncate db/f10 1394291 0 2024-02-19T19:12:10.883 INFO:tasks.workunit.client.1.smithi125.stdout:3/244: mknod d0/c4e 0 2024-02-19T19:12:10.883 INFO:tasks.workunit.client.1.smithi125.stdout:8/200: link db/d18/l33 db/d18/d2f/l42 0 2024-02-19T19:12:10.883 INFO:tasks.workunit.client.1.smithi125.stdout:0/251: creat d5/d33/d42/f61 x:0 0 0 2024-02-19T19:12:10.883 INFO:tasks.workunit.client.1.smithi125.stdout:3/245: creat d0/d1/d4b/f4f x:0 0 0 2024-02-19T19:12:10.883 INFO:tasks.workunit.client.1.smithi125.stdout:8/201: creat db/d18/d30/f43 x:0 0 0 2024-02-19T19:12:10.883 INFO:tasks.workunit.client.1.smithi125.stdout:3/246: creat d0/d1/d4b/f50 x:0 0 0 2024-02-19T19:12:10.883 INFO:tasks.workunit.client.1.smithi125.stdout:8/202: chown db/c13 231843 1 2024-02-19T19:12:10.884 INFO:tasks.workunit.client.1.smithi125.stdout:0/252: creat d5/d19/f62 x:0 0 0 2024-02-19T19:12:10.884 INFO:tasks.workunit.client.1.smithi125.stdout:3/247: creat d0/f51 x:0 0 0 2024-02-19T19:12:10.884 INFO:tasks.workunit.client.1.smithi125.stdout:3/248: chown d0/f51 232751 1 2024-02-19T19:12:10.884 INFO:tasks.workunit.client.1.smithi125.stdout:0/253: rmdir d5/d19/d27 39 2024-02-19T19:12:10.884 INFO:tasks.workunit.client.1.smithi125.stdout:8/203: link l8 db/d18/d2f/d3f/l44 0 2024-02-19T19:12:10.884 INFO:tasks.workunit.client.1.smithi125.stdout:3/249: mkdir d0/d1/d4b/d52 0 2024-02-19T19:12:10.884 INFO:tasks.workunit.client.1.smithi125.stdout:8/204: symlink db/l45 0 2024-02-19T19:12:10.885 INFO:tasks.workunit.client.1.smithi125.stdout:3/250: symlink d0/d1/d4b/d52/l53 0 2024-02-19T19:12:10.885 INFO:tasks.workunit.client.1.smithi125.stdout:8/205: link db/d18/f21 db/f46 0 2024-02-19T19:12:10.885 INFO:tasks.workunit.client.1.smithi125.stdout:3/251: truncate d0/f33 432183 0 2024-02-19T19:12:10.885 INFO:tasks.workunit.client.1.smithi125.stdout:8/206: mknod db/d18/d2f/d3f/c47 0 2024-02-19T19:12:10.885 INFO:tasks.workunit.client.1.smithi125.stdout:3/252: truncate d0/de/f1c 583282 0 2024-02-19T19:12:10.885 INFO:tasks.workunit.client.1.smithi125.stdout:3/253: dread - d0/d1/f4d zero size 2024-02-19T19:12:10.886 INFO:tasks.workunit.client.1.smithi125.stdout:5/405: dread db/d17/d58/f3a [151552,65536] 0 2024-02-19T19:12:10.886 INFO:tasks.workunit.client.1.smithi125.stdout:5/406: write db/d17/f7d [396710,68551] 0 2024-02-19T19:12:10.886 INFO:tasks.workunit.client.1.smithi125.stdout:5/407: creat db/d17/d58/f81 x:0 0 0 2024-02-19T19:12:10.886 INFO:tasks.workunit.client.1.smithi125.stdout:5/408: unlink db/d17/d58/d25/f39 0 2024-02-19T19:12:10.927 INFO:tasks.workunit.client.1.smithi125.stdout:5/409: dwrite db/d26/d51/f7f [0,118784] 0 2024-02-19T19:12:10.927 INFO:tasks.workunit.client.1.smithi125.stdout:5/410: truncate db/d17/f41 698201 0 2024-02-19T19:12:10.927 INFO:tasks.workunit.client.1.smithi125.stdout:1/262: dwrite d1/d1a/f2a [126976,40960] 0 2024-02-19T19:12:10.927 INFO:tasks.workunit.client.1.smithi125.stdout:5/411: creat db/d17/d58/d33/d64/f82 x:0 0 0 2024-02-19T19:12:10.927 INFO:tasks.workunit.client.1.smithi125.stdout:5/412: symlink db/d17/d58/l83 0 2024-02-19T19:12:10.927 INFO:tasks.workunit.client.1.smithi125.stdout:1/263: symlink d1/d26/d29/l57 0 2024-02-19T19:12:10.928 INFO:tasks.workunit.client.1.smithi125.stdout:5/413: creat db/d17/f84 x:0 0 0 2024-02-19T19:12:10.928 INFO:tasks.workunit.client.1.smithi125.stdout:1/264: mknod d1/d26/d3c/d3f/c58 0 2024-02-19T19:12:10.928 INFO:tasks.workunit.client.1.smithi125.stdout:5/414: write db/d17/f7d [339292,13273] 0 2024-02-19T19:12:10.928 INFO:tasks.workunit.client.1.smithi125.stdout:8/207: dwrite db/f41 [118784,81920] 0 2024-02-19T19:12:10.928 INFO:tasks.workunit.client.1.smithi125.stdout:5/415: chown db/d17/f55 602993730 1 2024-02-19T19:12:10.928 INFO:tasks.workunit.client.1.smithi125.stdout:5/416: mkdir db/d17/d85 0 2024-02-19T19:12:10.928 INFO:tasks.workunit.client.1.smithi125.stdout:8/208: mkdir db/d18/d30/d48 0 2024-02-19T19:12:10.928 INFO:tasks.workunit.client.1.smithi125.stdout:8/209: dread db/f41 [81920,4096] 0 2024-02-19T19:12:10.929 INFO:tasks.workunit.client.1.smithi125.stdout:8/210: truncate db/f36 405125 0 2024-02-19T19:12:10.929 INFO:tasks.workunit.client.1.smithi125.stdout:9/251: dwrite d8/d15/f1c [1884160,49152] 0 2024-02-19T19:12:10.929 INFO:tasks.workunit.client.1.smithi125.stdout:9/252: read d8/d15/d32/f2a [242836,11691] 0 2024-02-19T19:12:10.929 INFO:tasks.workunit.client.1.smithi125.stdout:9/253: link d8/fe d8/d15/d22/d4e/f56 0 2024-02-19T19:12:10.929 INFO:tasks.workunit.client.1.smithi125.stdout:9/254: dread d8/d15/d22/d4e/f3b [1953792,12288] 0 2024-02-19T19:12:10.929 INFO:tasks.workunit.client.1.smithi125.stdout:3/254: dwrite d0/de/f28 [491520,110592] 0 2024-02-19T19:12:10.929 INFO:tasks.workunit.client.1.smithi125.stdout:3/255: rename d0/d1/d1e/f35 to d0/d1/d4b/d52/f54 0 2024-02-19T19:12:10.929 INFO:tasks.workunit.client.1.smithi125.stdout:3/256: stat d0/f24 0 2024-02-19T19:12:10.929 INFO:tasks.workunit.client.1.smithi125.stdout:0/254: dread d5/d1a/d4c/f5d [126976,32768] 0 2024-02-19T19:12:10.930 INFO:tasks.workunit.client.1.smithi125.stdout:0/255: write d5/f8 [797657,18738] 0 2024-02-19T19:12:10.930 INFO:tasks.workunit.client.1.smithi125.stdout:0/256: dread d5/d15/f52 [69632,90112] 0 2024-02-19T19:12:10.987 INFO:tasks.workunit.client.1.smithi125.stdout:5/417: dread db/d17/f43 [1257472,106496] 0 2024-02-19T19:12:10.990 INFO:tasks.workunit.client.1.smithi125.stdout:1/265: dwrite d1/dc/d36/f54 [1003520,69632] 0 2024-02-19T19:12:10.990 INFO:tasks.workunit.client.1.smithi125.stdout:1/266: symlink d1/l59 0 2024-02-19T19:12:10.990 INFO:tasks.workunit.client.1.smithi125.stdout:1/267: stat d1/d26/d23/l2b 0 2024-02-19T19:12:10.991 INFO:tasks.workunit.client.1.smithi125.stdout:1/268: truncate d1/dc/f52 565371 0 2024-02-19T19:12:10.991 INFO:tasks.workunit.client.1.smithi125.stdout:1/269: mknod d1/d26/d23/c5a 0 2024-02-19T19:12:10.991 INFO:tasks.workunit.client.1.smithi125.stdout:1/270: mkdir d1/d1a/d5b 0 2024-02-19T19:12:10.991 INFO:tasks.workunit.client.1.smithi125.stdout:1/271: write d1/dc/f1b [2074850,45112] 0 2024-02-19T19:12:10.991 INFO:tasks.workunit.client.1.smithi125.stdout:1/272: rmdir d1/d1a/d5b 0 2024-02-19T19:12:10.991 INFO:tasks.workunit.client.1.smithi125.stdout:1/273: creat d1/d26/d23/f5c x:0 0 0 2024-02-19T19:12:10.991 INFO:tasks.workunit.client.1.smithi125.stdout:1/274: write d1/d26/d3c/d3f/f48 [192568,58124] 0 2024-02-19T19:12:10.991 INFO:tasks.workunit.client.1.smithi125.stdout:1/275: dread d1/d26/f40 [999424,8192] 0 2024-02-19T19:12:10.991 INFO:tasks.workunit.client.1.smithi125.stdout:1/276: rmdir d1/d26/d3c 39 2024-02-19T19:12:10.992 INFO:tasks.workunit.client.1.smithi125.stdout:1/277: creat d1/d26/d29/f5d x:0 0 0 2024-02-19T19:12:10.992 INFO:tasks.workunit.client.1.smithi125.stdout:1/278: getdents d1/d26/d29 0 2024-02-19T19:12:10.992 INFO:tasks.workunit.client.1.smithi125.stdout:1/279: truncate d1/d1a/f50 859673 0 2024-02-19T19:12:10.992 INFO:tasks.workunit.client.1.smithi125.stdout:1/280: rmdir d1/d26/d23 39 2024-02-19T19:12:10.992 INFO:tasks.workunit.client.1.smithi125.stdout:1/281: rename d1/d1a/c1c to d1/d1a/c5e 0 2024-02-19T19:12:10.992 INFO:tasks.workunit.client.1.smithi125.stdout:8/211: dwrite db/f46 [3010560,77824] 0 2024-02-19T19:12:10.992 INFO:tasks.workunit.client.1.smithi125.stdout:0/257: dwrite d5/d33/d42/f61 [835584,4096] 0 2024-02-19T19:12:10.992 INFO:tasks.workunit.client.1.smithi125.stdout:0/258: creat d5/d19/d4a/f63 x:0 0 0 2024-02-19T19:12:10.992 INFO:tasks.workunit.client.1.smithi125.stdout:0/259: chown d5/d33/d46/f4b 7354 1 2024-02-19T19:12:11.040 INFO:tasks.workunit.client.1.smithi125.stdout:9/255: fdatasync d8/d15/d22/d4e/f56 0 2024-02-19T19:12:11.040 INFO:tasks.workunit.client.1.smithi125.stdout:8/212: fsync f4 0 2024-02-19T19:12:11.041 INFO:tasks.workunit.client.1.smithi125.stdout:8/213: chown db/l40 5 1 2024-02-19T19:12:11.043 INFO:tasks.workunit.client.1.smithi125.stdout:8/214: dread db/f26 [118784,49152] 0 2024-02-19T19:12:11.044 INFO:tasks.workunit.client.1.smithi125.stdout:6/226: sync 2024-02-19T19:12:11.044 INFO:tasks.workunit.client.1.smithi125.stdout:2/225: sync 2024-02-19T19:12:11.044 INFO:tasks.workunit.client.1.smithi125.stdout:7/235: sync 2024-02-19T19:12:11.044 INFO:tasks.workunit.client.1.smithi125.stdout:6/227: chown d6/db/df/l30 51 1 2024-02-19T19:12:11.044 INFO:tasks.workunit.client.1.smithi125.stdout:7/236: creat d12/d18/d2c/f42 x:0 0 0 2024-02-19T19:12:11.045 INFO:tasks.workunit.client.1.smithi125.stdout:6/228: mknod d6/db/df/d16/c42 0 2024-02-19T19:12:11.045 INFO:tasks.workunit.client.1.smithi125.stdout:6/229: chown d6/l13 225 1 2024-02-19T19:12:11.045 INFO:tasks.workunit.client.1.smithi125.stdout:7/237: readlink d12/d25/d2a/l2b 0 2024-02-19T19:12:11.045 INFO:tasks.workunit.client.1.smithi125.stdout:7/238: chown d12/d18/f1e 13611664 1 2024-02-19T19:12:11.047 INFO:tasks.workunit.client.1.smithi125.stdout:5/418: dwrite db/d17/d58/d4f/f7a [2035712,81920] 0 2024-02-19T19:12:11.047 INFO:tasks.workunit.client.1.smithi125.stdout:8/215: creat db/d18/d30/d48/f49 x:0 0 0 2024-02-19T19:12:11.047 INFO:tasks.workunit.client.1.smithi125.stdout:7/239: getdents d12/d25 0 2024-02-19T19:12:11.047 INFO:tasks.workunit.client.1.smithi125.stdout:9/256: rename d8/d15/d22/d4e/c3e to d8/d15/d22/c57 0 2024-02-19T19:12:11.047 INFO:tasks.workunit.client.1.smithi125.stdout:8/216: stat db/d18/d30/d48 0 2024-02-19T19:12:11.048 INFO:tasks.workunit.client.1.smithi125.stdout:2/226: creat d1/d27/d1d/d25/d2a/f41 x:0 0 0 2024-02-19T19:12:11.048 INFO:tasks.workunit.client.1.smithi125.stdout:5/419: chown db/d17/d58/d33/d64 0 1 2024-02-19T19:12:11.048 INFO:tasks.workunit.client.1.smithi125.stdout:8/217: rename db/d18/d2f/d3f to db/d18/d2f/d3f/d4a 22 2024-02-19T19:12:11.048 INFO:tasks.workunit.client.1.smithi125.stdout:5/420: rename db/d17/d58/d25/l60 to db/d26/d51/l86 0 2024-02-19T19:12:11.048 INFO:tasks.workunit.client.1.smithi125.stdout:9/257: creat d8/d15/d22/d4e/f58 x:0 0 0 2024-02-19T19:12:11.048 INFO:tasks.workunit.client.1.smithi125.stdout:2/227: creat d1/d27/d1d/d39/d40/f42 x:0 0 0 2024-02-19T19:12:11.048 INFO:tasks.workunit.client.1.smithi125.stdout:2/228: chown d1/d27/c1f 393796 1 2024-02-19T19:12:11.048 INFO:tasks.workunit.client.1.smithi125.stdout:6/230: rename d6/l18 to d6/d34/l43 0 2024-02-19T19:12:11.049 INFO:tasks.workunit.client.1.smithi125.stdout:7/240: write d12/d25/d26/d30/f35 [195769,33748] 0 2024-02-19T19:12:11.049 INFO:tasks.workunit.client.1.smithi125.stdout:7/241: chown cd 119525971 1 2024-02-19T19:12:11.049 INFO:tasks.workunit.client.1.smithi125.stdout:6/231: read - d6/d34/d29/f3f zero size 2024-02-19T19:12:11.049 INFO:tasks.workunit.client.1.smithi125.stdout:7/242: chown d12/d27/c29 7666 1 2024-02-19T19:12:11.049 INFO:tasks.workunit.client.1.smithi125.stdout:5/421: rename db/d17/d58/l4c to db/d17/d58/d33/d53/l87 0 2024-02-19T19:12:11.049 INFO:tasks.workunit.client.1.smithi125.stdout:7/243: chown d12/d25/d26/f3a 3950895 1 2024-02-19T19:12:11.049 INFO:tasks.workunit.client.1.smithi125.stdout:7/244: chown f1 1746084312 1 2024-02-19T19:12:11.049 INFO:tasks.workunit.client.1.smithi125.stdout:9/258: rename d8/d15/d32/f49 to d8/d15/d32/d4f/f59 0 2024-02-19T19:12:11.049 INFO:tasks.workunit.client.1.smithi125.stdout:9/259: rename d8/d15 to d8/d15/d22/d5a 22 2024-02-19T19:12:11.050 INFO:tasks.workunit.client.1.smithi125.stdout:6/232: symlink d6/d34/d2f/l44 0 2024-02-19T19:12:11.050 INFO:tasks.workunit.client.1.smithi125.stdout:9/260: rename d8/d15/d22/c2f to d8/d15/d32/c5b 0 2024-02-19T19:12:11.050 INFO:tasks.workunit.client.1.smithi125.stdout:6/233: dread - d6/d34/f2e zero size 2024-02-19T19:12:11.050 INFO:tasks.workunit.client.1.smithi125.stdout:9/261: chown d8/d15/d22/d4e/f54 11303648 1 2024-02-19T19:12:11.050 INFO:tasks.workunit.client.1.smithi125.stdout:7/245: read d12/d18/f1e [159260,103703] 0 2024-02-19T19:12:11.050 INFO:tasks.workunit.client.1.smithi125.stdout:9/262: read d8/d15/d32/f30 [149415,48039] 0 2024-02-19T19:12:11.050 INFO:tasks.workunit.client.1.smithi125.stdout:9/263: chown d8/f28 253 1 2024-02-19T19:12:11.050 INFO:tasks.workunit.client.1.smithi125.stdout:6/234: mkdir d6/d34/d2f/d45 0 2024-02-19T19:12:11.050 INFO:tasks.workunit.client.1.smithi125.stdout:9/264: getdents d8 0 2024-02-19T19:12:11.051 INFO:tasks.workunit.client.1.smithi125.stdout:6/235: getdents d6/d34/d2f 0 2024-02-19T19:12:11.051 INFO:tasks.workunit.client.1.smithi125.stdout:5/422: mknod db/d17/d58/d33/d53/c88 0 2024-02-19T19:12:11.051 INFO:tasks.workunit.client.1.smithi125.stdout:5/423: chown db/d17/d58/d33/d53 51202711 1 2024-02-19T19:12:11.051 INFO:tasks.workunit.client.1.smithi125.stdout:6/236: chown d6/db/df/d16/f38 1 1 2024-02-19T19:12:11.051 INFO:tasks.workunit.client.1.smithi125.stdout:6/237: unlink d6/l13 0 2024-02-19T19:12:11.051 INFO:tasks.workunit.client.1.smithi125.stdout:6/238: unlink d6/d34/l43 0 2024-02-19T19:12:11.051 INFO:tasks.workunit.client.1.smithi125.stdout:9/265: write d8/d15/d22/d4e/f47 [52851,54378] 0 2024-02-19T19:12:11.051 INFO:tasks.workunit.client.1.smithi125.stdout:6/239: symlink d6/d34/d2f/l46 0 2024-02-19T19:12:11.085 INFO:tasks.workunit.client.1.smithi125.stdout:6/240: dwrite d6/d34/f2a [4096,110592] 0 2024-02-19T19:12:11.086 INFO:tasks.workunit.client.1.smithi125.stdout:7/246: dwrite f5 [1110016,94208] 0 2024-02-19T19:12:11.086 INFO:tasks.workunit.client.1.smithi125.stdout:9/266: dwrite d8/d2e/f4b [364544,8192] 0 2024-02-19T19:12:11.086 INFO:tasks.workunit.client.1.smithi125.stdout:9/267: symlink d8/l5c 0 2024-02-19T19:12:11.086 INFO:tasks.workunit.client.1.smithi125.stdout:9/268: creat d8/d15/d32/f5d x:0 0 0 2024-02-19T19:12:11.086 INFO:tasks.workunit.client.1.smithi125.stdout:9/269: dread d8/f43 [831488,90112] 0 2024-02-19T19:12:11.086 INFO:tasks.workunit.client.1.smithi125.stdout:9/270: dread d8/d2e/f4b [200704,118784] 0 2024-02-19T19:12:11.086 INFO:tasks.workunit.client.1.smithi125.stdout:9/271: creat d8/d15/d32/d4f/f5e x:0 0 0 2024-02-19T19:12:11.086 INFO:tasks.workunit.client.1.smithi125.stdout:9/272: chown d8/d2e/f4b 42195312 1 2024-02-19T19:12:11.135 INFO:tasks.workunit.client.1.smithi125.stdout:5/424: fdatasync db/d17/d58/d33/d64/f70 0 2024-02-19T19:12:11.135 INFO:tasks.workunit.client.1.smithi125.stdout:1/282: fsync d1/d1a/f50 0 2024-02-19T19:12:11.135 INFO:tasks.workunit.client.1.smithi125.stdout:5/425: creat db/d17/d58/d25/f89 x:0 0 0 2024-02-19T19:12:11.135 INFO:tasks.workunit.client.1.smithi125.stdout:1/283: link d1/d26/f3b d1/dc/d36/d39/f5f 0 2024-02-19T19:12:11.136 INFO:tasks.workunit.client.1.smithi125.stdout:5/426: mknod db/d47/d52/c8a 0 2024-02-19T19:12:11.136 INFO:tasks.workunit.client.1.smithi125.stdout:6/241: fsync d6/f1e 0 2024-02-19T19:12:11.136 INFO:tasks.workunit.client.1.smithi125.stdout:7/247: fdatasync d12/d25/d2a/d31/f36 0 2024-02-19T19:12:11.136 INFO:tasks.workunit.client.1.smithi125.stdout:5/427: truncate db/d47/f6a 576606 0 2024-02-19T19:12:11.137 INFO:tasks.workunit.client.1.smithi125.stdout:9/273: dwrite d8/f50 [462848,69632] 0 2024-02-19T19:12:11.137 INFO:tasks.workunit.client.1.smithi125.stdout:9/274: dread - d8/d15/d32/f3f zero size 2024-02-19T19:12:11.137 INFO:tasks.workunit.client.1.smithi125.stdout:7/248: unlink d12/d25/d2a/d31/f32 0 2024-02-19T19:12:11.137 INFO:tasks.workunit.client.1.smithi125.stdout:6/242: truncate d6/db/f11 645078 0 2024-02-19T19:12:11.138 INFO:tasks.workunit.client.1.smithi125.stdout:7/249: write d12/d18/f20 [823074,13010] 0 2024-02-19T19:12:11.138 INFO:tasks.workunit.client.1.smithi125.stdout:5/428: dwrite db/d17/d58/f3a [655360,40960] 0 2024-02-19T19:12:11.138 INFO:tasks.workunit.client.1.smithi125.stdout:5/429: mknod db/d17/d58/d33/d64/c8b 0 2024-02-19T19:12:11.148 INFO:tasks.workunit.client.1.smithi125.stdout:1/284: write d1/dc/fd [66501,67940] 0 2024-02-19T19:12:11.148 INFO:tasks.workunit.client.1.smithi125.stdout:1/285: dread d1/dc/d36/d39/f3a [1019904,81920] 0 2024-02-19T19:12:11.148 INFO:tasks.workunit.client.1.smithi125.stdout:1/286: stat d1/dc/d36/d39 0 2024-02-19T19:12:11.170 INFO:tasks.workunit.client.1.smithi125.stdout:1/287: dwrite d1/dc/f17 [1093632,49152] 0 2024-02-19T19:12:11.170 INFO:tasks.workunit.client.1.smithi125.stdout:1/288: mknod d1/d1a/c60 0 2024-02-19T19:12:11.170 INFO:tasks.workunit.client.1.smithi125.stdout:1/289: stat d1/d1a/f50 0 2024-02-19T19:12:11.170 INFO:tasks.workunit.client.1.smithi125.stdout:1/290: creat d1/d1a/d3d/f61 x:0 0 0 2024-02-19T19:12:11.170 INFO:tasks.workunit.client.1.smithi125.stdout:1/291: mknod d1/d1a/d3d/c62 0 2024-02-19T19:12:11.170 INFO:tasks.workunit.client.1.smithi125.stdout:1/292: rename d1/l13 to d1/dc/d36/d41/d4b/l63 0 2024-02-19T19:12:11.170 INFO:tasks.workunit.client.1.smithi125.stdout:1/293: creat d1/d26/d3c/f64 x:0 0 0 2024-02-19T19:12:11.170 INFO:tasks.workunit.client.1.smithi125.stdout:1/294: mkdir d1/d26/d23/d65 0 2024-02-19T19:12:11.171 INFO:tasks.workunit.client.1.smithi125.stdout:1/295: creat d1/dc/d36/f66 x:0 0 0 2024-02-19T19:12:11.178 INFO:tasks.workunit.client.1.smithi125.stdout:6/243: dread d6/f9 [8192,98304] 0 2024-02-19T19:12:11.186 INFO:tasks.workunit.client.1.smithi125.stdout:9/275: dread d8/d2e/f3d [876544,4096] 0 2024-02-19T19:12:11.205 INFO:tasks.workunit.client.1.smithi125.stdout:7/250: fsync d12/d18/f23 0 2024-02-19T19:12:11.205 INFO:tasks.workunit.client.1.smithi125.stdout:5/430: fdatasync db/f75 0 2024-02-19T19:12:11.205 INFO:tasks.workunit.client.1.smithi125.stdout:7/251: dread d12/d18/f23 [237568,81920] 0 2024-02-19T19:12:11.205 INFO:tasks.workunit.client.1.smithi125.stdout:2/229: fdatasync d1/d27/d1d/d39/d40/f42 0 2024-02-19T19:12:11.205 INFO:tasks.workunit.client.1.smithi125.stdout:8/218: fsync db/f26 0 2024-02-19T19:12:11.206 INFO:tasks.workunit.client.1.smithi125.stdout:7/252: creat d12/d25/d26/f43 x:0 0 0 2024-02-19T19:12:11.206 INFO:tasks.workunit.client.1.smithi125.stdout:7/253: dread d12/d18/f23 [413696,4096] 0 2024-02-19T19:12:11.206 INFO:tasks.workunit.client.1.smithi125.stdout:7/254: truncate d12/d18/f1e 1241728 0 2024-02-19T19:12:11.206 INFO:tasks.workunit.client.1.smithi125.stdout:2/230: mknod d1/d27/d1d/d25/d2a/c43 0 2024-02-19T19:12:11.206 INFO:tasks.workunit.client.1.smithi125.stdout:7/255: truncate fa 1357816 0 2024-02-19T19:12:11.206 INFO:tasks.workunit.client.1.smithi125.stdout:1/296: fdatasync d1/dc/f2c 0 2024-02-19T19:12:11.206 INFO:tasks.workunit.client.1.smithi125.stdout:6/244: dwrite d6/d34/f36 [1032192,98304] 0 2024-02-19T19:12:11.211 INFO:tasks.workunit.client.1.smithi125.stdout:5/431: dwrite db/d17/f45 [2895872,126976] 0 2024-02-19T19:12:11.212 INFO:tasks.workunit.client.1.smithi125.stdout:5/432: chown db/d17/d58/d33/f3e 3 1 2024-02-19T19:12:11.212 INFO:tasks.workunit.client.1.smithi125.stdout:5/433: write db/d17/d58/d4f/f56 [956756,39541] 0 2024-02-19T19:12:11.212 INFO:tasks.workunit.client.1.smithi125.stdout:9/276: dwrite d8/d15/d22/f24 [65536,94208] 0 2024-02-19T19:12:11.212 INFO:tasks.workunit.client.1.smithi125.stdout:9/277: read d8/d15/d32/f2a [694763,112721] 0 2024-02-19T19:12:11.212 INFO:tasks.workunit.client.1.smithi125.stdout:9/278: rmdir d8/d15/d22/d4e 39 2024-02-19T19:12:11.212 INFO:tasks.workunit.client.1.smithi125.stdout:9/279: chown d8/d15/d32/c5b 9890313 1 2024-02-19T19:12:11.212 INFO:tasks.workunit.client.1.smithi125.stdout:9/280: creat d8/d2e/d4c/f5f x:0 0 0 2024-02-19T19:12:11.213 INFO:tasks.workunit.client.1.smithi125.stdout:8/219: dwrite db/f26 [598016,45056] 0 2024-02-19T19:12:11.213 INFO:tasks.workunit.client.1.smithi125.stdout:8/220: truncate db/f46 1779124 0 2024-02-19T19:12:11.213 INFO:tasks.workunit.client.1.smithi125.stdout:8/221: chown db/c12 1280 1 2024-02-19T19:12:11.213 INFO:tasks.workunit.client.1.smithi125.stdout:2/231: getdents d1/d27/d1d/d25 0 2024-02-19T19:12:11.213 INFO:tasks.workunit.client.1.smithi125.stdout:8/222: rmdir db/d18/d30 39 2024-02-19T19:12:11.213 INFO:tasks.workunit.client.1.smithi125.stdout:2/232: dread - d1/d27/d1d/d25/f2d zero size 2024-02-19T19:12:11.213 INFO:tasks.workunit.client.1.smithi125.stdout:8/223: write db/f41 [1198302,5616] 0 2024-02-19T19:12:11.213 INFO:tasks.workunit.client.1.smithi125.stdout:9/281: symlink d8/d2e/l60 0 2024-02-19T19:12:11.213 INFO:tasks.workunit.client.1.smithi125.stdout:5/434: mknod db/d17/d58/d25/d40/c8c 0 2024-02-19T19:12:11.213 INFO:tasks.workunit.client.1.smithi125.stdout:9/282: read - d8/d15/d22/d4e/f54 zero size 2024-02-19T19:12:11.214 INFO:tasks.workunit.client.1.smithi125.stdout:5/435: readlink db/l35 0 2024-02-19T19:12:11.214 INFO:tasks.workunit.client.1.smithi125.stdout:5/436: getdents db 0 2024-02-19T19:12:11.214 INFO:tasks.workunit.client.1.smithi125.stdout:1/297: symlink d1/dc/d36/d41/l67 0 2024-02-19T19:12:11.214 INFO:tasks.workunit.client.1.smithi125.stdout:2/233: dread d1/d27/d1d/d2c/f31 [1097728,77824] 0 2024-02-19T19:12:11.214 INFO:tasks.workunit.client.1.smithi125.stdout:2/234: rmdir d1/d27/d1d/d39/d40 39 2024-02-19T19:12:11.214 INFO:tasks.workunit.client.1.smithi125.stdout:2/235: stat d1/d27 0 2024-02-19T19:12:11.214 INFO:tasks.workunit.client.1.smithi125.stdout:2/236: creat d1/d27/f44 x:0 0 0 2024-02-19T19:12:11.214 INFO:tasks.workunit.client.1.smithi125.stdout:2/237: mkdir d1/d27/d45 0 2024-02-19T19:12:11.214 INFO:tasks.workunit.client.1.smithi125.stdout:7/256: getdents d12/d25/d26/d30/d37 0 2024-02-19T19:12:11.215 INFO:tasks.workunit.client.1.smithi125.stdout:7/257: chown f8 17944 1 2024-02-19T19:12:11.215 INFO:tasks.workunit.client.1.smithi125.stdout:7/258: rename d12/d27 to d12/d18/d44 0 2024-02-19T19:12:11.215 INFO:tasks.workunit.client.1.smithi125.stdout:7/259: creat d12/f45 x:0 0 0 2024-02-19T19:12:11.215 INFO:tasks.workunit.client.1.smithi125.stdout:6/245: link d6/d34/d2f/l44 d6/d34/d2f/l47 0 2024-02-19T19:12:11.215 INFO:tasks.workunit.client.1.smithi125.stdout:2/238: readlink d1/d27/d1d/d25/l3f 0 2024-02-19T19:12:11.215 INFO:tasks.workunit.client.1.smithi125.stdout:6/246: chown d6/db/df/d16 26 1 2024-02-19T19:12:11.215 INFO:tasks.workunit.client.1.smithi125.stdout:2/239: read d1/d27/d1d/d25/d2a/f34 [676442,30821] 0 2024-02-19T19:12:11.215 INFO:tasks.workunit.client.1.smithi125.stdout:6/247: unlink d6/d34/d2f/l46 0 2024-02-19T19:12:11.215 INFO:tasks.workunit.client.1.smithi125.stdout:7/260: write d12/d25/d2a/d31/f36 [781533,113401] 0 2024-02-19T19:12:11.215 INFO:tasks.workunit.client.1.smithi125.stdout:2/240: dread d1/d27/d1d/d25/d2a/f34 [663552,8192] 0 2024-02-19T19:12:11.216 INFO:tasks.workunit.client.1.smithi125.stdout:6/248: rmdir d6/db/df 39 2024-02-19T19:12:11.216 INFO:tasks.workunit.client.1.smithi125.stdout:2/241: readlink d1/d27/d1d/d25/l32 0 2024-02-19T19:12:11.216 INFO:tasks.workunit.client.1.smithi125.stdout:6/249: read d6/db/f17 [237496,68813] 0 2024-02-19T19:12:11.216 INFO:tasks.workunit.client.1.smithi125.stdout:6/250: rename d6/d34/d29/f37 to d6/d34/d2f/f48 0 2024-02-19T19:12:11.216 INFO:tasks.workunit.client.1.smithi125.stdout:2/242: write d1/d27/f10 [995683,52110] 0 2024-02-19T19:12:11.216 INFO:tasks.workunit.client.1.smithi125.stdout:2/243: readlink d1/l18 0 2024-02-19T19:12:11.216 INFO:tasks.workunit.client.1.smithi125.stdout:6/251: write d6/d34/f24 [827354,71405] 0 2024-02-19T19:12:11.216 INFO:tasks.workunit.client.1.smithi125.stdout:2/244: write d1/d27/d1d/d25/f38 [531566,73521] 0 2024-02-19T19:12:11.217 INFO:tasks.workunit.client.1.smithi125.stdout:2/245: symlink d1/d27/d1d/d25/d2a/l46 0 2024-02-19T19:12:11.217 INFO:tasks.workunit.client.1.smithi125.stdout:2/246: chown d1/d27/f44 1589 1 2024-02-19T19:12:11.217 INFO:tasks.workunit.client.1.smithi125.stdout:2/247: creat d1/f47 x:0 0 0 2024-02-19T19:12:11.217 INFO:tasks.workunit.client.1.smithi125.stdout:1/298: dwrite d1/f47 [1376256,16384] 0 2024-02-19T19:12:11.217 INFO:tasks.workunit.client.1.smithi125.stdout:1/299: dread - d1/d26/d3c/f64 zero size 2024-02-19T19:12:11.217 INFO:tasks.workunit.client.1.smithi125.stdout:1/300: stat d1 0 2024-02-19T19:12:11.291 INFO:tasks.workunit.client.1.smithi125.stdout:5/437: fsync db/d17/d58/d25/d40/f66 0 2024-02-19T19:12:11.291 INFO:tasks.workunit.client.1.smithi125.stdout:6/252: fdatasync d6/db/f17 0 2024-02-19T19:12:11.295 INFO:tasks.workunit.client.1.smithi125.stdout:8/224: dwrite db/f1e [409600,28672] 0 2024-02-19T19:12:11.295 INFO:tasks.workunit.client.1.smithi125.stdout:9/283: creat d8/d15/f61 x:0 0 0 2024-02-19T19:12:11.295 INFO:tasks.workunit.client.1.smithi125.stdout:8/225: readlink db/l2e 0 2024-02-19T19:12:11.296 INFO:tasks.workunit.client.1.smithi125.stdout:5/438: unlink db/d17/f43 0 2024-02-19T19:12:11.296 INFO:tasks.workunit.client.1.smithi125.stdout:9/284: mknod d8/d2e/c62 0 2024-02-19T19:12:11.296 INFO:tasks.workunit.client.1.smithi125.stdout:1/301: write d1/d26/d23/f5c [36329,67828] 0 2024-02-19T19:12:11.296 INFO:tasks.workunit.client.1.smithi125.stdout:5/439: symlink db/d26/l8d 0 2024-02-19T19:12:11.296 INFO:tasks.workunit.client.1.smithi125.stdout:5/440: creat db/d17/d58/d25/d40/f8e x:0 0 0 2024-02-19T19:12:11.296 INFO:tasks.workunit.client.1.smithi125.stdout:1/302: write d1/d1a/f2a [862108,99526] 0 2024-02-19T19:12:11.296 INFO:tasks.workunit.client.1.smithi125.stdout:1/303: unlink d1/dc/d36/d39/f53 0 2024-02-19T19:12:11.299 INFO:tasks.workunit.client.1.smithi125.stdout:6/253: dwrite d6/f9 [696320,28672] 0 2024-02-19T19:12:11.300 INFO:tasks.workunit.client.1.smithi125.stdout:6/254: write d6/d34/d2f/f48 [191273,17203] 0 2024-02-19T19:12:11.300 INFO:tasks.workunit.client.1.smithi125.stdout:6/255: chown d6/db/df/d16/c1a 29 1 2024-02-19T19:12:11.300 INFO:tasks.workunit.client.1.smithi125.stdout:6/256: unlink d6/d34/d29/f32 0 2024-02-19T19:12:11.300 INFO:tasks.workunit.client.1.smithi125.stdout:6/257: mkdir d6/db/d49 0 2024-02-19T19:12:11.300 INFO:tasks.workunit.client.1.smithi125.stdout:6/258: dread d6/db/f11 [577536,110592] 0 2024-02-19T19:12:11.300 INFO:tasks.workunit.client.1.smithi125.stdout:2/248: dwrite d1/d27/f11 [1196032,114688] 0 2024-02-19T19:12:11.300 INFO:tasks.workunit.client.1.smithi125.stdout:8/226: dwrite db/d18/d30/d48/f49 [229376,20480] 0 2024-02-19T19:12:11.301 INFO:tasks.workunit.client.1.smithi125.stdout:2/249: dread d1/d27/d1d/f24 [2146304,16384] 0 2024-02-19T19:12:11.301 INFO:tasks.workunit.client.1.smithi125.stdout:2/250: write d1/d27/f11 [33034,71] 0 2024-02-19T19:12:11.301 INFO:tasks.workunit.client.1.smithi125.stdout:2/251: stat d1/l18 0 2024-02-19T19:12:11.301 INFO:tasks.workunit.client.1.smithi125.stdout:2/252: creat d1/d27/d1d/d39/f48 x:0 0 0 2024-02-19T19:12:11.301 INFO:tasks.workunit.client.1.smithi125.stdout:5/441: dwrite db/f69 [28672,53248] 0 2024-02-19T19:12:11.301 INFO:tasks.workunit.client.1.smithi125.stdout:5/442: chown db/d26/d51/l5c 1 1 2024-02-19T19:12:11.301 INFO:tasks.workunit.client.1.smithi125.stdout:2/253: read d1/fd [572206,42824] 0 2024-02-19T19:12:11.301 INFO:tasks.workunit.client.1.smithi125.stdout:5/443: dread - db/d17/f84 zero size 2024-02-19T19:12:11.301 INFO:tasks.workunit.client.1.smithi125.stdout:2/254: chown d1/d27/cb 13939 1 2024-02-19T19:12:11.302 INFO:tasks.workunit.client.1.smithi125.stdout:5/444: unlink db/d26/d51/f7f 0 2024-02-19T19:12:11.302 INFO:tasks.workunit.client.1.smithi125.stdout:5/445: creat db/d17/d58/d33/d53/f8f x:0 0 0 2024-02-19T19:12:11.302 INFO:tasks.workunit.client.1.smithi125.stdout:5/446: creat db/d26/f90 x:0 0 0 2024-02-19T19:12:11.302 INFO:tasks.workunit.client.1.smithi125.stdout:2/255: write d1/f47 [655840,76518] 0 2024-02-19T19:12:11.302 INFO:tasks.workunit.client.1.smithi125.stdout:2/256: read - d1/d27/f44 zero size 2024-02-19T19:12:11.302 INFO:tasks.workunit.client.1.smithi125.stdout:2/257: creat d1/d27/d1d/d39/d40/f49 x:0 0 0 2024-02-19T19:12:11.302 INFO:tasks.workunit.client.1.smithi125.stdout:5/447: mkdir db/d17/d58/d33/d91 0 2024-02-19T19:12:11.302 INFO:tasks.workunit.client.1.smithi125.stdout:2/258: rename d1/d27/d1d/d16/l1a to d1/d36/l4a 0 2024-02-19T19:12:11.303 INFO:tasks.workunit.client.1.smithi125.stdout:1/304: dwrite d1/d1a/f2a [442368,69632] 0 2024-02-19T19:12:11.303 INFO:tasks.workunit.client.1.smithi125.stdout:2/259: dread d1/d27/f8 [1957888,36864] 0 2024-02-19T19:12:11.303 INFO:tasks.workunit.client.1.smithi125.stdout:1/305: creat d1/d26/d23/f68 x:0 0 0 2024-02-19T19:12:11.303 INFO:tasks.workunit.client.1.smithi125.stdout:5/448: write db/d17/d58/f3a [1860665,124007] 0 2024-02-19T19:12:11.303 INFO:tasks.workunit.client.1.smithi125.stdout:2/260: mkdir d1/d27/d1d/d39/d40/d4b 0 2024-02-19T19:12:11.303 INFO:tasks.workunit.client.1.smithi125.stdout:2/261: truncate d1/d27/d1d/d25/d2a/f34 341305 0 2024-02-19T19:12:11.355 INFO:tasks.workunit.client.1.smithi125.stdout:8/227: write db/f41 [170933,80324] 0 2024-02-19T19:12:11.355 INFO:tasks.workunit.client.1.smithi125.stdout:8/228: getdents db/d18/d2f/d3f 0 2024-02-19T19:12:11.355 INFO:tasks.workunit.client.1.smithi125.stdout:8/229: truncate db/f1e 181367 0 2024-02-19T19:12:11.355 INFO:tasks.workunit.client.1.smithi125.stdout:8/230: creat db/d18/d30/d3c/f4b x:0 0 0 2024-02-19T19:12:11.355 INFO:tasks.workunit.client.1.smithi125.stdout:8/231: write db/f38 [768330,31772] 0 2024-02-19T19:12:11.355 INFO:tasks.workunit.client.1.smithi125.stdout:8/232: mknod db/c4c 0 2024-02-19T19:12:11.355 INFO:tasks.workunit.client.1.smithi125.stdout:8/233: mkdir db/d18/d30/d3c/d4d 0 2024-02-19T19:12:11.355 INFO:tasks.workunit.client.1.smithi125.stdout:8/234: getdents db/d18 0 2024-02-19T19:12:11.356 INFO:tasks.workunit.client.1.smithi125.stdout:8/235: symlink db/d18/d2f/d3f/l4e 0 2024-02-19T19:12:11.356 INFO:tasks.workunit.client.1.smithi125.stdout:4/245: sync 2024-02-19T19:12:11.356 INFO:tasks.workunit.client.1.smithi125.stdout:3/257: sync 2024-02-19T19:12:11.356 INFO:tasks.workunit.client.1.smithi125.stdout:0/260: sync 2024-02-19T19:12:11.356 INFO:tasks.workunit.client.1.smithi125.stdout:3/258: rename d0/de/l38 to d0/d1/d4b/l55 0 2024-02-19T19:12:11.356 INFO:tasks.workunit.client.1.smithi125.stdout:8/236: truncate db/d18/f2a 347876 0 2024-02-19T19:12:11.356 INFO:tasks.workunit.client.1.smithi125.stdout:0/261: dread d5/d9/f26 [2478080,12288] 0 2024-02-19T19:12:11.356 INFO:tasks.workunit.client.1.smithi125.stdout:3/259: dread d0/d1/f41 [73728,73728] 0 2024-02-19T19:12:11.357 INFO:tasks.workunit.client.1.smithi125.stdout:4/246: write d0/d7/f26 [544041,64351] 0 2024-02-19T19:12:11.357 INFO:tasks.workunit.client.1.smithi125.stdout:8/237: getdents db 0 2024-02-19T19:12:11.357 INFO:tasks.workunit.client.1.smithi125.stdout:0/262: mknod d5/d9/c64 0 2024-02-19T19:12:11.357 INFO:tasks.workunit.client.1.smithi125.stdout:8/238: rmdir db/d18/d30/d3c 39 2024-02-19T19:12:11.357 INFO:tasks.workunit.client.1.smithi125.stdout:8/239: read - db/d18/d30/d3c/f4b zero size 2024-02-19T19:12:11.357 INFO:tasks.workunit.client.1.smithi125.stdout:0/263: rename d5/d9/fd to d5/d33/d42/f65 0 2024-02-19T19:12:11.357 INFO:tasks.workunit.client.1.smithi125.stdout:4/247: write d0/d7/d3b/f3d [276387,24028] 0 2024-02-19T19:12:11.357 INFO:tasks.workunit.client.1.smithi125.stdout:8/240: creat db/d18/d30/f4f x:0 0 0 2024-02-19T19:12:11.357 INFO:tasks.workunit.client.1.smithi125.stdout:4/248: unlink d0/d32/c4c 0 2024-02-19T19:12:11.358 INFO:tasks.workunit.client.1.smithi125.stdout:0/264: link d5/d15/d2c/f43 d5/d33/d46/f66 0 2024-02-19T19:12:11.358 INFO:tasks.workunit.client.1.smithi125.stdout:4/249: rename d0/c27 to d0/d7/dc/c4d 0 2024-02-19T19:12:11.358 INFO:tasks.workunit.client.1.smithi125.stdout:4/250: mknod d0/d7/dc/c4e 0 2024-02-19T19:12:11.358 INFO:tasks.workunit.client.1.smithi125.stdout:4/251: mknod d0/d7/d3b/c4f 0 2024-02-19T19:12:11.358 INFO:tasks.workunit.client.1.smithi125.stdout:4/252: getdents d0/d7/d3b 0 2024-02-19T19:12:11.358 INFO:tasks.workunit.client.1.smithi125.stdout:4/253: write d0/d7/f26 [762024,885] 0 2024-02-19T19:12:11.358 INFO:tasks.workunit.client.1.smithi125.stdout:6/259: dwrite d6/db/f17 [1884160,4096] 0 2024-02-19T19:12:11.358 INFO:tasks.workunit.client.1.smithi125.stdout:6/260: chown d6/f1e 3251 1 2024-02-19T19:12:11.358 INFO:tasks.workunit.client.1.smithi125.stdout:2/262: dwrite d1/d27/d1d/f2b [1097728,4096] 0 2024-02-19T19:12:11.359 INFO:tasks.workunit.client.1.smithi125.stdout:2/263: stat d1/d27/d1d/d39/d40/f42 0 2024-02-19T19:12:11.359 INFO:tasks.workunit.client.1.smithi125.stdout:2/264: dread - d1/d27/d1d/d39/d40/f42 zero size 2024-02-19T19:12:11.359 INFO:tasks.workunit.client.1.smithi125.stdout:2/265: stat d1/d27/d1d/d2c/f31 0 2024-02-19T19:12:11.359 INFO:tasks.workunit.client.1.smithi125.stdout:2/266: mkdir d1/d27/d1d/d39/d4c 0 2024-02-19T19:12:11.359 INFO:tasks.workunit.client.1.smithi125.stdout:5/449: dread db/d17/f22 [208896,65536] 0 2024-02-19T19:12:11.359 INFO:tasks.workunit.client.1.smithi125.stdout:5/450: dread db/d17/f1e [405504,49152] 0 2024-02-19T19:12:11.359 INFO:tasks.workunit.client.1.smithi125.stdout:5/451: creat db/d17/f92 x:0 0 0 2024-02-19T19:12:11.359 INFO:tasks.workunit.client.1.smithi125.stdout:2/267: write d1/d27/d1d/d39/d40/f42 [729011,56385] 0 2024-02-19T19:12:11.359 INFO:tasks.workunit.client.1.smithi125.stdout:2/268: mknod d1/d27/d1d/d39/d40/d4b/c4d 0 2024-02-19T19:12:11.360 INFO:tasks.workunit.client.1.smithi125.stdout:5/452: write db/d17/d58/f24 [2384645,61050] 0 2024-02-19T19:12:11.360 INFO:tasks.workunit.client.1.smithi125.stdout:2/269: mkdir d1/d27/d45/d4e 0 2024-02-19T19:12:11.360 INFO:tasks.workunit.client.1.smithi125.stdout:2/270: symlink d1/d27/l4f 0 2024-02-19T19:12:11.360 INFO:tasks.workunit.client.1.smithi125.stdout:2/271: write d1/d27/d1d/d2c/f31 [2121300,115034] 0 2024-02-19T19:12:11.394 INFO:tasks.workunit.client.1.smithi125.stdout:7/261: fsync d12/d18/f1e 0 2024-02-19T19:12:11.395 INFO:tasks.workunit.client.1.smithi125.stdout:7/262: symlink d12/d25/d2a/d31/l46 0 2024-02-19T19:12:11.395 INFO:tasks.workunit.client.1.smithi125.stdout:0/265: fdatasync d5/d19/d27/d32/f3a 0 2024-02-19T19:12:11.395 INFO:tasks.workunit.client.1.smithi125.stdout:7/263: dread - d12/d25/d26/f3a zero size 2024-02-19T19:12:11.395 INFO:tasks.workunit.client.1.smithi125.stdout:7/264: dread d12/d25/d26/f2f [53248,98304] 0 2024-02-19T19:12:11.395 INFO:tasks.workunit.client.1.smithi125.stdout:7/265: truncate d12/f17 100116 0 2024-02-19T19:12:11.395 INFO:tasks.workunit.client.1.smithi125.stdout:7/266: link d12/d25/d26/f28 d12/d18/d44/f47 0 2024-02-19T19:12:11.397 INFO:tasks.workunit.client.1.smithi125.stdout:2/272: dwrite d1/d27/d1d/f24 [2420736,4096] 0 2024-02-19T19:12:11.397 INFO:tasks.workunit.client.1.smithi125.stdout:2/273: creat d1/d27/d1d/f50 x:0 0 0 2024-02-19T19:12:11.399 INFO:tasks.workunit.client.1.smithi125.stdout:6/261: dread d6/f1e [794624,106496] 0 2024-02-19T19:12:11.399 INFO:tasks.workunit.client.1.smithi125.stdout:6/262: dread - d6/d34/f2e zero size 2024-02-19T19:12:11.399 INFO:tasks.workunit.client.1.smithi125.stdout:6/263: read - d6/d34/d29/f3f zero size 2024-02-19T19:12:11.399 INFO:tasks.workunit.client.1.smithi125.stdout:6/264: dread d6/db/f11 [315392,98304] 0 2024-02-19T19:12:11.399 INFO:tasks.workunit.client.1.smithi125.stdout:6/265: chown d6/db/f3e 4909 1 2024-02-19T19:12:11.399 INFO:tasks.workunit.client.1.smithi125.stdout:6/266: rename d6/d34 to d6/d4a 0 2024-02-19T19:12:11.400 INFO:tasks.workunit.client.1.smithi125.stdout:6/267: write d6/d4a/d29/f2d [1648971,41422] 0 2024-02-19T19:12:11.400 INFO:tasks.workunit.client.1.smithi125.stdout:6/268: rename d6/d4a/d2f/l47 to d6/db/l4b 0 2024-02-19T19:12:11.400 INFO:tasks.workunit.client.1.smithi125.stdout:6/269: chown d6/f9 9924 1 2024-02-19T19:12:11.400 INFO:tasks.workunit.client.1.smithi125.stdout:3/260: dwrite d0/de/f2e [618496,122880] 0 2024-02-19T19:12:11.400 INFO:tasks.workunit.client.1.smithi125.stdout:3/261: dread d0/f33 [376832,28672] 0 2024-02-19T19:12:11.400 INFO:tasks.workunit.client.1.smithi125.stdout:3/262: chown d0/de/l21 1589 1 2024-02-19T19:12:11.400 INFO:tasks.workunit.client.1.smithi125.stdout:3/263: rename d0/d1/f2d to d0/d1/f56 0 2024-02-19T19:12:11.402 INFO:tasks.workunit.client.1.smithi125.stdout:5/453: dread db/d47/f6a [282624,12288] 0 2024-02-19T19:12:11.402 INFO:tasks.workunit.client.1.smithi125.stdout:5/454: dread - db/d17/f92 zero size 2024-02-19T19:12:11.402 INFO:tasks.workunit.client.1.smithi125.stdout:4/254: dwrite d0/d32/f46 [946176,102400] 0 2024-02-19T19:12:11.402 INFO:tasks.workunit.client.1.smithi125.stdout:4/255: dread d0/d7/f2f [282624,49152] 0 2024-02-19T19:12:11.402 INFO:tasks.workunit.client.1.smithi125.stdout:4/256: mknod d0/d32/c50 0 2024-02-19T19:12:11.403 INFO:tasks.workunit.client.1.smithi125.stdout:4/257: creat d0/d7/d3b/f51 x:0 0 0 2024-02-19T19:12:11.403 INFO:tasks.workunit.client.1.smithi125.stdout:4/258: write d0/d7/dc/f1e [1438258,1395] 0 2024-02-19T19:12:11.403 INFO:tasks.workunit.client.1.smithi125.stdout:4/259: creat d0/df/f52 x:0 0 0 2024-02-19T19:12:11.403 INFO:tasks.workunit.client.1.smithi125.stdout:8/241: dwrite db/f1e [1224704,122880] 0 2024-02-19T19:12:11.403 INFO:tasks.workunit.client.1.smithi125.stdout:8/242: read db/f26 [163751,65912] 0 2024-02-19T19:12:11.403 INFO:tasks.workunit.client.1.smithi125.stdout:8/243: chown db/d18/d30/f4f 218153 1 2024-02-19T19:12:11.403 INFO:tasks.workunit.client.1.smithi125.stdout:8/244: chown db/l29 875 1 2024-02-19T19:12:11.403 INFO:tasks.workunit.client.1.smithi125.stdout:8/245: symlink db/d18/d30/d3c/d4d/l50 0 2024-02-19T19:12:11.404 INFO:tasks.workunit.client.1.smithi125.stdout:8/246: readlink db/d18/l22 0 2024-02-19T19:12:11.458 INFO:tasks.workunit.client.1.smithi125.stdout:0/266: fsync d5/d19/f44 0 2024-02-19T19:12:11.458 INFO:tasks.workunit.client.1.smithi125.stdout:4/260: fsync d0/d7/d3b/f43 0 2024-02-19T19:12:11.461 INFO:tasks.workunit.client.1.smithi125.stdout:8/247: dwrite db/d18/d30/d48/f49 [348160,57344] 0 2024-02-19T19:12:11.461 INFO:tasks.workunit.client.1.smithi125.stdout:5/455: dwrite db/d26/f90 [294912,20480] 0 2024-02-19T19:12:11.462 INFO:tasks.workunit.client.1.smithi125.stdout:6/270: dwrite d6/d4a/d2f/f48 [241664,122880] 0 2024-02-19T19:12:11.462 INFO:tasks.workunit.client.1.smithi125.stdout:6/271: readlink d6/db/df/d16/l26 0 2024-02-19T19:12:11.462 INFO:tasks.workunit.client.1.smithi125.stdout:8/248: readlink db/l28 0 2024-02-19T19:12:11.462 INFO:tasks.workunit.client.1.smithi125.stdout:0/267: write d5/d1a/d4c/f5d [371639,32331] 0 2024-02-19T19:12:11.462 INFO:tasks.workunit.client.1.smithi125.stdout:4/261: write d0/df/f33 [273989,97737] 0 2024-02-19T19:12:11.462 INFO:tasks.workunit.client.1.smithi125.stdout:3/264: dwrite d0/d1/f23 [958464,4096] 0 2024-02-19T19:12:11.462 INFO:tasks.workunit.client.1.smithi125.stdout:5/456: write db/d17/d58/d33/d64/f70 [257884,19263] 0 2024-02-19T19:12:11.462 INFO:tasks.workunit.client.1.smithi125.stdout:6/272: mkdir d6/db/d49/d4c 0 2024-02-19T19:12:11.463 INFO:tasks.workunit.client.1.smithi125.stdout:3/265: readlink d0/l1a 0 2024-02-19T19:12:11.463 INFO:tasks.workunit.client.1.smithi125.stdout:0/268: rmdir d5/d1a/d58 0 2024-02-19T19:12:11.463 INFO:tasks.workunit.client.1.smithi125.stdout:3/266: chown d0/ca 17901 1 2024-02-19T19:12:11.463 INFO:tasks.workunit.client.1.smithi125.stdout:5/457: mknod db/d17/d58/d33/d64/c93 0 2024-02-19T19:12:11.463 INFO:tasks.workunit.client.1.smithi125.stdout:3/267: dread - d0/d1/d1e/f36 zero size 2024-02-19T19:12:11.463 INFO:tasks.workunit.client.1.smithi125.stdout:7/267: dwrite d12/f45 [720896,16384] 0 2024-02-19T19:12:11.463 INFO:tasks.workunit.client.1.smithi125.stdout:5/458: getdents db/d17/d58/d33/d53 0 2024-02-19T19:12:11.463 INFO:tasks.workunit.client.1.smithi125.stdout:3/268: mknod d0/de/c57 0 2024-02-19T19:12:11.463 INFO:tasks.workunit.client.1.smithi125.stdout:6/273: mkdir d6/d4a/d4d 0 2024-02-19T19:12:11.464 INFO:tasks.workunit.client.1.smithi125.stdout:5/459: dread db/d17/d58/f1c [716800,77824] 0 2024-02-19T19:12:11.464 INFO:tasks.workunit.client.1.smithi125.stdout:3/269: creat d0/d1/f58 x:0 0 0 2024-02-19T19:12:11.464 INFO:tasks.workunit.client.1.smithi125.stdout:3/270: truncate d0/d1/f17 1377052 0 2024-02-19T19:12:11.464 INFO:tasks.workunit.client.1.smithi125.stdout:7/268: mkdir d12/d25/d2a/d48 0 2024-02-19T19:12:11.464 INFO:tasks.workunit.client.1.smithi125.stdout:5/460: symlink db/d17/d58/d25/d40/l94 0 2024-02-19T19:12:11.464 INFO:tasks.workunit.client.1.smithi125.stdout:0/269: write d5/d15/f52 [248129,73023] 0 2024-02-19T19:12:11.464 INFO:tasks.workunit.client.1.smithi125.stdout:7/269: creat d12/d25/d2a/d48/f49 x:0 0 0 2024-02-19T19:12:11.465 INFO:tasks.workunit.client.1.smithi125.stdout:0/270: chown d5/d19/f44 237662 1 2024-02-19T19:12:11.465 INFO:tasks.workunit.client.1.smithi125.stdout:7/270: getdents d12/d25/d3e 0 2024-02-19T19:12:11.465 INFO:tasks.workunit.client.1.smithi125.stdout:0/271: write d5/d19/d2b/f4e [413621,87350] 0 2024-02-19T19:12:11.465 INFO:tasks.workunit.client.1.smithi125.stdout:0/272: mknod d5/d1a/c67 0 2024-02-19T19:12:11.465 INFO:tasks.workunit.client.1.smithi125.stdout:0/273: dread d5/d15/f52 [69632,122880] 0 2024-02-19T19:12:11.465 INFO:tasks.workunit.client.1.smithi125.stdout:0/274: symlink d5/l68 0 2024-02-19T19:12:11.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.450+0000 7f9164d5b700 1 -- 172.21.15.96:0/79985943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9160100ea0 msgr2=0x7f9160101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:11.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.450+0000 7f9164d5b700 1 --2- 172.21.15.96:0/79985943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9160100ea0 0x7f9160101280 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9150009910 tx=0x7f9150009c20 comp rx=0 tx=0).stop 2024-02-19T19:12:11.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.450+0000 7f9164d5b700 1 -- 172.21.15.96:0/79985943 shutdown_connections 2024-02-19T19:12:11.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.450+0000 7f9164d5b700 1 --2- 172.21.15.96:0/79985943 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9160101850 0x7f91601058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:11.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.450+0000 7f9164d5b700 1 --2- 172.21.15.96:0/79985943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9160100ea0 0x7f9160101280 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:11.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.450+0000 7f9164d5b700 1 -- 172.21.15.96:0/79985943 >> 172.21.15.96:0/79985943 conn(0x7f91600fc750 msgr2=0x7f91600feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:11.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.450+0000 7f9164d5b700 1 -- 172.21.15.96:0/79985943 shutdown_connections 2024-02-19T19:12:11.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.450+0000 7f9164d5b700 1 -- 172.21.15.96:0/79985943 wait complete. 2024-02-19T19:12:11.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.451+0000 7f9164d5b700 1 Processor -- start 2024-02-19T19:12:11.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.451+0000 7f9164d5b700 1 -- start start 2024-02-19T19:12:11.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.451+0000 7f9164d5b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9160100ea0 0x7f9160073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:11.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.451+0000 7f9164d5b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9160101850 0x7f91600735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:11.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.451+0000 7f9164d5b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9160073b10 con 0x7f9160101850 2024-02-19T19:12:11.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.451+0000 7f9164d5b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9160073c50 con 0x7f9160100ea0 2024-02-19T19:12:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.451+0000 7f9157fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9160101850 0x7f91600735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.451+0000 7f9157fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9160101850 0x7f91600735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55868/0 (socket says 172.21.15.96:55868) 2024-02-19T19:12:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.451+0000 7f9157fff700 1 -- 172.21.15.96:0/1402551753 learned_addr learned my addr 172.21.15.96:0/1402551753 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:12:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.451+0000 7f915e59c700 1 --2- 172.21.15.96:0/1402551753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9160100ea0 0x7f9160073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.451+0000 7f9157fff700 1 -- 172.21.15.96:0/1402551753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9160100ea0 msgr2=0x7f9160073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.451+0000 7f9157fff700 1 --2- 172.21.15.96:0/1402551753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9160100ea0 0x7f9160073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.451+0000 7f9157fff700 1 -- 172.21.15.96:0/1402551753 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91500095f0 con 0x7f9160101850 2024-02-19T19:12:11.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.451+0000 7f915e59c700 1 --2- 172.21.15.96:0/1402551753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9160100ea0 0x7f9160073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:12:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.452+0000 7f9157fff700 1 --2- 172.21.15.96:0/1402551753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9160101850 0x7f91600735d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f914800c8f0 tx=0x7f914800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.452+0000 7f91577fe700 1 -- 172.21.15.96:0/1402551753 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9148007a50 con 0x7f9160101850 2024-02-19T19:12:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.452+0000 7f91577fe700 1 -- 172.21.15.96:0/1402551753 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9148007bb0 con 0x7f9160101850 2024-02-19T19:12:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.452+0000 7f9164d5b700 1 -- 172.21.15.96:0/1402551753 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91601a2af0 con 0x7f9160101850 2024-02-19T19:12:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.452+0000 7f91577fe700 1 -- 172.21.15.96:0/1402551753 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9148018630 con 0x7f9160101850 2024-02-19T19:12:11.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.452+0000 7f9164d5b700 1 -- 172.21.15.96:0/1402551753 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91601a2f00 con 0x7f9160101850 2024-02-19T19:12:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.453+0000 7f9164d5b700 1 -- 172.21.15.96:0/1402551753 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9160109240 con 0x7f9160101850 2024-02-19T19:12:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.453+0000 7f91577fe700 1 -- 172.21.15.96:0/1402551753 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f9148007d20 con 0x7f9160101850 2024-02-19T19:12:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.454+0000 7f91577fe700 1 --2- 172.21.15.96:0/1402551753 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f914c06d8a0 0x7f914c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:11.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.454+0000 7f91577fe700 1 -- 172.21.15.96:0/1402551753 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f914808d3c0 con 0x7f9160101850 2024-02-19T19:12:11.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.454+0000 7f915e59c700 1 --2- 172.21.15.96:0/1402551753 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f914c06d8a0 0x7f914c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:11.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.454+0000 7f915e59c700 1 --2- 172.21.15.96:0/1402551753 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f914c06d8a0 0x7f914c06fd60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f91500059d0 tx=0x7f915001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:11.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.458+0000 7f91577fe700 1 -- 172.21.15.96:0/1402551753 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9148056ca0 con 0x7f9160101850 2024-02-19T19:12:11.482 INFO:tasks.workunit.client.1.smithi125.stdout:5/461: dwrite db/d17/d58/d25/d40/f8e [745472,106496] 0 2024-02-19T19:12:11.483 INFO:tasks.workunit.client.1.smithi125.stdout:5/462: rename db/d17/d58/d25/d40/f4b to db/d17/d85/f95 0 2024-02-19T19:12:11.483 INFO:tasks.workunit.client.1.smithi125.stdout:5/463: mkdir db/d17/d58/d25/d40/d96 0 2024-02-19T19:12:11.483 INFO:tasks.workunit.client.1.smithi125.stdout:5/464: rename db/d17/d58/d25/d40/f66 to db/d17/d58/d33/f97 0 2024-02-19T19:12:11.489 INFO:tasks.workunit.client.1.smithi125.stdout:7/271: dread d12/f1f [12288,53248] 0 2024-02-19T19:12:11.489 INFO:tasks.workunit.client.1.smithi125.stdout:7/272: creat d12/d25/d2a/f4a x:0 0 0 2024-02-19T19:12:11.489 INFO:tasks.workunit.client.1.smithi125.stdout:7/273: chown d12/c22 1798388 1 2024-02-19T19:12:11.518 INFO:tasks.workunit.client.1.smithi125.stdout:4/262: fdatasync d0/d7/dc/fd 0 2024-02-19T19:12:11.518 INFO:tasks.workunit.client.1.smithi125.stdout:4/263: mknod d0/d7/d30/d42/c53 0 2024-02-19T19:12:11.518 INFO:tasks.workunit.client.1.smithi125.stdout:1/306: fsync d1/d1a/f2a 0 2024-02-19T19:12:11.518 INFO:tasks.workunit.client.1.smithi125.stdout:1/307: mkdir d1/dc/d36/d69 0 2024-02-19T19:12:11.518 INFO:tasks.workunit.client.1.smithi125.stdout:1/308: dread d1/d26/f40 [667648,4096] 0 2024-02-19T19:12:11.519 INFO:tasks.workunit.client.1.smithi125.stdout:1/309: stat d1/d26/f3b 0 2024-02-19T19:12:11.519 INFO:tasks.workunit.client.1.smithi125.stdout:1/310: creat d1/dc/d36/d41/d4b/f6a x:0 0 0 2024-02-19T19:12:11.519 INFO:tasks.workunit.client.1.smithi125.stdout:5/465: dwrite db/d17/d58/d33/f3e [4096,90112] 0 2024-02-19T19:12:11.519 INFO:tasks.workunit.client.1.smithi125.stdout:5/466: mkdir db/d17/d58/d33/d98 0 2024-02-19T19:12:11.519 INFO:tasks.workunit.client.1.smithi125.stdout:5/467: rename db/d17/f92 to db/d26/d51/f99 0 2024-02-19T19:12:11.519 INFO:tasks.workunit.client.1.smithi125.stdout:5/468: readlink db/d17/l6b 0 2024-02-19T19:12:11.537 INFO:tasks.workunit.client.1.smithi125.stdout:3/271: fsync d0/d1/d4b/f4f 0 2024-02-19T19:12:11.539 INFO:tasks.workunit.client.1.smithi125.stdout:1/311: dwrite d1/d26/d29/f35 [704512,45056] 0 2024-02-19T19:12:11.539 INFO:tasks.workunit.client.1.smithi125.stdout:1/312: mknod d1/dc/d36/c6b 0 2024-02-19T19:12:11.539 INFO:tasks.workunit.client.1.smithi125.stdout:1/313: write d1/d26/d3c/d3f/f48 [22318,112835] 0 2024-02-19T19:12:11.539 INFO:tasks.workunit.client.1.smithi125.stdout:1/314: write d1/dc/d36/f54 [565245,45465] 0 2024-02-19T19:12:11.539 INFO:tasks.workunit.client.1.smithi125.stdout:1/315: chown d1/f30 655418331 1 2024-02-19T19:12:11.540 INFO:tasks.workunit.client.1.smithi125.stdout:4/264: dwrite d0/df/f23 [16384,102400] 0 2024-02-19T19:12:11.540 INFO:tasks.workunit.client.1.smithi125.stdout:4/265: mknod d0/d7/c54 0 2024-02-19T19:12:11.540 INFO:tasks.workunit.client.1.smithi125.stdout:5/469: dwrite db/d17/f45 [3133440,16384] 0 2024-02-19T19:12:11.540 INFO:tasks.workunit.client.1.smithi125.stdout:5/470: chown db/d17/d58/d33/d64/c93 139012581 1 2024-02-19T19:12:11.540 INFO:tasks.workunit.client.1.smithi125.stdout:5/471: getdents db/d17/d58/d33/d98 0 2024-02-19T19:12:11.540 INFO:tasks.workunit.client.1.smithi125.stdout:5/472: rmdir db/d17/d58/d25/d40/d96 0 2024-02-19T19:12:11.540 INFO:tasks.workunit.client.1.smithi125.stdout:5/473: mknod db/d17/d58/d33/c9a 0 2024-02-19T19:12:11.540 INFO:tasks.workunit.client.1.smithi125.stdout:5/474: chown db/f34 472654682 1 2024-02-19T19:12:11.541 INFO:tasks.workunit.client.1.smithi125.stdout:4/266: dwrite d0/d7/dc/f9 [2338816,24576] 0 2024-02-19T19:12:11.541 INFO:tasks.workunit.client.1.smithi125.stdout:4/267: chown d0/df/c49 777845735 1 2024-02-19T19:12:11.541 INFO:tasks.workunit.client.1.smithi125.stdout:4/268: dread d0/d7/f26 [2211840,110592] 0 2024-02-19T19:12:11.562 INFO:tasks.workunit.client.1.smithi125.stdout:7/274: fsync f1 0 2024-02-19T19:12:11.563 INFO:tasks.workunit.client.1.smithi125.stdout:7/275: creat d12/d25/d26/d30/d37/f4b x:0 0 0 2024-02-19T19:12:11.563 INFO:tasks.workunit.client.1.smithi125.stdout:7/276: chown d12/d25/d2a/d31 226886 1 2024-02-19T19:12:11.563 INFO:tasks.workunit.client.1.smithi125.stdout:7/277: creat d12/d25/d26/f4c x:0 0 0 2024-02-19T19:12:11.563 INFO:tasks.workunit.client.1.smithi125.stdout:0/275: fsync d5/d9/f26 0 2024-02-19T19:12:11.563 INFO:tasks.workunit.client.1.smithi125.stdout:0/276: rename d5 to d5/d69 22 2024-02-19T19:12:11.563 INFO:tasks.workunit.client.1.smithi125.stdout:0/277: creat d5/d33/d46/f6a x:0 0 0 2024-02-19T19:12:11.563 INFO:tasks.workunit.client.1.smithi125.stdout:0/278: getdents d5/d19/d4a 0 2024-02-19T19:12:11.564 INFO:tasks.workunit.client.1.smithi125.stdout:0/279: link d5/d33/d46/f6a d5/d33/d46/f6b 0 2024-02-19T19:12:11.564 INFO:tasks.workunit.client.1.smithi125.stdout:0/280: dread - d5/d15/f5b zero size 2024-02-19T19:12:11.564 INFO:tasks.workunit.client.1.smithi125.stdout:0/281: mkdir d5/d19/d6c 0 2024-02-19T19:12:11.564 INFO:tasks.workunit.client.1.smithi125.stdout:0/282: dread d5/d15/d2c/f43 [401408,12288] 0 2024-02-19T19:12:11.566 INFO:tasks.workunit.client.1.smithi125.stdout:5/475: dwrite db/d26/d51/f7c [417792,61440] 0 2024-02-19T19:12:11.566 INFO:tasks.workunit.client.1.smithi125.stdout:0/283: rename d5/d33/f5f to d5/f6d 0 2024-02-19T19:12:11.566 INFO:tasks.workunit.client.1.smithi125.stdout:4/269: creat d0/d32/f55 x:0 0 0 2024-02-19T19:12:11.566 INFO:tasks.workunit.client.1.smithi125.stdout:7/278: write d12/d25/d26/d30/d37/f3f [1039745,49348] 0 2024-02-19T19:12:11.566 INFO:tasks.workunit.client.1.smithi125.stdout:4/270: creat d0/d7/dc/f56 x:0 0 0 2024-02-19T19:12:11.566 INFO:tasks.workunit.client.1.smithi125.stdout:7/279: symlink d12/d25/d2a/d48/l4d 0 2024-02-19T19:12:11.567 INFO:tasks.workunit.client.1.smithi125.stdout:7/280: write d12/d25/d26/d30/f35 [628539,88900] 0 2024-02-19T19:12:11.567 INFO:tasks.workunit.client.1.smithi125.stdout:7/281: read d12/d25/d26/d30/f35 [259475,120333] 0 2024-02-19T19:12:11.567 INFO:tasks.workunit.client.1.smithi125.stdout:7/282: rmdir d12/d25/d3e 39 2024-02-19T19:12:11.567 INFO:tasks.workunit.client.1.smithi125.stdout:7/283: write f8 [1897448,89202] 0 2024-02-19T19:12:11.567 INFO:tasks.workunit.client.1.smithi125.stdout:7/284: mkdir d12/d18/d2c/d4e 0 2024-02-19T19:12:11.567 INFO:tasks.workunit.client.1.smithi125.stdout:7/285: rmdir d12/d18/d2c 39 2024-02-19T19:12:11.567 INFO:tasks.workunit.client.1.smithi125.stdout:7/286: rename d12/f17 to d12/d3d/f4f 0 2024-02-19T19:12:11.567 INFO:tasks.workunit.client.1.smithi125.stdout:7/287: dread d12/d25/d26/d30/d37/f3f [196608,110592] 0 2024-02-19T19:12:11.567 INFO:tasks.workunit.client.1.smithi125.stdout:7/288: mkdir d12/d25/d2a/d31/d50 0 2024-02-19T19:12:11.568 INFO:tasks.workunit.client.1.smithi125.stdout:7/289: truncate d12/d25/d2a/f4a 60577 0 2024-02-19T19:12:11.568 INFO:tasks.workunit.client.1.smithi125.stdout:7/290: write d12/d25/d26/d30/d37/f4b [941098,42061] 0 2024-02-19T19:12:11.599 INFO:tasks.workunit.client.1.smithi125.stdout:0/284: fdatasync d5/f8 0 2024-02-19T19:12:11.599 INFO:tasks.workunit.client.1.smithi125.stdout:0/285: truncate d5/d1a/d4c/f5d 423576 0 2024-02-19T19:12:11.599 INFO:tasks.workunit.client.1.smithi125.stdout:0/286: mknod d5/d19/d2b/c6e 0 2024-02-19T19:12:11.599 INFO:tasks.workunit.client.1.smithi125.stdout:0/287: write d5/d19/f44 [462569,19918] 0 2024-02-19T19:12:11.599 INFO:tasks.workunit.client.1.smithi125.stdout:0/288: getdents d5/d19/d4a 0 2024-02-19T19:12:11.599 INFO:tasks.workunit.client.1.smithi125.stdout:0/289: mknod d5/c6f 0 2024-02-19T19:12:11.600 INFO:tasks.workunit.client.1.smithi125.stdout:0/290: stat d5/d33/d46 0 2024-02-19T19:12:11.600 INFO:tasks.workunit.client.1.smithi125.stdout:4/271: fdatasync d0/d32/f36 0 2024-02-19T19:12:11.600 INFO:tasks.workunit.client.1.smithi125.stdout:1/316: fsync d1/d26/f3b 0 2024-02-19T19:12:11.600 INFO:tasks.workunit.client.1.smithi125.stdout:0/291: unlink d5/d1a/d4c/f5d 0 2024-02-19T19:12:11.600 INFO:tasks.workunit.client.1.smithi125.stdout:5/476: fdatasync db/d17/f41 0 2024-02-19T19:12:11.600 INFO:tasks.workunit.client.1.smithi125.stdout:1/317: getdents d1/d26/d3c/d3f 0 2024-02-19T19:12:11.600 INFO:tasks.workunit.client.1.smithi125.stdout:5/477: truncate db/d17/d58/d33/d64/f70 1181047 0 2024-02-19T19:12:11.600 INFO:tasks.workunit.client.1.smithi125.stdout:4/272: write d0/d32/f47 [636339,18000] 0 2024-02-19T19:12:11.601 INFO:tasks.workunit.client.1.smithi125.stdout:4/273: mknod d0/c57 0 2024-02-19T19:12:11.601 INFO:tasks.workunit.client.1.smithi125.stdout:5/478: symlink db/d17/d58/d25/l9b 0 2024-02-19T19:12:11.601 INFO:tasks.workunit.client.1.smithi125.stdout:4/274: dread - d0/df/f1d zero size 2024-02-19T19:12:11.601 INFO:tasks.workunit.client.1.smithi125.stdout:5/479: truncate db/f30 1379432 0 2024-02-19T19:12:11.601 INFO:tasks.workunit.client.1.smithi125.stdout:1/318: read d1/dc/d36/d41/d4b/f4e [230345,103629] 0 2024-02-19T19:12:11.601 INFO:tasks.workunit.client.1.smithi125.stdout:5/480: stat db/d47/d52/d5d 0 2024-02-19T19:12:11.601 INFO:tasks.workunit.client.1.smithi125.stdout:1/319: mknod d1/dc/c6c 0 2024-02-19T19:12:11.601 INFO:tasks.workunit.client.1.smithi125.stdout:5/481: write db/d47/f7e [2626035,64543] 0 2024-02-19T19:12:11.601 INFO:tasks.workunit.client.1.smithi125.stdout:5/482: chown db/d17/d58/d25/f89 28 1 2024-02-19T19:12:11.603 INFO:tasks.workunit.client.1.smithi125.stdout:7/291: dwrite d12/d25/d26/f28 [679936,122880] 0 2024-02-19T19:12:11.604 INFO:tasks.workunit.client.1.smithi125.stdout:7/292: getdents d12/d25/d26 0 2024-02-19T19:12:11.604 INFO:tasks.workunit.client.1.smithi125.stdout:7/293: write f5 [416947,23214] 0 2024-02-19T19:12:11.604 INFO:tasks.workunit.client.1.smithi125.stdout:7/294: mkdir d12/d18/d44/d51 0 2024-02-19T19:12:11.604 INFO:tasks.workunit.client.1.smithi125.stdout:7/295: mkdir d12/d18/d44/d3b/d52 0 2024-02-19T19:12:11.604 INFO:tasks.workunit.client.1.smithi125.stdout:7/296: chown d12/d25/d3e/c41 5281 1 2024-02-19T19:12:11.604 INFO:tasks.workunit.client.1.smithi125.stdout:7/297: symlink d12/l53 0 2024-02-19T19:12:11.604 INFO:tasks.workunit.client.1.smithi125.stdout:7/298: write f5 [2048421,103282] 0 2024-02-19T19:12:11.605 INFO:tasks.workunit.client.1.smithi125.stdout:7/299: mkdir d12/d25/d26/d54 0 2024-02-19T19:12:11.605 INFO:tasks.workunit.client.1.smithi125.stdout:7/300: rename d12/d25/d2a/l2b to d12/d18/d44/d3b/d52/l55 0 2024-02-19T19:12:11.605 INFO:tasks.workunit.client.1.smithi125.stdout:4/275: dwrite d0/df/f23 [339968,36864] 0 2024-02-19T19:12:11.605 INFO:tasks.workunit.client.1.smithi125.stdout:4/276: dread d0/d7/f2f [81920,73728] 0 2024-02-19T19:12:11.605 INFO:tasks.workunit.client.1.smithi125.stdout:4/277: unlink d0/f17 0 2024-02-19T19:12:11.605 INFO:tasks.workunit.client.1.smithi125.stdout:1/320: dwrite d1/d26/d3c/f46 [487424,65536] 0 2024-02-19T19:12:11.605 INFO:tasks.workunit.client.1.smithi125.stdout:5/483: dwrite db/d17/f41 [835584,106496] 0 2024-02-19T19:12:11.605 INFO:tasks.workunit.client.1.smithi125.stdout:5/484: chown db/d17/d58/d33/d64 61197275 1 2024-02-19T19:12:11.605 INFO:tasks.workunit.client.1.smithi125.stdout:5/485: chown c9 790256 1 2024-02-19T19:12:11.605 INFO:tasks.workunit.client.1.smithi125.stdout:5/486: mkdir db/d17/d58/d33/d98/d9c 0 2024-02-19T19:12:11.606 INFO:tasks.workunit.client.1.smithi125.stdout:5/487: symlink db/d17/d58/d33/d64/l9d 0 2024-02-19T19:12:11.606 INFO:tasks.workunit.client.1.smithi125.stdout:5/488: creat db/d17/d58/d33/d98/d9c/f9e x:0 0 0 2024-02-19T19:12:11.606 INFO:tasks.workunit.client.1.smithi125.stdout:5/489: write db/d17/f45 [2140399,9207] 0 2024-02-19T19:12:11.606 INFO:tasks.workunit.client.1.smithi125.stdout:7/301: dwrite d12/f33 [843776,77824] 0 2024-02-19T19:12:11.606 INFO:tasks.workunit.client.1.smithi125.stdout:7/302: unlink d12/d18/f23 0 2024-02-19T19:12:11.607 INFO:tasks.workunit.client.1.smithi125.stdout:4/278: dwrite d0/d7/d3b/f3d [1306624,36864] 0 2024-02-19T19:12:11.607 INFO:tasks.workunit.client.1.smithi125.stdout:4/279: getdents d0 0 2024-02-19T19:12:11.690 INFO:tasks.workunit.client.1.smithi125.stdout:2/274: fdatasync d1/d27/d1d/d25/f38 0 2024-02-19T19:12:11.690 INFO:tasks.workunit.client.1.smithi125.stdout:8/249: fdatasync db/d18/d30/d48/f49 0 2024-02-19T19:12:11.690 INFO:tasks.workunit.client.1.smithi125.stdout:2/275: write d1/d27/d1d/d25/f38 [495094,43443] 0 2024-02-19T19:12:11.690 INFO:tasks.workunit.client.1.smithi125.stdout:2/276: readlink d1/l28 0 2024-02-19T19:12:11.690 INFO:tasks.workunit.client.1.smithi125.stdout:8/250: creat db/d18/d30/d48/f51 x:0 0 0 2024-02-19T19:12:11.690 INFO:tasks.workunit.client.1.smithi125.stdout:8/251: chown db/d18/d30/d48 4 1 2024-02-19T19:12:11.691 INFO:tasks.workunit.client.1.smithi125.stdout:8/252: readlink db/lf 0 2024-02-19T19:12:11.691 INFO:tasks.workunit.client.1.smithi125.stdout:2/277: symlink d1/d27/d1d/d39/d40/d4b/l51 0 2024-02-19T19:12:11.691 INFO:tasks.workunit.client.1.smithi125.stdout:2/278: chown d1/d36/l4a 7688136 1 2024-02-19T19:12:11.691 INFO:tasks.workunit.client.1.smithi125.stdout:8/253: write db/d18/d30/f4f [871110,1248] 0 2024-02-19T19:12:11.691 INFO:tasks.workunit.client.1.smithi125.stdout:2/279: rmdir d1/d27/d1d/d39/d40/d4b 39 2024-02-19T19:12:11.691 INFO:tasks.workunit.client.1.smithi125.stdout:2/280: getdents d1/d27/d1d/d39/d40/d4b 0 2024-02-19T19:12:11.691 INFO:tasks.workunit.client.1.smithi125.stdout:8/254: getdents db/d18 0 2024-02-19T19:12:11.691 INFO:tasks.workunit.client.1.smithi125.stdout:2/281: chown d1/d27/f22 1059656 1 2024-02-19T19:12:11.691 INFO:tasks.workunit.client.1.smithi125.stdout:2/282: readlink d1/d27/d1d/d25/l3f 0 2024-02-19T19:12:11.692 INFO:tasks.workunit.client.1.smithi125.stdout:2/283: creat d1/f52 x:0 0 0 2024-02-19T19:12:11.692 INFO:tasks.workunit.client.1.smithi125.stdout:8/255: creat db/d18/d30/d48/f52 x:0 0 0 2024-02-19T19:12:11.692 INFO:tasks.workunit.client.1.smithi125.stdout:2/284: mknod d1/d27/d1d/d25/c53 0 2024-02-19T19:12:11.692 INFO:tasks.workunit.client.1.smithi125.stdout:8/256: dread db/fc [1277952,114688] 0 2024-02-19T19:12:11.692 INFO:tasks.workunit.client.1.smithi125.stdout:2/285: write d1/fd [911565,3905] 0 2024-02-19T19:12:11.692 INFO:tasks.workunit.client.1.smithi125.stdout:8/257: creat db/d18/d30/d3c/f53 x:0 0 0 2024-02-19T19:12:11.692 INFO:tasks.workunit.client.1.smithi125.stdout:1/321: fsync d1/f30 0 2024-02-19T19:12:11.692 INFO:tasks.workunit.client.1.smithi125.stdout:7/303: fsync fc 0 2024-02-19T19:12:11.693 INFO:tasks.workunit.client.1.smithi125.stdout:8/258: truncate db/d18/d2f/f39 804234 0 2024-02-19T19:12:11.693 INFO:tasks.workunit.client.1.smithi125.stdout:7/304: stat d12 0 2024-02-19T19:12:11.693 INFO:tasks.workunit.client.1.smithi125.stdout:8/259: dread db/f36 [356352,77824] 0 2024-02-19T19:12:11.693 INFO:tasks.workunit.client.1.smithi125.stdout:7/305: creat d12/d18/d44/d51/f56 x:0 0 0 2024-02-19T19:12:11.693 INFO:tasks.workunit.client.1.smithi125.stdout:8/260: mknod db/c54 0 2024-02-19T19:12:11.693 INFO:tasks.workunit.client.1.smithi125.stdout:8/261: creat db/d18/d2f/d3f/f55 x:0 0 0 2024-02-19T19:12:11.693 INFO:tasks.workunit.client.1.smithi125.stdout:1/322: write d1/dc/f52 [177254,60318] 0 2024-02-19T19:12:11.693 INFO:tasks.workunit.client.1.smithi125.stdout:1/323: chown d1/dc/d36/d41/d4b 38267802 1 2024-02-19T19:12:11.693 INFO:tasks.workunit.client.1.smithi125.stdout:8/262: unlink db/d18/d2f/d3f/l4e 0 2024-02-19T19:12:11.694 INFO:tasks.workunit.client.1.smithi125.stdout:1/324: chown d1/d26/d3c/f46 0 1 2024-02-19T19:12:11.694 INFO:tasks.workunit.client.1.smithi125.stdout:8/263: creat db/d18/d30/d3c/d4d/f56 x:0 0 0 2024-02-19T19:12:11.694 INFO:tasks.workunit.client.1.smithi125.stdout:8/264: readlink db/d18/l33 0 2024-02-19T19:12:11.694 INFO:tasks.workunit.client.1.smithi125.stdout:8/265: getdents db/d18/d2f 0 2024-02-19T19:12:11.697 INFO:tasks.workunit.client.1.smithi125.stdout:2/286: dwrite d1/d27/d1d/d25/f2d [159744,98304] 0 2024-02-19T19:12:11.697 INFO:tasks.workunit.client.1.smithi125.stdout:1/325: dwrite d1/d26/d23/f68 [475136,36864] 0 2024-02-19T19:12:11.697 INFO:tasks.workunit.client.1.smithi125.stdout:8/266: dwrite db/d18/d30/d48/f49 [1028096,86016] 0 2024-02-19T19:12:11.697 INFO:tasks.workunit.client.1.smithi125.stdout:8/267: dread - db/d18/d30/d48/f52 zero size 2024-02-19T19:12:11.698 INFO:tasks.workunit.client.1.smithi125.stdout:8/268: write db/f1e [1879705,1409] 0 2024-02-19T19:12:11.698 INFO:tasks.workunit.client.1.smithi125.stdout:8/269: chown db/f38 63559023 1 2024-02-19T19:12:11.698 INFO:tasks.workunit.client.1.smithi125.stdout:8/270: dread db/d18/f32 [491520,118784] 0 2024-02-19T19:12:11.698 INFO:tasks.workunit.client.1.smithi125.stdout:8/271: chown db/d18/d2f/d3f/c47 0 1 2024-02-19T19:12:11.698 INFO:tasks.workunit.client.1.smithi125.stdout:8/272: write db/f38 [690322,114655] 0 2024-02-19T19:12:11.698 INFO:tasks.workunit.client.1.smithi125.stdout:8/273: creat db/d18/d30/d48/f57 x:0 0 0 2024-02-19T19:12:11.698 INFO:tasks.workunit.client.1.smithi125.stdout:8/274: stat db/d18/f1b 0 2024-02-19T19:12:11.698 INFO:tasks.workunit.client.1.smithi125.stdout:8/275: truncate db/d18/d30/f43 897826 0 2024-02-19T19:12:11.698 INFO:tasks.workunit.client.1.smithi125.stdout:8/276: dread db/d18/f2a [299008,32768] 0 2024-02-19T19:12:11.699 INFO:tasks.workunit.client.1.smithi125.stdout:8/277: write db/d18/f1b [2820868,105182] 0 2024-02-19T19:12:11.699 INFO:tasks.workunit.client.1.smithi125.stdout:8/278: write db/d18/f32 [307894,120111] 0 2024-02-19T19:12:11.699 INFO:tasks.workunit.client.1.smithi125.stdout:8/279: rename db/l45 to db/d18/d30/d3c/d4d/l58 0 2024-02-19T19:12:11.699 INFO:tasks.workunit.client.1.smithi125.stdout:1/326: creat d1/d26/d23/f6d x:0 0 0 2024-02-19T19:12:11.699 INFO:tasks.workunit.client.1.smithi125.stdout:1/327: rename d1/dc/d36/d41 to d1/d1a/d3d/d6e 0 2024-02-19T19:12:11.699 INFO:tasks.workunit.client.1.smithi125.stdout:1/328: creat d1/d26/d3c/f6f x:0 0 0 2024-02-19T19:12:11.699 INFO:tasks.workunit.client.1.smithi125.stdout:1/329: creat d1/f70 x:0 0 0 2024-02-19T19:12:11.699 INFO:tasks.workunit.client.1.smithi125.stdout:1/330: creat d1/d26/f71 x:0 0 0 2024-02-19T19:12:11.700 INFO:tasks.workunit.client.1.smithi125.stdout:1/331: chown d1/d26/d3c/d3f/f48 46 1 2024-02-19T19:12:11.700 INFO:tasks.workunit.client.1.smithi125.stdout:1/332: stat d1/dc/d36/c6b 0 2024-02-19T19:12:11.700 INFO:tasks.workunit.client.1.smithi125.stdout:1/333: readlink d1/d26/d3c/l56 0 2024-02-19T19:12:11.700 INFO:tasks.workunit.client.1.smithi125.stdout:8/280: dwrite db/d18/d30/d3c/d4d/f56 [1024000,86016] 0 2024-02-19T19:12:11.700 INFO:tasks.workunit.client.1.smithi125.stdout:2/287: dwrite d1/d27/f8 [1445888,8192] 0 2024-02-19T19:12:11.700 INFO:tasks.workunit.client.1.smithi125.stdout:2/288: unlink d1/d27/d1d/c15 0 2024-02-19T19:12:11.700 INFO:tasks.workunit.client.1.smithi125.stdout:2/289: truncate d1/d27/d1d/d25/f2d 1223275 0 2024-02-19T19:12:11.700 INFO:tasks.workunit.client.1.smithi125.stdout:2/290: write d1/d27/d1d/d39/d40/f49 [419807,2042] 0 2024-02-19T19:12:11.701 INFO:tasks.workunit.client.1.smithi125.stdout:8/281: write db/fc [2891792,98591] 0 2024-02-19T19:12:11.701 INFO:tasks.workunit.client.1.smithi125.stdout:2/291: write d1/d27/d1d/f2b [630620,15834] 0 2024-02-19T19:12:11.701 INFO:tasks.workunit.client.1.smithi125.stdout:2/292: link d1/d27/d1d/d25/l32 d1/d27/d1d/d25/d2a/l54 0 2024-02-19T19:12:11.701 INFO:tasks.workunit.client.1.smithi125.stdout:4/280: dread d0/f2e [131072,73728] 0 2024-02-19T19:12:11.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:11 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:11.704 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.682+0000 7f9164d5b700 1 -- 172.21.15.96:0/1402551753 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f91600746b0 con 0x7f914c06d8a0 2024-02-19T19:12:11.704 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:11 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:11.705 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.683+0000 7f91577fe700 1 -- 172.21.15.96:0/1402551753 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f91600746b0 con 0x7f914c06d8a0 2024-02-19T19:12:11.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.686+0000 7f9164d5b700 1 -- 172.21.15.96:0/1402551753 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f914c06d8a0 msgr2=0x7f914c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:11.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.686+0000 7f9164d5b700 1 --2- 172.21.15.96:0/1402551753 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f914c06d8a0 0x7f914c06fd60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f91500059d0 tx=0x7f915001a040 comp rx=0 tx=0).stop 2024-02-19T19:12:11.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.686+0000 7f9164d5b700 1 -- 172.21.15.96:0/1402551753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9160101850 msgr2=0x7f91600735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:11.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.686+0000 7f9164d5b700 1 --2- 172.21.15.96:0/1402551753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9160101850 0x7f91600735d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f914800c8f0 tx=0x7f914800ccb0 comp rx=0 tx=0).stop 2024-02-19T19:12:11.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.686+0000 7f9164d5b700 1 -- 172.21.15.96:0/1402551753 shutdown_connections 2024-02-19T19:12:11.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.686+0000 7f9164d5b700 1 --2- 172.21.15.96:0/1402551753 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f914c06d8a0 0x7f914c06fd60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:11.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.686+0000 7f9164d5b700 1 --2- 172.21.15.96:0/1402551753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9160100ea0 0x7f9160073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:11.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.686+0000 7f9164d5b700 1 --2- 172.21.15.96:0/1402551753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9160101850 0x7f91600735d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:11.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.686+0000 7f9164d5b700 1 -- 172.21.15.96:0/1402551753 >> 172.21.15.96:0/1402551753 conn(0x7f91600fc750 msgr2=0x7f91600fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:11.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.686+0000 7f9164d5b700 1 -- 172.21.15.96:0/1402551753 shutdown_connections 2024-02-19T19:12:11.710 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.686+0000 7f9164d5b700 1 -- 172.21.15.96:0/1402551753 wait complete. 2024-02-19T19:12:11.719 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:12:11.791 INFO:tasks.workunit.client.1.smithi125.stdout:1/334: dwrite d1/d26/d23/f55 [90112,81920] 0 2024-02-19T19:12:11.791 INFO:tasks.workunit.client.1.smithi125.stdout:1/335: creat d1/dc/f72 x:0 0 0 2024-02-19T19:12:11.792 INFO:tasks.workunit.client.1.smithi125.stdout:2/293: dwrite d1/d27/f8 [2437120,110592] 0 2024-02-19T19:12:11.792 INFO:tasks.workunit.client.1.smithi125.stdout:2/294: getdents d1/d27/d1d/d25/d2a 0 2024-02-19T19:12:11.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.791+0000 7f9bfee66700 1 -- 172.21.15.96:0/3805455212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bf8101850 msgr2=0x7f9bf81058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:11.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.791+0000 7f9bfee66700 1 --2- 172.21.15.96:0/3805455212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bf8101850 0x7f9bf81058a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9bec009910 tx=0x7f9bec009c20 comp rx=0 tx=0).stop 2024-02-19T19:12:11.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.791+0000 7f9bfee66700 1 -- 172.21.15.96:0/3805455212 shutdown_connections 2024-02-19T19:12:11.813 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.791+0000 7f9bfee66700 1 --2- 172.21.15.96:0/3805455212 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bf8101850 0x7f9bf81058a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:11.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.791+0000 7f9bfee66700 1 --2- 172.21.15.96:0/3805455212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9bf8100ea0 0x7f9bf8101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:11.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.791+0000 7f9bfee66700 1 -- 172.21.15.96:0/3805455212 >> 172.21.15.96:0/3805455212 conn(0x7f9bf80fc750 msgr2=0x7f9bf80feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:11.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.791+0000 7f9bfee66700 1 -- 172.21.15.96:0/3805455212 shutdown_connections 2024-02-19T19:12:11.814 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.791+0000 7f9bfee66700 1 -- 172.21.15.96:0/3805455212 wait complete. 2024-02-19T19:12:11.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.792+0000 7f9bfee66700 1 Processor -- start 2024-02-19T19:12:11.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.792+0000 7f9bfee66700 1 -- start start 2024-02-19T19:12:11.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.792+0000 7f9bfee66700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bf8100ea0 0x7f9bf819c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:11.816 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.792+0000 7f9bfee66700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9bf8101850 0x7f9bf819cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:11.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.792+0000 7f9bfee66700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf819d2d0 con 0x7f9bf8100ea0 2024-02-19T19:12:11.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.792+0000 7f9bfee66700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf8196780 con 0x7f9bf8101850 2024-02-19T19:12:11.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.792+0000 7f9bfcc02700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bf8100ea0 0x7f9bf819c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:11.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.792+0000 7f9bfcc02700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bf8100ea0 0x7f9bf819c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55884/0 (socket says 172.21.15.96:55884) 2024-02-19T19:12:11.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.792+0000 7f9bfcc02700 1 -- 172.21.15.96:0/1158797619 learned_addr learned my addr 172.21.15.96:0/1158797619 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:12:11.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.792+0000 7f9bf7fff700 1 --2- 172.21.15.96:0/1158797619 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9bf8101850 0x7f9bf819cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:11.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.792+0000 7f9bfcc02700 1 -- 172.21.15.96:0/1158797619 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9bf8101850 msgr2=0x7f9bf819cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:11.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.792+0000 7f9bfcc02700 1 --2- 172.21.15.96:0/1158797619 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9bf8101850 0x7f9bf819cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:11.817 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.792+0000 7f9bfcc02700 1 -- 172.21.15.96:0/1158797619 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec0095f0 con 0x7f9bf8100ea0 2024-02-19T19:12:11.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.792+0000 7f9bfcc02700 1 --2- 172.21.15.96:0/1158797619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bf8100ea0 0x7f9bf819c700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9be800d8d0 tx=0x7f9be800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:11.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.792+0000 7f9bf5ffb700 1 -- 172.21.15.96:0/1158797619 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9be80098a0 con 0x7f9bf8100ea0 2024-02-19T19:12:11.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.793+0000 7f9bf5ffb700 1 -- 172.21.15.96:0/1158797619 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9be8010460 con 0x7f9bf8100ea0 2024-02-19T19:12:11.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.793+0000 7f9bfee66700 1 -- 172.21.15.96:0/1158797619 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf8196a60 con 0x7f9bf8100ea0 2024-02-19T19:12:11.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.793+0000 7f9bf5ffb700 1 -- 172.21.15.96:0/1158797619 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9be800f5f0 con 0x7f9bf8100ea0 2024-02-19T19:12:11.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.793+0000 7f9bfee66700 1 -- 172.21.15.96:0/1158797619 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf8196fb0 con 0x7f9bf8100ea0 2024-02-19T19:12:11.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.794+0000 7f9bfee66700 1 -- 172.21.15.96:0/1158797619 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf81092a0 con 0x7f9bf8100ea0 2024-02-19T19:12:11.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.794+0000 7f9bf5ffb700 1 -- 172.21.15.96:0/1158797619 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f9be8009a00 con 0x7f9bf8100ea0 2024-02-19T19:12:11.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.794+0000 7f9bf5ffb700 1 --2- 172.21.15.96:0/1158797619 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9be006d8a0 0x7f9be006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:11.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.795+0000 7f9bf5ffb700 1 -- 172.21.15.96:0/1158797619 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9be808d290 con 0x7f9bf8100ea0 2024-02-19T19:12:11.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.795+0000 7f9bf7fff700 1 --2- 172.21.15.96:0/1158797619 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9be006d8a0 0x7f9be006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:11.819 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.795+0000 7f9bf7fff700 1 --2- 172.21.15.96:0/1158797619 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9be006d8a0 0x7f9be006fd60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8197bf0 tx=0x7f9bec01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:11.821 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:11.799+0000 7f9bf5ffb700 1 -- 172.21.15.96:0/1158797619 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9be805a6a0 con 0x7f9bf8100ea0 2024-02-19T19:12:11.891 INFO:tasks.workunit.client.1.smithi125.stdout:8/282: fsync db/d18/f27 0 2024-02-19T19:12:11.892 INFO:tasks.workunit.client.1.smithi125.stdout:1/336: dwrite d1/dc/d36/d39/f5f [720896,49152] 0 2024-02-19T19:12:11.892 INFO:tasks.workunit.client.1.smithi125.stdout:1/337: chown d1/dc/d36/f66 11 1 2024-02-19T19:12:11.901 INFO:tasks.workunit.client.1.smithi125.stdout:2/295: fsync d1/d27/f11 0 2024-02-19T19:12:11.901 INFO:tasks.workunit.client.1.smithi125.stdout:2/296: getdents d1/d27/d1d/d39/d4c 0 2024-02-19T19:12:11.905 INFO:tasks.workunit.client.1.smithi125.stdout:2/297: creat d1/d27/d1d/d39/f55 x:0 0 0 2024-02-19T19:12:11.906 INFO:tasks.workunit.client.1.smithi125.stdout:2/298: rename d1/fd to d1/d27/d45/f56 0 2024-02-19T19:12:11.906 INFO:tasks.workunit.client.1.smithi125.stdout:2/299: chown d1/d27/c14 1 1 2024-02-19T19:12:11.906 INFO:tasks.workunit.client.1.smithi125.stdout:2/300: truncate d1/d27/d1d/d39/d40/f49 524145 0 2024-02-19T19:12:11.906 INFO:tasks.workunit.client.1.smithi125.stdout:2/301: stat d1/d27/cb 0 2024-02-19T19:12:11.906 INFO:tasks.workunit.client.1.smithi125.stdout:2/302: symlink d1/d27/d45/l57 0 2024-02-19T19:12:11.906 INFO:tasks.workunit.client.1.smithi125.stdout:2/303: chown d1/d27/cb 293 1 2024-02-19T19:12:11.906 INFO:tasks.workunit.client.1.smithi125.stdout:2/304: symlink d1/d27/d1d/d2c/d2e/l58 0 2024-02-19T19:12:11.907 INFO:tasks.workunit.client.1.smithi125.stdout:2/305: write d1/d27/d1d/f2b [420888,86650] 0 2024-02-19T19:12:11.915 INFO:tasks.workunit.client.1.smithi125.stdout:1/338: dread d1/d1a/f2e [16384,16384] 0 2024-02-19T19:12:12.003 INFO:tasks.workunit.client.1.smithi125.stdout:1/339: dwrite d1/dc/d36/d39/f3a [614400,126976] 0 2024-02-19T19:12:12.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.010+0000 7f9bfee66700 1 -- 172.21.15.96:0/1158797619 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9bf8197da0 con 0x7f9be006d8a0 2024-02-19T19:12:12.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.011+0000 7f9bf5ffb700 1 -- 172.21.15.96:0/1158797619 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f9bf8197da0 con 0x7f9be006d8a0 2024-02-19T19:12:12.035 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.013+0000 7f9bfee66700 1 -- 172.21.15.96:0/1158797619 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9be006d8a0 msgr2=0x7f9be006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:12.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.013+0000 7f9bfee66700 1 --2- 172.21.15.96:0/1158797619 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9be006d8a0 0x7f9be006fd60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8197bf0 tx=0x7f9bec01a040 comp rx=0 tx=0).stop 2024-02-19T19:12:12.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.013+0000 7f9bfee66700 1 -- 172.21.15.96:0/1158797619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bf8100ea0 msgr2=0x7f9bf819c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:12.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.013+0000 7f9bfee66700 1 --2- 172.21.15.96:0/1158797619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bf8100ea0 0x7f9bf819c700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9be800d8d0 tx=0x7f9be800dbe0 comp rx=0 tx=0).stop 2024-02-19T19:12:12.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.013+0000 7f9bfee66700 1 -- 172.21.15.96:0/1158797619 shutdown_connections 2024-02-19T19:12:12.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.013+0000 7f9bfee66700 1 --2- 172.21.15.96:0/1158797619 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9be006d8a0 0x7f9be006fd60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:12.036 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.013+0000 7f9bfee66700 1 --2- 172.21.15.96:0/1158797619 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9bf8100ea0 0x7f9bf819c700 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:12.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.013+0000 7f9bfee66700 1 --2- 172.21.15.96:0/1158797619 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9bf8101850 0x7f9bf819cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:12.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.013+0000 7f9bfee66700 1 -- 172.21.15.96:0/1158797619 >> 172.21.15.96:0/1158797619 conn(0x7f9bf80fc750 msgr2=0x7f9bf80fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:12.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.013+0000 7f9bfee66700 1 -- 172.21.15.96:0/1158797619 shutdown_connections 2024-02-19T19:12:12.037 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.014+0000 7f9bfee66700 1 -- 172.21.15.96:0/1158797619 wait complete. 2024-02-19T19:12:12.054 INFO:tasks.workunit.client.1.smithi125.stdout:8/283: fsync db/f36 0 2024-02-19T19:12:12.055 INFO:tasks.workunit.client.1.smithi125.stdout:8/284: symlink db/d18/l59 0 2024-02-19T19:12:12.055 INFO:tasks.workunit.client.1.smithi125.stdout:8/285: dread - db/d18/d30/d48/f52 zero size 2024-02-19T19:12:12.055 INFO:tasks.workunit.client.1.smithi125.stdout:8/286: mkdir db/d18/d30/d5a 0 2024-02-19T19:12:12.055 INFO:tasks.workunit.client.1.smithi125.stdout:8/287: symlink db/d18/d30/d3c/d4d/l5b 0 2024-02-19T19:12:12.055 INFO:tasks.workunit.client.1.smithi125.stdout:8/288: truncate db/d18/d30/d48/f49 528937 0 2024-02-19T19:12:12.055 INFO:tasks.workunit.client.1.smithi125.stdout:8/289: dread db/f1e [860160,24576] 0 2024-02-19T19:12:12.055 INFO:tasks.workunit.client.1.smithi125.stdout:8/290: creat db/d18/d30/d48/f5c x:0 0 0 2024-02-19T19:12:12.056 INFO:tasks.workunit.client.1.smithi125.stdout:9/285: sync 2024-02-19T19:12:12.056 INFO:tasks.workunit.client.1.smithi125.stdout:9/286: symlink d8/d2e/l63 0 2024-02-19T19:12:12.057 INFO:tasks.workunit.client.1.smithi125.stdout:9/287: read d8/d15/d32/f2a [68776,121756] 0 2024-02-19T19:12:12.057 INFO:tasks.workunit.client.1.smithi125.stdout:9/288: dread d8/d15/f1c [946176,49152] 0 2024-02-19T19:12:12.057 INFO:tasks.workunit.client.1.smithi125.stdout:1/340: dwrite d1/d26/d23/f55 [3268608,114688] 0 2024-02-19T19:12:12.059 INFO:tasks.workunit.client.1.smithi125.stdout:8/291: dwrite db/d18/d30/f43 [528384,28672] 0 2024-02-19T19:12:12.060 INFO:tasks.workunit.client.1.smithi125.stdout:8/292: mkdir db/d18/d30/d3c/d4d/d5d 0 2024-02-19T19:12:12.060 INFO:tasks.workunit.client.1.smithi125.stdout:8/293: chown db/l23 7830 1 2024-02-19T19:12:12.060 INFO:tasks.workunit.client.1.smithi125.stdout:8/294: chown db/l3d 698107087 1 2024-02-19T19:12:12.060 INFO:tasks.workunit.client.1.smithi125.stdout:8/295: truncate db/d18/d30/f4f 1530746 0 2024-02-19T19:12:12.060 INFO:tasks.workunit.client.1.smithi125.stdout:8/296: unlink db/d18/d30/d3c/d4d/l58 0 2024-02-19T19:12:12.061 INFO:tasks.workunit.client.1.smithi125.stdout:8/297: rename db/fc to db/f5e 0 2024-02-19T19:12:12.062 INFO:tasks.workunit.client.1.smithi125.stdout:8/298: truncate db/d18/d30/d3c/f53 465761 0 2024-02-19T19:12:12.062 INFO:tasks.workunit.client.1.smithi125.stdout:8/299: symlink db/d18/d2f/d3f/l5f 0 2024-02-19T19:12:12.062 INFO:tasks.workunit.client.1.smithi125.stdout:8/300: chown db/f41 2518786 1 2024-02-19T19:12:12.062 INFO:tasks.workunit.client.1.smithi125.stdout:8/301: rename db/d18/d30/d5a to db/d18/d30/d3c/d4d/d5d/d60 0 2024-02-19T19:12:12.062 INFO:tasks.workunit.client.1.smithi125.stdout:8/302: rename db/f5e to db/d18/d30/d3c/d4d/f61 0 2024-02-19T19:12:12.062 INFO:tasks.workunit.client.1.smithi125.stdout:8/303: creat db/d18/f62 x:0 0 0 2024-02-19T19:12:12.062 INFO:tasks.workunit.client.1.smithi125.stdout:8/304: dwrite db/f46 [815104,24576] 0 2024-02-19T19:12:12.062 INFO:tasks.workunit.client.1.smithi125.stdout:8/305: symlink db/d18/d30/d48/l63 0 2024-02-19T19:12:12.063 INFO:tasks.workunit.client.1.smithi125.stdout:8/306: truncate db/d18/f32 637866 0 2024-02-19T19:12:12.063 INFO:tasks.workunit.client.1.smithi125.stdout:8/307: unlink db/d18/d2f/d3f/f55 0 2024-02-19T19:12:12.064 INFO:tasks.workunit.client.1.smithi125.stdout:9/289: dread d8/f1a [98304,57344] 0 2024-02-19T19:12:12.064 INFO:tasks.workunit.client.1.smithi125.stdout:9/290: creat d8/d15/d32/f64 x:0 0 0 2024-02-19T19:12:12.064 INFO:tasks.workunit.client.1.smithi125.stdout:9/291: rename d8/f1a to d8/d15/d32/f65 0 2024-02-19T19:12:12.064 INFO:tasks.workunit.client.1.smithi125.stdout:9/292: chown d8/d15/c46 384311 1 2024-02-19T19:12:12.065 INFO:tasks.workunit.client.1.smithi125.stdout:9/293: readlink d8/l5c 0 2024-02-19T19:12:12.065 INFO:tasks.workunit.client.1.smithi125.stdout:9/294: chown d8/d15/d22/d4e/f58 375 1 2024-02-19T19:12:12.123 INFO:tasks.workunit.client.1.smithi125.stdout:1/341: fsync d1/d26/d29/f5d 0 2024-02-19T19:12:12.123 INFO:tasks.workunit.client.1.smithi125.stdout:1/342: write d1/d26/d3c/f64 [175678,18819] 0 2024-02-19T19:12:12.123 INFO:tasks.workunit.client.1.smithi125.stdout:1/343: stat d1/dc/d36/l43 0 2024-02-19T19:12:12.123 INFO:tasks.workunit.client.1.smithi125.stdout:1/344: link d1/d26/d3c/f6f d1/d26/f73 0 2024-02-19T19:12:12.124 INFO:tasks.workunit.client.1.smithi125.stdout:1/345: dread d1/dc/d36/d39/f5f [139264,90112] 0 2024-02-19T19:12:12.124 INFO:tasks.workunit.client.1.smithi125.stdout:1/346: unlink d1/dc/d36/l4a 0 2024-02-19T19:12:12.124 INFO:tasks.workunit.client.1.smithi125.stdout:1/347: chown d1/d26/d29 1795772 1 2024-02-19T19:12:12.124 INFO:tasks.workunit.client.1.smithi125.stdout:1/348: stat d1/d26/l38 0 2024-02-19T19:12:12.124 INFO:tasks.workunit.client.1.smithi125.stdout:1/349: dread - d1/d26/d29/f5d zero size 2024-02-19T19:12:12.124 INFO:tasks.workunit.client.1.smithi125.stdout:1/350: write d1/dc/d36/f66 [938540,85935] 0 2024-02-19T19:12:12.126 INFO:tasks.workunit.client.1.smithi125.stdout:8/308: dwrite db/d18/d30/d48/f5c [122880,28672] 0 2024-02-19T19:12:12.126 INFO:tasks.workunit.client.1.smithi125.stdout:8/309: getdents db/d18/d30/d3c/d4d/d5d 0 2024-02-19T19:12:12.126 INFO:tasks.workunit.client.1.smithi125.stdout:8/310: creat db/d18/d30/d3c/d4d/d5d/f64 x:0 0 0 2024-02-19T19:12:12.126 INFO:tasks.workunit.client.1.smithi125.stdout:8/311: stat db/d18/d2f/d3f/l44 0 2024-02-19T19:12:12.126 INFO:tasks.workunit.client.1.smithi125.stdout:8/312: chown db/d18/d30/d3c/d4d 3 1 2024-02-19T19:12:12.126 INFO:tasks.workunit.client.1.smithi125.stdout:8/313: write db/d18/f2a [666717,127266] 0 2024-02-19T19:12:12.127 INFO:tasks.workunit.client.1.smithi125.stdout:8/314: write db/d18/d30/d3c/d4d/f56 [2077498,82530] 0 2024-02-19T19:12:12.127 INFO:tasks.workunit.client.1.smithi125.stdout:5/490: sync 2024-02-19T19:12:12.127 INFO:tasks.workunit.client.1.smithi125.stdout:6/274: sync 2024-02-19T19:12:12.127 INFO:tasks.workunit.client.1.smithi125.stdout:7/306: sync 2024-02-19T19:12:12.127 INFO:tasks.workunit.client.1.smithi125.stdout:3/272: sync 2024-02-19T19:12:12.127 INFO:tasks.workunit.client.1.smithi125.stdout:0/292: sync 2024-02-19T19:12:12.127 INFO:tasks.workunit.client.1.smithi125.stdout:6/275: chown d6/f9 21168 1 2024-02-19T19:12:12.127 INFO:tasks.workunit.client.1.smithi125.stdout:5/491: dread - db/d17/d58/f81 zero size 2024-02-19T19:12:12.127 INFO:tasks.workunit.client.1.smithi125.stdout:7/307: dread d12/d25/d26/f2f [81920,57344] 0 2024-02-19T19:12:12.128 INFO:tasks.workunit.client.1.smithi125.stdout:5/492: link db/f75 db/d17/d58/d4f/f9f 0 2024-02-19T19:12:12.128 INFO:tasks.workunit.client.1.smithi125.stdout:7/308: write d12/d18/d2c/f42 [1007432,54789] 0 2024-02-19T19:12:12.128 INFO:tasks.workunit.client.1.smithi125.stdout:7/309: rmdir d12/d18/d44/d51 39 2024-02-19T19:12:12.128 INFO:tasks.workunit.client.1.smithi125.stdout:7/310: write d12/d18/d44/f40 [660960,754] 0 2024-02-19T19:12:12.128 INFO:tasks.workunit.client.1.smithi125.stdout:8/315: dwrite db/d18/d30/d48/f49 [45056,102400] 0 2024-02-19T19:12:12.128 INFO:tasks.workunit.client.1.smithi125.stdout:8/316: dread db/f38 [368640,77824] 0 2024-02-19T19:12:12.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.117+0000 7f43370a6700 1 -- 172.21.15.96:0/2677622669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4330100ea0 msgr2=0x7f4330101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:12.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.117+0000 7f43370a6700 1 --2- 172.21.15.96:0/2677622669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4330100ea0 0x7f4330101280 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4324009910 tx=0x7f4324009c20 comp rx=0 tx=0).stop 2024-02-19T19:12:12.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.117+0000 7f43370a6700 1 -- 172.21.15.96:0/2677622669 shutdown_connections 2024-02-19T19:12:12.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.117+0000 7f43370a6700 1 --2- 172.21.15.96:0/2677622669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4330101850 0x7f43301058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:12.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.117+0000 7f43370a6700 1 --2- 172.21.15.96:0/2677622669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4330100ea0 0x7f4330101280 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:12.139 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.117+0000 7f43370a6700 1 -- 172.21.15.96:0/2677622669 >> 172.21.15.96:0/2677622669 conn(0x7f43300fc750 msgr2=0x7f43300feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:12.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.117+0000 7f43370a6700 1 -- 172.21.15.96:0/2677622669 shutdown_connections 2024-02-19T19:12:12.140 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.117+0000 7f43370a6700 1 -- 172.21.15.96:0/2677622669 wait complete. 2024-02-19T19:12:12.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.117+0000 7f43370a6700 1 Processor -- start 2024-02-19T19:12:12.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.117+0000 7f43370a6700 1 -- start start 2024-02-19T19:12:12.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.117+0000 7f43370a6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4330100ea0 0x7f4330073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:12.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.117+0000 7f43370a6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4330101850 0x7f43300735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:12.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.117+0000 7f43370a6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4330073b10 con 0x7f4330101850 2024-02-19T19:12:12.142 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.117+0000 7f43370a6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4330073c50 con 0x7f4330100ea0 2024-02-19T19:12:12.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.118+0000 7f432ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4330101850 0x7f43300735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:12.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.118+0000 7f4334e42700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4330100ea0 0x7f4330073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:12.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.118+0000 7f432ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4330101850 0x7f43300735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55906/0 (socket says 172.21.15.96:55906) 2024-02-19T19:12:12.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.118+0000 7f432ffff700 1 -- 172.21.15.96:0/3133620909 learned_addr learned my addr 172.21.15.96:0/3133620909 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:12:12.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.118+0000 7f4334e42700 1 -- 172.21.15.96:0/3133620909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4330101850 msgr2=0x7f43300735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:12.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.118+0000 7f4334e42700 1 --2- 172.21.15.96:0/3133620909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4330101850 0x7f43300735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:12.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.118+0000 7f4334e42700 1 -- 172.21.15.96:0/3133620909 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43240095f0 con 0x7f4330100ea0 2024-02-19T19:12:12.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.118+0000 7f432ffff700 1 --2- 172.21.15.96:0/3133620909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4330101850 0x7f43300735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:12:12.143 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.118+0000 7f4334e42700 1 --2- 172.21.15.96:0/3133620909 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4330100ea0 0x7f4330073090 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4324009fd0 tx=0x7f432400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:12.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.118+0000 7f432dffb700 1 -- 172.21.15.96:0/3133620909 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f432401d070 con 0x7f4330100ea0 2024-02-19T19:12:12.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.118+0000 7f43370a6700 1 -- 172.21.15.96:0/3133620909 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4330073ed0 con 0x7f4330100ea0 2024-02-19T19:12:12.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.118+0000 7f432dffb700 1 -- 172.21.15.96:0/3133620909 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f432400b610 con 0x7f4330100ea0 2024-02-19T19:12:12.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.118+0000 7f432dffb700 1 -- 172.21.15.96:0/3133620909 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4324022470 con 0x7f4330100ea0 2024-02-19T19:12:12.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.119+0000 7f43370a6700 1 -- 172.21.15.96:0/3133620909 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43301a2e20 con 0x7f4330100ea0 2024-02-19T19:12:12.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.119+0000 7f43370a6700 1 -- 172.21.15.96:0/3133620909 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4330109240 con 0x7f4330100ea0 2024-02-19T19:12:12.144 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.120+0000 7f432dffb700 1 -- 172.21.15.96:0/3133620909 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f43240050d0 con 0x7f4330100ea0 2024-02-19T19:12:12.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.120+0000 7f432dffb700 1 --2- 172.21.15.96:0/3133620909 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f432006d8a0 0x7f432006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:12.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.120+0000 7f432dffb700 1 -- 172.21.15.96:0/3133620909 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f432408e8e0 con 0x7f4330100ea0 2024-02-19T19:12:12.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.120+0000 7f432ffff700 1 --2- 172.21.15.96:0/3133620909 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f432006d8a0 0x7f432006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:12.145 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.121+0000 7f432ffff700 1 --2- 172.21.15.96:0/3133620909 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f432006d8a0 0x7f432006fd60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4330074880 tx=0x7f431c009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:12.148 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.126+0000 7f432dffb700 1 -- 172.21.15.96:0/3133620909 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4324058140 con 0x7f4330100ea0 2024-02-19T19:12:12.200 INFO:tasks.workunit.client.1.smithi125.stdout:1/351: fsync d1/d26/d23/f5c 0 2024-02-19T19:12:12.200 INFO:tasks.workunit.client.1.smithi125.stdout:1/352: dread - d1/d26/d23/f6d zero size 2024-02-19T19:12:12.200 INFO:tasks.workunit.client.1.smithi125.stdout:9/295: fdatasync d8/d15/d22/d4e/f54 0 2024-02-19T19:12:12.202 INFO:tasks.workunit.client.1.smithi125.stdout:8/317: dread db/d18/f21 [266240,94208] 0 2024-02-19T19:12:12.202 INFO:tasks.workunit.client.1.smithi125.stdout:1/353: mknod d1/dc/d36/d69/c74 0 2024-02-19T19:12:12.203 INFO:tasks.workunit.client.1.smithi125.stdout:3/273: unlink d0/ff 0 2024-02-19T19:12:12.203 INFO:tasks.workunit.client.1.smithi125.stdout:6/276: mkdir d6/d4a/d2f/d45/d4e 0 2024-02-19T19:12:12.203 INFO:tasks.workunit.client.1.smithi125.stdout:8/318: dread db/f46 [1372160,65536] 0 2024-02-19T19:12:12.203 INFO:tasks.workunit.client.1.smithi125.stdout:9/296: creat d8/d15/f66 x:0 0 0 2024-02-19T19:12:12.203 INFO:tasks.workunit.client.1.smithi125.stdout:5/493: truncate db/d17/f1e 291287 0 2024-02-19T19:12:12.203 INFO:tasks.workunit.client.1.smithi125.stdout:8/319: creat db/f65 x:0 0 0 2024-02-19T19:12:12.203 INFO:tasks.workunit.client.1.smithi125.stdout:6/277: read d6/db/df/f12 [1132019,113364] 0 2024-02-19T19:12:12.203 INFO:tasks.workunit.client.1.smithi125.stdout:9/297: rename d8/d15/d22/f24 to d8/d15/d22/f67 0 2024-02-19T19:12:12.204 INFO:tasks.workunit.client.1.smithi125.stdout:5/494: rename db/d17/d58/d4f/f63 to db/d17/d58/d25/d40/fa0 0 2024-02-19T19:12:12.204 INFO:tasks.workunit.client.1.smithi125.stdout:8/320: link db/d18/l33 db/d18/d30/d3c/d4d/l66 0 2024-02-19T19:12:12.204 INFO:tasks.workunit.client.1.smithi125.stdout:5/495: dread - db/d17/d58/d25/f89 zero size 2024-02-19T19:12:12.204 INFO:tasks.workunit.client.1.smithi125.stdout:9/298: creat d8/d15/d22/d4e/f68 x:0 0 0 2024-02-19T19:12:12.204 INFO:tasks.workunit.client.1.smithi125.stdout:5/496: truncate db/d26/d51/f99 62705 0 2024-02-19T19:12:12.204 INFO:tasks.workunit.client.1.smithi125.stdout:6/278: write d6/db/df/d16/f38 [215348,28114] 0 2024-02-19T19:12:12.204 INFO:tasks.workunit.client.1.smithi125.stdout:8/321: mkdir db/d18/d30/d48/d67 0 2024-02-19T19:12:12.204 INFO:tasks.workunit.client.1.smithi125.stdout:8/322: chown db/d18/d30/f43 5188 1 2024-02-19T19:12:12.205 INFO:tasks.workunit.client.1.smithi125.stdout:6/279: creat d6/d4a/d2f/f4f x:0 0 0 2024-02-19T19:12:12.205 INFO:tasks.workunit.client.1.smithi125.stdout:5/497: symlink db/d47/d52/la1 0 2024-02-19T19:12:12.205 INFO:tasks.workunit.client.1.smithi125.stdout:8/323: creat db/d18/d30/d3c/f68 x:0 0 0 2024-02-19T19:12:12.205 INFO:tasks.workunit.client.1.smithi125.stdout:0/293: dwrite d5/d19/f2f [253952,4096] 0 2024-02-19T19:12:12.205 INFO:tasks.workunit.client.1.smithi125.stdout:5/498: write db/d17/f41 [1642016,76958] 0 2024-02-19T19:12:12.205 INFO:tasks.workunit.client.1.smithi125.stdout:6/280: write d6/d4a/d2f/f4f [849363,38611] 0 2024-02-19T19:12:12.205 INFO:tasks.workunit.client.1.smithi125.stdout:6/281: getdents d6/db/df/d16 0 2024-02-19T19:12:12.205 INFO:tasks.workunit.client.1.smithi125.stdout:6/282: symlink d6/db/df/d3b/l50 0 2024-02-19T19:12:12.208 INFO:tasks.workunit.client.1.smithi125.stdout:7/311: dread d12/f1f [995328,36864] 0 2024-02-19T19:12:12.209 INFO:tasks.workunit.client.1.smithi125.stdout:7/312: write d12/f33 [152726,34827] 0 2024-02-19T19:12:12.209 INFO:tasks.workunit.client.1.smithi125.stdout:7/313: dread d12/d18/d44/f40 [135168,24576] 0 2024-02-19T19:12:12.209 INFO:tasks.workunit.client.1.smithi125.stdout:7/314: chown d12/d25/d2a/d31/f36 423083 1 2024-02-19T19:12:12.209 INFO:tasks.workunit.client.1.smithi125.stdout:7/315: dread - d12/d25/d26/f3a zero size 2024-02-19T19:12:12.209 INFO:tasks.workunit.client.1.smithi125.stdout:7/316: rename d12/d18/l24 to d12/d18/l57 0 2024-02-19T19:12:12.209 INFO:tasks.workunit.client.1.smithi125.stdout:7/317: chown d12/d25/d26/c39 21217 1 2024-02-19T19:12:12.209 INFO:tasks.workunit.client.1.smithi125.stdout:7/318: read d12/d25/d26/f28 [157658,6714] 0 2024-02-19T19:12:12.238 INFO:tasks.workunit.client.1.smithi125.stdout:0/294: dwrite d5/d19/f2f [368640,73728] 0 2024-02-19T19:12:12.238 INFO:tasks.workunit.client.1.smithi125.stdout:0/295: mkdir d5/d19/d27/d32/d70 0 2024-02-19T19:12:12.238 INFO:tasks.workunit.client.1.smithi125.stdout:0/296: creat d5/f71 x:0 0 0 2024-02-19T19:12:12.238 INFO:tasks.workunit.client.1.smithi125.stdout:0/297: symlink d5/d19/d27/l72 0 2024-02-19T19:12:12.238 INFO:tasks.workunit.client.1.smithi125.stdout:0/298: getdents d5/d33/d46 0 2024-02-19T19:12:12.242 INFO:tasks.workunit.client.1.smithi125.stdout:7/319: dwrite f8 [479232,90112] 0 2024-02-19T19:12:12.243 INFO:tasks.workunit.client.1.smithi125.stdout:7/320: truncate f1 2151960 0 2024-02-19T19:12:12.243 INFO:tasks.workunit.client.1.smithi125.stdout:7/321: creat d12/d25/f58 x:0 0 0 2024-02-19T19:12:12.243 INFO:tasks.workunit.client.1.smithi125.stdout:7/322: rename d12/d25 to d12/d18/d44/d3b/d59 0 2024-02-19T19:12:12.243 INFO:tasks.workunit.client.1.smithi125.stdout:5/499: dwrite db/d26/f77 [397312,12288] 0 2024-02-19T19:12:12.243 INFO:tasks.workunit.client.1.smithi125.stdout:7/323: readlink d12/d18/d44/d3b/d59/d2a/d48/l4d 0 2024-02-19T19:12:12.243 INFO:tasks.workunit.client.1.smithi125.stdout:5/500: stat db/d17/d58/d4f 0 2024-02-19T19:12:12.243 INFO:tasks.workunit.client.1.smithi125.stdout:5/501: mknod db/d26/d51/ca2 0 2024-02-19T19:12:12.244 INFO:tasks.workunit.client.1.smithi125.stdout:7/324: symlink d12/d18/d44/d51/l5a 0 2024-02-19T19:12:12.244 INFO:tasks.workunit.client.1.smithi125.stdout:7/325: creat d12/d18/d44/d3b/d59/d26/d54/f5b x:0 0 0 2024-02-19T19:12:12.244 INFO:tasks.workunit.client.1.smithi125.stdout:5/502: unlink f6 0 2024-02-19T19:12:12.244 INFO:tasks.workunit.client.1.smithi125.stdout:0/299: dwrite d5/d9/f1d [1363968,20480] 0 2024-02-19T19:12:12.341 INFO:tasks.workunit.client.1.smithi125.stdout:8/324: fsync db/f16 0 2024-02-19T19:12:12.342 INFO:tasks.workunit.client.1.smithi125.stdout:6/283: fsync d6/d4a/d2f/f48 0 2024-02-19T19:12:12.342 INFO:tasks.workunit.client.1.smithi125.stdout:5/503: dwrite db/d47/f6a [1163264,102400] 0 2024-02-19T19:12:12.342 INFO:tasks.workunit.client.1.smithi125.stdout:5/504: readlink db/d17/d58/d25/l9b 0 2024-02-19T19:12:12.342 INFO:tasks.workunit.client.1.smithi125.stdout:5/505: mknod db/d17/d58/d33/d64/ca3 0 2024-02-19T19:12:12.342 INFO:tasks.workunit.client.1.smithi125.stdout:5/506: creat db/d17/d58/d33/d98/d9c/fa4 x:0 0 0 2024-02-19T19:12:12.345 INFO:tasks.workunit.client.1.smithi125.stdout:1/354: dwrite d1/dc/d36/f66 [868352,94208] 0 2024-02-19T19:12:12.345 INFO:tasks.workunit.client.1.smithi125.stdout:0/300: dread d5/d33/d42/f45 [69632,90112] 0 2024-02-19T19:12:12.345 INFO:tasks.workunit.client.1.smithi125.stdout:0/301: creat d5/d19/d2b/f73 x:0 0 0 2024-02-19T19:12:12.345 INFO:tasks.workunit.client.1.smithi125.stdout:0/302: symlink d5/d15/l74 0 2024-02-19T19:12:12.345 INFO:tasks.workunit.client.1.smithi125.stdout:5/507: dread db/d47/d52/f4e [1347584,12288] 0 2024-02-19T19:12:12.347 INFO:tasks.workunit.client.1.smithi125.stdout:8/325: dwrite db/d18/d30/d48/f57 [974848,114688] 0 2024-02-19T19:12:12.348 INFO:tasks.workunit.client.1.smithi125.stdout:1/355: read d1/dc/d36/d39/f5f [735765,29746] 0 2024-02-19T19:12:12.349 INFO:tasks.workunit.client.1.smithi125.stdout:1/356: dread - d1/d26/f71 zero size 2024-02-19T19:12:12.349 INFO:tasks.workunit.client.1.smithi125.stdout:0/303: dwrite d5/d19/f2f [1708032,77824] 0 2024-02-19T19:12:12.350 INFO:tasks.workunit.client.1.smithi125.stdout:5/508: dwrite db/d17/d58/d25/d40/f5b [335872,106496] 0 2024-02-19T19:12:12.350 INFO:tasks.workunit.client.1.smithi125.stdout:5/509: rmdir db/d17/d58/d33 39 2024-02-19T19:12:12.350 INFO:tasks.workunit.client.1.smithi125.stdout:5/510: chown db/d26/d51/f7c 2 1 2024-02-19T19:12:12.351 INFO:tasks.workunit.client.1.smithi125.stdout:4/281: sync 2024-02-19T19:12:12.353 INFO:tasks.workunit.client.1.smithi125.stdout:8/326: dread db/d18/f1b [0,53248] 0 2024-02-19T19:12:12.353 INFO:tasks.workunit.client.1.smithi125.stdout:1/357: dread d1/d1a/f50 [192512,40960] 0 2024-02-19T19:12:12.353 INFO:tasks.workunit.client.1.smithi125.stdout:1/358: read - d1/dc/d36/f4f zero size 2024-02-19T19:12:12.353 INFO:tasks.workunit.client.1.smithi125.stdout:1/359: creat d1/d1a/d3d/d6e/d4b/f75 x:0 0 0 2024-02-19T19:12:12.353 INFO:tasks.workunit.client.1.smithi125.stdout:1/360: dread - d1/f45 zero size 2024-02-19T19:12:12.353 INFO:tasks.workunit.client.1.smithi125.stdout:1/361: dread - d1/d1a/d3d/f44 zero size 2024-02-19T19:12:12.353 INFO:tasks.workunit.client.1.smithi125.stdout:1/362: rename d1/dc/d36/l43 to d1/d26/d3c/d3f/l76 0 2024-02-19T19:12:12.353 INFO:tasks.workunit.client.1.smithi125.stdout:1/363: dread d1/dc/f1f [266240,122880] 0 2024-02-19T19:12:12.354 INFO:tasks.workunit.client.1.smithi125.stdout:1/364: write d1/d1a/d3d/d6e/d4b/f75 [178688,77868] 0 2024-02-19T19:12:12.354 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.331+0000 7f43370a6700 1 -- 172.21.15.96:0/3133620909 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f43300611d0 con 0x7f432006d8a0 2024-02-19T19:12:12.363 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.341+0000 7f432dffb700 1 -- 172.21.15.96:0/3133620909 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f43300611d0 con 0x7f432006d8a0 2024-02-19T19:12:12.363 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:12:12.364 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (6m) 91s ago 15m 24.9M - 0.25.0 c8568f914cd2 bbaf83a1e476 2024-02-19T19:12:12.364 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (16m) 91s ago 16m 8652k - 18.2.1 94eadd990e0a b41bff2e0043 2024-02-19T19:12:12.364 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (15m) 20s ago 15m 8560k - 18.2.1 94eadd990e0a 254ab7e7a040 2024-02-19T19:12:12.364 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3m) 91s ago 16m 6669k - 19.0.0-1450-gf78a58c0 f081f847070a deea0ffefa0f 2024-02-19T19:12:12.364 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (3m) 20s ago 14m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 3421965dc5b0 2024-02-19T19:12:12.364 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (5m) 91s ago 15m 86.6M - 9.4.12 a0ea5e3c46d9 0102d90938e4 2024-02-19T19:12:12.364 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (10m) 91s ago 10m 27.6M - 18.2.1 94eadd990e0a 0a61d9cd40d1 2024-02-19T19:12:12.364 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (10m) 91s ago 10m 24.6M - 18.2.1 94eadd990e0a 58db3e7a7d75 2024-02-19T19:12:12.364 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (10m) 20s ago 10m 53.9M - 18.2.1 94eadd990e0a 211d64de8a63 2024-02-19T19:12:12.365 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (10m) 20s ago 10m 75.3M - 18.2.1 94eadd990e0a 2a04b5a8eaf4 2024-02-19T19:12:12.365 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:8443,9283,8765 running (7m) 91s ago 17m 500M - 19.0.0-1450-gf78a58c0 f081f847070a a86fbe94fe3f 2024-02-19T19:12:12.365 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (7m) 20s ago 14m 449M - 19.0.0-1450-gf78a58c0 f081f847070a e250486d572d 2024-02-19T19:12:12.365 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4m) 91s ago 17m 50.6M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d70090d516e3 2024-02-19T19:12:12.365 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (3m) 20s ago 14m 42.2M 2048M 19.0.0-1450-gf78a58c0 f081f847070a f56b17bdc9a0 2024-02-19T19:12:12.365 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (7m) 91s ago 16m 15.1M - 1.5.0 0da6a335fe13 51f622ea33d6 2024-02-19T19:12:12.366 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (7m) 20s ago 14m 17.0M - 1.5.0 0da6a335fe13 464e076a52a1 2024-02-19T19:12:12.366 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (2m) 91s ago 14m 46.9M 1216M 19.0.0-1450-gf78a58c0 f081f847070a b3dffd6a3fb2 2024-02-19T19:12:12.366 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2m) 91s ago 13m 44.4M 1216M 19.0.0-1450-gf78a58c0 f081f847070a f0dd6d8f952f 2024-02-19T19:12:12.366 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (98s) 91s ago 13m 14.8M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 51b70eaaa7a9 2024-02-19T19:12:12.366 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (59s) 20s ago 12m 76.9M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 73b832b7b243 2024-02-19T19:12:12.366 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (24s) 20s ago 12m 15.0M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 1309ffc459f9 2024-02-19T19:12:12.366 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (11m) 20s ago 11m 96.3M 2240M 18.2.1 94eadd990e0a e5731974b46a 2024-02-19T19:12:12.366 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (6m) 91s ago 15m 64.9M - 2.43.0 a07b618ecd1d a4edcf6ed669 2024-02-19T19:12:12.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.343+0000 7f43370a6700 1 -- 172.21.15.96:0/3133620909 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f432006d8a0 msgr2=0x7f432006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:12.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.343+0000 7f43370a6700 1 --2- 172.21.15.96:0/3133620909 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f432006d8a0 0x7f432006fd60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4330074880 tx=0x7f431c009260 comp rx=0 tx=0).stop 2024-02-19T19:12:12.367 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.343+0000 7f43370a6700 1 -- 172.21.15.96:0/3133620909 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4330100ea0 msgr2=0x7f4330073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:12.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.343+0000 7f43370a6700 1 --2- 172.21.15.96:0/3133620909 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4330100ea0 0x7f4330073090 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4324009fd0 tx=0x7f432400f690 comp rx=0 tx=0).stop 2024-02-19T19:12:12.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.343+0000 7f43370a6700 1 -- 172.21.15.96:0/3133620909 shutdown_connections 2024-02-19T19:12:12.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.343+0000 7f43370a6700 1 --2- 172.21.15.96:0/3133620909 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f432006d8a0 0x7f432006fd60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:12.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.343+0000 7f43370a6700 1 --2- 172.21.15.96:0/3133620909 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4330100ea0 0x7f4330073090 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:12.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.343+0000 7f43370a6700 1 --2- 172.21.15.96:0/3133620909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4330101850 0x7f43300735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:12.368 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.343+0000 7f43370a6700 1 -- 172.21.15.96:0/3133620909 >> 172.21.15.96:0/3133620909 conn(0x7f43300fc750 msgr2=0x7f43300fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:12.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.343+0000 7f43370a6700 1 -- 172.21.15.96:0/3133620909 shutdown_connections 2024-02-19T19:12:12.369 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.343+0000 7f43370a6700 1 -- 172.21.15.96:0/3133620909 wait complete. 2024-02-19T19:12:12.466 INFO:tasks.workunit.client.1.smithi125.stdout:0/304: fsync d5/d19/d4a/f4f 0 2024-02-19T19:12:12.467 INFO:tasks.workunit.client.1.smithi125.stdout:0/305: write d5/d19/d27/d32/f37 [2244373,76591] 0 2024-02-19T19:12:12.467 INFO:tasks.workunit.client.1.smithi125.stdout:1/365: fdatasync d1/d26/d3c/f6f 0 2024-02-19T19:12:12.467 INFO:tasks.workunit.client.1.smithi125.stdout:4/282: dwrite d0/d32/f36 [618496,53248] 0 2024-02-19T19:12:12.468 INFO:tasks.workunit.client.1.smithi125.stdout:4/283: rename d0/d7/dc to d0/d7/d30/d58 0 2024-02-19T19:12:12.470 INFO:tasks.workunit.client.1.smithi125.stdout:5/511: dwrite db/d17/d58/d25/f3c [1486848,114688] 0 2024-02-19T19:12:12.470 INFO:tasks.workunit.client.1.smithi125.stdout:5/512: stat db/d26/d51/l5c 0 2024-02-19T19:12:12.470 INFO:tasks.workunit.client.1.smithi125.stdout:4/284: dwrite d0/d7/d30/d58/fd [1073152,16384] 0 2024-02-19T19:12:12.471 INFO:tasks.workunit.client.1.smithi125.stdout:4/285: dread d0/f40 [233472,4096] 0 2024-02-19T19:12:12.471 INFO:tasks.workunit.client.1.smithi125.stdout:4/286: dread d0/d7/d30/d58/fd [278528,81920] 0 2024-02-19T19:12:12.471 INFO:tasks.workunit.client.1.smithi125.stdout:4/287: link d0/d7/f13 d0/f59 0 2024-02-19T19:12:12.471 INFO:tasks.workunit.client.1.smithi125.stdout:4/288: mknod d0/d32/c5a 0 2024-02-19T19:12:12.471 INFO:tasks.workunit.client.1.smithi125.stdout:4/289: symlink d0/d7/d30/d42/l5b 0 2024-02-19T19:12:12.471 INFO:tasks.workunit.client.1.smithi125.stdout:4/290: creat d0/f5c x:0 0 0 2024-02-19T19:12:12.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.446+0000 7f7d54491700 1 -- 172.21.15.96:0/3267515658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d4c0ffc20 msgr2=0x7f7d4c100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:12.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.446+0000 7f7d54491700 1 --2- 172.21.15.96:0/3267515658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d4c0ffc20 0x7f7d4c100080 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7d40009910 tx=0x7f7d40009c20 comp rx=0 tx=0).stop 2024-02-19T19:12:12.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.446+0000 7f7d54491700 1 -- 172.21.15.96:0/3267515658 shutdown_connections 2024-02-19T19:12:12.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.446+0000 7f7d54491700 1 --2- 172.21.15.96:0/3267515658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d4c0ffc20 0x7f7d4c100080 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:12.473 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.446+0000 7f7d54491700 1 --2- 172.21.15.96:0/3267515658 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d4c105bd0 0x7f7d4c105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:12.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.446+0000 7f7d54491700 1 -- 172.21.15.96:0/3267515658 >> 172.21.15.96:0/3267515658 conn(0x7f7d4c075670 msgr2=0x7f7d4c075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:12.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.446+0000 7f7d54491700 1 -- 172.21.15.96:0/3267515658 shutdown_connections 2024-02-19T19:12:12.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.446+0000 7f7d54491700 1 -- 172.21.15.96:0/3267515658 wait complete. 2024-02-19T19:12:12.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.446+0000 7f7d54491700 1 Processor -- start 2024-02-19T19:12:12.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.447+0000 7f7d54491700 1 -- start start 2024-02-19T19:12:12.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.447+0000 7f7d54491700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d4c0ffc20 0x7f7d4c19b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:12.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.447+0000 7f7d54491700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d4c105bd0 0x7f7d4c19bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:12.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.447+0000 7f7d54491700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c195620 con 0x7f7d4c0ffc20 2024-02-19T19:12:12.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.447+0000 7f7d54491700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c195790 con 0x7f7d4c105bd0 2024-02-19T19:12:12.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.447+0000 7f7d5222d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d4c0ffc20 0x7f7d4c19b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:12.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.447+0000 7f7d5222d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d4c0ffc20 0x7f7d4c19b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55922/0 (socket says 172.21.15.96:55922) 2024-02-19T19:12:12.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.447+0000 7f7d5222d700 1 -- 172.21.15.96:0/973296977 learned_addr learned my addr 172.21.15.96:0/973296977 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:12:12.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.447+0000 7f7d51a2c700 1 --2- 172.21.15.96:0/973296977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d4c105bd0 0x7f7d4c19bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:12.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.447+0000 7f7d5222d700 1 -- 172.21.15.96:0/973296977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d4c105bd0 msgr2=0x7f7d4c19bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:12.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.447+0000 7f7d5222d700 1 --2- 172.21.15.96:0/973296977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d4c105bd0 0x7f7d4c19bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:12.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.447+0000 7f7d5222d700 1 -- 172.21.15.96:0/973296977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d400095f0 con 0x7f7d4c0ffc20 2024-02-19T19:12:12.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.447+0000 7f7d5222d700 1 --2- 172.21.15.96:0/973296977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d4c0ffc20 0x7f7d4c19b630 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400d900 tx=0x7f7d4400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:12.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.447+0000 7f7d4b7fe700 1 -- 172.21.15.96:0/973296977 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d440041f0 con 0x7f7d4c0ffc20 2024-02-19T19:12:12.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.447+0000 7f7d4b7fe700 1 -- 172.21.15.96:0/973296977 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d44004cf0 con 0x7f7d4c0ffc20 2024-02-19T19:12:12.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.447+0000 7f7d4b7fe700 1 -- 172.21.15.96:0/973296977 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d4400b750 con 0x7f7d4c0ffc20 2024-02-19T19:12:12.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.448+0000 7f7d54491700 1 -- 172.21.15.96:0/973296977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4c195a70 con 0x7f7d4c0ffc20 2024-02-19T19:12:12.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.448+0000 7f7d54491700 1 -- 172.21.15.96:0/973296977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c195fc0 con 0x7f7d4c0ffc20 2024-02-19T19:12:12.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.449+0000 7f7d54491700 1 -- 172.21.15.96:0/973296977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4c1080d0 con 0x7f7d4c0ffc20 2024-02-19T19:12:12.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.449+0000 7f7d4b7fe700 1 -- 172.21.15.96:0/973296977 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f7d44004750 con 0x7f7d4c0ffc20 2024-02-19T19:12:12.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.449+0000 7f7d4b7fe700 1 --2- 172.21.15.96:0/973296977 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7d3406d8a0 0x7f7d3406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:12.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.450+0000 7f7d4b7fe700 1 -- 172.21.15.96:0/973296977 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7d4408d2d0 con 0x7f7d4c0ffc20 2024-02-19T19:12:12.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.450+0000 7f7d51a2c700 1 --2- 172.21.15.96:0/973296977 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7d3406d8a0 0x7f7d3406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:12.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.450+0000 7f7d51a2c700 1 --2- 172.21.15.96:0/973296977 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7d3406d8a0 0x7f7d3406fd60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c196ec0 tx=0x7f7d4001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:12.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.454+0000 7f7d4b7fe700 1 -- 172.21.15.96:0/973296977 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7d44056bb0 con 0x7f7d4c0ffc20 2024-02-19T19:12:12.481 INFO:tasks.workunit.client.1.smithi125.stdout:8/327: dread db/f16 [430080,81920] 0 2024-02-19T19:12:12.481 INFO:tasks.workunit.client.1.smithi125.stdout:8/328: symlink db/d18/d2f/l69 0 2024-02-19T19:12:12.481 INFO:tasks.workunit.client.1.smithi125.stdout:8/329: dread db/d18/d30/d3c/f53 [446464,4096] 0 2024-02-19T19:12:12.505 INFO:tasks.workunit.client.1.smithi125.stdout:0/306: fsync d5/d15/f52 0 2024-02-19T19:12:12.506 INFO:tasks.workunit.client.1.smithi125.stdout:1/366: fdatasync d1/d26/d29/f35 0 2024-02-19T19:12:12.506 INFO:tasks.workunit.client.1.smithi125.stdout:1/367: write d1/dc/f2c [900906,118161] 0 2024-02-19T19:12:12.506 INFO:tasks.workunit.client.1.smithi125.stdout:4/291: fsync d0/d7/d30/d58/f29 0 2024-02-19T19:12:12.512 INFO:tasks.workunit.client.1.smithi125.stdout:8/330: dwrite db/d18/f62 [184320,126976] 0 2024-02-19T19:12:12.512 INFO:tasks.workunit.client.1.smithi125.stdout:0/307: dwrite d5/d19/f62 [983040,40960] 0 2024-02-19T19:12:12.512 INFO:tasks.workunit.client.1.smithi125.stdout:1/368: creat d1/dc/d36/f77 x:0 0 0 2024-02-19T19:12:12.512 INFO:tasks.workunit.client.1.smithi125.stdout:4/292: mkdir d0/d7/d30/d5d 0 2024-02-19T19:12:12.512 INFO:tasks.workunit.client.1.smithi125.stdout:5/513: dread db/d17/f41 [225280,106496] 0 2024-02-19T19:12:12.513 INFO:tasks.workunit.client.1.smithi125.stdout:1/369: mkdir d1/d78 0 2024-02-19T19:12:12.513 INFO:tasks.workunit.client.1.smithi125.stdout:4/293: mkdir d0/df/d5e 0 2024-02-19T19:12:12.513 INFO:tasks.workunit.client.1.smithi125.stdout:5/514: mknod db/d17/ca5 0 2024-02-19T19:12:12.513 INFO:tasks.workunit.client.1.smithi125.stdout:1/370: truncate d1/f70 431841 0 2024-02-19T19:12:12.513 INFO:tasks.workunit.client.1.smithi125.stdout:1/371: truncate d1/dc/f2c 1692435 0 2024-02-19T19:12:12.513 INFO:tasks.workunit.client.1.smithi125.stdout:4/294: creat d0/d7/d3b/f5f x:0 0 0 2024-02-19T19:12:12.513 INFO:tasks.workunit.client.1.smithi125.stdout:4/295: chown d0/f1b 4468 1 2024-02-19T19:12:12.513 INFO:tasks.workunit.client.1.smithi125.stdout:5/515: rename db/l1a to db/d26/la6 0 2024-02-19T19:12:12.513 INFO:tasks.workunit.client.1.smithi125.stdout:0/308: write d5/d9/f26 [2248438,66885] 0 2024-02-19T19:12:12.513 INFO:tasks.workunit.client.1.smithi125.stdout:5/516: stat db/f69 0 2024-02-19T19:12:12.514 INFO:tasks.workunit.client.1.smithi125.stdout:5/517: mknod db/d17/d58/d33/d98/d9c/ca7 0 2024-02-19T19:12:12.514 INFO:tasks.workunit.client.1.smithi125.stdout:5/518: symlink db/d17/d58/d25/la8 0 2024-02-19T19:12:12.514 INFO:tasks.workunit.client.1.smithi125.stdout:5/519: readlink db/d47/d52/la1 0 2024-02-19T19:12:12.514 INFO:tasks.workunit.client.1.smithi125.stdout:4/296: write d0/d32/f36 [910854,128509] 0 2024-02-19T19:12:12.514 INFO:tasks.workunit.client.1.smithi125.stdout:4/297: mkdir d0/d32/d60 0 2024-02-19T19:12:12.514 INFO:tasks.workunit.client.1.smithi125.stdout:4/298: rename d0/f5c to d0/d32/f61 0 2024-02-19T19:12:12.514 INFO:tasks.workunit.client.1.smithi125.stdout:4/299: rename d0/d32/f47 to d0/d7/d3b/f62 0 2024-02-19T19:12:12.566 INFO:tasks.workunit.client.1.smithi125.stdout:8/331: dwrite db/f10 [208896,57344] 0 2024-02-19T19:12:12.567 INFO:tasks.workunit.client.1.smithi125.stdout:8/332: write db/d18/d30/f4f [31048,105211] 0 2024-02-19T19:12:12.567 INFO:tasks.workunit.client.1.smithi125.stdout:8/333: unlink db/f10 0 2024-02-19T19:12:12.567 INFO:tasks.workunit.client.1.smithi125.stdout:8/334: truncate db/f65 381344 0 2024-02-19T19:12:12.567 INFO:tasks.workunit.client.1.smithi125.stdout:8/335: rmdir db/d18/d30/d48 39 2024-02-19T19:12:12.569 INFO:tasks.workunit.client.1.smithi125.stdout:8/336: rmdir db/d18/d30/d3c/d4d 39 2024-02-19T19:12:12.569 INFO:tasks.workunit.client.1.smithi125.stdout:8/337: write db/f26 [504384,47278] 0 2024-02-19T19:12:12.570 INFO:tasks.workunit.client.1.smithi125.stdout:8/338: unlink db/d18/l33 0 2024-02-19T19:12:12.570 INFO:tasks.workunit.client.1.smithi125.stdout:2/306: sync 2024-02-19T19:12:12.570 INFO:tasks.workunit.client.1.smithi125.stdout:9/299: sync 2024-02-19T19:12:12.571 INFO:tasks.workunit.client.1.smithi125.stdout:9/300: truncate d8/f28 1723912 0 2024-02-19T19:12:12.571 INFO:tasks.workunit.client.1.smithi125.stdout:2/307: creat d1/f59 x:0 0 0 2024-02-19T19:12:12.571 INFO:tasks.workunit.client.1.smithi125.stdout:0/309: dwrite d5/d19/d27/d32/f37 [1781760,32768] 0 2024-02-19T19:12:12.571 INFO:tasks.workunit.client.1.smithi125.stdout:9/301: mknod d8/d2e/d4c/c69 0 2024-02-19T19:12:12.571 INFO:tasks.workunit.client.1.smithi125.stdout:9/302: write f3 [1314557,75227] 0 2024-02-19T19:12:12.582 INFO:tasks.workunit.client.1.smithi125.stdout:1/372: dread d1/d26/d3c/f64 [69632,114688] 0 2024-02-19T19:12:12.582 INFO:tasks.workunit.client.1.smithi125.stdout:1/373: readlink d1/d26/l21 0 2024-02-19T19:12:12.591 INFO:tasks.workunit.client.1.smithi125.stdout:5/520: write db/d17/d58/ff [169747,85236] 0 2024-02-19T19:12:12.591 INFO:tasks.workunit.client.1.smithi125.stdout:5/521: chown db/d47/c54 151767463 1 2024-02-19T19:12:12.592 INFO:tasks.workunit.client.1.smithi125.stdout:5/522: read db/d47/d52/f4e [416447,127570] 0 2024-02-19T19:12:12.592 INFO:tasks.workunit.client.1.smithi125.stdout:5/523: rmdir db/d17/d58/d4f 39 2024-02-19T19:12:12.592 INFO:tasks.workunit.client.1.smithi125.stdout:5/524: creat db/d17/d58/d33/d64/fa9 x:0 0 0 2024-02-19T19:12:12.639 INFO:tasks.workunit.client.1.smithi125.stdout:0/310: dwrite d5/d19/d27/d32/f37 [2818048,122880] 0 2024-02-19T19:12:12.639 INFO:tasks.workunit.client.1.smithi125.stdout:0/311: mkdir d5/d9/d75 0 2024-02-19T19:12:12.639 INFO:tasks.workunit.client.1.smithi125.stdout:0/312: symlink d5/d19/d48/l76 0 2024-02-19T19:12:12.639 INFO:tasks.workunit.client.1.smithi125.stdout:0/313: creat d5/d15/d2c/f77 x:0 0 0 2024-02-19T19:12:12.639 INFO:tasks.workunit.client.1.smithi125.stdout:0/314: creat d5/d19/f78 x:0 0 0 2024-02-19T19:12:12.639 INFO:tasks.workunit.client.1.smithi125.stdout:0/315: link d5/d33/d42/f45 d5/d1a/f79 0 2024-02-19T19:12:12.640 INFO:tasks.workunit.client.1.smithi125.stdout:0/316: chown d5/d15/d2c/f77 830 1 2024-02-19T19:12:12.640 INFO:tasks.workunit.client.1.smithi125.stdout:0/317: readlink d5/d9/l11 0 2024-02-19T19:12:12.640 INFO:tasks.workunit.client.1.smithi125.stdout:0/318: link d5/d9/f26 d5/d19/d2b/f7a 0 2024-02-19T19:12:12.640 INFO:tasks.workunit.client.1.smithi125.stdout:0/319: symlink d5/d1a/l7b 0 2024-02-19T19:12:12.640 INFO:tasks.workunit.client.1.smithi125.stdout:0/320: symlink d5/d19/l7c 0 2024-02-19T19:12:12.640 INFO:tasks.workunit.client.1.smithi125.stdout:0/321: creat d5/d19/d27/d32/f7d x:0 0 0 2024-02-19T19:12:12.640 INFO:tasks.workunit.client.1.smithi125.stdout:0/322: chown d5/d19/d27/l72 719640 1 2024-02-19T19:12:12.640 INFO:tasks.workunit.client.1.smithi125.stdout:0/323: chown d5/d9/l14 55422 1 2024-02-19T19:12:12.641 INFO:tasks.workunit.client.1.smithi125.stdout:0/324: dread d5/d15/d2c/f43 [86016,122880] 0 2024-02-19T19:12:12.642 INFO:tasks.workunit.client.1.smithi125.stdout:1/374: dwrite d1/dc/d36/f66 [794624,49152] 0 2024-02-19T19:12:12.643 INFO:tasks.workunit.client.1.smithi125.stdout:1/375: readlink d1/d1a/l25 0 2024-02-19T19:12:12.643 INFO:tasks.workunit.client.1.smithi125.stdout:1/376: mknod d1/d1a/c79 0 2024-02-19T19:12:12.643 INFO:tasks.workunit.client.1.smithi125.stdout:1/377: creat d1/d26/d3c/d3f/f7a x:0 0 0 2024-02-19T19:12:12.643 INFO:tasks.workunit.client.1.smithi125.stdout:1/378: dread d1/d26/d3c/f46 [385024,32768] 0 2024-02-19T19:12:12.643 INFO:tasks.workunit.client.1.smithi125.stdout:1/379: read d1/d26/d23/f55 [357633,19226] 0 2024-02-19T19:12:12.643 INFO:tasks.workunit.client.1.smithi125.stdout:1/380: dread d1/d26/f3b [557056,90112] 0 2024-02-19T19:12:12.643 INFO:tasks.workunit.client.1.smithi125.stdout:1/381: truncate d1/f45 136944 0 2024-02-19T19:12:12.644 INFO:tasks.workunit.client.1.smithi125.stdout:1/382: unlink d1/d26/d29/l57 0 2024-02-19T19:12:12.644 INFO:tasks.workunit.client.1.smithi125.stdout:1/383: chown d1/d1a/f2a 0 1 2024-02-19T19:12:12.644 INFO:tasks.workunit.client.1.smithi125.stdout:1/384: link d1/dc/l4d d1/d26/d29/l7b 0 2024-02-19T19:12:12.644 INFO:tasks.workunit.client.1.smithi125.stdout:1/385: creat d1/dc/d36/d69/f7c x:0 0 0 2024-02-19T19:12:12.644 INFO:tasks.workunit.client.1.smithi125.stdout:1/386: getdents d1/dc/d36/d39 0 2024-02-19T19:12:12.644 INFO:tasks.workunit.client.1.smithi125.stdout:1/387: write d1/d26/d3c/f46 [221337,70763] 0 2024-02-19T19:12:12.644 INFO:tasks.workunit.client.1.smithi125.stdout:1/388: write d1/d26/d3c/f64 [1231081,98830] 0 2024-02-19T19:12:12.644 INFO:tasks.workunit.client.1.smithi125.stdout:1/389: rmdir d1/d26 39 2024-02-19T19:12:12.646 INFO:tasks.workunit.client.1.smithi125.stdout:8/339: write db/f16 [356268,101609] 0 2024-02-19T19:12:12.649 INFO:tasks.workunit.client.1.smithi125.stdout:0/325: read d5/d9/f1d [1340550,51271] 0 2024-02-19T19:12:12.698 INFO:tasks.workunit.client.1.smithi125.stdout:5/525: fdatasync db/d17/d58/f72 0 2024-02-19T19:12:12.698 INFO:tasks.workunit.client.1.smithi125.stdout:2/308: fdatasync d1/d27/d1d/d25/d2a/f34 0 2024-02-19T19:12:12.701 INFO:tasks.workunit.client.1.smithi125.stdout:1/390: dwrite d1/dc/fd [270336,73728] 0 2024-02-19T19:12:12.702 INFO:tasks.workunit.client.1.smithi125.stdout:8/340: rename db/d18/d30/d48/f49 to db/d18/d30/d3c/f6a 0 2024-02-19T19:12:12.702 INFO:tasks.workunit.client.1.smithi125.stdout:0/326: write d5/d1a/f20 [352196,12562] 0 2024-02-19T19:12:12.702 INFO:tasks.workunit.client.1.smithi125.stdout:0/327: creat d5/d33/f7e x:0 0 0 2024-02-19T19:12:12.703 INFO:tasks.workunit.client.1.smithi125.stdout:0/328: mknod d5/d9/c7f 0 2024-02-19T19:12:12.703 INFO:tasks.workunit.client.1.smithi125.stdout:0/329: rename d5/d19/d4a to d5/d15/d2c/d80 0 2024-02-19T19:12:12.703 INFO:tasks.workunit.client.1.smithi125.stdout:1/391: dwrite d1/dc/f1b [1753088,32768] 0 2024-02-19T19:12:12.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:12 smithi125 ceph-mon[86115]: pgmap v151: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-19T19:12:12.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:12 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-19T19:12:12.705 INFO:tasks.workunit.client.1.smithi125.stdout:1/392: write d1/dc/f1b [978847,69951] 0 2024-02-19T19:12:12.705 INFO:tasks.workunit.client.1.smithi125.stdout:1/393: readlink d1/dc/l1e 0 2024-02-19T19:12:12.705 INFO:tasks.workunit.client.1.smithi125.stdout:1/394: truncate d1/f30 496220 0 2024-02-19T19:12:12.705 INFO:tasks.workunit.client.1.smithi125.stdout:1/395: stat d1/d1a/c79 0 2024-02-19T19:12:12.705 INFO:tasks.workunit.client.1.smithi125.stdout:1/396: chown d1/d1a/d3d/d6e/d4b/l63 19137425 1 2024-02-19T19:12:12.705 INFO:tasks.workunit.client.1.smithi125.stdout:1/397: rename d1/d26/d3c/f6f to d1/d26/f7d 0 2024-02-19T19:12:12.705 INFO:tasks.workunit.client.1.smithi125.stdout:1/398: dread - d1/dc/f72 zero size 2024-02-19T19:12:12.706 INFO:tasks.workunit.client.1.smithi125.stdout:8/341: dwrite db/d18/d30/f43 [294912,110592] 0 2024-02-19T19:12:12.706 INFO:tasks.workunit.client.1.smithi125.stdout:0/330: truncate d5/d19/f62 1023959 0 2024-02-19T19:12:12.706 INFO:tasks.workunit.client.1.smithi125.stdout:0/331: chown d5/l68 3 1 2024-02-19T19:12:12.707 INFO:tasks.workunit.client.1.smithi125.stdout:2/309: dread d1/d27/d1d/d39/d40/f42 [708608,118784] 0 2024-02-19T19:12:12.707 INFO:tasks.workunit.client.1.smithi125.stdout:2/310: creat d1/d27/f5a x:0 0 0 2024-02-19T19:12:12.707 INFO:tasks.workunit.client.1.smithi125.stdout:2/311: stat d1/d27/d1d/d2c/f31 0 2024-02-19T19:12:12.759 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.737+0000 7f7d54491700 1 -- 172.21.15.96:0/973296977 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7d4c196be0 con 0x7f7d4c0ffc20 2024-02-19T19:12:12.760 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:12 smithi096 ceph-mon[112483]: pgmap v151: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-19T19:12:12.760 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:12 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-19T19:12:12.760 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.738+0000 7f7d4b7fe700 1 -- 172.21.15.96:0/973296977 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f7d44016330 con 0x7f7d4c0ffc20 2024-02-19T19:12:12.761 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:12:12.761 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:12:12.761 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:12:12.761 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:12:12.761 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:12:12.761 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:12:12.762 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:12:12.762 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:12:12.762 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 1, 2024-02-19T19:12:12.762 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 5 2024-02-19T19:12:12.762 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:12:12.762 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:12:12.762 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-19T19:12:12.762 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:12:12.762 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:12:12.763 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 5, 2024-02-19T19:12:12.763 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 9 2024-02-19T19:12:12.763 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:12:12.763 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:12:12.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.740+0000 7f7d54491700 1 -- 172.21.15.96:0/973296977 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7d3406d8a0 msgr2=0x7f7d3406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:12.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.740+0000 7f7d54491700 1 --2- 172.21.15.96:0/973296977 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7d3406d8a0 0x7f7d3406fd60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c196ec0 tx=0x7f7d4001a040 comp rx=0 tx=0).stop 2024-02-19T19:12:12.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.740+0000 7f7d54491700 1 -- 172.21.15.96:0/973296977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d4c0ffc20 msgr2=0x7f7d4c19b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:12.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.740+0000 7f7d54491700 1 --2- 172.21.15.96:0/973296977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d4c0ffc20 0x7f7d4c19b630 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400d900 tx=0x7f7d4400dc10 comp rx=0 tx=0).stop 2024-02-19T19:12:12.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.740+0000 7f7d54491700 1 -- 172.21.15.96:0/973296977 shutdown_connections 2024-02-19T19:12:12.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.740+0000 7f7d54491700 1 --2- 172.21.15.96:0/973296977 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7d3406d8a0 0x7f7d3406fd60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:12.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.740+0000 7f7d54491700 1 --2- 172.21.15.96:0/973296977 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7d4c0ffc20 0x7f7d4c19b630 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:12.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.740+0000 7f7d54491700 1 --2- 172.21.15.96:0/973296977 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d4c105bd0 0x7f7d4c19bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:12.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.740+0000 7f7d54491700 1 -- 172.21.15.96:0/973296977 >> 172.21.15.96:0/973296977 conn(0x7f7d4c075670 msgr2=0x7f7d4c0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:12.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.740+0000 7f7d54491700 1 -- 172.21.15.96:0/973296977 shutdown_connections 2024-02-19T19:12:12.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.740+0000 7f7d54491700 1 -- 172.21.15.96:0/973296977 wait complete. 2024-02-19T19:12:12.806 INFO:tasks.workunit.client.1.smithi125.stdout:0/332: dwrite d5/d1a/f55 [299008,77824] 0 2024-02-19T19:12:12.806 INFO:tasks.workunit.client.1.smithi125.stdout:0/333: chown d5/f1f 16219 1 2024-02-19T19:12:12.808 INFO:tasks.workunit.client.1.smithi125.stdout:8/342: write db/f36 [1518968,130599] 0 2024-02-19T19:12:12.810 INFO:tasks.workunit.client.1.smithi125.stdout:3/274: sync 2024-02-19T19:12:12.811 INFO:tasks.workunit.client.1.smithi125.stdout:7/326: sync 2024-02-19T19:12:12.811 INFO:tasks.workunit.client.1.smithi125.stdout:6/284: sync 2024-02-19T19:12:12.811 INFO:tasks.workunit.client.1.smithi125.stdout:7/327: mknod d12/d18/d44/d3b/d59/d2a/d48/c5c 0 2024-02-19T19:12:12.811 INFO:tasks.workunit.client.1.smithi125.stdout:6/285: creat d6/db/df/f51 x:0 0 0 2024-02-19T19:12:12.811 INFO:tasks.workunit.client.1.smithi125.stdout:7/328: chown d12/d18/d44/d3b/d52 1445895713 1 2024-02-19T19:12:12.811 INFO:tasks.workunit.client.1.smithi125.stdout:6/286: truncate d6/db/df/d3b/f3c 129870 0 2024-02-19T19:12:12.811 INFO:tasks.workunit.client.1.smithi125.stdout:7/329: rename d12/d18/d44/d3b/d59/d26/f43 to d12/d18/d44/d3b/d59/d2a/d48/f5d 0 2024-02-19T19:12:12.811 INFO:tasks.workunit.client.1.smithi125.stdout:7/330: rmdir d12/d18/d44/d3b 39 2024-02-19T19:12:12.812 INFO:tasks.workunit.client.1.smithi125.stdout:7/331: stat d12/d18/d44/d3b/d59/d26/d30/c38 0 2024-02-19T19:12:12.812 INFO:tasks.workunit.client.1.smithi125.stdout:6/287: unlink d6/db/df/l30 0 2024-02-19T19:12:12.812 INFO:tasks.workunit.client.1.smithi125.stdout:6/288: getdents d6/db/df 0 2024-02-19T19:12:12.812 INFO:tasks.workunit.client.1.smithi125.stdout:6/289: stat d6/d4a/d2f/f4f 0 2024-02-19T19:12:12.812 INFO:tasks.workunit.client.1.smithi125.stdout:6/290: getdents d6 0 2024-02-19T19:12:12.812 INFO:tasks.workunit.client.1.smithi125.stdout:6/291: dread d6/db/f17 [528384,40960] 0 2024-02-19T19:12:12.812 INFO:tasks.workunit.client.1.smithi125.stdout:2/312: dwrite d1/d27/d1d/d25/d2a/f34 [1499136,118784] 0 2024-02-19T19:12:12.813 INFO:tasks.workunit.client.1.smithi125.stdout:2/313: rename d1/d27/d1d/d16 to d1/d27/d1d/d16/d5b 22 2024-02-19T19:12:12.813 INFO:tasks.workunit.client.1.smithi125.stdout:2/314: creat d1/d27/d45/f5c x:0 0 0 2024-02-19T19:12:12.813 INFO:tasks.workunit.client.1.smithi125.stdout:2/315: write d1/f47 [1536399,111380] 0 2024-02-19T19:12:12.813 INFO:tasks.workunit.client.1.smithi125.stdout:0/334: dwrite d5/d1a/f34 [847872,4096] 0 2024-02-19T19:12:12.813 INFO:tasks.workunit.client.1.smithi125.stdout:2/316: rmdir d1/d27/d45/d4e 0 2024-02-19T19:12:12.813 INFO:tasks.workunit.client.1.smithi125.stdout:0/335: mknod d5/d15/d2c/d80/c81 0 2024-02-19T19:12:12.813 INFO:tasks.workunit.client.1.smithi125.stdout:2/317: mkdir d1/d27/d45/d5d 0 2024-02-19T19:12:12.813 INFO:tasks.workunit.client.1.smithi125.stdout:0/336: unlink d5/d9/l11 0 2024-02-19T19:12:12.814 INFO:tasks.workunit.client.1.smithi125.stdout:0/337: creat d5/d15/f82 x:0 0 0 2024-02-19T19:12:12.814 INFO:tasks.workunit.client.1.smithi125.stdout:0/338: symlink d5/d33/l83 0 2024-02-19T19:12:12.814 INFO:tasks.workunit.client.1.smithi125.stdout:0/339: mknod d5/c84 0 2024-02-19T19:12:12.814 INFO:tasks.workunit.client.1.smithi125.stdout:0/340: getdents d5/d19/d27/d32 0 2024-02-19T19:12:12.814 INFO:tasks.workunit.client.1.smithi125.stdout:0/341: chown d5/d19/d27/f5c 1 1 2024-02-19T19:12:12.859 INFO:tasks.workunit.client.1.smithi125.stdout:6/292: dwrite d6/d4a/d2f/f48 [741376,110592] 0 2024-02-19T19:12:12.859 INFO:tasks.workunit.client.1.smithi125.stdout:6/293: mkdir d6/d52 0 2024-02-19T19:12:12.860 INFO:tasks.workunit.client.1.smithi125.stdout:7/332: dwrite d12/f1f [2015232,45056] 0 2024-02-19T19:12:12.860 INFO:tasks.workunit.client.1.smithi125.stdout:7/333: write d12/d18/d44/d3b/d59/d2a/d48/f5d [115131,64846] 0 2024-02-19T19:12:12.862 INFO:tasks.workunit.client.1.smithi125.stdout:3/275: dwrite d0/f19 [466944,118784] 0 2024-02-19T19:12:12.862 INFO:tasks.workunit.client.1.smithi125.stdout:3/276: dread d0/d1/d1e/f2c [282624,122880] 0 2024-02-19T19:12:12.862 INFO:tasks.workunit.client.1.smithi125.stdout:3/277: dread - d0/d1/d4b/f4f zero size 2024-02-19T19:12:12.862 INFO:tasks.workunit.client.1.smithi125.stdout:3/278: link d0/de/f44 d0/d1/d4b/d52/f59 0 2024-02-19T19:12:12.862 INFO:tasks.workunit.client.1.smithi125.stdout:3/279: chown d0/l1a 0 1 2024-02-19T19:12:12.862 INFO:tasks.workunit.client.1.smithi125.stdout:3/280: rename d0/de/f28 to d0/d1/d1e/f5a 0 2024-02-19T19:12:12.863 INFO:tasks.workunit.client.1.smithi125.stdout:3/281: read d0/d1/f17 [69440,5761] 0 2024-02-19T19:12:12.863 INFO:tasks.workunit.client.1.smithi125.stdout:3/282: rename d0/de/f14 to d0/d1/d39/f5b 0 2024-02-19T19:12:12.863 INFO:tasks.workunit.client.1.smithi125.stdout:3/283: unlink d0/f32 0 2024-02-19T19:12:12.863 INFO:tasks.workunit.client.1.smithi125.stdout:3/284: dread - d0/d1/d4b/f4f zero size 2024-02-19T19:12:12.863 INFO:tasks.workunit.client.1.smithi125.stdout:3/285: rename d0/de/l21 to d0/l5c 0 2024-02-19T19:12:12.864 INFO:tasks.workunit.client.1.smithi125.stdout:7/334: dwrite d12/d18/d44/d3b/d59/d2a/d31/f36 [139264,114688] 0 2024-02-19T19:12:12.864 INFO:tasks.workunit.client.1.smithi125.stdout:7/335: rename f1 to d12/d18/d44/d3b/d59/f5e 0 2024-02-19T19:12:12.864 INFO:tasks.workunit.client.1.smithi125.stdout:7/336: write d12/d18/d44/d51/f56 [565529,114743] 0 2024-02-19T19:12:12.864 INFO:tasks.workunit.client.1.smithi125.stdout:7/337: creat d12/d18/d44/d3b/d59/d26/d54/f5f x:0 0 0 2024-02-19T19:12:12.865 INFO:tasks.workunit.client.1.smithi125.stdout:3/286: dwrite d0/d1/d39/f49 [524288,90112] 0 2024-02-19T19:12:12.865 INFO:tasks.workunit.client.1.smithi125.stdout:3/287: chown d0/d1/d4b/c4c 13557356 1 2024-02-19T19:12:12.865 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.843+0000 7f071a62d700 1 -- 172.21.15.96:0/2639655252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07140ffda0 msgr2=0x7f0714100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:12.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.843+0000 7f071a62d700 1 --2- 172.21.15.96:0/2639655252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07140ffda0 0x7f0714100180 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0704009910 tx=0x7f0704009c20 comp rx=0 tx=0).stop 2024-02-19T19:12:12.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.843+0000 7f071a62d700 1 -- 172.21.15.96:0/2639655252 shutdown_connections 2024-02-19T19:12:12.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.843+0000 7f071a62d700 1 --2- 172.21.15.96:0/2639655252 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0714100750 0x7f07141047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:12.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.843+0000 7f071a62d700 1 --2- 172.21.15.96:0/2639655252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07140ffda0 0x7f0714100180 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:12.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.843+0000 7f071a62d700 1 -- 172.21.15.96:0/2639655252 >> 172.21.15.96:0/2639655252 conn(0x7f07140fb650 msgr2=0x7f07140fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:12.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.843+0000 7f071a62d700 1 -- 172.21.15.96:0/2639655252 shutdown_connections 2024-02-19T19:12:12.866 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.843+0000 7f071a62d700 1 -- 172.21.15.96:0/2639655252 wait complete. 2024-02-19T19:12:12.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.844+0000 7f071a62d700 1 Processor -- start 2024-02-19T19:12:12.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.844+0000 7f071a62d700 1 -- start start 2024-02-19T19:12:12.868 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.844+0000 7f071a62d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07140ffda0 0x7f071419b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:12.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.844+0000 7f071a62d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0714100750 0x7f071419ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:12.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.844+0000 7f071a62d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071419c090 con 0x7f0714100750 2024-02-19T19:12:12.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.844+0000 7f071a62d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07141955d0 con 0x7f07140ffda0 2024-02-19T19:12:12.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.844+0000 7f07137fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0714100750 0x7f071419ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:12.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.844+0000 7f07137fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0714100750 0x7f071419ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55932/0 (socket says 172.21.15.96:55932) 2024-02-19T19:12:12.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.844+0000 7f07137fe700 1 -- 172.21.15.96:0/2370838614 learned_addr learned my addr 172.21.15.96:0/2370838614 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:12:12.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.845+0000 7f0713fff700 1 --2- 172.21.15.96:0/2370838614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07140ffda0 0x7f071419b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:12.869 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.845+0000 7f07137fe700 1 -- 172.21.15.96:0/2370838614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07140ffda0 msgr2=0x7f071419b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:12.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.845+0000 7f07137fe700 1 --2- 172.21.15.96:0/2370838614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07140ffda0 0x7f071419b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:12.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.845+0000 7f07137fe700 1 -- 172.21.15.96:0/2370838614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07040095f0 con 0x7f0714100750 2024-02-19T19:12:12.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.845+0000 7f07137fe700 1 --2- 172.21.15.96:0/2370838614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0714100750 0x7f071419ba90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f070800c960 tx=0x7f070800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:12.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.845+0000 7f07117fa700 1 -- 172.21.15.96:0/2370838614 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0708007a70 con 0x7f0714100750 2024-02-19T19:12:12.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.845+0000 7f07117fa700 1 -- 172.21.15.96:0/2370838614 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0708007bd0 con 0x7f0714100750 2024-02-19T19:12:12.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.845+0000 7f071a62d700 1 -- 172.21.15.96:0/2370838614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07141958b0 con 0x7f0714100750 2024-02-19T19:12:12.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.845+0000 7f07117fa700 1 -- 172.21.15.96:0/2370838614 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0708018630 con 0x7f0714100750 2024-02-19T19:12:12.870 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.845+0000 7f071a62d700 1 -- 172.21.15.96:0/2370838614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0714195e00 con 0x7f0714100750 2024-02-19T19:12:12.871 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.846+0000 7f071a62d700 1 -- 172.21.15.96:0/2370838614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0714108140 con 0x7f0714100750 2024-02-19T19:12:12.871 INFO:tasks.workunit.client.1.smithi125.stdout:8/343: truncate f4 772912 0 2024-02-19T19:12:12.871 INFO:tasks.workunit.client.1.smithi125.stdout:8/344: link f4 db/f6b 0 2024-02-19T19:12:12.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.847+0000 7f07117fa700 1 -- 172.21.15.96:0/2370838614 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f070800f450 con 0x7f0714100750 2024-02-19T19:12:12.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.847+0000 7f07117fa700 1 --2- 172.21.15.96:0/2370838614 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f06fc06d8a0 0x7f06fc06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:12.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.847+0000 7f07117fa700 1 -- 172.21.15.96:0/2370838614 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f070808d520 con 0x7f0714100750 2024-02-19T19:12:12.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.847+0000 7f0713fff700 1 --2- 172.21.15.96:0/2370838614 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f06fc06d8a0 0x7f06fc06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:12.872 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.847+0000 7f0713fff700 1 --2- 172.21.15.96:0/2370838614 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f06fc06d8a0 0x7f06fc06fd60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0704006010 tx=0x7f070401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:12.873 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:12.851+0000 7f07117fa700 1 -- 172.21.15.96:0/2370838614 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f070805a810 con 0x7f0714100750 2024-02-19T19:12:12.874 INFO:tasks.workunit.client.1.smithi125.stdout:0/342: dread d5/d9/f1d [552960,106496] 0 2024-02-19T19:12:12.918 INFO:tasks.workunit.client.1.smithi125.stdout:6/294: fsync d6/d4a/f2e 0 2024-02-19T19:12:12.919 INFO:tasks.workunit.client.1.smithi125.stdout:6/295: stat d6/db/df/d3b/f3c 0 2024-02-19T19:12:12.926 INFO:tasks.workunit.client.1.smithi125.stdout:0/343: read d5/d1a/f34 [768475,24016] 0 2024-02-19T19:12:12.927 INFO:tasks.workunit.client.1.smithi125.stdout:3/288: dwrite d0/f51 [954368,53248] 0 2024-02-19T19:12:12.927 INFO:tasks.workunit.client.1.smithi125.stdout:6/296: creat d6/d4a/d2f/d45/d4e/f53 x:0 0 0 2024-02-19T19:12:12.927 INFO:tasks.workunit.client.1.smithi125.stdout:2/318: dread d1/d27/d45/f56 [307200,73728] 0 2024-02-19T19:12:12.927 INFO:tasks.workunit.client.1.smithi125.stdout:8/345: creat db/d18/d30/d48/f6c x:0 0 0 2024-02-19T19:12:12.927 INFO:tasks.workunit.client.1.smithi125.stdout:0/344: write d5/d19/d2b/f7a [3185760,8992] 0 2024-02-19T19:12:12.927 INFO:tasks.workunit.client.1.smithi125.stdout:8/346: write db/d18/d2f/f39 [637975,20351] 0 2024-02-19T19:12:12.927 INFO:tasks.workunit.client.1.smithi125.stdout:2/319: symlink d1/d27/d1d/d39/d40/d4b/l5e 0 2024-02-19T19:12:12.927 INFO:tasks.workunit.client.1.smithi125.stdout:8/347: truncate db/f38 1818140 0 2024-02-19T19:12:12.928 INFO:tasks.workunit.client.1.smithi125.stdout:2/320: truncate d1/d27/d1d/d39/f48 19289 0 2024-02-19T19:12:12.928 INFO:tasks.workunit.client.1.smithi125.stdout:2/321: creat d1/d27/d1d/d25/d2a/f5f x:0 0 0 2024-02-19T19:12:12.928 INFO:tasks.workunit.client.1.smithi125.stdout:2/322: chown d1/d27/d1d/d25/d2a/f5f 1 1 2024-02-19T19:12:12.928 INFO:tasks.workunit.client.1.smithi125.stdout:2/323: dread d1/d27/f11 [1040384,122880] 0 2024-02-19T19:12:12.928 INFO:tasks.workunit.client.1.smithi125.stdout:2/324: chown d1/d27/f10 36 1 2024-02-19T19:12:12.928 INFO:tasks.workunit.client.1.smithi125.stdout:2/325: readlink d1/d36/l4a 0 2024-02-19T19:12:12.928 INFO:tasks.workunit.client.1.smithi125.stdout:2/326: rename d1/d27/l4f to d1/d27/d1d/d39/d40/d4b/l60 0 2024-02-19T19:12:12.933 INFO:tasks.workunit.client.1.smithi125.stdout:7/338: dread fc [204800,77824] 0 2024-02-19T19:12:12.934 INFO:tasks.workunit.client.1.smithi125.stdout:7/339: mkdir d12/d18/d44/d3b/d59/d2a/d31/d50/d60 0 2024-02-19T19:12:12.934 INFO:tasks.workunit.client.1.smithi125.stdout:7/340: truncate d12/d18/d44/f40 688628 0 2024-02-19T19:12:13.023 INFO:tasks.workunit.client.1.smithi125.stdout:8/348: dwrite db/f38 [1695744,69632] 0 2024-02-19T19:12:13.024 INFO:tasks.workunit.client.1.smithi125.stdout:2/327: dwrite d1/d27/d1d/d2c/f31 [2064384,73728] 0 2024-02-19T19:12:13.024 INFO:tasks.workunit.client.1.smithi125.stdout:8/349: mkdir db/d6d 0 2024-02-19T19:12:13.024 INFO:tasks.workunit.client.1.smithi125.stdout:2/328: mknod d1/d27/d1d/d39/c61 0 2024-02-19T19:12:13.024 INFO:tasks.workunit.client.1.smithi125.stdout:2/329: chown d1/d27/d1d/d25/f2d 2818 1 2024-02-19T19:12:13.024 INFO:tasks.workunit.client.1.smithi125.stdout:2/330: dread d1/d27/d1d/d25/f38 [286720,122880] 0 2024-02-19T19:12:13.024 INFO:tasks.workunit.client.1.smithi125.stdout:3/289: dwrite d0/de/f1c [208896,102400] 0 2024-02-19T19:12:13.024 INFO:tasks.workunit.client.1.smithi125.stdout:3/290: link d0/d1/d4b/d52/f59 d0/d1/d1e/f5d 0 2024-02-19T19:12:13.024 INFO:tasks.workunit.client.1.smithi125.stdout:3/291: dread - d0/d1/d4b/f50 zero size 2024-02-19T19:12:13.025 INFO:tasks.workunit.client.1.smithi125.stdout:2/331: read d1/d27/d1d/d25/f38 [392459,115245] 0 2024-02-19T19:12:13.025 INFO:tasks.workunit.client.1.smithi125.stdout:2/332: write d1/d27/d1d/d25/d2a/f5f [620177,105473] 0 2024-02-19T19:12:13.025 INFO:tasks.workunit.client.1.smithi125.stdout:2/333: symlink d1/d27/d1d/d39/d40/d4b/l62 0 2024-02-19T19:12:13.025 INFO:tasks.workunit.client.1.smithi125.stdout:6/297: dwrite d6/d4a/d2f/d45/d4e/f53 [921600,118784] 0 2024-02-19T19:12:13.025 INFO:tasks.workunit.client.1.smithi125.stdout:2/334: write d1/d27/d1d/f50 [551581,48348] 0 2024-02-19T19:12:13.025 INFO:tasks.workunit.client.1.smithi125.stdout:6/298: truncate d6/d4a/f19 1149163 0 2024-02-19T19:12:13.025 INFO:tasks.workunit.client.1.smithi125.stdout:2/335: rename d1/d27/d1d/d39/d40/f42 to d1/d27/d1d/d2c/d2e/f63 0 2024-02-19T19:12:13.025 INFO:tasks.workunit.client.1.smithi125.stdout:6/299: creat d6/db/df/f54 x:0 0 0 2024-02-19T19:12:13.025 INFO:tasks.workunit.client.1.smithi125.stdout:6/300: rename d6/db/df/d16/c1a to d6/db/d49/d4c/c55 0 2024-02-19T19:12:13.025 INFO:tasks.workunit.client.1.smithi125.stdout:0/345: dwrite d5/d19/f78 [622592,53248] 0 2024-02-19T19:12:13.026 INFO:tasks.workunit.client.1.smithi125.stdout:0/346: symlink d5/d19/d27/d32/l85 0 2024-02-19T19:12:13.026 INFO:tasks.workunit.client.1.smithi125.stdout:6/301: write d6/d4a/d29/f2d [3014879,109792] 0 2024-02-19T19:12:13.026 INFO:tasks.workunit.client.1.smithi125.stdout:0/347: chown d5/d1a/l2a 6151 1 2024-02-19T19:12:13.026 INFO:tasks.workunit.client.1.smithi125.stdout:6/302: link d6/db/df/d16/c42 d6/db/df/c56 0 2024-02-19T19:12:13.026 INFO:tasks.workunit.client.1.smithi125.stdout:6/303: readlink d6/db/df/d16/l1c 0 2024-02-19T19:12:13.026 INFO:tasks.workunit.client.1.smithi125.stdout:7/341: write d12/f1f [2055204,46059] 0 2024-02-19T19:12:13.026 INFO:tasks.workunit.client.1.smithi125.stdout:7/342: chown d12/d18/d44/d3b/d59/d26/d30/d37 0 1 2024-02-19T19:12:13.026 INFO:tasks.workunit.client.1.smithi125.stdout:6/304: getdents d6/d4a/d2f/d45 0 2024-02-19T19:12:13.027 INFO:tasks.workunit.client.1.smithi125.stdout:8/350: dwrite db/d18/f2a [1806336,102400] 0 2024-02-19T19:12:13.027 INFO:tasks.workunit.client.1.smithi125.stdout:8/351: symlink db/d18/d30/d48/d67/l6e 0 2024-02-19T19:12:13.027 INFO:tasks.workunit.client.1.smithi125.stdout:8/352: read db/d18/d2f/f39 [459416,113275] 0 2024-02-19T19:12:13.027 INFO:tasks.workunit.client.1.smithi125.stdout:8/353: mkdir db/d18/d30/d3c/d4d/d5d/d6f 0 2024-02-19T19:12:13.027 INFO:tasks.workunit.client.1.smithi125.stdout:8/354: chown db/d18/f32 7799 1 2024-02-19T19:12:13.027 INFO:tasks.workunit.client.1.smithi125.stdout:8/355: getdents db/d18/d30/d3c/d4d/d5d 0 2024-02-19T19:12:13.027 INFO:tasks.workunit.client.1.smithi125.stdout:8/356: getdents db 0 2024-02-19T19:12:13.027 INFO:tasks.workunit.client.1.smithi125.stdout:8/357: mkdir db/d18/d30/d3c/d70 0 2024-02-19T19:12:13.027 INFO:tasks.workunit.client.1.smithi125.stdout:8/358: chown db/d18/d30/d3c 16437039 1 2024-02-19T19:12:13.028 INFO:tasks.workunit.client.1.smithi125.stdout:8/359: dread db/d18/f32 [188416,94208] 0 2024-02-19T19:12:13.028 INFO:tasks.workunit.client.1.smithi125.stdout:8/360: unlink db/d18/f2a 0 2024-02-19T19:12:13.028 INFO:tasks.workunit.client.1.smithi125.stdout:8/361: write db/d18/f21 [223664,19187] 0 2024-02-19T19:12:13.059 INFO:tasks.workunit.client.1.smithi125.stdout:0/348: fdatasync d5/d1a/f79 0 2024-02-19T19:12:13.089 INFO:tasks.workunit.client.1.smithi125.stdout:8/362: fsync db/f16 0 2024-02-19T19:12:13.092 INFO:tasks.workunit.client.1.smithi125.stdout:3/292: dwrite d0/d1/f17 [1085440,4096] 0 2024-02-19T19:12:13.092 INFO:tasks.workunit.client.1.smithi125.stdout:7/343: dwrite d12/d18/d44/f47 [782336,53248] 0 2024-02-19T19:12:13.092 INFO:tasks.workunit.client.1.smithi125.stdout:2/336: dwrite d1/d27/d1d/d2c/f31 [98304,77824] 0 2024-02-19T19:12:13.092 INFO:tasks.workunit.client.1.smithi125.stdout:7/344: dread - d12/d18/d44/d3b/d59/d26/f3a zero size 2024-02-19T19:12:13.092 INFO:tasks.workunit.client.1.smithi125.stdout:7/345: link d12/d18/d44/d3b/d59/f58 d12/d18/d44/d3b/d59/d2a/d31/f61 0 2024-02-19T19:12:13.092 INFO:tasks.workunit.client.1.smithi125.stdout:7/346: rename d12/d18/d44/f47 to d12/d18/d44/d3b/d59/d26/d30/d37/f62 0 2024-02-19T19:12:13.092 INFO:tasks.workunit.client.1.smithi125.stdout:2/337: mkdir d1/d27/d1d/d39/d40/d4b/d64 0 2024-02-19T19:12:13.093 INFO:tasks.workunit.client.1.smithi125.stdout:2/338: unlink d1/d27/f8 0 2024-02-19T19:12:13.093 INFO:tasks.workunit.client.1.smithi125.stdout:2/339: stat d1/d27/d1d/d16 0 2024-02-19T19:12:13.093 INFO:tasks.workunit.client.1.smithi125.stdout:2/340: dread d1/d27/f22 [2998272,114688] 0 2024-02-19T19:12:13.093 INFO:tasks.workunit.client.1.smithi125.stdout:7/347: mkdir d12/d18/d63 0 2024-02-19T19:12:13.093 INFO:tasks.workunit.client.1.smithi125.stdout:7/348: stat d12/d18/d44/d3b/d59/d2a/d48/c5c 0 2024-02-19T19:12:13.093 INFO:tasks.workunit.client.1.smithi125.stdout:7/349: chown f5 362540 1 2024-02-19T19:12:13.094 INFO:tasks.workunit.client.1.smithi125.stdout:7/350: creat d12/d18/d44/d51/f64 x:0 0 0 2024-02-19T19:12:13.094 INFO:tasks.workunit.client.1.smithi125.stdout:7/351: chown d12/d18/d44/d3b/d52/l55 61800121 1 2024-02-19T19:12:13.094 INFO:tasks.workunit.client.1.smithi125.stdout:2/341: write d1/f59 [756027,60921] 0 2024-02-19T19:12:13.094 INFO:tasks.workunit.client.1.smithi125.stdout:7/352: unlink d12/d18/d44/d3b/d59/d2a/d48/f5d 0 2024-02-19T19:12:13.094 INFO:tasks.workunit.client.1.smithi125.stdout:2/342: link d1/d27/f11 d1/d27/d1d/d2c/d2e/f65 0 2024-02-19T19:12:13.094 INFO:tasks.workunit.client.1.smithi125.stdout:2/343: getdents d1/d27/d1d/d39/d40/d4b 0 2024-02-19T19:12:13.094 INFO:tasks.workunit.client.1.smithi125.stdout:7/353: symlink d12/d18/d44/d3b/d59/d26/d54/l65 0 2024-02-19T19:12:13.094 INFO:tasks.workunit.client.1.smithi125.stdout:7/354: mkdir d12/d18/d66 0 2024-02-19T19:12:13.095 INFO:tasks.workunit.client.1.smithi125.stdout:0/349: dwrite d5/d19/d2b/f7a [4009984,114688] 0 2024-02-19T19:12:13.095 INFO:tasks.workunit.client.1.smithi125.stdout:0/350: truncate d5/d19/d27/d32/f7d 989786 0 2024-02-19T19:12:13.096 INFO:tasks.workunit.client.1.smithi125.stdout:0/351: chown d5/f6d 14377 1 2024-02-19T19:12:13.096 INFO:tasks.workunit.client.1.smithi125.stdout:0/352: rename d5/d19 to d5/d19/d48/d86 22 2024-02-19T19:12:13.096 INFO:tasks.workunit.client.1.smithi125.stdout:0/353: mknod d5/d9/c87 0 2024-02-19T19:12:13.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.090+0000 7f071a62d700 1 -- 172.21.15.96:0/2370838614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0714196bc0 con 0x7f0714100750 2024-02-19T19:12:13.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.090+0000 7f07117fa700 1 -- 172.21.15.96:0/2370838614 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1886 (secure 0 0 0) 0x7f0714196bc0 con 0x7f0714100750 2024-02-19T19:12:13.113 INFO:teuthology.orchestra.run.smithi096.stdout:e20 2024-02-19T19:12:13.113 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:12:13.113 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:12:13.113 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2024-02-19T19:12:13.113 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:12:13.113 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:12:13.113 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2024-02-19T19:12:13.114 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 20 2024-02-19T19:12:13.114 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-19T19:12:13.114 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-02-19T19:01:42.881136+0000 2024-02-19T19:12:13.114 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2024-02-19T19:10:58.917735+0000 2024-02-19T19:12:13.114 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2024-02-19T19:12:13.115 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2024-02-19T19:12:13.115 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2024-02-19T19:12:13.115 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2024-02-19T19:12:13.115 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2024-02-19T19:12:13.115 INFO:teuthology.orchestra.run.smithi096.stdout:max_xattr_size 65536 2024-02-19T19:12:13.115 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2024-02-19T19:12:13.115 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2024-02-19T19:12:13.116 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 46 2024-02-19T19:12:13.116 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:12:13.116 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2024-02-19T19:12:13.116 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2024-02-19T19:12:13.116 INFO:teuthology.orchestra.run.smithi096.stdout:up {0=14490,1=24267} 2024-02-19T19:12:13.116 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2024-02-19T19:12:13.116 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2024-02-19T19:12:13.117 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2024-02-19T19:12:13.117 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2024-02-19T19:12:13.117 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2024-02-19T19:12:13.117 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data enabled 2024-02-19T19:12:13.117 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2024-02-19T19:12:13.117 INFO:teuthology.orchestra.run.smithi096.stdout:bal_rank_mask -1 2024-02-19T19:12:13.117 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2024-02-19T19:12:13.117 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pccmys{0:14490} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:12:13.118 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.usrmcg{0:14502} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/413113741,v1:172.21.15.96:6827/413113741] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:12:13.118 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.srnlol{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.125:6824/3084054986,v1:172.21.15.125:6825/3084054986] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:12:13.118 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.pwyuga{1:24275} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.125:6826/3098247423,v1:172.21.15.125:6827/3098247423] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:12:13.118 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:12:13.118 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:12:13.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.092+0000 7f071a62d700 1 -- 172.21.15.96:0/2370838614 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f06fc06d8a0 msgr2=0x7f06fc06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:13.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.092+0000 7f071a62d700 1 --2- 172.21.15.96:0/2370838614 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f06fc06d8a0 0x7f06fc06fd60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0704006010 tx=0x7f070401a040 comp rx=0 tx=0).stop 2024-02-19T19:12:13.119 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.092+0000 7f071a62d700 1 -- 172.21.15.96:0/2370838614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0714100750 msgr2=0x7f071419ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:13.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.092+0000 7f071a62d700 1 --2- 172.21.15.96:0/2370838614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0714100750 0x7f071419ba90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f070800c960 tx=0x7f070800cc70 comp rx=0 tx=0).stop 2024-02-19T19:12:13.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.092+0000 7f071a62d700 1 -- 172.21.15.96:0/2370838614 shutdown_connections 2024-02-19T19:12:13.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.092+0000 7f071a62d700 1 --2- 172.21.15.96:0/2370838614 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f06fc06d8a0 0x7f06fc06fd60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:13.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.092+0000 7f071a62d700 1 --2- 172.21.15.96:0/2370838614 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f07140ffda0 0x7f071419b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:13.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.092+0000 7f071a62d700 1 --2- 172.21.15.96:0/2370838614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0714100750 0x7f071419ba90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:13.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.092+0000 7f071a62d700 1 -- 172.21.15.96:0/2370838614 >> 172.21.15.96:0/2370838614 conn(0x7f07140fb650 msgr2=0x7f07140fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:13.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.093+0000 7f071a62d700 1 -- 172.21.15.96:0/2370838614 shutdown_connections 2024-02-19T19:12:13.121 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.093+0000 7f071a62d700 1 -- 172.21.15.96:0/2370838614 wait complete. 2024-02-19T19:12:13.121 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 20 2024-02-19T19:12:13.129 INFO:tasks.workunit.client.1.smithi125.stdout:3/293: fsync d0/d1/f58 0 2024-02-19T19:12:13.129 INFO:tasks.workunit.client.1.smithi125.stdout:3/294: dread d0/f33 [385024,45056] 0 2024-02-19T19:12:13.129 INFO:tasks.workunit.client.1.smithi125.stdout:3/295: creat d0/d1/d4b/d52/f5e x:0 0 0 2024-02-19T19:12:13.132 INFO:tasks.workunit.client.1.smithi125.stdout:0/354: dwrite d5/d1a/f55 [262144,24576] 0 2024-02-19T19:12:13.133 INFO:tasks.workunit.client.1.smithi125.stdout:0/355: dread - d5/d33/d46/f6b zero size 2024-02-19T19:12:13.133 INFO:tasks.workunit.client.1.smithi125.stdout:3/296: dwrite d0/d1/d1e/f34 [393216,20480] 0 2024-02-19T19:12:13.133 INFO:tasks.workunit.client.1.smithi125.stdout:3/297: dread - d0/de/f3b zero size 2024-02-19T19:12:13.133 INFO:tasks.workunit.client.1.smithi125.stdout:3/298: mkdir d0/d5f 0 2024-02-19T19:12:13.133 INFO:tasks.workunit.client.1.smithi125.stdout:7/355: dwrite d12/d18/d44/d3b/d59/d26/d30/d37/f3f [57344,90112] 0 2024-02-19T19:12:13.133 INFO:tasks.workunit.client.1.smithi125.stdout:7/356: read d12/f1f [161798,34213] 0 2024-02-19T19:12:13.133 INFO:tasks.workunit.client.1.smithi125.stdout:7/357: write d12/d18/d44/d3b/d59/d2a/d48/f49 [511974,25745] 0 2024-02-19T19:12:13.184 INFO:tasks.workunit.client.1.smithi125.stdout:7/358: mkdir d12/d18/d44/d3b/d59/d67 0 2024-02-19T19:12:13.184 INFO:tasks.workunit.client.1.smithi125.stdout:0/356: dwrite d5/d1a/f55 [286720,36864] 0 2024-02-19T19:12:13.184 INFO:tasks.workunit.client.1.smithi125.stdout:7/359: creat d12/d18/f68 x:0 0 0 2024-02-19T19:12:13.184 INFO:tasks.workunit.client.1.smithi125.stdout:0/357: dread - d5/f6d zero size 2024-02-19T19:12:13.215 INFO:tasks.workunit.client.1.smithi125.stdout:3/299: fsync d0/de/f1c 0 2024-02-19T19:12:13.216 INFO:tasks.workunit.client.1.smithi125.stdout:3/300: chown d0/d1/f31 1 1 2024-02-19T19:12:13.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.196+0000 7fa3c20bb700 1 -- 172.21.15.96:0/3469975834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3bc102700 msgr2=0x7fa3bc10abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:13.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.196+0000 7fa3c20bb700 1 --2- 172.21.15.96:0/3469975834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3bc102700 0x7fa3bc10abf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4009910 tx=0x7fa3a4009c20 comp rx=0 tx=0).stop 2024-02-19T19:12:13.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.196+0000 7fa3c20bb700 1 -- 172.21.15.96:0/3469975834 shutdown_connections 2024-02-19T19:12:13.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.196+0000 7fa3c20bb700 1 --2- 172.21.15.96:0/3469975834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3bc102700 0x7fa3bc10abf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:13.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.196+0000 7fa3c20bb700 1 --2- 172.21.15.96:0/3469975834 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3bc101de0 0x7fa3bc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:13.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.196+0000 7fa3c20bb700 1 -- 172.21.15.96:0/3469975834 >> 172.21.15.96:0/3469975834 conn(0x7fa3bc0fb610 msgr2=0x7fa3bc0fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:13.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.196+0000 7fa3c20bb700 1 -- 172.21.15.96:0/3469975834 shutdown_connections 2024-02-19T19:12:13.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.196+0000 7fa3c20bb700 1 -- 172.21.15.96:0/3469975834 wait complete. 2024-02-19T19:12:13.221 INFO:tasks.workunit.client.1.smithi125.stdout:3/301: truncate d0/d1/d1e/f5d 427697 0 2024-02-19T19:12:13.221 INFO:tasks.workunit.client.1.smithi125.stdout:3/302: dread - d0/f3c zero size 2024-02-19T19:12:13.221 INFO:tasks.workunit.client.1.smithi125.stdout:0/358: unlink d5/d19/d2b/f73 0 2024-02-19T19:12:13.221 INFO:tasks.workunit.client.1.smithi125.stdout:3/303: mkdir d0/d1/d1e/d60 0 2024-02-19T19:12:13.222 INFO:tasks.workunit.client.1.smithi125.stdout:0/359: truncate d5/d19/d2b/f4e 235170 0 2024-02-19T19:12:13.222 INFO:tasks.workunit.client.1.smithi125.stdout:0/360: link d5/d19/d27/d32/f7d d5/d33/d42/f88 0 2024-02-19T19:12:13.222 INFO:tasks.workunit.client.1.smithi125.stdout:0/361: dread d5/d19/d27/d32/f7d [823296,102400] 0 2024-02-19T19:12:13.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.197+0000 7fa3c20bb700 1 Processor -- start 2024-02-19T19:12:13.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.197+0000 7fa3c20bb700 1 -- start start 2024-02-19T19:12:13.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.197+0000 7fa3c20bb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3bc101de0 0x7fa3bc19c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:13.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.197+0000 7fa3c20bb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3bc102700 0x7fa3bc19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:13.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.197+0000 7fa3c20bb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc19d370 con 0x7fa3bc102700 2024-02-19T19:12:13.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.197+0000 7fa3c20bb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3bc196820 con 0x7fa3bc101de0 2024-02-19T19:12:13.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.197+0000 7fa3baffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3bc102700 0x7fa3bc19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:13.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.197+0000 7fa3baffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3bc102700 0x7fa3bc19cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55958/0 (socket says 172.21.15.96:55958) 2024-02-19T19:12:13.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.197+0000 7fa3baffd700 1 -- 172.21.15.96:0/3799568332 learned_addr learned my addr 172.21.15.96:0/3799568332 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:12:13.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.197+0000 7fa3bb7fe700 1 --2- 172.21.15.96:0/3799568332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3bc101de0 0x7fa3bc19c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:13.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.197+0000 7fa3baffd700 1 -- 172.21.15.96:0/3799568332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3bc101de0 msgr2=0x7fa3bc19c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:13.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.197+0000 7fa3baffd700 1 --2- 172.21.15.96:0/3799568332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3bc101de0 0x7fa3bc19c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:13.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.197+0000 7fa3baffd700 1 -- 172.21.15.96:0/3799568332 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a40095f0 con 0x7fa3bc102700 2024-02-19T19:12:13.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.197+0000 7fa3bb7fe700 1 --2- 172.21.15.96:0/3799568332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3bc101de0 0x7fa3bc19c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:12:13.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.197+0000 7fa3baffd700 1 --2- 172.21.15.96:0/3799568332 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3bc102700 0x7fa3bc19cce0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40092e0 tx=0x7fa3a400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:13.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.198+0000 7fa3b8ff9700 1 -- 172.21.15.96:0/3799568332 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3a401d070 con 0x7fa3bc102700 2024-02-19T19:12:13.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.198+0000 7fa3b8ff9700 1 -- 172.21.15.96:0/3799568332 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa3a400f460 con 0x7fa3bc102700 2024-02-19T19:12:13.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.198+0000 7fa3c20bb700 1 -- 172.21.15.96:0/3799568332 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3bc196aa0 con 0x7fa3bc102700 2024-02-19T19:12:13.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.198+0000 7fa3b8ff9700 1 -- 172.21.15.96:0/3799568332 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3a4017610 con 0x7fa3bc102700 2024-02-19T19:12:13.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.198+0000 7fa3c20bb700 1 -- 172.21.15.96:0/3799568332 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3bc196f90 con 0x7fa3bc102700 2024-02-19T19:12:13.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.199+0000 7fa3c20bb700 1 -- 172.21.15.96:0/3799568332 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3bc1082f0 con 0x7fa3bc102700 2024-02-19T19:12:13.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.199+0000 7fa3b8ff9700 1 -- 172.21.15.96:0/3799568332 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fa3a400f5d0 con 0x7fa3bc102700 2024-02-19T19:12:13.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.200+0000 7fa3b8ff9700 1 --2- 172.21.15.96:0/3799568332 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa3a806d8a0 0x7fa3a806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:13.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.200+0000 7fa3b8ff9700 1 -- 172.21.15.96:0/3799568332 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa3a408e950 con 0x7fa3bc102700 2024-02-19T19:12:13.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.200+0000 7fa3bb7fe700 1 --2- 172.21.15.96:0/3799568332 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa3a806d8a0 0x7fa3a806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:13.226 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.200+0000 7fa3bb7fe700 1 --2- 172.21.15.96:0/3799568332 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa3a806d8a0 0x7fa3a806fd60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4009fa0 tx=0x7fa3b4009570 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:13.227 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.204+0000 7fa3b8ff9700 1 -- 172.21.15.96:0/3799568332 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa3a405bce0 con 0x7fa3bc102700 2024-02-19T19:12:13.275 INFO:tasks.workunit.client.1.smithi125.stdout:0/362: rename d5/d19/d27/d32/f3c to d5/d15/f89 0 2024-02-19T19:12:13.275 INFO:tasks.workunit.client.1.smithi125.stdout:0/363: rename d5/d15/f52 to d5/d15/f8a 0 2024-02-19T19:12:13.275 INFO:tasks.workunit.client.1.smithi125.stdout:0/364: getdents d5/d15/d2c/d80 0 2024-02-19T19:12:13.275 INFO:tasks.workunit.client.1.smithi125.stdout:0/365: creat d5/d33/f8b x:0 0 0 2024-02-19T19:12:13.275 INFO:tasks.workunit.client.1.smithi125.stdout:0/366: creat d5/d19/d27/f8c x:0 0 0 2024-02-19T19:12:13.317 INFO:tasks.workunit.client.1.smithi125.stdout:4/300: sync 2024-02-19T19:12:13.317 INFO:tasks.workunit.client.1.smithi125.stdout:5/526: sync 2024-02-19T19:12:13.317 INFO:tasks.workunit.client.1.smithi125.stdout:9/303: sync 2024-02-19T19:12:13.317 INFO:tasks.workunit.client.1.smithi125.stdout:1/399: sync 2024-02-19T19:12:13.317 INFO:tasks.workunit.client.1.smithi125.stdout:4/301: readlink d0/d32/l44 0 2024-02-19T19:12:13.372 INFO:tasks.workunit.client.1.smithi125.stdout:6/305: fdatasync d6/f1e 0 2024-02-19T19:12:13.372 INFO:tasks.workunit.client.1.smithi125.stdout:2/344: fsync d1/d27/d1d/f50 0 2024-02-19T19:12:13.372 INFO:tasks.workunit.client.1.smithi125.stdout:1/400: fsync d1/dc/d36/d39/f5f 0 2024-02-19T19:12:13.381 INFO:tasks.workunit.client.1.smithi125.stdout:5/527: dwrite db/d17/f84 [614400,20480] 0 2024-02-19T19:12:13.381 INFO:tasks.workunit.client.1.smithi125.stdout:2/345: rename d1/d27/d1d/d39/f48 to d1/d27/d1d/d39/d40/f66 0 2024-02-19T19:12:13.381 INFO:tasks.workunit.client.1.smithi125.stdout:6/306: rmdir d6/d52 0 2024-02-19T19:12:13.381 INFO:tasks.workunit.client.1.smithi125.stdout:2/346: chown d1/d27/d1d/d16/l3e 235236610 1 2024-02-19T19:12:13.382 INFO:tasks.workunit.client.1.smithi125.stdout:1/401: symlink d1/d26/d3c/d3f/l7e 0 2024-02-19T19:12:13.382 INFO:tasks.workunit.client.1.smithi125.stdout:6/307: symlink d6/db/df/d16/l57 0 2024-02-19T19:12:13.382 INFO:tasks.workunit.client.1.smithi125.stdout:6/308: rmdir d6/d4a/d2f/d45/d4e 39 2024-02-19T19:12:13.382 INFO:tasks.workunit.client.1.smithi125.stdout:6/309: rmdir d6/d4a 39 2024-02-19T19:12:13.382 INFO:tasks.workunit.client.1.smithi125.stdout:6/310: chown d6/db/df/d16/l1c 11526093 1 2024-02-19T19:12:13.382 INFO:tasks.workunit.client.1.smithi125.stdout:1/402: truncate d1/dc/d36/f54 404470 0 2024-02-19T19:12:13.382 INFO:tasks.workunit.client.1.smithi125.stdout:6/311: dread d6/db/f3e [630784,77824] 0 2024-02-19T19:12:13.382 INFO:tasks.workunit.client.1.smithi125.stdout:1/403: creat d1/d78/f7f x:0 0 0 2024-02-19T19:12:13.382 INFO:tasks.workunit.client.1.smithi125.stdout:6/312: symlink d6/l58 0 2024-02-19T19:12:13.383 INFO:tasks.workunit.client.1.smithi125.stdout:9/304: dread d8/d15/d32/f65 [516096,106496] 0 2024-02-19T19:12:13.383 INFO:tasks.workunit.client.1.smithi125.stdout:9/305: readlink d8/l5c 0 2024-02-19T19:12:13.383 INFO:tasks.workunit.client.1.smithi125.stdout:6/313: creat d6/db/d49/f59 x:0 0 0 2024-02-19T19:12:13.383 INFO:tasks.workunit.client.1.smithi125.stdout:9/306: chown d8/d15/l21 253 1 2024-02-19T19:12:13.383 INFO:tasks.workunit.client.1.smithi125.stdout:1/404: write d1/d1a/f50 [1170068,107596] 0 2024-02-19T19:12:13.383 INFO:tasks.workunit.client.1.smithi125.stdout:6/314: creat d6/db/df/d3b/f5a x:0 0 0 2024-02-19T19:12:13.383 INFO:tasks.workunit.client.1.smithi125.stdout:6/315: mkdir d6/d4a/d2f/d45/d5b 0 2024-02-19T19:12:13.383 INFO:tasks.workunit.client.1.smithi125.stdout:8/363: sync 2024-02-19T19:12:13.385 INFO:tasks.workunit.client.1.smithi125.stdout:4/302: write d0/d7/d30/d58/f9 [1016652,94109] 0 2024-02-19T19:12:13.435 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.413+0000 7fa3c20bb700 1 -- 172.21.15.96:0/3799568332 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3bc197270 con 0x7fa3a806d8a0 2024-02-19T19:12:13.436 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.414+0000 7fa3b8ff9700 1 -- 172.21.15.96:0/3799568332 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fa3bc197270 con 0x7fa3a806d8a0 2024-02-19T19:12:13.437 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:12:13.437 INFO:teuthology.orchestra.run.smithi096.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:12:13.437 INFO:teuthology.orchestra.run.smithi096.stdout: "in_progress": true, 2024-02-19T19:12:13.437 INFO:teuthology.orchestra.run.smithi096.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:12:13.437 INFO:teuthology.orchestra.run.smithi096.stdout: "services_complete": [ 2024-02-19T19:12:13.437 INFO:teuthology.orchestra.run.smithi096.stdout: "crash", 2024-02-19T19:12:13.437 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr", 2024-02-19T19:12:13.438 INFO:teuthology.orchestra.run.smithi096.stdout: "mon" 2024-02-19T19:12:13.438 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-02-19T19:12:13.438 INFO:teuthology.orchestra.run.smithi096.stdout: "progress": "11/23 daemons upgraded", 2024-02-19T19:12:13.438 INFO:teuthology.orchestra.run.smithi096.stdout: "message": "Currently upgrading osd daemons", 2024-02-19T19:12:13.438 INFO:teuthology.orchestra.run.smithi096.stdout: "is_paused": false 2024-02-19T19:12:13.438 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:12:13.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.416+0000 7fa3c20bb700 1 -- 172.21.15.96:0/3799568332 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa3a806d8a0 msgr2=0x7fa3a806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:13.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.416+0000 7fa3c20bb700 1 --2- 172.21.15.96:0/3799568332 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa3a806d8a0 0x7fa3a806fd60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4009fa0 tx=0x7fa3b4009570 comp rx=0 tx=0).stop 2024-02-19T19:12:13.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.416+0000 7fa3c20bb700 1 -- 172.21.15.96:0/3799568332 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3bc102700 msgr2=0x7fa3bc19cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:13.439 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.416+0000 7fa3c20bb700 1 --2- 172.21.15.96:0/3799568332 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3bc102700 0x7fa3bc19cce0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40092e0 tx=0x7fa3a400be20 comp rx=0 tx=0).stop 2024-02-19T19:12:13.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.416+0000 7fa3c20bb700 1 -- 172.21.15.96:0/3799568332 shutdown_connections 2024-02-19T19:12:13.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.416+0000 7fa3c20bb700 1 --2- 172.21.15.96:0/3799568332 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa3a806d8a0 0x7fa3a806fd60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:13.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.416+0000 7fa3c20bb700 1 --2- 172.21.15.96:0/3799568332 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3bc101de0 0x7fa3bc19c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:13.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.416+0000 7fa3c20bb700 1 --2- 172.21.15.96:0/3799568332 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3bc102700 0x7fa3bc19cce0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:13.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.416+0000 7fa3c20bb700 1 -- 172.21.15.96:0/3799568332 >> 172.21.15.96:0/3799568332 conn(0x7fa3bc0fb610 msgr2=0x7fa3bc105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:13.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.417+0000 7fa3c20bb700 1 -- 172.21.15.96:0/3799568332 shutdown_connections 2024-02-19T19:12:13.440 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.417+0000 7fa3c20bb700 1 -- 172.21.15.96:0/3799568332 wait complete. 2024-02-19T19:12:13.441 INFO:tasks.workunit.client.1.smithi125.stdout:5/528: fsync db/d17/d58/d33/d64/f70 0 2024-02-19T19:12:13.442 INFO:tasks.workunit.client.1.smithi125.stdout:8/364: fdatasync db/d18/d30/d3c/f53 0 2024-02-19T19:12:13.442 INFO:tasks.workunit.client.1.smithi125.stdout:8/365: symlink db/d18/d2f/l71 0 2024-02-19T19:12:13.442 INFO:tasks.workunit.client.1.smithi125.stdout:6/316: dwrite d6/f1e [1126400,65536] 0 2024-02-19T19:12:13.442 INFO:tasks.workunit.client.1.smithi125.stdout:6/317: dread d6/d4a/f36 [208896,65536] 0 2024-02-19T19:12:13.442 INFO:tasks.workunit.client.1.smithi125.stdout:6/318: creat d6/db/df/d16/f5c x:0 0 0 2024-02-19T19:12:13.442 INFO:tasks.workunit.client.1.smithi125.stdout:6/319: rename d6/d4a to d6/db/d5d 0 2024-02-19T19:12:13.442 INFO:tasks.workunit.client.1.smithi125.stdout:6/320: unlink d6/db/d5d/d29/c3a 0 2024-02-19T19:12:13.443 INFO:tasks.workunit.client.1.smithi125.stdout:5/529: dwrite f1 [1544192,90112] 0 2024-02-19T19:12:13.444 INFO:tasks.workunit.client.1.smithi125.stdout:5/530: rename db/d17/d58 to db/d17/d58/d25/daa 22 2024-02-19T19:12:13.444 INFO:tasks.workunit.client.1.smithi125.stdout:5/531: stat c9 0 2024-02-19T19:12:13.444 INFO:tasks.workunit.client.1.smithi125.stdout:5/532: stat db/d17/d58/d33/d91 0 2024-02-19T19:12:13.444 INFO:tasks.workunit.client.1.smithi125.stdout:5/533: chown db/d26/l8d 24896594 1 2024-02-19T19:12:13.444 INFO:tasks.workunit.client.1.smithi125.stdout:5/534: stat db/d17/d58/d33/d64/l9d 0 2024-02-19T19:12:13.444 INFO:tasks.workunit.client.1.smithi125.stdout:5/535: read db/d26/d51/f7c [300271,57658] 0 2024-02-19T19:12:13.444 INFO:tasks.workunit.client.1.smithi125.stdout:5/536: chown db/d17/f22 14 1 2024-02-19T19:12:13.444 INFO:tasks.workunit.client.1.smithi125.stdout:9/307: dwrite d8/d15/f2c [1359872,61440] 0 2024-02-19T19:12:13.452 INFO:tasks.workunit.client.1.smithi125.stdout:8/366: dread db/d18/d30/d3c/d4d/f56 [1105920,4096] 0 2024-02-19T19:12:13.452 INFO:tasks.workunit.client.1.smithi125.stdout:8/367: mkdir db/d18/d2f/d72 0 2024-02-19T19:12:13.452 INFO:tasks.workunit.client.1.smithi125.stdout:8/368: creat db/f73 x:0 0 0 2024-02-19T19:12:13.452 INFO:tasks.workunit.client.1.smithi125.stdout:8/369: creat db/d18/d30/d3c/d4d/d5d/d6f/f74 x:0 0 0 2024-02-19T19:12:13.492 INFO:tasks.workunit.client.1.smithi125.stdout:6/321: fsync d6/db/d5d/d2f/d45/d4e/f53 0 2024-02-19T19:12:13.492 INFO:tasks.workunit.client.1.smithi125.stdout:6/322: mknod d6/db/d5d/d2f/c5e 0 2024-02-19T19:12:13.492 INFO:tasks.workunit.client.1.smithi125.stdout:6/323: chown d6/db/df/f51 62259242 1 2024-02-19T19:12:13.492 INFO:tasks.workunit.client.1.smithi125.stdout:6/324: creat d6/db/d5d/f5f x:0 0 0 2024-02-19T19:12:13.493 INFO:tasks.workunit.client.1.smithi125.stdout:0/367: fsync d5/d33/f8b 0 2024-02-19T19:12:13.493 INFO:tasks.workunit.client.1.smithi125.stdout:6/325: creat d6/db/d5d/d2f/d45/f60 x:0 0 0 2024-02-19T19:12:13.493 INFO:tasks.workunit.client.1.smithi125.stdout:0/368: getdents d5 0 2024-02-19T19:12:13.493 INFO:tasks.workunit.client.1.smithi125.stdout:0/369: dread - d5/d19/f47 zero size 2024-02-19T19:12:13.493 INFO:tasks.workunit.client.1.smithi125.stdout:9/308: fsync d8/f43 0 2024-02-19T19:12:13.493 INFO:tasks.workunit.client.1.smithi125.stdout:6/326: dread d6/db/df/f14 [667648,81920] 0 2024-02-19T19:12:13.494 INFO:tasks.workunit.client.1.smithi125.stdout:9/309: creat d8/d15/f6a x:0 0 0 2024-02-19T19:12:13.494 INFO:tasks.workunit.client.1.smithi125.stdout:9/310: stat d8/d2e/l63 0 2024-02-19T19:12:13.496 INFO:tasks.workunit.client.1.smithi125.stdout:0/370: dwrite d5/d33/d46/f6a [372736,110592] 0 2024-02-19T19:12:13.497 INFO:tasks.workunit.client.1.smithi125.stdout:6/327: dwrite d6/db/df/d16/f20 [1458176,45056] 0 2024-02-19T19:12:13.501 INFO:tasks.workunit.client.1.smithi125.stdout:0/371: read d5/d19/d27/d32/f7d [948601,122797] 0 2024-02-19T19:12:13.501 INFO:tasks.workunit.client.1.smithi125.stdout:6/328: symlink d6/db/df/d16/l61 0 2024-02-19T19:12:13.501 INFO:tasks.workunit.client.1.smithi125.stdout:8/370: dwrite db/d18/f1b [1658880,98304] 0 2024-02-19T19:12:13.501 INFO:tasks.workunit.client.1.smithi125.stdout:6/329: chown d6/db/d5d/d2f/d45/f60 56 1 2024-02-19T19:12:13.501 INFO:tasks.workunit.client.1.smithi125.stdout:6/330: link d6/db/df/f51 d6/db/d5d/d2f/d45/d5b/f62 0 2024-02-19T19:12:13.501 INFO:tasks.workunit.client.1.smithi125.stdout:8/371: write db/d18/f32 [505205,4542] 0 2024-02-19T19:12:13.501 INFO:tasks.workunit.client.1.smithi125.stdout:6/331: rename d6/db/d5d/d2f/d45/d5b to d6/db/d5d/d63 0 2024-02-19T19:12:13.501 INFO:tasks.workunit.client.1.smithi125.stdout:6/332: rmdir d6/db/df 39 2024-02-19T19:12:13.502 INFO:tasks.workunit.client.1.smithi125.stdout:6/333: unlink d6/db/d5d/d29/f3f 0 2024-02-19T19:12:13.502 INFO:tasks.workunit.client.1.smithi125.stdout:8/372: creat db/d18/d2f/d3f/f75 x:0 0 0 2024-02-19T19:12:13.502 INFO:tasks.workunit.client.1.smithi125.stdout:6/334: dread d6/db/d5d/d29/f2d [1298432,24576] 0 2024-02-19T19:12:13.502 INFO:tasks.workunit.client.1.smithi125.stdout:8/373: creat db/d18/d2f/d3f/f76 x:0 0 0 2024-02-19T19:12:13.502 INFO:tasks.workunit.client.1.smithi125.stdout:6/335: chown d6/db/df/c56 94170 1 2024-02-19T19:12:13.502 INFO:tasks.workunit.client.1.smithi125.stdout:6/336: read d6/db/df/d16/f38 [191147,12468] 0 2024-02-19T19:12:13.502 INFO:tasks.workunit.client.1.smithi125.stdout:8/374: write db/d18/d30/d3c/d4d/f56 [3206579,97683] 0 2024-02-19T19:12:13.502 INFO:tasks.workunit.client.1.smithi125.stdout:8/375: creat db/d18/d30/d3c/d4d/d5d/d6f/f77 x:0 0 0 2024-02-19T19:12:13.502 INFO:tasks.workunit.client.1.smithi125.stdout:8/376: mkdir db/d18/d30/d3c/d4d/d5d/d6f/d78 0 2024-02-19T19:12:13.503 INFO:tasks.workunit.client.1.smithi125.stdout:8/377: write db/d18/d30/d3c/d4d/f61 [358770,33085] 0 2024-02-19T19:12:13.503 INFO:tasks.workunit.client.1.smithi125.stdout:8/378: mknod db/d18/d30/d3c/d4d/d5d/c79 0 2024-02-19T19:12:13.503 INFO:tasks.workunit.client.1.smithi125.stdout:8/379: creat db/d18/d30/d48/f7a x:0 0 0 2024-02-19T19:12:13.503 INFO:tasks.workunit.client.1.smithi125.stdout:8/380: getdents db/d18/d30/d48 0 2024-02-19T19:12:13.503 INFO:tasks.workunit.client.1.smithi125.stdout:8/381: chown db/l23 51 1 2024-02-19T19:12:13.503 INFO:tasks.workunit.client.1.smithi125.stdout:5/537: write db/d47/d52/f5a [3143908,106858] 0 2024-02-19T19:12:13.503 INFO:tasks.workunit.client.1.smithi125.stdout:5/538: getdents db/d47/d52 0 2024-02-19T19:12:13.503 INFO:tasks.workunit.client.1.smithi125.stdout:0/372: link d5/d9/f1d d5/d19/d27/d32/f8d 0 2024-02-19T19:12:13.504 INFO:tasks.workunit.client.1.smithi125.stdout:6/337: rmdir d6/db/d5d/d4d 0 2024-02-19T19:12:13.504 INFO:tasks.workunit.client.1.smithi125.stdout:6/338: creat d6/db/f64 x:0 0 0 2024-02-19T19:12:13.504 INFO:tasks.workunit.client.1.smithi125.stdout:0/373: creat d5/d19/d27/f8e x:0 0 0 2024-02-19T19:12:13.504 INFO:tasks.workunit.client.1.smithi125.stdout:9/311: dwrite d8/f50 [618496,77824] 0 2024-02-19T19:12:13.504 INFO:tasks.workunit.client.1.smithi125.stdout:9/312: write d8/d15/d22/d4e/f3b [2183603,758] 0 2024-02-19T19:12:13.504 INFO:tasks.workunit.client.1.smithi125.stdout:9/313: mkdir d8/d15/d22/d4e/d6b 0 2024-02-19T19:12:13.504 INFO:tasks.workunit.client.1.smithi125.stdout:9/314: write d8/d2e/d4c/f5f [969172,33318] 0 2024-02-19T19:12:13.504 INFO:tasks.workunit.client.1.smithi125.stdout:9/315: creat d8/d15/d32/d4f/f6c x:0 0 0 2024-02-19T19:12:13.505 INFO:tasks.workunit.client.1.smithi125.stdout:9/316: mkdir d8/d2e/d6d 0 2024-02-19T19:12:13.505 INFO:tasks.workunit.client.1.smithi125.stdout:9/317: mkdir d8/d15/d32/d4f/d6e 0 2024-02-19T19:12:13.505 INFO:tasks.workunit.client.1.smithi125.stdout:9/318: rename d8/l5c to d8/d15/d22/l6f 0 2024-02-19T19:12:13.505 INFO:tasks.workunit.client.1.smithi125.stdout:9/319: creat d8/d15/f70 x:0 0 0 2024-02-19T19:12:13.505 INFO:tasks.workunit.client.1.smithi125.stdout:9/320: chown d8/d2e/l40 1 1 2024-02-19T19:12:13.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.523+0000 7f180d48d700 1 -- 172.21.15.96:0/152709858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1808105bd0 msgr2=0x7f1808105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:13.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.523+0000 7f180d48d700 1 --2- 172.21.15.96:0/152709858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1808105bd0 0x7f1808105fb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f17f8009910 tx=0x7f17f8009c20 comp rx=0 tx=0).stop 2024-02-19T19:12:13.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.523+0000 7f180d48d700 1 -- 172.21.15.96:0/152709858 shutdown_connections 2024-02-19T19:12:13.545 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.523+0000 7f180d48d700 1 --2- 172.21.15.96:0/152709858 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f18080ffc20 0x7f1808100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:13.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.523+0000 7f180d48d700 1 --2- 172.21.15.96:0/152709858 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1808105bd0 0x7f1808105fb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:13.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.523+0000 7f180d48d700 1 -- 172.21.15.96:0/152709858 >> 172.21.15.96:0/152709858 conn(0x7f1808075670 msgr2=0x7f1808075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:13.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.523+0000 7f180d48d700 1 -- 172.21.15.96:0/152709858 shutdown_connections 2024-02-19T19:12:13.546 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.523+0000 7f180d48d700 1 -- 172.21.15.96:0/152709858 wait complete. 2024-02-19T19:12:13.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.523+0000 7f180d48d700 1 Processor -- start 2024-02-19T19:12:13.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.524+0000 7f180d48d700 1 -- start start 2024-02-19T19:12:13.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.524+0000 7f180d48d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18080ffc20 0x7f18081976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:13.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.524+0000 7f180d48d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1808105bd0 0x7f1808197c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:13.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.524+0000 7f180d48d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18081982f0 con 0x7f18080ffc20 2024-02-19T19:12:13.548 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.524+0000 7f180d48d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1808198460 con 0x7f1808105bd0 2024-02-19T19:12:13.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.524+0000 7f1806ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18080ffc20 0x7f18081976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:13.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.524+0000 7f1806ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18080ffc20 0x7f18081976d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47202/0 (socket says 172.21.15.96:47202) 2024-02-19T19:12:13.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.524+0000 7f1806ffd700 1 -- 172.21.15.96:0/1885433229 learned_addr learned my addr 172.21.15.96:0/1885433229 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:12:13.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.524+0000 7f17fe7fc700 1 --2- 172.21.15.96:0/1885433229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1808105bd0 0x7f1808197c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:13.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.524+0000 7f1806ffd700 1 -- 172.21.15.96:0/1885433229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1808105bd0 msgr2=0x7f1808197c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:13.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.524+0000 7f1806ffd700 1 --2- 172.21.15.96:0/1885433229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1808105bd0 0x7f1808197c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:13.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.524+0000 7f1806ffd700 1 -- 172.21.15.96:0/1885433229 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f80095f0 con 0x7f18080ffc20 2024-02-19T19:12:13.549 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.524+0000 7f17fe7fc700 1 --2- 172.21.15.96:0/1885433229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1808105bd0 0x7f1808197c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:12:13.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.524+0000 7f1806ffd700 1 --2- 172.21.15.96:0/1885433229 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18080ffc20 0x7f18081976d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f17f80092e0 tx=0x7f17f800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:13.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.525+0000 7f1804ff9700 1 -- 172.21.15.96:0/1885433229 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17f801d070 con 0x7f18080ffc20 2024-02-19T19:12:13.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.525+0000 7f1804ff9700 1 -- 172.21.15.96:0/1885433229 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f17f8005e00 con 0x7f18080ffc20 2024-02-19T19:12:13.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.525+0000 7f1804ff9700 1 -- 172.21.15.96:0/1885433229 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17f8017400 con 0x7f18080ffc20 2024-02-19T19:12:13.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.525+0000 7f180d48d700 1 -- 172.21.15.96:0/1885433229 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18081a0740 con 0x7f18080ffc20 2024-02-19T19:12:13.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.525+0000 7f180d48d700 1 -- 172.21.15.96:0/1885433229 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18081a0bb0 con 0x7f18080ffc20 2024-02-19T19:12:13.550 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.526+0000 7f180d48d700 1 -- 172.21.15.96:0/1885433229 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18081080f0 con 0x7f18080ffc20 2024-02-19T19:12:13.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.526+0000 7f1804ff9700 1 -- 172.21.15.96:0/1885433229 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f17f800f460 con 0x7f18080ffc20 2024-02-19T19:12:13.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.527+0000 7f1804ff9700 1 --2- 172.21.15.96:0/1885433229 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f17f406d8a0 0x7f17f406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:13.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.527+0000 7f1804ff9700 1 -- 172.21.15.96:0/1885433229 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f17f808ea20 con 0x7f18080ffc20 2024-02-19T19:12:13.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.527+0000 7f17fe7fc700 1 --2- 172.21.15.96:0/1885433229 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f17f406d8a0 0x7f17f406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:13.551 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.527+0000 7f17fe7fc700 1 --2- 172.21.15.96:0/1885433229 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f17f406d8a0 0x7f17f406fd60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f17f0005950 tx=0x7f17f00058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:13.553 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.531+0000 7f1804ff9700 1 -- 172.21.15.96:0/1885433229 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f17f8058220 con 0x7f18080ffc20 2024-02-19T19:12:13.575 INFO:tasks.workunit.client.1.smithi125.stdout:3/304: sync 2024-02-19T19:12:13.575 INFO:tasks.workunit.client.1.smithi125.stdout:7/360: sync 2024-02-19T19:12:13.575 INFO:tasks.workunit.client.1.smithi125.stdout:3/305: creat d0/de/f61 x:0 0 0 2024-02-19T19:12:13.575 INFO:tasks.workunit.client.1.smithi125.stdout:7/361: dread - d12/d18/f3c zero size 2024-02-19T19:12:13.607 INFO:tasks.workunit.client.1.smithi125.stdout:5/539: fdatasync db/d17/d58/f3a 0 2024-02-19T19:12:13.607 INFO:tasks.workunit.client.1.smithi125.stdout:6/339: fdatasync d6/db/d5d/f24 0 2024-02-19T19:12:13.607 INFO:tasks.workunit.client.1.smithi125.stdout:5/540: read - db/d17/d58/f81 zero size 2024-02-19T19:12:13.607 INFO:tasks.workunit.client.1.smithi125.stdout:6/340: write d6/db/d5d/f19 [474308,340] 0 2024-02-19T19:12:13.607 INFO:tasks.workunit.client.1.smithi125.stdout:6/341: rmdir d6/db/d5d/d63 39 2024-02-19T19:12:13.608 INFO:tasks.workunit.client.1.smithi125.stdout:6/342: rename l2 to d6/db/d5d/d2f/d45/l65 0 2024-02-19T19:12:13.608 INFO:tasks.workunit.client.1.smithi125.stdout:6/343: chown d6/db/d5d/l39 242 1 2024-02-19T19:12:13.608 INFO:tasks.workunit.client.1.smithi125.stdout:6/344: creat d6/db/d49/d4c/f66 x:0 0 0 2024-02-19T19:12:13.614 INFO:tasks.workunit.client.1.smithi125.stdout:9/321: fdatasync d8/f43 0 2024-02-19T19:12:13.614 INFO:tasks.workunit.client.1.smithi125.stdout:3/306: fdatasync d0/de/f3b 0 2024-02-19T19:12:13.615 INFO:tasks.workunit.client.1.smithi125.stdout:3/307: stat d0/d1/d1e/f27 0 2024-02-19T19:12:13.621 INFO:tasks.workunit.client.1.smithi125.stdout:5/541: dwrite db/d17/d58/d33/d64/fa9 [839680,126976] 0 2024-02-19T19:12:13.621 INFO:tasks.workunit.client.1.smithi125.stdout:7/362: dwrite d12/d18/d44/d51/f56 [1413120,94208] 0 2024-02-19T19:12:13.622 INFO:tasks.workunit.client.1.smithi125.stdout:9/322: link d8/d15/d22/c57 d8/d15/d32/d4f/c71 0 2024-02-19T19:12:13.622 INFO:tasks.workunit.client.1.smithi125.stdout:7/363: stat d12/d18/d44 0 2024-02-19T19:12:13.622 INFO:tasks.workunit.client.1.smithi125.stdout:5/542: creat db/d17/d58/d33/d98/fab x:0 0 0 2024-02-19T19:12:13.622 INFO:tasks.workunit.client.1.smithi125.stdout:5/543: dread db/d17/d58/f72 [479232,90112] 0 2024-02-19T19:12:13.625 INFO:tasks.workunit.client.1.smithi125.stdout:3/308: truncate d0/f19 546500 0 2024-02-19T19:12:13.625 INFO:tasks.workunit.client.1.smithi125.stdout:7/364: dwrite f8 [28672,69632] 0 2024-02-19T19:12:13.626 INFO:tasks.workunit.client.1.smithi125.stdout:7/365: creat d12/d3d/f69 x:0 0 0 2024-02-19T19:12:13.626 INFO:tasks.workunit.client.1.smithi125.stdout:7/366: chown l6 7 1 2024-02-19T19:12:13.627 INFO:tasks.workunit.client.1.smithi125.stdout:4/303: sync 2024-02-19T19:12:13.627 INFO:tasks.workunit.client.1.smithi125.stdout:1/405: sync 2024-02-19T19:12:13.627 INFO:tasks.workunit.client.1.smithi125.stdout:2/347: sync 2024-02-19T19:12:13.627 INFO:tasks.workunit.client.1.smithi125.stdout:4/304: dread d0/d7/f26 [794624,126976] 0 2024-02-19T19:12:13.628 INFO:tasks.workunit.client.1.smithi125.stdout:1/406: rename d1/d26/d29 to d1/d78/d80 0 2024-02-19T19:12:13.628 INFO:tasks.workunit.client.1.smithi125.stdout:9/323: symlink d8/d15/l72 0 2024-02-19T19:12:13.628 INFO:tasks.workunit.client.1.smithi125.stdout:5/544: write db/d17/d58/d33/f3e [879786,68247] 0 2024-02-19T19:12:13.628 INFO:tasks.workunit.client.1.smithi125.stdout:3/309: write d0/d1/d1e/f2c [1418075,72100] 0 2024-02-19T19:12:13.629 INFO:tasks.workunit.client.1.smithi125.stdout:1/407: creat d1/dc/d36/d69/f81 x:0 0 0 2024-02-19T19:12:13.629 INFO:tasks.workunit.client.1.smithi125.stdout:9/324: symlink d8/d15/d22/d4e/l73 0 2024-02-19T19:12:13.629 INFO:tasks.workunit.client.1.smithi125.stdout:5/545: dread db/d26/d51/f99 [28672,40960] 0 2024-02-19T19:12:13.629 INFO:tasks.workunit.client.1.smithi125.stdout:9/325: rename d8/d15 to d8/d15/d22/d4e/d74 22 2024-02-19T19:12:13.629 INFO:tasks.workunit.client.1.smithi125.stdout:5/546: stat db/d17/d58/d25/d40/l73 0 2024-02-19T19:12:13.629 INFO:tasks.workunit.client.1.smithi125.stdout:9/326: stat d8/d15/d22/f67 0 2024-02-19T19:12:13.629 INFO:tasks.workunit.client.1.smithi125.stdout:5/547: chown db/d17/d58/d25/l9b 3 1 2024-02-19T19:12:13.629 INFO:tasks.workunit.client.1.smithi125.stdout:1/408: rmdir d1/d26/d23/d65 0 2024-02-19T19:12:13.630 INFO:tasks.workunit.client.1.smithi125.stdout:9/327: truncate d8/d15/f61 306376 0 2024-02-19T19:12:13.630 INFO:tasks.workunit.client.1.smithi125.stdout:1/409: dread - d1/dc/d36/d69/f81 zero size 2024-02-19T19:12:13.630 INFO:tasks.workunit.client.1.smithi125.stdout:5/548: link db/d17/d58/d33/d98/d9c/f9e db/d17/d85/fac 0 2024-02-19T19:12:13.630 INFO:tasks.workunit.client.1.smithi125.stdout:9/328: link d8/d15/f70 d8/d15/d32/d4f/d6e/f75 0 2024-02-19T19:12:13.630 INFO:tasks.workunit.client.1.smithi125.stdout:1/410: stat d1/d78/d80/l3e 0 2024-02-19T19:12:13.630 INFO:tasks.workunit.client.1.smithi125.stdout:9/329: chown d8/la 891938 1 2024-02-19T19:12:13.630 INFO:tasks.workunit.client.1.smithi125.stdout:1/411: mknod d1/d26/d3c/d3f/c82 0 2024-02-19T19:12:13.630 INFO:tasks.workunit.client.1.smithi125.stdout:9/330: unlink d8/f11 0 2024-02-19T19:12:13.630 INFO:tasks.workunit.client.1.smithi125.stdout:5/549: mkdir db/d17/d58/d4f/dad 0 2024-02-19T19:12:13.631 INFO:tasks.workunit.client.1.smithi125.stdout:1/412: creat d1/d26/f83 x:0 0 0 2024-02-19T19:12:13.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:13 smithi125 ceph-mon[86115]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-19T19:12:13.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:13 smithi125 ceph-mon[86115]: Upgrade: osd.5 is safe to restart 2024-02-19T19:12:13.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:13 smithi125 ceph-mon[86115]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:12:13.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:13 smithi125 ceph-mon[86115]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:12:13.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:13 smithi125 ceph-mon[86115]: from='client.44301 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:12:13.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:13 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/973296977' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:13.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:13 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/2370838614' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:12:13.751 INFO:tasks.workunit.client.1.smithi125.stdout:4/305: fdatasync d0/d7/d30/d58/f1e 0 2024-02-19T19:12:13.752 INFO:tasks.workunit.client.1.smithi125.stdout:4/306: unlink d0/d7/l8 0 2024-02-19T19:12:13.752 INFO:tasks.workunit.client.1.smithi125.stdout:4/307: link d0/d7/d30/d58/c4e d0/df/c63 0 2024-02-19T19:12:13.752 INFO:tasks.workunit.client.1.smithi125.stdout:9/331: fdatasync d8/f9 0 2024-02-19T19:12:13.752 INFO:tasks.workunit.client.1.smithi125.stdout:3/310: fsync d0/d1/d1e/f34 0 2024-02-19T19:12:13.752 INFO:tasks.workunit.client.1.smithi125.stdout:9/332: truncate d8/d15/f61 993659 0 2024-02-19T19:12:13.752 INFO:tasks.workunit.client.1.smithi125.stdout:3/311: dread d0/d1/d1e/f2c [1282048,61440] 0 2024-02-19T19:12:13.752 INFO:tasks.workunit.client.1.smithi125.stdout:9/333: rmdir d8/d15/d32/d4f 39 2024-02-19T19:12:13.752 INFO:tasks.workunit.client.1.smithi125.stdout:4/308: write d0/d32/f55 [933556,66797] 0 2024-02-19T19:12:13.753 INFO:tasks.workunit.client.1.smithi125.stdout:3/312: mknod d0/d1/d39/c62 0 2024-02-19T19:12:13.753 INFO:tasks.workunit.client.1.smithi125.stdout:9/334: creat d8/d15/d22/d4e/d6b/f76 x:0 0 0 2024-02-19T19:12:13.753 INFO:tasks.workunit.client.1.smithi125.stdout:3/313: dread d0/d1/d39/f49 [12288,53248] 0 2024-02-19T19:12:13.753 INFO:tasks.workunit.client.1.smithi125.stdout:9/335: symlink d8/d2e/d4c/l77 0 2024-02-19T19:12:13.753 INFO:tasks.workunit.client.1.smithi125.stdout:9/336: creat d8/d15/d22/f78 x:0 0 0 2024-02-19T19:12:13.753 INFO:tasks.workunit.client.1.smithi125.stdout:9/337: link d8/d15/f1c d8/d15/d32/d4f/f79 0 2024-02-19T19:12:13.753 INFO:tasks.workunit.client.1.smithi125.stdout:3/314: write d0/d1/d1e/f2c [770702,116871] 0 2024-02-19T19:12:13.753 INFO:tasks.workunit.client.1.smithi125.stdout:9/338: chown d8/d15/d32/c16 424067 1 2024-02-19T19:12:13.753 INFO:tasks.workunit.client.1.smithi125.stdout:3/315: creat d0/d1/f63 x:0 0 0 2024-02-19T19:12:13.754 INFO:tasks.workunit.client.1.smithi125.stdout:3/316: chown d0/d1/d1e/f2c 58534 1 2024-02-19T19:12:13.754 INFO:tasks.workunit.client.1.smithi125.stdout:9/339: write d8/d15/d22/f67 [485609,93565] 0 2024-02-19T19:12:13.754 INFO:tasks.workunit.client.1.smithi125.stdout:9/340: dread - d8/d15/f66 zero size 2024-02-19T19:12:13.754 INFO:tasks.workunit.client.1.smithi125.stdout:3/317: write d0/d1/d4b/d52/f5e [790043,88262] 0 2024-02-19T19:12:13.754 INFO:tasks.workunit.client.1.smithi125.stdout:9/341: write d8/d15/d32/f3f [476559,5039] 0 2024-02-19T19:12:13.754 INFO:tasks.workunit.client.1.smithi125.stdout:9/342: chown d8/d15/f6a 81 1 2024-02-19T19:12:13.754 INFO:tasks.workunit.client.1.smithi125.stdout:9/343: dread - d8/d15/d22/d4e/f68 zero size 2024-02-19T19:12:13.754 INFO:tasks.workunit.client.1.smithi125.stdout:9/344: creat d8/d15/d22/d44/f7a x:0 0 0 2024-02-19T19:12:13.754 INFO:tasks.workunit.client.1.smithi125.stdout:7/367: dwrite d12/d18/d44/d3b/d59/d2a/d31/f61 [290816,86016] 0 2024-02-19T19:12:13.755 INFO:tasks.workunit.client.1.smithi125.stdout:9/345: dread d8/f50 [208896,61440] 0 2024-02-19T19:12:13.755 INFO:tasks.workunit.client.1.smithi125.stdout:9/346: creat d8/d15/f7b x:0 0 0 2024-02-19T19:12:13.755 INFO:tasks.workunit.client.1.smithi125.stdout:7/368: chown d12/d18/d44/d3b/d52/l55 1 1 2024-02-19T19:12:13.755 INFO:tasks.workunit.client.1.smithi125.stdout:9/347: truncate d8/f9 2351501 0 2024-02-19T19:12:13.755 INFO:tasks.workunit.client.1.smithi125.stdout:7/369: truncate d12/d18/d44/d3b/d59/d26/d30/d37/f3f 1878046 0 2024-02-19T19:12:13.755 INFO:tasks.workunit.client.1.smithi125.stdout:9/348: read d8/f50 [112886,55548] 0 2024-02-19T19:12:13.755 INFO:tasks.workunit.client.1.smithi125.stdout:9/349: dread - d8/d15/d32/f64 zero size 2024-02-19T19:12:13.755 INFO:tasks.workunit.client.1.smithi125.stdout:7/370: rename d12/d18/d44/d3b/d52 to d12/d18/d44/d3b/d59/d2a/d6a 0 2024-02-19T19:12:13.755 INFO:tasks.workunit.client.1.smithi125.stdout:7/371: stat d12/d18/d44/d3b/d59/d26/d54 0 2024-02-19T19:12:13.758 INFO:tasks.workunit.client.1.smithi125.stdout:2/348: dwrite d1/d27/f33 [2502656,126976] 0 2024-02-19T19:12:13.758 INFO:tasks.workunit.client.1.smithi125.stdout:2/349: truncate d1/f2 4593671 0 2024-02-19T19:12:13.758 INFO:tasks.workunit.client.1.smithi125.stdout:2/350: write d1/d27/d1d/f50 [808286,72085] 0 2024-02-19T19:12:13.759 INFO:tasks.workunit.client.1.smithi125.stdout:2/351: getdents d1/d27/d1d 0 2024-02-19T19:12:13.759 INFO:tasks.workunit.client.1.smithi125.stdout:2/352: rename d1/d27/d1d/f50 to d1/d36/f67 0 2024-02-19T19:12:13.759 INFO:tasks.workunit.client.1.smithi125.stdout:2/353: rename d1/d27/d1d/d39/d40/d4b to d1/d27/d1d/d39/d40/d4b/d68 22 2024-02-19T19:12:13.759 INFO:tasks.workunit.client.1.smithi125.stdout:5/550: dwrite db/d47/d52/f4e [2461696,90112] 0 2024-02-19T19:12:13.759 INFO:tasks.workunit.client.1.smithi125.stdout:5/551: mkdir db/d17/d58/d33/d98/dae 0 2024-02-19T19:12:13.759 INFO:tasks.workunit.client.1.smithi125.stdout:5/552: chown db/d17/d85 1338493 1 2024-02-19T19:12:13.759 INFO:tasks.workunit.client.1.smithi125.stdout:5/553: write db/d17/d58/d25/d40/f8e [1593741,117259] 0 2024-02-19T19:12:13.759 INFO:tasks.workunit.client.1.smithi125.stdout:5/554: creat db/d17/d58/d4f/faf x:0 0 0 2024-02-19T19:12:13.760 INFO:tasks.workunit.client.1.smithi125.stdout:5/555: chown db/d17/d58/c18 339180 1 2024-02-19T19:12:13.760 INFO:tasks.workunit.client.1.smithi125.stdout:1/413: dwrite d1/f45 [991232,94208] 0 2024-02-19T19:12:13.760 INFO:tasks.workunit.client.1.smithi125.stdout:5/556: creat db/d17/d58/d33/d98/d9c/fb0 x:0 0 0 2024-02-19T19:12:13.760 INFO:tasks.workunit.client.1.smithi125.stdout:5/557: chown db/d17/f84 96767970 1 2024-02-19T19:12:13.760 INFO:tasks.workunit.client.1.smithi125.stdout:1/414: write d1/d26/d23/f68 [326947,84329] 0 2024-02-19T19:12:13.760 INFO:tasks.workunit.client.1.smithi125.stdout:5/558: symlink db/d17/d58/lb1 0 2024-02-19T19:12:13.760 INFO:tasks.workunit.client.1.smithi125.stdout:1/415: truncate d1/d78/d80/f5d 90150 0 2024-02-19T19:12:13.760 INFO:tasks.workunit.client.1.smithi125.stdout:5/559: creat db/d17/d58/d4f/dad/fb2 x:0 0 0 2024-02-19T19:12:13.761 INFO:tasks.workunit.client.1.smithi125.stdout:1/416: mknod d1/d1a/c84 0 2024-02-19T19:12:13.761 INFO:tasks.workunit.client.1.smithi125.stdout:5/560: getdents db/d17/d58/d33/d98/d9c 0 2024-02-19T19:12:13.761 INFO:tasks.workunit.client.1.smithi125.stdout:5/561: readlink db/d17/d58/l14 0 2024-02-19T19:12:13.761 INFO:tasks.workunit.client.1.smithi125.stdout:5/562: truncate db/d17/d58/d33/d98/d9c/fa4 453290 0 2024-02-19T19:12:13.761 INFO:tasks.workunit.client.1.smithi125.stdout:9/350: dwrite f6 [966656,49152] 0 2024-02-19T19:12:13.761 INFO:tasks.workunit.client.1.smithi125.stdout:7/372: dwrite d12/d18/d44/d3b/d59/d26/d30/f35 [1101824,94208] 0 2024-02-19T19:12:13.761 INFO:tasks.workunit.client.1.smithi125.stdout:7/373: read fc [62476,18051] 0 2024-02-19T19:12:13.761 INFO:tasks.workunit.client.1.smithi125.stdout:7/374: rename d12/d18/d44/d3b/d59/d26/f4c to d12/d18/d44/d51/f6b 0 2024-02-19T19:12:13.761 INFO:tasks.workunit.client.1.smithi125.stdout:7/375: write d12/d18/d2c/f2d [350911,71588] 0 2024-02-19T19:12:13.761 INFO:tasks.workunit.client.1.smithi125.stdout:7/376: mknod d12/d18/d44/d3b/d59/d26/d30/d37/c6c 0 2024-02-19T19:12:13.762 INFO:tasks.workunit.client.1.smithi125.stdout:7/377: dread - d12/d18/f68 zero size 2024-02-19T19:12:13.762 INFO:tasks.workunit.client.1.smithi125.stdout:7/378: dread f8 [1421312,114688] 0 2024-02-19T19:12:13.762 INFO:tasks.workunit.client.1.smithi125.stdout:7/379: truncate fa 1843345 0 2024-02-19T19:12:13.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:13 smithi096 ceph-mon[112483]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-19T19:12:13.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:13 smithi096 ceph-mon[112483]: Upgrade: osd.5 is safe to restart 2024-02-19T19:12:13.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:13 smithi096 ceph-mon[112483]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:12:13.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:13 smithi096 ceph-mon[112483]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:12:13.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:13 smithi096 ceph-mon[112483]: from='client.44301 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:12:13.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:13 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/973296977' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:13.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:13 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/2370838614' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:12:13.813 INFO:tasks.workunit.client.1.smithi125.stdout:6/345: fsync d6/f1e 0 2024-02-19T19:12:13.813 INFO:tasks.workunit.client.1.smithi125.stdout:4/309: fdatasync d0/d7/d3b/f5f 0 2024-02-19T19:12:13.813 INFO:tasks.workunit.client.1.smithi125.stdout:1/417: fsync d1/f70 0 2024-02-19T19:12:13.814 INFO:tasks.workunit.client.1.smithi125.stdout:7/380: fdatasync d12/f1f 0 2024-02-19T19:12:13.814 INFO:tasks.workunit.client.1.smithi125.stdout:5/563: fsync db/d47/d52/d5d/f7b 0 2024-02-19T19:12:13.814 INFO:tasks.workunit.client.1.smithi125.stdout:4/310: chown d0/d7/d30/d58 411 1 2024-02-19T19:12:13.820 INFO:tasks.workunit.client.1.smithi125.stdout:7/381: dread d12/d18/d44/d3b/d59/d2a/f4a [53248,61440] 0 2024-02-19T19:12:13.820 INFO:tasks.workunit.client.1.smithi125.stdout:2/354: dwrite d1/d27/d1d/d39/f55 [860160,28672] 0 2024-02-19T19:12:13.820 INFO:tasks.workunit.client.1.smithi125.stdout:4/311: creat d0/d7/d30/d5d/f64 x:0 0 0 2024-02-19T19:12:13.820 INFO:tasks.workunit.client.1.smithi125.stdout:2/355: dread d1/d27/f22 [2547712,106496] 0 2024-02-19T19:12:13.821 INFO:tasks.workunit.client.1.smithi125.stdout:2/356: truncate d1/f2 4913105 0 2024-02-19T19:12:13.821 INFO:tasks.workunit.client.1.smithi125.stdout:6/346: write d6/db/f64 [372480,54331] 0 2024-02-19T19:12:13.821 INFO:tasks.workunit.client.1.smithi125.stdout:5/564: write db/d17/d58/f1c [1615185,85521] 0 2024-02-19T19:12:13.821 INFO:tasks.workunit.client.1.smithi125.stdout:5/565: chown db/d17/f7d 759013719 1 2024-02-19T19:12:13.821 INFO:tasks.workunit.client.1.smithi125.stdout:5/566: chown db/d17/d58/d4f/dad/fb2 12 1 2024-02-19T19:12:13.822 INFO:tasks.workunit.client.1.smithi125.stdout:4/312: dwrite d0/d7/d30/d58/f1e [933888,4096] 0 2024-02-19T19:12:13.822 INFO:tasks.workunit.client.1.smithi125.stdout:4/313: truncate d0/d7/d30/d5d/f64 206696 0 2024-02-19T19:12:13.822 INFO:tasks.workunit.client.1.smithi125.stdout:6/347: dwrite d6/db/df/d16/f5c [671744,86016] 0 2024-02-19T19:12:13.823 INFO:tasks.workunit.client.1.smithi125.stdout:2/357: creat d1/d27/d1d/d39/f69 x:0 0 0 2024-02-19T19:12:13.823 INFO:tasks.workunit.client.1.smithi125.stdout:6/348: mknod d6/c67 0 2024-02-19T19:12:13.823 INFO:tasks.workunit.client.1.smithi125.stdout:6/349: mkdir d6/db/d5d/d29/d68 0 2024-02-19T19:12:13.824 INFO:tasks.workunit.client.1.smithi125.stdout:5/567: truncate db/d17/f22 988089 0 2024-02-19T19:12:13.824 INFO:tasks.workunit.client.1.smithi125.stdout:6/350: mknod d6/db/d49/c69 0 2024-02-19T19:12:13.824 INFO:tasks.workunit.client.1.smithi125.stdout:6/351: rmdir d6/db/d49 39 2024-02-19T19:12:13.824 INFO:tasks.workunit.client.1.smithi125.stdout:5/568: chown db/d17/d58/f81 126525 1 2024-02-19T19:12:13.824 INFO:tasks.workunit.client.1.smithi125.stdout:4/314: rename d0/d32/c50 to d0/d32/d60/c65 0 2024-02-19T19:12:13.824 INFO:tasks.workunit.client.1.smithi125.stdout:6/352: link d6/db/l4b d6/db/df/d3b/l6a 0 2024-02-19T19:12:13.824 INFO:tasks.workunit.client.1.smithi125.stdout:6/353: chown d6/db/df/f14 88127382 1 2024-02-19T19:12:13.824 INFO:tasks.workunit.client.1.smithi125.stdout:6/354: chown d6/db/d5d/d2f/c5e 13467 1 2024-02-19T19:12:13.825 INFO:tasks.workunit.client.1.smithi125.stdout:2/358: dwrite d1/d27/f5a [196608,36864] 0 2024-02-19T19:12:13.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.807+0000 7f180d48d700 1 -- 172.21.15.96:0/1885433229 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1808068c70 con 0x7f18080ffc20 2024-02-19T19:12:13.829 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.807+0000 7f1804ff9700 1 -- 172.21.15.96:0/1885433229 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f17f805b8e0 con 0x7f18080ffc20 2024-02-19T19:12:13.830 INFO:teuthology.orchestra.run.smithi096.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T19:12:13.830 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-19T19:12:13.830 INFO:teuthology.orchestra.run.smithi096.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-19T19:12:13.832 INFO:tasks.workunit.client.1.smithi125.stdout:1/418: dread d1/d26/d3c/d3f/f48 [16384,65536] 0 2024-02-19T19:12:13.832 INFO:tasks.workunit.client.1.smithi125.stdout:1/419: getdents d1/dc/d36/d39 0 2024-02-19T19:12:13.832 INFO:tasks.workunit.client.1.smithi125.stdout:1/420: rmdir d1/d26/d3c/d3f 39 2024-02-19T19:12:13.832 INFO:tasks.workunit.client.1.smithi125.stdout:1/421: write d1/dc/d36/d39/f5f [387246,46190] 0 2024-02-19T19:12:13.832 INFO:tasks.workunit.client.1.smithi125.stdout:1/422: mknod d1/d1a/c85 0 2024-02-19T19:12:13.832 INFO:tasks.workunit.client.1.smithi125.stdout:1/423: symlink d1/dc/d36/l86 0 2024-02-19T19:12:13.833 INFO:tasks.workunit.client.1.smithi125.stdout:1/424: write d1/d26/f40 [187210,43403] 0 2024-02-19T19:12:13.833 INFO:tasks.workunit.client.1.smithi125.stdout:1/425: mkdir d1/d1a/d3d/d6e/d87 0 2024-02-19T19:12:13.833 INFO:tasks.workunit.client.1.smithi125.stdout:1/426: getdents d1/d26 0 2024-02-19T19:12:13.833 INFO:tasks.workunit.client.1.smithi125.stdout:1/427: chown d1/d1a/d3d/d6e/d4b 6598 1 2024-02-19T19:12:13.833 INFO:tasks.workunit.client.1.smithi125.stdout:1/428: creat d1/d1a/f88 x:0 0 0 2024-02-19T19:12:13.833 INFO:tasks.workunit.client.1.smithi125.stdout:1/429: write d1/f47 [1430362,107425] 0 2024-02-19T19:12:13.833 INFO:tasks.workunit.client.1.smithi125.stdout:1/430: dread - d1/dc/d36/f77 zero size 2024-02-19T19:12:13.833 INFO:tasks.workunit.client.1.smithi125.stdout:1/431: chown f0 118215 1 2024-02-19T19:12:13.833 INFO:tasks.workunit.client.1.smithi125.stdout:1/432: mknod d1/d1a/d3d/d6e/c89 0 2024-02-19T19:12:13.833 INFO:tasks.workunit.client.1.smithi125.stdout:1/433: dread - d1/d26/f83 zero size 2024-02-19T19:12:13.834 INFO:tasks.workunit.client.1.smithi125.stdout:1/434: mkdir d1/d78/d8a 0 2024-02-19T19:12:13.834 INFO:tasks.workunit.client.1.smithi125.stdout:1/435: mknod d1/dc/d36/d69/c8b 0 2024-02-19T19:12:13.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.809+0000 7f180d48d700 1 -- 172.21.15.96:0/1885433229 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f17f406d8a0 msgr2=0x7f17f406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:13.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.809+0000 7f180d48d700 1 --2- 172.21.15.96:0/1885433229 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f17f406d8a0 0x7f17f406fd60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f17f0005950 tx=0x7f17f00058e0 comp rx=0 tx=0).stop 2024-02-19T19:12:13.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.809+0000 7f180d48d700 1 -- 172.21.15.96:0/1885433229 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18080ffc20 msgr2=0x7f18081976d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:13.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.809+0000 7f180d48d700 1 --2- 172.21.15.96:0/1885433229 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18080ffc20 0x7f18081976d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f17f80092e0 tx=0x7f17f800be20 comp rx=0 tx=0).stop 2024-02-19T19:12:13.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.809+0000 7f180d48d700 1 -- 172.21.15.96:0/1885433229 shutdown_connections 2024-02-19T19:12:13.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.809+0000 7f180d48d700 1 --2- 172.21.15.96:0/1885433229 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f17f406d8a0 0x7f17f406fd60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:13.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.809+0000 7f180d48d700 1 --2- 172.21.15.96:0/1885433229 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18080ffc20 0x7f18081976d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:13.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.810+0000 7f180d48d700 1 --2- 172.21.15.96:0/1885433229 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1808105bd0 0x7f1808197c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:13.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.810+0000 7f180d48d700 1 -- 172.21.15.96:0/1885433229 >> 172.21.15.96:0/1885433229 conn(0x7f1808075670 msgr2=0x7f18080feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:13.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.810+0000 7f180d48d700 1 -- 172.21.15.96:0/1885433229 shutdown_connections 2024-02-19T19:12:13.835 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:13.810+0000 7f180d48d700 1 -- 172.21.15.96:0/1885433229 wait complete. 2024-02-19T19:12:13.840 INFO:tasks.workunit.client.1.smithi125.stdout:9/351: dread d8/d15/d22/f67 [106496,36864] 0 2024-02-19T19:12:13.941 INFO:tasks.workunit.client.1.smithi125.stdout:9/352: dwrite d8/d15/d22/d4e/f47 [45056,53248] 0 2024-02-19T19:12:13.941 INFO:tasks.workunit.client.1.smithi125.stdout:9/353: rename d8/d15/d32/d4f/f6c to d8/d2e/d4c/f7c 0 2024-02-19T19:12:13.941 INFO:tasks.workunit.client.1.smithi125.stdout:9/354: symlink d8/d15/l7d 0 2024-02-19T19:12:13.942 INFO:tasks.workunit.client.1.smithi125.stdout:1/436: dwrite d1/d26/f73 [339968,106496] 0 2024-02-19T19:12:13.942 INFO:tasks.workunit.client.1.smithi125.stdout:1/437: dread d1/f14 [765952,49152] 0 2024-02-19T19:12:13.942 INFO:tasks.workunit.client.1.smithi125.stdout:1/438: chown d1/dc/c18 24 1 2024-02-19T19:12:13.943 INFO:tasks.workunit.client.1.smithi125.stdout:2/359: dwrite d1/d27/d45/f56 [1642496,102400] 0 2024-02-19T19:12:13.943 INFO:tasks.workunit.client.1.smithi125.stdout:2/360: stat d1/d27/d1d/d2c/d2e/f65 0 2024-02-19T19:12:13.943 INFO:tasks.workunit.client.1.smithi125.stdout:2/361: symlink d1/d27/d1d/d2c/l6a 0 2024-02-19T19:12:13.949 INFO:tasks.workunit.client.1.smithi125.stdout:5/569: dread db/d47/f7e [2629632,122880] 0 2024-02-19T19:12:13.950 INFO:tasks.workunit.client.1.smithi125.stdout:5/570: mknod db/d17/d58/d25/d40/cb3 0 2024-02-19T19:12:13.950 INFO:tasks.workunit.client.1.smithi125.stdout:5/571: write db/d47/f7e [3919548,48706] 0 2024-02-19T19:12:13.950 INFO:tasks.workunit.client.1.smithi125.stdout:5/572: dread db/d17/d58/f1f [73728,20480] 0 2024-02-19T19:12:13.950 INFO:tasks.workunit.client.1.smithi125.stdout:5/573: creat db/d17/d85/fb4 x:0 0 0 2024-02-19T19:12:13.950 INFO:tasks.workunit.client.1.smithi125.stdout:5/574: rmdir db/d17/d58 39 2024-02-19T19:12:13.958 INFO:tasks.workunit.client.1.smithi125.stdout:4/315: dread d0/df/f33 [36864,73728] 0 2024-02-19T19:12:13.958 INFO:tasks.workunit.client.1.smithi125.stdout:4/316: rmdir d0/d32/d60 39 2024-02-19T19:12:13.958 INFO:tasks.workunit.client.1.smithi125.stdout:4/317: chown d0/d7/d30/d58/f29 4418 1 2024-02-19T19:12:13.958 INFO:tasks.workunit.client.1.smithi125.stdout:4/318: truncate d0/d7/d30/d58/f29 227565 0 2024-02-19T19:12:13.958 INFO:tasks.workunit.client.1.smithi125.stdout:4/319: chown d0/d7/d30/d58/c1f 155 1 2024-02-19T19:12:13.958 INFO:tasks.workunit.client.1.smithi125.stdout:4/320: dread d0/d32/f36 [790528,53248] 0 2024-02-19T19:12:14.031 INFO:tasks.workunit.client.1.smithi125.stdout:6/355: fdatasync d6/db/f3d 0 2024-02-19T19:12:14.031 INFO:tasks.workunit.client.1.smithi125.stdout:6/356: chown d6/db/df/c41 6811770 1 2024-02-19T19:12:14.048 INFO:tasks.workunit.client.1.smithi125.stdout:1/439: fsync d1/d26/d23/f6d 0 2024-02-19T19:12:14.058 INFO:tasks.workunit.client.1.smithi125.stdout:4/321: dwrite d0/d7/d3b/f3d [45056,4096] 0 2024-02-19T19:12:14.058 INFO:tasks.workunit.client.1.smithi125.stdout:9/355: dwrite d8/d15/d32/d4f/f79 [671744,69632] 0 2024-02-19T19:12:14.058 INFO:tasks.workunit.client.1.smithi125.stdout:5/575: dwrite db/d17/d58/d33/d64/f82 [28672,114688] 0 2024-02-19T19:12:14.059 INFO:tasks.workunit.client.1.smithi125.stdout:5/576: chown db/d26/d51/l86 275662872 1 2024-02-19T19:12:14.059 INFO:tasks.workunit.client.1.smithi125.stdout:5/577: chown db/d17/d85 76512552 1 2024-02-19T19:12:14.059 INFO:tasks.workunit.client.1.smithi125.stdout:4/322: read d0/f2e [29599,17255] 0 2024-02-19T19:12:14.059 INFO:tasks.workunit.client.1.smithi125.stdout:9/356: write d8/f31 [336966,19806] 0 2024-02-19T19:12:14.059 INFO:tasks.workunit.client.1.smithi125.stdout:5/578: write db/d17/d58/d4f/f56 [1092443,15298] 0 2024-02-19T19:12:14.059 INFO:tasks.workunit.client.1.smithi125.stdout:9/357: getdents d8/d15/d32/d4f 0 2024-02-19T19:12:14.059 INFO:tasks.workunit.client.1.smithi125.stdout:9/358: mknod d8/d15/d32/c7e 0 2024-02-19T19:12:14.065 INFO:tasks.workunit.client.1.smithi125.stdout:6/357: dread d6/db/d5d/f24 [442368,28672] 0 2024-02-19T19:12:14.066 INFO:tasks.workunit.client.1.smithi125.stdout:1/440: dwrite d1/d1a/f2a [610304,126976] 0 2024-02-19T19:12:14.067 INFO:tasks.workunit.client.1.smithi125.stdout:1/441: symlink d1/d26/l8c 0 2024-02-19T19:12:14.067 INFO:tasks.workunit.client.1.smithi125.stdout:1/442: rename d1/d26/d23/f5c to d1/d26/d3c/d3f/f8d 0 2024-02-19T19:12:14.067 INFO:tasks.workunit.client.1.smithi125.stdout:1/443: creat d1/dc/d36/d69/f8e x:0 0 0 2024-02-19T19:12:14.067 INFO:tasks.workunit.client.1.smithi125.stdout:1/444: creat d1/d26/d3c/f8f x:0 0 0 2024-02-19T19:12:14.067 INFO:tasks.workunit.client.1.smithi125.stdout:1/445: write d1/d26/d3c/f8f [292547,61163] 0 2024-02-19T19:12:14.067 INFO:tasks.workunit.client.1.smithi125.stdout:1/446: rename d1/l7 to d1/d26/l90 0 2024-02-19T19:12:14.067 INFO:tasks.workunit.client.1.smithi125.stdout:1/447: write d1/f30 [547351,125553] 0 2024-02-19T19:12:14.067 INFO:tasks.workunit.client.1.smithi125.stdout:1/448: readlink d1/d26/l8c 0 2024-02-19T19:12:14.067 INFO:tasks.workunit.client.1.smithi125.stdout:1/449: truncate d1/d26/f71 1026797 0 2024-02-19T19:12:14.068 INFO:tasks.workunit.client.1.smithi125.stdout:1/450: chown d1/d26/l21 384 1 2024-02-19T19:12:14.068 INFO:tasks.workunit.client.1.smithi125.stdout:1/451: rename d1/d1a/d3d/d6e/d4b/l63 to d1/d26/d23/l91 0 2024-02-19T19:12:14.068 INFO:tasks.workunit.client.1.smithi125.stdout:1/452: write d1/dc/d36/d39/f5f [57165,78073] 0 2024-02-19T19:12:14.068 INFO:tasks.workunit.client.1.smithi125.stdout:8/382: sync 2024-02-19T19:12:14.068 INFO:tasks.workunit.client.1.smithi125.stdout:8/383: link db/d18/c3b db/d18/d2f/d72/c7b 0 2024-02-19T19:12:14.160 INFO:tasks.workunit.client.1.smithi125.stdout:9/359: dwrite d8/d15/d22/d4e/d6b/f76 [102400,81920] 0 2024-02-19T19:12:14.161 INFO:tasks.workunit.client.1.smithi125.stdout:9/360: dread d8/fe [208896,16384] 0 2024-02-19T19:12:14.161 INFO:tasks.workunit.client.1.smithi125.stdout:9/361: creat d8/d15/d22/d4e/f7f x:0 0 0 2024-02-19T19:12:14.161 INFO:tasks.workunit.client.1.smithi125.stdout:8/384: read db/f41 [149441,9600] 0 2024-02-19T19:12:14.161 INFO:tasks.workunit.client.1.smithi125.stdout:8/385: creat db/d18/d2f/d3f/f7c x:0 0 0 2024-02-19T19:12:14.161 INFO:tasks.workunit.client.1.smithi125.stdout:8/386: stat db/l40 0 2024-02-19T19:12:14.161 INFO:tasks.workunit.client.1.smithi125.stdout:8/387: readlink db/l28 0 2024-02-19T19:12:14.162 INFO:tasks.workunit.client.1.smithi125.stdout:8/388: symlink db/d18/d30/d48/l7d 0 2024-02-19T19:12:14.162 INFO:tasks.workunit.client.1.smithi125.stdout:8/389: symlink db/d18/d2f/l7e 0 2024-02-19T19:12:14.162 INFO:tasks.workunit.client.1.smithi125.stdout:8/390: write db/d18/d30/d48/f6c [785401,111857] 0 2024-02-19T19:12:14.162 INFO:tasks.workunit.client.1.smithi125.stdout:8/391: mknod db/d18/d30/d3c/d4d/c7f 0 2024-02-19T19:12:14.162 INFO:tasks.workunit.client.1.smithi125.stdout:8/392: rename db/d18/d30/d3c/d4d/d5d/d6f/d78 to db/d18/d30/d80 0 2024-02-19T19:12:14.162 INFO:tasks.workunit.client.1.smithi125.stdout:8/393: mkdir db/d81 0 2024-02-19T19:12:14.162 INFO:tasks.workunit.client.1.smithi125.stdout:8/394: write db/d18/d30/d3c/f68 [367722,55411] 0 2024-02-19T19:12:14.162 INFO:tasks.workunit.client.1.smithi125.stdout:8/395: creat db/d18/d30/f82 x:0 0 0 2024-02-19T19:12:14.162 INFO:tasks.workunit.client.1.smithi125.stdout:8/396: symlink db/d18/d30/d48/l83 0 2024-02-19T19:12:14.163 INFO:tasks.workunit.client.1.smithi125.stdout:8/397: dread db/f1e [20480,102400] 0 2024-02-19T19:12:14.163 INFO:tasks.workunit.client.1.smithi125.stdout:8/398: mknod db/d18/d30/d3c/d4d/c84 0 2024-02-19T19:12:14.163 INFO:tasks.workunit.client.1.smithi125.stdout:8/399: write db/f1e [925767,3606] 0 2024-02-19T19:12:14.185 INFO:tasks.workunit.client.1.smithi125.stdout:4/323: fsync d0/d7/d30/d58/f24 0 2024-02-19T19:12:14.185 INFO:tasks.workunit.client.1.smithi125.stdout:4/324: unlink d0/df/c49 0 2024-02-19T19:12:14.185 INFO:tasks.workunit.client.1.smithi125.stdout:4/325: creat d0/d7/f66 x:0 0 0 2024-02-19T19:12:14.185 INFO:tasks.workunit.client.1.smithi125.stdout:4/326: chown d0/d7/d3b/c4f 450490 1 2024-02-19T19:12:14.189 INFO:tasks.workunit.client.1.smithi125.stdout:6/358: fsync d6/db/f17 0 2024-02-19T19:12:14.189 INFO:tasks.workunit.client.1.smithi125.stdout:1/453: fsync d1/d26/d23/f6d 0 2024-02-19T19:12:14.194 INFO:tasks.workunit.client.1.smithi125.stdout:4/327: unlink d0/d7/d30/d58/c4d 0 2024-02-19T19:12:14.194 INFO:tasks.workunit.client.1.smithi125.stdout:9/362: dwrite d8/d2e/f45 [204800,106496] 0 2024-02-19T19:12:14.194 INFO:tasks.workunit.client.1.smithi125.stdout:1/454: symlink d1/d26/d3c/l92 0 2024-02-19T19:12:14.194 INFO:tasks.workunit.client.1.smithi125.stdout:9/363: readlink d8/d15/d32/l1e 0 2024-02-19T19:12:14.198 INFO:tasks.workunit.client.1.smithi125.stdout:4/328: rename d0/d7/d3b/c4f to d0/d32/d60/c67 0 2024-02-19T19:12:14.198 INFO:tasks.workunit.client.1.smithi125.stdout:4/329: mknod d0/d32/c68 0 2024-02-19T19:12:14.198 INFO:tasks.workunit.client.1.smithi125.stdout:9/364: mknod d8/d15/c80 0 2024-02-19T19:12:14.199 INFO:tasks.workunit.client.1.smithi125.stdout:4/330: dread d0/d7/d3b/f3d [655360,118784] 0 2024-02-19T19:12:14.199 INFO:tasks.workunit.client.1.smithi125.stdout:4/331: unlink d0/df/f1d 0 2024-02-19T19:12:14.199 INFO:tasks.workunit.client.1.smithi125.stdout:4/332: creat d0/d7/d30/d58/f69 x:0 0 0 2024-02-19T19:12:14.199 INFO:tasks.workunit.client.1.smithi125.stdout:4/333: symlink d0/d7/d30/d42/l6a 0 2024-02-19T19:12:14.199 INFO:tasks.workunit.client.1.smithi125.stdout:9/365: write d8/d15/f7b [385838,125436] 0 2024-02-19T19:12:14.199 INFO:tasks.workunit.client.1.smithi125.stdout:4/334: link d0/df/f1c d0/d7/d3b/f6b 0 2024-02-19T19:12:14.199 INFO:tasks.workunit.client.1.smithi125.stdout:9/366: symlink d8/d15/d22/d4e/d6b/l81 0 2024-02-19T19:12:14.199 INFO:tasks.workunit.client.1.smithi125.stdout:4/335: mkdir d0/d7/d30/d6c 0 2024-02-19T19:12:14.200 INFO:tasks.workunit.client.1.smithi125.stdout:4/336: getdents d0/df 0 2024-02-19T19:12:14.200 INFO:tasks.workunit.client.1.smithi125.stdout:4/337: rename d0/d7/d30/d42/l6a to d0/d32/d60/l6d 0 2024-02-19T19:12:14.200 INFO:tasks.workunit.client.1.smithi125.stdout:4/338: dread d0/d7/d3b/f6b [495616,106496] 0 2024-02-19T19:12:14.200 INFO:tasks.workunit.client.1.smithi125.stdout:4/339: chown d0/d7/d30/c37 104691 1 2024-02-19T19:12:14.200 INFO:tasks.workunit.client.1.smithi125.stdout:4/340: creat d0/d7/d30/d58/f6e x:0 0 0 2024-02-19T19:12:14.200 INFO:tasks.workunit.client.1.smithi125.stdout:4/341: unlink d0/d7/d30/d58/c19 0 2024-02-19T19:12:14.200 INFO:tasks.workunit.client.1.smithi125.stdout:4/342: symlink d0/d7/d3b/l6f 0 2024-02-19T19:12:14.200 INFO:tasks.workunit.client.1.smithi125.stdout:4/343: readlink d0/d32/l44 0 2024-02-19T19:12:14.201 INFO:tasks.workunit.client.1.smithi125.stdout:1/455: creat d1/dc/d36/f93 x:0 0 0 2024-02-19T19:12:14.201 INFO:tasks.workunit.client.1.smithi125.stdout:1/456: rmdir d1/d78 39 2024-02-19T19:12:14.201 INFO:tasks.workunit.client.1.smithi125.stdout:1/457: truncate d1/d26/d23/f68 963057 0 2024-02-19T19:12:14.201 INFO:tasks.workunit.client.1.smithi125.stdout:1/458: truncate d1/dc/f52 608324 0 2024-02-19T19:12:14.201 INFO:tasks.workunit.client.1.smithi125.stdout:1/459: truncate d1/d78/d80/f35 941330 0 2024-02-19T19:12:14.201 INFO:tasks.workunit.client.1.smithi125.stdout:1/460: chown d1/dc/d36/d39 75796 1 2024-02-19T19:12:14.201 INFO:tasks.workunit.client.1.smithi125.stdout:1/461: chown d1/dc/f1f 699 1 2024-02-19T19:12:14.201 INFO:tasks.workunit.client.1.smithi125.stdout:1/462: chown d1/dc/d36/f4f 50058 1 2024-02-19T19:12:14.201 INFO:tasks.workunit.client.1.smithi125.stdout:6/359: dwrite d6/db/d5d/f2a [937984,36864] 0 2024-02-19T19:12:14.202 INFO:tasks.workunit.client.1.smithi125.stdout:1/463: read d1/dc/f17 [23975,109399] 0 2024-02-19T19:12:14.202 INFO:tasks.workunit.client.1.smithi125.stdout:1/464: readlink d1/dc/d36/l86 0 2024-02-19T19:12:14.202 INFO:tasks.workunit.client.1.smithi125.stdout:1/465: symlink d1/d78/d80/l94 0 2024-02-19T19:12:14.202 INFO:tasks.workunit.client.1.smithi125.stdout:1/466: mknod d1/d26/d3c/c95 0 2024-02-19T19:12:14.202 INFO:tasks.workunit.client.1.smithi125.stdout:1/467: chown d1 99291487 1 2024-02-19T19:12:14.202 INFO:tasks.workunit.client.1.smithi125.stdout:1/468: creat d1/d26/d23/f96 x:0 0 0 2024-02-19T19:12:14.202 INFO:tasks.workunit.client.1.smithi125.stdout:1/469: dread d1/dc/f1b [143360,69632] 0 2024-02-19T19:12:14.202 INFO:tasks.workunit.client.1.smithi125.stdout:9/367: dwrite d8/d15/d22/d44/f7a [876544,90112] 0 2024-02-19T19:12:14.203 INFO:tasks.workunit.client.1.smithi125.stdout:9/368: mknod d8/d15/d22/d44/c82 0 2024-02-19T19:12:14.203 INFO:tasks.workunit.client.1.smithi125.stdout:9/369: rename f1 to d8/d15/d22/d4e/f83 0 2024-02-19T19:12:14.203 INFO:tasks.workunit.client.1.smithi125.stdout:9/370: chown d8/d2e 4353 1 2024-02-19T19:12:14.203 INFO:tasks.workunit.client.1.smithi125.stdout:9/371: chown d8/d2e/f4b 14227711 1 2024-02-19T19:12:14.280 INFO:tasks.workunit.client.1.smithi125.stdout:0/374: sync 2024-02-19T19:12:14.281 INFO:tasks.workunit.client.1.smithi125.stdout:3/318: sync 2024-02-19T19:12:14.281 INFO:tasks.workunit.client.1.smithi125.stdout:3/319: symlink d0/d1/d1e/l64 0 2024-02-19T19:12:14.281 INFO:tasks.workunit.client.1.smithi125.stdout:1/470: dwrite d1/dc/f17 [139264,16384] 0 2024-02-19T19:12:14.281 INFO:tasks.workunit.client.1.smithi125.stdout:6/360: dwrite d6/db/d5d/d2f/f48 [1306624,81920] 0 2024-02-19T19:12:14.351 INFO:tasks.workunit.client.1.smithi125.stdout:1/471: fdatasync d1/d1a/f88 0 2024-02-19T19:12:14.351 INFO:tasks.workunit.client.1.smithi125.stdout:6/361: fdatasync d6/db/d5d/f36 0 2024-02-19T19:12:14.357 INFO:tasks.workunit.client.1.smithi125.stdout:7/382: sync 2024-02-19T19:12:14.357 INFO:tasks.workunit.client.1.smithi125.stdout:2/362: sync 2024-02-19T19:12:14.357 INFO:tasks.workunit.client.1.smithi125.stdout:2/363: chown d1/d27/d1d/f2b 407603528 1 2024-02-19T19:12:14.357 INFO:tasks.workunit.client.1.smithi125.stdout:7/383: write f5 [2827312,35402] 0 2024-02-19T19:12:14.359 INFO:tasks.workunit.client.1.smithi125.stdout:3/320: dwrite d0/d1/f17 [581632,90112] 0 2024-02-19T19:12:14.359 INFO:tasks.workunit.client.1.smithi125.stdout:2/364: symlink d1/d27/d1d/d2c/l6b 0 2024-02-19T19:12:14.359 INFO:tasks.workunit.client.1.smithi125.stdout:1/472: symlink d1/l97 0 2024-02-19T19:12:14.359 INFO:tasks.workunit.client.1.smithi125.stdout:2/365: chown d1/d27/d1d/d2c/d2e 1630 1 2024-02-19T19:12:14.359 INFO:tasks.workunit.client.1.smithi125.stdout:1/473: rmdir d1/d78 39 2024-02-19T19:12:14.359 INFO:tasks.workunit.client.1.smithi125.stdout:2/366: creat d1/d27/d1d/d2c/d2e/f6c x:0 0 0 2024-02-19T19:12:14.360 INFO:tasks.workunit.client.1.smithi125.stdout:1/474: creat d1/dc/d36/d69/f98 x:0 0 0 2024-02-19T19:12:14.360 INFO:tasks.workunit.client.1.smithi125.stdout:2/367: truncate d1/d27/d1d/d39/d40/f49 1561187 0 2024-02-19T19:12:14.360 INFO:tasks.workunit.client.1.smithi125.stdout:2/368: creat d1/d36/f6d x:0 0 0 2024-02-19T19:12:14.360 INFO:tasks.workunit.client.1.smithi125.stdout:1/475: symlink d1/d26/l99 0 2024-02-19T19:12:14.360 INFO:tasks.workunit.client.1.smithi125.stdout:2/369: dread d1/d27/d1d/d25/d2a/f5f [204800,16384] 0 2024-02-19T19:12:14.360 INFO:tasks.workunit.client.1.smithi125.stdout:1/476: getdents d1/d1a 0 2024-02-19T19:12:14.360 INFO:tasks.workunit.client.1.smithi125.stdout:1/477: rename d1/d1a/d3d/d6e to d1/d1a/d3d/d6e/d9a 22 2024-02-19T19:12:14.361 INFO:tasks.workunit.client.1.smithi125.stdout:1/478: dread d1/d78/d80/f5d [49152,114688] 0 2024-02-19T19:12:14.361 INFO:tasks.workunit.client.1.smithi125.stdout:1/479: stat d1/dc/d36/f93 0 2024-02-19T19:12:14.361 INFO:tasks.workunit.client.1.smithi125.stdout:1/480: creat d1/f9b x:0 0 0 2024-02-19T19:12:14.361 INFO:tasks.workunit.client.1.smithi125.stdout:1/481: rename d1/d26/d3c/d3f/c58 to d1/d78/d80/c9c 0 2024-02-19T19:12:14.362 INFO:tasks.workunit.client.1.smithi125.stdout:0/375: dread d5/d19/d27/d32/f3a [892928,61440] 0 2024-02-19T19:12:14.362 INFO:tasks.workunit.client.1.smithi125.stdout:0/376: chown d5/d19/d27/d32/f3a 37566059 1 2024-02-19T19:12:14.362 INFO:tasks.workunit.client.1.smithi125.stdout:0/377: mkdir d5/d33/d42/d8f 0 2024-02-19T19:12:14.362 INFO:tasks.workunit.client.1.smithi125.stdout:0/378: symlink d5/d19/d27/l90 0 2024-02-19T19:12:14.362 INFO:tasks.workunit.client.1.smithi125.stdout:0/379: symlink d5/d19/d2b/l91 0 2024-02-19T19:12:14.362 INFO:tasks.workunit.client.1.smithi125.stdout:0/380: unlink d5/d1a/c67 0 2024-02-19T19:12:14.362 INFO:tasks.workunit.client.1.smithi125.stdout:0/381: chown d5/l35 976 1 2024-02-19T19:12:14.425 INFO:tasks.workunit.client.1.smithi125.stdout:7/384: fsync d12/d18/d2c/f42 0 2024-02-19T19:12:14.426 INFO:tasks.workunit.client.1.smithi125.stdout:7/385: mkdir d12/d18/d44/d3b/d59/d2a/d6a/d6d 0 2024-02-19T19:12:14.426 INFO:tasks.workunit.client.1.smithi125.stdout:7/386: write d12/d18/d44/d3b/d59/d26/d30/d37/f62 [1831735,73481] 0 2024-02-19T19:12:14.426 INFO:tasks.workunit.client.1.smithi125.stdout:2/370: fsync d1/d27/d1d/d25/d2a/f34 0 2024-02-19T19:12:14.426 INFO:tasks.workunit.client.1.smithi125.stdout:6/362: dwrite d6/db/df/d3b/f5a [995328,16384] 0 2024-02-19T19:12:14.426 INFO:tasks.workunit.client.1.smithi125.stdout:6/363: rmdir d6/db/df/d3b 39 2024-02-19T19:12:14.427 INFO:tasks.workunit.client.1.smithi125.stdout:3/321: dwrite d0/de/f3b [614400,16384] 0 2024-02-19T19:12:14.428 INFO:tasks.workunit.client.1.smithi125.stdout:1/482: dwrite d1/d26/f83 [446464,102400] 0 2024-02-19T19:12:14.428 INFO:tasks.workunit.client.1.smithi125.stdout:0/382: dwrite d5/d19/d27/f5c [647168,94208] 0 2024-02-19T19:12:14.428 INFO:tasks.workunit.client.1.smithi125.stdout:0/383: getdents d5/d9/d75 0 2024-02-19T19:12:14.428 INFO:tasks.workunit.client.1.smithi125.stdout:0/384: rmdir d5/d19/d27/d32 39 2024-02-19T19:12:14.428 INFO:tasks.workunit.client.1.smithi125.stdout:7/387: dwrite d12/f33 [495616,106496] 0 2024-02-19T19:12:14.436 INFO:tasks.workunit.client.1.smithi125.stdout:2/371: dread d1/d27/d1d/d25/f2d [217088,77824] 0 2024-02-19T19:12:14.476 INFO:tasks.workunit.client.1.smithi125.stdout:0/385: fsync d5/d15/f5b 0 2024-02-19T19:12:14.476 INFO:tasks.workunit.client.1.smithi125.stdout:0/386: stat d5/d19/d27/d32/f3a 0 2024-02-19T19:12:14.480 INFO:tasks.workunit.client.1.smithi125.stdout:3/322: write d0/d1/d1e/f1f [728819,3445] 0 2024-02-19T19:12:14.480 INFO:tasks.workunit.client.1.smithi125.stdout:3/323: chown d0 1316861 1 2024-02-19T19:12:14.481 INFO:tasks.workunit.client.1.smithi125.stdout:1/483: dwrite d1/dc/f72 [839680,77824] 0 2024-02-19T19:12:14.481 INFO:tasks.workunit.client.1.smithi125.stdout:2/372: dwrite d1/d27/d45/f5c [499712,20480] 0 2024-02-19T19:12:14.482 INFO:tasks.workunit.client.1.smithi125.stdout:3/324: creat d0/d1/f65 x:0 0 0 2024-02-19T19:12:14.482 INFO:tasks.workunit.client.1.smithi125.stdout:3/325: getdents d0/d1/d1e/d60 0 2024-02-19T19:12:14.482 INFO:tasks.workunit.client.1.smithi125.stdout:1/484: creat d1/d26/d3c/f9d x:0 0 0 2024-02-19T19:12:14.482 INFO:tasks.workunit.client.1.smithi125.stdout:1/485: mknod d1/d26/d3c/c9e 0 2024-02-19T19:12:14.482 INFO:tasks.workunit.client.1.smithi125.stdout:3/326: readlink d0/d1/d4b/l55 0 2024-02-19T19:12:14.482 INFO:tasks.workunit.client.1.smithi125.stdout:1/486: rmdir d1/d26/d3c/d3f 39 2024-02-19T19:12:14.482 INFO:tasks.workunit.client.1.smithi125.stdout:3/327: link d0/c26 d0/d1/c66 0 2024-02-19T19:12:14.482 INFO:tasks.workunit.client.1.smithi125.stdout:1/487: symlink d1/d1a/l9f 0 2024-02-19T19:12:14.482 INFO:tasks.workunit.client.1.smithi125.stdout:3/328: dread d0/de/f2b [462848,94208] 0 2024-02-19T19:12:14.483 INFO:tasks.workunit.client.1.smithi125.stdout:1/488: chown d1/d1a/f2e 5096700 1 2024-02-19T19:12:14.483 INFO:tasks.workunit.client.1.smithi125.stdout:3/329: chown d0/d1/d39/l48 56904 1 2024-02-19T19:12:14.483 INFO:tasks.workunit.client.1.smithi125.stdout:1/489: mknod d1/dc/d36/d39/ca0 0 2024-02-19T19:12:14.483 INFO:tasks.workunit.client.1.smithi125.stdout:1/490: creat d1/dc/d36/d39/fa1 x:0 0 0 2024-02-19T19:12:14.483 INFO:tasks.workunit.client.1.smithi125.stdout:1/491: dread d1/d26/d3c/f46 [90112,49152] 0 2024-02-19T19:12:14.485 INFO:tasks.workunit.client.1.smithi125.stdout:7/388: dread d12/d18/d44/d3b/d59/d26/f2f [217088,4096] 0 2024-02-19T19:12:14.485 INFO:tasks.workunit.client.1.smithi125.stdout:7/389: write d12/d18/d44/d3b/d59/d26/f2f [263108,71125] 0 2024-02-19T19:12:14.485 INFO:tasks.workunit.client.1.smithi125.stdout:7/390: dread d12/d18/d44/d3b/d59/d2a/d48/f49 [8192,20480] 0 2024-02-19T19:12:14.485 INFO:tasks.workunit.client.1.smithi125.stdout:7/391: write d12/f33 [1543742,45145] 0 2024-02-19T19:12:14.485 INFO:tasks.workunit.client.1.smithi125.stdout:7/392: creat d12/d18/d44/d3b/d59/d2a/d31/d50/d60/f6e x:0 0 0 2024-02-19T19:12:14.485 INFO:tasks.workunit.client.1.smithi125.stdout:7/393: write d12/d18/d44/d3b/d59/d26/d54/f5b [117794,68805] 0 2024-02-19T19:12:14.485 INFO:tasks.workunit.client.1.smithi125.stdout:7/394: dread - d12/d18/f3c zero size 2024-02-19T19:12:14.486 INFO:tasks.workunit.client.1.smithi125.stdout:7/395: stat d12/f45 0 2024-02-19T19:12:14.486 INFO:tasks.workunit.client.1.smithi125.stdout:7/396: truncate d12/f45 616867 0 2024-02-19T19:12:14.486 INFO:tasks.workunit.client.1.smithi125.stdout:7/397: read fc [135589,25475] 0 2024-02-19T19:12:14.486 INFO:tasks.workunit.client.1.smithi125.stdout:7/398: mknod d12/d18/d44/d3b/d59/d26/c6f 0 2024-02-19T19:12:14.487 INFO:tasks.workunit.client.1.smithi125.stdout:0/387: dwrite d5/d1a/f55 [626688,106496] 0 2024-02-19T19:12:14.488 INFO:tasks.workunit.client.1.smithi125.stdout:0/388: dread d5/d33/d46/f6a [102400,73728] 0 2024-02-19T19:12:14.488 INFO:tasks.workunit.client.1.smithi125.stdout:2/373: dwrite d1/d27/d1d/d39/d40/f49 [557056,61440] 0 2024-02-19T19:12:14.488 INFO:tasks.workunit.client.1.smithi125.stdout:2/374: dread d1/d27/f22 [2899968,61440] 0 2024-02-19T19:12:14.488 INFO:tasks.workunit.client.1.smithi125.stdout:2/375: rmdir d1/d27/d1d/d39/d4c 0 2024-02-19T19:12:14.488 INFO:tasks.workunit.client.1.smithi125.stdout:2/376: truncate d1/d27/d1d/d39/f69 797554 0 2024-02-19T19:12:14.488 INFO:tasks.workunit.client.1.smithi125.stdout:2/377: getdents d1/d27/d1d/d39/d40/d4b 0 2024-02-19T19:12:14.488 INFO:tasks.workunit.client.1.smithi125.stdout:3/330: dwrite d0/d1/f56 [393216,40960] 0 2024-02-19T19:12:14.488 INFO:tasks.workunit.client.1.smithi125.stdout:2/378: write d1/d27/d1d/d39/d40/f49 [96086,12829] 0 2024-02-19T19:12:14.489 INFO:tasks.workunit.client.1.smithi125.stdout:2/379: creat d1/d27/d1d/d25/f6e x:0 0 0 2024-02-19T19:12:14.489 INFO:tasks.workunit.client.1.smithi125.stdout:3/331: creat d0/d1/d4b/f67 x:0 0 0 2024-02-19T19:12:14.489 INFO:tasks.workunit.client.1.smithi125.stdout:2/380: mknod d1/d27/d1d/d39/d40/d4b/c6f 0 2024-02-19T19:12:14.489 INFO:tasks.workunit.client.1.smithi125.stdout:2/381: write d1/d27/d1d/d2c/d2e/f65 [1655592,84809] 0 2024-02-19T19:12:14.492 INFO:tasks.workunit.client.1.smithi125.stdout:7/399: read f5 [1112823,7886] 0 2024-02-19T19:12:14.566 INFO:tasks.workunit.client.1.smithi125.stdout:1/492: fsync d1/dc/d36/d39/f5f 0 2024-02-19T19:12:14.567 INFO:tasks.workunit.client.1.smithi125.stdout:1/493: mknod d1/d78/d8a/ca2 0 2024-02-19T19:12:14.567 INFO:tasks.workunit.client.1.smithi125.stdout:0/389: dread d5/d15/f8a [299008,114688] 0 2024-02-19T19:12:14.570 INFO:tasks.workunit.client.1.smithi125.stdout:3/332: link d0/de/f3b d0/d1/d1e/f68 0 2024-02-19T19:12:14.570 INFO:tasks.workunit.client.1.smithi125.stdout:3/333: dread d0/de/f44 [380928,24576] 0 2024-02-19T19:12:14.570 INFO:tasks.workunit.client.1.smithi125.stdout:3/334: write d0/d1/d1e/f68 [1286395,110003] 0 2024-02-19T19:12:14.570 INFO:tasks.workunit.client.1.smithi125.stdout:3/335: mkdir d0/d1/d1e/d69 0 2024-02-19T19:12:14.573 INFO:tasks.workunit.client.1.smithi125.stdout:4/344: sync 2024-02-19T19:12:14.574 INFO:tasks.workunit.client.1.smithi125.stdout:9/372: sync 2024-02-19T19:12:14.574 INFO:tasks.workunit.client.1.smithi125.stdout:8/400: sync 2024-02-19T19:12:14.574 INFO:tasks.workunit.client.1.smithi125.stdout:5/579: sync 2024-02-19T19:12:14.574 INFO:tasks.workunit.client.1.smithi125.stdout:4/345: link d0/d7/d3b/f3d d0/d7/d30/d6c/f70 0 2024-02-19T19:12:14.574 INFO:tasks.workunit.client.1.smithi125.stdout:8/401: truncate db/d18/d30/f43 496318 0 2024-02-19T19:12:14.574 INFO:tasks.workunit.client.1.smithi125.stdout:9/373: mkdir d8/d2e/d4c/d84 0 2024-02-19T19:12:14.574 INFO:tasks.workunit.client.1.smithi125.stdout:9/374: chown d8/d2e/d4c/f7c 263045 1 2024-02-19T19:12:14.574 INFO:tasks.workunit.client.1.smithi125.stdout:4/346: creat d0/d7/f71 x:0 0 0 2024-02-19T19:12:14.575 INFO:tasks.workunit.client.1.smithi125.stdout:8/402: creat db/d6d/f85 x:0 0 0 2024-02-19T19:12:14.575 INFO:tasks.workunit.client.1.smithi125.stdout:9/375: mkdir d8/d15/d32/d4f/d85 0 2024-02-19T19:12:14.575 INFO:tasks.workunit.client.1.smithi125.stdout:4/347: rename d0/c57 to d0/d7/d30/d5d/c72 0 2024-02-19T19:12:14.575 INFO:tasks.workunit.client.1.smithi125.stdout:4/348: chown d0/d7/d30/d58/fd 3471 1 2024-02-19T19:12:14.575 INFO:tasks.workunit.client.1.smithi125.stdout:8/403: write db/d18/d2f/d3f/f75 [487599,72849] 0 2024-02-19T19:12:14.575 INFO:tasks.workunit.client.1.smithi125.stdout:9/376: creat d8/d15/f86 x:0 0 0 2024-02-19T19:12:14.575 INFO:tasks.workunit.client.1.smithi125.stdout:7/400: dwrite d12/f33 [2502656,73728] 0 2024-02-19T19:12:14.575 INFO:tasks.workunit.client.1.smithi125.stdout:9/377: mknod d8/d15/c87 0 2024-02-19T19:12:14.576 INFO:tasks.workunit.client.1.smithi125.stdout:7/401: unlink d12/d18/d44/c29 0 2024-02-19T19:12:14.576 INFO:tasks.workunit.client.1.smithi125.stdout:9/378: creat d8/d2e/d6d/f88 x:0 0 0 2024-02-19T19:12:14.576 INFO:tasks.workunit.client.1.smithi125.stdout:7/402: mknod d12/d18/d44/d3b/d59/d26/d30/d37/c70 0 2024-02-19T19:12:14.576 INFO:tasks.workunit.client.1.smithi125.stdout:9/379: creat d8/d15/d22/d44/f89 x:0 0 0 2024-02-19T19:12:14.576 INFO:tasks.workunit.client.1.smithi125.stdout:2/382: dwrite d1/f2 [5201920,49152] 0 2024-02-19T19:12:14.576 INFO:tasks.workunit.client.1.smithi125.stdout:2/383: dread d1/d27/d45/f56 [602112,16384] 0 2024-02-19T19:12:14.576 INFO:tasks.workunit.client.1.smithi125.stdout:9/380: dread f6 [352256,110592] 0 2024-02-19T19:12:14.576 INFO:tasks.workunit.client.1.smithi125.stdout:9/381: chown d8/d2e/c62 17739 1 2024-02-19T19:12:14.576 INFO:tasks.workunit.client.1.smithi125.stdout:2/384: rename d1/d27/d1d/d39/d40 to d1/d36/d70 0 2024-02-19T19:12:14.577 INFO:tasks.workunit.client.1.smithi125.stdout:2/385: dread d1/f59 [385024,77824] 0 2024-02-19T19:12:14.577 INFO:tasks.workunit.client.1.smithi125.stdout:2/386: chown d1/d27/d45/f56 5857 1 2024-02-19T19:12:14.577 INFO:tasks.workunit.client.1.smithi125.stdout:2/387: dread d1/d27/f11 [40960,8192] 0 2024-02-19T19:12:14.577 INFO:tasks.workunit.client.1.smithi125.stdout:2/388: stat d1/d27/d1d 0 2024-02-19T19:12:14.577 INFO:tasks.workunit.client.1.smithi125.stdout:1/494: dwrite d1/d26/d3c/f46 [1212416,61440] 0 2024-02-19T19:12:14.577 INFO:tasks.workunit.client.1.smithi125.stdout:9/382: write d8/d15/d22/d4e/f83 [684454,87860] 0 2024-02-19T19:12:14.577 INFO:tasks.workunit.client.1.smithi125.stdout:1/495: getdents d1/dc/d36/d39 0 2024-02-19T19:12:14.577 INFO:tasks.workunit.client.1.smithi125.stdout:1/496: chown d1/d1a 564515 1 2024-02-19T19:12:14.578 INFO:tasks.workunit.client.1.smithi125.stdout:1/497: read d1/dc/f1b [1096559,92539] 0 2024-02-19T19:12:14.578 INFO:tasks.workunit.client.1.smithi125.stdout:0/390: dwrite d5/d15/d2c/f43 [806912,61440] 0 2024-02-19T19:12:14.578 INFO:tasks.workunit.client.1.smithi125.stdout:0/391: mkdir d5/d33/d42/d92 0 2024-02-19T19:12:14.578 INFO:tasks.workunit.client.1.smithi125.stdout:0/392: write d5/d15/f82 [459810,114675] 0 2024-02-19T19:12:14.578 INFO:tasks.workunit.client.1.smithi125.stdout:0/393: stat d5/d19/d2b/c6e 0 2024-02-19T19:12:14.581 INFO:tasks.workunit.client.1.smithi125.stdout:4/349: dread d0/d7/d30/d58/f2d [839680,98304] 0 2024-02-19T19:12:14.642 INFO:tasks.workunit.client.1.smithi125.stdout:3/336: fsync d0/de/f3d 0 2024-02-19T19:12:14.643 INFO:tasks.workunit.client.1.smithi125.stdout:5/580: dwrite db/d17/d58/d4f/f7a [3641344,77824] 0 2024-02-19T19:12:14.643 INFO:tasks.workunit.client.1.smithi125.stdout:5/581: rmdir db/d17 39 2024-02-19T19:12:14.646 INFO:tasks.workunit.client.1.smithi125.stdout:7/403: dwrite d12/d18/d44/d3b/d59/d26/f28 [2912256,4096] 0 2024-02-19T19:12:14.646 INFO:tasks.workunit.client.1.smithi125.stdout:7/404: write fc [745157,87120] 0 2024-02-19T19:12:14.646 INFO:tasks.workunit.client.1.smithi125.stdout:7/405: dread d12/d18/d44/d51/f56 [1265664,122880] 0 2024-02-19T19:12:14.646 INFO:tasks.workunit.client.1.smithi125.stdout:3/337: dwrite d0/de/f44 [167936,86016] 0 2024-02-19T19:12:14.646 INFO:tasks.workunit.client.1.smithi125.stdout:3/338: stat d0/d1/d4b/d52 0 2024-02-19T19:12:14.646 INFO:tasks.workunit.client.1.smithi125.stdout:5/582: dwrite db/d17/d58/d33/d98/d9c/f9e [966656,49152] 0 2024-02-19T19:12:14.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:14 smithi125 ceph-mon[86115]: pgmap v152: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:12:14.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:14 smithi125 ceph-mon[86115]: from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:12:14.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:14 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/1885433229' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:12:14.723 INFO:tasks.workunit.client.1.smithi125.stdout:9/383: fdatasync d8/d15/f7b 0 2024-02-19T19:12:14.730 INFO:tasks.workunit.client.1.smithi125.stdout:4/350: dwrite d0/f1b [90112,49152] 0 2024-02-19T19:12:14.730 INFO:tasks.workunit.client.1.smithi125.stdout:5/583: mknod db/d17/d58/cb5 0 2024-02-19T19:12:14.731 INFO:tasks.workunit.client.1.smithi125.stdout:5/584: dread db/d17/d85/f95 [110592,81920] 0 2024-02-19T19:12:14.731 INFO:tasks.workunit.client.1.smithi125.stdout:5/585: getdents db/d17/d58/d25 0 2024-02-19T19:12:14.731 INFO:tasks.workunit.client.1.smithi125.stdout:3/339: mkdir d0/d1/d1e/d60/d6a 0 2024-02-19T19:12:14.731 INFO:tasks.workunit.client.1.smithi125.stdout:3/340: chown d0/d1/f4d 1853400 1 2024-02-19T19:12:14.731 INFO:tasks.workunit.client.1.smithi125.stdout:9/384: symlink d8/d15/d22/d4e/l8a 0 2024-02-19T19:12:14.731 INFO:tasks.workunit.client.1.smithi125.stdout:9/385: chown d8/d15/d22/d4e/f47 921 1 2024-02-19T19:12:14.731 INFO:tasks.workunit.client.1.smithi125.stdout:9/386: rename d8/d15/d32/c2b to d8/d2e/d4c/c8b 0 2024-02-19T19:12:14.731 INFO:tasks.workunit.client.1.smithi125.stdout:9/387: write d8/d15/d32/f3f [1272101,115342] 0 2024-02-19T19:12:14.732 INFO:tasks.workunit.client.1.smithi125.stdout:9/388: write d8/d15/f61 [605736,3614] 0 2024-02-19T19:12:14.732 INFO:tasks.workunit.client.1.smithi125.stdout:9/389: unlink d8/f26 0 2024-02-19T19:12:14.732 INFO:tasks.workunit.client.1.smithi125.stdout:9/390: creat d8/d2e/d4c/d84/f8c x:0 0 0 2024-02-19T19:12:14.732 INFO:tasks.workunit.client.1.smithi125.stdout:9/391: getdents d8/d15/d32/d4f/d6e 0 2024-02-19T19:12:14.732 INFO:tasks.workunit.client.1.smithi125.stdout:9/392: creat d8/d15/d32/d4f/d6e/f8d x:0 0 0 2024-02-19T19:12:14.732 INFO:tasks.workunit.client.1.smithi125.stdout:9/393: rmdir d8/d15/d22/d4e/d6b 39 2024-02-19T19:12:14.732 INFO:tasks.workunit.client.1.smithi125.stdout:9/394: symlink d8/l8e 0 2024-02-19T19:12:14.732 INFO:tasks.workunit.client.1.smithi125.stdout:9/395: creat d8/d15/d32/d4f/d6e/f8f x:0 0 0 2024-02-19T19:12:14.733 INFO:tasks.workunit.client.1.smithi125.stdout:9/396: read d8/d15/d32/f65 [806725,54132] 0 2024-02-19T19:12:14.733 INFO:tasks.workunit.client.1.smithi125.stdout:9/397: readlink d8/d15/l3a 0 2024-02-19T19:12:14.733 INFO:tasks.workunit.client.1.smithi125.stdout:9/398: write d8/d15/d32/d4f/f59 [832253,13409] 0 2024-02-19T19:12:14.733 INFO:tasks.workunit.client.1.smithi125.stdout:9/399: mkdir d8/d15/d22/d4e/d90 0 2024-02-19T19:12:14.733 INFO:tasks.workunit.client.1.smithi125.stdout:9/400: write d8/d15/d32/d4f/d6e/f8d [998796,4181] 0 2024-02-19T19:12:14.733 INFO:tasks.workunit.client.1.smithi125.stdout:9/401: chown d8/d15/l3a 1318939 1 2024-02-19T19:12:14.733 INFO:tasks.workunit.client.1.smithi125.stdout:9/402: dread f3 [1249280,53248] 0 2024-02-19T19:12:14.733 INFO:tasks.workunit.client.1.smithi125.stdout:9/403: creat d8/d2e/d4c/f91 x:0 0 0 2024-02-19T19:12:14.734 INFO:tasks.workunit.client.1.smithi125.stdout:9/404: link d8/d15/d22/d4e/f54 d8/d15/d22/d44/f92 0 2024-02-19T19:12:14.734 INFO:tasks.workunit.client.1.smithi125.stdout:9/405: write d8/d15/f1c [2880221,77651] 0 2024-02-19T19:12:14.734 INFO:tasks.workunit.client.1.smithi125.stdout:9/406: dread d8/d15/d32/f3f [565248,122880] 0 2024-02-19T19:12:14.734 INFO:tasks.workunit.client.1.smithi125.stdout:9/407: symlink d8/d15/d22/l93 0 2024-02-19T19:12:14.734 INFO:tasks.workunit.client.1.smithi125.stdout:9/408: write d8/d2e/d4c/f7c [426074,16060] 0 2024-02-19T19:12:14.734 INFO:tasks.workunit.client.1.smithi125.stdout:6/364: sync 2024-02-19T19:12:14.734 INFO:tasks.workunit.client.1.smithi125.stdout:6/365: mkdir d6/db/d5d/d2f/d45/d4e/d6b 0 2024-02-19T19:12:14.734 INFO:tasks.workunit.client.1.smithi125.stdout:6/366: chown d6/f9 5018452 1 2024-02-19T19:12:14.734 INFO:tasks.workunit.client.1.smithi125.stdout:6/367: mknod d6/c6c 0 2024-02-19T19:12:14.735 INFO:tasks.workunit.client.1.smithi125.stdout:6/368: write d6/db/d5d/f2e [461352,7947] 0 2024-02-19T19:12:14.735 INFO:tasks.workunit.client.1.smithi125.stdout:6/369: chown d6/db/df/d16/f2b 370 1 2024-02-19T19:12:14.735 INFO:tasks.workunit.client.1.smithi125.stdout:6/370: creat d6/db/d49/d4c/f6d x:0 0 0 2024-02-19T19:12:14.735 INFO:tasks.workunit.client.1.smithi125.stdout:6/371: chown d6/db/df/f54 25479 1 2024-02-19T19:12:14.735 INFO:tasks.workunit.client.1.smithi125.stdout:6/372: dread - d6/db/d5d/d2f/d45/f60 zero size 2024-02-19T19:12:14.735 INFO:tasks.workunit.client.1.smithi125.stdout:6/373: creat d6/db/d5d/f6e x:0 0 0 2024-02-19T19:12:14.737 INFO:tasks.workunit.client.1.smithi125.stdout:4/351: dread d0/d7/d30/d58/f1e [430080,90112] 0 2024-02-19T19:12:14.737 INFO:tasks.workunit.client.1.smithi125.stdout:4/352: write d0/d7/f71 [892505,110285] 0 2024-02-19T19:12:14.737 INFO:tasks.workunit.client.1.smithi125.stdout:4/353: link d0/d7/d30/d58/f2d d0/df/f73 0 2024-02-19T19:12:14.738 INFO:tasks.workunit.client.1.smithi125.stdout:4/354: rename d0/d7/d30/d58/c4e to d0/df/c74 0 2024-02-19T19:12:14.738 INFO:tasks.workunit.client.1.smithi125.stdout:4/355: mkdir d0/d7/d3b/d75 0 2024-02-19T19:12:14.738 INFO:tasks.workunit.client.1.smithi125.stdout:4/356: mkdir d0/d7/d76 0 2024-02-19T19:12:14.738 INFO:tasks.workunit.client.1.smithi125.stdout:4/357: mkdir d0/d7/d3b/d77 0 2024-02-19T19:12:14.738 INFO:tasks.workunit.client.1.smithi125.stdout:4/358: creat d0/d7/d30/d42/f78 x:0 0 0 2024-02-19T19:12:14.738 INFO:tasks.workunit.client.1.smithi125.stdout:4/359: creat d0/d7/d30/d58/f79 x:0 0 0 2024-02-19T19:12:14.738 INFO:tasks.workunit.client.1.smithi125.stdout:4/360: creat d0/d7/d30/d42/f7a x:0 0 0 2024-02-19T19:12:14.738 INFO:tasks.workunit.client.1.smithi125.stdout:4/361: read - d0/df/f52 zero size 2024-02-19T19:12:14.738 INFO:tasks.workunit.client.1.smithi125.stdout:4/362: truncate d0/df/f52 696539 0 2024-02-19T19:12:14.739 INFO:tasks.workunit.client.1.smithi125.stdout:4/363: write d0/d7/d30/d58/f39 [787931,56018] 0 2024-02-19T19:12:14.739 INFO:tasks.workunit.client.1.smithi125.stdout:4/364: chown d0/d32/c5a 22879 1 2024-02-19T19:12:14.739 INFO:tasks.workunit.client.1.smithi125.stdout:4/365: mkdir d0/d7/d30/d42/d7b 0 2024-02-19T19:12:14.739 INFO:tasks.workunit.client.1.smithi125.stdout:4/366: chown d0/df/f73 479902 1 2024-02-19T19:12:14.739 INFO:tasks.workunit.client.1.smithi125.stdout:4/367: stat d0/c22 0 2024-02-19T19:12:14.739 INFO:tasks.workunit.client.1.smithi125.stdout:4/368: chown d0/d7/d30/d42/f78 4 1 2024-02-19T19:12:14.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:14 smithi096 ceph-mon[112483]: pgmap v152: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:12:14.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:14 smithi096 ceph-mon[112483]: from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:12:14.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:14 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/1885433229' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:12:14.790 INFO:tasks.workunit.client.1.smithi125.stdout:9/409: dwrite d8/f43 [192512,8192] 0 2024-02-19T19:12:14.790 INFO:tasks.workunit.client.1.smithi125.stdout:9/410: write d8/f28 [1451951,86407] 0 2024-02-19T19:12:14.790 INFO:tasks.workunit.client.1.smithi125.stdout:9/411: chown d8/f50 5 1 2024-02-19T19:12:14.790 INFO:tasks.workunit.client.1.smithi125.stdout:9/412: creat d8/d2e/d4c/d84/f94 x:0 0 0 2024-02-19T19:12:14.790 INFO:tasks.workunit.client.1.smithi125.stdout:4/369: dwrite d0/d7/d30/d58/f39 [565248,122880] 0 2024-02-19T19:12:14.790 INFO:tasks.workunit.client.1.smithi125.stdout:4/370: rename d0/l34 to d0/d7/d3b/l7c 0 2024-02-19T19:12:14.796 INFO:tasks.workunit.client.1.smithi125.stdout:6/374: dread d6/db/df/d16/f20 [311296,110592] 0 2024-02-19T19:12:14.796 INFO:tasks.workunit.client.1.smithi125.stdout:6/375: mknod d6/db/d49/d4c/c6f 0 2024-02-19T19:12:14.796 INFO:tasks.workunit.client.1.smithi125.stdout:6/376: readlink d6/db/d5d/d29/l2c 0 2024-02-19T19:12:14.822 INFO:tasks.workunit.client.1.smithi125.stdout:5/586: fsync db/d17/d58/d33/f3e 0 2024-02-19T19:12:14.822 INFO:tasks.workunit.client.1.smithi125.stdout:5/587: chown db/d17/d58/d33/d64/c67 1010995 1 2024-02-19T19:12:14.835 INFO:tasks.workunit.client.1.smithi125.stdout:3/341: fdatasync d0/d1/d4b/f67 0 2024-02-19T19:12:14.839 INFO:tasks.workunit.client.1.smithi125.stdout:4/371: dwrite d0/d7/d30/d58/f1e [1634304,40960] 0 2024-02-19T19:12:14.840 INFO:tasks.workunit.client.1.smithi125.stdout:6/377: dwrite d6/db/d49/d4c/f66 [892928,53248] 0 2024-02-19T19:12:14.840 INFO:tasks.workunit.client.1.smithi125.stdout:9/413: dwrite d8/d15/d22/d44/f89 [962560,102400] 0 2024-02-19T19:12:14.840 INFO:tasks.workunit.client.1.smithi125.stdout:5/588: dwrite db/d17/d58/f24 [454656,45056] 0 2024-02-19T19:12:14.840 INFO:tasks.workunit.client.1.smithi125.stdout:9/414: rmdir d8/d15/d22/d4e 39 2024-02-19T19:12:14.840 INFO:tasks.workunit.client.1.smithi125.stdout:6/378: mknod d6/db/df/d3b/c70 0 2024-02-19T19:12:14.840 INFO:tasks.workunit.client.1.smithi125.stdout:9/415: getdents d8/d2e/d6d 0 2024-02-19T19:12:14.840 INFO:tasks.workunit.client.1.smithi125.stdout:6/379: getdents d6/db/d5d 0 2024-02-19T19:12:14.841 INFO:tasks.workunit.client.1.smithi125.stdout:6/380: dread - d6/db/d5d/f6e zero size 2024-02-19T19:12:14.841 INFO:tasks.workunit.client.1.smithi125.stdout:5/589: mkdir db/d47/db6 0 2024-02-19T19:12:14.841 INFO:tasks.workunit.client.1.smithi125.stdout:3/342: mknod d0/d5f/c6b 0 2024-02-19T19:12:14.841 INFO:tasks.workunit.client.1.smithi125.stdout:5/590: stat db/d17/d58/d33/d64/c93 0 2024-02-19T19:12:14.841 INFO:tasks.workunit.client.1.smithi125.stdout:6/381: unlink d6/db/f3d 0 2024-02-19T19:12:14.841 INFO:tasks.workunit.client.1.smithi125.stdout:3/343: unlink d0/d1/d4b/d52/f54 0 2024-02-19T19:12:14.841 INFO:tasks.workunit.client.1.smithi125.stdout:9/416: mkdir d8/d15/d32/d95 0 2024-02-19T19:12:14.842 INFO:tasks.workunit.client.1.smithi125.stdout:3/344: dread - d0/f3c zero size 2024-02-19T19:12:14.842 INFO:tasks.workunit.client.1.smithi125.stdout:5/591: creat db/d47/d52/d5d/fb7 x:0 0 0 2024-02-19T19:12:14.842 INFO:tasks.workunit.client.1.smithi125.stdout:4/372: write d0/d7/d3b/f43 [655865,111368] 0 2024-02-19T19:12:14.842 INFO:tasks.workunit.client.1.smithi125.stdout:3/345: rename d0/de/f3d to d0/de/f6c 0 2024-02-19T19:12:14.842 INFO:tasks.workunit.client.1.smithi125.stdout:3/346: stat d0/l1a 0 2024-02-19T19:12:14.842 INFO:tasks.workunit.client.1.smithi125.stdout:4/373: readlink d0/d7/l41 0 2024-02-19T19:12:14.842 INFO:tasks.workunit.client.1.smithi125.stdout:9/417: mkdir d8/d2e/d4c/d96 0 2024-02-19T19:12:14.842 INFO:tasks.workunit.client.1.smithi125.stdout:4/374: chown d0/d7/d30/d58/f2d 101 1 2024-02-19T19:12:14.843 INFO:tasks.workunit.client.1.smithi125.stdout:3/347: creat d0/f6d x:0 0 0 2024-02-19T19:12:14.843 INFO:tasks.workunit.client.1.smithi125.stdout:3/348: stat d0/de/f1c 0 2024-02-19T19:12:14.843 INFO:tasks.workunit.client.1.smithi125.stdout:9/418: symlink d8/d2e/d6d/l97 0 2024-02-19T19:12:14.843 INFO:tasks.workunit.client.1.smithi125.stdout:3/349: truncate d0/d1/f56 1679684 0 2024-02-19T19:12:14.843 INFO:tasks.workunit.client.1.smithi125.stdout:5/592: write db/d17/d85/fb4 [874222,68330] 0 2024-02-19T19:12:14.843 INFO:tasks.workunit.client.1.smithi125.stdout:9/419: mknod d8/d15/d22/d44/c98 0 2024-02-19T19:12:14.843 INFO:tasks.workunit.client.1.smithi125.stdout:5/593: dread db/d17/d58/d33/d98/d9c/f9e [385024,8192] 0 2024-02-19T19:12:14.843 INFO:tasks.workunit.client.1.smithi125.stdout:4/375: write d0/df/f2a [1283629,45854] 0 2024-02-19T19:12:14.844 INFO:tasks.workunit.client.1.smithi125.stdout:3/350: unlink d0/de/f2e 0 2024-02-19T19:12:14.844 INFO:tasks.workunit.client.1.smithi125.stdout:9/420: mkdir d8/d15/d32/d4f/d6e/d99 0 2024-02-19T19:12:14.844 INFO:tasks.workunit.client.1.smithi125.stdout:9/421: creat d8/d15/d22/d4e/d90/f9a x:0 0 0 2024-02-19T19:12:14.844 INFO:tasks.workunit.client.1.smithi125.stdout:9/422: rmdir d8/d15/d22/d4e/d90 39 2024-02-19T19:12:14.844 INFO:tasks.workunit.client.1.smithi125.stdout:9/423: dread d8/d15/d32/f65 [901120,32768] 0 2024-02-19T19:12:14.844 INFO:tasks.workunit.client.1.smithi125.stdout:9/424: creat d8/d15/d32/f9b x:0 0 0 2024-02-19T19:12:14.844 INFO:tasks.workunit.client.1.smithi125.stdout:9/425: symlink d8/l9c 0 2024-02-19T19:12:14.844 INFO:tasks.workunit.client.1.smithi125.stdout:9/426: mkdir d8/d15/d9d 0 2024-02-19T19:12:14.845 INFO:tasks.workunit.client.1.smithi125.stdout:9/427: truncate d8/d15/d32/f9b 494970 0 2024-02-19T19:12:14.845 INFO:tasks.workunit.client.1.smithi125.stdout:9/428: getdents d8/d2e 0 2024-02-19T19:12:14.845 INFO:tasks.workunit.client.1.smithi125.stdout:9/429: mknod d8/d15/d32/d4f/d6e/c9e 0 2024-02-19T19:12:14.845 INFO:tasks.workunit.client.1.smithi125.stdout:9/430: mknod d8/d15/d32/d4f/d6e/c9f 0 2024-02-19T19:12:14.873 INFO:tasks.workunit.client.1.smithi125.stdout:6/382: dwrite d6/db/df/f12 [1781760,122880] 0 2024-02-19T19:12:14.874 INFO:tasks.workunit.client.1.smithi125.stdout:6/383: dread d6/db/d5d/f36 [811008,40960] 0 2024-02-19T19:12:14.874 INFO:tasks.workunit.client.1.smithi125.stdout:6/384: dread - d6/db/df/f51 zero size 2024-02-19T19:12:14.874 INFO:tasks.workunit.client.1.smithi125.stdout:6/385: write d6/db/d5d/f2a [1776951,75905] 0 2024-02-19T19:12:14.874 INFO:tasks.workunit.client.1.smithi125.stdout:6/386: link d6/db/df/d16/f38 d6/db/d5d/d29/d68/f71 0 2024-02-19T19:12:14.874 INFO:tasks.workunit.client.1.smithi125.stdout:6/387: rename d6/db/df/d3b/l6a to d6/db/d49/d4c/l72 0 2024-02-19T19:12:14.874 INFO:tasks.workunit.client.1.smithi125.stdout:6/388: write d6/db/d5d/d29/d68/f71 [510162,72043] 0 2024-02-19T19:12:14.880 INFO:tasks.workunit.client.1.smithi125.stdout:5/594: dwrite db/d47/d52/d5d/f7b [139264,12288] 0 2024-02-19T19:12:14.880 INFO:tasks.workunit.client.1.smithi125.stdout:3/351: dwrite d0/d1/f4d [536576,45056] 0 2024-02-19T19:12:14.880 INFO:tasks.workunit.client.1.smithi125.stdout:3/352: dread - d0/d1/f63 zero size 2024-02-19T19:12:14.880 INFO:tasks.workunit.client.1.smithi125.stdout:3/353: rename d0/d1/f58 to d0/d1/f6e 0 2024-02-19T19:12:14.880 INFO:tasks.workunit.client.1.smithi125.stdout:3/354: dread - d0/d1/f63 zero size 2024-02-19T19:12:14.880 INFO:tasks.workunit.client.1.smithi125.stdout:6/389: dwrite d6/db/d49/d4c/f66 [1683456,102400] 0 2024-02-19T19:12:15.003 INFO:tasks.workunit.client.1.smithi125.stdout:4/376: fdatasync d0/d32/f55 0 2024-02-19T19:12:15.004 INFO:tasks.workunit.client.1.smithi125.stdout:4/377: mknod d0/d32/d60/c7d 0 2024-02-19T19:12:15.004 INFO:tasks.workunit.client.1.smithi125.stdout:4/378: creat d0/d32/d60/f7e x:0 0 0 2024-02-19T19:12:15.011 INFO:tasks.workunit.client.1.smithi125.stdout:3/355: dread d0/d1/f41 [249856,86016] 0 2024-02-19T19:12:15.011 INFO:tasks.workunit.client.1.smithi125.stdout:3/356: dread - d0/d1/f6e zero size 2024-02-19T19:12:15.021 INFO:tasks.workunit.client.1.smithi125.stdout:9/431: fsync d8/d15/d32/f64 0 2024-02-19T19:12:15.021 INFO:tasks.workunit.client.1.smithi125.stdout:9/432: dread - d8/d2e/d4c/d84/f8c zero size 2024-02-19T19:12:15.022 INFO:tasks.workunit.client.1.smithi125.stdout:9/433: write d8/f50 [1050932,85952] 0 2024-02-19T19:12:15.022 INFO:tasks.workunit.client.1.smithi125.stdout:9/434: chown d8/d15/d22 274484 1 2024-02-19T19:12:15.023 INFO:tasks.workunit.client.1.smithi125.stdout:6/390: dwrite d6/db/df/f14 [2322432,8192] 0 2024-02-19T19:12:15.023 INFO:tasks.workunit.client.1.smithi125.stdout:5/595: dwrite db/d17/d58/d33/d98/d9c/fa4 [438272,28672] 0 2024-02-19T19:12:15.024 INFO:tasks.workunit.client.1.smithi125.stdout:9/435: mknod d8/d15/d32/d4f/d85/ca0 0 2024-02-19T19:12:15.024 INFO:tasks.workunit.client.1.smithi125.stdout:9/436: chown d8/d2e 1907504656 1 2024-02-19T19:12:15.024 INFO:tasks.workunit.client.1.smithi125.stdout:5/596: rmdir db/d17/d58 39 2024-02-19T19:12:15.024 INFO:tasks.workunit.client.1.smithi125.stdout:6/391: symlink d6/db/d5d/d2f/d45/d4e/l73 0 2024-02-19T19:12:15.024 INFO:tasks.workunit.client.1.smithi125.stdout:9/437: mknod d8/d15/d22/d4e/d6b/ca1 0 2024-02-19T19:12:15.024 INFO:tasks.workunit.client.1.smithi125.stdout:6/392: rename d6/db/d5d/d2f/f4f to d6/db/d49/d4c/f74 0 2024-02-19T19:12:15.024 INFO:tasks.workunit.client.1.smithi125.stdout:6/393: getdents d6 0 2024-02-19T19:12:15.038 INFO:tasks.workunit.client.1.smithi125.stdout:3/357: dread d0/de/f6c [438272,90112] 0 2024-02-19T19:12:15.051 INFO:tasks.workunit.client.1.smithi125.stdout:6/394: dwrite d6/db/df/d16/f2b [634880,45056] 0 2024-02-19T19:12:15.051 INFO:tasks.workunit.client.1.smithi125.stdout:6/395: chown d6/db/d49/c69 83647849 1 2024-02-19T19:12:15.051 INFO:tasks.workunit.client.1.smithi125.stdout:6/396: write d6/db/df/f21 [128123,36667] 0 2024-02-19T19:12:15.052 INFO:tasks.workunit.client.1.smithi125.stdout:6/397: chown d6/db 1682 1 2024-02-19T19:12:15.052 INFO:tasks.workunit.client.1.smithi125.stdout:6/398: rename d6/db/f64 to d6/db/d5d/d63/f75 0 2024-02-19T19:12:15.052 INFO:tasks.workunit.client.1.smithi125.stdout:6/399: write d6/db/d49/f59 [61478,36050] 0 2024-02-19T19:12:15.052 INFO:tasks.workunit.client.1.smithi125.stdout:6/400: mknod d6/db/d5d/d63/c76 0 2024-02-19T19:12:15.052 INFO:tasks.workunit.client.1.smithi125.stdout:6/401: dread d6/db/d5d/f24 [98304,45056] 0 2024-02-19T19:12:15.052 INFO:tasks.workunit.client.1.smithi125.stdout:9/438: dwrite d8/d15/f2c [1146880,40960] 0 2024-02-19T19:12:15.052 INFO:tasks.workunit.client.1.smithi125.stdout:9/439: dread - d8/d15/d22/d4e/f58 zero size 2024-02-19T19:12:15.053 INFO:tasks.workunit.client.1.smithi125.stdout:5/597: dwrite db/d47/f5f [884736,57344] 0 2024-02-19T19:12:15.053 INFO:tasks.workunit.client.1.smithi125.stdout:9/440: mkdir d8/d15/da2 0 2024-02-19T19:12:15.053 INFO:tasks.workunit.client.1.smithi125.stdout:5/598: truncate db/d17/f41 1866470 0 2024-02-19T19:12:15.053 INFO:tasks.workunit.client.1.smithi125.stdout:5/599: truncate db/d17/d58/f6e 370494 0 2024-02-19T19:12:15.053 INFO:tasks.workunit.client.1.smithi125.stdout:5/600: creat db/d17/d58/d33/d98/fb8 x:0 0 0 2024-02-19T19:12:15.053 INFO:tasks.workunit.client.1.smithi125.stdout:3/358: read d0/d1/d4b/d52/f59 [110938,99577] 0 2024-02-19T19:12:15.053 INFO:tasks.workunit.client.1.smithi125.stdout:5/601: rename db/d26/c3f to db/d17/d58/d33/d64/cb9 0 2024-02-19T19:12:15.053 INFO:tasks.workunit.client.1.smithi125.stdout:6/402: dwrite d6/db/d5d/d29/d68/f71 [1359872,102400] 0 2024-02-19T19:12:15.054 INFO:tasks.workunit.client.1.smithi125.stdout:6/403: rename d6/db/df/d16/f20 to d6/db/df/d3b/f77 0 2024-02-19T19:12:15.079 INFO:tasks.workunit.client.1.smithi125.stdout:4/379: fsync d0/d32/d60/f7e 0 2024-02-19T19:12:15.093 INFO:tasks.workunit.client.1.smithi125.stdout:9/441: fsync d8/d15/d32/d4f/d6e/f8d 0 2024-02-19T19:12:15.094 INFO:tasks.workunit.client.1.smithi125.stdout:9/442: read - d8/d15/d32/f5d zero size 2024-02-19T19:12:15.096 INFO:tasks.workunit.client.1.smithi125.stdout:5/602: dread db/d17/f7d [442368,12288] 0 2024-02-19T19:12:15.096 INFO:tasks.workunit.client.1.smithi125.stdout:4/380: unlink d0/d32/c3c 0 2024-02-19T19:12:15.096 INFO:tasks.workunit.client.1.smithi125.stdout:6/404: dwrite d6/db/f11 [1355776,8192] 0 2024-02-19T19:12:15.096 INFO:tasks.workunit.client.1.smithi125.stdout:3/359: dwrite d0/d1/f23 [1781760,4096] 0 2024-02-19T19:12:15.097 INFO:tasks.workunit.client.1.smithi125.stdout:4/381: symlink d0/df/d5e/l7f 0 2024-02-19T19:12:15.097 INFO:tasks.workunit.client.1.smithi125.stdout:3/360: write d0/d1/f6e [836707,15955] 0 2024-02-19T19:12:15.097 INFO:tasks.workunit.client.1.smithi125.stdout:4/382: read d0/d32/f36 [1033574,28063] 0 2024-02-19T19:12:15.097 INFO:tasks.workunit.client.1.smithi125.stdout:3/361: mknod d0/d1/d39/c6f 0 2024-02-19T19:12:15.097 INFO:tasks.workunit.client.1.smithi125.stdout:6/405: write d6/db/d5d/d29/d68/f71 [1720583,78985] 0 2024-02-19T19:12:15.097 INFO:tasks.workunit.client.1.smithi125.stdout:4/383: rename d0/df/c74 to d0/d7/d30/d42/d7b/c80 0 2024-02-19T19:12:15.097 INFO:tasks.workunit.client.1.smithi125.stdout:3/362: symlink d0/d1/d4b/l70 0 2024-02-19T19:12:15.097 INFO:tasks.workunit.client.1.smithi125.stdout:3/363: write d0/d1/d1e/f2c [351989,7743] 0 2024-02-19T19:12:15.098 INFO:tasks.workunit.client.1.smithi125.stdout:3/364: write d0/de/f2b [1484836,47580] 0 2024-02-19T19:12:15.098 INFO:tasks.workunit.client.1.smithi125.stdout:3/365: unlink d0/de/f3a 0 2024-02-19T19:12:15.098 INFO:tasks.workunit.client.1.smithi125.stdout:3/366: stat d0/d1/d4b/f50 0 2024-02-19T19:12:15.098 INFO:tasks.workunit.client.1.smithi125.stdout:3/367: mkdir d0/d5f/d71 0 2024-02-19T19:12:15.098 INFO:tasks.workunit.client.1.smithi125.stdout:3/368: getdents d0/d5f 0 2024-02-19T19:12:15.098 INFO:tasks.workunit.client.1.smithi125.stdout:3/369: dread d0/d1/d39/f5b [704512,36864] 0 2024-02-19T19:12:15.098 INFO:tasks.workunit.client.1.smithi125.stdout:3/370: write d0/d1/f4d [1445215,39579] 0 2024-02-19T19:12:15.098 INFO:tasks.workunit.client.1.smithi125.stdout:3/371: truncate d0/de/f13 1204595 0 2024-02-19T19:12:15.099 INFO:tasks.workunit.client.1.smithi125.stdout:3/372: truncate d0/d1/d1e/f2c 744237 0 2024-02-19T19:12:15.099 INFO:tasks.workunit.client.1.smithi125.stdout:3/373: write d0/d1/d39/f49 [698921,81279] 0 2024-02-19T19:12:15.099 INFO:tasks.workunit.client.1.smithi125.stdout:3/374: creat d0/d5f/d71/f72 x:0 0 0 2024-02-19T19:12:15.099 INFO:tasks.workunit.client.1.smithi125.stdout:3/375: mkdir d0/d1/d1e/d60/d73 0 2024-02-19T19:12:15.099 INFO:tasks.workunit.client.1.smithi125.stdout:3/376: readlink d0/d1/d4b/l70 0 2024-02-19T19:12:15.099 INFO:tasks.workunit.client.1.smithi125.stdout:3/377: write d0/d1/f4d [2004322,26926] 0 2024-02-19T19:12:15.099 INFO:tasks.workunit.client.1.smithi125.stdout:3/378: mkdir d0/d1/d1e/d60/d73/d74 0 2024-02-19T19:12:15.100 INFO:tasks.workunit.client.1.smithi125.stdout:9/443: dwrite d8/d15/f2c [811008,94208] 0 2024-02-19T19:12:15.100 INFO:tasks.workunit.client.1.smithi125.stdout:9/444: truncate d8/d15/f2c 2461682 0 2024-02-19T19:12:15.101 INFO:tasks.workunit.client.1.smithi125.stdout:9/445: creat d8/d15/d32/d4f/d6e/fa3 x:0 0 0 2024-02-19T19:12:15.101 INFO:tasks.workunit.client.1.smithi125.stdout:3/379: dwrite d0/f6d [581632,126976] 0 2024-02-19T19:12:15.101 INFO:tasks.workunit.client.1.smithi125.stdout:3/380: read - d0/d1/d4b/f50 zero size 2024-02-19T19:12:15.101 INFO:tasks.workunit.client.1.smithi125.stdout:3/381: creat d0/d5f/f75 x:0 0 0 2024-02-19T19:12:15.191 INFO:tasks.workunit.client.1.smithi125.stdout:5/603: fsync db/d17/d58/d33/d98/fab 0 2024-02-19T19:12:15.191 INFO:tasks.workunit.client.1.smithi125.stdout:5/604: symlink db/d17/d58/d4f/lba 0 2024-02-19T19:12:15.191 INFO:tasks.workunit.client.1.smithi125.stdout:5/605: link db/d17/f45 db/d17/d58/d25/d40/fbb 0 2024-02-19T19:12:15.191 INFO:tasks.workunit.client.1.smithi125.stdout:4/384: fsync d0/f40 0 2024-02-19T19:12:15.191 INFO:tasks.workunit.client.1.smithi125.stdout:6/406: fdatasync d6/db/d5d/f2e 0 2024-02-19T19:12:15.193 INFO:tasks.workunit.client.1.smithi125.stdout:5/606: mknod db/d17/d58/cbc 0 2024-02-19T19:12:15.196 INFO:tasks.workunit.client.1.smithi125.stdout:4/385: write d0/d7/d3b/f62 [1263513,119028] 0 2024-02-19T19:12:15.196 INFO:tasks.workunit.client.1.smithi125.stdout:4/386: write d0/d7/d3b/f3d [2250716,1159] 0 2024-02-19T19:12:15.196 INFO:tasks.workunit.client.1.smithi125.stdout:9/446: write d8/d15/f61 [445740,16827] 0 2024-02-19T19:12:15.197 INFO:tasks.workunit.client.1.smithi125.stdout:9/447: mknod d8/d15/d32/ca4 0 2024-02-19T19:12:15.197 INFO:tasks.workunit.client.1.smithi125.stdout:9/448: dread d8/d15/f61 [126976,16384] 0 2024-02-19T19:12:15.197 INFO:tasks.workunit.client.1.smithi125.stdout:9/449: truncate d8/f43 652417 0 2024-02-19T19:12:15.197 INFO:tasks.workunit.client.1.smithi125.stdout:9/450: chown d8/d15/c38 73 1 2024-02-19T19:12:15.197 INFO:tasks.workunit.client.1.smithi125.stdout:9/451: dread d8/d15/d22/d4e/f3b [1036288,110592] 0 2024-02-19T19:12:15.197 INFO:tasks.workunit.client.1.smithi125.stdout:9/452: stat f3 0 2024-02-19T19:12:15.197 INFO:tasks.workunit.client.1.smithi125.stdout:9/453: symlink d8/d15/d32/d4f/d6e/la5 0 2024-02-19T19:12:15.197 INFO:tasks.workunit.client.1.smithi125.stdout:9/454: stat d8/d15/d22/d4e/f7f 0 2024-02-19T19:12:15.197 INFO:tasks.workunit.client.1.smithi125.stdout:9/455: creat d8/d15/d22/fa6 x:0 0 0 2024-02-19T19:12:15.198 INFO:tasks.workunit.client.1.smithi125.stdout:6/407: dwrite d6/db/df/f54 [225280,45056] 0 2024-02-19T19:12:15.198 INFO:tasks.workunit.client.1.smithi125.stdout:6/408: chown d6/db/d5d/d2f/d45/f60 0 1 2024-02-19T19:12:15.198 INFO:tasks.workunit.client.1.smithi125.stdout:6/409: stat d6/db/df/d16/l1c 0 2024-02-19T19:12:15.198 INFO:tasks.workunit.client.1.smithi125.stdout:3/382: rename d0/c4a to d0/d1/d4b/d52/c76 0 2024-02-19T19:12:15.198 INFO:tasks.workunit.client.1.smithi125.stdout:3/383: symlink d0/d1/d4b/d52/l77 0 2024-02-19T19:12:15.198 INFO:tasks.workunit.client.1.smithi125.stdout:3/384: chown d0/d1/f23 810 1 2024-02-19T19:12:15.198 INFO:tasks.workunit.client.1.smithi125.stdout:3/385: rmdir d0/d1/d39 39 2024-02-19T19:12:15.198 INFO:tasks.workunit.client.1.smithi125.stdout:3/386: getdents d0/d5f 0 2024-02-19T19:12:15.199 INFO:tasks.workunit.client.1.smithi125.stdout:3/387: readlink d0/de/l22 0 2024-02-19T19:12:15.199 INFO:tasks.workunit.client.1.smithi125.stdout:3/388: write d0/d1/f17 [452229,119861] 0 2024-02-19T19:12:15.199 INFO:tasks.workunit.client.1.smithi125.stdout:5/607: dwrite db/f69 [897024,126976] 0 2024-02-19T19:12:15.199 INFO:tasks.workunit.client.1.smithi125.stdout:5/608: dread - db/d47/d52/d5d/fb7 zero size 2024-02-19T19:12:15.199 INFO:tasks.workunit.client.1.smithi125.stdout:5/609: write db/d26/f77 [161288,19704] 0 2024-02-19T19:12:15.199 INFO:tasks.workunit.client.1.smithi125.stdout:4/387: dwrite d0/d7/f13 [749568,16384] 0 2024-02-19T19:12:15.199 INFO:tasks.workunit.client.1.smithi125.stdout:4/388: write d0/d7/d30/d58/f24 [325725,16115] 0 2024-02-19T19:12:15.199 INFO:tasks.workunit.client.1.smithi125.stdout:9/456: dwrite f2 [2203648,40960] 0 2024-02-19T19:12:15.199 INFO:tasks.workunit.client.1.smithi125.stdout:9/457: truncate d8/d15/d22/d44/f7a 997666 0 2024-02-19T19:12:15.200 INFO:tasks.workunit.client.1.smithi125.stdout:6/410: dwrite d6/db/d5d/f2e [282624,12288] 0 2024-02-19T19:12:15.262 INFO:tasks.workunit.client.1.smithi125.stdout:5/610: dwrite db/d17/d58/d25/d40/f5b [765952,45056] 0 2024-02-19T19:12:15.262 INFO:tasks.workunit.client.1.smithi125.stdout:5/611: chown db/d17/d58/d33/d53/f8f 581488 1 2024-02-19T19:12:15.262 INFO:tasks.workunit.client.1.smithi125.stdout:5/612: chown db/d17/l6b 60262108 1 2024-02-19T19:12:15.262 INFO:tasks.workunit.client.1.smithi125.stdout:5/613: creat db/d17/d58/d33/d98/fbd x:0 0 0 2024-02-19T19:12:15.265 INFO:tasks.workunit.client.1.smithi125.stdout:9/458: dwrite d8/d15/d32/f30 [1028096,12288] 0 2024-02-19T19:12:15.265 INFO:tasks.workunit.client.1.smithi125.stdout:9/459: stat d8/d2e/f4b 0 2024-02-19T19:12:15.265 INFO:tasks.workunit.client.1.smithi125.stdout:9/460: readlink d8/d2e/l40 0 2024-02-19T19:12:15.265 INFO:tasks.workunit.client.1.smithi125.stdout:9/461: unlink d8/f43 0 2024-02-19T19:12:15.265 INFO:tasks.workunit.client.1.smithi125.stdout:9/462: creat d8/d15/d32/d4f/d6e/d99/fa7 x:0 0 0 2024-02-19T19:12:15.265 INFO:tasks.workunit.client.1.smithi125.stdout:9/463: write f3 [1879587,31475] 0 2024-02-19T19:12:15.266 INFO:tasks.workunit.client.1.smithi125.stdout:9/464: mknod d8/d15/d22/d4e/ca8 0 2024-02-19T19:12:15.267 INFO:tasks.workunit.client.1.smithi125.stdout:4/389: creat d0/d7/d3b/f81 x:0 0 0 2024-02-19T19:12:15.267 INFO:tasks.workunit.client.1.smithi125.stdout:4/390: creat d0/d7/d3b/f82 x:0 0 0 2024-02-19T19:12:15.267 INFO:tasks.workunit.client.1.smithi125.stdout:4/391: stat d0/d7/d30/d42/d7b/c80 0 2024-02-19T19:12:15.267 INFO:tasks.workunit.client.1.smithi125.stdout:5/614: dwrite db/d17/d58/f81 [167936,36864] 0 2024-02-19T19:12:15.267 INFO:tasks.workunit.client.1.smithi125.stdout:5/615: rename db/d17/d58/d25/d40 to db/d17/d58/d33/d91/dbe 0 2024-02-19T19:12:15.267 INFO:tasks.workunit.client.1.smithi125.stdout:5/616: rmdir db/d26 39 2024-02-19T19:12:15.267 INFO:tasks.workunit.client.1.smithi125.stdout:5/617: chown db/d17/d58/c12 25 1 2024-02-19T19:12:15.267 INFO:tasks.workunit.client.1.smithi125.stdout:9/465: read d8/d2e/f45 [100205,106425] 0 2024-02-19T19:12:15.273 INFO:tasks.workunit.client.1.smithi125.stdout:6/411: write d6/db/f11 [86826,8462] 0 2024-02-19T19:12:15.273 INFO:tasks.workunit.client.1.smithi125.stdout:6/412: rmdir d6/db/d5d/d2f/d45 39 2024-02-19T19:12:15.276 INFO:tasks.workunit.client.1.smithi125.stdout:4/392: write d0/d7/d30/d58/f9 [1092690,27028] 0 2024-02-19T19:12:15.279 INFO:tasks.workunit.client.1.smithi125.stdout:5/618: write db/d47/d52/f5a [2006439,107804] 0 2024-02-19T19:12:15.348 INFO:tasks.workunit.client.1.smithi125.stdout:9/466: fdatasync d8/d15/d22/d4e/f47 0 2024-02-19T19:12:15.351 INFO:tasks.workunit.client.1.smithi125.stdout:3/389: dwrite d0/d1/f4d [1994752,53248] 0 2024-02-19T19:12:15.351 INFO:tasks.workunit.client.1.smithi125.stdout:9/467: write d8/d15/f61 [333182,39785] 0 2024-02-19T19:12:15.351 INFO:tasks.workunit.client.1.smithi125.stdout:6/413: symlink d6/db/df/l78 0 2024-02-19T19:12:15.351 INFO:tasks.workunit.client.1.smithi125.stdout:4/393: symlink d0/d7/d30/d42/l83 0 2024-02-19T19:12:15.351 INFO:tasks.workunit.client.1.smithi125.stdout:6/414: stat d6/db/d49/f59 0 2024-02-19T19:12:15.351 INFO:tasks.workunit.client.1.smithi125.stdout:4/394: rename d0/d32/c68 to d0/d7/d3b/d75/c84 0 2024-02-19T19:12:15.351 INFO:tasks.workunit.client.1.smithi125.stdout:9/468: write d8/d15/d22/d4e/f3b [1470949,44278] 0 2024-02-19T19:12:15.354 INFO:tasks.workunit.client.1.smithi125.stdout:7/406: sync 2024-02-19T19:12:15.354 INFO:tasks.workunit.client.1.smithi125.stdout:1/498: sync 2024-02-19T19:12:15.354 INFO:tasks.workunit.client.1.smithi125.stdout:8/404: sync 2024-02-19T19:12:15.354 INFO:tasks.workunit.client.1.smithi125.stdout:0/394: sync 2024-02-19T19:12:15.355 INFO:tasks.workunit.client.1.smithi125.stdout:2/389: sync 2024-02-19T19:12:15.355 INFO:tasks.workunit.client.1.smithi125.stdout:1/499: chown d1/dc/f1f 0 1 2024-02-19T19:12:15.355 INFO:tasks.workunit.client.1.smithi125.stdout:0/395: chown d5/d33/d42/f65 51 1 2024-02-19T19:12:15.355 INFO:tasks.workunit.client.1.smithi125.stdout:7/407: creat d12/d18/d2c/d4e/f71 x:0 0 0 2024-02-19T19:12:15.355 INFO:tasks.workunit.client.1.smithi125.stdout:8/405: mknod db/d18/d30/c86 0 2024-02-19T19:12:15.355 INFO:tasks.workunit.client.1.smithi125.stdout:1/500: mkdir d1/da3 0 2024-02-19T19:12:15.355 INFO:tasks.workunit.client.1.smithi125.stdout:1/501: rmdir d1/dc/d36 39 2024-02-19T19:12:15.355 INFO:tasks.workunit.client.1.smithi125.stdout:7/408: mknod d12/d18/d44/d3b/d59/d2a/d31/d50/d60/c72 0 2024-02-19T19:12:15.356 INFO:tasks.workunit.client.1.smithi125.stdout:8/406: getdents db/d18 0 2024-02-19T19:12:15.356 INFO:tasks.workunit.client.1.smithi125.stdout:7/409: dread - d12/d18/f68 zero size 2024-02-19T19:12:15.356 INFO:tasks.workunit.client.1.smithi125.stdout:1/502: rename d1/d1a/c85 to d1/d78/d80/ca4 0 2024-02-19T19:12:15.356 INFO:tasks.workunit.client.1.smithi125.stdout:1/503: dread d1/d26/d3c/f64 [647168,102400] 0 2024-02-19T19:12:15.356 INFO:tasks.workunit.client.1.smithi125.stdout:7/410: creat d12/d18/d44/d3b/d59/d26/d30/f73 x:0 0 0 2024-02-19T19:12:15.356 INFO:tasks.workunit.client.1.smithi125.stdout:7/411: rename d12/f33 to d12/d18/d2c/f74 0 2024-02-19T19:12:15.356 INFO:tasks.workunit.client.1.smithi125.stdout:5/619: dwrite db/d17/d58/d4f/faf [671744,86016] 0 2024-02-19T19:12:15.357 INFO:tasks.workunit.client.1.smithi125.stdout:5/620: link db/d17/f41 db/d26/fbf 0 2024-02-19T19:12:15.357 INFO:tasks.workunit.client.1.smithi125.stdout:5/621: mknod db/d17/d85/cc0 0 2024-02-19T19:12:15.357 INFO:tasks.workunit.client.1.smithi125.stdout:5/622: symlink db/d26/d51/lc1 0 2024-02-19T19:12:15.357 INFO:tasks.workunit.client.1.smithi125.stdout:5/623: symlink db/d17/d58/d33/d98/lc2 0 2024-02-19T19:12:15.357 INFO:tasks.workunit.client.1.smithi125.stdout:5/624: symlink db/d47/d52/d5d/lc3 0 2024-02-19T19:12:15.357 INFO:tasks.workunit.client.1.smithi125.stdout:5/625: write db/d17/d58/d33/d91/dbe/fa0 [102376,62986] 0 2024-02-19T19:12:15.357 INFO:tasks.workunit.client.1.smithi125.stdout:5/626: creat db/d17/d58/d33/d98/d9c/fc4 x:0 0 0 2024-02-19T19:12:15.413 INFO:tasks.workunit.client.1.smithi125.stdout:6/415: dwrite d6/db/d5d/f5f [745472,114688] 0 2024-02-19T19:12:15.413 INFO:tasks.workunit.client.1.smithi125.stdout:6/416: rename d6/db/d5d/f24 to d6/db/df/d3b/f79 0 2024-02-19T19:12:15.413 INFO:tasks.workunit.client.1.smithi125.stdout:6/417: rmdir d6/db/df 39 2024-02-19T19:12:15.413 INFO:tasks.workunit.client.1.smithi125.stdout:6/418: rename d6/db/df/c28 to d6/db/d5d/d2f/d45/c7a 0 2024-02-19T19:12:15.413 INFO:tasks.workunit.client.1.smithi125.stdout:6/419: mkdir d6/db/d5d/d2f/d7b 0 2024-02-19T19:12:15.414 INFO:tasks.workunit.client.1.smithi125.stdout:6/420: creat d6/db/df/f7c x:0 0 0 2024-02-19T19:12:15.414 INFO:tasks.workunit.client.1.smithi125.stdout:6/421: dread d6/db/df/d3b/f79 [98304,118784] 0 2024-02-19T19:12:15.414 INFO:tasks.workunit.client.1.smithi125.stdout:6/422: stat d6/cc 0 2024-02-19T19:12:15.414 INFO:tasks.workunit.client.1.smithi125.stdout:6/423: symlink d6/db/d5d/d29/d68/l7d 0 2024-02-19T19:12:15.414 INFO:tasks.workunit.client.1.smithi125.stdout:6/424: chown d6/db/d49/d4c/f74 11783 1 2024-02-19T19:12:15.414 INFO:tasks.workunit.client.1.smithi125.stdout:6/425: dread d6/db/f17 [602112,36864] 0 2024-02-19T19:12:15.414 INFO:tasks.workunit.client.1.smithi125.stdout:6/426: dread d6/db/d5d/f5f [61440,69632] 0 2024-02-19T19:12:15.414 INFO:tasks.workunit.client.1.smithi125.stdout:6/427: mkdir d6/db/df/d16/d7e 0 2024-02-19T19:12:15.414 INFO:tasks.workunit.client.1.smithi125.stdout:6/428: link d6/db/d5d/d2f/d45/c7a d6/db/d5d/d2f/d45/d4e/c7f 0 2024-02-19T19:12:15.415 INFO:tasks.workunit.client.1.smithi125.stdout:6/429: mknod d6/db/d5d/d29/d68/c80 0 2024-02-19T19:12:15.415 INFO:tasks.workunit.client.1.smithi125.stdout:6/430: creat d6/db/df/d16/f81 x:0 0 0 2024-02-19T19:12:15.415 INFO:tasks.workunit.client.1.smithi125.stdout:6/431: chown d6/db/d49/d4c/f6d 163 1 2024-02-19T19:12:15.415 INFO:tasks.workunit.client.1.smithi125.stdout:6/432: creat d6/db/d5d/f82 x:0 0 0 2024-02-19T19:12:15.415 INFO:tasks.workunit.client.1.smithi125.stdout:6/433: rename d6 to d6/db/d5d/d29/d83 22 2024-02-19T19:12:15.415 INFO:tasks.workunit.client.1.smithi125.stdout:6/434: dread d6/db/d49/d4c/f74 [757760,53248] 0 2024-02-19T19:12:15.415 INFO:tasks.workunit.client.1.smithi125.stdout:6/435: readlink d6/db/df/d16/l1c 0 2024-02-19T19:12:15.415 INFO:tasks.workunit.client.1.smithi125.stdout:6/436: creat d6/db/d5d/d29/f84 x:0 0 0 2024-02-19T19:12:15.416 INFO:tasks.workunit.client.1.smithi125.stdout:3/390: read d0/de/f44 [196586,102751] 0 2024-02-19T19:12:15.416 INFO:tasks.workunit.client.1.smithi125.stdout:3/391: mknod d0/d5f/d71/c78 0 2024-02-19T19:12:15.416 INFO:tasks.workunit.client.1.smithi125.stdout:3/392: write d0/d1/f23 [1556755,9858] 0 2024-02-19T19:12:15.417 INFO:tasks.workunit.client.1.smithi125.stdout:5/627: dwrite db/d17/d58/f37 [4096,24576] 0 2024-02-19T19:12:15.419 INFO:tasks.workunit.client.1.smithi125.stdout:4/395: dwrite d0/fa [1347584,57344] 0 2024-02-19T19:12:15.419 INFO:tasks.workunit.client.1.smithi125.stdout:4/396: mkdir d0/d7/d85 0 2024-02-19T19:12:15.419 INFO:tasks.workunit.client.1.smithi125.stdout:4/397: rename d0/d7/d30/d58/f56 to d0/d7/d30/d42/f86 0 2024-02-19T19:12:15.419 INFO:tasks.workunit.client.1.smithi125.stdout:4/398: dread d0/df/f73 [217088,102400] 0 2024-02-19T19:12:15.419 INFO:tasks.workunit.client.1.smithi125.stdout:4/399: readlink d0/d7/l41 0 2024-02-19T19:12:15.419 INFO:tasks.workunit.client.1.smithi125.stdout:4/400: rmdir d0/d7/d30/d42/d7b 39 2024-02-19T19:12:15.419 INFO:tasks.workunit.client.1.smithi125.stdout:4/401: rename d0/d7/f66 to d0/d7/d30/d58/f87 0 2024-02-19T19:12:15.420 INFO:tasks.workunit.client.1.smithi125.stdout:4/402: link d0/d32/c5a d0/d7/d76/c88 0 2024-02-19T19:12:15.420 INFO:tasks.workunit.client.1.smithi125.stdout:4/403: dread - d0/d7/d3b/f5f zero size 2024-02-19T19:12:15.420 INFO:tasks.workunit.client.1.smithi125.stdout:1/504: dwrite d1/d1a/f50 [864256,49152] 0 2024-02-19T19:12:15.420 INFO:tasks.workunit.client.1.smithi125.stdout:1/505: write d1/d26/d23/f68 [431688,98320] 0 2024-02-19T19:12:15.420 INFO:tasks.workunit.client.1.smithi125.stdout:1/506: creat d1/dc/d36/fa5 x:0 0 0 2024-02-19T19:12:15.421 INFO:tasks.workunit.client.1.smithi125.stdout:7/412: dwrite d12/d18/d44/d3b/d59/d26/d30/d37/f3f [2215936,122880] 0 2024-02-19T19:12:15.421 INFO:tasks.workunit.client.1.smithi125.stdout:7/413: write d12/d18/f20 [1490423,10921] 0 2024-02-19T19:12:15.421 INFO:tasks.workunit.client.1.smithi125.stdout:7/414: mknod d12/d18/d44/d3b/d59/d2a/c75 0 2024-02-19T19:12:15.421 INFO:tasks.workunit.client.1.smithi125.stdout:7/415: readlink d12/d18/d44/l2e 0 2024-02-19T19:12:15.422 INFO:tasks.workunit.client.1.smithi125.stdout:6/437: read d6/db/d5d/f19 [723050,118118] 0 2024-02-19T19:12:15.422 INFO:tasks.workunit.client.1.smithi125.stdout:6/438: write d6/db/df/d16/f38 [2490456,120137] 0 2024-02-19T19:12:15.531 INFO:tasks.workunit.client.1.smithi125.stdout:9/469: fdatasync d8/d15/d32/f3f 0 2024-02-19T19:12:15.532 INFO:tasks.workunit.client.1.smithi125.stdout:9/470: truncate d8/d2e/f4b 1156772 0 2024-02-19T19:12:15.532 INFO:tasks.workunit.client.1.smithi125.stdout:9/471: chown d8/d15/d22/d4e/f83 14392014 1 2024-02-19T19:12:15.532 INFO:tasks.workunit.client.1.smithi125.stdout:9/472: dread d8/d15/d22/d44/f89 [552960,4096] 0 2024-02-19T19:12:15.532 INFO:tasks.workunit.client.1.smithi125.stdout:9/473: dread d8/f9 [1134592,106496] 0 2024-02-19T19:12:15.533 INFO:tasks.workunit.client.1.smithi125.stdout:6/439: dread d6/db/d49/f59 [57344,36864] 0 2024-02-19T19:12:15.533 INFO:tasks.workunit.client.1.smithi125.stdout:5/628: dwrite db/d17/d58/d33/d64/f70 [1581056,61440] 0 2024-02-19T19:12:15.537 INFO:tasks.workunit.client.1.smithi125.stdout:4/404: dread d0/df/f33 [253952,4096] 0 2024-02-19T19:12:15.537 INFO:tasks.workunit.client.1.smithi125.stdout:4/405: symlink d0/d7/d30/d58/l89 0 2024-02-19T19:12:15.538 INFO:tasks.workunit.client.1.smithi125.stdout:4/406: getdents d0/df 0 2024-02-19T19:12:15.548 INFO:tasks.workunit.client.1.smithi125.stdout:7/416: fsync d12/d18/d44/d3b/d59/d2a/f4a 0 2024-02-19T19:12:15.548 INFO:tasks.workunit.client.1.smithi125.stdout:1/507: fsync d1/d26/f73 0 2024-02-19T19:12:15.548 INFO:tasks.workunit.client.1.smithi125.stdout:1/508: creat d1/d1a/d3d/d6e/d4b/fa6 x:0 0 0 2024-02-19T19:12:15.549 INFO:tasks.workunit.client.1.smithi125.stdout:1/509: dread d1/dc/f1f [397312,122880] 0 2024-02-19T19:12:15.554 INFO:tasks.workunit.client.1.smithi125.stdout:7/417: dwrite d12/d18/d44/d51/f56 [868352,118784] 0 2024-02-19T19:12:15.555 INFO:tasks.workunit.client.1.smithi125.stdout:7/418: creat d12/d18/d2c/f76 x:0 0 0 2024-02-19T19:12:15.555 INFO:tasks.workunit.client.1.smithi125.stdout:7/419: dread f8 [1609728,122880] 0 2024-02-19T19:12:15.555 INFO:tasks.workunit.client.1.smithi125.stdout:7/420: mknod d12/d18/d44/d3b/d59/c77 0 2024-02-19T19:12:15.555 INFO:tasks.workunit.client.1.smithi125.stdout:7/421: write d12/d3d/f4f [19156,72535] 0 2024-02-19T19:12:15.555 INFO:tasks.workunit.client.1.smithi125.stdout:7/422: rename d12/d18/d44/d3b to d12/d18/d44/d3b/d59/d26/d54/d78 22 2024-02-19T19:12:15.555 INFO:tasks.workunit.client.1.smithi125.stdout:9/474: dwrite d8/d15/d32/d4f/f59 [843776,126976] 0 2024-02-19T19:12:15.555 INFO:tasks.workunit.client.1.smithi125.stdout:9/475: chown d8/d15/f6a 441915 1 2024-02-19T19:12:15.556 INFO:tasks.workunit.client.1.smithi125.stdout:9/476: read - d8/d15/d32/d4f/d6e/f8f zero size 2024-02-19T19:12:15.556 INFO:tasks.workunit.client.1.smithi125.stdout:9/477: mknod d8/d15/d32/d4f/d85/ca9 0 2024-02-19T19:12:15.556 INFO:tasks.workunit.client.1.smithi125.stdout:4/407: dwrite d0/d7/f2f [696320,102400] 0 2024-02-19T19:12:15.557 INFO:tasks.workunit.client.1.smithi125.stdout:1/510: dwrite d1/d78/d80/f5d [143360,90112] 0 2024-02-19T19:12:15.557 INFO:tasks.workunit.client.1.smithi125.stdout:5/629: dread db/d47/f7e [1196032,98304] 0 2024-02-19T19:12:15.557 INFO:tasks.workunit.client.1.smithi125.stdout:5/630: chown db/d17/d58/d33/d53/f8f 273341 1 2024-02-19T19:12:15.558 INFO:tasks.workunit.client.1.smithi125.stdout:7/423: dwrite d12/d18/f20 [2338816,77824] 0 2024-02-19T19:12:15.558 INFO:tasks.workunit.client.1.smithi125.stdout:7/424: write fc [906469,130964] 0 2024-02-19T19:12:15.559 INFO:tasks.workunit.client.1.smithi125.stdout:7/425: truncate d12/d3d/f4f 232349 0 2024-02-19T19:12:15.559 INFO:tasks.workunit.client.1.smithi125.stdout:7/426: symlink d12/d18/d44/d3b/d59/d2a/d6a/l79 0 2024-02-19T19:12:15.559 INFO:tasks.workunit.client.1.smithi125.stdout:7/427: creat d12/d18/d44/d3b/d59/d3e/f7a x:0 0 0 2024-02-19T19:12:15.559 INFO:tasks.workunit.client.1.smithi125.stdout:7/428: read f5 [2189779,30220] 0 2024-02-19T19:12:15.559 INFO:tasks.workunit.client.1.smithi125.stdout:7/429: read f5 [1590909,51334] 0 2024-02-19T19:12:15.559 INFO:tasks.workunit.client.1.smithi125.stdout:7/430: dread - d12/d18/d2c/f76 zero size 2024-02-19T19:12:15.559 INFO:tasks.workunit.client.1.smithi125.stdout:7/431: truncate d12/d18/d44/d3b/d59/f5e 2463623 0 2024-02-19T19:12:15.560 INFO:tasks.workunit.client.1.smithi125.stdout:7/432: mknod d12/d18/d44/d3b/d59/d2a/d31/c7b 0 2024-02-19T19:12:15.560 INFO:tasks.workunit.client.1.smithi125.stdout:7/433: mknod d12/d18/d44/d3b/d59/c7c 0 2024-02-19T19:12:15.562 INFO:tasks.workunit.client.1.smithi125.stdout:5/631: dwrite f1 [2555904,90112] 0 2024-02-19T19:12:15.562 INFO:tasks.workunit.client.1.smithi125.stdout:4/408: dwrite d0/d7/d30/d58/f79 [901120,20480] 0 2024-02-19T19:12:15.562 INFO:tasks.workunit.client.1.smithi125.stdout:9/478: dwrite d8/d2e/d4c/f5f [1671168,90112] 0 2024-02-19T19:12:15.563 INFO:tasks.workunit.client.1.smithi125.stdout:5/632: chown db/d26/fbf 12655 1 2024-02-19T19:12:15.563 INFO:tasks.workunit.client.1.smithi125.stdout:1/511: dwrite d1/f14 [1314816,122880] 0 2024-02-19T19:12:15.563 INFO:tasks.workunit.client.1.smithi125.stdout:4/409: readlink d0/d7/d30/d58/l89 0 2024-02-19T19:12:15.563 INFO:tasks.workunit.client.1.smithi125.stdout:9/479: rename d8/d15/d22/d44/f4d to d8/d2e/d4c/faa 0 2024-02-19T19:12:15.563 INFO:tasks.workunit.client.1.smithi125.stdout:9/480: truncate d8/d2e/d4c/d84/f94 397210 0 2024-02-19T19:12:15.563 INFO:tasks.workunit.client.1.smithi125.stdout:4/410: rename d0/d32/c3f to d0/d7/d30/d6c/c8a 0 2024-02-19T19:12:15.563 INFO:tasks.workunit.client.1.smithi125.stdout:5/633: unlink db/d17/d58/d33/d53/l68 0 2024-02-19T19:12:15.563 INFO:tasks.workunit.client.1.smithi125.stdout:9/481: chown d8/d15/d22/d4e/l8a 6343381 1 2024-02-19T19:12:15.564 INFO:tasks.workunit.client.1.smithi125.stdout:4/411: link d0/d7/d30/d58/f2d d0/d32/f8b 0 2024-02-19T19:12:15.564 INFO:tasks.workunit.client.1.smithi125.stdout:9/482: rename d8/d15/l1f to d8/d15/da2/lab 0 2024-02-19T19:12:15.564 INFO:tasks.workunit.client.1.smithi125.stdout:5/634: dread db/d17/d58/f1c [155648,61440] 0 2024-02-19T19:12:15.564 INFO:tasks.workunit.client.1.smithi125.stdout:1/512: creat d1/d1a/d3d/d6e/fa7 x:0 0 0 2024-02-19T19:12:15.564 INFO:tasks.workunit.client.1.smithi125.stdout:1/513: creat d1/d26/d3c/fa8 x:0 0 0 2024-02-19T19:12:15.564 INFO:tasks.workunit.client.1.smithi125.stdout:9/483: write f2 [2869203,70530] 0 2024-02-19T19:12:15.564 INFO:tasks.workunit.client.1.smithi125.stdout:1/514: creat d1/d26/d3c/d3f/fa9 x:0 0 0 2024-02-19T19:12:15.564 INFO:tasks.workunit.client.1.smithi125.stdout:1/515: creat d1/faa x:0 0 0 2024-02-19T19:12:15.565 INFO:tasks.workunit.client.1.smithi125.stdout:9/484: symlink d8/d15/d22/d4e/d90/lac 0 2024-02-19T19:12:15.565 INFO:tasks.workunit.client.1.smithi125.stdout:1/516: rename d1/d1a/d3d/d6e/d4b/f75 to d1/d78/d8a/fab 0 2024-02-19T19:12:15.565 INFO:tasks.workunit.client.1.smithi125.stdout:1/517: write d1/f30 [647045,39579] 0 2024-02-19T19:12:15.565 INFO:tasks.workunit.client.1.smithi125.stdout:1/518: write d1/d1a/d3d/d6e/d4b/f4e [1697590,74222] 0 2024-02-19T19:12:15.565 INFO:tasks.workunit.client.1.smithi125.stdout:1/519: mknod d1/d26/cac 0 2024-02-19T19:12:15.565 INFO:tasks.workunit.client.1.smithi125.stdout:1/520: write d1/d1a/d3d/d6e/fa7 [730779,72235] 0 2024-02-19T19:12:15.667 INFO:tasks.workunit.client.1.smithi125.stdout:9/485: dwrite d8/d15/f70 [147456,12288] 0 2024-02-19T19:12:15.667 INFO:tasks.workunit.client.1.smithi125.stdout:9/486: symlink d8/lad 0 2024-02-19T19:12:15.667 INFO:tasks.workunit.client.1.smithi125.stdout:9/487: mknod d8/d2e/d4c/d84/cae 0 2024-02-19T19:12:15.667 INFO:tasks.workunit.client.1.smithi125.stdout:1/521: dwrite d1/dc/d36/d39/fa1 [258048,73728] 0 2024-02-19T19:12:15.668 INFO:tasks.workunit.client.1.smithi125.stdout:9/488: write d8/d15/d22/d4e/f83 [51532,52623] 0 2024-02-19T19:12:15.668 INFO:tasks.workunit.client.1.smithi125.stdout:1/522: rename d1/d26/f7d to d1/dc/d36/d69/fad 0 2024-02-19T19:12:15.668 INFO:tasks.workunit.client.1.smithi125.stdout:9/489: mknod d8/d15/da2/caf 0 2024-02-19T19:12:15.668 INFO:tasks.workunit.client.1.smithi125.stdout:9/490: creat d8/d15/d22/d44/fb0 x:0 0 0 2024-02-19T19:12:15.668 INFO:tasks.workunit.client.1.smithi125.stdout:1/523: creat d1/da3/fae x:0 0 0 2024-02-19T19:12:15.668 INFO:tasks.workunit.client.1.smithi125.stdout:9/491: creat d8/d15/d32/d4f/d6e/fb1 x:0 0 0 2024-02-19T19:12:15.668 INFO:tasks.workunit.client.1.smithi125.stdout:1/524: truncate d1/d78/d8a/fab 383063 0 2024-02-19T19:12:15.668 INFO:tasks.workunit.client.1.smithi125.stdout:1/525: symlink d1/dc/d36/d69/laf 0 2024-02-19T19:12:15.680 INFO:tasks.workunit.client.1.smithi125.stdout:4/412: dread d0/d7/d30/d58/f9 [466944,49152] 0 2024-02-19T19:12:15.684 INFO:tasks.workunit.client.1.smithi125.stdout:5/635: dread db/f34 [368640,90112] 0 2024-02-19T19:12:15.728 INFO:tasks.workunit.client.1.smithi125.stdout:7/434: fdatasync d12/d18/d44/d51/f56 0 2024-02-19T19:12:15.729 INFO:tasks.workunit.client.1.smithi125.stdout:5/636: fsync db/d26/d51/f7c 0 2024-02-19T19:12:15.729 INFO:tasks.workunit.client.1.smithi125.stdout:7/435: chown d12/c34 105532000 1 2024-02-19T19:12:15.729 INFO:tasks.workunit.client.1.smithi125.stdout:7/436: getdents d12/d18/d2c/d4e 0 2024-02-19T19:12:15.729 INFO:tasks.workunit.client.1.smithi125.stdout:5/637: read db/d47/f7e [765347,86302] 0 2024-02-19T19:12:15.733 INFO:tasks.workunit.client.1.smithi125.stdout:9/492: dwrite d8/d15/d22/d44/fb0 [749568,4096] 0 2024-02-19T19:12:15.733 INFO:tasks.workunit.client.1.smithi125.stdout:7/437: symlink d12/d18/d44/d3b/d59/d26/d54/l7d 0 2024-02-19T19:12:15.733 INFO:tasks.workunit.client.1.smithi125.stdout:4/413: dwrite d0/f1b [1843200,73728] 0 2024-02-19T19:12:15.733 INFO:tasks.workunit.client.1.smithi125.stdout:1/526: dwrite d1/d1a/f88 [102400,4096] 0 2024-02-19T19:12:15.733 INFO:tasks.workunit.client.1.smithi125.stdout:7/438: creat d12/f7e x:0 0 0 2024-02-19T19:12:15.733 INFO:tasks.workunit.client.1.smithi125.stdout:4/414: write d0/d7/d3b/f51 [612804,4658] 0 2024-02-19T19:12:15.734 INFO:tasks.workunit.client.1.smithi125.stdout:7/439: getdents d12/d18/d2c/d4e 0 2024-02-19T19:12:15.734 INFO:tasks.workunit.client.1.smithi125.stdout:1/527: write d1/d78/d80/f5d [595381,40420] 0 2024-02-19T19:12:15.734 INFO:tasks.workunit.client.1.smithi125.stdout:4/415: mknod d0/d7/d76/c8c 0 2024-02-19T19:12:15.734 INFO:tasks.workunit.client.1.smithi125.stdout:4/416: read - d0/d7/d3b/f5f zero size 2024-02-19T19:12:15.734 INFO:tasks.workunit.client.1.smithi125.stdout:1/528: link d1/d1a/d3d/d6e/l67 d1/d78/d8a/lb0 0 2024-02-19T19:12:15.734 INFO:tasks.workunit.client.1.smithi125.stdout:4/417: symlink d0/d7/d3b/d77/l8d 0 2024-02-19T19:12:15.734 INFO:tasks.workunit.client.1.smithi125.stdout:5/638: dwrite db/d47/f7e [3239936,36864] 0 2024-02-19T19:12:15.734 INFO:tasks.workunit.client.1.smithi125.stdout:5/639: chown db/d17/d58/d33/d64 7 1 2024-02-19T19:12:15.735 INFO:tasks.workunit.client.1.smithi125.stdout:5/640: mknod db/d17/d58/d33/cc5 0 2024-02-19T19:12:15.735 INFO:tasks.workunit.client.1.smithi125.stdout:5/641: symlink db/d17/lc6 0 2024-02-19T19:12:15.735 INFO:tasks.workunit.client.1.smithi125.stdout:5/642: symlink db/d17/d58/lc7 0 2024-02-19T19:12:15.735 INFO:tasks.workunit.client.1.smithi125.stdout:5/643: symlink db/d17/d58/d33/lc8 0 2024-02-19T19:12:15.735 INFO:tasks.workunit.client.1.smithi125.stdout:5/644: chown db/d26/d51/l74 760514515 1 2024-02-19T19:12:15.735 INFO:tasks.workunit.client.1.smithi125.stdout:5/645: rename db/d17/d58/d33/f97 to db/d17/d58/d33/fc9 0 2024-02-19T19:12:15.784 INFO:tasks.workunit.client.1.smithi125.stdout:5/646: dwrite db/d17/d58/d33/d91/dbe/f5b [1069056,12288] 0 2024-02-19T19:12:15.785 INFO:tasks.workunit.client.1.smithi125.stdout:5/647: mknod db/d47/cca 0 2024-02-19T19:12:15.785 INFO:tasks.workunit.client.1.smithi125.stdout:5/648: creat db/d26/d51/fcb x:0 0 0 2024-02-19T19:12:15.785 INFO:tasks.workunit.client.1.smithi125.stdout:5/649: truncate db/d17/d58/f81 761781 0 2024-02-19T19:12:15.785 INFO:tasks.workunit.client.1.smithi125.stdout:5/650: rmdir db/d17/d58/d33/d53 39 2024-02-19T19:12:15.785 INFO:tasks.workunit.client.1.smithi125.stdout:5/651: creat db/d17/d58/d33/d98/fcc x:0 0 0 2024-02-19T19:12:15.785 INFO:tasks.workunit.client.1.smithi125.stdout:5/652: readlink db/d17/d58/d25/l9b 0 2024-02-19T19:12:15.786 INFO:tasks.workunit.client.1.smithi125.stdout:4/418: dwrite d0/d32/f36 [20480,69632] 0 2024-02-19T19:12:15.786 INFO:tasks.workunit.client.1.smithi125.stdout:4/419: write d0/d7/d3b/f3d [1821594,85832] 0 2024-02-19T19:12:15.786 INFO:tasks.workunit.client.1.smithi125.stdout:4/420: creat d0/d7/d3b/f8e x:0 0 0 2024-02-19T19:12:15.786 INFO:tasks.workunit.client.1.smithi125.stdout:4/421: chown d0/d32/c5a 3 1 2024-02-19T19:12:15.786 INFO:tasks.workunit.client.1.smithi125.stdout:4/422: creat d0/d7/d85/f8f x:0 0 0 2024-02-19T19:12:15.786 INFO:tasks.workunit.client.1.smithi125.stdout:4/423: write d0/d7/d3b/f81 [800849,85248] 0 2024-02-19T19:12:15.786 INFO:tasks.workunit.client.1.smithi125.stdout:4/424: write d0/d7/d30/d58/f24 [726487,51408] 0 2024-02-19T19:12:15.786 INFO:tasks.workunit.client.1.smithi125.stdout:4/425: write d0/d7/d3b/f81 [663645,71424] 0 2024-02-19T19:12:15.787 INFO:tasks.workunit.client.1.smithi125.stdout:4/426: unlink d0/f59 0 2024-02-19T19:12:15.787 INFO:tasks.workunit.client.1.smithi125.stdout:4/427: link d0/d7/d30/d58/f2d d0/d7/d3b/d75/f90 0 2024-02-19T19:12:15.787 INFO:tasks.workunit.client.1.smithi125.stdout:9/493: dwrite d8/f28 [1224704,118784] 0 2024-02-19T19:12:15.787 INFO:tasks.workunit.client.1.smithi125.stdout:9/494: mknod d8/d15/d22/d4e/cb2 0 2024-02-19T19:12:15.787 INFO:tasks.workunit.client.1.smithi125.stdout:4/428: unlink d0/df/f2a 0 2024-02-19T19:12:15.824 INFO:tasks.workunit.client.1.smithi125.stdout:7/440: fsync d12/d18/d44/d3b/d59/d26/f2f 0 2024-02-19T19:12:15.824 INFO:tasks.workunit.client.1.smithi125.stdout:6/440: fdatasync d6/db/df/d16/f38 0 2024-02-19T19:12:15.824 INFO:tasks.workunit.client.1.smithi125.stdout:6/441: write d6/db/df/d16/f2b [1040766,85322] 0 2024-02-19T19:12:15.824 INFO:tasks.workunit.client.1.smithi125.stdout:5/653: fdatasync db/d47/f5f 0 2024-02-19T19:12:15.824 INFO:tasks.workunit.client.1.smithi125.stdout:4/429: fdatasync d0/d32/f8b 0 2024-02-19T19:12:15.832 INFO:tasks.workunit.client.1.smithi125.stdout:7/441: dwrite d12/d18/f1e [0,45056] 0 2024-02-19T19:12:15.832 INFO:tasks.workunit.client.1.smithi125.stdout:4/430: unlink d0/d7/d3b/d75/c84 0 2024-02-19T19:12:15.832 INFO:tasks.workunit.client.1.smithi125.stdout:7/442: chown d12/c1c 14252318 1 2024-02-19T19:12:15.832 INFO:tasks.workunit.client.1.smithi125.stdout:4/431: truncate d0/df/f52 390362 0 2024-02-19T19:12:15.832 INFO:tasks.workunit.client.1.smithi125.stdout:7/443: creat d12/d18/d44/d3b/d59/d2a/d6a/d6d/f7f x:0 0 0 2024-02-19T19:12:15.833 INFO:tasks.workunit.client.1.smithi125.stdout:7/444: dread d12/d18/d44/d3b/d59/d26/d30/d37/f62 [1269760,86016] 0 2024-02-19T19:12:15.835 INFO:tasks.workunit.client.1.smithi125.stdout:7/445: write d12/d18/d44/f40 [731823,74443] 0 2024-02-19T19:12:15.835 INFO:tasks.workunit.client.1.smithi125.stdout:6/442: creat d6/db/d5d/d63/f85 x:0 0 0 2024-02-19T19:12:15.836 INFO:tasks.workunit.client.1.smithi125.stdout:7/446: symlink d12/d18/d44/d3b/d59/l80 0 2024-02-19T19:12:15.836 INFO:tasks.workunit.client.1.smithi125.stdout:7/447: dread d12/d18/d44/f40 [376832,32768] 0 2024-02-19T19:12:15.836 INFO:tasks.workunit.client.1.smithi125.stdout:4/432: mknod d0/d7/d30/d6c/c91 0 2024-02-19T19:12:15.836 INFO:tasks.workunit.client.1.smithi125.stdout:6/443: creat d6/db/d5d/d2f/f86 x:0 0 0 2024-02-19T19:12:15.836 INFO:tasks.workunit.client.1.smithi125.stdout:4/433: symlink d0/d7/d3b/l92 0 2024-02-19T19:12:15.836 INFO:tasks.workunit.client.1.smithi125.stdout:6/444: mknod d6/db/df/d3b/c87 0 2024-02-19T19:12:15.836 INFO:tasks.workunit.client.1.smithi125.stdout:4/434: dread d0/d7/d30/d58/f29 [176128,94208] 0 2024-02-19T19:12:15.836 INFO:tasks.workunit.client.1.smithi125.stdout:6/445: symlink d6/db/d49/l88 0 2024-02-19T19:12:15.837 INFO:tasks.workunit.client.1.smithi125.stdout:4/435: creat d0/d7/d30/d6c/f93 x:0 0 0 2024-02-19T19:12:15.837 INFO:tasks.workunit.client.1.smithi125.stdout:4/436: mknod d0/d7/d30/c94 0 2024-02-19T19:12:15.837 INFO:tasks.workunit.client.1.smithi125.stdout:4/437: write d0/df/f73 [1768346,28645] 0 2024-02-19T19:12:15.837 INFO:tasks.workunit.client.1.smithi125.stdout:4/438: link d0/d32/d60/c65 d0/d7/d3b/d77/c95 0 2024-02-19T19:12:15.837 INFO:tasks.workunit.client.1.smithi125.stdout:4/439: readlink d0/l2c 0 2024-02-19T19:12:15.837 INFO:tasks.workunit.client.1.smithi125.stdout:4/440: mknod d0/d7/d30/d58/c96 0 2024-02-19T19:12:15.837 INFO:tasks.workunit.client.1.smithi125.stdout:4/441: mknod d0/d7/d3b/d77/c97 0 2024-02-19T19:12:15.837 INFO:tasks.workunit.client.1.smithi125.stdout:4/442: mknod d0/d7/d76/c98 0 2024-02-19T19:12:15.837 INFO:tasks.workunit.client.1.smithi125.stdout:4/443: creat d0/d7/d30/d42/d7b/f99 x:0 0 0 2024-02-19T19:12:15.837 INFO:tasks.workunit.client.1.smithi125.stdout:4/444: rename d0/d7/d30/d58/l89 to d0/d7/d30/l9a 0 2024-02-19T19:12:15.838 INFO:tasks.workunit.client.1.smithi125.stdout:4/445: write d0/df/f73 [1421621,95750] 0 2024-02-19T19:12:15.838 INFO:tasks.workunit.client.1.smithi125.stdout:4/446: dread - d0/d7/d30/d42/f86 zero size 2024-02-19T19:12:15.838 INFO:tasks.workunit.client.1.smithi125.stdout:4/447: rename d0/d7/d3b/f82 to d0/d7/d30/d5d/f9b 0 2024-02-19T19:12:15.838 INFO:tasks.workunit.client.1.smithi125.stdout:4/448: readlink d0/d7/d3b/l7c 0 2024-02-19T19:12:15.838 INFO:tasks.workunit.client.1.smithi125.stdout:4/449: creat d0/d7/d3b/f9c x:0 0 0 2024-02-19T19:12:15.838 INFO:tasks.workunit.client.1.smithi125.stdout:5/654: dwrite db/d17/d58/d33/fc9 [1011712,24576] 0 2024-02-19T19:12:15.838 INFO:tasks.workunit.client.1.smithi125.stdout:6/446: dwrite d6/db/df/f21 [884736,65536] 0 2024-02-19T19:12:15.838 INFO:tasks.workunit.client.1.smithi125.stdout:6/447: write d6/db/df/d16/f5c [1249732,65121] 0 2024-02-19T19:12:15.838 INFO:tasks.workunit.client.1.smithi125.stdout:6/448: creat d6/db/d5d/d2f/d45/f89 x:0 0 0 2024-02-19T19:12:15.839 INFO:tasks.workunit.client.1.smithi125.stdout:6/449: write d6/db/d5d/d2f/f86 [203464,85663] 0 2024-02-19T19:12:15.839 INFO:tasks.workunit.client.1.smithi125.stdout:6/450: stat d6/db/df/f51 0 2024-02-19T19:12:15.839 INFO:tasks.workunit.client.1.smithi125.stdout:6/451: creat d6/db/d5d/d2f/d45/f8a x:0 0 0 2024-02-19T19:12:15.839 INFO:tasks.workunit.client.1.smithi125.stdout:6/452: dread d6/db/d5d/d2f/d45/d4e/f53 [421888,102400] 0 2024-02-19T19:12:15.839 INFO:tasks.workunit.client.1.smithi125.stdout:6/453: chown d6/db/d49/d4c/c6f 150410246 1 2024-02-19T19:12:15.850 INFO:tasks.workunit.client.1.smithi125.stdout:7/448: read f8 [456754,33783] 0 2024-02-19T19:12:15.850 INFO:tasks.workunit.client.1.smithi125.stdout:7/449: rmdir d12 39 2024-02-19T19:12:15.864 INFO:tasks.workunit.client.1.smithi125.stdout:9/495: dread d8/d15/d22/f67 [61440,90112] 0 2024-02-19T19:12:15.864 INFO:tasks.workunit.client.1.smithi125.stdout:9/496: creat d8/d15/fb3 x:0 0 0 2024-02-19T19:12:15.864 INFO:tasks.workunit.client.1.smithi125.stdout:9/497: write d8/d15/fb3 [407203,54683] 0 2024-02-19T19:12:15.966 INFO:tasks.workunit.client.1.smithi125.stdout:4/450: fdatasync d0/fa 0 2024-02-19T19:12:15.966 INFO:tasks.workunit.client.1.smithi125.stdout:4/451: chown d0/d7/d30/d58/fd 13171886 1 2024-02-19T19:12:15.966 INFO:tasks.workunit.client.1.smithi125.stdout:4/452: truncate d0/d7/d30/d58/f87 403922 0 2024-02-19T19:12:15.966 INFO:tasks.workunit.client.1.smithi125.stdout:4/453: getdents d0/d7/d30/d42/d7b 0 2024-02-19T19:12:15.966 INFO:tasks.workunit.client.1.smithi125.stdout:7/450: dread fc [933888,126976] 0 2024-02-19T19:12:15.966 INFO:tasks.workunit.client.1.smithi125.stdout:7/451: mkdir d12/d18/d44/d51/d81 0 2024-02-19T19:12:15.966 INFO:tasks.workunit.client.1.smithi125.stdout:7/452: getdents d12/d18/d44/d51/d81 0 2024-02-19T19:12:15.967 INFO:tasks.workunit.client.1.smithi125.stdout:7/453: mkdir d12/d18/d2c/d4e/d82 0 2024-02-19T19:12:15.969 INFO:tasks.workunit.client.1.smithi125.stdout:5/655: rename db/d17/d58/f24 to db/d17/d58/d33/d91/dbe/fcd 0 2024-02-19T19:12:15.969 INFO:tasks.workunit.client.1.smithi125.stdout:6/454: rename d6/db to d6/db/d5d/d2f/d8b 22 2024-02-19T19:12:15.969 INFO:tasks.workunit.client.1.smithi125.stdout:5/656: chown db/d26/fbf 142 1 2024-02-19T19:12:15.969 INFO:tasks.workunit.client.1.smithi125.stdout:6/455: read d6/db/df/d3b/f3c [98956,85878] 0 2024-02-19T19:12:15.970 INFO:tasks.workunit.client.1.smithi125.stdout:5/657: dread db/d17/d58/f81 [221184,69632] 0 2024-02-19T19:12:15.970 INFO:tasks.workunit.client.1.smithi125.stdout:6/456: mknod d6/db/df/c8c 0 2024-02-19T19:12:15.970 INFO:tasks.workunit.client.1.smithi125.stdout:6/457: mkdir d6/db/d5d/d2f/d7b/d8d 0 2024-02-19T19:12:15.970 INFO:tasks.workunit.client.1.smithi125.stdout:6/458: rename d6/db/d5d/d2f/d45/d4e/c7f to d6/db/d49/d4c/c8e 0 2024-02-19T19:12:15.970 INFO:tasks.workunit.client.1.smithi125.stdout:6/459: getdents d6/db 0 2024-02-19T19:12:15.970 INFO:tasks.workunit.client.1.smithi125.stdout:6/460: creat d6/db/d5d/d2f/d7b/f8f x:0 0 0 2024-02-19T19:12:15.970 INFO:tasks.workunit.client.1.smithi125.stdout:6/461: write d6/db/d5d/f19 [1733573,51691] 0 2024-02-19T19:12:15.970 INFO:tasks.workunit.client.1.smithi125.stdout:6/462: chown d6/db/d5d/d29/f2d 51 1 2024-02-19T19:12:15.971 INFO:tasks.workunit.client.1.smithi125.stdout:9/498: dwrite d8/d2e/d4c/f5f [1449984,32768] 0 2024-02-19T19:12:15.973 INFO:tasks.workunit.client.1.smithi125.stdout:7/454: dwrite d12/d18/d44/d51/f56 [389120,94208] 0 2024-02-19T19:12:15.973 INFO:tasks.workunit.client.1.smithi125.stdout:7/455: creat d12/d18/d44/d51/d81/f83 x:0 0 0 2024-02-19T19:12:15.973 INFO:tasks.workunit.client.1.smithi125.stdout:7/456: link d12/d18/d44/d3b/d59/d2a/d31/d50/d60/c72 d12/d18/d44/d3b/d59/d2a/c84 0 2024-02-19T19:12:15.973 INFO:tasks.workunit.client.1.smithi125.stdout:5/658: dwrite db/d47/f7e [933888,4096] 0 2024-02-19T19:12:15.973 INFO:tasks.workunit.client.1.smithi125.stdout:7/457: rename d12/c1c to d12/d18/d44/c85 0 2024-02-19T19:12:15.973 INFO:tasks.workunit.client.1.smithi125.stdout:5/659: chown db/d47/f6a 472166 1 2024-02-19T19:12:15.973 INFO:tasks.workunit.client.1.smithi125.stdout:5/660: mkdir db/d17/d58/d33/d53/dce 0 2024-02-19T19:12:15.973 INFO:tasks.workunit.client.1.smithi125.stdout:5/661: rmdir db/d17/d58/d33/d91 39 2024-02-19T19:12:15.974 INFO:tasks.workunit.client.1.smithi125.stdout:7/458: write d12/d18/d44/d3b/d59/d2a/d48/f49 [508375,115090] 0 2024-02-19T19:12:15.974 INFO:tasks.workunit.client.1.smithi125.stdout:5/662: creat db/d17/d58/d33/d64/fcf x:0 0 0 2024-02-19T19:12:15.974 INFO:tasks.workunit.client.1.smithi125.stdout:5/663: getdents db/d47/d52 0 2024-02-19T19:12:15.974 INFO:tasks.workunit.client.1.smithi125.stdout:5/664: creat db/d17/d58/d33/d53/dce/fd0 x:0 0 0 2024-02-19T19:12:15.974 INFO:tasks.workunit.client.1.smithi125.stdout:5/665: readlink db/d47/d52/d5d/lc3 0 2024-02-19T19:12:15.974 INFO:tasks.workunit.client.1.smithi125.stdout:7/459: write d12/d18/d44/d51/f6b [857329,76465] 0 2024-02-19T19:12:15.974 INFO:tasks.workunit.client.1.smithi125.stdout:7/460: symlink d12/d18/d44/d51/l86 0 2024-02-19T19:12:15.974 INFO:tasks.workunit.client.1.smithi125.stdout:7/461: rename d12/d18/d44/d51/f6b to d12/d18/d44/d3b/d59/d26/f87 0 2024-02-19T19:12:15.974 INFO:tasks.workunit.client.1.smithi125.stdout:7/462: creat d12/d18/d44/d3b/d59/d26/d30/f88 x:0 0 0 2024-02-19T19:12:15.975 INFO:tasks.workunit.client.1.smithi125.stdout:7/463: creat d12/d18/d44/d3b/d59/d2a/d31/d50/f89 x:0 0 0 2024-02-19T19:12:16.005 INFO:tasks.workunit.client.1.smithi125.stdout:1/529: fdatasync d1/d78/d80/f5d 0 2024-02-19T19:12:16.005 INFO:tasks.workunit.client.1.smithi125.stdout:1/530: write d1/d26/d3c/fa8 [359991,119978] 0 2024-02-19T19:12:16.005 INFO:tasks.workunit.client.1.smithi125.stdout:1/531: write d1/d1a/f50 [2295414,93490] 0 2024-02-19T19:12:16.005 INFO:tasks.workunit.client.1.smithi125.stdout:1/532: chown d1/d1a/d3d/d6e/d4b 1 1 2024-02-19T19:12:16.088 INFO:tasks.workunit.client.1.smithi125.stdout:9/499: fdatasync d8/d15/f66 0 2024-02-19T19:12:16.089 INFO:tasks.workunit.client.1.smithi125.stdout:5/666: fsync db/d17/d58/d4f/dad/fb2 0 2024-02-19T19:12:16.090 INFO:tasks.workunit.client.1.smithi125.stdout:1/533: link d1/dc/d36/f66 d1/d78/d80/fb1 0 2024-02-19T19:12:16.090 INFO:tasks.workunit.client.1.smithi125.stdout:5/667: creat db/d17/d58/d25/fd1 x:0 0 0 2024-02-19T19:12:16.090 INFO:tasks.workunit.client.1.smithi125.stdout:5/668: dread db/d17/d58/f48 [356352,106496] 0 2024-02-19T19:12:16.090 INFO:tasks.workunit.client.1.smithi125.stdout:1/534: write d1/dc/d36/f54 [1117646,68890] 0 2024-02-19T19:12:16.091 INFO:tasks.workunit.client.1.smithi125.stdout:7/464: dread d12/d18/d44/d3b/d59/d26/f2f [110592,73728] 0 2024-02-19T19:12:16.094 INFO:tasks.workunit.client.1.smithi125.stdout:5/669: truncate db/d17/d58/f1c 1240882 0 2024-02-19T19:12:16.094 INFO:tasks.workunit.client.1.smithi125.stdout:5/670: stat db/d47/db6 0 2024-02-19T19:12:16.094 INFO:tasks.workunit.client.1.smithi125.stdout:3/393: sync 2024-02-19T19:12:16.094 INFO:tasks.workunit.client.1.smithi125.stdout:8/407: sync 2024-02-19T19:12:16.094 INFO:tasks.workunit.client.1.smithi125.stdout:5/671: chown db/d17/d58/cb5 108352 1 2024-02-19T19:12:16.094 INFO:tasks.workunit.client.1.smithi125.stdout:2/390: sync 2024-02-19T19:12:16.095 INFO:tasks.workunit.client.1.smithi125.stdout:0/396: sync 2024-02-19T19:12:16.095 INFO:tasks.workunit.client.1.smithi125.stdout:5/672: mknod db/d17/d85/cd2 0 2024-02-19T19:12:16.095 INFO:tasks.workunit.client.1.smithi125.stdout:0/397: unlink d5/d33/d46/c50 0 2024-02-19T19:12:16.095 INFO:tasks.workunit.client.1.smithi125.stdout:8/408: creat db/d18/d2f/d72/f87 x:0 0 0 2024-02-19T19:12:16.095 INFO:tasks.workunit.client.1.smithi125.stdout:2/391: read d1/d27/d1d/d25/f2d [1006669,78081] 0 2024-02-19T19:12:16.095 INFO:tasks.workunit.client.1.smithi125.stdout:0/398: readlink d5/d19/l28 0 2024-02-19T19:12:16.095 INFO:tasks.workunit.client.1.smithi125.stdout:8/409: mkdir db/d18/d30/d3c/d88 0 2024-02-19T19:12:16.095 INFO:tasks.workunit.client.1.smithi125.stdout:3/394: write d0/d1/d1e/f36 [1008734,116243] 0 2024-02-19T19:12:16.096 INFO:tasks.workunit.client.1.smithi125.stdout:3/395: write d0/f51 [1353361,56310] 0 2024-02-19T19:12:16.096 INFO:tasks.workunit.client.1.smithi125.stdout:3/396: truncate d0/d1/d1e/f27 532348 0 2024-02-19T19:12:16.096 INFO:tasks.workunit.client.1.smithi125.stdout:3/397: creat d0/d1/d1e/d60/d73/d74/f79 x:0 0 0 2024-02-19T19:12:16.096 INFO:tasks.workunit.client.1.smithi125.stdout:3/398: chown d0/c4e 6 1 2024-02-19T19:12:16.096 INFO:tasks.workunit.client.1.smithi125.stdout:3/399: getdents d0/d1/d1e/d60/d73/d74 0 2024-02-19T19:12:16.096 INFO:tasks.workunit.client.1.smithi125.stdout:3/400: link d0/d1/d1e/f5d d0/de/f7a 0 2024-02-19T19:12:16.096 INFO:tasks.workunit.client.1.smithi125.stdout:3/401: link d0/d1/d39/f49 d0/d1/d4b/f7b 0 2024-02-19T19:12:16.096 INFO:tasks.workunit.client.1.smithi125.stdout:3/402: mkdir d0/d1/d1e/d60/d7c 0 2024-02-19T19:12:16.096 INFO:tasks.workunit.client.1.smithi125.stdout:3/403: symlink d0/d1/d1e/d60/d7c/l7d 0 2024-02-19T19:12:16.097 INFO:tasks.workunit.client.1.smithi125.stdout:3/404: getdents d0/d5f/d71 0 2024-02-19T19:12:16.097 INFO:tasks.workunit.client.1.smithi125.stdout:3/405: symlink d0/d1/d1e/d60/l7e 0 2024-02-19T19:12:16.097 INFO:tasks.workunit.client.1.smithi125.stdout:3/406: chown d0/d1/d39/c6f 5352064 1 2024-02-19T19:12:16.097 INFO:tasks.workunit.client.1.smithi125.stdout:3/407: truncate d0/de/f1c 356390 0 2024-02-19T19:12:16.097 INFO:tasks.workunit.client.1.smithi125.stdout:3/408: write d0/d1/f63 [928849,76479] 0 2024-02-19T19:12:16.097 INFO:tasks.workunit.client.1.smithi125.stdout:3/409: write d0/d1/f65 [331476,109043] 0 2024-02-19T19:12:16.097 INFO:tasks.workunit.client.1.smithi125.stdout:3/410: dread d0/d1/d4b/d52/f5e [69632,98304] 0 2024-02-19T19:12:16.139 INFO:tasks.workunit.client.1.smithi125.stdout:5/673: dwrite db/d17/f20 [1777664,32768] 0 2024-02-19T19:12:16.139 INFO:tasks.workunit.client.1.smithi125.stdout:5/674: write db/d17/d85/fb4 [1966147,28900] 0 2024-02-19T19:12:16.139 INFO:tasks.workunit.client.1.smithi125.stdout:5/675: chown l7 7698436 1 2024-02-19T19:12:16.139 INFO:tasks.workunit.client.1.smithi125.stdout:5/676: mknod db/d17/d58/d33/d53/cd3 0 2024-02-19T19:12:16.139 INFO:tasks.workunit.client.1.smithi125.stdout:5/677: rename db/d17/d58/d33/d98/lc2 to db/d17/d58/d4f/ld4 0 2024-02-19T19:12:16.140 INFO:tasks.workunit.client.1.smithi125.stdout:5/678: mkdir db/d17/d58/d33/d53/dd5 0 2024-02-19T19:12:16.140 INFO:tasks.workunit.client.1.smithi125.stdout:5/679: creat db/d17/d58/d4f/fd6 x:0 0 0 2024-02-19T19:12:16.140 INFO:tasks.workunit.client.1.smithi125.stdout:5/680: rename db/d17/d58/f48 to db/d17/d58/d33/d98/fd7 0 2024-02-19T19:12:16.140 INFO:tasks.workunit.client.1.smithi125.stdout:5/681: chown db/d17/d58/d33/f3e 2989 1 2024-02-19T19:12:16.140 INFO:tasks.workunit.client.1.smithi125.stdout:5/682: mknod db/d17/d58/d33/cd8 0 2024-02-19T19:12:16.140 INFO:tasks.workunit.client.1.smithi125.stdout:5/683: getdents db/d17/d58/d33/d91 0 2024-02-19T19:12:16.140 INFO:tasks.workunit.client.1.smithi125.stdout:5/684: write db/d17/d58/d33/d91/dbe/fbb [1059267,44438] 0 2024-02-19T19:12:16.141 INFO:tasks.workunit.client.1.smithi125.stdout:5/685: creat db/d47/d52/d5d/fd9 x:0 0 0 2024-02-19T19:12:16.141 INFO:tasks.workunit.client.1.smithi125.stdout:5/686: chown db/d17/d58/c12 8 1 2024-02-19T19:12:16.141 INFO:tasks.workunit.client.1.smithi125.stdout:5/687: write db/d17/d58/d33/d91/dbe/f8e [1481744,105054] 0 2024-02-19T19:12:16.141 INFO:tasks.workunit.client.1.smithi125.stdout:2/392: dwrite d1/d36/d70/f49 [524288,106496] 0 2024-02-19T19:12:16.141 INFO:tasks.workunit.client.1.smithi125.stdout:2/393: getdents d1/d27/d1d/d16 0 2024-02-19T19:12:16.147 INFO:tasks.workunit.client.1.smithi125.stdout:7/465: dread f5 [2469888,118784] 0 2024-02-19T19:12:16.147 INFO:tasks.workunit.client.1.smithi125.stdout:7/466: dread d12/d18/d44/d3b/d59/d2a/f4a [28672,65536] 0 2024-02-19T19:12:16.148 INFO:tasks.workunit.client.1.smithi125.stdout:7/467: write d12/d18/d2c/f76 [798471,121196] 0 2024-02-19T19:12:16.148 INFO:tasks.workunit.client.1.smithi125.stdout:7/468: dread fa [983040,53248] 0 2024-02-19T19:12:16.148 INFO:tasks.workunit.client.1.smithi125.stdout:7/469: readlink d12/d18/d44/d3b/d59/l80 0 2024-02-19T19:12:16.186 INFO:tasks.workunit.client.1.smithi125.stdout:1/535: fsync d1/dc/d36/f77 0 2024-02-19T19:12:16.186 INFO:tasks.workunit.client.1.smithi125.stdout:0/399: fdatasync d5/f8 0 2024-02-19T19:12:16.186 INFO:tasks.workunit.client.1.smithi125.stdout:1/536: truncate d1/d1a/d3d/d6e/d4b/f6a 913048 0 2024-02-19T19:12:16.186 INFO:tasks.workunit.client.1.smithi125.stdout:3/411: fsync d0/d1/d1e/f1f 0 2024-02-19T19:12:16.186 INFO:tasks.workunit.client.1.smithi125.stdout:1/537: mknod d1/dc/cb2 0 2024-02-19T19:12:16.186 INFO:tasks.workunit.client.1.smithi125.stdout:1/538: link d1/dc/d36/d69/laf d1/d26/d23/lb3 0 2024-02-19T19:12:16.186 INFO:tasks.workunit.client.1.smithi125.stdout:1/539: write d1/d1a/d3d/f61 [50153,128282] 0 2024-02-19T19:12:16.187 INFO:tasks.workunit.client.1.smithi125.stdout:1/540: chown d1/l59 2056778 1 2024-02-19T19:12:16.188 INFO:tasks.workunit.client.1.smithi125.stdout:5/688: dwrite db/d17/d85/fb4 [864256,4096] 0 2024-02-19T19:12:16.188 INFO:tasks.workunit.client.1.smithi125.stdout:7/470: dwrite d12/d18/f3c [983040,53248] 0 2024-02-19T19:12:16.189 INFO:tasks.workunit.client.1.smithi125.stdout:0/400: dwrite d5/d15/d2c/d80/f4f [1130496,73728] 0 2024-02-19T19:12:16.190 INFO:tasks.workunit.client.1.smithi125.stdout:0/401: read - d5/d19/f47 zero size 2024-02-19T19:12:16.190 INFO:tasks.workunit.client.1.smithi125.stdout:0/402: stat d5/l13 0 2024-02-19T19:12:16.190 INFO:tasks.workunit.client.1.smithi125.stdout:0/403: chown d5/d9/f26 7 1 2024-02-19T19:12:16.190 INFO:tasks.workunit.client.1.smithi125.stdout:0/404: write d5/d33/f7e [252075,48906] 0 2024-02-19T19:12:16.191 INFO:tasks.workunit.client.1.smithi125.stdout:1/541: dread d1/d26/d23/f2d [53248,24576] 0 2024-02-19T19:12:16.191 INFO:tasks.workunit.client.1.smithi125.stdout:7/471: dwrite d12/d18/d44/d3b/d59/d26/d30/d37/f62 [1650688,69632] 0 2024-02-19T19:12:16.191 INFO:tasks.workunit.client.1.smithi125.stdout:7/472: dread - d12/d18/d44/d51/d81/f83 zero size 2024-02-19T19:12:16.255 INFO:tasks.workunit.client.1.smithi125.stdout:2/394: fdatasync d1/d27/d1d/f2b 0 2024-02-19T19:12:16.255 INFO:tasks.workunit.client.1.smithi125.stdout:5/689: fdatasync db/d17/d58/d33/f3e 0 2024-02-19T19:12:16.255 INFO:tasks.workunit.client.1.smithi125.stdout:5/690: write db/d17/d58/f6e [732829,72928] 0 2024-02-19T19:12:16.261 INFO:tasks.workunit.client.1.smithi125.stdout:3/412: dwrite d0/d1/f6e [262144,118784] 0 2024-02-19T19:12:16.262 INFO:tasks.workunit.client.1.smithi125.stdout:1/542: creat d1/d1a/fb4 x:0 0 0 2024-02-19T19:12:16.262 INFO:tasks.workunit.client.1.smithi125.stdout:5/691: mkdir db/d17/d85/dda 0 2024-02-19T19:12:16.262 INFO:tasks.workunit.client.1.smithi125.stdout:3/413: dread d0/d1/d1e/f68 [577536,20480] 0 2024-02-19T19:12:16.262 INFO:tasks.workunit.client.1.smithi125.stdout:1/543: rename d1/c2 to d1/d1a/d3d/d6e/d4b/cb5 0 2024-02-19T19:12:16.262 INFO:tasks.workunit.client.1.smithi125.stdout:3/414: chown d0/d1/l37 2133532429 1 2024-02-19T19:12:16.262 INFO:tasks.workunit.client.1.smithi125.stdout:3/415: link d0/de/f2b d0/d5f/d71/f7f 0 2024-02-19T19:12:16.262 INFO:tasks.workunit.client.1.smithi125.stdout:1/544: creat d1/d78/d8a/fb6 x:0 0 0 2024-02-19T19:12:16.262 INFO:tasks.workunit.client.1.smithi125.stdout:1/545: write d1/dc/fd [107887,19034] 0 2024-02-19T19:12:16.263 INFO:tasks.workunit.client.1.smithi125.stdout:3/416: creat d0/f80 x:0 0 0 2024-02-19T19:12:16.263 INFO:tasks.workunit.client.1.smithi125.stdout:1/546: rmdir d1/d26/d3c/d3f 39 2024-02-19T19:12:16.263 INFO:tasks.workunit.client.1.smithi125.stdout:1/547: dread d1/dc/f72 [593920,73728] 0 2024-02-19T19:12:16.263 INFO:tasks.workunit.client.1.smithi125.stdout:3/417: dread d0/d1/d1e/f5a [94208,77824] 0 2024-02-19T19:12:16.263 INFO:tasks.workunit.client.1.smithi125.stdout:1/548: write d1/d26/d23/f68 [394517,34541] 0 2024-02-19T19:12:16.263 INFO:tasks.workunit.client.1.smithi125.stdout:3/418: mkdir d0/d1/d4b/d52/d81 0 2024-02-19T19:12:16.263 INFO:tasks.workunit.client.1.smithi125.stdout:7/473: dwrite d12/d18/d44/d3b/d59/d26/d30/f35 [872448,122880] 0 2024-02-19T19:12:16.263 INFO:tasks.workunit.client.1.smithi125.stdout:7/474: creat d12/d18/d44/d3b/d59/d26/d30/d37/f8a x:0 0 0 2024-02-19T19:12:16.264 INFO:tasks.workunit.client.1.smithi125.stdout:7/475: mknod d12/d18/d44/c8b 0 2024-02-19T19:12:16.264 INFO:tasks.workunit.client.1.smithi125.stdout:2/395: dread d1/d27/d1d/f2b [1613824,61440] 0 2024-02-19T19:12:16.264 INFO:tasks.workunit.client.1.smithi125.stdout:2/396: link d1/d36/d70/d4b/c6f d1/d27/d1d/d25/c71 0 2024-02-19T19:12:16.264 INFO:tasks.workunit.client.1.smithi125.stdout:2/397: truncate d1/d27/f44 218548 0 2024-02-19T19:12:16.264 INFO:tasks.workunit.client.1.smithi125.stdout:2/398: rename d1/d27/d1d/d2c/l6a to d1/d36/d70/l72 0 2024-02-19T19:12:16.264 INFO:tasks.workunit.client.1.smithi125.stdout:2/399: link d1/d36/d70/d4b/c6f d1/d36/d70/c73 0 2024-02-19T19:12:16.264 INFO:tasks.workunit.client.1.smithi125.stdout:2/400: dread d1/d27/d1d/d25/d2a/f5f [229376,118784] 0 2024-02-19T19:12:16.264 INFO:tasks.workunit.client.1.smithi125.stdout:2/401: mknod d1/d36/d70/d4b/c74 0 2024-02-19T19:12:16.265 INFO:tasks.workunit.client.1.smithi125.stdout:0/405: dwrite d5/d33/d42/f61 [1331200,94208] 0 2024-02-19T19:12:16.265 INFO:tasks.workunit.client.1.smithi125.stdout:0/406: dread d5/d1a/f20 [1019904,4096] 0 2024-02-19T19:12:16.265 INFO:tasks.workunit.client.1.smithi125.stdout:0/407: dread d5/d15/f8a [73728,110592] 0 2024-02-19T19:12:16.265 INFO:tasks.workunit.client.1.smithi125.stdout:0/408: dread d5/d9/f1d [724992,24576] 0 2024-02-19T19:12:16.265 INFO:tasks.workunit.client.1.smithi125.stdout:0/409: read d5/d15/d2c/f43 [689194,30597] 0 2024-02-19T19:12:16.265 INFO:tasks.workunit.client.1.smithi125.stdout:0/410: rename d5/d19/l7c to d5/d15/d2c/d80/l93 0 2024-02-19T19:12:16.265 INFO:tasks.workunit.client.1.smithi125.stdout:0/411: link d5/d15/f89 d5/d1a/d4c/f94 0 2024-02-19T19:12:16.265 INFO:tasks.workunit.client.1.smithi125.stdout:0/412: mkdir d5/d1a/d95 0 2024-02-19T19:12:16.266 INFO:tasks.workunit.client.1.smithi125.stdout:0/413: symlink d5/d33/d42/l96 0 2024-02-19T19:12:16.266 INFO:tasks.workunit.client.1.smithi125.stdout:0/414: chown d5/d33/d42/d8f 0 1 2024-02-19T19:12:16.266 INFO:tasks.workunit.client.1.smithi125.stdout:0/415: rename d5/d19/f47 to d5/d33/f97 0 2024-02-19T19:12:16.266 INFO:tasks.workunit.client.1.smithi125.stdout:0/416: mknod d5/d15/d2c/d80/c98 0 2024-02-19T19:12:16.266 INFO:tasks.workunit.client.1.smithi125.stdout:0/417: symlink d5/d19/d48/l99 0 2024-02-19T19:12:16.266 INFO:tasks.workunit.client.1.smithi125.stdout:0/418: rename d5/d15/l5e to d5/d1a/l9a 0 2024-02-19T19:12:16.266 INFO:tasks.workunit.client.1.smithi125.stdout:0/419: write d5/d19/f44 [1269070,85420] 0 2024-02-19T19:12:16.266 INFO:tasks.workunit.client.1.smithi125.stdout:0/420: stat d5/f8 0 2024-02-19T19:12:16.266 INFO:tasks.workunit.client.1.smithi125.stdout:0/421: mkdir d5/d33/d9b 0 2024-02-19T19:12:16.267 INFO:tasks.workunit.client.1.smithi125.stdout:0/422: chown d5/f1f 517572 1 2024-02-19T19:12:16.303 INFO:tasks.workunit.client.1.smithi125.stdout:5/692: fsync db/f34 0 2024-02-19T19:12:16.304 INFO:tasks.workunit.client.1.smithi125.stdout:1/549: fsync d1/f45 0 2024-02-19T19:12:16.304 INFO:tasks.workunit.client.1.smithi125.stdout:1/550: stat d1/d78/d80/l94 0 2024-02-19T19:12:16.305 INFO:tasks.workunit.client.1.smithi125.stdout:0/423: dwrite d5/d19/d2b/f7a [413696,65536] 0 2024-02-19T19:12:16.346 INFO:tasks.workunit.client.1.smithi125.stdout:7/476: fdatasync d12/f7e 0 2024-02-19T19:12:16.347 INFO:tasks.workunit.client.1.smithi125.stdout:1/551: fdatasync d1/dc/d36/fa5 0 2024-02-19T19:12:16.347 INFO:tasks.workunit.client.1.smithi125.stdout:2/402: fdatasync d1/f59 0 2024-02-19T19:12:16.347 INFO:tasks.workunit.client.1.smithi125.stdout:7/477: readlink l6 0 2024-02-19T19:12:16.347 INFO:tasks.workunit.client.1.smithi125.stdout:5/693: fsync db/d17/d58/d33/d64/f70 0 2024-02-19T19:12:16.347 INFO:tasks.workunit.client.1.smithi125.stdout:2/403: rmdir d1/d27/d45/d5d 0 2024-02-19T19:12:16.347 INFO:tasks.workunit.client.1.smithi125.stdout:2/404: chown d1/d27/d1d/d25/f2d 9 1 2024-02-19T19:12:16.347 INFO:tasks.workunit.client.1.smithi125.stdout:2/405: rename d1/d27/d45/f5c to d1/d36/d70/d4b/f75 0 2024-02-19T19:12:16.347 INFO:tasks.workunit.client.1.smithi125.stdout:7/478: mkdir d12/d18/d44/d3b/d59/d26/d54/d8c 0 2024-02-19T19:12:16.347 INFO:tasks.workunit.client.1.smithi125.stdout:2/406: unlink d1/d27/d1d/d16/l3e 0 2024-02-19T19:12:16.348 INFO:tasks.workunit.client.1.smithi125.stdout:7/479: chown d12/d18/d44/d3b/d59/d26/d30/c38 29892 1 2024-02-19T19:12:16.348 INFO:tasks.workunit.client.1.smithi125.stdout:2/407: dread d1/d27/d45/f56 [770048,94208] 0 2024-02-19T19:12:16.348 INFO:tasks.workunit.client.1.smithi125.stdout:7/480: unlink d12/d18/d44/d3b/d59/d26/d54/l65 0 2024-02-19T19:12:16.348 INFO:tasks.workunit.client.1.smithi125.stdout:2/408: write d1/f47 [1738415,11162] 0 2024-02-19T19:12:16.348 INFO:tasks.workunit.client.1.smithi125.stdout:0/424: dwrite d5/d15/f89 [1191936,36864] 0 2024-02-19T19:12:16.348 INFO:tasks.workunit.client.1.smithi125.stdout:0/425: truncate d5/d1a/f20 1906226 0 2024-02-19T19:12:16.352 INFO:tasks.workunit.client.1.smithi125.stdout:2/409: read d1/d27/d1d/f24 [1980161,12333] 0 2024-02-19T19:12:16.352 INFO:tasks.workunit.client.1.smithi125.stdout:0/426: creat d5/d15/d2c/f9c x:0 0 0 2024-02-19T19:12:16.352 INFO:tasks.workunit.client.1.smithi125.stdout:0/427: dread - d5/d19/d27/f8c zero size 2024-02-19T19:12:16.352 INFO:tasks.workunit.client.1.smithi125.stdout:1/552: unlink d1/d26/d3c/f9d 0 2024-02-19T19:12:16.352 INFO:tasks.workunit.client.1.smithi125.stdout:0/428: mknod d5/d33/d42/c9d 0 2024-02-19T19:12:16.352 INFO:tasks.workunit.client.1.smithi125.stdout:1/553: dread - d1/d26/d3c/d3f/fa9 zero size 2024-02-19T19:12:16.352 INFO:tasks.workunit.client.1.smithi125.stdout:2/410: creat d1/d36/d70/f76 x:0 0 0 2024-02-19T19:12:16.353 INFO:tasks.workunit.client.1.smithi125.stdout:0/429: rename d5/d1a/l9a to d5/d19/d27/l9e 0 2024-02-19T19:12:16.353 INFO:tasks.workunit.client.1.smithi125.stdout:1/554: link d1/d1a/d3d/d6e/d4b/fa6 d1/d1a/d3d/d6e/d87/fb7 0 2024-02-19T19:12:16.353 INFO:tasks.workunit.client.1.smithi125.stdout:0/430: creat d5/d33/f9f x:0 0 0 2024-02-19T19:12:16.353 INFO:tasks.workunit.client.1.smithi125.stdout:1/555: truncate d1/dc/d36/d69/f81 422057 0 2024-02-19T19:12:16.353 INFO:tasks.workunit.client.1.smithi125.stdout:0/431: chown d5/d15/f82 63590 1 2024-02-19T19:12:16.353 INFO:tasks.workunit.client.1.smithi125.stdout:0/432: dread d5/d1a/d4c/f94 [1024000,90112] 0 2024-02-19T19:12:16.353 INFO:tasks.workunit.client.1.smithi125.stdout:0/433: write d5/d33/d42/f65 [1036547,38133] 0 2024-02-19T19:12:16.353 INFO:tasks.workunit.client.1.smithi125.stdout:7/481: dwrite d12/d18/d44/d3b/d59/d2a/d31/d50/f89 [790528,20480] 0 2024-02-19T19:12:16.353 INFO:tasks.workunit.client.1.smithi125.stdout:0/434: dread d5/d19/d27/d32/f8d [245760,118784] 0 2024-02-19T19:12:16.353 INFO:tasks.workunit.client.1.smithi125.stdout:5/694: dwrite db/d17/f57 [217088,65536] 0 2024-02-19T19:12:16.449 INFO:tasks.workunit.client.1.smithi125.stdout:2/411: fsync d1/ff 0 2024-02-19T19:12:16.449 INFO:tasks.workunit.client.1.smithi125.stdout:2/412: dread - d1/d27/d1d/d25/f6e zero size 2024-02-19T19:12:16.455 INFO:tasks.workunit.client.1.smithi125.stdout:0/435: mkdir d5/d9/da0 0 2024-02-19T19:12:16.455 INFO:tasks.workunit.client.1.smithi125.stdout:5/695: symlink db/d17/d58/d33/d91/ldb 0 2024-02-19T19:12:16.455 INFO:tasks.workunit.client.1.smithi125.stdout:7/482: symlink d12/d18/d44/d3b/d59/d2a/d6a/d6d/l8d 0 2024-02-19T19:12:16.455 INFO:tasks.workunit.client.1.smithi125.stdout:5/696: stat db/d17/d58/d33/d98/fb8 0 2024-02-19T19:12:16.455 INFO:tasks.workunit.client.1.smithi125.stdout:5/697: stat db/d17/d58/ff 0 2024-02-19T19:12:16.455 INFO:tasks.workunit.client.1.smithi125.stdout:7/483: chown d12/d18/d2c/f2d 1024790526 1 2024-02-19T19:12:16.455 INFO:tasks.workunit.client.1.smithi125.stdout:0/436: creat d5/d1a/d4c/fa1 x:0 0 0 2024-02-19T19:12:16.457 INFO:tasks.workunit.client.1.smithi125.stdout:1/556: dread d1/d26/d3c/d3f/f8d [28672,98304] 0 2024-02-19T19:12:16.457 INFO:tasks.workunit.client.1.smithi125.stdout:1/557: dread - d1/d78/d8a/fb6 zero size 2024-02-19T19:12:16.457 INFO:tasks.workunit.client.1.smithi125.stdout:1/558: rename d1/dc/cb2 to d1/d1a/cb8 0 2024-02-19T19:12:16.458 INFO:tasks.workunit.client.1.smithi125.stdout:1/559: read d1/d1a/f2e [96691,76275] 0 2024-02-19T19:12:16.488 INFO:tasks.workunit.client.1.smithi125.stdout:7/484: dwrite d12/d18/d44/d3b/d59/d26/f2f [954368,45056] 0 2024-02-19T19:12:16.488 INFO:tasks.workunit.client.1.smithi125.stdout:7/485: truncate d12/d18/d2c/f76 1275609 0 2024-02-19T19:12:16.488 INFO:tasks.workunit.client.1.smithi125.stdout:7/486: truncate d12/d18/d44/d3b/d59/d26/f87 469795 0 2024-02-19T19:12:16.488 INFO:tasks.workunit.client.1.smithi125.stdout:7/487: truncate d12/d18/d2c/f76 397024 0 2024-02-19T19:12:16.488 INFO:tasks.workunit.client.1.smithi125.stdout:2/413: dwrite d1/f59 [1601536,118784] 0 2024-02-19T19:12:16.489 INFO:tasks.workunit.client.1.smithi125.stdout:2/414: truncate d1/d27/d1d/d25/d2a/f41 474288 0 2024-02-19T19:12:16.489 INFO:tasks.workunit.client.1.smithi125.stdout:2/415: dread d1/d36/d70/d4b/f75 [471040,4096] 0 2024-02-19T19:12:16.489 INFO:tasks.workunit.client.1.smithi125.stdout:2/416: write d1/d36/d70/f66 [506684,51206] 0 2024-02-19T19:12:16.489 INFO:tasks.workunit.client.1.smithi125.stdout:2/417: link d1/d36/f67 d1/d27/d1d/f77 0 2024-02-19T19:12:16.489 INFO:tasks.workunit.client.1.smithi125.stdout:2/418: write d1/d27/d1d/d2c/d2e/f65 [1417269,126504] 0 2024-02-19T19:12:16.489 INFO:tasks.workunit.client.1.smithi125.stdout:2/419: creat d1/d27/d1d/d16/f78 x:0 0 0 2024-02-19T19:12:16.489 INFO:tasks.workunit.client.1.smithi125.stdout:0/437: dwrite d5/d33/d42/f88 [667648,98304] 0 2024-02-19T19:12:16.489 INFO:tasks.workunit.client.1.smithi125.stdout:0/438: readlink d5/l35 0 2024-02-19T19:12:16.489 INFO:tasks.workunit.client.1.smithi125.stdout:0/439: chown d5/d9/l29 81 1 2024-02-19T19:12:16.490 INFO:tasks.workunit.client.1.smithi125.stdout:0/440: write d5/d15/f89 [979356,117189] 0 2024-02-19T19:12:16.490 INFO:tasks.workunit.client.1.smithi125.stdout:0/441: chown d5/d33/d42/f61 898005608 1 2024-02-19T19:12:16.517 INFO:tasks.workunit.client.1.smithi125.stdout:4/454: sync 2024-02-19T19:12:16.517 INFO:tasks.workunit.client.1.smithi125.stdout:4/455: chown d0/d32/c5a 8 1 2024-02-19T19:12:16.517 INFO:tasks.workunit.client.1.smithi125.stdout:7/488: dwrite d12/d3d/f69 [258048,28672] 0 2024-02-19T19:12:16.518 INFO:tasks.workunit.client.1.smithi125.stdout:4/456: write d0/d7/d30/d58/f69 [246714,52368] 0 2024-02-19T19:12:16.518 INFO:tasks.workunit.client.1.smithi125.stdout:7/489: chown d12/d18/d44/f40 300 1 2024-02-19T19:12:16.518 INFO:tasks.workunit.client.1.smithi125.stdout:7/490: truncate d12/f45 193879 0 2024-02-19T19:12:16.518 INFO:tasks.workunit.client.1.smithi125.stdout:4/457: truncate d0/d7/d3b/f3d 1548825 0 2024-02-19T19:12:16.518 INFO:tasks.workunit.client.1.smithi125.stdout:7/491: truncate d12/d18/d2c/f2d 220864 0 2024-02-19T19:12:16.550 INFO:tasks.workunit.client.1.smithi125.stdout:1/560: fdatasync d1/d26/d23/f68 0 2024-02-19T19:12:16.551 INFO:tasks.workunit.client.1.smithi125.stdout:5/698: fdatasync db/d47/d52/f5a 0 2024-02-19T19:12:16.555 INFO:tasks.workunit.client.1.smithi125.stdout:7/492: dread d12/d18/d44/d3b/d59/d26/d30/d37/f3f [798720,61440] 0 2024-02-19T19:12:16.555 INFO:tasks.workunit.client.1.smithi125.stdout:4/458: symlink d0/df/l9d 0 2024-02-19T19:12:16.555 INFO:tasks.workunit.client.1.smithi125.stdout:7/493: chown d12/d18/d44/d51 8 1 2024-02-19T19:12:16.556 INFO:tasks.workunit.client.1.smithi125.stdout:0/442: dwrite d5/d1a/d4c/f94 [802816,4096] 0 2024-02-19T19:12:16.556 INFO:tasks.workunit.client.1.smithi125.stdout:2/420: dwrite d1/d27/d1d/d25/d2a/f34 [1118208,126976] 0 2024-02-19T19:12:16.556 INFO:tasks.workunit.client.1.smithi125.stdout:4/459: creat d0/d7/d85/f9e x:0 0 0 2024-02-19T19:12:16.556 INFO:tasks.workunit.client.1.smithi125.stdout:4/460: creat d0/df/f9f x:0 0 0 2024-02-19T19:12:16.556 INFO:tasks.workunit.client.1.smithi125.stdout:4/461: creat d0/d7/d85/fa0 x:0 0 0 2024-02-19T19:12:16.556 INFO:tasks.workunit.client.1.smithi125.stdout:0/443: write d5/d19/f44 [1279480,39400] 0 2024-02-19T19:12:16.556 INFO:tasks.workunit.client.1.smithi125.stdout:0/444: chown d5/d19/d27/l5a 523261900 1 2024-02-19T19:12:16.556 INFO:tasks.workunit.client.1.smithi125.stdout:0/445: dread d5/d9/f26 [446464,12288] 0 2024-02-19T19:12:16.557 INFO:tasks.workunit.client.1.smithi125.stdout:0/446: chown d5/d1a 0 1 2024-02-19T19:12:16.617 INFO:tasks.workunit.client.1.smithi125.stdout:5/699: fsync db/d17/d58/f1f 0 2024-02-19T19:12:16.617 INFO:tasks.workunit.client.1.smithi125.stdout:1/561: fsync d1/d78/d80/fb1 0 2024-02-19T19:12:16.617 INFO:tasks.workunit.client.1.smithi125.stdout:1/562: write d1/dc/f72 [1439713,70799] 0 2024-02-19T19:12:16.617 INFO:tasks.workunit.client.1.smithi125.stdout:1/563: link d1/f70 d1/d1a/d3d/fb9 0 2024-02-19T19:12:16.622 INFO:tasks.workunit.client.1.smithi125.stdout:5/700: mkdir db/d17/d58/d33/d98/d9c/ddc 0 2024-02-19T19:12:16.622 INFO:tasks.workunit.client.1.smithi125.stdout:0/447: creat d5/d19/d27/fa2 x:0 0 0 2024-02-19T19:12:16.622 INFO:tasks.workunit.client.1.smithi125.stdout:0/448: dread - d5/d33/d46/f4b zero size 2024-02-19T19:12:16.622 INFO:tasks.workunit.client.1.smithi125.stdout:0/449: chown d5/c40 129795594 1 2024-02-19T19:12:16.623 INFO:tasks.workunit.client.1.smithi125.stdout:5/701: creat db/d17/fdd x:0 0 0 2024-02-19T19:12:16.623 INFO:tasks.workunit.client.1.smithi125.stdout:5/702: chown db/d17/d58/d33/d91/dbe/fa0 5 1 2024-02-19T19:12:16.623 INFO:tasks.workunit.client.1.smithi125.stdout:0/450: link d5/d19/c56 d5/d15/ca3 0 2024-02-19T19:12:16.623 INFO:tasks.workunit.client.1.smithi125.stdout:4/462: creat d0/d32/fa1 x:0 0 0 2024-02-19T19:12:16.623 INFO:tasks.workunit.client.1.smithi125.stdout:5/703: truncate db/d17/d58/f72 1826650 0 2024-02-19T19:12:16.623 INFO:tasks.workunit.client.1.smithi125.stdout:5/704: stat db/d17/d85/fb4 0 2024-02-19T19:12:16.623 INFO:tasks.workunit.client.1.smithi125.stdout:5/705: dread - db/d17/d58/d33/d98/d9c/fb0 zero size 2024-02-19T19:12:16.623 INFO:tasks.workunit.client.1.smithi125.stdout:0/451: creat d5/d33/d42/fa4 x:0 0 0 2024-02-19T19:12:16.623 INFO:tasks.workunit.client.1.smithi125.stdout:4/463: write d0/d7/d30/d58/f9 [3350432,3664] 0 2024-02-19T19:12:16.624 INFO:tasks.workunit.client.1.smithi125.stdout:4/464: dread - d0/d7/d3b/f9c zero size 2024-02-19T19:12:16.624 INFO:tasks.workunit.client.1.smithi125.stdout:0/452: dread d5/d33/d42/f45 [245760,81920] 0 2024-02-19T19:12:16.624 INFO:tasks.workunit.client.1.smithi125.stdout:0/453: dread - d5/f6d zero size 2024-02-19T19:12:16.624 INFO:tasks.workunit.client.1.smithi125.stdout:4/465: getdents d0/d7/d30/d6c 0 2024-02-19T19:12:16.624 INFO:tasks.workunit.client.1.smithi125.stdout:0/454: mkdir d5/d33/d42/d92/da5 0 2024-02-19T19:12:16.624 INFO:tasks.workunit.client.1.smithi125.stdout:0/455: link d5/d19/d48/l76 d5/la6 0 2024-02-19T19:12:16.624 INFO:tasks.workunit.client.1.smithi125.stdout:4/466: write d0/d7/d85/f8f [697964,51992] 0 2024-02-19T19:12:16.624 INFO:tasks.workunit.client.1.smithi125.stdout:0/456: creat d5/d33/d42/fa7 x:0 0 0 2024-02-19T19:12:16.625 INFO:tasks.workunit.client.1.smithi125.stdout:0/457: creat d5/d9/fa8 x:0 0 0 2024-02-19T19:12:16.625 INFO:tasks.workunit.client.1.smithi125.stdout:0/458: creat d5/d19/d27/d32/d70/fa9 x:0 0 0 2024-02-19T19:12:16.625 INFO:tasks.workunit.client.1.smithi125.stdout:0/459: truncate d5/d33/d46/f4b 502025 0 2024-02-19T19:12:16.625 INFO:tasks.workunit.client.1.smithi125.stdout:0/460: truncate d5/d33/d42/f61 97164 0 2024-02-19T19:12:16.625 INFO:tasks.workunit.client.1.smithi125.stdout:0/461: link d5/d1a/f34 d5/faa 0 2024-02-19T19:12:16.625 INFO:tasks.workunit.client.1.smithi125.stdout:0/462: read - d5/d9/fa8 zero size 2024-02-19T19:12:16.625 INFO:tasks.workunit.client.1.smithi125.stdout:0/463: chown d5/d33/d42/f65 342659266 1 2024-02-19T19:12:16.625 INFO:tasks.workunit.client.1.smithi125.stdout:0/464: chown d5/d15/d2c/d80/c81 76316271 1 2024-02-19T19:12:16.625 INFO:tasks.workunit.client.1.smithi125.stdout:0/465: mknod d5/d19/d2b/cab 0 2024-02-19T19:12:16.626 INFO:tasks.workunit.client.1.smithi125.stdout:0/466: read d5/d33/d42/f65 [690610,44713] 0 2024-02-19T19:12:16.626 INFO:tasks.workunit.client.1.smithi125.stdout:0/467: symlink d5/d15/lac 0 2024-02-19T19:12:16.626 INFO:tasks.workunit.client.1.smithi125.stdout:2/421: dwrite d1/d27/d1d/d25/d2a/f5f [897024,16384] 0 2024-02-19T19:12:16.626 INFO:tasks.workunit.client.1.smithi125.stdout:2/422: creat d1/d36/d70/d4b/d64/f79 x:0 0 0 2024-02-19T19:12:16.626 INFO:tasks.workunit.client.1.smithi125.stdout:2/423: write d1/d36/d70/f49 [1511098,954] 0 2024-02-19T19:12:16.627 INFO:tasks.workunit.client.1.smithi125.stdout:1/564: dwrite d1/d78/f7f [1032192,53248] 0 2024-02-19T19:12:16.627 INFO:tasks.workunit.client.1.smithi125.stdout:1/565: mknod d1/d1a/d3d/d6e/d87/cba 0 2024-02-19T19:12:16.627 INFO:tasks.workunit.client.1.smithi125.stdout:1/566: creat d1/d1a/d3d/fbb x:0 0 0 2024-02-19T19:12:16.627 INFO:tasks.workunit.client.1.smithi125.stdout:0/468: dwrite d5/f6d [937984,16384] 0 2024-02-19T19:12:16.628 INFO:tasks.workunit.client.1.smithi125.stdout:0/469: write d5/f6d [294822,19124] 0 2024-02-19T19:12:16.628 INFO:tasks.workunit.client.1.smithi125.stdout:0/470: dread d5/d19/f44 [122880,98304] 0 2024-02-19T19:12:16.628 INFO:tasks.workunit.client.1.smithi125.stdout:0/471: write d5/d19/d27/d32/d70/fa9 [372418,122473] 0 2024-02-19T19:12:16.638 INFO:tasks.workunit.client.1.smithi125.stdout:5/706: dread db/d17/f41 [1179648,12288] 0 2024-02-19T19:12:16.638 INFO:tasks.workunit.client.1.smithi125.stdout:5/707: write db/d17/d58/d33/d98/d9c/fa4 [595594,24953] 0 2024-02-19T19:12:16.638 INFO:tasks.workunit.client.1.smithi125.stdout:5/708: read - db/d17/d58/d33/d53/dce/fd0 zero size 2024-02-19T19:12:16.638 INFO:tasks.workunit.client.1.smithi125.stdout:5/709: chown db/d26/d51/ca2 29308 1 2024-02-19T19:12:16.638 INFO:tasks.workunit.client.1.smithi125.stdout:5/710: creat db/d17/d85/fde x:0 0 0 2024-02-19T19:12:16.638 INFO:tasks.workunit.client.1.smithi125.stdout:5/711: chown db/d17/c49 53309208 1 2024-02-19T19:12:16.695 INFO:tasks.workunit.client.1.smithi125.stdout:2/424: mkdir d1/d27/d45/d7a 0 2024-02-19T19:12:16.695 INFO:tasks.workunit.client.1.smithi125.stdout:2/425: getdents d1/d27/d1d/d39 0 2024-02-19T19:12:16.695 INFO:tasks.workunit.client.1.smithi125.stdout:2/426: mkdir d1/d36/d70/d4b/d64/d7b 0 2024-02-19T19:12:16.695 INFO:tasks.workunit.client.1.smithi125.stdout:2/427: write d1/d36/f6d [61862,9669] 0 2024-02-19T19:12:16.695 INFO:tasks.workunit.client.1.smithi125.stdout:9/500: sync 2024-02-19T19:12:16.696 INFO:tasks.workunit.client.1.smithi125.stdout:6/463: sync 2024-02-19T19:12:16.696 INFO:tasks.workunit.client.1.smithi125.stdout:3/419: sync 2024-02-19T19:12:16.696 INFO:tasks.workunit.client.1.smithi125.stdout:8/410: sync 2024-02-19T19:12:16.696 INFO:tasks.workunit.client.1.smithi125.stdout:3/420: chown d0/d1/c46 6 1 2024-02-19T19:12:16.696 INFO:tasks.workunit.client.1.smithi125.stdout:6/464: getdents d6/db/d5d/d63 0 2024-02-19T19:12:16.696 INFO:tasks.workunit.client.1.smithi125.stdout:9/501: write d8/d15/d32/f2a [510987,33411] 0 2024-02-19T19:12:16.696 INFO:tasks.workunit.client.1.smithi125.stdout:8/411: creat db/d18/d30/f89 x:0 0 0 2024-02-19T19:12:16.696 INFO:tasks.workunit.client.1.smithi125.stdout:9/502: creat d8/fb4 x:0 0 0 2024-02-19T19:12:16.696 INFO:tasks.workunit.client.1.smithi125.stdout:8/412: creat db/d81/f8a x:0 0 0 2024-02-19T19:12:16.697 INFO:tasks.workunit.client.1.smithi125.stdout:9/503: write d8/d15/d22/f78 [623478,34211] 0 2024-02-19T19:12:16.697 INFO:tasks.workunit.client.1.smithi125.stdout:8/413: symlink db/d18/l8b 0 2024-02-19T19:12:16.697 INFO:tasks.workunit.client.1.smithi125.stdout:9/504: chown d8/d15/f86 9 1 2024-02-19T19:12:16.697 INFO:tasks.workunit.client.1.smithi125.stdout:9/505: rename d8/d2e/l4a to d8/d15/d32/d4f/lb5 0 2024-02-19T19:12:16.697 INFO:tasks.workunit.client.1.smithi125.stdout:8/414: rmdir db/d18/d30/d3c/d4d/d5d/d60 0 2024-02-19T19:12:16.697 INFO:tasks.workunit.client.1.smithi125.stdout:8/415: chown db/d18/d30/d48/f7a 526 1 2024-02-19T19:12:16.697 INFO:tasks.workunit.client.1.smithi125.stdout:9/506: write d8/d15/f70 [611473,40703] 0 2024-02-19T19:12:16.697 INFO:tasks.workunit.client.1.smithi125.stdout:9/507: creat d8/d15/d22/fb6 x:0 0 0 2024-02-19T19:12:16.697 INFO:tasks.workunit.client.1.smithi125.stdout:9/508: symlink d8/d15/da2/lb7 0 2024-02-19T19:12:16.698 INFO:tasks.workunit.client.1.smithi125.stdout:8/416: write f4 [1708752,103966] 0 2024-02-19T19:12:16.702 INFO:tasks.workunit.client.1.smithi125.stdout:1/567: dread d1/d1a/d3d/f61 [45056,28672] 0 2024-02-19T19:12:16.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:16 smithi125 ceph-mon[86115]: pgmap v153: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:12:16.723 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:16 smithi096 ceph-mon[112483]: pgmap v153: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:12:16.781 INFO:tasks.workunit.client.1.smithi125.stdout:0/472: fsync d5/d15/f82 0 2024-02-19T19:12:16.781 INFO:tasks.workunit.client.1.smithi125.stdout:0/473: mknod d5/d19/d6c/cad 0 2024-02-19T19:12:16.781 INFO:tasks.workunit.client.1.smithi125.stdout:0/474: symlink d5/d33/d42/d92/lae 0 2024-02-19T19:12:16.784 INFO:tasks.workunit.client.1.smithi125.stdout:6/465: dwrite d6/db/df/f14 [2555904,20480] 0 2024-02-19T19:12:16.784 INFO:tasks.workunit.client.1.smithi125.stdout:6/466: chown d6/db/df/f21 3127 1 2024-02-19T19:12:16.784 INFO:tasks.workunit.client.1.smithi125.stdout:9/509: dwrite d8/d2e/f4b [1277952,28672] 0 2024-02-19T19:12:16.784 INFO:tasks.workunit.client.1.smithi125.stdout:9/510: dread - d8/d2e/d4c/faa zero size 2024-02-19T19:12:16.784 INFO:tasks.workunit.client.1.smithi125.stdout:6/467: write d6/db/df/d3b/f5a [1594623,15464] 0 2024-02-19T19:12:16.784 INFO:tasks.workunit.client.1.smithi125.stdout:9/511: truncate d8/d15/d22/fa6 546509 0 2024-02-19T19:12:16.785 INFO:tasks.workunit.client.1.smithi125.stdout:9/512: rmdir d8/d15/d22 39 2024-02-19T19:12:16.785 INFO:tasks.workunit.client.1.smithi125.stdout:6/468: readlink d6/db/d49/l88 0 2024-02-19T19:12:16.785 INFO:tasks.workunit.client.1.smithi125.stdout:6/469: creat d6/db/d5d/d2f/d7b/d8d/f90 x:0 0 0 2024-02-19T19:12:16.785 INFO:tasks.workunit.client.1.smithi125.stdout:6/470: readlink d6/db/d5d/l39 0 2024-02-19T19:12:16.785 INFO:tasks.workunit.client.1.smithi125.stdout:6/471: creat d6/db/d5d/d29/f91 x:0 0 0 2024-02-19T19:12:16.785 INFO:tasks.workunit.client.1.smithi125.stdout:6/472: chown d6/db/d49/f59 471154 1 2024-02-19T19:12:16.785 INFO:tasks.workunit.client.1.smithi125.stdout:1/568: dwrite d1/d26/d3c/f46 [966656,32768] 0 2024-02-19T19:12:16.785 INFO:tasks.workunit.client.1.smithi125.stdout:6/473: truncate d6/db/d5d/d29/f2d 2584911 0 2024-02-19T19:12:16.786 INFO:tasks.workunit.client.1.smithi125.stdout:6/474: creat d6/db/d49/d4c/f92 x:0 0 0 2024-02-19T19:12:16.786 INFO:tasks.workunit.client.1.smithi125.stdout:6/475: mkdir d6/db/d5d/d93 0 2024-02-19T19:12:16.786 INFO:tasks.workunit.client.1.smithi125.stdout:1/569: creat d1/d26/d3c/fbc x:0 0 0 2024-02-19T19:12:16.786 INFO:tasks.workunit.client.1.smithi125.stdout:1/570: getdents d1/d78/d80 0 2024-02-19T19:12:16.786 INFO:tasks.workunit.client.1.smithi125.stdout:1/571: write d1/d26/f40 [1822922,100391] 0 2024-02-19T19:12:16.786 INFO:tasks.workunit.client.1.smithi125.stdout:1/572: creat d1/da3/fbd x:0 0 0 2024-02-19T19:12:16.786 INFO:tasks.workunit.client.1.smithi125.stdout:0/475: dwrite d5/ff [712704,114688] 0 2024-02-19T19:12:16.787 INFO:tasks.workunit.client.1.smithi125.stdout:0/476: symlink d5/d15/laf 0 2024-02-19T19:12:16.787 INFO:tasks.workunit.client.1.smithi125.stdout:6/476: dread d6/db/df/f21 [860160,69632] 0 2024-02-19T19:12:16.787 INFO:tasks.workunit.client.1.smithi125.stdout:6/477: link d6/db/d5d/d29/d68/l7d d6/db/d5d/d2f/d45/l94 0 2024-02-19T19:12:16.787 INFO:tasks.workunit.client.1.smithi125.stdout:6/478: rename d6/db/df/d16/f38 to d6/db/df/f95 0 2024-02-19T19:12:16.787 INFO:tasks.workunit.client.1.smithi125.stdout:6/479: chown d6/db/d5d/d29 72964 1 2024-02-19T19:12:16.864 INFO:tasks.workunit.client.1.smithi125.stdout:1/573: fsync d1/dc/d36/f77 0 2024-02-19T19:12:16.864 INFO:tasks.workunit.client.1.smithi125.stdout:1/574: chown d1/d1a/d3d/f61 4426 1 2024-02-19T19:12:16.865 INFO:tasks.workunit.client.1.smithi125.stdout:0/477: fdatasync d5/d33/d42/f88 0 2024-02-19T19:12:16.865 INFO:tasks.workunit.client.1.smithi125.stdout:1/575: mkdir d1/d1a/d3d/d6e/dbe 0 2024-02-19T19:12:16.865 INFO:tasks.workunit.client.1.smithi125.stdout:0/478: mknod d5/d15/cb0 0 2024-02-19T19:12:16.865 INFO:tasks.workunit.client.1.smithi125.stdout:0/479: mknod d5/d1a/cb1 0 2024-02-19T19:12:16.865 INFO:tasks.workunit.client.1.smithi125.stdout:1/576: symlink d1/dc/d36/d69/lbf 0 2024-02-19T19:12:16.865 INFO:tasks.workunit.client.1.smithi125.stdout:0/480: symlink d5/d19/d6c/lb2 0 2024-02-19T19:12:16.865 INFO:tasks.workunit.client.1.smithi125.stdout:1/577: mknod d1/d1a/d3d/d6e/d4b/cc0 0 2024-02-19T19:12:16.865 INFO:tasks.workunit.client.1.smithi125.stdout:0/481: write d5/d33/d42/f61 [146198,1796] 0 2024-02-19T19:12:16.866 INFO:tasks.workunit.client.1.smithi125.stdout:1/578: stat d1/dc/d36/d69 0 2024-02-19T19:12:16.866 INFO:tasks.workunit.client.1.smithi125.stdout:1/579: dread d1/f45 [913408,16384] 0 2024-02-19T19:12:16.866 INFO:tasks.workunit.client.1.smithi125.stdout:0/482: mkdir d5/d9/da0/db3 0 2024-02-19T19:12:16.866 INFO:tasks.workunit.client.1.smithi125.stdout:1/580: truncate d1/d1a/d3d/d6e/d4b/f6a 1622292 0 2024-02-19T19:12:16.866 INFO:tasks.workunit.client.1.smithi125.stdout:0/483: rmdir d5/d19/d48 39 2024-02-19T19:12:16.866 INFO:tasks.workunit.client.1.smithi125.stdout:1/581: mkdir d1/dc/d36/d69/dc1 0 2024-02-19T19:12:16.867 INFO:tasks.workunit.client.1.smithi125.stdout:6/480: dread d6/db/df/f54 [151552,98304] 0 2024-02-19T19:12:16.867 INFO:tasks.workunit.client.1.smithi125.stdout:6/481: creat d6/db/df/d16/d7e/f96 x:0 0 0 2024-02-19T19:12:16.867 INFO:tasks.workunit.client.1.smithi125.stdout:6/482: creat d6/db/d5d/d29/f97 x:0 0 0 2024-02-19T19:12:16.867 INFO:tasks.workunit.client.1.smithi125.stdout:6/483: write d6/db/d5d/d63/f62 [485400,69131] 0 2024-02-19T19:12:16.868 INFO:tasks.workunit.client.1.smithi125.stdout:0/484: dwrite d5/f71 [49152,49152] 0 2024-02-19T19:12:16.868 INFO:tasks.workunit.client.1.smithi125.stdout:0/485: creat d5/d9/d75/fb4 x:0 0 0 2024-02-19T19:12:16.869 INFO:tasks.workunit.client.1.smithi125.stdout:0/486: dread d5/d1a/d4c/f94 [819200,40960] 0 2024-02-19T19:12:16.869 INFO:tasks.workunit.client.1.smithi125.stdout:1/582: dwrite d1/d26/d23/f55 [2596864,40960] 0 2024-02-19T19:12:16.873 INFO:tasks.workunit.client.1.smithi125.stdout:6/484: dread d6/db/d49/d4c/f74 [823296,61440] 0 2024-02-19T19:12:16.873 INFO:tasks.workunit.client.1.smithi125.stdout:6/485: dread d6/f1e [425984,4096] 0 2024-02-19T19:12:16.873 INFO:tasks.workunit.client.1.smithi125.stdout:6/486: write d6/db/d5d/d29/f97 [11890,101604] 0 2024-02-19T19:12:16.874 INFO:tasks.workunit.client.1.smithi125.stdout:6/487: chown d6/db/f11 265344556 1 2024-02-19T19:12:16.874 INFO:tasks.workunit.client.1.smithi125.stdout:6/488: mkdir d6/db/d98 0 2024-02-19T19:12:16.948 INFO:tasks.workunit.client.1.smithi125.stdout:6/489: dwrite d6/db/d5d/f5f [614400,4096] 0 2024-02-19T19:12:16.948 INFO:tasks.workunit.client.1.smithi125.stdout:1/583: dwrite d1/f47 [1294336,28672] 0 2024-02-19T19:12:16.949 INFO:tasks.workunit.client.1.smithi125.stdout:6/490: rename d6/db/d5d/l39 to d6/db/d5d/d2f/d7b/d8d/l99 0 2024-02-19T19:12:16.949 INFO:tasks.workunit.client.1.smithi125.stdout:1/584: unlink d1/d78/d80/l3e 0 2024-02-19T19:12:16.949 INFO:tasks.workunit.client.1.smithi125.stdout:6/491: link d6/db/df/d16/l61 d6/db/df/d16/d7e/l9a 0 2024-02-19T19:12:16.949 INFO:tasks.workunit.client.1.smithi125.stdout:6/492: write d6/db/d5d/d2f/f86 [1195248,82414] 0 2024-02-19T19:12:16.949 INFO:tasks.workunit.client.1.smithi125.stdout:6/493: rmdir d6/db/df/d3b 39 2024-02-19T19:12:16.949 INFO:tasks.workunit.client.1.smithi125.stdout:6/494: getdents d6/db/df/d3b 0 2024-02-19T19:12:16.949 INFO:tasks.workunit.client.1.smithi125.stdout:6/495: mknod d6/db/d5d/d2f/c9b 0 2024-02-19T19:12:16.949 INFO:tasks.workunit.client.1.smithi125.stdout:6/496: creat d6/f9c x:0 0 0 2024-02-19T19:12:16.949 INFO:tasks.workunit.client.1.smithi125.stdout:6/497: creat d6/db/df/d3b/f9d x:0 0 0 2024-02-19T19:12:16.950 INFO:tasks.workunit.client.1.smithi125.stdout:1/585: dwrite d1/d78/d80/f35 [1777664,16384] 0 2024-02-19T19:12:17.051 INFO:tasks.workunit.client.1.smithi125.stdout:6/498: fdatasync d6/db/d5d/d63/f75 0 2024-02-19T19:12:17.051 INFO:tasks.workunit.client.1.smithi125.stdout:6/499: mknod d6/db/df/d3b/c9e 0 2024-02-19T19:12:17.051 INFO:tasks.workunit.client.1.smithi125.stdout:6/500: symlink d6/db/d5d/d29/d68/l9f 0 2024-02-19T19:12:17.051 INFO:tasks.workunit.client.1.smithi125.stdout:6/501: symlink d6/db/d49/d4c/la0 0 2024-02-19T19:12:17.053 INFO:tasks.workunit.client.1.smithi125.stdout:1/586: dwrite d1/f70 [614400,49152] 0 2024-02-19T19:12:17.054 INFO:tasks.workunit.client.1.smithi125.stdout:1/587: rename d1/d1a/d3d/c62 to d1/d78/d80/cc2 0 2024-02-19T19:12:17.054 INFO:tasks.workunit.client.1.smithi125.stdout:1/588: link d1/l59 d1/d78/lc3 0 2024-02-19T19:12:17.054 INFO:tasks.workunit.client.1.smithi125.stdout:1/589: write d1/d26/f40 [1301073,126087] 0 2024-02-19T19:12:17.054 INFO:tasks.workunit.client.1.smithi125.stdout:1/590: dread d1/dc/d36/f54 [753664,8192] 0 2024-02-19T19:12:17.054 INFO:tasks.workunit.client.1.smithi125.stdout:1/591: dread d1/dc/fd [1351680,90112] 0 2024-02-19T19:12:17.098 INFO:tasks.workunit.client.1.smithi125.stdout:6/502: fsync d6/db/df/f7c 0 2024-02-19T19:12:17.099 INFO:tasks.workunit.client.1.smithi125.stdout:7/494: sync 2024-02-19T19:12:17.100 INFO:tasks.workunit.client.1.smithi125.stdout:6/503: link d6/db/d5d/d2f/d45/f60 d6/db/d5d/d2f/d7b/d8d/fa1 0 2024-02-19T19:12:17.101 INFO:tasks.workunit.client.1.smithi125.stdout:1/592: dwrite d1/dc/f52 [1159168,73728] 0 2024-02-19T19:12:17.101 INFO:tasks.workunit.client.1.smithi125.stdout:6/504: chown d6/cc 17 1 2024-02-19T19:12:17.101 INFO:tasks.workunit.client.1.smithi125.stdout:6/505: mkdir d6/db/d5d/d93/da2 0 2024-02-19T19:12:17.101 INFO:tasks.workunit.client.1.smithi125.stdout:6/506: rename d6/db/d5d/d29 to d6/db/d5d/d29/da3 22 2024-02-19T19:12:17.101 INFO:tasks.workunit.client.1.smithi125.stdout:7/495: write d12/d18/f3c [1602523,100046] 0 2024-02-19T19:12:17.103 INFO:tasks.workunit.client.1.smithi125.stdout:7/496: mknod d12/d18/d44/d3b/d59/d2a/d31/d50/c8e 0 2024-02-19T19:12:17.103 INFO:tasks.workunit.client.1.smithi125.stdout:7/497: creat d12/d18/d2c/d4e/d82/f8f x:0 0 0 2024-02-19T19:12:17.104 INFO:tasks.workunit.client.1.smithi125.stdout:6/507: mknod d6/db/df/d16/ca4 0 2024-02-19T19:12:17.104 INFO:tasks.workunit.client.1.smithi125.stdout:6/508: chown d6/db/df/d16/l26 49 1 2024-02-19T19:12:17.104 INFO:tasks.workunit.client.1.smithi125.stdout:6/509: dread d6/db/df/d16/f2b [139264,61440] 0 2024-02-19T19:12:17.105 INFO:tasks.workunit.client.1.smithi125.stdout:7/498: write d12/d18/d44/d3b/d59/d26/f2f [61581,94592] 0 2024-02-19T19:12:17.105 INFO:tasks.workunit.client.1.smithi125.stdout:1/593: dwrite d1/d26/d23/f6d [897024,126976] 0 2024-02-19T19:12:17.105 INFO:tasks.workunit.client.1.smithi125.stdout:1/594: creat d1/d1a/fc4 x:0 0 0 2024-02-19T19:12:17.105 INFO:tasks.workunit.client.1.smithi125.stdout:1/595: write d1/d1a/fc4 [956959,86520] 0 2024-02-19T19:12:17.181 INFO:tasks.workunit.client.1.smithi125.stdout:6/510: dwrite d6/db/df/f12 [2797568,122880] 0 2024-02-19T19:12:17.181 INFO:tasks.workunit.client.1.smithi125.stdout:6/511: dread d6/db/d5d/d29/f2d [1810432,16384] 0 2024-02-19T19:12:17.181 INFO:tasks.workunit.client.1.smithi125.stdout:6/512: truncate d6/db/d5d/d2f/f48 930715 0 2024-02-19T19:12:17.182 INFO:tasks.workunit.client.1.smithi125.stdout:6/513: rmdir d6/db/df/d16/d7e 39 2024-02-19T19:12:17.182 INFO:tasks.workunit.client.1.smithi125.stdout:6/514: rename d6/db/d5d/f2e to d6/db/d49/fa5 0 2024-02-19T19:12:17.182 INFO:tasks.workunit.client.1.smithi125.stdout:6/515: truncate d6/db/d5d/d63/f62 955434 0 2024-02-19T19:12:17.182 INFO:tasks.workunit.client.1.smithi125.stdout:6/516: symlink d6/db/d5d/d2f/la6 0 2024-02-19T19:12:17.182 INFO:tasks.workunit.client.1.smithi125.stdout:6/517: chown d6/db/df/d16/l1c 553 1 2024-02-19T19:12:17.183 INFO:tasks.workunit.client.1.smithi125.stdout:6/518: mkdir d6/db/da7 0 2024-02-19T19:12:17.183 INFO:tasks.workunit.client.1.smithi125.stdout:6/519: write d6/db/d5d/d29/d68/f71 [139380,60828] 0 2024-02-19T19:12:17.184 INFO:tasks.workunit.client.1.smithi125.stdout:6/520: rmdir d6/db/df/d3b 39 2024-02-19T19:12:17.184 INFO:tasks.workunit.client.1.smithi125.stdout:1/596: creat d1/da3/fc5 x:0 0 0 2024-02-19T19:12:17.224 INFO:tasks.workunit.client.1.smithi125.stdout:7/499: fsync d12/d18/d2c/f2d 0 2024-02-19T19:12:17.224 INFO:tasks.workunit.client.1.smithi125.stdout:7/500: symlink d12/d3d/l90 0 2024-02-19T19:12:17.224 INFO:tasks.workunit.client.1.smithi125.stdout:7/501: readlink d12/d3d/l90 0 2024-02-19T19:12:17.224 INFO:tasks.workunit.client.1.smithi125.stdout:7/502: mknod d12/d18/d44/d3b/d59/d2a/d31/d50/c91 0 2024-02-19T19:12:17.225 INFO:tasks.workunit.client.1.smithi125.stdout:6/521: dwrite d6/db/d5d/d29/f97 [888832,118784] 0 2024-02-19T19:12:17.225 INFO:tasks.workunit.client.1.smithi125.stdout:6/522: write d6/db/d49/d4c/f92 [769751,91072] 0 2024-02-19T19:12:17.226 INFO:tasks.workunit.client.1.smithi125.stdout:1/597: dwrite d1/da3/fbd [565248,106496] 0 2024-02-19T19:12:17.236 INFO:tasks.workunit.client.1.smithi125.stdout:2/428: sync 2024-02-19T19:12:17.237 INFO:tasks.workunit.client.1.smithi125.stdout:5/712: sync 2024-02-19T19:12:17.237 INFO:tasks.workunit.client.1.smithi125.stdout:3/421: sync 2024-02-19T19:12:17.237 INFO:tasks.workunit.client.1.smithi125.stdout:8/417: sync 2024-02-19T19:12:17.237 INFO:tasks.workunit.client.1.smithi125.stdout:0/487: sync 2024-02-19T19:12:17.237 INFO:tasks.workunit.client.1.smithi125.stdout:4/467: sync 2024-02-19T19:12:17.237 INFO:tasks.workunit.client.1.smithi125.stdout:5/713: chown db/d26/d51/l74 3 1 2024-02-19T19:12:17.237 INFO:tasks.workunit.client.1.smithi125.stdout:5/714: dread - db/d17/d58/d4f/f9f zero size 2024-02-19T19:12:17.237 INFO:tasks.workunit.client.1.smithi125.stdout:9/513: sync 2024-02-19T19:12:17.237 INFO:tasks.workunit.client.1.smithi125.stdout:9/514: stat d8/d2e/c62 0 2024-02-19T19:12:17.238 INFO:tasks.workunit.client.1.smithi125.stdout:9/515: read d8/d15/d22/fa6 [465770,6337] 0 2024-02-19T19:12:17.239 INFO:tasks.workunit.client.1.smithi125.stdout:4/468: rename d0/d7/d30/d58/c96 to d0/d7/d3b/ca2 0 2024-02-19T19:12:17.239 INFO:tasks.workunit.client.1.smithi125.stdout:6/523: dwrite d6/db/df/f95 [2547712,65536] 0 2024-02-19T19:12:17.239 INFO:tasks.workunit.client.1.smithi125.stdout:0/488: creat d5/d9/d75/fb5 x:0 0 0 2024-02-19T19:12:17.239 INFO:tasks.workunit.client.1.smithi125.stdout:1/598: dwrite d1/dc/d36/d39/f3a [1650688,90112] 0 2024-02-19T19:12:17.239 INFO:tasks.workunit.client.1.smithi125.stdout:0/489: readlink d5/d19/d48/l99 0 2024-02-19T19:12:17.240 INFO:tasks.workunit.client.1.smithi125.stdout:3/422: unlink d0/d1/f31 0 2024-02-19T19:12:17.240 INFO:tasks.workunit.client.1.smithi125.stdout:9/516: truncate d8/d15/d32/d4f/d6e/f8d 826767 0 2024-02-19T19:12:17.240 INFO:tasks.workunit.client.1.smithi125.stdout:9/517: truncate d8/d15/d22/d4e/f55 1023177 0 2024-02-19T19:12:17.240 INFO:tasks.workunit.client.1.smithi125.stdout:9/518: chown d8/d15/c36 42696524 1 2024-02-19T19:12:17.240 INFO:tasks.workunit.client.1.smithi125.stdout:0/490: symlink d5/d19/d6c/lb6 0 2024-02-19T19:12:17.240 INFO:tasks.workunit.client.1.smithi125.stdout:0/491: rmdir d5 39 2024-02-19T19:12:17.240 INFO:tasks.workunit.client.1.smithi125.stdout:6/524: write d6/db/df/d16/d7e/f96 [826070,77357] 0 2024-02-19T19:12:17.240 INFO:tasks.workunit.client.1.smithi125.stdout:1/599: creat d1/dc/d36/d69/fc6 x:0 0 0 2024-02-19T19:12:17.241 INFO:tasks.workunit.client.1.smithi125.stdout:9/519: creat d8/d15/d9d/fb8 x:0 0 0 2024-02-19T19:12:17.241 INFO:tasks.workunit.client.1.smithi125.stdout:0/492: unlink d5/d19/d48/c60 0 2024-02-19T19:12:17.241 INFO:tasks.workunit.client.1.smithi125.stdout:9/520: dread - d8/d15/d22/d44/f92 zero size 2024-02-19T19:12:17.241 INFO:tasks.workunit.client.1.smithi125.stdout:6/525: mknod d6/db/d5d/d2f/ca8 0 2024-02-19T19:12:17.241 INFO:tasks.workunit.client.1.smithi125.stdout:9/521: dread - d8/d15/d32/d4f/d6e/fa3 zero size 2024-02-19T19:12:17.241 INFO:tasks.workunit.client.1.smithi125.stdout:1/600: mkdir d1/dc/d36/d69/dc7 0 2024-02-19T19:12:17.241 INFO:tasks.workunit.client.1.smithi125.stdout:1/601: getdents d1/d26/d3c 0 2024-02-19T19:12:17.241 INFO:tasks.workunit.client.1.smithi125.stdout:9/522: creat d8/d2e/fb9 x:0 0 0 2024-02-19T19:12:17.241 INFO:tasks.workunit.client.1.smithi125.stdout:1/602: creat d1/d26/d23/fc8 x:0 0 0 2024-02-19T19:12:17.242 INFO:tasks.workunit.client.1.smithi125.stdout:1/603: chown d1/dc/d36/d69/laf 152 1 2024-02-19T19:12:17.242 INFO:tasks.workunit.client.1.smithi125.stdout:0/493: write d5/f71 [237689,82217] 0 2024-02-19T19:12:17.242 INFO:tasks.workunit.client.1.smithi125.stdout:1/604: read d1/dc/d36/d39/fa1 [62786,36374] 0 2024-02-19T19:12:17.242 INFO:tasks.workunit.client.1.smithi125.stdout:0/494: dread d5/d19/d27/d32/d70/fa9 [65536,12288] 0 2024-02-19T19:12:17.242 INFO:tasks.workunit.client.1.smithi125.stdout:0/495: dread - d5/d15/d2c/d80/f63 zero size 2024-02-19T19:12:17.244 INFO:tasks.workunit.client.1.smithi125.stdout:5/715: dwrite db/d17/d58/f3a [1904640,81920] 0 2024-02-19T19:12:17.244 INFO:tasks.workunit.client.1.smithi125.stdout:5/716: link db/d26/d51/fcb db/d17/d58/d33/d53/dd5/fdf 0 2024-02-19T19:12:17.244 INFO:tasks.workunit.client.1.smithi125.stdout:5/717: write db/d17/d85/fb4 [191131,38678] 0 2024-02-19T19:12:17.244 INFO:tasks.workunit.client.1.smithi125.stdout:5/718: truncate db/d17/d58/d33/fc9 2424596 0 2024-02-19T19:12:17.244 INFO:tasks.workunit.client.1.smithi125.stdout:5/719: chown db/d17/d58/d33/d64/c8b 21994 1 2024-02-19T19:12:17.244 INFO:tasks.workunit.client.1.smithi125.stdout:5/720: rmdir db 39 2024-02-19T19:12:17.244 INFO:tasks.workunit.client.1.smithi125.stdout:5/721: rename db/d17/f20 to db/d17/d58/d4f/fe0 0 2024-02-19T19:12:17.245 INFO:tasks.workunit.client.1.smithi125.stdout:5/722: truncate db/d17/d58/d33/f80 672842 0 2024-02-19T19:12:17.245 INFO:tasks.workunit.client.1.smithi125.stdout:5/723: write db/d17/d58/d25/fd1 [307394,23052] 0 2024-02-19T19:12:17.245 INFO:tasks.workunit.client.1.smithi125.stdout:5/724: creat db/d17/d85/fe1 x:0 0 0 2024-02-19T19:12:17.245 INFO:tasks.workunit.client.1.smithi125.stdout:5/725: write db/d47/d52/f4e [1047444,66544] 0 2024-02-19T19:12:17.245 INFO:tasks.workunit.client.1.smithi125.stdout:5/726: symlink db/d17/d58/d33/d53/dd5/le2 0 2024-02-19T19:12:17.245 INFO:tasks.workunit.client.1.smithi125.stdout:5/727: stat db/d17/d58/d4f/f7a 0 2024-02-19T19:12:17.245 INFO:tasks.workunit.client.1.smithi125.stdout:5/728: symlink db/le3 0 2024-02-19T19:12:17.383 INFO:tasks.workunit.client.1.smithi125.stdout:3/423: fdatasync d0/d1/d39/f5b 0 2024-02-19T19:12:17.383 INFO:tasks.workunit.client.1.smithi125.stdout:3/424: getdents d0/d1/d1e/d60/d73 0 2024-02-19T19:12:17.388 INFO:tasks.workunit.client.1.smithi125.stdout:8/418: dwrite db/d18/d30/d48/f5c [208896,98304] 0 2024-02-19T19:12:17.389 INFO:tasks.workunit.client.1.smithi125.stdout:8/419: mknod db/d18/d30/d3c/d88/c8c 0 2024-02-19T19:12:17.389 INFO:tasks.workunit.client.1.smithi125.stdout:8/420: creat db/d18/d2f/d72/f8d x:0 0 0 2024-02-19T19:12:17.389 INFO:tasks.workunit.client.1.smithi125.stdout:9/523: dwrite d8/d15/d22/d44/fb0 [413696,61440] 0 2024-02-19T19:12:17.389 INFO:tasks.workunit.client.1.smithi125.stdout:9/524: dread d8/d15/d32/d4f/f59 [618496,57344] 0 2024-02-19T19:12:17.389 INFO:tasks.workunit.client.1.smithi125.stdout:0/496: dwrite d5/d19/f62 [577536,16384] 0 2024-02-19T19:12:17.389 INFO:tasks.workunit.client.1.smithi125.stdout:0/497: dread d5/f8 [745472,4096] 0 2024-02-19T19:12:17.389 INFO:tasks.workunit.client.1.smithi125.stdout:9/525: dread d8/d15/d22/d4e/f83 [1318912,94208] 0 2024-02-19T19:12:17.389 INFO:tasks.workunit.client.1.smithi125.stdout:0/498: mkdir d5/d19/d2b/db7 0 2024-02-19T19:12:17.390 INFO:tasks.workunit.client.1.smithi125.stdout:9/526: dread d8/d15/d22/d44/f89 [532480,102400] 0 2024-02-19T19:12:17.390 INFO:tasks.workunit.client.1.smithi125.stdout:9/527: rmdir d8/d15/d32/d4f 39 2024-02-19T19:12:17.390 INFO:tasks.workunit.client.1.smithi125.stdout:0/499: write d5/d33/d42/f45 [930948,31601] 0 2024-02-19T19:12:17.390 INFO:tasks.workunit.client.1.smithi125.stdout:0/500: link d5/d19/d6c/lb2 d5/d19/d2b/db7/lb8 0 2024-02-19T19:12:17.390 INFO:tasks.workunit.client.1.smithi125.stdout:0/501: readlink d5/d19/l31 0 2024-02-19T19:12:17.390 INFO:tasks.workunit.client.1.smithi125.stdout:9/528: rename d8/d15/d22/d4e/cb2 to d8/d15/d32/cba 0 2024-02-19T19:12:17.390 INFO:tasks.workunit.client.1.smithi125.stdout:0/502: rmdir d5/d9/da0 39 2024-02-19T19:12:17.390 INFO:tasks.workunit.client.1.smithi125.stdout:9/529: readlink d8/d2e/l60 0 2024-02-19T19:12:17.391 INFO:tasks.workunit.client.1.smithi125.stdout:0/503: unlink d5/d19/d2b/f4e 0 2024-02-19T19:12:17.391 INFO:tasks.workunit.client.1.smithi125.stdout:0/504: unlink d5/d9/fa8 0 2024-02-19T19:12:17.391 INFO:tasks.workunit.client.1.smithi125.stdout:9/530: rename d8/d15/c52 to d8/d15/d22/d4e/cbb 0 2024-02-19T19:12:17.391 INFO:tasks.workunit.client.1.smithi125.stdout:0/505: chown d5/d33/d46/f66 589 1 2024-02-19T19:12:17.391 INFO:tasks.workunit.client.1.smithi125.stdout:0/506: unlink d5/f1f 0 2024-02-19T19:12:17.391 INFO:tasks.workunit.client.1.smithi125.stdout:0/507: stat d5/d15/l74 0 2024-02-19T19:12:17.391 INFO:tasks.workunit.client.1.smithi125.stdout:4/469: dwrite d0/df/f1c [1875968,94208] 0 2024-02-19T19:12:17.391 INFO:tasks.workunit.client.1.smithi125.stdout:0/508: readlink d5/d33/d42/l54 0 2024-02-19T19:12:17.391 INFO:tasks.workunit.client.1.smithi125.stdout:9/531: creat d8/d15/d22/fbc x:0 0 0 2024-02-19T19:12:17.392 INFO:tasks.workunit.client.1.smithi125.stdout:0/509: mknod d5/d19/d27/d32/d70/cb9 0 2024-02-19T19:12:17.392 INFO:tasks.workunit.client.1.smithi125.stdout:9/532: creat d8/d15/d32/d4f/d85/fbd x:0 0 0 2024-02-19T19:12:17.392 INFO:tasks.workunit.client.1.smithi125.stdout:0/510: creat d5/d1a/fba x:0 0 0 2024-02-19T19:12:17.392 INFO:tasks.workunit.client.1.smithi125.stdout:0/511: unlink d5/d33/f9f 0 2024-02-19T19:12:17.392 INFO:tasks.workunit.client.1.smithi125.stdout:0/512: chown d5/d19 1 1 2024-02-19T19:12:17.392 INFO:tasks.workunit.client.1.smithi125.stdout:0/513: rename d5/d33/d46/l4d to d5/d15/d2c/d80/lbb 0 2024-02-19T19:12:17.392 INFO:tasks.workunit.client.1.smithi125.stdout:0/514: write d5/d15/d2c/f77 [710906,56436] 0 2024-02-19T19:12:17.392 INFO:tasks.workunit.client.1.smithi125.stdout:0/515: chown d5/d19/d27/l9e 2824181 1 2024-02-19T19:12:17.392 INFO:tasks.workunit.client.1.smithi125.stdout:0/516: dread - d5/d19/d27/fa2 zero size 2024-02-19T19:12:17.393 INFO:tasks.workunit.client.1.smithi125.stdout:0/517: dread - d5/d9/d75/fb5 zero size 2024-02-19T19:12:17.401 INFO:tasks.workunit.client.1.smithi125.stdout:3/425: dread d0/f6d [614400,16384] 0 2024-02-19T19:12:17.404 INFO:tasks.workunit.client.1.smithi125.stdout:6/526: dread d6/db/df/d16/f5c [737280,57344] 0 2024-02-19T19:12:17.446 INFO:tasks.workunit.client.1.smithi125.stdout:1/605: fsync d1/d26/d23/f68 0 2024-02-19T19:12:17.447 INFO:tasks.workunit.client.1.smithi125.stdout:5/729: fdatasync db/d17/d58/d4f/faf 0 2024-02-19T19:12:17.447 INFO:tasks.workunit.client.1.smithi125.stdout:1/606: write d1/d26/d3c/f64 [296993,43094] 0 2024-02-19T19:12:17.450 INFO:tasks.workunit.client.1.smithi125.stdout:6/527: dwrite d6/db/f11 [73728,12288] 0 2024-02-19T19:12:17.455 INFO:tasks.workunit.client.1.smithi125.stdout:0/518: dwrite d5/d33/f7e [831488,4096] 0 2024-02-19T19:12:17.455 INFO:tasks.workunit.client.1.smithi125.stdout:0/519: chown d5/d9/da0/db3 9 1 2024-02-19T19:12:17.455 INFO:tasks.workunit.client.1.smithi125.stdout:1/607: creat d1/d1a/d3d/d6e/d4b/fc9 x:0 0 0 2024-02-19T19:12:17.455 INFO:tasks.workunit.client.1.smithi125.stdout:5/730: getdents db/d17/d58/d33/d98/d9c 0 2024-02-19T19:12:17.455 INFO:tasks.workunit.client.1.smithi125.stdout:6/528: creat d6/db/d5d/fa9 x:0 0 0 2024-02-19T19:12:17.455 INFO:tasks.workunit.client.1.smithi125.stdout:0/520: chown d5/d15/d2c/d80/lbb 360827 1 2024-02-19T19:12:17.455 INFO:tasks.workunit.client.1.smithi125.stdout:0/521: link d5/l13 d5/d1a/d95/lbc 0 2024-02-19T19:12:17.455 INFO:tasks.workunit.client.1.smithi125.stdout:1/608: read d1/dc/fd [2067878,7423] 0 2024-02-19T19:12:17.456 INFO:tasks.workunit.client.1.smithi125.stdout:8/421: dread db/d18/f21 [241664,49152] 0 2024-02-19T19:12:17.456 INFO:tasks.workunit.client.1.smithi125.stdout:6/529: mknod d6/db/df/caa 0 2024-02-19T19:12:17.456 INFO:tasks.workunit.client.1.smithi125.stdout:6/530: rmdir d6/db/d5d/d2f 39 2024-02-19T19:12:17.456 INFO:tasks.workunit.client.1.smithi125.stdout:6/531: stat d6/db/d5d/d63/f75 0 2024-02-19T19:12:17.456 INFO:tasks.workunit.client.1.smithi125.stdout:8/422: dread db/d18/d30/d3c/d4d/f56 [106496,73728] 0 2024-02-19T19:12:17.456 INFO:tasks.workunit.client.1.smithi125.stdout:6/532: mknod d6/db/d5d/d93/cab 0 2024-02-19T19:12:17.456 INFO:tasks.workunit.client.1.smithi125.stdout:8/423: truncate db/d18/d30/d3c/d4d/d5d/d6f/f77 173262 0 2024-02-19T19:12:17.456 INFO:tasks.workunit.client.1.smithi125.stdout:6/533: write d6/db/d5d/f5f [101476,37730] 0 2024-02-19T19:12:17.457 INFO:tasks.workunit.client.1.smithi125.stdout:6/534: creat d6/db/d98/fac x:0 0 0 2024-02-19T19:12:17.457 INFO:tasks.workunit.client.1.smithi125.stdout:0/522: dwrite d5/d9/f1d [958464,32768] 0 2024-02-19T19:12:17.457 INFO:tasks.workunit.client.1.smithi125.stdout:0/523: getdents d5/d33/d42/d92/da5 0 2024-02-19T19:12:17.459 INFO:tasks.workunit.client.1.smithi125.stdout:9/533: dread d8/d15/d32/f3f [1327104,106496] 0 2024-02-19T19:12:17.464 INFO:tasks.workunit.client.1.smithi125.stdout:1/609: dread d1/d26/f40 [73728,36864] 0 2024-02-19T19:12:17.464 INFO:tasks.workunit.client.1.smithi125.stdout:1/610: symlink d1/d1a/d3d/d6e/dbe/lca 0 2024-02-19T19:12:17.464 INFO:tasks.workunit.client.1.smithi125.stdout:1/611: mkdir d1/dcb 0 2024-02-19T19:12:17.465 INFO:tasks.workunit.client.1.smithi125.stdout:1/612: write d1/dc/d36/d69/fc6 [373861,5133] 0 2024-02-19T19:12:17.465 INFO:tasks.workunit.client.1.smithi125.stdout:1/613: stat d1/d1a/fc4 0 2024-02-19T19:12:17.465 INFO:tasks.workunit.client.1.smithi125.stdout:1/614: rmdir d1/d1a/d3d/d6e/d87 39 2024-02-19T19:12:17.465 INFO:tasks.workunit.client.1.smithi125.stdout:1/615: dread d1/dc/d36/f66 [487424,102400] 0 2024-02-19T19:12:17.465 INFO:tasks.workunit.client.1.smithi125.stdout:1/616: write f0 [4125042,6756] 0 2024-02-19T19:12:17.465 INFO:tasks.workunit.client.1.smithi125.stdout:1/617: write d1/dc/d36/d39/f5f [1060740,73550] 0 2024-02-19T19:12:17.532 INFO:tasks.workunit.client.1.smithi125.stdout:1/618: creat d1/d1a/fcc x:0 0 0 2024-02-19T19:12:17.532 INFO:tasks.workunit.client.1.smithi125.stdout:1/619: creat d1/d1a/d3d/d6e/d87/fcd x:0 0 0 2024-02-19T19:12:17.532 INFO:tasks.workunit.client.1.smithi125.stdout:1/620: write d1/d78/f7f [613063,31889] 0 2024-02-19T19:12:17.532 INFO:tasks.workunit.client.1.smithi125.stdout:1/621: read d1/d26/d3c/d3f/f48 [169179,57768] 0 2024-02-19T19:12:17.532 INFO:tasks.workunit.client.1.smithi125.stdout:6/535: symlink d6/db/d5d/d93/da2/lad 0 2024-02-19T19:12:17.533 INFO:tasks.workunit.client.1.smithi125.stdout:6/536: rename d6/db/d5d/d2f/d7b/d8d/f90 to d6/db/d5d/d93/fae 0 2024-02-19T19:12:17.533 INFO:tasks.workunit.client.1.smithi125.stdout:6/537: mkdir d6/db/df/d16/d7e/daf 0 2024-02-19T19:12:17.533 INFO:tasks.workunit.client.1.smithi125.stdout:9/534: dwrite d8/d15/f70 [274432,94208] 0 2024-02-19T19:12:17.533 INFO:tasks.workunit.client.1.smithi125.stdout:9/535: stat d8/d15/d22 0 2024-02-19T19:12:17.533 INFO:tasks.workunit.client.1.smithi125.stdout:9/536: chown d8/d2e/d4c/d84 1316473 1 2024-02-19T19:12:17.533 INFO:tasks.workunit.client.1.smithi125.stdout:9/537: creat d8/d2e/fbe x:0 0 0 2024-02-19T19:12:17.533 INFO:tasks.workunit.client.1.smithi125.stdout:8/424: dwrite db/f6b [348160,106496] 0 2024-02-19T19:12:17.533 INFO:tasks.workunit.client.1.smithi125.stdout:8/425: dread - db/d18/d30/d3c/d4d/d5d/f64 zero size 2024-02-19T19:12:17.594 INFO:tasks.workunit.client.1.smithi125.stdout:7/503: fsync d12/d18/d44/d3b/d59/d26/f2f 0 2024-02-19T19:12:17.594 INFO:tasks.workunit.client.1.smithi125.stdout:7/504: chown d12/f1f 34075 1 2024-02-19T19:12:17.594 INFO:tasks.workunit.client.1.smithi125.stdout:7/505: dread - d12/d18/d44/d3b/d59/d3e/f7a zero size 2024-02-19T19:12:17.594 INFO:tasks.workunit.client.1.smithi125.stdout:8/426: fdatasync db/f65 0 2024-02-19T19:12:17.594 INFO:tasks.workunit.client.1.smithi125.stdout:0/524: fsync d5/d1a/f55 0 2024-02-19T19:12:17.595 INFO:tasks.workunit.client.1.smithi125.stdout:8/427: rename db/d18/d30/c86 to db/d18/d30/d3c/d4d/d5d/d6f/c8e 0 2024-02-19T19:12:17.598 INFO:tasks.workunit.client.1.smithi125.stdout:6/538: dwrite d6/db/d5d/d2f/f48 [937984,69632] 0 2024-02-19T19:12:17.599 INFO:tasks.workunit.client.1.smithi125.stdout:9/538: dwrite d8/d2e/f3d [2449408,28672] 0 2024-02-19T19:12:17.599 INFO:tasks.workunit.client.1.smithi125.stdout:7/506: dread d12/d18/d44/d3b/d59/f5e [1015808,53248] 0 2024-02-19T19:12:17.599 INFO:tasks.workunit.client.1.smithi125.stdout:1/622: dwrite d1/da3/fbd [688128,16384] 0 2024-02-19T19:12:17.599 INFO:tasks.workunit.client.1.smithi125.stdout:6/539: dread d6/db/d49/f59 [12288,20480] 0 2024-02-19T19:12:17.599 INFO:tasks.workunit.client.1.smithi125.stdout:6/540: truncate d6/db/d5d/d29/f84 766438 0 2024-02-19T19:12:17.599 INFO:tasks.workunit.client.1.smithi125.stdout:7/507: readlink d12/d18/l57 0 2024-02-19T19:12:17.599 INFO:tasks.workunit.client.1.smithi125.stdout:6/541: creat d6/fb0 x:0 0 0 2024-02-19T19:12:17.600 INFO:tasks.workunit.client.1.smithi125.stdout:8/428: dwrite db/d18/d30/d3c/d4d/d5d/d6f/f74 [77824,8192] 0 2024-02-19T19:12:17.600 INFO:tasks.workunit.client.1.smithi125.stdout:8/429: rmdir db/d18/d2f/d3f 39 2024-02-19T19:12:17.600 INFO:tasks.workunit.client.1.smithi125.stdout:0/525: write d5/d19/f2f [2445015,110365] 0 2024-02-19T19:12:17.600 INFO:tasks.workunit.client.1.smithi125.stdout:0/526: rmdir d5/d19/d2b 39 2024-02-19T19:12:17.600 INFO:tasks.workunit.client.1.smithi125.stdout:0/527: stat d5/d33/d42/l96 0 2024-02-19T19:12:17.600 INFO:tasks.workunit.client.1.smithi125.stdout:8/430: symlink db/d18/d30/d3c/d4d/d5d/d6f/l8f 0 2024-02-19T19:12:17.600 INFO:tasks.workunit.client.1.smithi125.stdout:8/431: write db/d18/f32 [1092940,117471] 0 2024-02-19T19:12:17.600 INFO:tasks.workunit.client.1.smithi125.stdout:8/432: symlink db/d18/d30/d3c/d4d/d5d/l90 0 2024-02-19T19:12:17.601 INFO:tasks.workunit.client.1.smithi125.stdout:8/433: symlink db/d18/d30/d80/l91 0 2024-02-19T19:12:17.601 INFO:tasks.workunit.client.1.smithi125.stdout:8/434: rmdir db/d18/d30/d3c/d4d 39 2024-02-19T19:12:17.601 INFO:tasks.workunit.client.1.smithi125.stdout:8/435: dread - db/d18/d2f/d3f/f76 zero size 2024-02-19T19:12:17.601 INFO:tasks.workunit.client.1.smithi125.stdout:8/436: symlink db/d18/d30/d80/l92 0 2024-02-19T19:12:17.601 INFO:tasks.workunit.client.1.smithi125.stdout:8/437: creat db/d18/d2f/f93 x:0 0 0 2024-02-19T19:12:17.672 INFO:tasks.workunit.client.1.smithi125.stdout:1/623: dwrite d1/d26/d3c/d3f/f48 [397312,40960] 0 2024-02-19T19:12:17.672 INFO:tasks.workunit.client.1.smithi125.stdout:1/624: chown d1/d26/f40 7889781 1 2024-02-19T19:12:17.677 INFO:tasks.workunit.client.1.smithi125.stdout:8/438: rename db/d18/d2f/d72/f8d to db/d18/d30/d3c/d4d/f94 0 2024-02-19T19:12:17.677 INFO:tasks.workunit.client.1.smithi125.stdout:8/439: dread db/f1e [184320,90112] 0 2024-02-19T19:12:17.677 INFO:tasks.workunit.client.1.smithi125.stdout:8/440: getdents db/d18/d30/d3c/d88 0 2024-02-19T19:12:17.677 INFO:tasks.workunit.client.1.smithi125.stdout:8/441: stat db/d18/d30/f43 0 2024-02-19T19:12:17.677 INFO:tasks.workunit.client.1.smithi125.stdout:8/442: write db/d18/d30/f89 [451710,26935] 0 2024-02-19T19:12:17.677 INFO:tasks.workunit.client.1.smithi125.stdout:8/443: mkdir db/d81/d95 0 2024-02-19T19:12:17.678 INFO:tasks.workunit.client.1.smithi125.stdout:7/508: dwrite d12/d18/d44/d3b/d59/d2a/d6a/d6d/f7f [598016,40960] 0 2024-02-19T19:12:17.678 INFO:tasks.workunit.client.1.smithi125.stdout:7/509: mknod d12/d18/d44/d3b/d59/d2a/d31/c92 0 2024-02-19T19:12:17.678 INFO:tasks.workunit.client.1.smithi125.stdout:1/625: dwrite d1/d26/d3c/f64 [2117632,53248] 0 2024-02-19T19:12:17.678 INFO:tasks.workunit.client.1.smithi125.stdout:1/626: truncate d1/da3/fbd 293163 0 2024-02-19T19:12:17.678 INFO:tasks.workunit.client.1.smithi125.stdout:1/627: creat d1/d26/d3c/fce x:0 0 0 2024-02-19T19:12:17.678 INFO:tasks.workunit.client.1.smithi125.stdout:1/628: chown d1/d1a/d3d/fbb 13240620 1 2024-02-19T19:12:17.678 INFO:tasks.workunit.client.1.smithi125.stdout:1/629: write d1/da3/fc5 [938583,117433] 0 2024-02-19T19:12:17.678 INFO:tasks.workunit.client.1.smithi125.stdout:1/630: read d1/d26/d23/f55 [1166548,11114] 0 2024-02-19T19:12:17.678 INFO:tasks.workunit.client.1.smithi125.stdout:1/631: link d1/d1a/cb8 d1/ccf 0 2024-02-19T19:12:17.679 INFO:tasks.workunit.client.1.smithi125.stdout:1/632: readlink d1/d26/l8c 0 2024-02-19T19:12:17.679 INFO:tasks.workunit.client.1.smithi125.stdout:1/633: mkdir d1/d1a/d3d/dd0 0 2024-02-19T19:12:17.742 INFO:tasks.workunit.client.1.smithi125.stdout:8/444: dwrite db/d18/d2f/d3f/f75 [425984,65536] 0 2024-02-19T19:12:17.742 INFO:tasks.workunit.client.1.smithi125.stdout:8/445: stat db/d18/d30/d80/l91 0 2024-02-19T19:12:17.742 INFO:tasks.workunit.client.1.smithi125.stdout:8/446: unlink db/l1f 0 2024-02-19T19:12:17.742 INFO:tasks.workunit.client.1.smithi125.stdout:8/447: write db/d18/d30/d3c/f4b [493205,119394] 0 2024-02-19T19:12:17.742 INFO:tasks.workunit.client.1.smithi125.stdout:8/448: read db/f46 [941774,88527] 0 2024-02-19T19:12:17.835 INFO:tasks.workunit.client.1.smithi125.stdout:2/429: sync 2024-02-19T19:12:17.835 INFO:tasks.workunit.client.1.smithi125.stdout:4/470: sync 2024-02-19T19:12:17.835 INFO:tasks.workunit.client.1.smithi125.stdout:4/471: dread d0/d7/d3b/f43 [274432,24576] 0 2024-02-19T19:12:17.835 INFO:tasks.workunit.client.1.smithi125.stdout:4/472: rename d0/d7/d3b/l7c to d0/df/la3 0 2024-02-19T19:12:17.835 INFO:tasks.workunit.client.1.smithi125.stdout:4/473: rmdir d0/d7/d30/d58 39 2024-02-19T19:12:17.836 INFO:tasks.workunit.client.1.smithi125.stdout:4/474: creat d0/d32/fa4 x:0 0 0 2024-02-19T19:12:17.836 INFO:tasks.workunit.client.1.smithi125.stdout:4/475: link d0/df/f73 d0/d7/d30/d42/fa5 0 2024-02-19T19:12:17.836 INFO:tasks.workunit.client.1.smithi125.stdout:4/476: read - d0/d32/d60/f7e zero size 2024-02-19T19:12:17.836 INFO:tasks.workunit.client.1.smithi125.stdout:4/477: dread - d0/d32/f61 zero size 2024-02-19T19:12:17.836 INFO:tasks.workunit.client.1.smithi125.stdout:4/478: symlink d0/d7/d30/d5d/la6 0 2024-02-19T19:12:17.836 INFO:tasks.workunit.client.1.smithi125.stdout:4/479: stat d0/d7/d3b/f43 0 2024-02-19T19:12:17.836 INFO:tasks.workunit.client.1.smithi125.stdout:4/480: write d0/d7/d3b/f62 [1340045,28548] 0 2024-02-19T19:12:17.836 INFO:tasks.workunit.client.1.smithi125.stdout:4/481: creat d0/df/fa7 x:0 0 0 2024-02-19T19:12:17.864 INFO:tasks.workunit.client.1.smithi125.stdout:4/482: fsync d0/d7/d30/d58/f69 0 2024-02-19T19:12:17.864 INFO:tasks.workunit.client.1.smithi125.stdout:2/430: fdatasync d1/f2 0 2024-02-19T19:12:17.871 INFO:tasks.workunit.client.1.smithi125.stdout:4/483: mknod d0/d7/d30/d42/ca8 0 2024-02-19T19:12:17.871 INFO:tasks.workunit.client.1.smithi125.stdout:2/431: creat d1/d36/d70/f7c x:0 0 0 2024-02-19T19:12:17.871 INFO:tasks.workunit.client.1.smithi125.stdout:4/484: dread d0/d7/d30/d58/f1e [1060864,65536] 0 2024-02-19T19:12:17.871 INFO:tasks.workunit.client.1.smithi125.stdout:2/432: creat d1/d27/d45/d7a/f7d x:0 0 0 2024-02-19T19:12:17.871 INFO:tasks.workunit.client.1.smithi125.stdout:2/433: unlink d1/d27/d1d/f77 0 2024-02-19T19:12:17.872 INFO:tasks.workunit.client.1.smithi125.stdout:2/434: truncate d1/f2 1239255 0 2024-02-19T19:12:17.872 INFO:tasks.workunit.client.1.smithi125.stdout:4/485: write d0/d7/d30/d6c/f93 [882889,105252] 0 2024-02-19T19:12:17.872 INFO:tasks.workunit.client.1.smithi125.stdout:4/486: chown d0/d7/d3b/d77/c97 256813909 1 2024-02-19T19:12:17.872 INFO:tasks.workunit.client.1.smithi125.stdout:4/487: read d0/d7/d3b/f62 [867403,43123] 0 2024-02-19T19:12:17.872 INFO:tasks.workunit.client.1.smithi125.stdout:4/488: symlink d0/df/la9 0 2024-02-19T19:12:17.872 INFO:tasks.workunit.client.1.smithi125.stdout:4/489: creat d0/d7/d76/faa x:0 0 0 2024-02-19T19:12:17.872 INFO:tasks.workunit.client.1.smithi125.stdout:4/490: dread d0/d7/d30/d6c/f93 [385024,40960] 0 2024-02-19T19:12:17.872 INFO:tasks.workunit.client.1.smithi125.stdout:4/491: getdents d0/d7 0 2024-02-19T19:12:17.872 INFO:tasks.workunit.client.1.smithi125.stdout:4/492: read - d0/d7/d85/fa0 zero size 2024-02-19T19:12:17.873 INFO:tasks.workunit.client.1.smithi125.stdout:4/493: creat d0/df/fab x:0 0 0 2024-02-19T19:12:17.873 INFO:tasks.workunit.client.1.smithi125.stdout:4/494: rmdir d0/d7/d30 39 2024-02-19T19:12:17.873 INFO:tasks.workunit.client.1.smithi125.stdout:4/495: mkdir d0/d7/d30/d58/dac 0 2024-02-19T19:12:17.873 INFO:tasks.workunit.client.1.smithi125.stdout:4/496: truncate d0/df/f1c 1758569 0 2024-02-19T19:12:17.873 INFO:tasks.workunit.client.1.smithi125.stdout:4/497: mkdir d0/d7/dad 0 2024-02-19T19:12:17.873 INFO:tasks.workunit.client.1.smithi125.stdout:4/498: unlink d0/d7/d3b/d77/c97 0 2024-02-19T19:12:17.873 INFO:tasks.workunit.client.1.smithi125.stdout:4/499: mknod d0/df/d5e/cae 0 2024-02-19T19:12:17.873 INFO:tasks.workunit.client.1.smithi125.stdout:4/500: stat d0/d7/d30/d58/f9 0 2024-02-19T19:12:17.873 INFO:tasks.workunit.client.1.smithi125.stdout:4/501: mknod d0/d7/d30/d42/caf 0 2024-02-19T19:12:17.874 INFO:tasks.workunit.client.1.smithi125.stdout:4/502: creat d0/d7/d30/d42/d7b/fb0 x:0 0 0 2024-02-19T19:12:17.874 INFO:tasks.workunit.client.1.smithi125.stdout:4/503: chown d0/df/f23 64777 1 2024-02-19T19:12:17.874 INFO:tasks.workunit.client.1.smithi125.stdout:4/504: getdents d0/df/d5e 0 2024-02-19T19:12:17.874 INFO:tasks.workunit.client.1.smithi125.stdout:4/505: dread d0/d7/d3b/f51 [53248,57344] 0 2024-02-19T19:12:17.874 INFO:tasks.workunit.client.1.smithi125.stdout:4/506: write d0/d32/f55 [798367,125977] 0 2024-02-19T19:12:17.874 INFO:tasks.workunit.client.1.smithi125.stdout:4/507: truncate d0/d7/d30/d58/f6e 341903 0 2024-02-19T19:12:17.874 INFO:tasks.workunit.client.1.smithi125.stdout:4/508: dread - d0/d7/d3b/f8e zero size 2024-02-19T19:12:17.874 INFO:tasks.workunit.client.1.smithi125.stdout:4/509: read d0/d7/d3b/f3d [144353,64685] 0 2024-02-19T19:12:18.005 INFO:tasks.workunit.client.1.smithi125.stdout:2/435: fsync d1/d36/d70/f49 0 2024-02-19T19:12:18.009 INFO:tasks.workunit.client.1.smithi125.stdout:2/436: creat d1/d27/d1d/d39/f7e x:0 0 0 2024-02-19T19:12:18.010 INFO:tasks.workunit.client.1.smithi125.stdout:3/426: sync 2024-02-19T19:12:18.010 INFO:tasks.workunit.client.1.smithi125.stdout:5/731: sync 2024-02-19T19:12:18.010 INFO:tasks.workunit.client.1.smithi125.stdout:9/539: sync 2024-02-19T19:12:18.010 INFO:tasks.workunit.client.1.smithi125.stdout:3/427: chown d0/d1/d4b/d52/f59 54181 1 2024-02-19T19:12:18.010 INFO:tasks.workunit.client.1.smithi125.stdout:9/540: creat d8/d15/d32/d4f/d6e/fbf x:0 0 0 2024-02-19T19:12:18.010 INFO:tasks.workunit.client.1.smithi125.stdout:3/428: mkdir d0/d1/d1e/d60/d73/d74/d82 0 2024-02-19T19:12:18.011 INFO:tasks.workunit.client.1.smithi125.stdout:9/541: dread d8/d15/d32/d4f/d6e/f75 [368640,61440] 0 2024-02-19T19:12:18.011 INFO:tasks.workunit.client.1.smithi125.stdout:9/542: chown d8/d15/d32/d4f/d6e/f8d 199497 1 2024-02-19T19:12:18.011 INFO:tasks.workunit.client.1.smithi125.stdout:9/543: truncate d8/d15/d32/d4f/d6e/f75 905952 0 2024-02-19T19:12:18.011 INFO:tasks.workunit.client.1.smithi125.stdout:3/429: creat d0/d1/d1e/d60/d73/f83 x:0 0 0 2024-02-19T19:12:18.011 INFO:tasks.workunit.client.1.smithi125.stdout:3/430: write d0/d1/d4b/f7b [1580411,33297] 0 2024-02-19T19:12:18.058 INFO:tasks.workunit.client.1.smithi125.stdout:5/732: dwrite db/d17/d58/d4f/faf [1712128,8192] 0 2024-02-19T19:12:18.058 INFO:tasks.workunit.client.1.smithi125.stdout:5/733: rmdir db/d17/d58/d4f 39 2024-02-19T19:12:18.059 INFO:tasks.workunit.client.1.smithi125.stdout:5/734: creat db/d17/d85/fe4 x:0 0 0 2024-02-19T19:12:18.059 INFO:tasks.workunit.client.1.smithi125.stdout:5/735: truncate db/d17/d85/f95 1300650 0 2024-02-19T19:12:18.059 INFO:tasks.workunit.client.1.smithi125.stdout:5/736: rmdir db/d17 39 2024-02-19T19:12:18.059 INFO:tasks.workunit.client.1.smithi125.stdout:9/544: dwrite d8/d2e/fb9 [901120,49152] 0 2024-02-19T19:12:18.059 INFO:tasks.workunit.client.1.smithi125.stdout:5/737: symlink db/d17/d85/le5 0 2024-02-19T19:12:18.059 INFO:tasks.workunit.client.1.smithi125.stdout:5/738: symlink db/d47/le6 0 2024-02-19T19:12:18.059 INFO:tasks.workunit.client.1.smithi125.stdout:5/739: rename db/d17/f84 to db/d47/d52/d5d/fe7 0 2024-02-19T19:12:18.059 INFO:tasks.workunit.client.1.smithi125.stdout:3/431: dwrite d0/d1/d1e/f27 [1523712,110592] 0 2024-02-19T19:12:18.060 INFO:tasks.workunit.client.1.smithi125.stdout:3/432: rename d0/d1/d39/f5b to d0/d1/d39/f84 0 2024-02-19T19:12:18.060 INFO:tasks.workunit.client.1.smithi125.stdout:3/433: chown d0/d1/c66 266574598 1 2024-02-19T19:12:18.066 INFO:tasks.workunit.client.1.smithi125.stdout:2/437: dread d1/d27/f11 [1724416,24576] 0 2024-02-19T19:12:18.066 INFO:tasks.workunit.client.1.smithi125.stdout:2/438: dread d1/d36/d70/f49 [1212416,28672] 0 2024-02-19T19:12:18.066 INFO:tasks.workunit.client.1.smithi125.stdout:2/439: write d1/d36/d70/d4b/f75 [1249040,85668] 0 2024-02-19T19:12:18.096 INFO:tasks.workunit.client.1.smithi125.stdout:5/740: fdatasync db/d47/d52/d5d/f7b 0 2024-02-19T19:12:18.104 INFO:tasks.workunit.client.1.smithi125.stdout:5/741: mknod db/d17/d85/ce8 0 2024-02-19T19:12:18.105 INFO:tasks.workunit.client.1.smithi125.stdout:2/440: dwrite d1/d27/f10 [1449984,98304] 0 2024-02-19T19:12:18.105 INFO:tasks.workunit.client.1.smithi125.stdout:5/742: mknod db/d17/d58/ce9 0 2024-02-19T19:12:18.105 INFO:tasks.workunit.client.1.smithi125.stdout:5/743: read - db/d17/d58/d33/d53/f8f zero size 2024-02-19T19:12:18.105 INFO:tasks.workunit.client.1.smithi125.stdout:2/441: unlink d1/d36/d70/f76 0 2024-02-19T19:12:18.105 INFO:tasks.workunit.client.1.smithi125.stdout:2/442: mkdir d1/d27/d1d/d25/d7f 0 2024-02-19T19:12:18.105 INFO:tasks.workunit.client.1.smithi125.stdout:2/443: readlink d1/l18 0 2024-02-19T19:12:18.105 INFO:tasks.workunit.client.1.smithi125.stdout:2/444: write d1/d36/d70/f7c [786770,37932] 0 2024-02-19T19:12:18.105 INFO:tasks.workunit.client.1.smithi125.stdout:2/445: write d1/d27/d1d/f2b [1720794,5867] 0 2024-02-19T19:12:18.106 INFO:tasks.workunit.client.1.smithi125.stdout:6/542: sync 2024-02-19T19:12:18.106 INFO:tasks.workunit.client.1.smithi125.stdout:0/528: sync 2024-02-19T19:12:18.106 INFO:tasks.workunit.client.1.smithi125.stdout:0/529: write d5/d33/d42/fa4 [539485,77372] 0 2024-02-19T19:12:18.106 INFO:tasks.workunit.client.1.smithi125.stdout:0/530: write d5/d15/d2c/f77 [224823,91229] 0 2024-02-19T19:12:18.106 INFO:tasks.workunit.client.1.smithi125.stdout:0/531: rename d5/d9/l14 to d5/d19/lbd 0 2024-02-19T19:12:18.106 INFO:tasks.workunit.client.1.smithi125.stdout:0/532: dread d5/d33/d42/f65 [1241088,114688] 0 2024-02-19T19:12:18.106 INFO:tasks.workunit.client.1.smithi125.stdout:0/533: write d5/d19/d27/d32/f3a [535610,34534] 0 2024-02-19T19:12:18.225 INFO:tasks.workunit.client.1.smithi125.stdout:2/446: dwrite d1/f47 [507904,69632] 0 2024-02-19T19:12:18.225 INFO:tasks.workunit.client.1.smithi125.stdout:2/447: creat d1/d36/d70/d4b/d64/f80 x:0 0 0 2024-02-19T19:12:18.226 INFO:tasks.workunit.client.1.smithi125.stdout:2/448: rmdir d1/d36 39 2024-02-19T19:12:18.226 INFO:tasks.workunit.client.1.smithi125.stdout:2/449: stat d1/d27/d1d/d25/d7f 0 2024-02-19T19:12:18.226 INFO:tasks.workunit.client.1.smithi125.stdout:2/450: symlink d1/d27/d1d/d2c/l81 0 2024-02-19T19:12:18.226 INFO:tasks.workunit.client.1.smithi125.stdout:2/451: write d1/d36/d70/f66 [1061275,36615] 0 2024-02-19T19:12:18.226 INFO:tasks.workunit.client.1.smithi125.stdout:2/452: write d1/f2 [396917,70182] 0 2024-02-19T19:12:18.226 INFO:tasks.workunit.client.1.smithi125.stdout:2/453: dread d1/ff [2727936,49152] 0 2024-02-19T19:12:18.226 INFO:tasks.workunit.client.1.smithi125.stdout:2/454: write d1/d27/d1d/d2c/d2e/f6c [276539,96195] 0 2024-02-19T19:12:18.227 INFO:tasks.workunit.client.1.smithi125.stdout:2/455: dwrite d1/d36/d70/f7c [458752,40960] 0 2024-02-19T19:12:18.227 INFO:tasks.workunit.client.1.smithi125.stdout:2/456: creat d1/d27/f82 x:0 0 0 2024-02-19T19:12:18.243 INFO:tasks.workunit.client.1.smithi125.stdout:6/543: dread d6/db/d5d/d29/f2d [557056,118784] 0 2024-02-19T19:12:18.243 INFO:tasks.workunit.client.1.smithi125.stdout:6/544: creat d6/db/df/d16/d7e/fb1 x:0 0 0 2024-02-19T19:12:18.243 INFO:tasks.workunit.client.1.smithi125.stdout:6/545: rename d6/db/d49/d4c/f6d to d6/db/da7/fb2 0 2024-02-19T19:12:18.244 INFO:tasks.workunit.client.1.smithi125.stdout:6/546: mknod d6/db/df/d3b/cb3 0 2024-02-19T19:12:18.244 INFO:tasks.workunit.client.1.smithi125.stdout:6/547: readlink d6/db/d49/d4c/la0 0 2024-02-19T19:12:18.244 INFO:tasks.workunit.client.1.smithi125.stdout:6/548: mknod d6/db/d5d/d29/d68/cb4 0 2024-02-19T19:12:18.244 INFO:tasks.workunit.client.1.smithi125.stdout:6/549: unlink d6/db/df/f21 0 2024-02-19T19:12:18.244 INFO:tasks.workunit.client.1.smithi125.stdout:6/550: write d6/db/d5d/d93/fae [1033974,62450] 0 2024-02-19T19:12:18.244 INFO:tasks.workunit.client.1.smithi125.stdout:6/551: readlink d6/db/d5d/d2f/d7b/d8d/l99 0 2024-02-19T19:12:18.244 INFO:tasks.workunit.client.1.smithi125.stdout:6/552: creat d6/db/d5d/d2f/d7b/d8d/fb5 x:0 0 0 2024-02-19T19:12:18.244 INFO:tasks.workunit.client.1.smithi125.stdout:6/553: truncate d6/db/df/d3b/f79 1585587 0 2024-02-19T19:12:18.245 INFO:tasks.workunit.client.1.smithi125.stdout:6/554: rename d6/db/d5d/d29/l2c to d6/db/d98/lb6 0 2024-02-19T19:12:18.245 INFO:tasks.workunit.client.1.smithi125.stdout:6/555: stat d6/ca 0 2024-02-19T19:12:18.283 INFO:tasks.workunit.client.1.smithi125.stdout:5/744: fsync db/d17/d58/d25/f3c 0 2024-02-19T19:12:18.283 INFO:tasks.workunit.client.1.smithi125.stdout:5/745: dread - db/d47/d52/d5d/fd9 zero size 2024-02-19T19:12:18.283 INFO:tasks.workunit.client.1.smithi125.stdout:5/746: truncate db/d17/d85/fde 838758 0 2024-02-19T19:12:18.283 INFO:tasks.workunit.client.1.smithi125.stdout:5/747: write db/d17/d58/d33/d91/dbe/f5b [259742,9976] 0 2024-02-19T19:12:18.283 INFO:tasks.workunit.client.1.smithi125.stdout:5/748: write db/d17/d58/d25/f89 [56566,78966] 0 2024-02-19T19:12:18.287 INFO:tasks.workunit.client.1.smithi125.stdout:1/634: sync 2024-02-19T19:12:18.287 INFO:tasks.workunit.client.1.smithi125.stdout:7/510: sync 2024-02-19T19:12:18.287 INFO:tasks.workunit.client.1.smithi125.stdout:4/510: sync 2024-02-19T19:12:18.287 INFO:tasks.workunit.client.1.smithi125.stdout:8/449: sync 2024-02-19T19:12:18.347 INFO:tasks.workunit.client.1.smithi125.stdout:5/749: fsync db/d17/d58/d25/f3c 0 2024-02-19T19:12:18.349 INFO:tasks.workunit.client.1.smithi125.stdout:6/556: dwrite d6/db/d5d/f40 [1843200,73728] 0 2024-02-19T19:12:18.349 INFO:tasks.workunit.client.1.smithi125.stdout:1/635: truncate d1/da3/fbd 929955 0 2024-02-19T19:12:18.349 INFO:tasks.workunit.client.1.smithi125.stdout:4/511: rename d0/d32/fa4 to d0/d7/d30/d58/fb1 0 2024-02-19T19:12:18.349 INFO:tasks.workunit.client.1.smithi125.stdout:8/450: write db/d18/d2f/f3a [2676757,17126] 0 2024-02-19T19:12:18.349 INFO:tasks.workunit.client.1.smithi125.stdout:7/511: mknod d12/d18/d44/d51/d81/c93 0 2024-02-19T19:12:18.349 INFO:tasks.workunit.client.1.smithi125.stdout:4/512: getdents d0 0 2024-02-19T19:12:18.350 INFO:tasks.workunit.client.1.smithi125.stdout:1/636: rmdir d1/dcb 0 2024-02-19T19:12:18.360 INFO:tasks.workunit.client.1.smithi125.stdout:8/451: dwrite db/d18/d30/d3c/f68 [69632,28672] 0 2024-02-19T19:12:18.360 INFO:tasks.workunit.client.1.smithi125.stdout:8/452: mkdir db/d18/d30/d48/d67/d96 0 2024-02-19T19:12:18.360 INFO:tasks.workunit.client.1.smithi125.stdout:8/453: rename db/d18/d30/d48/f52 to db/d18/d30/d80/f97 0 2024-02-19T19:12:18.362 INFO:tasks.workunit.client.1.smithi125.stdout:1/637: dwrite d1/dc/f72 [1310720,12288] 0 2024-02-19T19:12:18.362 INFO:tasks.workunit.client.1.smithi125.stdout:5/750: dwrite db/d47/f7e [1400832,8192] 0 2024-02-19T19:12:18.362 INFO:tasks.workunit.client.1.smithi125.stdout:5/751: dread db/d17/f55 [360448,98304] 0 2024-02-19T19:12:18.363 INFO:tasks.workunit.client.1.smithi125.stdout:5/752: rename db/d17/d85/cc0 to db/d17/d58/d33/d91/cea 0 2024-02-19T19:12:18.363 INFO:tasks.workunit.client.1.smithi125.stdout:4/513: dwrite d0/d32/f55 [1769472,32768] 0 2024-02-19T19:12:18.363 INFO:tasks.workunit.client.1.smithi125.stdout:5/753: mknod db/d17/d58/d33/d98/d9c/ddc/ceb 0 2024-02-19T19:12:18.369 INFO:tasks.workunit.client.1.smithi125.stdout:7/512: dread d12/d18/d44/d3b/d59/d2a/d31/f36 [36864,126976] 0 2024-02-19T19:12:18.410 INFO:tasks.workunit.client.1.smithi125.stdout:8/454: fdatasync db/f41 0 2024-02-19T19:12:18.411 INFO:tasks.workunit.client.1.smithi125.stdout:8/455: rename db/d18/d30/d3c/d88/c8c to db/d18/d2f/d3f/c98 0 2024-02-19T19:12:18.411 INFO:tasks.workunit.client.1.smithi125.stdout:7/513: fdatasync fa 0 2024-02-19T19:12:18.411 INFO:tasks.workunit.client.1.smithi125.stdout:7/514: write d12/d18/d44/d3b/d59/d2a/d6a/d6d/f7f [480850,111136] 0 2024-02-19T19:12:18.411 INFO:tasks.workunit.client.1.smithi125.stdout:7/515: truncate d12/d18/d44/d3b/d59/d26/d30/d37/f3f 2462092 0 2024-02-19T19:12:18.411 INFO:tasks.workunit.client.1.smithi125.stdout:8/456: fdatasync db/f6b 0 2024-02-19T19:12:18.411 INFO:tasks.workunit.client.1.smithi125.stdout:8/457: read db/d18/f21 [1384257,122132] 0 2024-02-19T19:12:18.411 INFO:tasks.workunit.client.1.smithi125.stdout:8/458: chown db/d18/d30/d48/l63 234992 1 2024-02-19T19:12:18.414 INFO:tasks.workunit.client.1.smithi125.stdout:1/638: dwrite d1/d1a/d3d/d6e/d87/fb7 [909312,4096] 0 2024-02-19T19:12:18.415 INFO:tasks.workunit.client.1.smithi125.stdout:1/639: truncate d1/faa 29686 0 2024-02-19T19:12:18.415 INFO:tasks.workunit.client.1.smithi125.stdout:4/514: dwrite d0/df/f73 [1921024,40960] 0 2024-02-19T19:12:18.415 INFO:tasks.workunit.client.1.smithi125.stdout:1/640: unlink d1/dc/d36/f77 0 2024-02-19T19:12:18.416 INFO:tasks.workunit.client.1.smithi125.stdout:1/641: chown d1/d78/d8a/fab 2920202 1 2024-02-19T19:12:18.416 INFO:tasks.workunit.client.1.smithi125.stdout:1/642: creat d1/d1a/d3d/fd1 x:0 0 0 2024-02-19T19:12:18.416 INFO:tasks.workunit.client.1.smithi125.stdout:1/643: write d1/d1a/d3d/fd1 [250851,33601] 0 2024-02-19T19:12:18.416 INFO:tasks.workunit.client.1.smithi125.stdout:7/516: dwrite d12/d18/d44/d3b/d59/d26/d30/d37/f62 [544768,49152] 0 2024-02-19T19:12:18.418 INFO:tasks.workunit.client.1.smithi125.stdout:5/754: dread db/d17/d85/fb4 [892928,45056] 0 2024-02-19T19:12:18.482 INFO:tasks.workunit.client.1.smithi125.stdout:4/515: fdatasync d0/df/f33 0 2024-02-19T19:12:18.486 INFO:tasks.workunit.client.1.smithi125.stdout:0/534: sync 2024-02-19T19:12:18.486 INFO:tasks.workunit.client.1.smithi125.stdout:3/434: sync 2024-02-19T19:12:18.486 INFO:tasks.workunit.client.1.smithi125.stdout:9/545: sync 2024-02-19T19:12:18.486 INFO:tasks.workunit.client.1.smithi125.stdout:3/435: write d0/de/f7a [534252,66107] 0 2024-02-19T19:12:18.490 INFO:tasks.workunit.client.1.smithi125.stdout:3/436: getdents d0 0 2024-02-19T19:12:18.491 INFO:tasks.workunit.client.1.smithi125.stdout:9/546: mknod d8/d15/d22/d44/cc0 0 2024-02-19T19:12:18.491 INFO:tasks.workunit.client.1.smithi125.stdout:7/517: creat d12/d18/d44/d3b/d59/d2a/d31/d50/f94 x:0 0 0 2024-02-19T19:12:18.491 INFO:tasks.workunit.client.1.smithi125.stdout:5/755: symlink db/lec 0 2024-02-19T19:12:18.491 INFO:tasks.workunit.client.1.smithi125.stdout:1/644: read d1/d26/f73 [414392,107985] 0 2024-02-19T19:12:18.491 INFO:tasks.workunit.client.1.smithi125.stdout:8/459: dread db/d18/d2f/f3a [2203648,40960] 0 2024-02-19T19:12:18.491 INFO:tasks.workunit.client.1.smithi125.stdout:5/756: rename db/d17/l6b to db/d47/d52/d5d/led 0 2024-02-19T19:12:18.491 INFO:tasks.workunit.client.1.smithi125.stdout:1/645: truncate d1/dc/f2c 1974337 0 2024-02-19T19:12:18.491 INFO:tasks.workunit.client.1.smithi125.stdout:1/646: readlink d1/dc/d36/d69/laf 0 2024-02-19T19:12:18.492 INFO:tasks.workunit.client.1.smithi125.stdout:8/460: mkdir db/d18/d2f/d99 0 2024-02-19T19:12:18.492 INFO:tasks.workunit.client.1.smithi125.stdout:8/461: chown db/d18/d30/d3c/d4d/d5d/d6f 2559926 1 2024-02-19T19:12:18.492 INFO:tasks.workunit.client.1.smithi125.stdout:1/647: rename d1/d1a/d3d/d6e/d4b/f4e to d1/d78/fd2 0 2024-02-19T19:12:18.492 INFO:tasks.workunit.client.1.smithi125.stdout:8/462: dread db/f36 [946176,98304] 0 2024-02-19T19:12:18.492 INFO:tasks.workunit.client.1.smithi125.stdout:1/648: mkdir d1/d1a/dd3 0 2024-02-19T19:12:18.492 INFO:tasks.workunit.client.1.smithi125.stdout:8/463: rename db/d18/d30/d3c/d4d/c84 to db/d18/d30/d3c/c9a 0 2024-02-19T19:12:18.492 INFO:tasks.workunit.client.1.smithi125.stdout:1/649: chown d1/d78/d80 1 1 2024-02-19T19:12:18.492 INFO:tasks.workunit.client.1.smithi125.stdout:1/650: getdents d1/da3 0 2024-02-19T19:12:18.493 INFO:tasks.workunit.client.1.smithi125.stdout:8/464: write db/d18/d30/d3c/f53 [544366,12137] 0 2024-02-19T19:12:18.493 INFO:tasks.workunit.client.1.smithi125.stdout:1/651: dread d1/da3/fbd [0,86016] 0 2024-02-19T19:12:18.493 INFO:tasks.workunit.client.1.smithi125.stdout:1/652: symlink d1/d1a/d3d/d6e/ld4 0 2024-02-19T19:12:18.493 INFO:tasks.workunit.client.1.smithi125.stdout:1/653: dread d1/d26/f40 [684032,4096] 0 2024-02-19T19:12:18.493 INFO:tasks.workunit.client.1.smithi125.stdout:1/654: chown d1/f47 2340 1 2024-02-19T19:12:18.493 INFO:tasks.workunit.client.1.smithi125.stdout:5/757: write db/d17/d58/d4f/f56 [1706775,127280] 0 2024-02-19T19:12:18.493 INFO:tasks.workunit.client.1.smithi125.stdout:1/655: creat d1/d1a/d3d/d6e/d4b/fd5 x:0 0 0 2024-02-19T19:12:18.493 INFO:tasks.workunit.client.1.smithi125.stdout:1/656: truncate d1/d1a/fc4 1617174 0 2024-02-19T19:12:18.494 INFO:tasks.workunit.client.1.smithi125.stdout:1/657: chown d1/d1a/fc4 130624070 1 2024-02-19T19:12:18.494 INFO:tasks.workunit.client.1.smithi125.stdout:1/658: creat d1/dc/d36/d39/fd6 x:0 0 0 2024-02-19T19:12:18.494 INFO:tasks.workunit.client.1.smithi125.stdout:1/659: dread d1/dc/d36/d39/fa1 [212992,28672] 0 2024-02-19T19:12:18.494 INFO:tasks.workunit.client.1.smithi125.stdout:1/660: dread - d1/d1a/fb4 zero size 2024-02-19T19:12:18.494 INFO:tasks.workunit.client.1.smithi125.stdout:1/661: truncate d1/d1a/d3d/fb9 1047871 0 2024-02-19T19:12:18.494 INFO:tasks.workunit.client.1.smithi125.stdout:1/662: creat d1/d1a/d3d/dd0/fd7 x:0 0 0 2024-02-19T19:12:18.494 INFO:tasks.workunit.client.1.smithi125.stdout:1/663: creat d1/d78/fd8 x:0 0 0 2024-02-19T19:12:18.494 INFO:tasks.workunit.client.1.smithi125.stdout:1/664: chown d1/dc/f72 1191550 1 2024-02-19T19:12:18.494 INFO:tasks.workunit.client.1.smithi125.stdout:8/465: write db/f26 [1195751,125829] 0 2024-02-19T19:12:18.495 INFO:tasks.workunit.client.1.smithi125.stdout:0/535: dwrite d5/d33/d46/f6b [602112,126976] 0 2024-02-19T19:12:18.495 INFO:tasks.workunit.client.1.smithi125.stdout:1/665: write d1/d1a/fc4 [1953151,104915] 0 2024-02-19T19:12:18.495 INFO:tasks.workunit.client.1.smithi125.stdout:1/666: symlink d1/d1a/d3d/d6e/dbe/ld9 0 2024-02-19T19:12:18.495 INFO:tasks.workunit.client.1.smithi125.stdout:1/667: mknod d1/d26/d23/cda 0 2024-02-19T19:12:18.495 INFO:tasks.workunit.client.1.smithi125.stdout:1/668: link d1/dc/l1e d1/da3/ldb 0 2024-02-19T19:12:18.495 INFO:tasks.workunit.client.1.smithi125.stdout:1/669: getdents d1/dc/d36 0 2024-02-19T19:12:18.495 INFO:tasks.workunit.client.1.smithi125.stdout:4/516: dread d0/d7/d3b/f81 [704512,32768] 0 2024-02-19T19:12:18.495 INFO:tasks.workunit.client.1.smithi125.stdout:4/517: write d0/df/fab [79596,120423] 0 2024-02-19T19:12:18.539 INFO:tasks.workunit.client.1.smithi125.stdout:9/547: fdatasync d8/d15/d22/d44/f92 0 2024-02-19T19:12:18.540 INFO:tasks.workunit.client.1.smithi125.stdout:9/548: truncate f6 714588 0 2024-02-19T19:12:18.540 INFO:tasks.workunit.client.1.smithi125.stdout:9/549: write d8/d15/d22/d44/f7a [1177189,62020] 0 2024-02-19T19:12:18.540 INFO:tasks.workunit.client.1.smithi125.stdout:9/550: rmdir d8/d15/d9d 39 2024-02-19T19:12:18.540 INFO:tasks.workunit.client.1.smithi125.stdout:9/551: mknod d8/d2e/d4c/d84/cc1 0 2024-02-19T19:12:18.540 INFO:tasks.workunit.client.1.smithi125.stdout:9/552: link d8/d15/d32/d4f/f59 d8/d15/d32/d4f/d6e/fc2 0 2024-02-19T19:12:18.542 INFO:tasks.workunit.client.1.smithi125.stdout:0/536: dwrite d5/d33/d42/fa4 [114688,61440] 0 2024-02-19T19:12:18.546 INFO:tasks.workunit.client.1.smithi125.stdout:5/758: dwrite db/d26/d51/fcb [204800,20480] 0 2024-02-19T19:12:18.546 INFO:tasks.workunit.client.1.smithi125.stdout:5/759: unlink db/d47/d52/d5d/fd9 0 2024-02-19T19:12:18.546 INFO:tasks.workunit.client.1.smithi125.stdout:8/466: dwrite db/d18/d2f/d3f/f75 [1568768,118784] 0 2024-02-19T19:12:18.546 INFO:tasks.workunit.client.1.smithi125.stdout:8/467: symlink db/l9b 0 2024-02-19T19:12:18.547 INFO:tasks.workunit.client.1.smithi125.stdout:9/553: dwrite f6 [598016,24576] 0 2024-02-19T19:12:18.547 INFO:tasks.workunit.client.1.smithi125.stdout:8/468: symlink db/l9c 0 2024-02-19T19:12:18.547 INFO:tasks.workunit.client.1.smithi125.stdout:8/469: readlink db/l40 0 2024-02-19T19:12:18.547 INFO:tasks.workunit.client.1.smithi125.stdout:8/470: mknod db/d18/d2f/d3f/c9d 0 2024-02-19T19:12:18.547 INFO:tasks.workunit.client.1.smithi125.stdout:8/471: truncate db/f65 401672 0 2024-02-19T19:12:18.547 INFO:tasks.workunit.client.1.smithi125.stdout:9/554: write d8/d15/d9d/fb8 [955865,108950] 0 2024-02-19T19:12:18.547 INFO:tasks.workunit.client.1.smithi125.stdout:9/555: rename d8/d15/d32/ca4 to d8/d2e/d4c/d96/cc3 0 2024-02-19T19:12:18.547 INFO:tasks.workunit.client.1.smithi125.stdout:9/556: creat d8/d15/d22/fc4 x:0 0 0 2024-02-19T19:12:18.548 INFO:tasks.workunit.client.1.smithi125.stdout:9/557: link d8/d15/d32/f30 d8/d2e/d4c/fc5 0 2024-02-19T19:12:18.548 INFO:tasks.workunit.client.1.smithi125.stdout:9/558: mknod d8/d15/da2/cc6 0 2024-02-19T19:12:18.548 INFO:tasks.workunit.client.1.smithi125.stdout:9/559: mknod d8/d15/d32/d4f/cc7 0 2024-02-19T19:12:18.548 INFO:tasks.workunit.client.1.smithi125.stdout:9/560: mknod d8/d15/d22/d44/cc8 0 2024-02-19T19:12:18.548 INFO:tasks.workunit.client.1.smithi125.stdout:9/561: creat d8/d2e/d4c/fc9 x:0 0 0 2024-02-19T19:12:18.548 INFO:tasks.workunit.client.1.smithi125.stdout:9/562: write d8/d15/d32/d4f/d85/fbd [667504,55357] 0 2024-02-19T19:12:18.548 INFO:tasks.workunit.client.1.smithi125.stdout:9/563: getdents d8/d15/d22 0 2024-02-19T19:12:18.548 INFO:tasks.workunit.client.1.smithi125.stdout:9/564: creat d8/d15/d22/d4e/d6b/fca x:0 0 0 2024-02-19T19:12:18.549 INFO:tasks.workunit.client.1.smithi125.stdout:9/565: dread - d8/d15/d22/fc4 zero size 2024-02-19T19:12:18.549 INFO:tasks.workunit.client.1.smithi125.stdout:9/566: getdents d8 0 2024-02-19T19:12:18.549 INFO:tasks.workunit.client.1.smithi125.stdout:9/567: mkdir d8/d15/d32/d4f/d85/dcb 0 2024-02-19T19:12:18.549 INFO:tasks.workunit.client.1.smithi125.stdout:9/568: dread d8/d15/d22/d4e/f47 [0,12288] 0 2024-02-19T19:12:18.549 INFO:tasks.workunit.client.1.smithi125.stdout:9/569: write d8/d2e/d4c/f5f [1973621,16090] 0 2024-02-19T19:12:18.549 INFO:tasks.workunit.client.1.smithi125.stdout:9/570: creat d8/d2e/d4c/d96/fcc x:0 0 0 2024-02-19T19:12:18.549 INFO:tasks.workunit.client.1.smithi125.stdout:9/571: write d8/d15/d32/d4f/d6e/fb1 [361153,82136] 0 2024-02-19T19:12:18.549 INFO:tasks.workunit.client.1.smithi125.stdout:9/572: creat d8/d2e/d4c/d96/fcd x:0 0 0 2024-02-19T19:12:18.550 INFO:tasks.workunit.client.1.smithi125.stdout:9/573: dread f3 [1269760,32768] 0 2024-02-19T19:12:18.550 INFO:tasks.workunit.client.1.smithi125.stdout:9/574: dread d8/d15/d32/f65 [380928,122880] 0 2024-02-19T19:12:18.550 INFO:tasks.workunit.client.1.smithi125.stdout:9/575: write d8/d15/d9d/fb8 [1648901,57661] 0 2024-02-19T19:12:18.550 INFO:tasks.workunit.client.1.smithi125.stdout:9/576: unlink d8/d15/f2c 0 2024-02-19T19:12:18.550 INFO:tasks.workunit.client.1.smithi125.stdout:9/577: write d8/d15/f1c [1751529,37783] 0 2024-02-19T19:12:18.550 INFO:tasks.workunit.client.1.smithi125.stdout:9/578: link d8/d2e/fbe d8/d2e/d4c/d84/fce 0 2024-02-19T19:12:18.550 INFO:tasks.workunit.client.1.smithi125.stdout:9/579: write d8/d15/d22/d44/f89 [475145,1779] 0 2024-02-19T19:12:18.551 INFO:tasks.workunit.client.1.smithi125.stdout:9/580: rename d8/d2e/d4c/d96/fcc to d8/d15/d22/fcf 0 2024-02-19T19:12:18.551 INFO:tasks.workunit.client.1.smithi125.stdout:9/581: chown d8/d15/d22/d4e/ca8 1617 1 2024-02-19T19:12:18.552 INFO:tasks.workunit.client.1.smithi125.stdout:7/518: dread d12/d18/d44/d3b/d59/d2a/d31/f61 [245760,118784] 0 2024-02-19T19:12:18.552 INFO:tasks.workunit.client.1.smithi125.stdout:7/519: write d12/d18/f68 [295843,32901] 0 2024-02-19T19:12:18.552 INFO:tasks.workunit.client.1.smithi125.stdout:7/520: truncate d12/d18/d44/d3b/d59/d26/f87 530122 0 2024-02-19T19:12:18.552 INFO:tasks.workunit.client.1.smithi125.stdout:7/521: mkdir d12/d18/d44/d3b/d59/d26/d54/d8c/d95 0 2024-02-19T19:12:18.552 INFO:tasks.workunit.client.1.smithi125.stdout:7/522: chown d12/d18/d44/d3b/d59/d2a/f4a 746 1 2024-02-19T19:12:18.552 INFO:tasks.workunit.client.1.smithi125.stdout:7/523: truncate d12/d18/d44/d51/f64 988880 0 2024-02-19T19:12:18.614 INFO:tasks.workunit.client.1.smithi125.stdout:4/518: fdatasync d0/d7/d3b/f9c 0 2024-02-19T19:12:18.621 INFO:tasks.workunit.client.1.smithi125.stdout:0/537: dwrite d5/d19/d27/fa2 [675840,61440] 0 2024-02-19T19:12:18.621 INFO:tasks.workunit.client.1.smithi125.stdout:9/582: dwrite d8/d15/f6a [479232,32768] 0 2024-02-19T19:12:18.622 INFO:tasks.workunit.client.1.smithi125.stdout:7/524: dwrite d12/d18/d44/d3b/d59/d26/d30/f88 [1019904,32768] 0 2024-02-19T19:12:18.622 INFO:tasks.workunit.client.1.smithi125.stdout:9/583: readlink d8/lad 0 2024-02-19T19:12:18.622 INFO:tasks.workunit.client.1.smithi125.stdout:7/525: truncate d12/d18/d44/d3b/d59/d26/d54/f5b 413755 0 2024-02-19T19:12:18.622 INFO:tasks.workunit.client.1.smithi125.stdout:7/526: chown fa 0 1 2024-02-19T19:12:18.622 INFO:tasks.workunit.client.1.smithi125.stdout:0/538: mknod d5/d33/d42/d92/cbe 0 2024-02-19T19:12:18.622 INFO:tasks.workunit.client.1.smithi125.stdout:9/584: rename f3 to d8/d2e/d4c/d96/fd0 0 2024-02-19T19:12:18.622 INFO:tasks.workunit.client.1.smithi125.stdout:7/527: rename d12/d18/d44/d3b/d59/d26/f2f to d12/d18/d44/d3b/d59/d2a/d31/d50/d60/f96 0 2024-02-19T19:12:18.622 INFO:tasks.workunit.client.1.smithi125.stdout:0/539: write d5/d19/d27/f5c [842196,21560] 0 2024-02-19T19:12:18.623 INFO:tasks.workunit.client.1.smithi125.stdout:7/528: mkdir d12/d18/d44/d3b/d59/d26/d30/d97 0 2024-02-19T19:12:18.623 INFO:tasks.workunit.client.1.smithi125.stdout:0/540: creat d5/fbf x:0 0 0 2024-02-19T19:12:18.623 INFO:tasks.workunit.client.1.smithi125.stdout:7/529: truncate d12/d18/d44/d3b/d59/d2a/d31/d50/f94 233795 0 2024-02-19T19:12:18.623 INFO:tasks.workunit.client.1.smithi125.stdout:0/541: creat d5/d19/d27/d32/d70/fc0 x:0 0 0 2024-02-19T19:12:18.623 INFO:tasks.workunit.client.1.smithi125.stdout:7/530: mkdir d12/d18/d44/d3b/d59/d26/d54/d8c/d98 0 2024-02-19T19:12:18.623 INFO:tasks.workunit.client.1.smithi125.stdout:0/542: dread d5/d19/f62 [450560,65536] 0 2024-02-19T19:12:18.623 INFO:tasks.workunit.client.1.smithi125.stdout:0/543: dread - d5/d19/d27/f8e zero size 2024-02-19T19:12:18.623 INFO:tasks.workunit.client.1.smithi125.stdout:7/531: creat d12/d18/d2c/d4e/f99 x:0 0 0 2024-02-19T19:12:18.624 INFO:tasks.workunit.client.1.smithi125.stdout:7/532: mkdir d12/d18/d66/d9a 0 2024-02-19T19:12:18.624 INFO:tasks.workunit.client.1.smithi125.stdout:7/533: write d12/d18/d44/f40 [229374,51820] 0 2024-02-19T19:12:18.624 INFO:tasks.workunit.client.1.smithi125.stdout:7/534: truncate d12/d18/d44/d3b/d59/d2a/d31/d50/f89 382075 0 2024-02-19T19:12:18.630 INFO:tasks.workunit.client.1.smithi125.stdout:8/472: dread db/f36 [245760,4096] 0 2024-02-19T19:12:18.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:18 smithi125 ceph-mon[86115]: pgmap v154: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:12:18.717 INFO:tasks.workunit.client.1.smithi125.stdout:0/544: dwrite d5/d19/f78 [643072,90112] 0 2024-02-19T19:12:18.717 INFO:tasks.workunit.client.1.smithi125.stdout:0/545: truncate d5/d19/f62 1953351 0 2024-02-19T19:12:18.717 INFO:tasks.workunit.client.1.smithi125.stdout:0/546: mkdir d5/d33/d9b/dc1 0 2024-02-19T19:12:18.717 INFO:tasks.workunit.client.1.smithi125.stdout:0/547: write d5/d15/d2c/d80/f63 [112761,64321] 0 2024-02-19T19:12:18.717 INFO:tasks.workunit.client.1.smithi125.stdout:0/548: truncate d5/d33/f8b 356381 0 2024-02-19T19:12:18.720 INFO:tasks.workunit.client.1.smithi125.stdout:6/557: sync 2024-02-19T19:12:18.721 INFO:tasks.workunit.client.1.smithi125.stdout:2/457: sync 2024-02-19T19:12:18.721 INFO:tasks.workunit.client.1.smithi125.stdout:2/458: rename d1/d36/d70/d4b/c4d to d1/c83 0 2024-02-19T19:12:18.721 INFO:tasks.workunit.client.1.smithi125.stdout:7/535: dwrite d12/d3d/f69 [40960,53248] 0 2024-02-19T19:12:18.721 INFO:tasks.workunit.client.1.smithi125.stdout:2/459: symlink d1/d36/d70/d4b/l84 0 2024-02-19T19:12:18.721 INFO:tasks.workunit.client.1.smithi125.stdout:7/536: creat d12/d18/d44/d51/f9b x:0 0 0 2024-02-19T19:12:18.721 INFO:tasks.workunit.client.1.smithi125.stdout:6/558: write d6/db/d5d/d2f/d7b/d8d/fa1 [635915,113990] 0 2024-02-19T19:12:18.721 INFO:tasks.workunit.client.1.smithi125.stdout:7/537: mkdir d12/d18/d63/d9c 0 2024-02-19T19:12:18.721 INFO:tasks.workunit.client.1.smithi125.stdout:7/538: rename d12/d18/d44/d3b/d59/d2a/d31/d50/d60/c72 to d12/d18/d44/d3b/d59/d26/d30/d97/c9d 0 2024-02-19T19:12:18.722 INFO:tasks.workunit.client.1.smithi125.stdout:7/539: dread - d12/f7e zero size 2024-02-19T19:12:18.722 INFO:tasks.workunit.client.1.smithi125.stdout:8/473: dwrite db/f41 [499712,98304] 0 2024-02-19T19:12:18.722 INFO:tasks.workunit.client.1.smithi125.stdout:7/540: write d12/d18/d44/d51/d81/f83 [584130,119675] 0 2024-02-19T19:12:18.722 INFO:tasks.workunit.client.1.smithi125.stdout:7/541: creat d12/d18/d44/d3b/d59/d2a/d6a/f9e x:0 0 0 2024-02-19T19:12:18.722 INFO:tasks.workunit.client.1.smithi125.stdout:7/542: chown d12/d18/d44/d3b/d59/d26/d30/d37/c6c 3659 1 2024-02-19T19:12:18.722 INFO:tasks.workunit.client.1.smithi125.stdout:7/543: chown d12/d18/d44/d3b/d59/d26/d54/d8c 14579606 1 2024-02-19T19:12:18.722 INFO:tasks.workunit.client.1.smithi125.stdout:7/544: dread d12/d18/d44/d3b/d59/d26/d30/f88 [888832,24576] 0 2024-02-19T19:12:18.722 INFO:tasks.workunit.client.1.smithi125.stdout:7/545: read d12/d18/d44/d3b/d59/d2a/d48/f49 [321481,71533] 0 2024-02-19T19:12:18.723 INFO:tasks.workunit.client.1.smithi125.stdout:7/546: creat d12/d18/d63/f9f x:0 0 0 2024-02-19T19:12:18.723 INFO:tasks.workunit.client.1.smithi125.stdout:0/549: write d5/d33/d46/f6b [718034,105739] 0 2024-02-19T19:12:18.723 INFO:tasks.workunit.client.1.smithi125.stdout:0/550: truncate d5/d19/d27/d32/f8d 2405557 0 2024-02-19T19:12:18.723 INFO:tasks.workunit.client.1.smithi125.stdout:0/551: write d5/d19/d27/d32/f3a [1893726,9994] 0 2024-02-19T19:12:18.723 INFO:tasks.workunit.client.1.smithi125.stdout:0/552: mkdir d5/d19/d27/d32/d70/dc2 0 2024-02-19T19:12:18.782 INFO:tasks.workunit.client.1.smithi125.stdout:0/553: dwrite d5/d33/d42/f61 [647168,12288] 0 2024-02-19T19:12:18.782 INFO:tasks.workunit.client.1.smithi125.stdout:2/460: dwrite d1/d27/f22 [1851392,65536] 0 2024-02-19T19:12:18.782 INFO:tasks.workunit.client.1.smithi125.stdout:7/547: dwrite d12/d3d/f4f [1118208,114688] 0 2024-02-19T19:12:18.782 INFO:tasks.workunit.client.1.smithi125.stdout:8/474: dwrite db/d18/d2f/f39 [401408,81920] 0 2024-02-19T19:12:18.783 INFO:tasks.workunit.client.1.smithi125.stdout:7/548: chown d12/d18/d44/d3b/d59/d2a/d31/f36 61 1 2024-02-19T19:12:18.783 INFO:tasks.workunit.client.1.smithi125.stdout:2/461: dread d1/d27/d1d/d2c/d2e/f63 [544768,28672] 0 2024-02-19T19:12:18.783 INFO:tasks.workunit.client.1.smithi125.stdout:2/462: chown d1/l28 1 1 2024-02-19T19:12:18.783 INFO:tasks.workunit.client.1.smithi125.stdout:8/475: mkdir db/d18/d30/d80/d9e 0 2024-02-19T19:12:18.783 INFO:tasks.workunit.client.1.smithi125.stdout:7/549: write d12/d18/d44/d3b/d59/d26/f3a [153613,116703] 0 2024-02-19T19:12:18.786 INFO:tasks.workunit.client.1.smithi125.stdout:6/559: dread d6/db/df/d3b/f79 [868352,49152] 0 2024-02-19T19:12:18.786 INFO:tasks.workunit.client.1.smithi125.stdout:7/550: rmdir d12/d18/d44/d3b/d59/d26/d54/d8c/d95 0 2024-02-19T19:12:18.786 INFO:tasks.workunit.client.1.smithi125.stdout:8/476: getdents db/d18/d2f 0 2024-02-19T19:12:18.786 INFO:tasks.workunit.client.1.smithi125.stdout:8/477: read db/d18/d30/f89 [14330,68051] 0 2024-02-19T19:12:18.787 INFO:tasks.workunit.client.1.smithi125.stdout:7/551: write d12/d18/d44/d3b/d59/d26/f28 [1461851,100394] 0 2024-02-19T19:12:18.787 INFO:tasks.workunit.client.1.smithi125.stdout:8/478: write db/d18/d30/d3c/f4b [1233304,58238] 0 2024-02-19T19:12:18.787 INFO:tasks.workunit.client.1.smithi125.stdout:7/552: mkdir d12/d18/d66/da0 0 2024-02-19T19:12:18.787 INFO:tasks.workunit.client.1.smithi125.stdout:8/479: read - db/d18/d30/d48/f7a zero size 2024-02-19T19:12:18.787 INFO:tasks.workunit.client.1.smithi125.stdout:8/480: stat db/d18/d2f 0 2024-02-19T19:12:18.787 INFO:tasks.workunit.client.1.smithi125.stdout:8/481: creat db/d18/d30/d3c/d4d/f9f x:0 0 0 2024-02-19T19:12:18.787 INFO:tasks.workunit.client.1.smithi125.stdout:8/482: dread - db/d18/d30/d48/f7a zero size 2024-02-19T19:12:18.787 INFO:tasks.workunit.client.1.smithi125.stdout:8/483: symlink db/d18/d30/d80/d9e/la0 0 2024-02-19T19:12:18.787 INFO:tasks.workunit.client.1.smithi125.stdout:6/560: link d6/db/d5d/f82 d6/fb7 0 2024-02-19T19:12:18.788 INFO:tasks.workunit.client.1.smithi125.stdout:6/561: mknod d6/cb8 0 2024-02-19T19:12:18.788 INFO:tasks.workunit.client.1.smithi125.stdout:6/562: creat d6/db/d98/fb9 x:0 0 0 2024-02-19T19:12:18.788 INFO:tasks.workunit.client.1.smithi125.stdout:0/554: dwrite d5/d19/d27/f8e [729088,61440] 0 2024-02-19T19:12:18.788 INFO:tasks.workunit.client.1.smithi125.stdout:0/555: write d5/d15/d2c/d80/f4f [1215947,111718] 0 2024-02-19T19:12:18.788 INFO:tasks.workunit.client.1.smithi125.stdout:0/556: mkdir d5/d19/d27/dc3 0 2024-02-19T19:12:18.788 INFO:tasks.workunit.client.1.smithi125.stdout:0/557: write d5/d33/f8b [151169,22112] 0 2024-02-19T19:12:18.788 INFO:tasks.workunit.client.1.smithi125.stdout:0/558: truncate d5/d33/d42/f65 2328192 0 2024-02-19T19:12:18.789 INFO:tasks.workunit.client.1.smithi125.stdout:0/559: mknod d5/d19/d27/dc3/cc4 0 2024-02-19T19:12:18.789 INFO:tasks.workunit.client.1.smithi125.stdout:0/560: readlink d5/d19/d2b/l91 0 2024-02-19T19:12:18.789 INFO:tasks.workunit.client.1.smithi125.stdout:0/561: mknod d5/d9/da0/cc5 0 2024-02-19T19:12:18.789 INFO:tasks.workunit.client.1.smithi125.stdout:2/463: dwrite d1/d27/d1d/d25/f38 [1310720,94208] 0 2024-02-19T19:12:18.789 INFO:tasks.workunit.client.1.smithi125.stdout:2/464: chown d1/d36/d70/f49 192383181 1 2024-02-19T19:12:18.789 INFO:tasks.workunit.client.1.smithi125.stdout:2/465: stat d1/d27 0 2024-02-19T19:12:18.789 INFO:tasks.workunit.client.1.smithi125.stdout:2/466: truncate d1/d27/d1d/d2c/d2e/f63 1659689 0 2024-02-19T19:12:18.789 INFO:tasks.workunit.client.1.smithi125.stdout:8/484: dwrite db/d18/f1b [1572864,16384] 0 2024-02-19T19:12:18.789 INFO:tasks.workunit.client.1.smithi125.stdout:2/467: mkdir d1/d36/d70/d85 0 2024-02-19T19:12:18.790 INFO:tasks.workunit.client.1.smithi125.stdout:8/485: write db/d18/d30/d3c/f53 [196284,8247] 0 2024-02-19T19:12:18.790 INFO:tasks.workunit.client.1.smithi125.stdout:8/486: truncate db/d18/d2f/f39 1450484 0 2024-02-19T19:12:18.790 INFO:tasks.workunit.client.1.smithi125.stdout:2/468: write d1/ff [661302,65880] 0 2024-02-19T19:12:18.790 INFO:tasks.workunit.client.1.smithi125.stdout:2/469: chown d1/d36 0 1 2024-02-19T19:12:18.790 INFO:tasks.workunit.client.1.smithi125.stdout:8/487: symlink db/d18/d30/d3c/la1 0 2024-02-19T19:12:18.790 INFO:tasks.workunit.client.1.smithi125.stdout:2/470: creat d1/d27/d1d/d25/d2a/f86 x:0 0 0 2024-02-19T19:12:18.790 INFO:tasks.workunit.client.1.smithi125.stdout:8/488: read db/f6b [1336988,98137] 0 2024-02-19T19:12:18.791 INFO:tasks.workunit.client.1.smithi125.stdout:2/471: mknod d1/d27/d1d/d25/d7f/c87 0 2024-02-19T19:12:18.791 INFO:tasks.workunit.client.1.smithi125.stdout:8/489: chown db/l9b 1811102 1 2024-02-19T19:12:18.791 INFO:tasks.workunit.client.1.smithi125.stdout:2/472: write d1/d27/d45/f56 [950338,69917] 0 2024-02-19T19:12:18.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:18 smithi096 ceph-mon[112483]: pgmap v154: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:12:18.899 INFO:tasks.workunit.client.1.smithi125.stdout:8/490: dwrite db/d18/d30/f89 [393216,57344] 0 2024-02-19T19:12:18.899 INFO:tasks.workunit.client.1.smithi125.stdout:8/491: mkdir db/d18/d30/d3c/d4d/d5d/da2 0 2024-02-19T19:12:18.899 INFO:tasks.workunit.client.1.smithi125.stdout:8/492: getdents db/d18/d30/d3c/d70 0 2024-02-19T19:12:18.899 INFO:tasks.workunit.client.1.smithi125.stdout:8/493: readlink db/d18/d30/d3c/d4d/d5d/d6f/l8f 0 2024-02-19T19:12:18.901 INFO:tasks.workunit.client.1.smithi125.stdout:0/562: dwrite d5/ff [2002944,90112] 0 2024-02-19T19:12:18.901 INFO:tasks.workunit.client.1.smithi125.stdout:0/563: rmdir d5/d33/d42/d8f 0 2024-02-19T19:12:18.901 INFO:tasks.workunit.client.1.smithi125.stdout:6/563: dwrite d6/db/d49/f59 [954368,98304] 0 2024-02-19T19:12:18.902 INFO:tasks.workunit.client.1.smithi125.stdout:6/564: creat d6/db/fba x:0 0 0 2024-02-19T19:12:18.902 INFO:tasks.workunit.client.1.smithi125.stdout:6/565: getdents d6/db/d5d 0 2024-02-19T19:12:18.902 INFO:tasks.workunit.client.1.smithi125.stdout:6/566: write d6/db/df/d16/f5c [1554779,33560] 0 2024-02-19T19:12:18.902 INFO:tasks.workunit.client.1.smithi125.stdout:6/567: write d6/db/df/f95 [742934,226] 0 2024-02-19T19:12:18.902 INFO:tasks.workunit.client.1.smithi125.stdout:6/568: mkdir d6/db/df/dbb 0 2024-02-19T19:12:18.902 INFO:tasks.workunit.client.1.smithi125.stdout:6/569: dread d6/db/d49/d4c/f74 [225280,86016] 0 2024-02-19T19:12:18.903 INFO:tasks.workunit.client.1.smithi125.stdout:6/570: chown d6/db/f11 24 1 2024-02-19T19:12:18.903 INFO:tasks.workunit.client.1.smithi125.stdout:6/571: stat d6/db/d5d/d2f/d45/l65 0 2024-02-19T19:12:18.903 INFO:tasks.workunit.client.1.smithi125.stdout:6/572: truncate d6/db/f11 893040 0 2024-02-19T19:12:18.903 INFO:tasks.workunit.client.1.smithi125.stdout:6/573: dread d6/db/f3e [937984,69632] 0 2024-02-19T19:12:18.903 INFO:tasks.workunit.client.1.smithi125.stdout:6/574: chown d6/db/d5d/d2f/d45/l94 2017656780 1 2024-02-19T19:12:18.903 INFO:tasks.workunit.client.1.smithi125.stdout:6/575: chown d6/f9 17941 1 2024-02-19T19:12:18.903 INFO:tasks.workunit.client.1.smithi125.stdout:6/576: truncate d6/db/d49/d4c/f66 2694337 0 2024-02-19T19:12:18.903 INFO:tasks.workunit.client.1.smithi125.stdout:8/494: dwrite db/d18/f21 [1773568,102400] 0 2024-02-19T19:12:18.904 INFO:tasks.workunit.client.1.smithi125.stdout:8/495: truncate db/f16 1241376 0 2024-02-19T19:12:18.941 INFO:tasks.workunit.client.1.smithi125.stdout:2/473: fdatasync d1/d27/d1d/d2c/f31 0 2024-02-19T19:12:18.941 INFO:tasks.workunit.client.1.smithi125.stdout:2/474: creat d1/d27/d1d/d25/f88 x:0 0 0 2024-02-19T19:12:18.941 INFO:tasks.workunit.client.1.smithi125.stdout:2/475: dread d1/d27/d1d/d25/f38 [1052672,12288] 0 2024-02-19T19:12:18.941 INFO:tasks.workunit.client.1.smithi125.stdout:2/476: symlink d1/d27/d1d/d25/d7f/l89 0 2024-02-19T19:12:18.941 INFO:tasks.workunit.client.1.smithi125.stdout:2/477: rmdir d1/d36/d70/d4b 39 2024-02-19T19:12:18.941 INFO:tasks.workunit.client.1.smithi125.stdout:2/478: chown d1/d27/d1d/d2c/l6b 3999 1 2024-02-19T19:12:18.945 INFO:tasks.workunit.client.1.smithi125.stdout:6/577: dwrite d6/db/d5d/d63/f75 [688128,81920] 0 2024-02-19T19:12:18.945 INFO:tasks.workunit.client.1.smithi125.stdout:6/578: mkdir d6/db/d5d/d2f/d7b/d8d/dbc 0 2024-02-19T19:12:18.945 INFO:tasks.workunit.client.1.smithi125.stdout:0/564: dwrite d5/d19/d27/f8e [1470464,36864] 0 2024-02-19T19:12:18.945 INFO:tasks.workunit.client.1.smithi125.stdout:0/565: readlink d5/la6 0 2024-02-19T19:12:18.946 INFO:tasks.workunit.client.1.smithi125.stdout:2/479: dwrite d1/d36/d70/d4b/d64/f79 [790528,73728] 0 2024-02-19T19:12:18.949 INFO:tasks.workunit.client.1.smithi125.stdout:6/579: dread d6/db/d5d/f40 [1904640,122880] 0 2024-02-19T19:12:18.949 INFO:tasks.workunit.client.1.smithi125.stdout:2/480: rename d1/f52 to d1/d36/d70/f8a 0 2024-02-19T19:12:18.949 INFO:tasks.workunit.client.1.smithi125.stdout:6/580: creat d6/db/d5d/d2f/d45/d4e/d6b/fbd x:0 0 0 2024-02-19T19:12:18.949 INFO:tasks.workunit.client.1.smithi125.stdout:2/481: read d1/d27/d1d/d2c/d2e/f6c [52320,109209] 0 2024-02-19T19:12:18.949 INFO:tasks.workunit.client.1.smithi125.stdout:2/482: mknod d1/d36/d70/c8b 0 2024-02-19T19:12:18.949 INFO:tasks.workunit.client.1.smithi125.stdout:2/483: rmdir d1/d27/d1d/d2c 39 2024-02-19T19:12:18.949 INFO:tasks.workunit.client.1.smithi125.stdout:2/484: symlink d1/d36/d70/l8c 0 2024-02-19T19:12:18.949 INFO:tasks.workunit.client.1.smithi125.stdout:2/485: symlink d1/d27/d1d/d25/l8d 0 2024-02-19T19:12:18.950 INFO:tasks.workunit.client.1.smithi125.stdout:2/486: creat d1/d27/d1d/d16/f8e x:0 0 0 2024-02-19T19:12:18.950 INFO:tasks.workunit.client.1.smithi125.stdout:2/487: chown d1/d27/d1d/d2c 8136648 1 2024-02-19T19:12:18.950 INFO:tasks.workunit.client.1.smithi125.stdout:2/488: rmdir d1/d27/d1d/d2c 39 2024-02-19T19:12:19.042 INFO:tasks.workunit.client.1.smithi125.stdout:6/581: dwrite d6/db/d5d/d63/f75 [61440,36864] 0 2024-02-19T19:12:19.043 INFO:tasks.workunit.client.1.smithi125.stdout:2/489: dwrite d1/d27/d1d/f2b [2203648,20480] 0 2024-02-19T19:12:19.043 INFO:tasks.workunit.client.1.smithi125.stdout:2/490: dread - d1/d36/d70/f8a zero size 2024-02-19T19:12:19.107 INFO:tasks.workunit.client.1.smithi125.stdout:6/582: dwrite d6/db/f17 [1622016,90112] 0 2024-02-19T19:12:19.108 INFO:tasks.workunit.client.1.smithi125.stdout:6/583: dread d6/db/f17 [1597440,8192] 0 2024-02-19T19:12:19.108 INFO:tasks.workunit.client.1.smithi125.stdout:6/584: chown d6/db/d5d/d63 100828 1 2024-02-19T19:12:19.110 INFO:tasks.workunit.client.1.smithi125.stdout:6/585: getdents d6/db/d5d/d2f 0 2024-02-19T19:12:19.110 INFO:tasks.workunit.client.1.smithi125.stdout:6/586: write d6/db/df/f12 [3120852,45795] 0 2024-02-19T19:12:19.110 INFO:tasks.workunit.client.1.smithi125.stdout:6/587: chown d6/db/df/dbb 28745491 1 2024-02-19T19:12:19.110 INFO:tasks.workunit.client.1.smithi125.stdout:6/588: chown d6/db/d5d/d29/f2d 19 1 2024-02-19T19:12:19.189 INFO:tasks.workunit.client.1.smithi125.stdout:6/589: fsync d6/db/d49/d4c/f74 0 2024-02-19T19:12:19.190 INFO:tasks.workunit.client.1.smithi125.stdout:3/437: sync 2024-02-19T19:12:19.191 INFO:tasks.workunit.client.1.smithi125.stdout:3/438: creat d0/d1/d1e/d60/f85 x:0 0 0 2024-02-19T19:12:19.191 INFO:tasks.workunit.client.1.smithi125.stdout:3/439: chown d0/de/f6c 606 1 2024-02-19T19:12:19.194 INFO:tasks.workunit.client.1.smithi125.stdout:6/590: rename d6/l58 to d6/db/d5d/d2f/d45/d4e/d6b/lbe 0 2024-02-19T19:12:19.194 INFO:tasks.workunit.client.1.smithi125.stdout:6/591: stat d6/db/d5d/d93/da2/lad 0 2024-02-19T19:12:19.195 INFO:tasks.workunit.client.1.smithi125.stdout:6/592: mknod d6/db/d5d/d2f/d7b/d8d/cbf 0 2024-02-19T19:12:19.195 INFO:tasks.workunit.client.1.smithi125.stdout:6/593: chown d6/db/df/d3b/c87 11993 1 2024-02-19T19:12:19.195 INFO:tasks.workunit.client.1.smithi125.stdout:6/594: mknod d6/db/d5d/d2f/d7b/cc0 0 2024-02-19T19:12:19.197 INFO:tasks.workunit.client.1.smithi125.stdout:3/440: dwrite d0/d1/d1e/f1f [2101248,126976] 0 2024-02-19T19:12:19.197 INFO:tasks.workunit.client.1.smithi125.stdout:3/441: creat d0/d1/d4b/d52/d81/f86 x:0 0 0 2024-02-19T19:12:19.197 INFO:tasks.workunit.client.1.smithi125.stdout:3/442: mkdir d0/d1/d87 0 2024-02-19T19:12:19.198 INFO:tasks.workunit.client.1.smithi125.stdout:3/443: mknod d0/d1/d39/c88 0 2024-02-19T19:12:19.341 INFO:tasks.workunit.client.1.smithi125.stdout:6/595: fsync d6/db/df/d3b/f5a 0 2024-02-19T19:12:19.341 INFO:tasks.workunit.client.1.smithi125.stdout:6/596: link d6/db/d5d/d29/f2d d6/db/d5d/d29/d68/fc1 0 2024-02-19T19:12:19.342 INFO:tasks.workunit.client.1.smithi125.stdout:6/597: dread - d6/db/d5d/d29/f91 zero size 2024-02-19T19:12:19.342 INFO:tasks.workunit.client.1.smithi125.stdout:6/598: mknod d6/db/d5d/d2f/d7b/cc2 0 2024-02-19T19:12:19.342 INFO:tasks.workunit.client.1.smithi125.stdout:6/599: mknod d6/db/d5d/d29/cc3 0 2024-02-19T19:12:19.342 INFO:tasks.workunit.client.1.smithi125.stdout:6/600: chown d6/db/df/f51 1 1 2024-02-19T19:12:19.342 INFO:tasks.workunit.client.1.smithi125.stdout:6/601: readlink d6/db/df/d3b/l50 0 2024-02-19T19:12:19.342 INFO:tasks.workunit.client.1.smithi125.stdout:6/602: rmdir d6/db/df 39 2024-02-19T19:12:19.342 INFO:tasks.workunit.client.1.smithi125.stdout:6/603: chown d6/db/d5d/d2f/d7b/d8d/dbc 144 1 2024-02-19T19:12:19.342 INFO:tasks.workunit.client.1.smithi125.stdout:6/604: truncate d6/f1e 821133 0 2024-02-19T19:12:19.343 INFO:tasks.workunit.client.1.smithi125.stdout:6/605: dread - d6/db/d5d/d2f/d45/f89 zero size 2024-02-19T19:12:19.343 INFO:tasks.workunit.client.1.smithi125.stdout:6/606: mkdir d6/db/d5d/dc4 0 2024-02-19T19:12:19.343 INFO:tasks.workunit.client.1.smithi125.stdout:6/607: write d6/db/d98/fb9 [509570,109297] 0 2024-02-19T19:12:19.343 INFO:tasks.workunit.client.1.smithi125.stdout:6/608: truncate d6/db/d49/fa5 493100 0 2024-02-19T19:12:19.343 INFO:tasks.workunit.client.1.smithi125.stdout:6/609: dread - d6/db/d5d/f6e zero size 2024-02-19T19:12:19.343 INFO:tasks.workunit.client.1.smithi125.stdout:6/610: read - d6/db/d5d/d2f/d7b/f8f zero size 2024-02-19T19:12:19.343 INFO:tasks.workunit.client.1.smithi125.stdout:6/611: creat d6/db/d5d/d29/fc5 x:0 0 0 2024-02-19T19:12:19.343 INFO:tasks.workunit.client.1.smithi125.stdout:6/612: creat d6/db/d5d/d29/fc6 x:0 0 0 2024-02-19T19:12:19.343 INFO:tasks.workunit.client.1.smithi125.stdout:6/613: truncate d6/db/d5d/f82 61789 0 2024-02-19T19:12:19.344 INFO:tasks.workunit.client.1.smithi125.stdout:6/614: dread - d6/db/da7/fb2 zero size 2024-02-19T19:12:19.344 INFO:tasks.workunit.client.1.smithi125.stdout:1/670: sync 2024-02-19T19:12:19.344 INFO:tasks.workunit.client.1.smithi125.stdout:5/760: sync 2024-02-19T19:12:19.407 INFO:tasks.workunit.client.1.smithi125.stdout:5/761: fsync db/d47/f5f 0 2024-02-19T19:12:19.407 INFO:tasks.workunit.client.1.smithi125.stdout:5/762: chown db/d17/d58/d4f/c6c 248331023 1 2024-02-19T19:12:19.407 INFO:tasks.workunit.client.1.smithi125.stdout:1/671: fdatasync d1/dc/f72 0 2024-02-19T19:12:19.407 INFO:tasks.workunit.client.1.smithi125.stdout:6/615: fdatasync d6/db/d5d/d2f/d45/d4e/d6b/fbd 0 2024-02-19T19:12:19.407 INFO:tasks.workunit.client.1.smithi125.stdout:1/672: chown d1/d26/d23/f2d 687992819 1 2024-02-19T19:12:19.407 INFO:tasks.workunit.client.1.smithi125.stdout:1/673: dread - d1/f9b zero size 2024-02-19T19:12:19.407 INFO:tasks.workunit.client.1.smithi125.stdout:1/674: chown d1/dc/d36/d39/f5f 17 1 2024-02-19T19:12:19.408 INFO:tasks.workunit.client.1.smithi125.stdout:6/616: write d6/db/fba [814815,29693] 0 2024-02-19T19:12:19.420 INFO:tasks.workunit.client.1.smithi125.stdout:5/763: fdatasync db/f34 0 2024-02-19T19:12:19.420 INFO:tasks.workunit.client.1.smithi125.stdout:5/764: stat db/d17/f22 0 2024-02-19T19:12:19.420 INFO:tasks.workunit.client.1.smithi125.stdout:1/675: fsync d1/d26/d23/f2d 0 2024-02-19T19:12:19.421 INFO:tasks.workunit.client.1.smithi125.stdout:6/617: dwrite d6/db/df/d3b/f9d [479232,32768] 0 2024-02-19T19:12:19.421 INFO:tasks.workunit.client.1.smithi125.stdout:6/618: symlink d6/db/d5d/d93/lc7 0 2024-02-19T19:12:19.421 INFO:tasks.workunit.client.1.smithi125.stdout:6/619: stat d6/db/df/d16/d7e/fb1 0 2024-02-19T19:12:19.424 INFO:tasks.workunit.client.1.smithi125.stdout:1/676: mknod d1/d78/cdc 0 2024-02-19T19:12:19.424 INFO:tasks.workunit.client.1.smithi125.stdout:1/677: chown d1/c16 1532751522 1 2024-02-19T19:12:19.425 INFO:tasks.workunit.client.1.smithi125.stdout:6/620: dwrite d6/db/d5d/d2f/d7b/f8f [401408,32768] 0 2024-02-19T19:12:19.425 INFO:tasks.workunit.client.1.smithi125.stdout:6/621: stat d6/db/d5d/f6e 0 2024-02-19T19:12:19.425 INFO:tasks.workunit.client.1.smithi125.stdout:6/622: mknod d6/db/d5d/cc8 0 2024-02-19T19:12:19.487 INFO:tasks.workunit.client.1.smithi125.stdout:6/623: fdatasync d6/db/df/d3b/f79 0 2024-02-19T19:12:19.491 INFO:tasks.workunit.client.1.smithi125.stdout:6/624: creat d6/db/d49/d4c/fc9 x:0 0 0 2024-02-19T19:12:19.555 INFO:tasks.workunit.client.1.smithi125.stdout:6/625: dwrite d6/db/d5d/f2a [1351680,20480] 0 2024-02-19T19:12:19.555 INFO:tasks.workunit.client.1.smithi125.stdout:6/626: dread d6/db/d49/d4c/f92 [208896,86016] 0 2024-02-19T19:12:19.608 INFO:tasks.workunit.client.1.smithi125.stdout:6/627: dwrite d6/db/df/d3b/f3c [819200,86016] 0 2024-02-19T19:12:19.609 INFO:tasks.workunit.client.1.smithi125.stdout:6/628: creat d6/db/d5d/d93/da2/fca x:0 0 0 2024-02-19T19:12:19.609 INFO:tasks.workunit.client.1.smithi125.stdout:6/629: mknod d6/db/df/d16/ccb 0 2024-02-19T19:12:19.609 INFO:tasks.workunit.client.1.smithi125.stdout:6/630: dread - d6/db/d5d/f6e zero size 2024-02-19T19:12:19.609 INFO:tasks.workunit.client.1.smithi125.stdout:4/519: sync 2024-02-19T19:12:19.609 INFO:tasks.workunit.client.1.smithi125.stdout:6/631: dread - d6/db/d49/d4c/fc9 zero size 2024-02-19T19:12:19.609 INFO:tasks.workunit.client.1.smithi125.stdout:6/632: readlink d6/db/d5d/d2f/la6 0 2024-02-19T19:12:19.638 INFO:tasks.workunit.client.1.smithi125.stdout:6/633: mkdir d6/db/df/d3b/dcc 0 2024-02-19T19:12:19.638 INFO:tasks.workunit.client.1.smithi125.stdout:6/634: creat d6/db/df/d16/d7e/fcd x:0 0 0 2024-02-19T19:12:19.640 INFO:tasks.workunit.client.1.smithi125.stdout:0/566: sync 2024-02-19T19:12:19.641 INFO:tasks.workunit.client.1.smithi125.stdout:1/678: sync 2024-02-19T19:12:19.641 INFO:tasks.workunit.client.1.smithi125.stdout:2/491: sync 2024-02-19T19:12:19.641 INFO:tasks.workunit.client.1.smithi125.stdout:5/765: sync 2024-02-19T19:12:19.641 INFO:tasks.workunit.client.1.smithi125.stdout:1/679: chown d1/d78/d8a 1156 1 2024-02-19T19:12:19.641 INFO:tasks.workunit.client.1.smithi125.stdout:8/496: sync 2024-02-19T19:12:19.641 INFO:tasks.workunit.client.1.smithi125.stdout:7/553: sync 2024-02-19T19:12:19.641 INFO:tasks.workunit.client.1.smithi125.stdout:1/680: truncate d1/dc/d36/f54 1486075 0 2024-02-19T19:12:19.641 INFO:tasks.workunit.client.1.smithi125.stdout:1/681: chown d1/d26/d3c/c95 971239 1 2024-02-19T19:12:19.642 INFO:tasks.workunit.client.1.smithi125.stdout:2/492: creat d1/d27/f8f x:0 0 0 2024-02-19T19:12:19.642 INFO:tasks.workunit.client.1.smithi125.stdout:5/766: getdents db/d17/d58 0 2024-02-19T19:12:19.642 INFO:tasks.workunit.client.1.smithi125.stdout:0/567: symlink d5/d19/d27/lc6 0 2024-02-19T19:12:19.642 INFO:tasks.workunit.client.1.smithi125.stdout:2/493: creat d1/d27/d1d/d2c/d2e/f90 x:0 0 0 2024-02-19T19:12:19.642 INFO:tasks.workunit.client.1.smithi125.stdout:8/497: write db/d18/d30/d48/f51 [576901,69245] 0 2024-02-19T19:12:19.642 INFO:tasks.workunit.client.1.smithi125.stdout:5/767: write db/d26/d51/f99 [972965,63123] 0 2024-02-19T19:12:19.642 INFO:tasks.workunit.client.1.smithi125.stdout:2/494: mkdir d1/d36/d70/d4b/d64/d7b/d91 0 2024-02-19T19:12:19.642 INFO:tasks.workunit.client.1.smithi125.stdout:3/444: sync 2024-02-19T19:12:19.643 INFO:tasks.workunit.client.1.smithi125.stdout:9/585: sync 2024-02-19T19:12:19.643 INFO:tasks.workunit.client.1.smithi125.stdout:1/682: write d1/d78/d80/f5d [1300681,99842] 0 2024-02-19T19:12:19.643 INFO:tasks.workunit.client.1.smithi125.stdout:5/768: dread db/d17/d58/d33/d53/dd5/fdf [102400,20480] 0 2024-02-19T19:12:19.643 INFO:tasks.workunit.client.1.smithi125.stdout:2/495: creat d1/d27/d1d/d2c/d2e/f92 x:0 0 0 2024-02-19T19:12:19.643 INFO:tasks.workunit.client.1.smithi125.stdout:1/683: rmdir d1/d78/d80 39 2024-02-19T19:12:19.643 INFO:tasks.workunit.client.1.smithi125.stdout:5/769: dread db/d17/d58/f6e [630784,65536] 0 2024-02-19T19:12:19.643 INFO:tasks.workunit.client.1.smithi125.stdout:8/498: rename db/d18/d30/d3c/d88 to db/d18/d30/d80/d9e/da3 0 2024-02-19T19:12:19.643 INFO:tasks.workunit.client.1.smithi125.stdout:1/684: truncate d1/f14 4888891 0 2024-02-19T19:12:19.643 INFO:tasks.workunit.client.1.smithi125.stdout:2/496: creat d1/d27/d1d/d25/d7f/f93 x:0 0 0 2024-02-19T19:12:19.644 INFO:tasks.workunit.client.1.smithi125.stdout:9/586: creat d8/d15/d9d/fd1 x:0 0 0 2024-02-19T19:12:19.644 INFO:tasks.workunit.client.1.smithi125.stdout:2/497: dread - d1/d36/d70/d4b/d64/f80 zero size 2024-02-19T19:12:19.644 INFO:tasks.workunit.client.1.smithi125.stdout:1/685: mkdir d1/d1a/d3d/d6e/d87/ddd 0 2024-02-19T19:12:19.644 INFO:tasks.workunit.client.1.smithi125.stdout:9/587: mknod d8/d15/d32/d4f/d85/dcb/cd2 0 2024-02-19T19:12:19.644 INFO:tasks.workunit.client.1.smithi125.stdout:2/498: mknod d1/d27/d1d/d25/d2a/c94 0 2024-02-19T19:12:19.644 INFO:tasks.workunit.client.1.smithi125.stdout:9/588: readlink d8/d15/d32/l1e 0 2024-02-19T19:12:19.644 INFO:tasks.workunit.client.1.smithi125.stdout:1/686: mknod d1/da3/cde 0 2024-02-19T19:12:19.644 INFO:tasks.workunit.client.1.smithi125.stdout:2/499: link d1/d27/d45/d7a/f7d d1/d27/d45/d7a/f95 0 2024-02-19T19:12:19.644 INFO:tasks.workunit.client.1.smithi125.stdout:1/687: rmdir d1/d78/d80 39 2024-02-19T19:12:19.645 INFO:tasks.workunit.client.1.smithi125.stdout:5/770: write db/d17/d58/d4f/dad/fb2 [358897,81860] 0 2024-02-19T19:12:19.645 INFO:tasks.workunit.client.1.smithi125.stdout:5/771: creat db/d47/d52/fee x:0 0 0 2024-02-19T19:12:19.645 INFO:tasks.workunit.client.1.smithi125.stdout:5/772: creat db/d47/d52/fef x:0 0 0 2024-02-19T19:12:19.645 INFO:tasks.workunit.client.1.smithi125.stdout:5/773: creat db/d26/ff0 x:0 0 0 2024-02-19T19:12:19.645 INFO:tasks.workunit.client.1.smithi125.stdout:5/774: truncate db/d26/d51/fcb 966844 0 2024-02-19T19:12:19.645 INFO:tasks.workunit.client.1.smithi125.stdout:5/775: dread db/f34 [561152,77824] 0 2024-02-19T19:12:19.645 INFO:tasks.workunit.client.1.smithi125.stdout:5/776: chown db/d26/d51/lc1 23038 1 2024-02-19T19:12:19.706 INFO:tasks.workunit.client.1.smithi125.stdout:4/520: fsync d0/d7/d30/d42/d7b/f99 0 2024-02-19T19:12:19.706 INFO:tasks.workunit.client.1.smithi125.stdout:4/521: write d0/d32/d60/f7e [509098,92444] 0 2024-02-19T19:12:19.707 INFO:tasks.workunit.client.1.smithi125.stdout:5/777: fdatasync db/d47/d52/d5d/f7b 0 2024-02-19T19:12:19.707 INFO:tasks.workunit.client.1.smithi125.stdout:5/778: getdents db/d17/d58/d33/d98/d9c 0 2024-02-19T19:12:19.707 INFO:tasks.workunit.client.1.smithi125.stdout:5/779: mkdir db/d17/d58/d33/d64/df1 0 2024-02-19T19:12:19.707 INFO:tasks.workunit.client.1.smithi125.stdout:5/780: chown db/d17/d58/d4f/f7a 6007 1 2024-02-19T19:12:19.707 INFO:tasks.workunit.client.1.smithi125.stdout:5/781: rename db/lec to db/d17/d58/d33/d53/lf2 0 2024-02-19T19:12:19.707 INFO:tasks.workunit.client.1.smithi125.stdout:6/635: dwrite d6/db/d5d/d29/d68/fc1 [1486848,4096] 0 2024-02-19T19:12:19.707 INFO:tasks.workunit.client.1.smithi125.stdout:6/636: readlink d6/db/df/d16/l1c 0 2024-02-19T19:12:19.707 INFO:tasks.workunit.client.1.smithi125.stdout:6/637: write d6/db/df/d16/d7e/fcd [813706,61233] 0 2024-02-19T19:12:19.708 INFO:tasks.workunit.client.1.smithi125.stdout:6/638: truncate d6/db/df/f14 3278119 0 2024-02-19T19:12:19.710 INFO:tasks.workunit.client.1.smithi125.stdout:0/568: dwrite d5/d19/d27/f8c [491520,86016] 0 2024-02-19T19:12:19.711 INFO:tasks.workunit.client.1.smithi125.stdout:2/500: dwrite d1/d36/d70/d4b/d64/f80 [843776,90112] 0 2024-02-19T19:12:19.711 INFO:tasks.workunit.client.1.smithi125.stdout:2/501: creat d1/d27/d1d/f96 x:0 0 0 2024-02-19T19:12:19.711 INFO:tasks.workunit.client.1.smithi125.stdout:2/502: creat d1/d36/d70/d4b/d64/d7b/d91/f97 x:0 0 0 2024-02-19T19:12:19.711 INFO:tasks.workunit.client.1.smithi125.stdout:2/503: mknod d1/d36/d70/d4b/d64/d7b/d91/c98 0 2024-02-19T19:12:19.711 INFO:tasks.workunit.client.1.smithi125.stdout:7/554: dwrite d12/d18/d2c/d4e/f99 [307200,94208] 0 2024-02-19T19:12:19.711 INFO:tasks.workunit.client.1.smithi125.stdout:7/555: write d12/d18/d44/d51/f64 [787283,44132] 0 2024-02-19T19:12:19.711 INFO:tasks.workunit.client.1.smithi125.stdout:7/556: dread d12/d18/d44/d51/f56 [266240,86016] 0 2024-02-19T19:12:19.711 INFO:tasks.workunit.client.1.smithi125.stdout:7/557: creat d12/d18/d44/d3b/d59/d2a/d31/d50/fa1 x:0 0 0 2024-02-19T19:12:19.712 INFO:tasks.workunit.client.1.smithi125.stdout:7/558: chown d12/d18/d44/d3b/d59/d26/d54/f5b 429 1 2024-02-19T19:12:19.712 INFO:tasks.workunit.client.1.smithi125.stdout:7/559: chown d12/c22 0 1 2024-02-19T19:12:19.712 INFO:tasks.workunit.client.1.smithi125.stdout:7/560: creat d12/d18/d44/d3b/d59/d26/d30/d37/fa2 x:0 0 0 2024-02-19T19:12:19.712 INFO:tasks.workunit.client.1.smithi125.stdout:3/445: dwrite d0/d5f/d71/f7f [90112,118784] 0 2024-02-19T19:12:19.712 INFO:tasks.workunit.client.1.smithi125.stdout:3/446: creat d0/d1/d1e/d60/d73/d74/d82/f89 x:0 0 0 2024-02-19T19:12:19.712 INFO:tasks.workunit.client.1.smithi125.stdout:8/499: dwrite db/d18/d30/d48/f7a [344064,94208] 0 2024-02-19T19:12:19.712 INFO:tasks.workunit.client.1.smithi125.stdout:8/500: rmdir db 39 2024-02-19T19:12:19.712 INFO:tasks.workunit.client.1.smithi125.stdout:8/501: stat db/d18/d30/d80/f97 0 2024-02-19T19:12:19.713 INFO:tasks.workunit.client.1.smithi125.stdout:8/502: truncate db/d18/f2d 3354054 0 2024-02-19T19:12:19.713 INFO:tasks.workunit.client.1.smithi125.stdout:8/503: readlink db/d18/d2f/l69 0 2024-02-19T19:12:19.713 INFO:tasks.workunit.client.1.smithi125.stdout:1/688: dwrite d1/d1a/f2a [139264,24576] 0 2024-02-19T19:12:19.713 INFO:tasks.workunit.client.1.smithi125.stdout:1/689: chown d1/dc/d36/d39/f3a 461675 1 2024-02-19T19:12:19.713 INFO:tasks.workunit.client.1.smithi125.stdout:1/690: write d1/d78/d8a/fb6 [690835,60920] 0 2024-02-19T19:12:19.713 INFO:tasks.workunit.client.1.smithi125.stdout:1/691: creat d1/d26/fdf x:0 0 0 2024-02-19T19:12:19.713 INFO:tasks.workunit.client.1.smithi125.stdout:9/589: dwrite d8/d2e/d4c/d96/fd0 [638976,61440] 0 2024-02-19T19:12:19.713 INFO:tasks.workunit.client.1.smithi125.stdout:9/590: mknod d8/d15/d32/d4f/d6e/d99/cd3 0 2024-02-19T19:12:19.713 INFO:tasks.workunit.client.1.smithi125.stdout:9/591: write d8/d15/d22/d4e/f3b [2918503,63541] 0 2024-02-19T19:12:19.714 INFO:tasks.workunit.client.1.smithi125.stdout:9/592: write d8/d15/d9d/fd1 [703242,110172] 0 2024-02-19T19:12:19.714 INFO:tasks.workunit.client.1.smithi125.stdout:9/593: link d8/d15/d32/d4f/d85/ca0 d8/d2e/d4c/cd4 0 2024-02-19T19:12:19.714 INFO:tasks.workunit.client.1.smithi125.stdout:9/594: creat d8/d2e/fd5 x:0 0 0 2024-02-19T19:12:19.714 INFO:tasks.workunit.client.1.smithi125.stdout:9/595: rename d8/d2e/fd5 to d8/d2e/d4c/d84/fd6 0 2024-02-19T19:12:19.735 INFO:tasks.workunit.client.1.smithi125.stdout:4/522: fsync d0/d7/d30/d42/d7b/fb0 0 2024-02-19T19:12:19.735 INFO:tasks.workunit.client.1.smithi125.stdout:4/523: truncate d0/d7/d30/d42/f78 222729 0 2024-02-19T19:12:19.735 INFO:tasks.workunit.client.1.smithi125.stdout:0/569: fdatasync d5/d9/f26 0 2024-02-19T19:12:19.735 INFO:tasks.workunit.client.1.smithi125.stdout:3/447: fsync d0/d1/d4b/f67 0 2024-02-19T19:12:19.735 INFO:tasks.workunit.client.1.smithi125.stdout:0/570: readlink d5/d19/d6c/lb2 0 2024-02-19T19:12:19.736 INFO:tasks.workunit.client.1.smithi125.stdout:3/448: write d0/de/f61 [816593,81389] 0 2024-02-19T19:12:19.736 INFO:tasks.workunit.client.1.smithi125.stdout:3/449: creat d0/d1/d4b/d52/f8a x:0 0 0 2024-02-19T19:12:19.736 INFO:tasks.workunit.client.1.smithi125.stdout:3/450: creat d0/d1/d39/f8b x:0 0 0 2024-02-19T19:12:19.736 INFO:tasks.workunit.client.1.smithi125.stdout:3/451: truncate d0/d5f/d71/f7f 1370505 0 2024-02-19T19:12:19.736 INFO:tasks.workunit.client.1.smithi125.stdout:3/452: chown d0/d1/d1e 3 1 2024-02-19T19:12:19.736 INFO:tasks.workunit.client.1.smithi125.stdout:3/453: rename d0/d1/d39/c6f to d0/de/c8c 0 2024-02-19T19:12:19.736 INFO:tasks.workunit.client.1.smithi125.stdout:3/454: dread d0/d1/d1e/f5d [479232,8192] 0 2024-02-19T19:12:19.736 INFO:tasks.workunit.client.1.smithi125.stdout:5/782: dwrite db/d47/d52/d5d/fb7 [278528,69632] 0 2024-02-19T19:12:19.736 INFO:tasks.workunit.client.1.smithi125.stdout:5/783: readlink db/le3 0 2024-02-19T19:12:19.737 INFO:tasks.workunit.client.1.smithi125.stdout:5/784: rename db/d17/d58/d33/d64/c8b to db/d17/d58/d33/d53/cf3 0 2024-02-19T19:12:19.737 INFO:tasks.workunit.client.1.smithi125.stdout:5/785: creat db/d26/ff4 x:0 0 0 2024-02-19T19:12:19.737 INFO:tasks.workunit.client.1.smithi125.stdout:5/786: write db/d26/ff4 [477894,57600] 0 2024-02-19T19:12:19.737 INFO:tasks.workunit.client.1.smithi125.stdout:5/787: chown db/d17/d58/l83 0 1 2024-02-19T19:12:19.737 INFO:tasks.workunit.client.1.smithi125.stdout:5/788: rename db/d17/d58/d33/d64 to db/d17/d58/d33/d64/df5 22 2024-02-19T19:12:19.737 INFO:tasks.workunit.client.1.smithi125.stdout:5/789: rename db/d17/d58/f1f to db/d17/d58/d4f/ff6 0 2024-02-19T19:12:19.737 INFO:tasks.workunit.client.1.smithi125.stdout:5/790: rename db/d17/f57 to db/d17/d58/d33/d53/dce/ff7 0 2024-02-19T19:12:19.737 INFO:tasks.workunit.client.1.smithi125.stdout:5/791: mkdir db/d17/d58/d33/d98/dae/df8 0 2024-02-19T19:12:19.740 INFO:tasks.workunit.client.1.smithi125.stdout:6/639: dwrite d6/db/d5d/d2f/f86 [2166784,32768] 0 2024-02-19T19:12:19.740 INFO:tasks.workunit.client.1.smithi125.stdout:6/640: creat d6/fce x:0 0 0 2024-02-19T19:12:19.740 INFO:tasks.workunit.client.1.smithi125.stdout:6/641: stat d6/f9 0 2024-02-19T19:12:19.740 INFO:tasks.workunit.client.1.smithi125.stdout:2/504: dwrite d1/d27/f22 [901120,77824] 0 2024-02-19T19:12:19.740 INFO:tasks.workunit.client.1.smithi125.stdout:1/692: dwrite d1/d1a/d3d/d6e/d4b/fd5 [319488,126976] 0 2024-02-19T19:12:19.741 INFO:tasks.workunit.client.1.smithi125.stdout:1/693: symlink d1/da3/le0 0 2024-02-19T19:12:19.741 INFO:tasks.workunit.client.1.smithi125.stdout:1/694: readlink d1/d26/d3c/l56 0 2024-02-19T19:12:19.741 INFO:tasks.workunit.client.1.smithi125.stdout:7/561: dread d12/d3d/f69 [90112,94208] 0 2024-02-19T19:12:19.741 INFO:tasks.workunit.client.1.smithi125.stdout:7/562: getdents d12/d18/d63 0 2024-02-19T19:12:19.741 INFO:tasks.workunit.client.1.smithi125.stdout:7/563: chown d12/d18/d44/d3b/d59/f5e 2105 1 2024-02-19T19:12:19.741 INFO:tasks.workunit.client.1.smithi125.stdout:7/564: creat d12/d18/d44/d3b/d59/d26/d30/d97/fa3 x:0 0 0 2024-02-19T19:12:19.741 INFO:tasks.workunit.client.1.smithi125.stdout:7/565: write d12/d18/d44/d3b/d59/d26/d30/f88 [1467996,2151] 0 2024-02-19T19:12:19.741 INFO:tasks.workunit.client.1.smithi125.stdout:7/566: dread d12/d18/d2c/f76 [319488,45056] 0 2024-02-19T19:12:19.742 INFO:tasks.workunit.client.1.smithi125.stdout:7/567: creat d12/d18/d44/d3b/d59/d2a/d31/d50/d60/fa4 x:0 0 0 2024-02-19T19:12:19.742 INFO:tasks.workunit.client.1.smithi125.stdout:7/568: creat d12/d18/d44/d3b/d59/d2a/fa5 x:0 0 0 2024-02-19T19:12:19.742 INFO:tasks.workunit.client.1.smithi125.stdout:7/569: mknod d12/d18/d44/d3b/d59/d2a/d31/d50/ca6 0 2024-02-19T19:12:19.742 INFO:tasks.workunit.client.1.smithi125.stdout:7/570: truncate d12/d18/f20 1926076 0 2024-02-19T19:12:19.742 INFO:tasks.workunit.client.1.smithi125.stdout:7/571: read d12/d18/d44/d51/d81/f83 [385292,122646] 0 2024-02-19T19:12:19.742 INFO:tasks.workunit.client.1.smithi125.stdout:7/572: unlink d12/d18/d44/d3b/d59/d2a/fa5 0 2024-02-19T19:12:19.742 INFO:tasks.workunit.client.1.smithi125.stdout:7/573: dread d12/d3d/f4f [401408,61440] 0 2024-02-19T19:12:19.742 INFO:tasks.workunit.client.1.smithi125.stdout:7/574: chown d12/d18/d44/d3b/d59/d2a/d31/c7b 447289 1 2024-02-19T19:12:19.742 INFO:tasks.workunit.client.1.smithi125.stdout:7/575: dread - d12/f7e zero size 2024-02-19T19:12:19.743 INFO:tasks.workunit.client.1.smithi125.stdout:7/576: dread - d12/d18/d44/d3b/d59/d2a/d31/d50/d60/fa4 zero size 2024-02-19T19:12:19.743 INFO:tasks.workunit.client.1.smithi125.stdout:5/792: dwrite db/d17/d58/d33/d53/dce/fd0 [266240,28672] 0 2024-02-19T19:12:19.743 INFO:tasks.workunit.client.1.smithi125.stdout:5/793: dread db/d17/d58/f72 [1376256,45056] 0 2024-02-19T19:12:19.743 INFO:tasks.workunit.client.1.smithi125.stdout:5/794: mknod db/d17/d58/d33/d91/cf9 0 2024-02-19T19:12:19.743 INFO:tasks.workunit.client.1.smithi125.stdout:5/795: getdents db/d17/d58/d4f/dad 0 2024-02-19T19:12:19.752 INFO:tasks.workunit.client.1.smithi125.stdout:8/504: dread db/f6b [643072,73728] 0 2024-02-19T19:12:19.752 INFO:tasks.workunit.client.1.smithi125.stdout:8/505: read db/d18/d30/d3c/d4d/f56 [1673958,41128] 0 2024-02-19T19:12:19.761 INFO:tasks.workunit.client.1.smithi125.stdout:4/524: dread d0/d7/d3b/f62 [1286144,77824] 0 2024-02-19T19:12:19.761 INFO:tasks.workunit.client.1.smithi125.stdout:4/525: rmdir d0/d32/d60 39 2024-02-19T19:12:19.804 INFO:tasks.workunit.client.1.smithi125.stdout:0/571: fdatasync d5/d15/d2c/f9c 0 2024-02-19T19:12:19.804 INFO:tasks.workunit.client.1.smithi125.stdout:6/642: fsync d6/db/d5d/f19 0 2024-02-19T19:12:19.804 INFO:tasks.workunit.client.1.smithi125.stdout:2/505: fsync d1/d36/f67 0 2024-02-19T19:12:19.805 INFO:tasks.workunit.client.1.smithi125.stdout:6/643: dread d6/db/d98/fb9 [249856,81920] 0 2024-02-19T19:12:19.809 INFO:tasks.workunit.client.1.smithi125.stdout:6/644: mknod d6/db/da7/ccf 0 2024-02-19T19:12:19.809 INFO:tasks.workunit.client.1.smithi125.stdout:6/645: unlink d6/db/d5d/d29/d68/cb4 0 2024-02-19T19:12:19.810 INFO:tasks.workunit.client.1.smithi125.stdout:6/646: chown d6/db/d5d/d2f/c5e 21144 1 2024-02-19T19:12:19.810 INFO:tasks.workunit.client.1.smithi125.stdout:1/695: dwrite d1/d26/f40 [1146880,94208] 0 2024-02-19T19:12:19.810 INFO:tasks.workunit.client.1.smithi125.stdout:8/506: truncate db/d18/d30/f43 1072611 0 2024-02-19T19:12:19.810 INFO:tasks.workunit.client.1.smithi125.stdout:1/696: truncate d1/faa 554163 0 2024-02-19T19:12:19.810 INFO:tasks.workunit.client.1.smithi125.stdout:8/507: dread db/d18/d30/d48/f57 [270336,32768] 0 2024-02-19T19:12:19.810 INFO:tasks.workunit.client.1.smithi125.stdout:1/697: unlink d1/d1a/d3d/fb9 0 2024-02-19T19:12:19.810 INFO:tasks.workunit.client.1.smithi125.stdout:1/698: dread d1/d26/d23/f55 [2363392,98304] 0 2024-02-19T19:12:19.810 INFO:tasks.workunit.client.1.smithi125.stdout:1/699: chown d1/d78/cdc 0 1 2024-02-19T19:12:19.811 INFO:tasks.workunit.client.1.smithi125.stdout:1/700: dread d1/dc/d36/d69/f81 [348160,122880] 0 2024-02-19T19:12:19.811 INFO:tasks.workunit.client.1.smithi125.stdout:1/701: mknod d1/d1a/d3d/d6e/d4b/ce1 0 2024-02-19T19:12:19.811 INFO:tasks.workunit.client.1.smithi125.stdout:1/702: mkdir d1/d1a/d3d/de2 0 2024-02-19T19:12:19.811 INFO:tasks.workunit.client.1.smithi125.stdout:1/703: dread - d1/dc/d36/d69/f7c zero size 2024-02-19T19:12:19.811 INFO:tasks.workunit.client.1.smithi125.stdout:2/506: dwrite d1/d27/d1d/d25/d7f/f93 [913408,57344] 0 2024-02-19T19:12:19.811 INFO:tasks.workunit.client.1.smithi125.stdout:2/507: dread - d1/d27/d1d/f96 zero size 2024-02-19T19:12:19.811 INFO:tasks.workunit.client.1.smithi125.stdout:2/508: write d1/d36/d70/d4b/d64/f79 [1180849,85227] 0 2024-02-19T19:12:19.811 INFO:tasks.workunit.client.1.smithi125.stdout:2/509: rmdir d1/d27/d45 39 2024-02-19T19:12:19.812 INFO:tasks.workunit.client.1.smithi125.stdout:2/510: readlink d1/d36/d70/d4b/l5e 0 2024-02-19T19:12:19.812 INFO:tasks.workunit.client.1.smithi125.stdout:2/511: readlink d1/d36/d70/d4b/l84 0 2024-02-19T19:12:19.812 INFO:tasks.workunit.client.1.smithi125.stdout:6/647: dwrite d6/db/d49/d4c/f66 [3657728,73728] 0 2024-02-19T19:12:19.812 INFO:tasks.workunit.client.1.smithi125.stdout:6/648: creat d6/db/d5d/d29/fd0 x:0 0 0 2024-02-19T19:12:19.812 INFO:tasks.workunit.client.1.smithi125.stdout:6/649: mkdir d6/db/d5d/d2f/d7b/d8d/dd1 0 2024-02-19T19:12:19.812 INFO:tasks.workunit.client.1.smithi125.stdout:6/650: creat d6/db/d5d/d2f/d45/d4e/d6b/fd2 x:0 0 0 2024-02-19T19:12:19.812 INFO:tasks.workunit.client.1.smithi125.stdout:6/651: creat d6/db/df/dbb/fd3 x:0 0 0 2024-02-19T19:12:19.812 INFO:tasks.workunit.client.1.smithi125.stdout:6/652: readlink d6/db/d5d/d2f/d45/d4e/l73 0 2024-02-19T19:12:19.813 INFO:tasks.workunit.client.1.smithi125.stdout:6/653: dread d6/db/f17 [1347584,86016] 0 2024-02-19T19:12:19.813 INFO:tasks.workunit.client.1.smithi125.stdout:6/654: creat d6/db/d5d/d2f/d45/d4e/d6b/fd4 x:0 0 0 2024-02-19T19:12:19.813 INFO:tasks.workunit.client.1.smithi125.stdout:6/655: creat d6/db/df/d3b/fd5 x:0 0 0 2024-02-19T19:12:19.813 INFO:tasks.workunit.client.1.smithi125.stdout:6/656: dread d6/db/d5d/d2f/f86 [622592,4096] 0 2024-02-19T19:12:19.813 INFO:tasks.workunit.client.1.smithi125.stdout:6/657: symlink d6/db/d5d/d63/ld6 0 2024-02-19T19:12:19.813 INFO:tasks.workunit.client.1.smithi125.stdout:6/658: write d6/db/d5d/f40 [1655077,12214] 0 2024-02-19T19:12:19.813 INFO:tasks.workunit.client.1.smithi125.stdout:6/659: truncate d6/db/df/d16/f5c 340907 0 2024-02-19T19:12:19.813 INFO:tasks.workunit.client.1.smithi125.stdout:6/660: symlink d6/ld7 0 2024-02-19T19:12:19.819 INFO:tasks.workunit.client.1.smithi125.stdout:4/526: dread d0/d32/f46 [913408,65536] 0 2024-02-19T19:12:19.866 INFO:tasks.workunit.client.1.smithi125.stdout:8/508: dwrite db/d18/d30/d3c/f68 [1216512,126976] 0 2024-02-19T19:12:19.866 INFO:tasks.workunit.client.1.smithi125.stdout:8/509: rename db/d18/d30/f82 to db/d18/d30/d80/fa4 0 2024-02-19T19:12:19.868 INFO:tasks.workunit.client.1.smithi125.stdout:1/704: dwrite d1/d1a/d3d/d6e/d87/fcd [290816,73728] 0 2024-02-19T19:12:19.869 INFO:tasks.workunit.client.1.smithi125.stdout:1/705: truncate f0 4636502 0 2024-02-19T19:12:19.869 INFO:tasks.workunit.client.1.smithi125.stdout:1/706: unlink d1/l5 0 2024-02-19T19:12:19.869 INFO:tasks.workunit.client.1.smithi125.stdout:1/707: creat d1/d78/d8a/fe3 x:0 0 0 2024-02-19T19:12:19.869 INFO:tasks.workunit.client.1.smithi125.stdout:1/708: symlink d1/d1a/d3d/d6e/le4 0 2024-02-19T19:12:19.869 INFO:tasks.workunit.client.1.smithi125.stdout:1/709: mknod d1/d1a/d3d/d6e/d87/ce5 0 2024-02-19T19:12:19.869 INFO:tasks.workunit.client.1.smithi125.stdout:1/710: chown d1/d26/d3c/c95 1015731 1 2024-02-19T19:12:19.875 INFO:tasks.workunit.client.1.smithi125.stdout:2/512: dread d1/d27/d1d/d2c/f31 [2064384,49152] 0 2024-02-19T19:12:19.875 INFO:tasks.workunit.client.1.smithi125.stdout:2/513: chown d1/d27/d1d/d25/d2a 802 1 2024-02-19T19:12:19.875 INFO:tasks.workunit.client.1.smithi125.stdout:2/514: write d1/d27/f5a [384296,3669] 0 2024-02-19T19:12:19.875 INFO:tasks.workunit.client.1.smithi125.stdout:2/515: chown d1/d27/d1d/l26 70649752 1 2024-02-19T19:12:19.875 INFO:tasks.workunit.client.1.smithi125.stdout:2/516: write d1/d27/d1d/d25/d2a/f86 [925945,111197] 0 2024-02-19T19:12:19.910 INFO:tasks.workunit.client.1.smithi125.stdout:0/572: fsync d5/d33/d42/f65 0 2024-02-19T19:12:19.910 INFO:tasks.workunit.client.1.smithi125.stdout:0/573: rename d5/d19/c41 to d5/d1a/d95/cc7 0 2024-02-19T19:12:19.911 INFO:tasks.workunit.client.1.smithi125.stdout:1/711: dwrite d1/d78/d8a/fab [1191936,86016] 0 2024-02-19T19:12:19.911 INFO:tasks.workunit.client.1.smithi125.stdout:2/517: dwrite d1/d27/f10 [1052672,16384] 0 2024-02-19T19:12:19.931 INFO:tasks.workunit.client.1.smithi125.stdout:8/510: fdatasync db/d18/d30/d3c/f53 0 2024-02-19T19:12:19.932 INFO:tasks.workunit.client.1.smithi125.stdout:6/661: fdatasync d6/db/d5d/d29/d68/f71 0 2024-02-19T19:12:19.932 INFO:tasks.workunit.client.1.smithi125.stdout:6/662: creat d6/db/d5d/fd8 x:0 0 0 2024-02-19T19:12:19.932 INFO:tasks.workunit.client.1.smithi125.stdout:1/712: dwrite d1/d26/d23/f68 [1486848,24576] 0 2024-02-19T19:12:19.932 INFO:tasks.workunit.client.1.smithi125.stdout:1/713: write d1/d26/d3c/d3f/f8d [861231,91651] 0 2024-02-19T19:12:19.932 INFO:tasks.workunit.client.1.smithi125.stdout:1/714: write d1/d1a/d3d/dd0/fd7 [981209,129658] 0 2024-02-19T19:12:19.933 INFO:tasks.workunit.client.1.smithi125.stdout:8/511: dwrite db/f38 [290816,40960] 0 2024-02-19T19:12:19.981 INFO:tasks.workunit.client.1.smithi125.stdout:0/574: fsync d5/d19/d27/f8e 0 2024-02-19T19:12:19.981 INFO:tasks.workunit.client.1.smithi125.stdout:6/663: fdatasync d6/db/d49/d4c/f92 0 2024-02-19T19:12:19.981 INFO:tasks.workunit.client.1.smithi125.stdout:2/518: fsync d1/d27/f11 0 2024-02-19T19:12:19.981 INFO:tasks.workunit.client.1.smithi125.stdout:1/715: fsync d1/d26/d3c/f64 0 2024-02-19T19:12:19.982 INFO:tasks.workunit.client.1.smithi125.stdout:2/519: dread d1/d27/d1d/d2c/f31 [471040,57344] 0 2024-02-19T19:12:19.983 INFO:tasks.workunit.client.1.smithi125.stdout:8/512: write db/d18/d30/d80/fa4 [657745,902] 0 2024-02-19T19:12:19.983 INFO:tasks.workunit.client.1.smithi125.stdout:2/520: getdents d1/d27/d1d/d2c 0 2024-02-19T19:12:19.983 INFO:tasks.workunit.client.1.smithi125.stdout:8/513: write db/d18/f62 [421411,22812] 0 2024-02-19T19:12:19.983 INFO:tasks.workunit.client.1.smithi125.stdout:1/716: truncate d1/dc/f2c 790753 0 2024-02-19T19:12:19.984 INFO:tasks.workunit.client.1.smithi125.stdout:6/664: write d6/db/d5d/f6e [178709,129439] 0 2024-02-19T19:12:19.984 INFO:tasks.workunit.client.1.smithi125.stdout:1/717: creat d1/dc/d36/d69/dc1/fe6 x:0 0 0 2024-02-19T19:12:19.984 INFO:tasks.workunit.client.1.smithi125.stdout:8/514: creat db/d18/d30/d80/d9e/da3/fa5 x:0 0 0 2024-02-19T19:12:19.984 INFO:tasks.workunit.client.1.smithi125.stdout:8/515: chown db/d18 27888 1 2024-02-19T19:12:19.984 INFO:tasks.workunit.client.1.smithi125.stdout:6/665: rename d6/db/df to d6/db/d5d/d2f/d45/dd9 0 2024-02-19T19:12:19.984 INFO:tasks.workunit.client.1.smithi125.stdout:8/516: rename db/l40 to db/d81/la6 0 2024-02-19T19:12:19.984 INFO:tasks.workunit.client.1.smithi125.stdout:6/666: rename d6/db/d5d/d2f/d45/dd9/d16/d7e to d6/db/d5d/d2f/d45/dd9/d3b/dda 0 2024-02-19T19:12:19.984 INFO:tasks.workunit.client.1.smithi125.stdout:6/667: dread - d6/fb0 zero size 2024-02-19T19:12:19.985 INFO:tasks.workunit.client.1.smithi125.stdout:8/517: rename db/f38 to db/d6d/fa7 0 2024-02-19T19:12:19.985 INFO:tasks.workunit.client.1.smithi125.stdout:6/668: chown d6/db/d5d/d2f/d45/dd9/d16/l57 496119 1 2024-02-19T19:12:19.985 INFO:tasks.workunit.client.1.smithi125.stdout:0/575: dwrite d5/d19/d2b/f7a [3436544,4096] 0 2024-02-19T19:12:20.080 INFO:tasks.workunit.client.1.smithi125.stdout:2/521: fdatasync d1/d27/d1d/d2c/f31 0 2024-02-19T19:12:20.081 INFO:tasks.workunit.client.1.smithi125.stdout:6/669: fdatasync d6/db/d5d/d2f/d45/d4e/f53 0 2024-02-19T19:12:20.081 INFO:tasks.workunit.client.1.smithi125.stdout:0/576: fdatasync d5/d33/d42/f45 0 2024-02-19T19:12:20.081 INFO:tasks.workunit.client.1.smithi125.stdout:6/670: truncate d6/db/d5d/d2f/d45/dd9/f51 1721804 0 2024-02-19T19:12:20.081 INFO:tasks.workunit.client.1.smithi125.stdout:6/671: dread d6/db/d49/d4c/f92 [708608,40960] 0 2024-02-19T19:12:20.081 INFO:tasks.workunit.client.1.smithi125.stdout:0/577: rename d5/d9/d75 to d5/d19/d27/d32/d70/dc2/dc8 0 2024-02-19T19:12:20.081 INFO:tasks.workunit.client.1.smithi125.stdout:6/672: mknod d6/db/d5d/dc4/cdb 0 2024-02-19T19:12:20.081 INFO:tasks.workunit.client.1.smithi125.stdout:0/578: creat d5/d15/d2c/d80/fc9 x:0 0 0 2024-02-19T19:12:20.082 INFO:tasks.workunit.client.1.smithi125.stdout:6/673: creat d6/db/d5d/d2f/d45/d4e/fdc x:0 0 0 2024-02-19T19:12:20.083 INFO:tasks.workunit.client.1.smithi125.stdout:0/579: dread d5/d33/d42/f61 [647168,57344] 0 2024-02-19T19:12:20.083 INFO:tasks.workunit.client.1.smithi125.stdout:6/674: dread d6/db/d5d/d29/f2d [774144,40960] 0 2024-02-19T19:12:20.083 INFO:tasks.workunit.client.1.smithi125.stdout:2/522: dwrite d1/d27/d1d/d25/f38 [1880064,28672] 0 2024-02-19T19:12:20.084 INFO:tasks.workunit.client.1.smithi125.stdout:0/580: unlink d5/d19/d27/d32/l59 0 2024-02-19T19:12:20.084 INFO:tasks.workunit.client.1.smithi125.stdout:0/581: link d5/d1a/d95/lbc d5/d1a/d4c/lca 0 2024-02-19T19:12:20.084 INFO:tasks.workunit.client.1.smithi125.stdout:2/523: rename d1/d27/d1d/d25/c53 to d1/d36/d70/d4b/d64/c99 0 2024-02-19T19:12:20.084 INFO:tasks.workunit.client.1.smithi125.stdout:6/675: write d6/db/fba [1252430,77771] 0 2024-02-19T19:12:20.084 INFO:tasks.workunit.client.1.smithi125.stdout:0/582: unlink d5/f71 0 2024-02-19T19:12:20.084 INFO:tasks.workunit.client.1.smithi125.stdout:0/583: rmdir d5 39 2024-02-19T19:12:20.084 INFO:tasks.workunit.client.1.smithi125.stdout:6/676: getdents d6/db/d5d/d2f/d45/dd9 0 2024-02-19T19:12:20.084 INFO:tasks.workunit.client.1.smithi125.stdout:6/677: read d6/db/d5d/d2f/f86 [1688785,128807] 0 2024-02-19T19:12:20.085 INFO:tasks.workunit.client.1.smithi125.stdout:6/678: readlink d6/db/d5d/d63/ld6 0 2024-02-19T19:12:20.085 INFO:tasks.workunit.client.1.smithi125.stdout:6/679: unlink d6/db/d5d/d2f/d45/dd9/l78 0 2024-02-19T19:12:20.085 INFO:tasks.workunit.client.1.smithi125.stdout:6/680: read d6/db/d5d/f82 [53009,12447] 0 2024-02-19T19:12:20.085 INFO:tasks.workunit.client.1.smithi125.stdout:6/681: chown d6/db/d5d/d2f/c5e 1280524 1 2024-02-19T19:12:20.085 INFO:tasks.workunit.client.1.smithi125.stdout:6/682: stat d6/db/d5d/d2f/d45/dd9/d16/f81 0 2024-02-19T19:12:20.085 INFO:tasks.workunit.client.1.smithi125.stdout:6/683: link d6/db/d5d/f19 d6/db/d49/fdd 0 2024-02-19T19:12:20.108 INFO:tasks.workunit.client.1.smithi125.stdout:0/584: dwrite d5/d19/f2f [2392064,24576] 0 2024-02-19T19:12:20.109 INFO:tasks.workunit.client.1.smithi125.stdout:0/585: symlink d5/d33/d9b/lcb 0 2024-02-19T19:12:20.109 INFO:tasks.workunit.client.1.smithi125.stdout:0/586: read d5/d1a/f34 [718242,117560] 0 2024-02-19T19:12:20.109 INFO:tasks.workunit.client.1.smithi125.stdout:0/587: creat d5/d9/fcc x:0 0 0 2024-02-19T19:12:20.109 INFO:tasks.workunit.client.1.smithi125.stdout:0/588: dread d5/d33/d46/f66 [348160,118784] 0 2024-02-19T19:12:20.109 INFO:tasks.workunit.client.1.smithi125.stdout:0/589: write d5/d1a/d4c/fa1 [353793,77733] 0 2024-02-19T19:12:20.109 INFO:tasks.workunit.client.1.smithi125.stdout:0/590: chown d5/d19/d27/d32/d70/dc2/dc8/fb5 1 1 2024-02-19T19:12:20.109 INFO:tasks.workunit.client.1.smithi125.stdout:6/684: dwrite d6/db/d5d/d2f/d45/dd9/d16/f81 [65536,28672] 0 2024-02-19T19:12:20.109 INFO:tasks.workunit.client.1.smithi125.stdout:0/591: mkdir d5/d9/dcd 0 2024-02-19T19:12:20.109 INFO:tasks.workunit.client.1.smithi125.stdout:0/592: mkdir d5/d9/dcd/dce 0 2024-02-19T19:12:20.110 INFO:tasks.workunit.client.1.smithi125.stdout:6/685: symlink d6/db/d5d/d2f/d7b/d8d/dd1/lde 0 2024-02-19T19:12:20.110 INFO:tasks.workunit.client.1.smithi125.stdout:6/686: creat d6/db/d5d/d2f/d7b/d8d/fdf x:0 0 0 2024-02-19T19:12:20.110 INFO:tasks.workunit.client.1.smithi125.stdout:0/593: creat d5/d19/fcf x:0 0 0 2024-02-19T19:12:20.110 INFO:tasks.workunit.client.1.smithi125.stdout:0/594: read - d5/d9/fcc zero size 2024-02-19T19:12:20.110 INFO:tasks.workunit.client.1.smithi125.stdout:6/687: rename d6/db/d5d/d29/f97 to d6/db/d5d/d2f/d45/dd9/dbb/fe0 0 2024-02-19T19:12:20.110 INFO:tasks.workunit.client.1.smithi125.stdout:6/688: chown d6/db/d5d/d2f/d45/dd9/d3b/dda/fcd 833127573 1 2024-02-19T19:12:20.110 INFO:tasks.workunit.client.1.smithi125.stdout:0/595: rename d5/c84 to d5/d9/da0/db3/cd0 0 2024-02-19T19:12:20.110 INFO:tasks.workunit.client.1.smithi125.stdout:6/689: write d6/db/d5d/d29/fc6 [942847,10225] 0 2024-02-19T19:12:20.111 INFO:tasks.workunit.client.1.smithi125.stdout:0/596: getdents d5/d33/d46 0 2024-02-19T19:12:20.111 INFO:tasks.workunit.client.1.smithi125.stdout:0/597: rename d5/d19/d27/d32/d70/dc2/dc8/fb5 to d5/d15/d2c/fd1 0 2024-02-19T19:12:20.111 INFO:tasks.workunit.client.1.smithi125.stdout:0/598: write d5/d33/f7e [951723,12186] 0 2024-02-19T19:12:20.111 INFO:tasks.workunit.client.1.smithi125.stdout:0/599: dread d5/d1a/f34 [94208,114688] 0 2024-02-19T19:12:20.111 INFO:tasks.workunit.client.1.smithi125.stdout:0/600: dread d5/d33/d42/f45 [638976,57344] 0 2024-02-19T19:12:20.111 INFO:tasks.workunit.client.1.smithi125.stdout:0/601: write d5/d33/d46/f4b [1035194,107445] 0 2024-02-19T19:12:20.111 INFO:tasks.workunit.client.1.smithi125.stdout:0/602: write d5/d19/d27/d32/f8d [1774434,26929] 0 2024-02-19T19:12:20.111 INFO:tasks.workunit.client.1.smithi125.stdout:0/603: chown d5/d1a 374 1 2024-02-19T19:12:20.124 INFO:tasks.workunit.client.1.smithi125.stdout:2/524: fdatasync d1/d27/d1d/d2c/d2e/f63 0 2024-02-19T19:12:20.124 INFO:tasks.workunit.client.1.smithi125.stdout:2/525: chown d1/d36/d70/d4b/d64/d7b 0 1 2024-02-19T19:12:20.124 INFO:tasks.workunit.client.1.smithi125.stdout:2/526: chown d1/d27/d1d/d2c/d2e/f90 438340356 1 2024-02-19T19:12:20.124 INFO:tasks.workunit.client.1.smithi125.stdout:6/690: fsync d6/db/f3e 0 2024-02-19T19:12:20.124 INFO:tasks.workunit.client.1.smithi125.stdout:6/691: dread - d6/db/d5d/d29/f91 zero size 2024-02-19T19:12:20.129 INFO:tasks.workunit.client.1.smithi125.stdout:2/527: mknod d1/c9a 0 2024-02-19T19:12:20.129 INFO:tasks.workunit.client.1.smithi125.stdout:2/528: readlink d1/d36/l4a 0 2024-02-19T19:12:20.129 INFO:tasks.workunit.client.1.smithi125.stdout:6/692: readlink d6/db/d5d/d2f/l44 0 2024-02-19T19:12:20.129 INFO:tasks.workunit.client.1.smithi125.stdout:0/604: dwrite d5/d19/d27/d32/f8d [2461696,28672] 0 2024-02-19T19:12:20.129 INFO:tasks.workunit.client.1.smithi125.stdout:2/529: write d1/d27/f82 [95508,24741] 0 2024-02-19T19:12:20.129 INFO:tasks.workunit.client.1.smithi125.stdout:6/693: mkdir d6/db/d5d/d2f/d45/dd9/d3b/de1 0 2024-02-19T19:12:20.129 INFO:tasks.workunit.client.1.smithi125.stdout:0/605: mkdir d5/d19/d27/d32/d70/dd2 0 2024-02-19T19:12:20.130 INFO:tasks.workunit.client.1.smithi125.stdout:2/530: link d1/d27/d1d/d25/l3f d1/d36/d70/d4b/d64/d7b/l9b 0 2024-02-19T19:12:20.130 INFO:tasks.workunit.client.1.smithi125.stdout:6/694: creat d6/db/d5d/d2f/d7b/d8d/fe2 x:0 0 0 2024-02-19T19:12:20.130 INFO:tasks.workunit.client.1.smithi125.stdout:0/606: mkdir d5/d9/dcd/dd3 0 2024-02-19T19:12:20.130 INFO:tasks.workunit.client.1.smithi125.stdout:2/531: truncate d1/d27/d45/f56 365131 0 2024-02-19T19:12:20.130 INFO:tasks.workunit.client.1.smithi125.stdout:6/695: unlink d6/db/d5d/d2f/f48 0 2024-02-19T19:12:20.132 INFO:tasks.workunit.client.1.smithi125.stdout:6/696: mkdir d6/db/d5d/d2f/d45/dd9/d3b/dda/daf/de3 0 2024-02-19T19:12:20.132 INFO:tasks.workunit.client.1.smithi125.stdout:6/697: truncate d6/db/d5d/d2f/d7b/f8f 247763 0 2024-02-19T19:12:20.132 INFO:tasks.workunit.client.1.smithi125.stdout:6/698: chown d6/db/d5d/d2f/la6 2 1 2024-02-19T19:12:20.134 INFO:tasks.workunit.client.1.smithi125.stdout:6/699: read d6/db/d5d/d63/f75 [741801,53884] 0 2024-02-19T19:12:20.135 INFO:tasks.workunit.client.1.smithi125.stdout:0/607: dwrite d5/d19/d27/f5c [356352,8192] 0 2024-02-19T19:12:20.135 INFO:tasks.workunit.client.1.smithi125.stdout:0/608: chown d5/d9/dcd/dd3 69622 1 2024-02-19T19:12:20.135 INFO:tasks.workunit.client.1.smithi125.stdout:6/700: creat d6/db/d5d/d2f/d45/d4e/d6b/fe4 x:0 0 0 2024-02-19T19:12:20.135 INFO:tasks.workunit.client.1.smithi125.stdout:6/701: chown d6/db 8 1 2024-02-19T19:12:20.135 INFO:tasks.workunit.client.1.smithi125.stdout:0/609: dread d5/d19/d2b/f7a [2191360,28672] 0 2024-02-19T19:12:20.135 INFO:tasks.workunit.client.1.smithi125.stdout:0/610: write d5/d33/d42/f65 [2286313,71798] 0 2024-02-19T19:12:20.135 INFO:tasks.workunit.client.1.smithi125.stdout:0/611: chown d5/d33/l83 2027275199 1 2024-02-19T19:12:20.136 INFO:tasks.workunit.client.1.smithi125.stdout:0/612: mkdir d5/d9/da0/db3/dd4 0 2024-02-19T19:12:20.136 INFO:tasks.workunit.client.1.smithi125.stdout:0/613: creat d5/d19/d2b/fd5 x:0 0 0 2024-02-19T19:12:20.136 INFO:tasks.workunit.client.1.smithi125.stdout:0/614: chown d5/d1a/c2d 6 1 2024-02-19T19:12:20.136 INFO:tasks.workunit.client.1.smithi125.stdout:0/615: mknod d5/d19/cd6 0 2024-02-19T19:12:20.136 INFO:tasks.workunit.client.1.smithi125.stdout:0/616: dread d5/d15/f89 [421888,110592] 0 2024-02-19T19:12:20.136 INFO:tasks.workunit.client.1.smithi125.stdout:0/617: chown d5/d9/c64 88637 1 2024-02-19T19:12:20.140 INFO:tasks.workunit.client.1.smithi125.stdout:2/532: dread d1/d27/f11 [1736704,118784] 0 2024-02-19T19:12:20.141 INFO:tasks.workunit.client.1.smithi125.stdout:2/533: chown d1/d36/f6d 12 1 2024-02-19T19:12:20.222 INFO:tasks.workunit.client.1.smithi125.stdout:0/618: dwrite d5/d19/d27/d32/d70/fc0 [380928,77824] 0 2024-02-19T19:12:20.222 INFO:tasks.workunit.client.1.smithi125.stdout:0/619: mkdir d5/d19/d27/d32/dd7 0 2024-02-19T19:12:20.222 INFO:tasks.workunit.client.1.smithi125.stdout:0/620: chown d5/d19/d27/d32/d70/cb9 252157215 1 2024-02-19T19:12:20.222 INFO:tasks.workunit.client.1.smithi125.stdout:0/621: stat d5/d19/d27/d32/d70/dc2/dc8/fb4 0 2024-02-19T19:12:20.222 INFO:tasks.workunit.client.1.smithi125.stdout:0/622: readlink d5/d19/lbd 0 2024-02-19T19:12:20.223 INFO:tasks.workunit.client.1.smithi125.stdout:0/623: mknod d5/d33/d42/d92/da5/cd8 0 2024-02-19T19:12:20.223 INFO:tasks.workunit.client.1.smithi125.stdout:0/624: chown d5/d19/d2b/fd5 22 1 2024-02-19T19:12:20.223 INFO:tasks.workunit.client.1.smithi125.stdout:0/625: dread d5/d1a/f20 [217088,20480] 0 2024-02-19T19:12:20.223 INFO:tasks.workunit.client.1.smithi125.stdout:0/626: read d5/d19/f44 [134491,121494] 0 2024-02-19T19:12:20.223 INFO:tasks.workunit.client.1.smithi125.stdout:0/627: mkdir d5/d9/dcd/dd3/dd9 0 2024-02-19T19:12:20.223 INFO:tasks.workunit.client.1.smithi125.stdout:0/628: creat d5/d19/d2b/fda x:0 0 0 2024-02-19T19:12:20.223 INFO:tasks.workunit.client.1.smithi125.stdout:0/629: write d5/d15/f82 [943626,122937] 0 2024-02-19T19:12:20.223 INFO:tasks.workunit.client.1.smithi125.stdout:0/630: chown d5/d9/fcc 2343 1 2024-02-19T19:12:20.224 INFO:tasks.workunit.client.1.smithi125.stdout:0/631: link d5/d1a/d4c/fa1 d5/d19/d27/d32/d70/dd2/fdb 0 2024-02-19T19:12:20.225 INFO:tasks.workunit.client.1.smithi125.stdout:0/632: creat d5/d19/d27/fdc x:0 0 0 2024-02-19T19:12:20.225 INFO:tasks.workunit.client.1.smithi125.stdout:6/702: dwrite d6/db/d5d/d29/d68/f71 [2985984,110592] 0 2024-02-19T19:12:20.225 INFO:tasks.workunit.client.1.smithi125.stdout:6/703: truncate d6/db/d5d/d2f/f86 788729 0 2024-02-19T19:12:20.225 INFO:tasks.workunit.client.1.smithi125.stdout:6/704: readlink d6/db/d5d/d2f/d45/l65 0 2024-02-19T19:12:20.226 INFO:tasks.workunit.client.1.smithi125.stdout:2/534: dwrite d1/d27/d1d/d25/d2a/f34 [2883584,32768] 0 2024-02-19T19:12:20.226 INFO:tasks.workunit.client.1.smithi125.stdout:2/535: getdents d1/d36/d70/d4b/d64 0 2024-02-19T19:12:20.226 INFO:tasks.workunit.client.1.smithi125.stdout:2/536: chown d1/d27/d1d/d25/d2a/f5f 864717 1 2024-02-19T19:12:20.226 INFO:tasks.workunit.client.1.smithi125.stdout:2/537: mknod d1/d36/d70/c9c 0 2024-02-19T19:12:20.226 INFO:tasks.workunit.client.1.smithi125.stdout:2/538: link d1/d36/l4a d1/d36/d70/d4b/d64/d7b/d91/l9d 0 2024-02-19T19:12:20.226 INFO:tasks.workunit.client.1.smithi125.stdout:2/539: dread d1/d36/d70/d4b/f75 [569344,61440] 0 2024-02-19T19:12:20.226 INFO:tasks.workunit.client.1.smithi125.stdout:2/540: rmdir d1/d27/d1d/d25/d7f 39 2024-02-19T19:12:20.259 INFO:tasks.workunit.client.1.smithi125.stdout:0/633: dwrite d5/d15/d2c/f9c [716800,61440] 0 2024-02-19T19:12:20.259 INFO:tasks.workunit.client.1.smithi125.stdout:0/634: symlink d5/d19/d27/d32/d70/ldd 0 2024-02-19T19:12:20.260 INFO:tasks.workunit.client.1.smithi125.stdout:0/635: chown d5/d1a/f79 12 1 2024-02-19T19:12:20.260 INFO:tasks.workunit.client.1.smithi125.stdout:0/636: chown d5/d33/d42/f61 13 1 2024-02-19T19:12:20.260 INFO:tasks.workunit.client.1.smithi125.stdout:0/637: chown d5/d15/d2c/f9c 2643505 1 2024-02-19T19:12:20.262 INFO:tasks.workunit.client.1.smithi125.stdout:2/541: dwrite d1/d27/d45/f56 [1126400,8192] 0 2024-02-19T19:12:20.269 INFO:tasks.workunit.client.1.smithi125.stdout:2/542: dwrite d1/d27/f11 [1036288,49152] 0 2024-02-19T19:12:20.270 INFO:tasks.workunit.client.1.smithi125.stdout:2/543: mknod d1/d36/d70/d85/c9e 0 2024-02-19T19:12:20.270 INFO:tasks.workunit.client.1.smithi125.stdout:2/544: symlink d1/d36/d70/l9f 0 2024-02-19T19:12:20.270 INFO:tasks.workunit.client.1.smithi125.stdout:2/545: mkdir d1/d27/d1d/d25/da0 0 2024-02-19T19:12:20.270 INFO:tasks.workunit.client.1.smithi125.stdout:2/546: creat d1/d36/d70/d4b/d64/fa1 x:0 0 0 2024-02-19T19:12:20.270 INFO:tasks.workunit.client.1.smithi125.stdout:2/547: mkdir d1/d27/da2 0 2024-02-19T19:12:20.270 INFO:tasks.workunit.client.1.smithi125.stdout:2/548: read d1/d36/d70/f7c [14696,60114] 0 2024-02-19T19:12:20.270 INFO:tasks.workunit.client.1.smithi125.stdout:2/549: dread d1/d27/d1d/f2b [245760,90112] 0 2024-02-19T19:12:20.271 INFO:tasks.workunit.client.1.smithi125.stdout:2/550: readlink d1/d27/d1d/d2c/l81 0 2024-02-19T19:12:20.415 INFO:tasks.workunit.client.1.smithi125.stdout:0/638: fsync d5/d15/f89 0 2024-02-19T19:12:20.423 INFO:tasks.workunit.client.1.smithi125.stdout:0/639: symlink d5/d9/lde 0 2024-02-19T19:12:20.423 INFO:tasks.workunit.client.1.smithi125.stdout:0/640: dread - d5/d19/d2b/fd5 zero size 2024-02-19T19:12:20.424 INFO:tasks.workunit.client.1.smithi125.stdout:0/641: write d5/d19/d27/fdc [86418,41340] 0 2024-02-19T19:12:20.424 INFO:tasks.workunit.client.1.smithi125.stdout:0/642: chown d5/d33/d42/d92/da5 103043 1 2024-02-19T19:12:20.424 INFO:tasks.workunit.client.1.smithi125.stdout:0/643: rename d5/d19/d27/d32/f37 to d5/d9/da0/fdf 0 2024-02-19T19:12:20.424 INFO:tasks.workunit.client.1.smithi125.stdout:0/644: stat d5/d19/d27/l5a 0 2024-02-19T19:12:20.426 INFO:tasks.workunit.client.1.smithi125.stdout:0/645: dwrite d5/d1a/d4c/f94 [1740800,57344] 0 2024-02-19T19:12:20.426 INFO:tasks.workunit.client.1.smithi125.stdout:0/646: unlink d5/d19/d27/l72 0 2024-02-19T19:12:20.427 INFO:tasks.workunit.client.1.smithi125.stdout:0/647: rename d5/d19/d48/l99 to d5/d19/d6c/le0 0 2024-02-19T19:12:20.427 INFO:tasks.workunit.client.1.smithi125.stdout:0/648: symlink d5/d9/dcd/dce/le1 0 2024-02-19T19:12:20.427 INFO:tasks.workunit.client.1.smithi125.stdout:0/649: chown d5/d19/d2b/l51 15 1 2024-02-19T19:12:20.427 INFO:tasks.workunit.client.1.smithi125.stdout:0/650: chown d5/d33/d42/d92/cbe 3 1 2024-02-19T19:12:20.427 INFO:tasks.workunit.client.1.smithi125.stdout:0/651: dread d5/d1a/f20 [1404928,53248] 0 2024-02-19T19:12:20.496 INFO:tasks.workunit.client.1.smithi125.stdout:9/596: sync 2024-02-19T19:12:20.496 INFO:tasks.workunit.client.1.smithi125.stdout:1/718: sync 2024-02-19T19:12:20.496 INFO:tasks.workunit.client.1.smithi125.stdout:5/796: sync 2024-02-19T19:12:20.496 INFO:tasks.workunit.client.1.smithi125.stdout:8/518: sync 2024-02-19T19:12:20.496 INFO:tasks.workunit.client.1.smithi125.stdout:3/455: sync 2024-02-19T19:12:20.496 INFO:tasks.workunit.client.1.smithi125.stdout:1/719: unlink d1/dc/d36/d69/fc6 0 2024-02-19T19:12:20.496 INFO:tasks.workunit.client.1.smithi125.stdout:4/527: sync 2024-02-19T19:12:20.497 INFO:tasks.workunit.client.1.smithi125.stdout:7/577: sync 2024-02-19T19:12:20.497 INFO:tasks.workunit.client.1.smithi125.stdout:4/528: dread - d0/d7/d85/f9e zero size 2024-02-19T19:12:20.497 INFO:tasks.workunit.client.1.smithi125.stdout:1/720: link d1/d26/d3c/c9e d1/d78/ce7 0 2024-02-19T19:12:20.497 INFO:tasks.workunit.client.1.smithi125.stdout:1/721: chown d1/d26/d3c/l92 391054209 1 2024-02-19T19:12:20.497 INFO:tasks.workunit.client.1.smithi125.stdout:4/529: mknod d0/cb2 0 2024-02-19T19:12:20.497 INFO:tasks.workunit.client.1.smithi125.stdout:7/578: read d12/d18/d44/d3b/d59/d2a/d6a/d6d/f7f [472842,74228] 0 2024-02-19T19:12:20.497 INFO:tasks.workunit.client.1.smithi125.stdout:4/530: write d0/d7/d85/f8f [569823,32028] 0 2024-02-19T19:12:20.497 INFO:tasks.workunit.client.1.smithi125.stdout:7/579: truncate d12/d18/d44/d3b/d59/d26/d30/f35 1484495 0 2024-02-19T19:12:20.497 INFO:tasks.workunit.client.1.smithi125.stdout:7/580: getdents d12/d18/d44/d3b/d59/d2a/d31/d50/d60 0 2024-02-19T19:12:20.498 INFO:tasks.workunit.client.1.smithi125.stdout:4/531: mkdir d0/d7/d30/d42/db3 0 2024-02-19T19:12:20.498 INFO:tasks.workunit.client.1.smithi125.stdout:7/581: rmdir d12/d18/d66/d9a 0 2024-02-19T19:12:20.498 INFO:tasks.workunit.client.1.smithi125.stdout:7/582: getdents d12/d18/d66 0 2024-02-19T19:12:20.498 INFO:tasks.workunit.client.1.smithi125.stdout:4/532: write d0/d7/d30/d42/d7b/f99 [832136,34057] 0 2024-02-19T19:12:20.498 INFO:tasks.workunit.client.1.smithi125.stdout:7/583: rmdir d12/d18/d63/d9c 0 2024-02-19T19:12:20.498 INFO:tasks.workunit.client.1.smithi125.stdout:4/533: creat d0/df/d5e/fb4 x:0 0 0 2024-02-19T19:12:20.498 INFO:tasks.workunit.client.1.smithi125.stdout:7/584: stat d12/d18/d44/d3b/d59/d26/d54/d8c/d98 0 2024-02-19T19:12:20.498 INFO:tasks.workunit.client.1.smithi125.stdout:4/534: rename d0/d32/c5a to d0/d7/d30/d5d/cb5 0 2024-02-19T19:12:20.498 INFO:tasks.workunit.client.1.smithi125.stdout:4/535: creat d0/d7/d30/d58/dac/fb6 x:0 0 0 2024-02-19T19:12:20.498 INFO:tasks.workunit.client.1.smithi125.stdout:4/536: chown d0/df/fab 14558 1 2024-02-19T19:12:20.499 INFO:tasks.workunit.client.1.smithi125.stdout:4/537: truncate d0/d7/d3b/f43 1049675 0 2024-02-19T19:12:20.499 INFO:tasks.workunit.client.1.smithi125.stdout:7/585: write d12/d18/d44/d3b/d59/d26/d30/f88 [2028684,48354] 0 2024-02-19T19:12:20.499 INFO:tasks.workunit.client.1.smithi125.stdout:7/586: link d12/d18/d44/d3b/d59/d26/d30/d37/c6c d12/d18/d44/d3b/d59/d2a/d31/d50/ca7 0 2024-02-19T19:12:20.557 INFO:tasks.workunit.client.1.smithi125.stdout:8/519: fdatasync db/d18/d2f/d3f/f75 0 2024-02-19T19:12:20.557 INFO:tasks.workunit.client.1.smithi125.stdout:1/722: fsync d1/dc/f52 0 2024-02-19T19:12:20.557 INFO:tasks.workunit.client.1.smithi125.stdout:4/538: fsync d0/d7/d30/d5d/f9b 0 2024-02-19T19:12:20.557 INFO:tasks.workunit.client.1.smithi125.stdout:3/456: fsync d0/d1/d1e/f2c 0 2024-02-19T19:12:20.559 INFO:tasks.workunit.client.1.smithi125.stdout:9/597: dwrite d8/d15/d32/d4f/d6e/d99/fa7 [913408,73728] 0 2024-02-19T19:12:20.559 INFO:tasks.workunit.client.1.smithi125.stdout:5/797: dwrite db/d17/d58/d4f/faf [389120,122880] 0 2024-02-19T19:12:20.559 INFO:tasks.workunit.client.1.smithi125.stdout:7/587: dwrite d12/d18/d44/d51/d81/f83 [933888,12288] 0 2024-02-19T19:12:20.559 INFO:tasks.workunit.client.1.smithi125.stdout:0/652: dread d5/d19/d27/fdc [102400,90112] 0 2024-02-19T19:12:20.560 INFO:tasks.workunit.client.1.smithi125.stdout:4/539: creat d0/d7/d30/d42/d7b/fb7 x:0 0 0 2024-02-19T19:12:20.560 INFO:tasks.workunit.client.1.smithi125.stdout:1/723: mknod d1/d78/d80/ce8 0 2024-02-19T19:12:20.560 INFO:tasks.workunit.client.1.smithi125.stdout:7/588: truncate d12/d18/d44/d3b/d59/d26/f3a 1106740 0 2024-02-19T19:12:20.560 INFO:tasks.workunit.client.1.smithi125.stdout:5/798: mknod db/d26/cfa 0 2024-02-19T19:12:20.560 INFO:tasks.workunit.client.1.smithi125.stdout:4/540: creat d0/d7/d30/d42/d7b/fb8 x:0 0 0 2024-02-19T19:12:20.560 INFO:tasks.workunit.client.1.smithi125.stdout:3/457: symlink d0/d1/d1e/d60/d73/d74/d82/l8d 0 2024-02-19T19:12:20.560 INFO:tasks.workunit.client.1.smithi125.stdout:3/458: stat d0/d1/l16 0 2024-02-19T19:12:20.560 INFO:tasks.workunit.client.1.smithi125.stdout:7/589: dread d12/d18/d44/d3b/d59/d26/d30/f35 [503808,28672] 0 2024-02-19T19:12:20.561 INFO:tasks.workunit.client.1.smithi125.stdout:8/520: write db/f16 [246841,124562] 0 2024-02-19T19:12:20.561 INFO:tasks.workunit.client.1.smithi125.stdout:9/598: symlink d8/d15/d32/ld7 0 2024-02-19T19:12:20.561 INFO:tasks.workunit.client.1.smithi125.stdout:0/653: mkdir d5/d33/d46/de2 0 2024-02-19T19:12:20.561 INFO:tasks.workunit.client.1.smithi125.stdout:8/521: readlink db/d18/d30/d48/l7d 0 2024-02-19T19:12:20.561 INFO:tasks.workunit.client.1.smithi125.stdout:3/459: rename d0/d1/l16 to d0/l8e 0 2024-02-19T19:12:20.561 INFO:tasks.workunit.client.1.smithi125.stdout:4/541: mkdir d0/d7/dad/db9 0 2024-02-19T19:12:20.561 INFO:tasks.workunit.client.1.smithi125.stdout:9/599: mknod d8/d15/d22/d4e/cd8 0 2024-02-19T19:12:20.561 INFO:tasks.workunit.client.1.smithi125.stdout:0/654: truncate d5/d19/d27/d32/d70/dc2/dc8/fb4 542595 0 2024-02-19T19:12:20.562 INFO:tasks.workunit.client.1.smithi125.stdout:9/600: chown d8/d15/f66 8713 1 2024-02-19T19:12:20.562 INFO:tasks.workunit.client.1.smithi125.stdout:8/522: unlink db/f65 0 2024-02-19T19:12:20.562 INFO:tasks.workunit.client.1.smithi125.stdout:4/542: creat d0/fba x:0 0 0 2024-02-19T19:12:20.562 INFO:tasks.workunit.client.1.smithi125.stdout:3/460: creat d0/d1/d4b/d52/d81/f8f x:0 0 0 2024-02-19T19:12:20.562 INFO:tasks.workunit.client.1.smithi125.stdout:4/543: readlink d0/l2c 0 2024-02-19T19:12:20.562 INFO:tasks.workunit.client.1.smithi125.stdout:9/601: rename d8/l8e to d8/d15/d22/d4e/d6b/ld9 0 2024-02-19T19:12:20.562 INFO:tasks.workunit.client.1.smithi125.stdout:4/544: stat d0/d7 0 2024-02-19T19:12:20.563 INFO:tasks.workunit.client.1.smithi125.stdout:3/461: link d0/de/f2b d0/d1/d4b/d52/d81/f90 0 2024-02-19T19:12:20.563 INFO:tasks.workunit.client.1.smithi125.stdout:4/545: truncate d0/d7/d30/d42/d7b/fb8 441824 0 2024-02-19T19:12:20.563 INFO:tasks.workunit.client.1.smithi125.stdout:9/602: truncate d8/d15/d32/d4f/d6e/f8d 1525048 0 2024-02-19T19:12:20.563 INFO:tasks.workunit.client.1.smithi125.stdout:8/523: mknod db/d18/d30/d48/ca8 0 2024-02-19T19:12:20.563 INFO:tasks.workunit.client.1.smithi125.stdout:4/546: chown d0/d7/d30/l9a 899624488 1 2024-02-19T19:12:20.563 INFO:tasks.workunit.client.1.smithi125.stdout:9/603: link d8/ld d8/lda 0 2024-02-19T19:12:20.563 INFO:tasks.workunit.client.1.smithi125.stdout:3/462: symlink d0/d1/d87/l91 0 2024-02-19T19:12:20.563 INFO:tasks.workunit.client.1.smithi125.stdout:3/463: unlink d0/d1/d1e/d60/d7c/l7d 0 2024-02-19T19:12:20.563 INFO:tasks.workunit.client.1.smithi125.stdout:1/724: dwrite d1/d1a/d3d/fbb [737280,8192] 0 2024-02-19T19:12:20.563 INFO:tasks.workunit.client.1.smithi125.stdout:3/464: creat d0/d1/d4b/d52/d81/f92 x:0 0 0 2024-02-19T19:12:20.564 INFO:tasks.workunit.client.1.smithi125.stdout:1/725: write d1/d78/fd8 [685177,16761] 0 2024-02-19T19:12:20.584 INFO:tasks.workunit.client.1.smithi125.stdout:8/524: dwrite db/d18/d30/d80/d9e/da3/fa5 [393216,98304] 0 2024-02-19T19:12:20.584 INFO:tasks.workunit.client.1.smithi125.stdout:8/525: write db/d18/d2f/d72/f87 [913310,718] 0 2024-02-19T19:12:20.584 INFO:tasks.workunit.client.1.smithi125.stdout:8/526: creat db/d18/d30/fa9 x:0 0 0 2024-02-19T19:12:20.584 INFO:tasks.workunit.client.1.smithi125.stdout:8/527: chown db/d18/d30 3751199 1 2024-02-19T19:12:20.587 INFO:tasks.workunit.client.1.smithi125.stdout:5/799: dwrite db/f30 [1179648,28672] 0 2024-02-19T19:12:20.589 INFO:tasks.workunit.client.1.smithi125.stdout:9/604: dwrite d8/d15/d22/d44/fb0 [1576960,69632] 0 2024-02-19T19:12:20.589 INFO:tasks.workunit.client.1.smithi125.stdout:8/528: dread db/d18/d30/d3c/d4d/f61 [483328,53248] 0 2024-02-19T19:12:20.597 INFO:tasks.workunit.client.1.smithi125.stdout:1/726: dread d1/d26/d23/f2d [94208,4096] 0 2024-02-19T19:12:20.597 INFO:tasks.workunit.client.1.smithi125.stdout:1/727: mkdir d1/dc/d36/d69/dc7/de9 0 2024-02-19T19:12:20.700 INFO:tasks.workunit.client.1.smithi125.stdout:3/465: fdatasync d0/f24 0 2024-02-19T19:12:20.700 INFO:tasks.workunit.client.1.smithi125.stdout:4/547: fsync d0/d7/d3b/f45 0 2024-02-19T19:12:20.701 INFO:tasks.workunit.client.1.smithi125.stdout:3/466: creat d0/d1/d87/f93 x:0 0 0 2024-02-19T19:12:20.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:20 smithi125 ceph-mon[86115]: pgmap v155: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:12:20.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:12:20.705 INFO:tasks.workunit.client.1.smithi125.stdout:1/728: fdatasync d1/d1a/f2e 0 2024-02-19T19:12:20.705 INFO:tasks.workunit.client.1.smithi125.stdout:9/605: fsync d8/d2e/d4c/fc5 0 2024-02-19T19:12:20.705 INFO:tasks.workunit.client.1.smithi125.stdout:8/529: fsync db/d18/d30/d48/f5c 0 2024-02-19T19:12:20.713 INFO:tasks.workunit.client.1.smithi125.stdout:3/467: truncate d0/d1/f17 1843564 0 2024-02-19T19:12:20.713 INFO:tasks.workunit.client.1.smithi125.stdout:8/530: getdents db/d18/d30/d80/d9e/da3 0 2024-02-19T19:12:20.713 INFO:tasks.workunit.client.1.smithi125.stdout:5/800: dwrite db/d17/f1e [212992,36864] 0 2024-02-19T19:12:20.713 INFO:tasks.workunit.client.1.smithi125.stdout:9/606: rename d8/d2e/d4c/fc5 to d8/d15/d32/d4f/d6e/fdb 0 2024-02-19T19:12:20.713 INFO:tasks.workunit.client.1.smithi125.stdout:3/468: chown d0/f24 99917163 1 2024-02-19T19:12:20.713 INFO:tasks.workunit.client.1.smithi125.stdout:5/801: rmdir db/d17/d58/d25 39 2024-02-19T19:12:20.713 INFO:tasks.workunit.client.1.smithi125.stdout:1/729: write d1/d1a/d3d/f61 [415492,31368] 0 2024-02-19T19:12:20.714 INFO:tasks.workunit.client.1.smithi125.stdout:3/469: mknod d0/d1/d87/c94 0 2024-02-19T19:12:20.714 INFO:tasks.workunit.client.1.smithi125.stdout:8/531: creat db/d18/d30/d80/d9e/da3/faa x:0 0 0 2024-02-19T19:12:20.714 INFO:tasks.workunit.client.1.smithi125.stdout:1/730: getdents d1/d1a 0 2024-02-19T19:12:20.714 INFO:tasks.workunit.client.1.smithi125.stdout:4/548: write d0/f2e [732170,86177] 0 2024-02-19T19:12:20.714 INFO:tasks.workunit.client.1.smithi125.stdout:9/607: mkdir d8/d15/d32/d4f/ddc 0 2024-02-19T19:12:20.714 INFO:tasks.workunit.client.1.smithi125.stdout:8/532: getdents db/d18/d30/d3c/d4d 0 2024-02-19T19:12:20.714 INFO:tasks.workunit.client.1.smithi125.stdout:4/549: read - d0/d7/d85/fa0 zero size 2024-02-19T19:12:20.714 INFO:tasks.workunit.client.1.smithi125.stdout:9/608: stat d8/d15/d22/d4e/d6b/ca1 0 2024-02-19T19:12:20.714 INFO:tasks.workunit.client.1.smithi125.stdout:3/470: mkdir d0/d95 0 2024-02-19T19:12:20.715 INFO:tasks.workunit.client.1.smithi125.stdout:4/550: mknod d0/d7/d85/cbb 0 2024-02-19T19:12:20.715 INFO:tasks.workunit.client.1.smithi125.stdout:9/609: rename d8/d15/da2/lb7 to d8/d15/d22/d4e/ldd 0 2024-02-19T19:12:20.715 INFO:tasks.workunit.client.1.smithi125.stdout:4/551: getdents d0/d7/d30/d58/dac 0 2024-02-19T19:12:20.715 INFO:tasks.workunit.client.1.smithi125.stdout:9/610: symlink d8/d15/d22/d4e/d6b/lde 0 2024-02-19T19:12:20.715 INFO:tasks.workunit.client.1.smithi125.stdout:9/611: getdents d8/d15/da2 0 2024-02-19T19:12:20.715 INFO:tasks.workunit.client.1.smithi125.stdout:9/612: symlink d8/d15/d32/d4f/ldf 0 2024-02-19T19:12:20.715 INFO:tasks.workunit.client.1.smithi125.stdout:9/613: stat d8/l9c 0 2024-02-19T19:12:20.715 INFO:tasks.workunit.client.1.smithi125.stdout:9/614: readlink d8/d15/d32/d4f/d6e/la5 0 2024-02-19T19:12:20.715 INFO:tasks.workunit.client.1.smithi125.stdout:3/471: rename d0/de/f2b to d0/d1/d4b/f96 0 2024-02-19T19:12:20.716 INFO:tasks.workunit.client.1.smithi125.stdout:1/731: write d1/d78/d8a/fe3 [795188,1644] 0 2024-02-19T19:12:20.716 INFO:tasks.workunit.client.1.smithi125.stdout:3/472: symlink d0/l97 0 2024-02-19T19:12:20.716 INFO:tasks.workunit.client.1.smithi125.stdout:9/615: dwrite d8/d2e/f4b [1081344,36864] 0 2024-02-19T19:12:20.717 INFO:tasks.workunit.client.1.smithi125.stdout:9/616: mkdir d8/d15/d22/de0 0 2024-02-19T19:12:20.717 INFO:tasks.workunit.client.1.smithi125.stdout:9/617: read d8/d15/d22/f78 [585694,48376] 0 2024-02-19T19:12:20.778 INFO:tasks.workunit.client.1.smithi125.stdout:5/802: fdatasync db/d17/d58/d33/d91/dbe/fbb 0 2024-02-19T19:12:20.778 INFO:tasks.workunit.client.1.smithi125.stdout:5/803: dread db/d17/d58/f37 [258048,77824] 0 2024-02-19T19:12:20.778 INFO:tasks.workunit.client.1.smithi125.stdout:5/804: chown db/d17/d58/l83 8212 1 2024-02-19T19:12:20.778 INFO:tasks.workunit.client.1.smithi125.stdout:3/473: fsync d0/d1/d4b/f67 0 2024-02-19T19:12:20.779 INFO:tasks.workunit.client.1.smithi125.stdout:8/533: fsync db/d18/d2f/d3f/f76 0 2024-02-19T19:12:20.779 INFO:tasks.workunit.client.1.smithi125.stdout:8/534: dread - db/d18/d30/fa9 zero size 2024-02-19T19:12:20.779 INFO:tasks.workunit.client.1.smithi125.stdout:1/732: creat d1/dc/d36/d69/fea x:0 0 0 2024-02-19T19:12:20.779 INFO:tasks.workunit.client.1.smithi125.stdout:1/733: unlink f0 0 2024-02-19T19:12:20.779 INFO:tasks.workunit.client.1.smithi125.stdout:1/734: mknod d1/dc/d36/d39/ceb 0 2024-02-19T19:12:20.780 INFO:tasks.workunit.client.1.smithi125.stdout:9/618: dwrite d8/d2e/d4c/f5f [229376,40960] 0 2024-02-19T19:12:20.780 INFO:tasks.workunit.client.1.smithi125.stdout:9/619: mkdir d8/d15/da2/de1 0 2024-02-19T19:12:20.781 INFO:tasks.workunit.client.1.smithi125.stdout:5/805: dread db/d17/d58/d4f/ff6 [49152,86016] 0 2024-02-19T19:12:20.781 INFO:tasks.workunit.client.1.smithi125.stdout:8/535: rename db/d18/d2f/d3f/f76 to db/d18/d2f/fab 0 2024-02-19T19:12:20.781 INFO:tasks.workunit.client.1.smithi125.stdout:5/806: dread db/d47/d52/d5d/f7b [126976,4096] 0 2024-02-19T19:12:20.781 INFO:tasks.workunit.client.1.smithi125.stdout:5/807: creat db/d47/d52/ffb x:0 0 0 2024-02-19T19:12:20.781 INFO:tasks.workunit.client.1.smithi125.stdout:9/620: rmdir d8/d15/d32/d95 0 2024-02-19T19:12:20.781 INFO:tasks.workunit.client.1.smithi125.stdout:5/808: rename c9 to db/d17/cfc 0 2024-02-19T19:12:20.781 INFO:tasks.workunit.client.1.smithi125.stdout:1/735: dwrite d1/d1a/d3d/d6e/fa7 [1294336,16384] 0 2024-02-19T19:12:20.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:20 smithi096 ceph-mon[112483]: pgmap v155: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:12:20.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:12:20.822 INFO:tasks.workunit.client.1.smithi125.stdout:8/536: dwrite db/d18/d30/d48/f51 [1273856,53248] 0 2024-02-19T19:12:20.822 INFO:tasks.workunit.client.1.smithi125.stdout:8/537: mkdir db/d18/d30/d80/dac 0 2024-02-19T19:12:20.823 INFO:tasks.workunit.client.1.smithi125.stdout:8/538: dread - db/d18/d2f/f93 zero size 2024-02-19T19:12:20.823 INFO:tasks.workunit.client.1.smithi125.stdout:8/539: creat db/d18/d2f/d3f/fad x:0 0 0 2024-02-19T19:12:20.823 INFO:tasks.workunit.client.1.smithi125.stdout:8/540: mkdir db/d18/d30/d3c/d4d/d5d/da2/dae 0 2024-02-19T19:12:20.825 INFO:tasks.workunit.client.1.smithi125.stdout:5/809: rename db/d47/d52 to db/d17/d58/d33/d98/dae/dfd 0 2024-02-19T19:12:20.825 INFO:tasks.workunit.client.1.smithi125.stdout:8/541: creat db/d6d/faf x:0 0 0 2024-02-19T19:12:20.825 INFO:tasks.workunit.client.1.smithi125.stdout:8/542: chown db/d6d/faf 428 1 2024-02-19T19:12:20.825 INFO:tasks.workunit.client.1.smithi125.stdout:8/543: mknod db/d18/d30/d3c/d4d/d5d/da2/dae/cb0 0 2024-02-19T19:12:20.827 INFO:tasks.workunit.client.1.smithi125.stdout:1/736: dwrite d1/dc/f1f [24576,118784] 0 2024-02-19T19:12:20.827 INFO:tasks.workunit.client.1.smithi125.stdout:1/737: write d1/d26/f71 [947224,24995] 0 2024-02-19T19:12:20.827 INFO:tasks.workunit.client.1.smithi125.stdout:1/738: mknod d1/d78/d8a/cec 0 2024-02-19T19:12:20.827 INFO:tasks.workunit.client.1.smithi125.stdout:1/739: mkdir d1/d1a/ded 0 2024-02-19T19:12:20.827 INFO:tasks.workunit.client.1.smithi125.stdout:1/740: truncate d1/d78/f7f 163820 0 2024-02-19T19:12:20.827 INFO:tasks.workunit.client.1.smithi125.stdout:1/741: rename d1/d1a/d3d/d6e/d4b/c4c to d1/d26/d3c/cee 0 2024-02-19T19:12:20.827 INFO:tasks.workunit.client.1.smithi125.stdout:1/742: write d1/d1a/f2a [933402,76600] 0 2024-02-19T19:12:20.827 INFO:tasks.workunit.client.1.smithi125.stdout:1/743: dread d1/d78/d80/f35 [1654784,110592] 0 2024-02-19T19:12:20.828 INFO:tasks.workunit.client.1.smithi125.stdout:1/744: write d1/d26/d3c/f64 [1586567,65305] 0 2024-02-19T19:12:20.828 INFO:tasks.workunit.client.1.smithi125.stdout:1/745: getdents d1/d1a/d3d/d6e/d87 0 2024-02-19T19:12:20.885 INFO:tasks.workunit.client.1.smithi125.stdout:9/621: fsync d8/f9 0 2024-02-19T19:12:20.885 INFO:tasks.workunit.client.1.smithi125.stdout:3/474: fsync d0/d1/f56 0 2024-02-19T19:12:20.908 INFO:tasks.workunit.client.1.smithi125.stdout:9/622: fdatasync d8/d15/d32/f65 0 2024-02-19T19:12:20.918 INFO:tasks.workunit.client.1.smithi125.stdout:3/475: dwrite d0/f6d [1245184,57344] 0 2024-02-19T19:12:20.919 INFO:tasks.workunit.client.1.smithi125.stdout:1/746: dwrite d1/d1a/d3d/fbb [937984,73728] 0 2024-02-19T19:12:20.919 INFO:tasks.workunit.client.1.smithi125.stdout:8/544: dwrite db/d18/d30/f4f [1114112,20480] 0 2024-02-19T19:12:20.919 INFO:tasks.workunit.client.1.smithi125.stdout:5/810: dwrite db/d17/d58/d4f/fd6 [552960,122880] 0 2024-02-19T19:12:20.919 INFO:tasks.workunit.client.1.smithi125.stdout:3/476: mknod d0/d1/d4b/d52/c98 0 2024-02-19T19:12:20.920 INFO:tasks.workunit.client.1.smithi125.stdout:5/811: dread db/d17/d58/d4f/ff6 [45056,36864] 0 2024-02-19T19:12:20.920 INFO:tasks.workunit.client.1.smithi125.stdout:5/812: chown db/d47/l62 341 1 2024-02-19T19:12:20.920 INFO:tasks.workunit.client.1.smithi125.stdout:5/813: getdents db/d17/d58 0 2024-02-19T19:12:20.920 INFO:tasks.workunit.client.1.smithi125.stdout:5/814: dread db/d17/d58/d33/d64/fa9 [536576,16384] 0 2024-02-19T19:12:20.921 INFO:tasks.workunit.client.1.smithi125.stdout:5/815: dread - db/d17/d58/d33/d98/dae/dfd/fee zero size 2024-02-19T19:12:20.921 INFO:tasks.workunit.client.1.smithi125.stdout:5/816: symlink db/d17/d85/lfe 0 2024-02-19T19:12:20.921 INFO:tasks.workunit.client.1.smithi125.stdout:9/623: mkdir d8/d15/d32/d4f/d85/de2 0 2024-02-19T19:12:20.922 INFO:tasks.workunit.client.1.smithi125.stdout:5/817: write db/d17/d58/d33/d98/fbd [707573,58251] 0 2024-02-19T19:12:20.922 INFO:tasks.workunit.client.1.smithi125.stdout:9/624: read - d8/d15/d22/d4e/f58 zero size 2024-02-19T19:12:20.922 INFO:tasks.workunit.client.1.smithi125.stdout:9/625: dread d8/d2e/f45 [126976,77824] 0 2024-02-19T19:12:20.922 INFO:tasks.workunit.client.1.smithi125.stdout:5/818: mknod db/d17/d58/d33/d98/cff 0 2024-02-19T19:12:20.922 INFO:tasks.workunit.client.1.smithi125.stdout:5/819: symlink db/d17/d58/d33/d53/dd5/l100 0 2024-02-19T19:12:20.923 INFO:tasks.workunit.client.1.smithi125.stdout:9/626: creat d8/d15/fe3 x:0 0 0 2024-02-19T19:12:20.923 INFO:tasks.workunit.client.1.smithi125.stdout:5/820: chown db/d17/d58/d4f/ff6 86528 1 2024-02-19T19:12:20.923 INFO:tasks.workunit.client.1.smithi125.stdout:5/821: truncate db/d17/d58/d33/d91/dbe/fcd 1320044 0 2024-02-19T19:12:20.923 INFO:tasks.workunit.client.1.smithi125.stdout:5/822: chown db/d17/d58/d33/d53/c88 1 1 2024-02-19T19:12:20.924 INFO:tasks.workunit.client.1.smithi125.stdout:5/823: symlink db/d17/d58/d33/d98/dae/dfd/d5d/l101 0 2024-02-19T19:12:20.924 INFO:tasks.workunit.client.1.smithi125.stdout:1/747: symlink d1/d78/d80/lef 0 2024-02-19T19:12:20.924 INFO:tasks.workunit.client.1.smithi125.stdout:1/748: creat d1/d1a/ff0 x:0 0 0 2024-02-19T19:12:20.924 INFO:tasks.workunit.client.1.smithi125.stdout:1/749: write d1/f14 [1137491,38873] 0 2024-02-19T19:12:20.925 INFO:tasks.workunit.client.1.smithi125.stdout:1/750: getdents d1/d78 0 2024-02-19T19:12:20.925 INFO:tasks.workunit.client.1.smithi125.stdout:1/751: stat d1/d26/f3b 0 2024-02-19T19:12:20.925 INFO:tasks.workunit.client.1.smithi125.stdout:8/545: dwrite db/f1e [675840,20480] 0 2024-02-19T19:12:20.925 INFO:tasks.workunit.client.1.smithi125.stdout:8/546: getdents db/d18 0 2024-02-19T19:12:20.926 INFO:tasks.workunit.client.1.smithi125.stdout:8/547: dread db/d18/f27 [266240,77824] 0 2024-02-19T19:12:20.926 INFO:tasks.workunit.client.1.smithi125.stdout:9/627: dwrite d8/d15/d22/fcf [327680,73728] 0 2024-02-19T19:12:20.926 INFO:tasks.workunit.client.1.smithi125.stdout:9/628: write d8/d15/d22/d4e/f7f [305101,109811] 0 2024-02-19T19:12:20.926 INFO:tasks.workunit.client.1.smithi125.stdout:9/629: dread d8/d15/d9d/fd1 [475136,16384] 0 2024-02-19T19:12:20.927 INFO:tasks.workunit.client.1.smithi125.stdout:9/630: chown d8/d15/d22/d4e/f58 78 1 2024-02-19T19:12:20.927 INFO:tasks.workunit.client.1.smithi125.stdout:9/631: mknod d8/d2e/d6d/ce4 0 2024-02-19T19:12:20.927 INFO:tasks.workunit.client.1.smithi125.stdout:9/632: rmdir d8 39 2024-02-19T19:12:20.927 INFO:tasks.workunit.client.1.smithi125.stdout:9/633: creat d8/d2e/fe5 x:0 0 0 2024-02-19T19:12:20.928 INFO:tasks.workunit.client.1.smithi125.stdout:5/824: dwrite db/d17/d85/fe1 [335872,90112] 0 2024-02-19T19:12:20.928 INFO:tasks.workunit.client.1.smithi125.stdout:5/825: stat db/d17/d58/l83 0 2024-02-19T19:12:20.928 INFO:tasks.workunit.client.1.smithi125.stdout:5/826: readlink db/l38 0 2024-02-19T19:12:20.928 INFO:tasks.workunit.client.1.smithi125.stdout:5/827: creat db/d17/d58/d33/d98/dae/f102 x:0 0 0 2024-02-19T19:12:20.929 INFO:tasks.workunit.client.1.smithi125.stdout:5/828: dread db/d17/d58/f81 [552960,118784] 0 2024-02-19T19:12:20.992 INFO:tasks.workunit.client.1.smithi125.stdout:7/590: sync 2024-02-19T19:12:20.993 INFO:tasks.workunit.client.1.smithi125.stdout:2/551: sync 2024-02-19T19:12:20.993 INFO:tasks.workunit.client.1.smithi125.stdout:6/705: sync 2024-02-19T19:12:20.993 INFO:tasks.workunit.client.1.smithi125.stdout:6/706: dread d6/db/d5d/d29/f84 [94208,73728] 0 2024-02-19T19:12:20.993 INFO:tasks.workunit.client.1.smithi125.stdout:2/552: mkdir d1/d27/d1d/d25/da3 0 2024-02-19T19:12:20.994 INFO:tasks.workunit.client.1.smithi125.stdout:6/707: mknod d6/db/ce5 0 2024-02-19T19:12:20.994 INFO:tasks.workunit.client.1.smithi125.stdout:6/708: rename d6/c6c to d6/db/d5d/d93/ce6 0 2024-02-19T19:12:20.994 INFO:tasks.workunit.client.1.smithi125.stdout:6/709: chown d6/db/d5d/d93/da2/lad 1426 1 2024-02-19T19:12:20.994 INFO:tasks.workunit.client.1.smithi125.stdout:6/710: dread d6/db/d5d/d2f/d45/dd9/d3b/dda/f96 [643072,20480] 0 2024-02-19T19:12:20.995 INFO:tasks.workunit.client.1.smithi125.stdout:6/711: mknod d6/db/d5d/d29/ce7 0 2024-02-19T19:12:20.995 INFO:tasks.workunit.client.1.smithi125.stdout:6/712: truncate d6/db/d5d/d2f/d7b/d8d/fdf 404591 0 2024-02-19T19:12:20.995 INFO:tasks.workunit.client.1.smithi125.stdout:8/548: dwrite db/d18/d30/f4f [983040,4096] 0 2024-02-19T19:12:20.995 INFO:tasks.workunit.client.1.smithi125.stdout:8/549: mkdir db/d18/d30/d48/db1 0 2024-02-19T19:12:20.996 INFO:tasks.workunit.client.1.smithi125.stdout:8/550: write db/d18/d2f/d3f/f75 [12728,83178] 0 2024-02-19T19:12:20.996 INFO:tasks.workunit.client.1.smithi125.stdout:8/551: getdents db/d18/d30/d3c 0 2024-02-19T19:12:20.996 INFO:tasks.workunit.client.1.smithi125.stdout:8/552: truncate db/d18/d30/d3c/d4d/d5d/d6f/f77 1197439 0 2024-02-19T19:12:20.996 INFO:tasks.workunit.client.1.smithi125.stdout:8/553: write db/d18/d30/d3c/d4d/f94 [709684,12586] 0 2024-02-19T19:12:20.997 INFO:tasks.workunit.client.1.smithi125.stdout:8/554: readlink db/d18/d30/d80/d9e/la0 0 2024-02-19T19:12:20.997 INFO:tasks.workunit.client.1.smithi125.stdout:9/634: dwrite d8/d2e/f4b [1953792,98304] 0 2024-02-19T19:12:20.997 INFO:tasks.workunit.client.1.smithi125.stdout:1/752: dwrite d1/d26/d3c/d3f/f8d [1085440,20480] 0 2024-02-19T19:12:20.997 INFO:tasks.workunit.client.1.smithi125.stdout:1/753: unlink d1/d78/d80/c9c 0 2024-02-19T19:12:20.998 INFO:tasks.workunit.client.1.smithi125.stdout:1/754: symlink d1/dc/d36/d69/dc7/lf1 0 2024-02-19T19:12:20.998 INFO:tasks.workunit.client.1.smithi125.stdout:1/755: write d1/d1a/ff0 [331228,35707] 0 2024-02-19T19:12:20.998 INFO:tasks.workunit.client.1.smithi125.stdout:1/756: mknod d1/d1a/d3d/d6e/d87/cf2 0 2024-02-19T19:12:20.998 INFO:tasks.workunit.client.1.smithi125.stdout:5/829: dwrite db/d17/d58/d4f/ff6 [1069056,32768] 0 2024-02-19T19:12:20.998 INFO:tasks.workunit.client.1.smithi125.stdout:1/757: truncate d1/d26/d23/f68 1426907 0 2024-02-19T19:12:20.999 INFO:tasks.workunit.client.1.smithi125.stdout:5/830: symlink db/d17/l103 0 2024-02-19T19:12:20.999 INFO:tasks.workunit.client.1.smithi125.stdout:1/758: read d1/f30 [18950,44800] 0 2024-02-19T19:12:20.999 INFO:tasks.workunit.client.1.smithi125.stdout:5/831: mkdir db/d17/d85/d104 0 2024-02-19T19:12:20.999 INFO:tasks.workunit.client.1.smithi125.stdout:5/832: mkdir db/d26/d51/d105 0 2024-02-19T19:12:21.000 INFO:tasks.workunit.client.1.smithi125.stdout:1/759: symlink d1/d1a/ded/lf3 0 2024-02-19T19:12:21.000 INFO:tasks.workunit.client.1.smithi125.stdout:1/760: link d1/d78/lc3 d1/d1a/d3d/d6e/lf4 0 2024-02-19T19:12:21.000 INFO:tasks.workunit.client.1.smithi125.stdout:1/761: creat d1/d1a/d3d/de2/ff5 x:0 0 0 2024-02-19T19:12:21.000 INFO:tasks.workunit.client.1.smithi125.stdout:1/762: rmdir d1 39 2024-02-19T19:12:21.001 INFO:tasks.workunit.client.1.smithi125.stdout:5/833: write db/d17/d58/d4f/f9f [62963,109720] 0 2024-02-19T19:12:21.001 INFO:tasks.workunit.client.1.smithi125.stdout:1/763: rename d1/d26/d23/c28 to d1/d26/cf6 0 2024-02-19T19:12:21.001 INFO:tasks.workunit.client.1.smithi125.stdout:5/834: dread - db/d17/d58/d33/d98/dae/dfd/ffb zero size 2024-02-19T19:12:21.001 INFO:tasks.workunit.client.1.smithi125.stdout:5/835: dread db/d17/d58/d33/d91/dbe/fbb [2744320,53248] 0 2024-02-19T19:12:21.002 INFO:tasks.workunit.client.1.smithi125.stdout:5/836: truncate db/d47/f5f 1469455 0 2024-02-19T19:12:21.002 INFO:tasks.workunit.client.1.smithi125.stdout:1/764: creat d1/d1a/ded/ff7 x:0 0 0 2024-02-19T19:12:21.002 INFO:tasks.workunit.client.1.smithi125.stdout:5/837: readlink db/d17/d58/d33/d53/lf2 0 2024-02-19T19:12:21.002 INFO:tasks.workunit.client.1.smithi125.stdout:1/765: dread - d1/d1a/fb4 zero size 2024-02-19T19:12:21.003 INFO:tasks.workunit.client.1.smithi125.stdout:5/838: mkdir db/d17/d106 0 2024-02-19T19:12:21.003 INFO:tasks.workunit.client.1.smithi125.stdout:5/839: rename db/d17/d58/d33/d64/fcf to db/d17/d58/d33/d98/dae/dfd/d5d/f107 0 2024-02-19T19:12:21.003 INFO:tasks.workunit.client.1.smithi125.stdout:5/840: rename db/d17/d58/d4f/faf to db/d17/d58/d33/d53/dce/f108 0 2024-02-19T19:12:21.123 INFO:tasks.workunit.client.1.smithi125.stdout:3/477: fdatasync d0/f24 0 2024-02-19T19:12:21.124 INFO:tasks.workunit.client.1.smithi125.stdout:3/478: dread d0/d1/d1e/f5a [118784,86016] 0 2024-02-19T19:12:21.144 INFO:tasks.workunit.client.1.smithi125.stdout:7/591: fsync d12/d18/d2c/d4e/f99 0 2024-02-19T19:12:21.144 INFO:tasks.workunit.client.1.smithi125.stdout:5/841: fdatasync db/d17/d58/d33/d98/dae/dfd/f5a 0 2024-02-19T19:12:21.144 INFO:tasks.workunit.client.1.smithi125.stdout:6/713: fsync d6/db/d5d/f40 0 2024-02-19T19:12:21.145 INFO:tasks.workunit.client.1.smithi125.stdout:2/553: fsync d1/d36/d70/f49 0 2024-02-19T19:12:21.150 INFO:tasks.workunit.client.1.smithi125.stdout:6/714: link d6/db/d49/d4c/c8e d6/db/d49/ce8 0 2024-02-19T19:12:21.150 INFO:tasks.workunit.client.1.smithi125.stdout:5/842: mknod db/d17/d85/c109 0 2024-02-19T19:12:21.150 INFO:tasks.workunit.client.1.smithi125.stdout:2/554: mkdir d1/d36/d70/d85/da4 0 2024-02-19T19:12:21.150 INFO:tasks.workunit.client.1.smithi125.stdout:8/555: dwrite db/d18/d2f/f39 [1626112,12288] 0 2024-02-19T19:12:21.151 INFO:tasks.workunit.client.1.smithi125.stdout:7/592: symlink d12/d18/d44/d3b/d59/d67/la8 0 2024-02-19T19:12:21.151 INFO:tasks.workunit.client.1.smithi125.stdout:3/479: dwrite d0/d1/d4b/f50 [872448,81920] 0 2024-02-19T19:12:21.151 INFO:tasks.workunit.client.1.smithi125.stdout:7/593: dread d12/d18/d44/d51/d81/f83 [475136,28672] 0 2024-02-19T19:12:21.151 INFO:tasks.workunit.client.1.smithi125.stdout:8/556: creat db/d18/d30/d48/d67/d96/fb2 x:0 0 0 2024-02-19T19:12:21.152 INFO:tasks.workunit.client.1.smithi125.stdout:8/557: dread db/d18/d2f/d3f/f75 [831488,20480] 0 2024-02-19T19:12:21.152 INFO:tasks.workunit.client.1.smithi125.stdout:3/480: symlink d0/d1/d1e/d60/d7c/l99 0 2024-02-19T19:12:21.152 INFO:tasks.workunit.client.1.smithi125.stdout:5/843: write db/d17/d58/d4f/ff6 [1756146,109066] 0 2024-02-19T19:12:21.152 INFO:tasks.workunit.client.1.smithi125.stdout:5/844: chown db/d26/d51/f7c 19777 1 2024-02-19T19:12:21.153 INFO:tasks.workunit.client.1.smithi125.stdout:5/845: chown db/d17/d58/d4f/fe0 821 1 2024-02-19T19:12:21.153 INFO:tasks.workunit.client.1.smithi125.stdout:5/846: chown db/d17/d58/d33/d53/lf2 8 1 2024-02-19T19:12:21.153 INFO:tasks.workunit.client.1.smithi125.stdout:5/847: dread db/d17/d85/fde [757760,16384] 0 2024-02-19T19:12:21.153 INFO:tasks.workunit.client.1.smithi125.stdout:5/848: link db/d17/d58/d33/d98/dae/dfd/d5d/l101 db/d47/l10a 0 2024-02-19T19:12:21.154 INFO:tasks.workunit.client.1.smithi125.stdout:1/766: dwrite d1/d1a/fb4 [532480,4096] 0 2024-02-19T19:12:21.154 INFO:tasks.workunit.client.1.smithi125.stdout:9/635: dwrite d8/d15/d22/fb6 [552960,20480] 0 2024-02-19T19:12:21.154 INFO:tasks.workunit.client.1.smithi125.stdout:5/849: mkdir db/d26/d10b 0 2024-02-19T19:12:21.154 INFO:tasks.workunit.client.1.smithi125.stdout:5/850: creat db/d26/f10c x:0 0 0 2024-02-19T19:12:21.155 INFO:tasks.workunit.client.1.smithi125.stdout:5/851: symlink db/d17/d58/d33/d91/dbe/l10d 0 2024-02-19T19:12:21.155 INFO:tasks.workunit.client.1.smithi125.stdout:9/636: write d8/d15/d32/d4f/f59 [2195844,80235] 0 2024-02-19T19:12:21.155 INFO:tasks.workunit.client.1.smithi125.stdout:5/852: write db/d17/d58/ff [178360,102089] 0 2024-02-19T19:12:21.155 INFO:tasks.workunit.client.1.smithi125.stdout:9/637: symlink d8/d15/d22/le6 0 2024-02-19T19:12:21.156 INFO:tasks.workunit.client.1.smithi125.stdout:9/638: stat d8/d15/d22/d4e/d90/f9a 0 2024-02-19T19:12:21.156 INFO:tasks.workunit.client.1.smithi125.stdout:9/639: write d8/d2e/f45 [1276931,1436] 0 2024-02-19T19:12:21.156 INFO:tasks.workunit.client.1.smithi125.stdout:9/640: chown d8/d15/l21 172 1 2024-02-19T19:12:21.156 INFO:tasks.workunit.client.1.smithi125.stdout:9/641: mkdir d8/d15/d32/d4f/de7 0 2024-02-19T19:12:21.157 INFO:tasks.workunit.client.1.smithi125.stdout:9/642: chown d8/d15/d32/d4f/ldf 3 1 2024-02-19T19:12:21.192 INFO:tasks.workunit.client.1.smithi125.stdout:6/715: fdatasync d6/db/d5d/d2f/d45/dd9/d16/f5c 0 2024-02-19T19:12:21.192 INFO:tasks.workunit.client.1.smithi125.stdout:6/716: mknod d6/db/d5d/d93/da2/ce9 0 2024-02-19T19:12:21.192 INFO:tasks.workunit.client.1.smithi125.stdout:6/717: creat d6/db/d5d/d2f/d45/dd9/dbb/fea x:0 0 0 2024-02-19T19:12:21.193 INFO:tasks.workunit.client.1.smithi125.stdout:6/718: dread - d6/db/d5d/d2f/d7b/d8d/fe2 zero size 2024-02-19T19:12:21.193 INFO:tasks.workunit.client.1.smithi125.stdout:6/719: write d6/db/d5d/d29/f2d [2447187,119221] 0 2024-02-19T19:12:21.193 INFO:tasks.workunit.client.1.smithi125.stdout:5/853: fsync db/d17/d58/d33/d91/dbe/f5b 0 2024-02-19T19:12:21.193 INFO:tasks.workunit.client.1.smithi125.stdout:6/720: write d6/db/d5d/d2f/d45/f8a [103863,52263] 0 2024-02-19T19:12:21.193 INFO:tasks.workunit.client.1.smithi125.stdout:6/721: rename d6/db/d5d/d2f/d45/dd9/dbb/fe0 to d6/db/d5d/d2f/d7b/d8d/dbc/feb 0 2024-02-19T19:12:21.193 INFO:tasks.workunit.client.1.smithi125.stdout:6/722: getdents d6/db/d98 0 2024-02-19T19:12:21.193 INFO:tasks.workunit.client.1.smithi125.stdout:6/723: rename d6/db/d5d/d29/fc5 to d6/db/d5d/d2f/d45/fec 0 2024-02-19T19:12:21.193 INFO:tasks.workunit.client.1.smithi125.stdout:6/724: creat d6/db/d49/fed x:0 0 0 2024-02-19T19:12:21.194 INFO:tasks.workunit.client.1.smithi125.stdout:5/854: write db/d17/d58/d33/d98/dae/dfd/d5d/fe7 [730381,65690] 0 2024-02-19T19:12:21.194 INFO:tasks.workunit.client.1.smithi125.stdout:5/855: read db/d17/d58/d4f/f7a [1182127,16128] 0 2024-02-19T19:12:21.194 INFO:tasks.workunit.client.1.smithi125.stdout:6/725: write d6/db/d5d/d2f/d45/dd9/d16/f81 [676429,15578] 0 2024-02-19T19:12:21.194 INFO:tasks.workunit.client.1.smithi125.stdout:6/726: rename d6/ld7 to d6/db/d5d/lee 0 2024-02-19T19:12:21.198 INFO:tasks.workunit.client.1.smithi125.stdout:7/594: dwrite d12/d18/d44/d3b/d59/d26/d54/f5f [872448,114688] 0 2024-02-19T19:12:21.198 INFO:tasks.workunit.client.1.smithi125.stdout:7/595: unlink d12/d18/d44/d3b/d59/d2a/d31/d50/d60/fa4 0 2024-02-19T19:12:21.198 INFO:tasks.workunit.client.1.smithi125.stdout:9/643: dwrite d8/d15/d22/fcf [389120,77824] 0 2024-02-19T19:12:21.199 INFO:tasks.workunit.client.1.smithi125.stdout:9/644: dread d8/d15/d32/f9b [131072,28672] 0 2024-02-19T19:12:21.199 INFO:tasks.workunit.client.1.smithi125.stdout:9/645: write d8/d2e/f45 [814472,122453] 0 2024-02-19T19:12:21.199 INFO:tasks.workunit.client.1.smithi125.stdout:9/646: rename d8/d15/d22/fbc to d8/d15/d32/d4f/de7/fe8 0 2024-02-19T19:12:21.199 INFO:tasks.workunit.client.1.smithi125.stdout:9/647: dread d8/d2e/d4c/f7c [65536,45056] 0 2024-02-19T19:12:21.199 INFO:tasks.workunit.client.1.smithi125.stdout:9/648: creat d8/d2e/d4c/fe9 x:0 0 0 2024-02-19T19:12:21.199 INFO:tasks.workunit.client.1.smithi125.stdout:9/649: readlink d8/d15/d32/l1e 0 2024-02-19T19:12:21.199 INFO:tasks.workunit.client.1.smithi125.stdout:3/481: dwrite d0/d5f/d71/f7f [1589248,24576] 0 2024-02-19T19:12:21.200 INFO:tasks.workunit.client.1.smithi125.stdout:3/482: dread d0/d1/d39/f84 [557056,110592] 0 2024-02-19T19:12:21.200 INFO:tasks.workunit.client.1.smithi125.stdout:3/483: chown d0/d1/d4b/d52/l53 25095153 1 2024-02-19T19:12:21.200 INFO:tasks.workunit.client.1.smithi125.stdout:3/484: truncate d0/d1/d1e/f5d 361893 0 2024-02-19T19:12:21.200 INFO:tasks.workunit.client.1.smithi125.stdout:3/485: truncate d0/d1/d4b/f7b 1603203 0 2024-02-19T19:12:21.200 INFO:tasks.workunit.client.1.smithi125.stdout:3/486: readlink d0/d1/d1e/d60/l7e 0 2024-02-19T19:12:21.200 INFO:tasks.workunit.client.1.smithi125.stdout:1/767: dwrite d1/dc/d36/fa5 [536576,40960] 0 2024-02-19T19:12:21.201 INFO:tasks.workunit.client.1.smithi125.stdout:3/487: creat d0/d1/d1e/d60/d73/d74/d82/f9a x:0 0 0 2024-02-19T19:12:21.201 INFO:tasks.workunit.client.1.smithi125.stdout:1/768: symlink d1/d26/lf8 0 2024-02-19T19:12:21.201 INFO:tasks.workunit.client.1.smithi125.stdout:8/558: dread db/d18/d30/d80/d9e/da3/fa5 [282624,122880] 0 2024-02-19T19:12:21.201 INFO:tasks.workunit.client.1.smithi125.stdout:1/769: truncate d1/da3/fc5 1614284 0 2024-02-19T19:12:21.201 INFO:tasks.workunit.client.1.smithi125.stdout:1/770: dread - d1/dc/d36/d69/f8e zero size 2024-02-19T19:12:21.201 INFO:tasks.workunit.client.1.smithi125.stdout:5/856: dwrite db/d17/d58/d33/d98/dae/dfd/d5d/fe7 [90112,28672] 0 2024-02-19T19:12:21.201 INFO:tasks.workunit.client.1.smithi125.stdout:5/857: creat db/f10e x:0 0 0 2024-02-19T19:12:21.201 INFO:tasks.workunit.client.1.smithi125.stdout:5/858: readlink db/d47/l62 0 2024-02-19T19:12:21.202 INFO:tasks.workunit.client.1.smithi125.stdout:6/727: dwrite d6/db/d49/fed [262144,8192] 0 2024-02-19T19:12:21.202 INFO:tasks.workunit.client.1.smithi125.stdout:6/728: stat d6/fb0 0 2024-02-19T19:12:21.202 INFO:tasks.workunit.client.1.smithi125.stdout:5/859: creat db/d17/d58/d33/f10f x:0 0 0 2024-02-19T19:12:21.202 INFO:tasks.workunit.client.1.smithi125.stdout:5/860: symlink db/d47/db6/l110 0 2024-02-19T19:12:21.202 INFO:tasks.workunit.client.1.smithi125.stdout:6/729: mkdir d6/db/d5d/d2f/d45/d4e/def 0 2024-02-19T19:12:21.202 INFO:tasks.workunit.client.1.smithi125.stdout:5/861: link db/d26/d51/lc1 db/d26/d51/d105/l111 0 2024-02-19T19:12:21.202 INFO:tasks.workunit.client.1.smithi125.stdout:5/862: stat db/d17/d58/lc7 0 2024-02-19T19:12:21.202 INFO:tasks.workunit.client.1.smithi125.stdout:6/730: symlink d6/db/d5d/lf0 0 2024-02-19T19:12:21.203 INFO:tasks.workunit.client.1.smithi125.stdout:6/731: truncate d6/db/da7/fb2 291134 0 2024-02-19T19:12:21.203 INFO:tasks.workunit.client.1.smithi125.stdout:6/732: creat d6/db/d5d/d2f/d45/dd9/d3b/dda/ff1 x:0 0 0 2024-02-19T19:12:21.203 INFO:tasks.workunit.client.1.smithi125.stdout:6/733: creat d6/db/d98/ff2 x:0 0 0 2024-02-19T19:12:21.266 INFO:tasks.workunit.client.1.smithi125.stdout:8/559: fsync db/d18/d30/d80/d9e/da3/faa 0 2024-02-19T19:12:21.281 INFO:tasks.workunit.client.1.smithi125.stdout:7/596: dwrite d12/d18/d44/d3b/d59/f5e [2203648,24576] 0 2024-02-19T19:12:21.281 INFO:tasks.workunit.client.1.smithi125.stdout:6/734: dwrite d6/db/d5d/d2f/d45/dd9/d3b/dda/ff1 [966656,12288] 0 2024-02-19T19:12:21.281 INFO:tasks.workunit.client.1.smithi125.stdout:9/650: dwrite d8/d15/d32/d4f/d6e/f75 [999424,118784] 0 2024-02-19T19:12:21.282 INFO:tasks.workunit.client.1.smithi125.stdout:5/863: dwrite db/d17/d58/d33/fc9 [704512,36864] 0 2024-02-19T19:12:21.282 INFO:tasks.workunit.client.1.smithi125.stdout:8/560: creat db/d18/d30/d80/d9e/fb3 x:0 0 0 2024-02-19T19:12:21.282 INFO:tasks.workunit.client.1.smithi125.stdout:3/488: dwrite d0/f33 [884736,12288] 0 2024-02-19T19:12:21.282 INFO:tasks.workunit.client.1.smithi125.stdout:6/735: readlink d6/db/d5d/d2f/d45/d4e/l73 0 2024-02-19T19:12:21.282 INFO:tasks.workunit.client.1.smithi125.stdout:7/597: truncate d12/d18/d44/d3b/d59/d2a/f4a 770095 0 2024-02-19T19:12:21.282 INFO:tasks.workunit.client.1.smithi125.stdout:9/651: truncate d8/d2e/d6d/f88 21238 0 2024-02-19T19:12:21.282 INFO:tasks.workunit.client.1.smithi125.stdout:5/864: getdents db/d17/d58/d33/d98/d9c/ddc 0 2024-02-19T19:12:21.282 INFO:tasks.workunit.client.1.smithi125.stdout:7/598: getdents d12/d18/d44/d51/d81 0 2024-02-19T19:12:21.283 INFO:tasks.workunit.client.1.smithi125.stdout:7/599: getdents d12/d18/d44/d3b/d59/d67 0 2024-02-19T19:12:21.283 INFO:tasks.workunit.client.1.smithi125.stdout:9/652: creat d8/d15/da2/de1/fea x:0 0 0 2024-02-19T19:12:21.283 INFO:tasks.workunit.client.1.smithi125.stdout:7/600: write d12/d18/f3c [2681514,46040] 0 2024-02-19T19:12:21.283 INFO:tasks.workunit.client.1.smithi125.stdout:9/653: dread d8/d15/d32/d4f/d6e/f8d [921600,126976] 0 2024-02-19T19:12:21.283 INFO:tasks.workunit.client.1.smithi125.stdout:7/601: mknod d12/d18/d44/d3b/d59/d26/ca9 0 2024-02-19T19:12:21.283 INFO:tasks.workunit.client.1.smithi125.stdout:7/602: readlink d12/d18/d44/d51/l5a 0 2024-02-19T19:12:21.283 INFO:tasks.workunit.client.1.smithi125.stdout:7/603: mknod d12/d18/d44/d3b/caa 0 2024-02-19T19:12:21.283 INFO:tasks.workunit.client.1.smithi125.stdout:7/604: write d12/d18/d44/d3b/d59/d2a/d31/d50/d60/f96 [1322798,22548] 0 2024-02-19T19:12:21.284 INFO:tasks.workunit.client.1.smithi125.stdout:7/605: chown d12/d18/d44/d3b/d59/d26/d30/d97 565802234 1 2024-02-19T19:12:21.284 INFO:tasks.workunit.client.1.smithi125.stdout:7/606: chown d12/d18/d44/d3b/d59/d2a/d6a/l55 3949 1 2024-02-19T19:12:21.284 INFO:tasks.workunit.client.1.smithi125.stdout:1/771: dread d1/d26/f3b [1114112,106496] 0 2024-02-19T19:12:21.284 INFO:tasks.workunit.client.1.smithi125.stdout:1/772: symlink d1/da3/lf9 0 2024-02-19T19:12:21.284 INFO:tasks.workunit.client.1.smithi125.stdout:1/773: mknod d1/dc/d36/cfa 0 2024-02-19T19:12:21.284 INFO:tasks.workunit.client.1.smithi125.stdout:3/489: dwrite d0/d1/d1e/d60/d73/f83 [831488,4096] 0 2024-02-19T19:12:21.284 INFO:tasks.workunit.client.1.smithi125.stdout:3/490: creat d0/d1/d1e/d60/d73/d74/d82/f9b x:0 0 0 2024-02-19T19:12:21.285 INFO:tasks.workunit.client.1.smithi125.stdout:6/736: dwrite d6/db/d49/d4c/f92 [724992,20480] 0 2024-02-19T19:12:21.285 INFO:tasks.workunit.client.1.smithi125.stdout:6/737: mkdir d6/db/d5d/d2f/d45/dd9/d3b/dcc/df3 0 2024-02-19T19:12:21.285 INFO:tasks.workunit.client.1.smithi125.stdout:6/738: write d6/db/d5d/d2f/d45/dd9/d16/f5c [1131490,28220] 0 2024-02-19T19:12:21.285 INFO:tasks.workunit.client.1.smithi125.stdout:5/865: dwrite db/d17/d58/d4f/f56 [524288,49152] 0 2024-02-19T19:12:21.285 INFO:tasks.workunit.client.1.smithi125.stdout:6/739: dread d6/db/d5d/d2f/d45/dd9/f12 [2920448,118784] 0 2024-02-19T19:12:21.285 INFO:tasks.workunit.client.1.smithi125.stdout:5/866: creat db/d17/d58/d33/d64/df1/f112 x:0 0 0 2024-02-19T19:12:21.285 INFO:tasks.workunit.client.1.smithi125.stdout:6/740: stat d6/db/d49/fed 0 2024-02-19T19:12:21.285 INFO:tasks.workunit.client.1.smithi125.stdout:5/867: creat db/d17/d58/d33/d98/d9c/f113 x:0 0 0 2024-02-19T19:12:21.286 INFO:tasks.workunit.client.1.smithi125.stdout:5/868: dread db/d17/d58/d33/d98/d9c/f9e [536576,90112] 0 2024-02-19T19:12:21.286 INFO:tasks.workunit.client.1.smithi125.stdout:5/869: mknod db/d17/d58/d33/d53/c114 0 2024-02-19T19:12:21.286 INFO:tasks.workunit.client.1.smithi125.stdout:7/607: dwrite d12/d18/d2c/f42 [1810432,36864] 0 2024-02-19T19:12:21.286 INFO:tasks.workunit.client.1.smithi125.stdout:6/741: mkdir d6/db/d5d/d2f/d45/dd9/d3b/dcc/df4 0 2024-02-19T19:12:21.286 INFO:tasks.workunit.client.1.smithi125.stdout:5/870: creat db/d17/d58/d33/f115 x:0 0 0 2024-02-19T19:12:21.286 INFO:tasks.workunit.client.1.smithi125.stdout:5/871: chown db/d17/d58/d33/d98/dae/dfd/d5d/led 34072 1 2024-02-19T19:12:21.286 INFO:tasks.workunit.client.1.smithi125.stdout:5/872: chown db/d17/d58/d33/d98/d9c/ddc 7 1 2024-02-19T19:12:21.287 INFO:tasks.workunit.client.1.smithi125.stdout:7/608: write d12/d18/d2c/d4e/f99 [870446,22236] 0 2024-02-19T19:12:21.287 INFO:tasks.workunit.client.1.smithi125.stdout:5/873: unlink db/d26/l8d 0 2024-02-19T19:12:21.287 INFO:tasks.workunit.client.1.smithi125.stdout:7/609: mkdir d12/d18/d44/d3b/d59/d2a/d6a/dab 0 2024-02-19T19:12:21.287 INFO:tasks.workunit.client.1.smithi125.stdout:1/774: dwrite d1/dc/d36/f54 [86016,28672] 0 2024-02-19T19:12:21.287 INFO:tasks.workunit.client.1.smithi125.stdout:7/610: rename d12/d18/d44/d3b/d59/d2a/d31/f61 to d12/d18/d44/d3b/d59/fac 0 2024-02-19T19:12:21.287 INFO:tasks.workunit.client.1.smithi125.stdout:7/611: dread d12/d18/d2c/f2d [61440,122880] 0 2024-02-19T19:12:21.287 INFO:tasks.workunit.client.1.smithi125.stdout:7/612: rename d12/d18/d44/d3b/d59/d2a/d48 to d12/d18/d44/d3b/d59/d26/d30/dad 0 2024-02-19T19:12:21.287 INFO:tasks.workunit.client.1.smithi125.stdout:7/613: symlink d12/d18/d44/d3b/d59/d67/lae 0 2024-02-19T19:12:21.287 INFO:tasks.workunit.client.1.smithi125.stdout:7/614: symlink d12/d18/d66/laf 0 2024-02-19T19:12:21.288 INFO:tasks.workunit.client.1.smithi125.stdout:7/615: chown d12/d18/d2c/f76 1 1 2024-02-19T19:12:21.288 INFO:tasks.workunit.client.1.smithi125.stdout:7/616: creat d12/d18/d44/d51/d81/fb0 x:0 0 0 2024-02-19T19:12:21.382 INFO:tasks.workunit.client.1.smithi125.stdout:8/561: fdatasync db/d18/d30/d3c/d4d/d5d/f64 0 2024-02-19T19:12:21.382 INFO:tasks.workunit.client.1.smithi125.stdout:9/654: fdatasync d8/d15/d22/d4e/f56 0 2024-02-19T19:12:21.382 INFO:tasks.workunit.client.1.smithi125.stdout:9/655: write d8/d15/d32/d4f/d6e/fc2 [252481,98381] 0 2024-02-19T19:12:21.383 INFO:tasks.workunit.client.1.smithi125.stdout:9/656: dread d8/d15/d9d/fd1 [286720,40960] 0 2024-02-19T19:12:21.383 INFO:tasks.workunit.client.1.smithi125.stdout:6/742: dwrite d6/db/d49/d4c/f74 [1781760,16384] 0 2024-02-19T19:12:21.387 INFO:tasks.workunit.client.1.smithi125.stdout:1/775: creat d1/d1a/d3d/d6e/d87/ffb x:0 0 0 2024-02-19T19:12:21.387 INFO:tasks.workunit.client.1.smithi125.stdout:1/776: symlink d1/d1a/d3d/de2/lfc 0 2024-02-19T19:12:21.387 INFO:tasks.workunit.client.1.smithi125.stdout:1/777: symlink d1/d78/d8a/lfd 0 2024-02-19T19:12:21.387 INFO:tasks.workunit.client.1.smithi125.stdout:1/778: symlink d1/d1a/d3d/d6e/d87/lfe 0 2024-02-19T19:12:21.388 INFO:tasks.workunit.client.1.smithi125.stdout:8/562: dread db/d18/d30/d80/d9e/da3/fa5 [348160,106496] 0 2024-02-19T19:12:21.388 INFO:tasks.workunit.client.1.smithi125.stdout:8/563: mkdir db/db4 0 2024-02-19T19:12:21.388 INFO:tasks.workunit.client.1.smithi125.stdout:8/564: rename db/ld to db/d18/d30/d3c/d4d/d5d/d6f/lb5 0 2024-02-19T19:12:21.388 INFO:tasks.workunit.client.1.smithi125.stdout:8/565: getdents db/d18/d30/d3c/d4d/d5d 0 2024-02-19T19:12:21.388 INFO:tasks.workunit.client.1.smithi125.stdout:8/566: readlink db/lf 0 2024-02-19T19:12:21.388 INFO:tasks.workunit.client.1.smithi125.stdout:8/567: dread db/d18/d30/d3c/f68 [1159168,36864] 0 2024-02-19T19:12:21.388 INFO:tasks.workunit.client.1.smithi125.stdout:8/568: creat db/d18/d30/d80/d9e/da3/fb6 x:0 0 0 2024-02-19T19:12:21.389 INFO:tasks.workunit.client.1.smithi125.stdout:8/569: stat db/d18/d2f/l7e 0 2024-02-19T19:12:21.389 INFO:tasks.workunit.client.1.smithi125.stdout:3/491: mkdir d0/d95/d9c 0 2024-02-19T19:12:21.389 INFO:tasks.workunit.client.1.smithi125.stdout:9/657: dwrite d8/d15/f86 [266240,49152] 0 2024-02-19T19:12:21.389 INFO:tasks.workunit.client.1.smithi125.stdout:9/658: truncate d8/d15/d32/d4f/d6e/fbf 451574 0 2024-02-19T19:12:21.389 INFO:tasks.workunit.client.1.smithi125.stdout:9/659: mknod d8/d2e/d6d/ceb 0 2024-02-19T19:12:21.389 INFO:tasks.workunit.client.1.smithi125.stdout:9/660: truncate d8/d2e/fe5 740233 0 2024-02-19T19:12:21.394 INFO:tasks.workunit.client.1.smithi125.stdout:6/743: write d6/db/d5d/d2f/d45/dd9/d16/f2b [1538725,66548] 0 2024-02-19T19:12:21.394 INFO:tasks.workunit.client.1.smithi125.stdout:6/744: write d6/db/d5d/f5f [1272281,17559] 0 2024-02-19T19:12:21.394 INFO:tasks.workunit.client.1.smithi125.stdout:6/745: symlink d6/db/d5d/lf5 0 2024-02-19T19:12:21.394 INFO:tasks.workunit.client.1.smithi125.stdout:6/746: mknod d6/db/d5d/d2f/d7b/d8d/dbc/cf6 0 2024-02-19T19:12:21.394 INFO:tasks.workunit.client.1.smithi125.stdout:6/747: rename d6/db/d98/ff2 to d6/db/d49/d4c/ff7 0 2024-02-19T19:12:21.394 INFO:tasks.workunit.client.1.smithi125.stdout:6/748: symlink d6/db/d5d/d93/lf8 0 2024-02-19T19:12:21.394 INFO:tasks.workunit.client.1.smithi125.stdout:6/749: chown d6/db/d5d/f19 166906 1 2024-02-19T19:12:21.394 INFO:tasks.workunit.client.1.smithi125.stdout:6/750: write d6/db/f3e [1076765,33248] 0 2024-02-19T19:12:21.395 INFO:tasks.workunit.client.1.smithi125.stdout:6/751: write d6/db/d5d/d29/f2d [1102315,78161] 0 2024-02-19T19:12:21.432 INFO:tasks.workunit.client.1.smithi125.stdout:5/874: fdatasync db/d17/f7d 0 2024-02-19T19:12:21.432 INFO:tasks.workunit.client.1.smithi125.stdout:5/875: write f1 [1881139,24555] 0 2024-02-19T19:12:21.433 INFO:tasks.workunit.client.1.smithi125.stdout:5/876: truncate db/d26/f90 1136128 0 2024-02-19T19:12:21.433 INFO:tasks.workunit.client.1.smithi125.stdout:5/877: symlink db/d17/d58/l116 0 2024-02-19T19:12:21.433 INFO:tasks.workunit.client.1.smithi125.stdout:5/878: dread db/d17/d58/d33/d64/f70 [1441792,45056] 0 2024-02-19T19:12:21.433 INFO:tasks.workunit.client.1.smithi125.stdout:5/879: creat db/d17/d58/d33/d98/dae/f117 x:0 0 0 2024-02-19T19:12:21.433 INFO:tasks.workunit.client.1.smithi125.stdout:3/492: dwrite d0/d1/f41 [704512,40960] 0 2024-02-19T19:12:21.433 INFO:tasks.workunit.client.1.smithi125.stdout:3/493: chown d0/d1/f41 125034 1 2024-02-19T19:12:21.433 INFO:tasks.workunit.client.1.smithi125.stdout:3/494: chown d0/l97 484 1 2024-02-19T19:12:21.434 INFO:tasks.workunit.client.1.smithi125.stdout:3/495: truncate d0/de/f13 610208 0 2024-02-19T19:12:21.436 INFO:tasks.workunit.client.1.smithi125.stdout:8/570: dwrite db/d18/d2f/f93 [524288,86016] 0 2024-02-19T19:12:21.436 INFO:tasks.workunit.client.1.smithi125.stdout:8/571: write db/d18/d30/d3c/d4d/d5d/d6f/f77 [632958,34] 0 2024-02-19T19:12:21.436 INFO:tasks.workunit.client.1.smithi125.stdout:8/572: symlink db/d18/lb7 0 2024-02-19T19:12:21.436 INFO:tasks.workunit.client.1.smithi125.stdout:8/573: dread - db/d18/d2f/d3f/fad zero size 2024-02-19T19:12:21.436 INFO:tasks.workunit.client.1.smithi125.stdout:8/574: creat db/d81/d95/fb8 x:0 0 0 2024-02-19T19:12:21.436 INFO:tasks.workunit.client.1.smithi125.stdout:8/575: dread db/d18/d30/d3c/d4d/f56 [1388544,81920] 0 2024-02-19T19:12:21.437 INFO:tasks.workunit.client.1.smithi125.stdout:8/576: readlink db/l23 0 2024-02-19T19:12:21.437 INFO:tasks.workunit.client.1.smithi125.stdout:8/577: dread - db/f73 zero size 2024-02-19T19:12:21.437 INFO:tasks.workunit.client.1.smithi125.stdout:6/752: dwrite d6/db/d5d/d2f/d45/f8a [1044480,77824] 0 2024-02-19T19:12:21.437 INFO:tasks.workunit.client.1.smithi125.stdout:9/661: dwrite d8/f9 [270336,36864] 0 2024-02-19T19:12:21.437 INFO:tasks.workunit.client.1.smithi125.stdout:5/880: dwrite db/d17/d58/d33/d98/fd7 [45056,4096] 0 2024-02-19T19:12:21.437 INFO:tasks.workunit.client.1.smithi125.stdout:5/881: creat db/d17/d85/dda/f118 x:0 0 0 2024-02-19T19:12:21.437 INFO:tasks.workunit.client.1.smithi125.stdout:5/882: chown db/d47 451623553 1 2024-02-19T19:12:21.437 INFO:tasks.workunit.client.1.smithi125.stdout:5/883: chown db/d17/d58/d33/d53/dd5/le2 26520285 1 2024-02-19T19:12:21.438 INFO:tasks.workunit.client.1.smithi125.stdout:5/884: dread db/d17/d58/d33/d98/d9c/fa4 [65536,77824] 0 2024-02-19T19:12:21.438 INFO:tasks.workunit.client.1.smithi125.stdout:5/885: dread db/d17/f55 [1507328,86016] 0 2024-02-19T19:12:21.438 INFO:tasks.workunit.client.1.smithi125.stdout:5/886: link db/d17/d58/d33/d91/ldb db/d17/d58/d33/d98/d9c/l119 0 2024-02-19T19:12:21.438 INFO:tasks.workunit.client.1.smithi125.stdout:3/496: dwrite d0/d1/d4b/d52/d81/f92 [483328,36864] 0 2024-02-19T19:12:21.438 INFO:tasks.workunit.client.1.smithi125.stdout:3/497: link d0/d1/d4b/d52/d81/f90 d0/d1/d1e/d60/f9d 0 2024-02-19T19:12:21.438 INFO:tasks.workunit.client.1.smithi125.stdout:3/498: dread - d0/d1/d4b/d52/d81/f8f zero size 2024-02-19T19:12:21.438 INFO:tasks.workunit.client.1.smithi125.stdout:3/499: link d0/f24 d0/d1/d1e/f9e 0 2024-02-19T19:12:21.478 INFO:tasks.workunit.client.1.smithi125.stdout:9/662: fdatasync d8/d15/d22/f67 0 2024-02-19T19:12:21.478 INFO:tasks.workunit.client.1.smithi125.stdout:9/663: dread d8/d15/d22/fb6 [192512,24576] 0 2024-02-19T19:12:21.479 INFO:tasks.workunit.client.1.smithi125.stdout:3/500: fdatasync d0/d1/d4b/d52/d81/f8f 0 2024-02-19T19:12:21.479 INFO:tasks.workunit.client.1.smithi125.stdout:8/578: fdatasync db/d18/d30/d3c/d4d/f56 0 2024-02-19T19:12:21.479 INFO:tasks.workunit.client.1.smithi125.stdout:3/501: symlink d0/d1/d4b/d52/l9f 0 2024-02-19T19:12:21.479 INFO:tasks.workunit.client.1.smithi125.stdout:3/502: chown d0/c4e 94933 1 2024-02-19T19:12:21.479 INFO:tasks.workunit.client.1.smithi125.stdout:8/579: mkdir db/d18/d30/d48/db9 0 2024-02-19T19:12:21.479 INFO:tasks.workunit.client.1.smithi125.stdout:3/503: write d0/d1/f56 [1789579,58873] 0 2024-02-19T19:12:21.479 INFO:tasks.workunit.client.1.smithi125.stdout:8/580: write db/d18/d30/d80/d9e/da3/faa [96656,37000] 0 2024-02-19T19:12:21.479 INFO:tasks.workunit.client.1.smithi125.stdout:8/581: stat db/d18/d30/d3c/d4d/l5b 0 2024-02-19T19:12:21.479 INFO:tasks.workunit.client.1.smithi125.stdout:8/582: dread db/d18/d2f/d72/f87 [835584,69632] 0 2024-02-19T19:12:21.480 INFO:tasks.workunit.client.1.smithi125.stdout:6/753: dwrite d6/db/f3e [1064960,114688] 0 2024-02-19T19:12:21.480 INFO:tasks.workunit.client.1.smithi125.stdout:6/754: dread - d6/fb0 zero size 2024-02-19T19:12:21.480 INFO:tasks.workunit.client.1.smithi125.stdout:6/755: mknod d6/db/d5d/d2f/d45/dd9/d3b/de1/cf9 0 2024-02-19T19:12:21.481 INFO:tasks.workunit.client.1.smithi125.stdout:8/583: link db/f41 db/d18/d30/d48/db1/fba 0 2024-02-19T19:12:21.481 INFO:tasks.workunit.client.1.smithi125.stdout:8/584: rename db/f73 to db/d18/d30/d80/dac/fbb 0 2024-02-19T19:12:21.481 INFO:tasks.workunit.client.1.smithi125.stdout:8/585: read - db/d18/d30/d48/d67/d96/fb2 zero size 2024-02-19T19:12:21.481 INFO:tasks.workunit.client.1.smithi125.stdout:8/586: chown db/d18/d30/d3c/d4d/d5d 3 1 2024-02-19T19:12:21.533 INFO:tasks.workunit.client.1.smithi125.stdout:9/664: fdatasync d8/d2e/d4c/faa 0 2024-02-19T19:12:21.533 INFO:tasks.workunit.client.1.smithi125.stdout:9/665: symlink d8/lec 0 2024-02-19T19:12:21.533 INFO:tasks.workunit.client.1.smithi125.stdout:3/504: fsync d0/d1/d1e/f1f 0 2024-02-19T19:12:21.534 INFO:tasks.workunit.client.1.smithi125.stdout:6/756: fsync d6/db/d49/fed 0 2024-02-19T19:12:21.534 INFO:tasks.workunit.client.1.smithi125.stdout:3/505: mknod d0/d1/d4b/ca0 0 2024-02-19T19:12:21.534 INFO:tasks.workunit.client.1.smithi125.stdout:3/506: mknod d0/d1/d4b/ca1 0 2024-02-19T19:12:21.534 INFO:tasks.workunit.client.1.smithi125.stdout:6/757: write d6/f1e [1132339,83420] 0 2024-02-19T19:12:21.534 INFO:tasks.workunit.client.1.smithi125.stdout:3/507: write d0/d5f/d71/f7f [1834452,5950] 0 2024-02-19T19:12:21.534 INFO:tasks.workunit.client.1.smithi125.stdout:3/508: mknod d0/d1/d4b/d52/ca2 0 2024-02-19T19:12:21.534 INFO:tasks.workunit.client.1.smithi125.stdout:6/758: truncate d6/db/d5d/f2a 1168069 0 2024-02-19T19:12:21.534 INFO:tasks.workunit.client.1.smithi125.stdout:3/509: unlink d0/de/c42 0 2024-02-19T19:12:21.535 INFO:tasks.workunit.client.1.smithi125.stdout:3/510: dread - d0/d1/d1e/d60/f85 zero size 2024-02-19T19:12:21.535 INFO:tasks.workunit.client.1.smithi125.stdout:6/759: write d6/db/d5d/f19 [1500114,1831] 0 2024-02-19T19:12:21.535 INFO:tasks.workunit.client.1.smithi125.stdout:3/511: creat d0/d1/d1e/d60/fa3 x:0 0 0 2024-02-19T19:12:21.535 INFO:tasks.workunit.client.1.smithi125.stdout:6/760: creat d6/db/d49/d4c/ffa x:0 0 0 2024-02-19T19:12:21.535 INFO:tasks.workunit.client.1.smithi125.stdout:3/512: readlink d0/l47 0 2024-02-19T19:12:21.535 INFO:tasks.workunit.client.1.smithi125.stdout:6/761: dread - d6/db/d5d/d2f/d45/dd9/f7c zero size 2024-02-19T19:12:21.535 INFO:tasks.workunit.client.1.smithi125.stdout:6/762: getdents d6/db/d5d/d2f/d45/dd9/d16 0 2024-02-19T19:12:21.535 INFO:tasks.workunit.client.1.smithi125.stdout:6/763: chown d6/db/d49/d4c 9213147 1 2024-02-19T19:12:21.548 INFO:tasks.workunit.client.1.smithi125.stdout:9/666: fsync d8/d15/d22/f67 0 2024-02-19T19:12:21.551 INFO:tasks.workunit.client.1.smithi125.stdout:3/513: dwrite d0/d1/f41 [929792,32768] 0 2024-02-19T19:12:21.551 INFO:tasks.workunit.client.1.smithi125.stdout:3/514: mkdir d0/d1/d1e/d69/da4 0 2024-02-19T19:12:21.551 INFO:tasks.workunit.client.1.smithi125.stdout:3/515: dread d0/f51 [389120,77824] 0 2024-02-19T19:12:21.551 INFO:tasks.workunit.client.1.smithi125.stdout:3/516: mkdir d0/d1/d1e/d60/da5 0 2024-02-19T19:12:21.551 INFO:tasks.workunit.client.1.smithi125.stdout:3/517: write d0/f51 [938376,71361] 0 2024-02-19T19:12:21.552 INFO:tasks.workunit.client.1.smithi125.stdout:3/518: dwrite d0/d1/d1e/f5a [729088,73728] 0 2024-02-19T19:12:21.552 INFO:tasks.workunit.client.1.smithi125.stdout:3/519: read d0/d1/d1e/f2c [382571,1271] 0 2024-02-19T19:12:21.553 INFO:tasks.workunit.client.1.smithi125.stdout:3/520: creat d0/d1/d1e/d60/d73/fa6 x:0 0 0 2024-02-19T19:12:21.553 INFO:tasks.workunit.client.1.smithi125.stdout:3/521: creat d0/d95/fa7 x:0 0 0 2024-02-19T19:12:21.553 INFO:tasks.workunit.client.1.smithi125.stdout:3/522: chown d0/d1/d1e/d60 307099845 1 2024-02-19T19:12:21.553 INFO:tasks.workunit.client.1.smithi125.stdout:3/523: getdents d0/d5f 0 2024-02-19T19:12:21.553 INFO:tasks.workunit.client.1.smithi125.stdout:3/524: write d0/d1/d1e/d60/d73/d74/d82/f89 [608186,87187] 0 2024-02-19T19:12:21.553 INFO:tasks.workunit.client.1.smithi125.stdout:3/525: stat d0/d1/d4b/d52/ca2 0 2024-02-19T19:12:21.553 INFO:tasks.workunit.client.1.smithi125.stdout:3/526: rmdir d0/d5f/d71 39 2024-02-19T19:12:21.623 INFO:tasks.workunit.client.1.smithi125.stdout:9/667: fdatasync d8/d15/d22/f78 0 2024-02-19T19:12:21.624 INFO:tasks.workunit.client.1.smithi125.stdout:9/668: creat d8/d2e/fed x:0 0 0 2024-02-19T19:12:21.624 INFO:tasks.workunit.client.1.smithi125.stdout:9/669: chown d8/d2e/f45 1580939 1 2024-02-19T19:12:21.624 INFO:tasks.workunit.client.1.smithi125.stdout:9/670: creat d8/d15/d32/d4f/d85/de2/fee x:0 0 0 2024-02-19T19:12:21.624 INFO:tasks.workunit.client.1.smithi125.stdout:6/764: fsync d6/db/d5d/d2f/d45/dd9/dbb/fea 0 2024-02-19T19:12:21.627 INFO:tasks.workunit.client.1.smithi125.stdout:9/671: creat d8/d15/d32/d4f/d85/dcb/fef x:0 0 0 2024-02-19T19:12:21.627 INFO:tasks.workunit.client.1.smithi125.stdout:9/672: dread - d8/d15/d32/d4f/d85/de2/fee zero size 2024-02-19T19:12:21.627 INFO:tasks.workunit.client.1.smithi125.stdout:9/673: readlink d8/d15/d22/d4e/d90/lac 0 2024-02-19T19:12:21.627 INFO:tasks.workunit.client.1.smithi125.stdout:9/674: dread d8/d15/d22/d4e/f7f [249856,12288] 0 2024-02-19T19:12:21.627 INFO:tasks.workunit.client.1.smithi125.stdout:9/675: write d8/d2e/fe5 [1690937,83337] 0 2024-02-19T19:12:21.628 INFO:tasks.workunit.client.1.smithi125.stdout:9/676: mkdir d8/d15/d32/d4f/d6e/df0 0 2024-02-19T19:12:21.628 INFO:tasks.workunit.client.1.smithi125.stdout:9/677: creat d8/d15/d32/d4f/d6e/df0/ff1 x:0 0 0 2024-02-19T19:12:21.628 INFO:tasks.workunit.client.1.smithi125.stdout:6/765: dwrite d6/db/f17 [688128,61440] 0 2024-02-19T19:12:21.628 INFO:tasks.workunit.client.1.smithi125.stdout:6/766: write d6/f9 [1587470,130841] 0 2024-02-19T19:12:21.628 INFO:tasks.workunit.client.1.smithi125.stdout:6/767: readlink d6/db/d49/l88 0 2024-02-19T19:12:21.628 INFO:tasks.workunit.client.1.smithi125.stdout:6/768: mkdir d6/db/d5d/d2f/d45/d4e/dfb 0 2024-02-19T19:12:21.628 INFO:tasks.workunit.client.1.smithi125.stdout:6/769: readlink d6/db/d5d/d2f/d7b/d8d/dd1/lde 0 2024-02-19T19:12:21.628 INFO:tasks.workunit.client.1.smithi125.stdout:6/770: creat d6/db/ffc x:0 0 0 2024-02-19T19:12:21.679 INFO:tasks.workunit.client.1.smithi125.stdout:9/678: fdatasync d8/fe 0 2024-02-19T19:12:21.679 INFO:tasks.workunit.client.1.smithi125.stdout:9/679: readlink d8/d15/l23 0 2024-02-19T19:12:21.681 INFO:tasks.workunit.client.1.smithi125.stdout:6/771: dwrite d6/db/d5d/d2f/d45/dd9/f54 [389120,106496] 0 2024-02-19T19:12:21.686 INFO:tasks.workunit.client.1.smithi125.stdout:6/772: unlink d6/db/d5d/d29/d68/l9f 0 2024-02-19T19:12:21.686 INFO:tasks.workunit.client.1.smithi125.stdout:6/773: symlink d6/lfd 0 2024-02-19T19:12:21.686 INFO:tasks.workunit.client.1.smithi125.stdout:6/774: getdents d6/db/d5d/d2f/d45/dd9/d3b/dcc/df3 0 2024-02-19T19:12:21.686 INFO:tasks.workunit.client.1.smithi125.stdout:6/775: dread d6/db/d5d/d2f/d45/dd9/f12 [327680,110592] 0 2024-02-19T19:12:21.686 INFO:tasks.workunit.client.1.smithi125.stdout:6/776: symlink d6/db/d5d/d2f/d45/d4e/def/lfe 0 2024-02-19T19:12:21.687 INFO:tasks.workunit.client.1.smithi125.stdout:6/777: mknod d6/db/d5d/d2f/cff 0 2024-02-19T19:12:21.687 INFO:tasks.workunit.client.1.smithi125.stdout:6/778: chown d6/db/d5d/d2f/d45/dd9/caa 7 1 2024-02-19T19:12:21.687 INFO:tasks.workunit.client.1.smithi125.stdout:6/779: creat d6/db/d5d/d2f/f100 x:0 0 0 2024-02-19T19:12:21.687 INFO:tasks.workunit.client.1.smithi125.stdout:6/780: symlink d6/db/d5d/d2f/d45/dd9/d3b/l101 0 2024-02-19T19:12:21.687 INFO:tasks.workunit.client.1.smithi125.stdout:6/781: truncate d6/db/d5d/d2f/d45/dd9/d16/f5c 1756909 0 2024-02-19T19:12:21.687 INFO:tasks.workunit.client.1.smithi125.stdout:2/555: sync 2024-02-19T19:12:21.687 INFO:tasks.workunit.client.1.smithi125.stdout:0/655: sync 2024-02-19T19:12:21.687 INFO:tasks.workunit.client.1.smithi125.stdout:4/552: sync 2024-02-19T19:12:21.688 INFO:tasks.workunit.client.1.smithi125.stdout:4/553: stat d0/d7/d3b/ca2 0 2024-02-19T19:12:21.688 INFO:tasks.workunit.client.1.smithi125.stdout:2/556: rename d1/d36/d70/d4b/d64/d7b/l9b to d1/d27/d1d/d39/la5 0 2024-02-19T19:12:21.688 INFO:tasks.workunit.client.1.smithi125.stdout:2/557: truncate d1/f47 1341065 0 2024-02-19T19:12:21.688 INFO:tasks.workunit.client.1.smithi125.stdout:0/656: write d5/d19/d2b/f7a [2322658,124055] 0 2024-02-19T19:12:21.688 INFO:tasks.workunit.client.1.smithi125.stdout:2/558: rename d1/d27/d1d/d25/d2a/f5f to d1/d36/d70/d85/da4/fa6 0 2024-02-19T19:12:21.688 INFO:tasks.workunit.client.1.smithi125.stdout:2/559: read - d1/d27/d1d/d25/f6e zero size 2024-02-19T19:12:21.688 INFO:tasks.workunit.client.1.smithi125.stdout:2/560: creat d1/d27/d1d/d25/da3/fa7 x:0 0 0 2024-02-19T19:12:21.688 INFO:tasks.workunit.client.1.smithi125.stdout:0/657: truncate d5/d19/d2b/f7a 149625 0 2024-02-19T19:12:21.688 INFO:tasks.workunit.client.1.smithi125.stdout:0/658: mkdir d5/d19/d27/de3 0 2024-02-19T19:12:21.689 INFO:tasks.workunit.client.1.smithi125.stdout:0/659: creat d5/d1a/fe4 x:0 0 0 2024-02-19T19:12:21.689 INFO:tasks.workunit.client.1.smithi125.stdout:0/660: readlink d5/d33/d9b/lcb 0 2024-02-19T19:12:21.689 INFO:tasks.workunit.client.1.smithi125.stdout:0/661: mkdir d5/d33/d9b/de5 0 2024-02-19T19:12:21.689 INFO:tasks.workunit.client.1.smithi125.stdout:0/662: unlink d5/d15/l2e 0 2024-02-19T19:12:21.689 INFO:tasks.workunit.client.1.smithi125.stdout:0/663: rmdir d5/d9/dcd/dd3/dd9 0 2024-02-19T19:12:21.689 INFO:tasks.workunit.client.1.smithi125.stdout:0/664: mkdir d5/d33/d46/de6 0 2024-02-19T19:12:21.692 INFO:tasks.workunit.client.1.smithi125.stdout:9/680: dread d8/d15/d22/d4e/d6b/f76 [77824,81920] 0 2024-02-19T19:12:21.692 INFO:tasks.workunit.client.1.smithi125.stdout:9/681: unlink f6 0 2024-02-19T19:12:21.693 INFO:tasks.workunit.client.1.smithi125.stdout:9/682: truncate d8/d15/d22/d4e/f7f 1235191 0 2024-02-19T19:12:21.693 INFO:tasks.workunit.client.1.smithi125.stdout:9/683: creat d8/d15/d9d/ff2 x:0 0 0 2024-02-19T19:12:21.693 INFO:tasks.workunit.client.1.smithi125.stdout:9/684: write d8/d15/d9d/ff2 [320576,120603] 0 2024-02-19T19:12:21.693 INFO:tasks.workunit.client.1.smithi125.stdout:9/685: creat d8/d15/d32/d4f/d6e/ff3 x:0 0 0 2024-02-19T19:12:21.693 INFO:tasks.workunit.client.1.smithi125.stdout:9/686: readlink d8/d15/d22/d4e/d90/lac 0 2024-02-19T19:12:21.693 INFO:tasks.workunit.client.1.smithi125.stdout:9/687: creat d8/d15/d32/d4f/ddc/ff4 x:0 0 0 2024-02-19T19:12:21.693 INFO:tasks.workunit.client.1.smithi125.stdout:9/688: dread - d8/d2e/d4c/d84/f8c zero size 2024-02-19T19:12:21.693 INFO:tasks.workunit.client.1.smithi125.stdout:9/689: dread - d8/d2e/d4c/d96/fcd zero size 2024-02-19T19:12:21.693 INFO:tasks.workunit.client.1.smithi125.stdout:9/690: rename d8/d15/d22/d4e/f7f to d8/d15/d32/d4f/ddc/ff5 0 2024-02-19T19:12:21.694 INFO:tasks.workunit.client.1.smithi125.stdout:9/691: truncate d8/d2e/fed 260675 0 2024-02-19T19:12:21.694 INFO:tasks.workunit.client.1.smithi125.stdout:9/692: creat d8/d2e/d6d/ff6 x:0 0 0 2024-02-19T19:12:21.740 INFO:tasks.workunit.client.1.smithi125.stdout:6/782: dwrite d6/db/d5d/f82 [53248,40960] 0 2024-02-19T19:12:21.740 INFO:tasks.workunit.client.1.smithi125.stdout:6/783: write d6/db/d5d/d2f/d7b/d8d/fdf [846418,56406] 0 2024-02-19T19:12:21.740 INFO:tasks.workunit.client.1.smithi125.stdout:6/784: dread d6/db/d49/fa5 [159744,61440] 0 2024-02-19T19:12:21.743 INFO:tasks.workunit.client.1.smithi125.stdout:9/693: dwrite d8/d15/d22/d4e/f47 [1044480,102400] 0 2024-02-19T19:12:21.743 INFO:tasks.workunit.client.1.smithi125.stdout:9/694: readlink d8/d15/d32/l41 0 2024-02-19T19:12:21.744 INFO:tasks.workunit.client.1.smithi125.stdout:0/665: dwrite d5/d9/da0/fdf [1122304,12288] 0 2024-02-19T19:12:21.744 INFO:tasks.workunit.client.1.smithi125.stdout:0/666: creat d5/d33/d42/fe7 x:0 0 0 2024-02-19T19:12:21.745 INFO:tasks.workunit.client.1.smithi125.stdout:0/667: symlink d5/d33/d42/d92/le8 0 2024-02-19T19:12:21.745 INFO:tasks.workunit.client.1.smithi125.stdout:0/668: mknod d5/d19/d27/d32/d70/dc2/dc8/ce9 0 2024-02-19T19:12:21.745 INFO:tasks.workunit.client.1.smithi125.stdout:0/669: creat d5/d19/d27/de3/fea x:0 0 0 2024-02-19T19:12:21.745 INFO:tasks.workunit.client.1.smithi125.stdout:0/670: unlink d5/d33/d42/c9d 0 2024-02-19T19:12:21.745 INFO:tasks.workunit.client.1.smithi125.stdout:0/671: creat d5/d33/d9b/feb x:0 0 0 2024-02-19T19:12:21.747 INFO:tasks.workunit.client.1.smithi125.stdout:2/561: dwrite d1/d27/d1d/d39/f7e [999424,49152] 0 2024-02-19T19:12:21.747 INFO:tasks.workunit.client.1.smithi125.stdout:2/562: write d1/d27/d1d/d39/f69 [171615,89876] 0 2024-02-19T19:12:21.747 INFO:tasks.workunit.client.1.smithi125.stdout:2/563: rename d1/d36/d70/d4b/d64 to d1/d27/d1d/da8 0 2024-02-19T19:12:21.747 INFO:tasks.workunit.client.1.smithi125.stdout:2/564: unlink d1/d36/f6d 0 2024-02-19T19:12:21.747 INFO:tasks.workunit.client.1.smithi125.stdout:6/785: dwrite d6/db/d5d/d2f/d7b/d8d/fa1 [446464,110592] 0 2024-02-19T19:12:21.747 INFO:tasks.workunit.client.1.smithi125.stdout:6/786: mknod d6/db/d5d/d2f/d45/dd9/d16/c102 0 2024-02-19T19:12:21.747 INFO:tasks.workunit.client.1.smithi125.stdout:6/787: dread d6/db/f17 [765952,49152] 0 2024-02-19T19:12:21.748 INFO:tasks.workunit.client.1.smithi125.stdout:6/788: dread - d6/db/d49/d4c/fc9 zero size 2024-02-19T19:12:21.748 INFO:tasks.workunit.client.1.smithi125.stdout:6/789: getdents d6/db/d5d/d2f/d45/dd9 0 2024-02-19T19:12:21.748 INFO:tasks.workunit.client.1.smithi125.stdout:6/790: creat d6/db/d5d/d2f/d45/dd9/f103 x:0 0 0 2024-02-19T19:12:21.748 INFO:tasks.workunit.client.1.smithi125.stdout:6/791: creat d6/db/d49/f104 x:0 0 0 2024-02-19T19:12:21.842 INFO:tasks.workunit.client.1.smithi125.stdout:0/672: dread d5/d19/d27/d32/d70/fc0 [360448,24576] 0 2024-02-19T19:12:21.842 INFO:tasks.workunit.client.1.smithi125.stdout:9/695: dread d8/d15/f70 [1019904,90112] 0 2024-02-19T19:12:21.842 INFO:tasks.workunit.client.1.smithi125.stdout:9/696: rename d8/d15/l25 to d8/d2e/d4c/d96/lf7 0 2024-02-19T19:12:21.842 INFO:tasks.workunit.client.1.smithi125.stdout:9/697: mkdir d8/d15/d32/d4f/ddc/df8 0 2024-02-19T19:12:21.843 INFO:tasks.workunit.client.1.smithi125.stdout:0/673: truncate d5/d15/d2c/f77 161658 0 2024-02-19T19:12:21.843 INFO:tasks.workunit.client.1.smithi125.stdout:0/674: rename d5/d19/d27/f8e to d5/d19/d27/d32/d70/dc2/dc8/fec 0 2024-02-19T19:12:21.843 INFO:tasks.workunit.client.1.smithi125.stdout:0/675: mkdir d5/d19/d6c/ded 0 2024-02-19T19:12:21.843 INFO:tasks.workunit.client.1.smithi125.stdout:0/676: symlink d5/d33/lee 0 2024-02-19T19:12:21.843 INFO:tasks.workunit.client.1.smithi125.stdout:0/677: dread d5/d33/d46/f4b [450560,16384] 0 2024-02-19T19:12:21.843 INFO:tasks.workunit.client.1.smithi125.stdout:0/678: rename d5/d19/d27/fdc to d5/d33/d9b/fef 0 2024-02-19T19:12:21.843 INFO:tasks.workunit.client.1.smithi125.stdout:0/679: symlink d5/d19/d2b/db7/lf0 0 2024-02-19T19:12:21.855 INFO:tasks.workunit.client.1.smithi125.stdout:2/565: write d1/d27/f22 [1809653,70931] 0 2024-02-19T19:12:21.856 INFO:tasks.workunit.client.1.smithi125.stdout:2/566: creat d1/d27/d1d/d16/fa9 x:0 0 0 2024-02-19T19:12:21.856 INFO:tasks.workunit.client.1.smithi125.stdout:2/567: creat d1/d27/d1d/da8/d7b/d91/faa x:0 0 0 2024-02-19T19:12:21.856 INFO:tasks.workunit.client.1.smithi125.stdout:2/568: symlink d1/d36/d70/d85/da4/lab 0 2024-02-19T19:12:21.856 INFO:tasks.workunit.client.1.smithi125.stdout:2/569: chown d1/l18 1508 1 2024-02-19T19:12:21.856 INFO:tasks.workunit.client.1.smithi125.stdout:2/570: creat d1/d27/d1d/d25/d7f/fac x:0 0 0 2024-02-19T19:12:21.894 INFO:tasks.workunit.client.1.smithi125.stdout:0/680: dwrite d5/d15/d2c/fd1 [389120,90112] 0 2024-02-19T19:12:21.894 INFO:tasks.workunit.client.1.smithi125.stdout:0/681: mknod d5/d15/cf1 0 2024-02-19T19:12:21.895 INFO:tasks.workunit.client.1.smithi125.stdout:9/698: dwrite d8/d15/d22/d4e/f55 [483328,57344] 0 2024-02-19T19:12:21.895 INFO:tasks.workunit.client.1.smithi125.stdout:9/699: symlink d8/d2e/d6d/lf9 0 2024-02-19T19:12:21.911 INFO:tasks.workunit.client.1.smithi125.stdout:2/571: fsync d1/d27/f10 0 2024-02-19T19:12:21.911 INFO:tasks.workunit.client.1.smithi125.stdout:2/572: chown d1/d27/d1d/d39/f69 11463 1 2024-02-19T19:12:21.911 INFO:tasks.workunit.client.1.smithi125.stdout:2/573: write d1/d27/d1d/da8/fa1 [488269,113624] 0 2024-02-19T19:12:21.914 INFO:tasks.workunit.client.1.smithi125.stdout:2/574: truncate d1/d27/d1d/da8/d7b/d91/faa 148628 0 2024-02-19T19:12:21.914 INFO:tasks.workunit.client.1.smithi125.stdout:0/682: dwrite d5/d1a/f20 [2121728,4096] 0 2024-02-19T19:12:21.914 INFO:tasks.workunit.client.1.smithi125.stdout:9/700: dwrite d8/d15/d32/f5d [360448,49152] 0 2024-02-19T19:12:21.914 INFO:tasks.workunit.client.1.smithi125.stdout:2/575: dread - d1/d27/d1d/d25/f6e zero size 2024-02-19T19:12:21.914 INFO:tasks.workunit.client.1.smithi125.stdout:0/683: rename d5/d15/cf1 to d5/d9/dcd/dd3/cf2 0 2024-02-19T19:12:21.914 INFO:tasks.workunit.client.1.smithi125.stdout:9/701: creat d8/d15/d22/de0/ffa x:0 0 0 2024-02-19T19:12:21.914 INFO:tasks.workunit.client.1.smithi125.stdout:0/684: creat d5/d33/d46/de6/ff3 x:0 0 0 2024-02-19T19:12:21.915 INFO:tasks.workunit.client.1.smithi125.stdout:9/702: write d8/d15/d22/d4e/f56 [848073,30828] 0 2024-02-19T19:12:21.915 INFO:tasks.workunit.client.1.smithi125.stdout:9/703: chown d8/d15/da2/cc6 981 1 2024-02-19T19:12:21.915 INFO:tasks.workunit.client.1.smithi125.stdout:9/704: write d8/d2e/f45 [1205534,79379] 0 2024-02-19T19:12:21.915 INFO:tasks.workunit.client.1.smithi125.stdout:9/705: dread - d8/d2e/d4c/d84/fce zero size 2024-02-19T19:12:21.915 INFO:tasks.workunit.client.1.smithi125.stdout:9/706: creat d8/d2e/d4c/d84/ffb x:0 0 0 2024-02-19T19:12:21.915 INFO:tasks.workunit.client.1.smithi125.stdout:9/707: creat d8/d15/d22/d4e/d90/ffc x:0 0 0 2024-02-19T19:12:21.915 INFO:tasks.workunit.client.1.smithi125.stdout:9/708: mknod d8/d15/d22/d44/cfd 0 2024-02-19T19:12:21.915 INFO:tasks.workunit.client.1.smithi125.stdout:9/709: dread d8/d2e/d4c/f5f [757760,65536] 0 2024-02-19T19:12:21.916 INFO:tasks.workunit.client.1.smithi125.stdout:9/710: creat d8/d15/d22/de0/ffe x:0 0 0 2024-02-19T19:12:21.916 INFO:tasks.workunit.client.1.smithi125.stdout:9/711: truncate d8/d15/d32/d4f/ddc/ff4 102372 0 2024-02-19T19:12:21.937 INFO:tasks.workunit.client.1.smithi125.stdout:0/685: dwrite d5/d19/d27/d32/f8d [2035712,90112] 0 2024-02-19T19:12:21.937 INFO:tasks.workunit.client.1.smithi125.stdout:0/686: link d5/d19/d27/dc3/cc4 d5/d19/d2b/db7/cf4 0 2024-02-19T19:12:21.937 INFO:tasks.workunit.client.1.smithi125.stdout:0/687: creat d5/d19/d27/ff5 x:0 0 0 2024-02-19T19:12:21.937 INFO:tasks.workunit.client.1.smithi125.stdout:0/688: write d5/d15/f82 [1125786,27425] 0 2024-02-19T19:12:21.937 INFO:tasks.workunit.client.1.smithi125.stdout:0/689: dread - d5/d33/d42/fa7 zero size 2024-02-19T19:12:21.937 INFO:tasks.workunit.client.1.smithi125.stdout:0/690: dread d5/d19/d27/d32/d70/dc2/dc8/fb4 [372736,53248] 0 2024-02-19T19:12:21.937 INFO:tasks.workunit.client.1.smithi125.stdout:0/691: link d5/d19/d27/f5c d5/d33/d46/ff6 0 2024-02-19T19:12:21.938 INFO:tasks.workunit.client.1.smithi125.stdout:9/712: dwrite d8/d15/d32/d4f/d6e/fdb [1675264,73728] 0 2024-02-19T19:12:21.938 INFO:tasks.workunit.client.1.smithi125.stdout:0/692: rmdir d5/d33/d9b/dc1 0 2024-02-19T19:12:21.938 INFO:tasks.workunit.client.1.smithi125.stdout:9/713: rename d8/ld to d8/d15/d32/d4f/lff 0 2024-02-19T19:12:21.938 INFO:tasks.workunit.client.1.smithi125.stdout:0/693: unlink d5/d9/c3f 0 2024-02-19T19:12:21.938 INFO:tasks.workunit.client.1.smithi125.stdout:9/714: creat d8/d15/f100 x:0 0 0 2024-02-19T19:12:21.938 INFO:tasks.workunit.client.1.smithi125.stdout:0/694: truncate d5/d33/d46/f6a 749616 0 2024-02-19T19:12:21.938 INFO:tasks.workunit.client.1.smithi125.stdout:9/715: rmdir d8/d2e 39 2024-02-19T19:12:21.938 INFO:tasks.workunit.client.1.smithi125.stdout:0/695: write d5/d1a/d4c/f94 [1466171,125459] 0 2024-02-19T19:12:21.938 INFO:tasks.workunit.client.1.smithi125.stdout:0/696: truncate d5/d9/f1d 3322261 0 2024-02-19T19:12:21.939 INFO:tasks.workunit.client.1.smithi125.stdout:0/697: write d5/d19/d27/d32/f3a [2565240,126853] 0 2024-02-19T19:12:22.030 INFO:tasks.workunit.client.1.smithi125.stdout:0/698: dwrite d5/d19/d27/d32/d70/dc2/dc8/fec [1286144,86016] 0 2024-02-19T19:12:22.033 INFO:tasks.workunit.client.1.smithi125.stdout:9/716: dwrite d8/d15/fe3 [286720,4096] 0 2024-02-19T19:12:22.036 INFO:tasks.workunit.client.1.smithi125.stdout:0/699: dread d5/d19/f44 [1339392,106496] 0 2024-02-19T19:12:22.036 INFO:tasks.workunit.client.1.smithi125.stdout:0/700: mknod d5/d15/d2c/cf7 0 2024-02-19T19:12:22.036 INFO:tasks.workunit.client.1.smithi125.stdout:0/701: chown d5/d33/d42/d92/le8 44232664 1 2024-02-19T19:12:22.037 INFO:tasks.workunit.client.1.smithi125.stdout:0/702: symlink d5/d9/lf8 0 2024-02-19T19:12:22.037 INFO:tasks.workunit.client.1.smithi125.stdout:0/703: rename d5/d19/d27/d32/d70/dd2/fdb to d5/d19/d6c/ff9 0 2024-02-19T19:12:22.037 INFO:tasks.workunit.client.1.smithi125.stdout:0/704: dread d5/d19/d6c/ff9 [32768,57344] 0 2024-02-19T19:12:22.039 INFO:tasks.workunit.client.1.smithi125.stdout:0/705: dwrite d5/d15/d2c/d80/f63 [741376,28672] 0 2024-02-19T19:12:22.044 INFO:tasks.workunit.client.1.smithi125.stdout:0/706: rename d5/d19/d27/d32/d70/dc2 to d5/d15/d2c/d80/dfa 0 2024-02-19T19:12:22.044 INFO:tasks.workunit.client.1.smithi125.stdout:0/707: dread d5/d19/f2f [1040384,12288] 0 2024-02-19T19:12:22.044 INFO:tasks.workunit.client.1.smithi125.stdout:0/708: truncate d5/d15/f8a 921940 0 2024-02-19T19:12:22.044 INFO:tasks.workunit.client.1.smithi125.stdout:9/717: dread d8/d15/d32/d4f/d6e/fb1 [413696,16384] 0 2024-02-19T19:12:22.044 INFO:tasks.workunit.client.1.smithi125.stdout:9/718: write d8/d15/d32/d4f/d6e/f8f [929644,61509] 0 2024-02-19T19:12:22.044 INFO:tasks.workunit.client.1.smithi125.stdout:9/719: readlink d8/d15/l72 0 2024-02-19T19:12:22.045 INFO:tasks.workunit.client.1.smithi125.stdout:9/720: link d8/d15/d22/f78 d8/d15/d22/d4e/d6b/f101 0 2024-02-19T19:12:22.051 INFO:tasks.workunit.client.1.smithi125.stdout:0/709: dread d5/d33/f7e [827392,20480] 0 2024-02-19T19:12:22.052 INFO:tasks.workunit.client.1.smithi125.stdout:0/710: unlink d5/la6 0 2024-02-19T19:12:22.052 INFO:tasks.workunit.client.1.smithi125.stdout:0/711: rename d5/d19/d6c/ded to d5/d9/da0/db3/dd4/dfb 0 2024-02-19T19:12:22.052 INFO:tasks.workunit.client.1.smithi125.stdout:0/712: chown d5/d19/d2b/f7a 57522500 1 2024-02-19T19:12:22.052 INFO:tasks.workunit.client.1.smithi125.stdout:0/713: dread - d5/d1a/fba zero size 2024-02-19T19:12:22.052 INFO:tasks.workunit.client.1.smithi125.stdout:0/714: write d5/d19/d2b/fd5 [39857,36441] 0 2024-02-19T19:12:22.052 INFO:tasks.workunit.client.1.smithi125.stdout:0/715: creat d5/d19/d48/ffc x:0 0 0 2024-02-19T19:12:22.052 INFO:tasks.workunit.client.1.smithi125.stdout:0/716: dread - d5/d19/d48/ffc zero size 2024-02-19T19:12:22.052 INFO:tasks.workunit.client.1.smithi125.stdout:0/717: rename d5/d19/f44 to d5/d19/d27/dc3/ffd 0 2024-02-19T19:12:22.134 INFO:tasks.workunit.client.1.smithi125.stdout:0/718: symlink d5/d33/lfe 0 2024-02-19T19:12:22.134 INFO:tasks.workunit.client.1.smithi125.stdout:0/719: chown d5/d15/d2c/f77 132887 1 2024-02-19T19:12:22.134 INFO:tasks.workunit.client.1.smithi125.stdout:0/720: write d5/d1a/f20 [3073908,47695] 0 2024-02-19T19:12:22.134 INFO:tasks.workunit.client.1.smithi125.stdout:0/721: mknod d5/d19/d27/d32/dd7/cff 0 2024-02-19T19:12:22.135 INFO:tasks.workunit.client.1.smithi125.stdout:0/722: readlink d5/d19/d27/d32/l85 0 2024-02-19T19:12:22.135 INFO:tasks.workunit.client.1.smithi125.stdout:0/723: mknod d5/d33/c100 0 2024-02-19T19:12:22.135 INFO:tasks.workunit.client.1.smithi125.stdout:0/724: dread d5/faa [126976,45056] 0 2024-02-19T19:12:22.135 INFO:tasks.workunit.client.1.smithi125.stdout:0/725: rmdir d5/d33/d46/de2 0 2024-02-19T19:12:22.135 INFO:tasks.workunit.client.1.smithi125.stdout:0/726: write d5/d19/d27/d32/d70/fa9 [600165,79625] 0 2024-02-19T19:12:22.135 INFO:tasks.workunit.client.1.smithi125.stdout:0/727: rename d5/d9/fcc to d5/d19/d6c/f101 0 2024-02-19T19:12:22.135 INFO:tasks.workunit.client.1.smithi125.stdout:0/728: creat d5/d33/f102 x:0 0 0 2024-02-19T19:12:22.135 INFO:tasks.workunit.client.1.smithi125.stdout:0/729: write d5/d19/d48/ffc [873633,116423] 0 2024-02-19T19:12:22.136 INFO:tasks.workunit.client.1.smithi125.stdout:0/730: dread - d5/d19/d6c/f101 zero size 2024-02-19T19:12:22.136 INFO:tasks.workunit.client.1.smithi125.stdout:0/731: dread d5/faa [28672,4096] 0 2024-02-19T19:12:22.136 INFO:tasks.workunit.client.1.smithi125.stdout:0/732: write d5/d19/f62 [2702693,509] 0 2024-02-19T19:12:22.136 INFO:tasks.workunit.client.1.smithi125.stdout:0/733: mknod d5/d19/d6c/c103 0 2024-02-19T19:12:22.152 INFO:tasks.workunit.client.1.smithi125.stdout:9/721: fdatasync d8/d15/d9d/ff2 0 2024-02-19T19:12:22.152 INFO:tasks.workunit.client.1.smithi125.stdout:9/722: rename d8/d15/da2/de1/fea to d8/d15/d32/d4f/d6e/d99/f102 0 2024-02-19T19:12:22.152 INFO:tasks.workunit.client.1.smithi125.stdout:9/723: creat d8/d15/d22/d4e/d90/f103 x:0 0 0 2024-02-19T19:12:22.153 INFO:tasks.workunit.client.1.smithi125.stdout:9/724: truncate d8/d2e/fb9 35872 0 2024-02-19T19:12:22.153 INFO:tasks.workunit.client.1.smithi125.stdout:9/725: readlink d8/d15/d22/l6f 0 2024-02-19T19:12:22.153 INFO:tasks.workunit.client.1.smithi125.stdout:9/726: readlink d8/d15/d22/d4e/d6b/lde 0 2024-02-19T19:12:22.156 INFO:tasks.workunit.client.1.smithi125.stdout:0/734: dwrite d5/d9/f26 [16384,69632] 0 2024-02-19T19:12:22.156 INFO:tasks.workunit.client.1.smithi125.stdout:9/727: read d8/d15/d32/d4f/f59 [1994460,32690] 0 2024-02-19T19:12:22.156 INFO:tasks.workunit.client.1.smithi125.stdout:9/728: chown d8/l42 114163 1 2024-02-19T19:12:22.157 INFO:tasks.workunit.client.1.smithi125.stdout:9/729: stat d8/d15/d22/le6 0 2024-02-19T19:12:22.157 INFO:tasks.workunit.client.1.smithi125.stdout:9/730: dread d8/d15/d22/fb6 [503808,16384] 0 2024-02-19T19:12:22.166 INFO:tasks.workunit.client.1.smithi125.stdout:0/735: dwrite d5/d33/d42/fa7 [303104,90112] 0 2024-02-19T19:12:22.166 INFO:tasks.workunit.client.1.smithi125.stdout:9/731: dwrite d8/d15/d9d/ff2 [585728,114688] 0 2024-02-19T19:12:22.166 INFO:tasks.workunit.client.1.smithi125.stdout:0/736: symlink d5/d1a/d95/l104 0 2024-02-19T19:12:22.166 INFO:tasks.workunit.client.1.smithi125.stdout:0/737: symlink d5/d15/d2c/l105 0 2024-02-19T19:12:22.170 INFO:tasks.workunit.client.1.smithi125.stdout:9/732: dwrite d8/d15/d32/d4f/d6e/d99/f102 [258048,114688] 0 2024-02-19T19:12:22.170 INFO:tasks.workunit.client.1.smithi125.stdout:9/733: mknod d8/d15/d32/d4f/de7/c104 0 2024-02-19T19:12:22.170 INFO:tasks.workunit.client.1.smithi125.stdout:0/738: dread d5/d15/d2c/d80/f63 [114688,106496] 0 2024-02-19T19:12:22.170 INFO:tasks.workunit.client.1.smithi125.stdout:0/739: write d5/ff [2242193,26153] 0 2024-02-19T19:12:22.274 INFO:tasks.workunit.client.1.smithi125.stdout:9/734: truncate d8/d15/d22/d4e/f55 95889 0 2024-02-19T19:12:22.275 INFO:tasks.workunit.client.1.smithi125.stdout:9/735: creat d8/d15/d32/d4f/d6e/d99/f105 x:0 0 0 2024-02-19T19:12:22.285 INFO:tasks.workunit.client.1.smithi125.stdout:0/740: dread d5/d33/d42/fa4 [114688,49152] 0 2024-02-19T19:12:22.286 INFO:tasks.workunit.client.1.smithi125.stdout:0/741: dread - d5/fbf zero size 2024-02-19T19:12:22.309 INFO:tasks.workunit.client.1.smithi125.stdout:9/736: mkdir d8/d15/d32/d4f/d6e/df0/d106 0 2024-02-19T19:12:22.309 INFO:tasks.workunit.client.1.smithi125.stdout:0/742: rmdir d5/d19/d27/d32 39 2024-02-19T19:12:22.309 INFO:tasks.workunit.client.1.smithi125.stdout:9/737: dwrite d8/d15/d32/d4f/d6e/fa3 [995328,73728] 0 2024-02-19T19:12:22.313 INFO:tasks.workunit.client.1.smithi125.stdout:9/738: rename d8/d15/d32/cba to d8/d2e/d4c/d84/c107 0 2024-02-19T19:12:22.313 INFO:tasks.workunit.client.1.smithi125.stdout:9/739: write d8/d2e/d4c/d84/f94 [1257256,70518] 0 2024-02-19T19:12:22.313 INFO:tasks.workunit.client.1.smithi125.stdout:9/740: truncate d8/d15/d22/d4e/f83 794430 0 2024-02-19T19:12:22.318 INFO:tasks.workunit.client.1.smithi125.stdout:0/743: dread d5/d19/d27/d32/f3a [524288,40960] 0 2024-02-19T19:12:22.320 INFO:tasks.workunit.client.1.smithi125.stdout:0/744: rename d5/d19/d6c to d5/d9/da0/db3/dd4/dfb/d106 0 2024-02-19T19:12:22.320 INFO:tasks.workunit.client.1.smithi125.stdout:0/745: rmdir d5/d15/d2c/d80/dfa 39 2024-02-19T19:12:22.323 INFO:tasks.workunit.client.1.smithi125.stdout:8/587: sync 2024-02-19T19:12:22.324 INFO:tasks.workunit.client.1.smithi125.stdout:5/887: sync 2024-02-19T19:12:22.324 INFO:tasks.workunit.client.1.smithi125.stdout:5/888: chown db/d26/cfa 10160 1 2024-02-19T19:12:22.324 INFO:tasks.workunit.client.1.smithi125.stdout:3/527: sync 2024-02-19T19:12:22.324 INFO:tasks.workunit.client.1.smithi125.stdout:2/576: sync 2024-02-19T19:12:22.324 INFO:tasks.workunit.client.1.smithi125.stdout:5/889: dread - db/d17/d58/d33/d98/dae/dfd/ffb zero size 2024-02-19T19:12:22.324 INFO:tasks.workunit.client.1.smithi125.stdout:7/617: sync 2024-02-19T19:12:22.324 INFO:tasks.workunit.client.1.smithi125.stdout:4/554: sync 2024-02-19T19:12:22.325 INFO:tasks.workunit.client.1.smithi125.stdout:2/577: stat d1/d27/f11 0 2024-02-19T19:12:22.325 INFO:tasks.workunit.client.1.smithi125.stdout:7/618: chown d12/d18/d44/d3b/d59/d2a/d6a/d6d 871 1 2024-02-19T19:12:22.325 INFO:tasks.workunit.client.1.smithi125.stdout:2/578: dread - d1/d27/d1d/f96 zero size 2024-02-19T19:12:22.325 INFO:tasks.workunit.client.1.smithi125.stdout:7/619: getdents d12/d18/d44/d3b/d59/d2a/d6a 0 2024-02-19T19:12:22.325 INFO:tasks.workunit.client.1.smithi125.stdout:4/555: symlink d0/d7/dad/db9/lbc 0 2024-02-19T19:12:22.325 INFO:tasks.workunit.client.1.smithi125.stdout:6/792: sync 2024-02-19T19:12:22.325 INFO:tasks.workunit.client.1.smithi125.stdout:1/779: sync 2024-02-19T19:12:22.325 INFO:tasks.workunit.client.1.smithi125.stdout:4/556: readlink d0/df/l9d 0 2024-02-19T19:12:22.325 INFO:tasks.workunit.client.1.smithi125.stdout:7/620: mkdir d12/d18/d44/d3b/d59/d26/d30/d97/db1 0 2024-02-19T19:12:22.326 INFO:tasks.workunit.client.1.smithi125.stdout:6/793: mknod d6/db/d5d/d2f/d7b/d8d/dd1/c105 0 2024-02-19T19:12:22.326 INFO:tasks.workunit.client.1.smithi125.stdout:7/621: rename d12/d18/d2c/f2d to d12/d18/d44/d3b/d59/d2a/d31/d50/fb2 0 2024-02-19T19:12:22.326 INFO:tasks.workunit.client.1.smithi125.stdout:1/780: symlink d1/d1a/d3d/d6e/dbe/lff 0 2024-02-19T19:12:22.326 INFO:tasks.workunit.client.1.smithi125.stdout:7/622: truncate d12/d18/d44/d51/f9b 1037447 0 2024-02-19T19:12:22.326 INFO:tasks.workunit.client.1.smithi125.stdout:4/557: symlink d0/df/lbd 0 2024-02-19T19:12:22.326 INFO:tasks.workunit.client.1.smithi125.stdout:6/794: truncate d6/db/d5d/d2f/d45/dd9/f95 3218052 0 2024-02-19T19:12:22.326 INFO:tasks.workunit.client.1.smithi125.stdout:7/623: chown d12/d18/d2c/f42 1312398 1 2024-02-19T19:12:22.326 INFO:tasks.workunit.client.1.smithi125.stdout:7/624: rmdir d12/d18/d44/d3b/d59/d2a/d31/d50/d60 39 2024-02-19T19:12:22.326 INFO:tasks.workunit.client.1.smithi125.stdout:6/795: rmdir d6/db/d5d/d2f/d45/dd9/d3b/de1 39 2024-02-19T19:12:22.327 INFO:tasks.workunit.client.1.smithi125.stdout:1/781: symlink d1/d26/l100 0 2024-02-19T19:12:22.327 INFO:tasks.workunit.client.1.smithi125.stdout:7/625: dread d12/d18/d44/d3b/d59/d2a/d6a/d6d/f7f [331776,12288] 0 2024-02-19T19:12:22.327 INFO:tasks.workunit.client.1.smithi125.stdout:1/782: getdents d1/dc/d36/d69/dc1 0 2024-02-19T19:12:22.327 INFO:tasks.workunit.client.1.smithi125.stdout:6/796: creat d6/db/d5d/d93/da2/f106 x:0 0 0 2024-02-19T19:12:22.327 INFO:tasks.workunit.client.1.smithi125.stdout:4/558: mkdir d0/d7/dad/dbe 0 2024-02-19T19:12:22.327 INFO:tasks.workunit.client.1.smithi125.stdout:6/797: readlink d6/db/d5d/d2f/d45/dd9/d16/l1c 0 2024-02-19T19:12:22.327 INFO:tasks.workunit.client.1.smithi125.stdout:6/798: chown d6/db/d5d/d63/f85 14 1 2024-02-19T19:12:22.327 INFO:tasks.workunit.client.1.smithi125.stdout:7/626: symlink d12/d18/d2c/d4e/lb3 0 2024-02-19T19:12:22.327 INFO:tasks.workunit.client.1.smithi125.stdout:4/559: mknod d0/d7/d3b/d77/cbf 0 2024-02-19T19:12:22.328 INFO:tasks.workunit.client.1.smithi125.stdout:1/783: write d1/d78/fd2 [2198753,35392] 0 2024-02-19T19:12:22.328 INFO:tasks.workunit.client.1.smithi125.stdout:1/784: chown d1/d1a/d3d/d6e/dbe/lff 579688 1 2024-02-19T19:12:22.328 INFO:tasks.workunit.client.1.smithi125.stdout:6/799: rename d6/db/d49/d4c to d6/db/d5d/d2f/d45/d107 0 2024-02-19T19:12:22.328 INFO:tasks.workunit.client.1.smithi125.stdout:1/785: dread d1/d78/fd2 [802816,24576] 0 2024-02-19T19:12:22.328 INFO:tasks.workunit.client.1.smithi125.stdout:6/800: truncate d6/db/d5d/d2f/d45/d4e/d6b/fd4 859961 0 2024-02-19T19:12:22.328 INFO:tasks.workunit.client.1.smithi125.stdout:1/786: truncate d1/d1a/d3d/de2/ff5 908424 0 2024-02-19T19:12:22.328 INFO:tasks.workunit.client.1.smithi125.stdout:1/787: dread - d1/d1a/d3d/d6e/d4b/fc9 zero size 2024-02-19T19:12:22.328 INFO:tasks.workunit.client.1.smithi125.stdout:4/560: dread d0/d7/d30/d58/f6e [339968,122880] 0 2024-02-19T19:12:22.329 INFO:tasks.workunit.client.1.smithi125.stdout:1/788: link d1/faa d1/dc/d36/d69/dc7/de9/f101 0 2024-02-19T19:12:22.329 INFO:tasks.workunit.client.1.smithi125.stdout:6/801: mkdir d6/db/d49/d108 0 2024-02-19T19:12:22.329 INFO:tasks.workunit.client.1.smithi125.stdout:1/789: write d1/d26/d23/f96 [470383,8532] 0 2024-02-19T19:12:22.329 INFO:tasks.workunit.client.1.smithi125.stdout:6/802: link d6/db/d5d/f36 d6/db/d5d/d2f/d45/d107/f109 0 2024-02-19T19:12:22.329 INFO:tasks.workunit.client.1.smithi125.stdout:6/803: chown d6/cb8 36174245 1 2024-02-19T19:12:22.329 INFO:tasks.workunit.client.1.smithi125.stdout:1/790: mkdir d1/d102 0 2024-02-19T19:12:22.329 INFO:tasks.workunit.client.1.smithi125.stdout:4/561: symlink d0/d7/d30/d42/lc0 0 2024-02-19T19:12:22.329 INFO:tasks.workunit.client.1.smithi125.stdout:6/804: creat d6/db/d5d/d29/f10a x:0 0 0 2024-02-19T19:12:22.329 INFO:tasks.workunit.client.1.smithi125.stdout:6/805: readlink d6/db/d5d/d2f/la6 0 2024-02-19T19:12:22.330 INFO:tasks.workunit.client.1.smithi125.stdout:1/791: creat d1/dc/d36/d69/dc7/f103 x:0 0 0 2024-02-19T19:12:22.330 INFO:tasks.workunit.client.1.smithi125.stdout:9/741: dread d8/d2e/d4c/f7c [401408,77824] 0 2024-02-19T19:12:22.330 INFO:tasks.workunit.client.1.smithi125.stdout:9/742: link d8/d15/d32/d4f/d6e/d99/f105 d8/d2e/f108 0 2024-02-19T19:12:22.330 INFO:tasks.workunit.client.1.smithi125.stdout:9/743: dread - d8/d15/d22/de0/ffe zero size 2024-02-19T19:12:22.331 INFO:tasks.workunit.client.1.smithi125.stdout:0/746: dread d5/d1a/f55 [634880,110592] 0 2024-02-19T19:12:22.430 INFO:tasks.workunit.client.1.smithi125.stdout:2/579: fdatasync d1/d27/f82 0 2024-02-19T19:12:22.431 INFO:tasks.workunit.client.1.smithi125.stdout:2/580: dread - d1/d27/d1d/d16/fa9 zero size 2024-02-19T19:12:22.433 INFO:tasks.workunit.client.1.smithi125.stdout:3/528: dwrite d0/d1/d1e/f1f [2392064,73728] 0 2024-02-19T19:12:22.433 INFO:tasks.workunit.client.1.smithi125.stdout:7/627: dwrite d12/d18/d2c/d4e/f71 [405504,86016] 0 2024-02-19T19:12:22.434 INFO:tasks.workunit.client.1.smithi125.stdout:5/890: dwrite db/d17/d58/d33/d98/fb8 [864256,110592] 0 2024-02-19T19:12:22.434 INFO:tasks.workunit.client.1.smithi125.stdout:8/588: dwrite db/d18/d2f/d72/f87 [905216,36864] 0 2024-02-19T19:12:22.438 INFO:tasks.workunit.client.1.smithi125.stdout:6/806: creat d6/db/da7/f10b x:0 0 0 2024-02-19T19:12:22.438 INFO:tasks.workunit.client.1.smithi125.stdout:4/562: creat d0/d7/dad/dbe/fc1 x:0 0 0 2024-02-19T19:12:22.438 INFO:tasks.workunit.client.1.smithi125.stdout:9/744: mknod d8/d15/d32/d4f/c109 0 2024-02-19T19:12:22.438 INFO:tasks.workunit.client.1.smithi125.stdout:2/581: creat d1/d27/d1d/d25/da3/fad x:0 0 0 2024-02-19T19:12:22.438 INFO:tasks.workunit.client.1.smithi125.stdout:1/792: symlink d1/dc/d36/d69/dc7/de9/l104 0 2024-02-19T19:12:22.439 INFO:tasks.workunit.client.1.smithi125.stdout:3/529: creat d0/d1/d1e/fa8 x:0 0 0 2024-02-19T19:12:22.439 INFO:tasks.workunit.client.1.smithi125.stdout:4/563: chown d0/d7/d85/cbb 0 1 2024-02-19T19:12:22.439 INFO:tasks.workunit.client.1.smithi125.stdout:2/582: chown d1/d27/d1d/da8/d7b/d91/f97 43 1 2024-02-19T19:12:22.439 INFO:tasks.workunit.client.1.smithi125.stdout:0/747: mkdir d5/d19/d27/d32/dd7/d107 0 2024-02-19T19:12:22.439 INFO:tasks.workunit.client.1.smithi125.stdout:2/583: rmdir d1/d27/d1d/d25/da3 39 2024-02-19T19:12:22.439 INFO:tasks.workunit.client.1.smithi125.stdout:5/891: creat db/d17/d58/f11a x:0 0 0 2024-02-19T19:12:22.439 INFO:tasks.workunit.client.1.smithi125.stdout:8/589: creat db/d18/d30/d48/fbc x:0 0 0 2024-02-19T19:12:22.440 INFO:tasks.workunit.client.1.smithi125.stdout:7/628: symlink d12/d18/d44/d3b/d59/d26/d30/d37/lb4 0 2024-02-19T19:12:22.440 INFO:tasks.workunit.client.1.smithi125.stdout:7/629: chown d12/d18/f3c 33 1 2024-02-19T19:12:22.440 INFO:tasks.workunit.client.1.smithi125.stdout:1/793: truncate d1/dc/d36/fa5 911801 0 2024-02-19T19:12:22.440 INFO:tasks.workunit.client.1.smithi125.stdout:6/807: dread d6/db/d5d/d2f/d45/dd9/d3b/dda/ff1 [491520,4096] 0 2024-02-19T19:12:22.440 INFO:tasks.workunit.client.1.smithi125.stdout:3/530: creat d0/d95/fa9 x:0 0 0 2024-02-19T19:12:22.440 INFO:tasks.workunit.client.1.smithi125.stdout:1/794: getdents d1/d1a 0 2024-02-19T19:12:22.440 INFO:tasks.workunit.client.1.smithi125.stdout:6/808: symlink d6/db/da7/l10c 0 2024-02-19T19:12:22.441 INFO:tasks.workunit.client.1.smithi125.stdout:9/745: unlink d8/d15/d32/f3f 0 2024-02-19T19:12:22.441 INFO:tasks.workunit.client.1.smithi125.stdout:9/746: chown d8/lb 2541791 1 2024-02-19T19:12:22.441 INFO:tasks.workunit.client.1.smithi125.stdout:7/630: write fa [2269577,83865] 0 2024-02-19T19:12:22.441 INFO:tasks.workunit.client.1.smithi125.stdout:6/809: mkdir d6/db/d5d/d2f/d45/dd9/d3b/d10d 0 2024-02-19T19:12:22.441 INFO:tasks.workunit.client.1.smithi125.stdout:3/531: write d0/d1/d1e/d60/d73/d74/d82/f9b [162080,68944] 0 2024-02-19T19:12:22.441 INFO:tasks.workunit.client.1.smithi125.stdout:6/810: readlink d6/db/d5d/d2f/d45/dd9/d3b/l50 0 2024-02-19T19:12:22.441 INFO:tasks.workunit.client.1.smithi125.stdout:4/564: write d0/d7/d30/d5d/f64 [668805,79094] 0 2024-02-19T19:12:22.442 INFO:tasks.workunit.client.1.smithi125.stdout:6/811: truncate d6/db/d49/f59 2065197 0 2024-02-19T19:12:22.442 INFO:tasks.workunit.client.1.smithi125.stdout:2/584: rename d1/d27/d1d/d2c/l6b to d1/d27/d1d/d25/d2a/lae 0 2024-02-19T19:12:22.442 INFO:tasks.workunit.client.1.smithi125.stdout:2/585: creat d1/d27/d1d/da8/d7b/d91/faf x:0 0 0 2024-02-19T19:12:22.442 INFO:tasks.workunit.client.1.smithi125.stdout:2/586: read d1/d27/d1d/d2c/f31 [471618,1497] 0 2024-02-19T19:12:22.442 INFO:tasks.workunit.client.1.smithi125.stdout:2/587: truncate d1/d27/d1d/d2c/d2e/f92 1034550 0 2024-02-19T19:12:22.442 INFO:tasks.workunit.client.1.smithi125.stdout:1/795: write d1/d78/f7f [696639,79379] 0 2024-02-19T19:12:22.442 INFO:tasks.workunit.client.1.smithi125.stdout:5/892: write db/d17/d58/d33/d53/dce/ff7 [39988,82112] 0 2024-02-19T19:12:22.442 INFO:tasks.workunit.client.1.smithi125.stdout:5/893: write db/d26/f90 [984027,112566] 0 2024-02-19T19:12:22.478 INFO:tasks.workunit.client.1.smithi125.stdout:4/565: fdatasync d0/f2e 0 2024-02-19T19:12:22.478 INFO:tasks.workunit.client.1.smithi125.stdout:4/566: dread d0/fa [1183744,57344] 0 2024-02-19T19:12:22.478 INFO:tasks.workunit.client.1.smithi125.stdout:4/567: rmdir d0/d7/d3b 39 2024-02-19T19:12:22.479 INFO:tasks.workunit.client.1.smithi125.stdout:4/568: write d0/d7/d30/d5d/f64 [1658866,39950] 0 2024-02-19T19:12:22.482 INFO:tasks.workunit.client.1.smithi125.stdout:4/569: readlink d0/d7/d30/l3e 0 2024-02-19T19:12:22.482 INFO:tasks.workunit.client.1.smithi125.stdout:3/532: mkdir d0/d1/d4b/d52/daa 0 2024-02-19T19:12:22.482 INFO:tasks.workunit.client.1.smithi125.stdout:4/570: write d0/d7/d30/d5d/f64 [2041572,51594] 0 2024-02-19T19:12:22.482 INFO:tasks.workunit.client.1.smithi125.stdout:1/796: link d1/d1a/d3d/d6e/d4b/fc9 d1/d1a/d3d/d6e/dbe/f105 0 2024-02-19T19:12:22.482 INFO:tasks.workunit.client.1.smithi125.stdout:1/797: rmdir d1/dc/d36/d39 39 2024-02-19T19:12:22.483 INFO:tasks.workunit.client.1.smithi125.stdout:1/798: chown d1/d26/d3c/d3f/l76 462 1 2024-02-19T19:12:22.483 INFO:tasks.workunit.client.1.smithi125.stdout:8/590: rename db/d18/d30/d80/d9e/la0 to db/d18/d30/d80/dac/lbd 0 2024-02-19T19:12:22.483 INFO:tasks.workunit.client.1.smithi125.stdout:6/812: write d6/f9 [32917,73124] 0 2024-02-19T19:12:22.483 INFO:tasks.workunit.client.1.smithi125.stdout:0/748: rename d5/d9/f1d to d5/d9/f108 0 2024-02-19T19:12:22.483 INFO:tasks.workunit.client.1.smithi125.stdout:6/813: getdents d6/db/d5d/d2f/d45/d107 0 2024-02-19T19:12:22.483 INFO:tasks.workunit.client.1.smithi125.stdout:0/749: dread d5/d19/d27/f5c [585728,8192] 0 2024-02-19T19:12:22.483 INFO:tasks.workunit.client.1.smithi125.stdout:1/799: write d1/d1a/d3d/d6e/fa7 [1683817,45496] 0 2024-02-19T19:12:22.483 INFO:tasks.workunit.client.1.smithi125.stdout:0/750: chown d5/d15/d2c/d80/dfa/dc8/fb4 61815 1 2024-02-19T19:12:22.483 INFO:tasks.workunit.client.1.smithi125.stdout:6/814: dread d6/db/d5d/d63/f62 [618496,28672] 0 2024-02-19T19:12:22.484 INFO:tasks.workunit.client.1.smithi125.stdout:9/747: read d8/d15/d22/fcf [344395,82759] 0 2024-02-19T19:12:22.484 INFO:tasks.workunit.client.1.smithi125.stdout:1/800: dread d1/d78/fd2 [1949696,114688] 0 2024-02-19T19:12:22.484 INFO:tasks.workunit.client.1.smithi125.stdout:0/751: rename d5/d9/da0 to d5/d19/d27/d32/d109 0 2024-02-19T19:12:22.484 INFO:tasks.workunit.client.1.smithi125.stdout:0/752: getdents d5 0 2024-02-19T19:12:22.484 INFO:tasks.workunit.client.1.smithi125.stdout:6/815: write d6/db/d5d/d2f/d45/f8a [1649339,38948] 0 2024-02-19T19:12:22.484 INFO:tasks.workunit.client.1.smithi125.stdout:0/753: dread d5/d33/d42/f61 [602112,36864] 0 2024-02-19T19:12:22.484 INFO:tasks.workunit.client.1.smithi125.stdout:3/533: unlink d0/f80 0 2024-02-19T19:12:22.484 INFO:tasks.workunit.client.1.smithi125.stdout:1/801: truncate d1/d78/d80/f5d 971486 0 2024-02-19T19:12:22.485 INFO:tasks.workunit.client.1.smithi125.stdout:9/748: mkdir d8/d15/d32/d4f/d6e/d99/d10a 0 2024-02-19T19:12:22.485 INFO:tasks.workunit.client.1.smithi125.stdout:6/816: creat d6/db/f10e x:0 0 0 2024-02-19T19:12:22.485 INFO:tasks.workunit.client.1.smithi125.stdout:1/802: chown d1/d1a/d3d/d6e/le4 178203 1 2024-02-19T19:12:22.485 INFO:tasks.workunit.client.1.smithi125.stdout:6/817: getdents d6/db/d5d/d2f 0 2024-02-19T19:12:22.485 INFO:tasks.workunit.client.1.smithi125.stdout:3/534: creat d0/d95/fab x:0 0 0 2024-02-19T19:12:22.485 INFO:tasks.workunit.client.1.smithi125.stdout:7/631: rename d12/d18/d44/d51/d81 to d12/d18/d2c/db5 0 2024-02-19T19:12:22.485 INFO:tasks.workunit.client.1.smithi125.stdout:9/749: rename d8/d15/d32/d4f/d85/ca0 to d8/d15/d32/d4f/c10b 0 2024-02-19T19:12:22.485 INFO:tasks.workunit.client.1.smithi125.stdout:9/750: read - d8/d2e/d4c/d84/ffb zero size 2024-02-19T19:12:22.485 INFO:tasks.workunit.client.1.smithi125.stdout:3/535: rmdir d0/d1/d1e/d69/da4 0 2024-02-19T19:12:22.486 INFO:tasks.workunit.client.1.smithi125.stdout:3/536: unlink d0/de/f3b 0 2024-02-19T19:12:22.486 INFO:tasks.workunit.client.1.smithi125.stdout:6/818: truncate d6/db/d5d/d29/f2d 2013776 0 2024-02-19T19:12:22.486 INFO:tasks.workunit.client.1.smithi125.stdout:9/751: mkdir d8/d2e/d4c/d84/d10c 0 2024-02-19T19:12:22.486 INFO:tasks.workunit.client.1.smithi125.stdout:3/537: creat d0/d1/d4b/d52/fac x:0 0 0 2024-02-19T19:12:22.486 INFO:tasks.workunit.client.1.smithi125.stdout:3/538: creat d0/d1/d1e/d69/fad x:0 0 0 2024-02-19T19:12:22.486 INFO:tasks.workunit.client.1.smithi125.stdout:3/539: mkdir d0/d1/dae 0 2024-02-19T19:12:22.486 INFO:tasks.workunit.client.1.smithi125.stdout:3/540: mkdir d0/d95/d9c/daf 0 2024-02-19T19:12:22.486 INFO:tasks.workunit.client.1.smithi125.stdout:5/894: dwrite db/d17/d58/d4f/f56 [438272,36864] 0 2024-02-19T19:12:22.486 INFO:tasks.workunit.client.1.smithi125.stdout:3/541: getdents d0/de 0 2024-02-19T19:12:22.487 INFO:tasks.workunit.client.1.smithi125.stdout:5/895: write db/d17/d58/d33/d91/dbe/fa0 [2475173,100311] 0 2024-02-19T19:12:22.487 INFO:tasks.workunit.client.1.smithi125.stdout:3/542: write d0/d1/d4b/d52/d81/f90 [1517875,116248] 0 2024-02-19T19:12:22.487 INFO:tasks.workunit.client.1.smithi125.stdout:5/896: symlink db/d17/d58/d33/d98/dae/l11b 0 2024-02-19T19:12:22.487 INFO:tasks.workunit.client.1.smithi125.stdout:3/543: mkdir d0/d1/d1e/db0 0 2024-02-19T19:12:22.487 INFO:tasks.workunit.client.1.smithi125.stdout:2/588: dwrite d1/d27/d45/d7a/f7d [749568,94208] 0 2024-02-19T19:12:22.487 INFO:tasks.workunit.client.1.smithi125.stdout:2/589: getdents d1/d27/d1d/d2c/d2e 0 2024-02-19T19:12:22.506 INFO:tasks.workunit.client.1.smithi125.stdout:9/752: dwrite d8/d15/d22/d4e/d6b/f76 [1077248,81920] 0 2024-02-19T19:12:22.506 INFO:tasks.workunit.client.1.smithi125.stdout:9/753: read d8/d15/d22/d44/fb0 [1447254,43759] 0 2024-02-19T19:12:22.507 INFO:tasks.workunit.client.1.smithi125.stdout:9/754: dread d8/d15/d32/d4f/d6e/fa3 [704512,61440] 0 2024-02-19T19:12:22.507 INFO:tasks.workunit.client.1.smithi125.stdout:9/755: chown d8/d2e/l60 9 1 2024-02-19T19:12:22.507 INFO:tasks.workunit.client.1.smithi125.stdout:9/756: readlink d8/d2e/d4c/l77 0 2024-02-19T19:12:22.507 INFO:tasks.workunit.client.1.smithi125.stdout:9/757: write d8/d15/d22/d4e/f55 [381722,127079] 0 2024-02-19T19:12:22.514 INFO:tasks.workunit.client.1.smithi125.stdout:1/803: dwrite d1/d78/d80/f5d [827392,16384] 0 2024-02-19T19:12:22.514 INFO:tasks.workunit.client.1.smithi125.stdout:1/804: rename d1/dc/d36/d69/dc7 to d1/d26/d23/d106 0 2024-02-19T19:12:22.515 INFO:tasks.workunit.client.1.smithi125.stdout:1/805: getdents d1/d1a/d3d 0 2024-02-19T19:12:22.515 INFO:tasks.workunit.client.1.smithi125.stdout:6/819: dwrite d6/db/d49/f104 [368640,45056] 0 2024-02-19T19:12:22.515 INFO:tasks.workunit.client.1.smithi125.stdout:1/806: symlink d1/d1a/d3d/l107 0 2024-02-19T19:12:22.515 INFO:tasks.workunit.client.1.smithi125.stdout:1/807: getdents d1/d26/d23 0 2024-02-19T19:12:22.515 INFO:tasks.workunit.client.1.smithi125.stdout:1/808: dread d1/f14 [1781760,98304] 0 2024-02-19T19:12:22.515 INFO:tasks.workunit.client.1.smithi125.stdout:1/809: link d1/dc/d36/fa5 d1/d26/f108 0 2024-02-19T19:12:22.516 INFO:tasks.workunit.client.1.smithi125.stdout:8/591: dwrite db/d18/d30/d80/d9e/da3/fb6 [172032,49152] 0 2024-02-19T19:12:22.516 INFO:tasks.workunit.client.1.smithi125.stdout:8/592: dread db/d18/f62 [73728,49152] 0 2024-02-19T19:12:22.516 INFO:tasks.workunit.client.1.smithi125.stdout:3/544: dwrite d0/d1/d4b/d52/f59 [704512,20480] 0 2024-02-19T19:12:22.516 INFO:tasks.workunit.client.1.smithi125.stdout:8/593: write db/d81/d95/fb8 [59118,120625] 0 2024-02-19T19:12:22.516 INFO:tasks.workunit.client.1.smithi125.stdout:3/545: mkdir d0/db1 0 2024-02-19T19:12:22.516 INFO:tasks.workunit.client.1.smithi125.stdout:3/546: write d0/d1/d1e/fa8 [253486,73121] 0 2024-02-19T19:12:22.516 INFO:tasks.workunit.client.1.smithi125.stdout:3/547: mkdir d0/d1/d4b/db2 0 2024-02-19T19:12:22.517 INFO:tasks.workunit.client.1.smithi125.stdout:3/548: rmdir d0/d1 39 2024-02-19T19:12:22.517 INFO:tasks.workunit.client.1.smithi125.stdout:3/549: readlink d0/d1/d4b/d52/l53 0 2024-02-19T19:12:22.517 INFO:tasks.workunit.client.1.smithi125.stdout:5/897: dwrite db/f34 [2355200,77824] 0 2024-02-19T19:12:22.517 INFO:tasks.workunit.client.1.smithi125.stdout:5/898: dread db/d17/f22 [962560,45056] 0 2024-02-19T19:12:22.631 INFO:tasks.workunit.client.1.smithi125.stdout:0/754: fsync d5/d33/d42/f88 0 2024-02-19T19:12:22.631 INFO:tasks.workunit.client.1.smithi125.stdout:0/755: creat d5/d19/d2b/db7/f10a x:0 0 0 2024-02-19T19:12:22.632 INFO:tasks.workunit.client.1.smithi125.stdout:1/810: dwrite d1/dc/d36/d39/fd6 [831488,122880] 0 2024-02-19T19:12:22.632 INFO:tasks.workunit.client.1.smithi125.stdout:1/811: dread d1/d26/f108 [32768,77824] 0 2024-02-19T19:12:22.632 INFO:tasks.workunit.client.1.smithi125.stdout:1/812: write d1/dc/d36/d69/f8e [474624,66783] 0 2024-02-19T19:12:22.632 INFO:tasks.workunit.client.1.smithi125.stdout:1/813: mknod d1/d1a/d3d/d6e/d87/c109 0 2024-02-19T19:12:22.649 INFO:tasks.workunit.client.1.smithi125.stdout:2/590: fdatasync d1/d27/d1d/da8/d7b/d91/faa 0 2024-02-19T19:12:22.649 INFO:tasks.workunit.client.1.smithi125.stdout:2/591: write d1/d27/d1d/d2c/d2e/f65 [582230,86432] 0 2024-02-19T19:12:22.649 INFO:tasks.workunit.client.1.smithi125.stdout:2/592: rename d1/d27/d1d/da8/c99 to d1/d27/d1d/cb0 0 2024-02-19T19:12:22.649 INFO:tasks.workunit.client.1.smithi125.stdout:9/758: fsync d8/d15/d22/fc4 0 2024-02-19T19:12:22.649 INFO:tasks.workunit.client.1.smithi125.stdout:9/759: dread - d8/d15/d22/d44/f92 zero size 2024-02-19T19:12:22.649 INFO:tasks.workunit.client.1.smithi125.stdout:9/760: rmdir d8/d15/d32 39 2024-02-19T19:12:22.650 INFO:tasks.workunit.client.1.smithi125.stdout:9/761: rmdir d8/d15/d32/d4f/d6e 39 2024-02-19T19:12:22.650 INFO:tasks.workunit.client.1.smithi125.stdout:9/762: read d8/d15/d22/d4e/f47 [247195,52042] 0 2024-02-19T19:12:22.650 INFO:tasks.workunit.client.1.smithi125.stdout:9/763: truncate d8/d15/d22/d4e/f83 1705082 0 2024-02-19T19:12:22.650 INFO:tasks.workunit.client.1.smithi125.stdout:9/764: dread d8/d15/d32/d4f/ddc/ff5 [851968,86016] 0 2024-02-19T19:12:22.650 INFO:tasks.workunit.client.1.smithi125.stdout:9/765: unlink d8/d15/d22/l6f 0 2024-02-19T19:12:22.650 INFO:tasks.workunit.client.1.smithi125.stdout:9/766: dread d8/d2e/d4c/d84/f94 [643072,69632] 0 2024-02-19T19:12:22.654 INFO:tasks.workunit.client.1.smithi125.stdout:3/550: dwrite d0/d1/d4b/d52/d81/f92 [1060864,32768] 0 2024-02-19T19:12:22.655 INFO:tasks.workunit.client.1.smithi125.stdout:3/551: mknod d0/d1/d1e/d60/cb3 0 2024-02-19T19:12:22.655 INFO:tasks.workunit.client.1.smithi125.stdout:3/552: mkdir d0/d1/d39/db4 0 2024-02-19T19:12:22.655 INFO:tasks.workunit.client.1.smithi125.stdout:3/553: creat d0/d1/d1e/db0/fb5 x:0 0 0 2024-02-19T19:12:22.655 INFO:tasks.workunit.client.1.smithi125.stdout:3/554: rename d0/d5f to d0/d1/d1e/d60/d7c/db6 0 2024-02-19T19:12:22.655 INFO:tasks.workunit.client.1.smithi125.stdout:3/555: rename d0/d1/dae to d0/d1/d4b/d52/d81/db7 0 2024-02-19T19:12:22.655 INFO:tasks.workunit.client.1.smithi125.stdout:3/556: truncate d0/d1/d1e/d60/d73/f83 193349 0 2024-02-19T19:12:22.656 INFO:tasks.workunit.client.1.smithi125.stdout:3/557: chown d0/d1/d1e/f2c 53619 1 2024-02-19T19:12:22.656 INFO:tasks.workunit.client.1.smithi125.stdout:3/558: chown d0/d1/d1e/d69/fad 785221 1 2024-02-19T19:12:22.656 INFO:tasks.workunit.client.1.smithi125.stdout:3/559: write d0/d1/d1e/f34 [277304,83871] 0 2024-02-19T19:12:22.656 INFO:tasks.workunit.client.1.smithi125.stdout:3/560: truncate d0/d1/d1e/d60/d73/d74/d82/f89 1391684 0 2024-02-19T19:12:22.656 INFO:tasks.workunit.client.1.smithi125.stdout:3/561: creat d0/d1/d4b/d52/d81/db7/fb8 x:0 0 0 2024-02-19T19:12:22.656 INFO:tasks.workunit.client.1.smithi125.stdout:6/820: dread d6/db/d49/fdd [1646592,98304] 0 2024-02-19T19:12:22.656 INFO:tasks.workunit.client.1.smithi125.stdout:6/821: write d6/db/d5d/f5f [658770,67552] 0 2024-02-19T19:12:22.657 INFO:tasks.workunit.client.1.smithi125.stdout:6/822: chown d6/db/d5d/d2f/d7b/d8d/dd1/c105 3197 1 2024-02-19T19:12:22.657 INFO:tasks.workunit.client.1.smithi125.stdout:6/823: rename d6/db/d5d/d2f/c9b to d6/c10f 0 2024-02-19T19:12:22.657 INFO:tasks.workunit.client.1.smithi125.stdout:6/824: readlink d6/db/d5d/lee 0 2024-02-19T19:12:22.657 INFO:tasks.workunit.client.1.smithi125.stdout:6/825: creat d6/db/d5d/d2f/d45/dd9/dbb/f110 x:0 0 0 2024-02-19T19:12:22.657 INFO:tasks.workunit.client.1.smithi125.stdout:5/899: dwrite db/d17/d85/dda/f118 [278528,4096] 0 2024-02-19T19:12:22.657 INFO:tasks.workunit.client.1.smithi125.stdout:5/900: mknod db/d17/d85/c11c 0 2024-02-19T19:12:22.657 INFO:tasks.workunit.client.1.smithi125.stdout:5/901: write db/d26/fbf [2451211,33237] 0 2024-02-19T19:12:22.658 INFO:tasks.workunit.client.1.smithi125.stdout:5/902: creat db/d17/d58/d33/d98/d9c/ddc/f11d x:0 0 0 2024-02-19T19:12:22.658 INFO:tasks.workunit.client.1.smithi125.stdout:5/903: dread db/d17/d58/f81 [49152,106496] 0 2024-02-19T19:12:22.658 INFO:tasks.workunit.client.1.smithi125.stdout:5/904: chown db/d47/db6 18480 1 2024-02-19T19:12:22.658 INFO:tasks.workunit.client.1.smithi125.stdout:5/905: mknod db/d17/d58/d33/d91/dbe/c11e 0 2024-02-19T19:12:22.658 INFO:tasks.workunit.client.1.smithi125.stdout:5/906: creat db/d17/d58/d33/d98/dae/f11f x:0 0 0 2024-02-19T19:12:22.658 INFO:tasks.workunit.client.1.smithi125.stdout:5/907: stat db/d26/f90 0 2024-02-19T19:12:22.658 INFO:tasks.workunit.client.1.smithi125.stdout:0/756: dwrite d5/d9/f108 [1957888,86016] 0 2024-02-19T19:12:22.659 INFO:tasks.workunit.client.1.smithi125.stdout:2/593: dwrite d1/d27/f22 [2748416,32768] 0 2024-02-19T19:12:22.659 INFO:tasks.workunit.client.1.smithi125.stdout:2/594: rmdir d1/d27/d45 39 2024-02-19T19:12:22.659 INFO:tasks.workunit.client.1.smithi125.stdout:2/595: truncate d1/d27/d1d/d25/da3/fad 860377 0 2024-02-19T19:12:22.659 INFO:tasks.workunit.client.1.smithi125.stdout:2/596: creat d1/d27/d1d/d39/fb1 x:0 0 0 2024-02-19T19:12:22.659 INFO:tasks.workunit.client.1.smithi125.stdout:2/597: creat d1/d27/d1d/d2c/d2e/fb2 x:0 0 0 2024-02-19T19:12:22.659 INFO:tasks.workunit.client.1.smithi125.stdout:2/598: creat d1/fb3 x:0 0 0 2024-02-19T19:12:22.659 INFO:tasks.workunit.client.1.smithi125.stdout:2/599: readlink d1/d36/d70/l8c 0 2024-02-19T19:12:22.659 INFO:tasks.workunit.client.1.smithi125.stdout:2/600: truncate d1/d36/d70/f66 563547 0 2024-02-19T19:12:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:22 smithi125 ceph-mon[86115]: pgmap v156: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:12:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:22.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-19T19:12:22.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:12:22.710 INFO:tasks.workunit.client.1.smithi125.stdout:1/814: fsync d1/d26/d3c/fbc 0 2024-02-19T19:12:22.710 INFO:tasks.workunit.client.1.smithi125.stdout:1/815: dread d1/f30 [69632,24576] 0 2024-02-19T19:12:22.711 INFO:tasks.workunit.client.1.smithi125.stdout:1/816: readlink d1/d26/d23/lb3 0 2024-02-19T19:12:22.711 INFO:tasks.workunit.client.1.smithi125.stdout:2/601: fdatasync d1/d27/d1d/da8/d7b/d91/f97 0 2024-02-19T19:12:22.711 INFO:tasks.workunit.client.1.smithi125.stdout:2/602: chown d1/l17 417643 1 2024-02-19T19:12:22.713 INFO:tasks.workunit.client.1.smithi125.stdout:1/817: link d1/d26/d3c/c95 d1/da3/c10a 0 2024-02-19T19:12:22.713 INFO:tasks.workunit.client.1.smithi125.stdout:3/562: dwrite d0/de/f6c [876544,24576] 0 2024-02-19T19:12:22.713 INFO:tasks.workunit.client.1.smithi125.stdout:6/826: dwrite d6/db/da7/fb2 [458752,110592] 0 2024-02-19T19:12:22.713 INFO:tasks.workunit.client.1.smithi125.stdout:9/767: dwrite d8/d15/d22/d4e/d90/f9a [200704,53248] 0 2024-02-19T19:12:22.713 INFO:tasks.workunit.client.1.smithi125.stdout:2/603: dread d1/d27/d1d/da8/f79 [188416,57344] 0 2024-02-19T19:12:22.714 INFO:tasks.workunit.client.1.smithi125.stdout:3/563: dread d0/de/f61 [262144,110592] 0 2024-02-19T19:12:22.714 INFO:tasks.workunit.client.1.smithi125.stdout:9/768: rename d8/d15/da2/de1 to d8/d15/d10d 0 2024-02-19T19:12:22.714 INFO:tasks.workunit.client.1.smithi125.stdout:3/564: chown d0/d1/d1e/d60/d7c/db6/c6b 57510902 1 2024-02-19T19:12:22.714 INFO:tasks.workunit.client.1.smithi125.stdout:3/565: chown d0/d1/d1e/f36 25905621 1 2024-02-19T19:12:22.714 INFO:tasks.workunit.client.1.smithi125.stdout:3/566: dread - d0/d1/d39/f8b zero size 2024-02-19T19:12:22.714 INFO:tasks.workunit.client.1.smithi125.stdout:3/567: chown d0/f33 689327489 1 2024-02-19T19:12:22.714 INFO:tasks.workunit.client.1.smithi125.stdout:3/568: stat d0/f51 0 2024-02-19T19:12:22.714 INFO:tasks.workunit.client.1.smithi125.stdout:3/569: creat d0/d95/d9c/fb9 x:0 0 0 2024-02-19T19:12:22.714 INFO:tasks.workunit.client.1.smithi125.stdout:3/570: mkdir d0/d95/d9c/dba 0 2024-02-19T19:12:22.716 INFO:tasks.workunit.client.1.smithi125.stdout:6/827: dwrite d6/db/d5d/d2f/d45/dd9/f12 [2723840,40960] 0 2024-02-19T19:12:22.716 INFO:tasks.workunit.client.1.smithi125.stdout:6/828: truncate d6/db/d5d/d2f/d45/d107/f92 1308904 0 2024-02-19T19:12:22.716 INFO:tasks.workunit.client.1.smithi125.stdout:6/829: write d6/db/d5d/d2f/d45/dd9/dbb/fd3 [1010989,90176] 0 2024-02-19T19:12:22.717 INFO:tasks.workunit.client.1.smithi125.stdout:6/830: truncate d6/db/d5d/d2f/d45/dd9/d3b/dda/fb1 740138 0 2024-02-19T19:12:22.718 INFO:tasks.workunit.client.1.smithi125.stdout:1/818: dwrite d1/dc/f52 [1449984,102400] 0 2024-02-19T19:12:22.718 INFO:tasks.workunit.client.1.smithi125.stdout:1/819: chown d1/d78/d80/c32 6248625 1 2024-02-19T19:12:22.718 INFO:tasks.workunit.client.1.smithi125.stdout:1/820: write d1/dc/f1b [1992954,120525] 0 2024-02-19T19:12:22.718 INFO:tasks.workunit.client.1.smithi125.stdout:1/821: link d1/f30 d1/d1a/d3d/d6e/d87/f10b 0 2024-02-19T19:12:22.718 INFO:tasks.workunit.client.1.smithi125.stdout:9/769: dwrite d8/d15/d22/fc4 [610304,90112] 0 2024-02-19T19:12:22.718 INFO:tasks.workunit.client.1.smithi125.stdout:1/822: symlink d1/d78/d80/l10c 0 2024-02-19T19:12:22.719 INFO:tasks.workunit.client.1.smithi125.stdout:1/823: mknod d1/d1a/dd3/c10d 0 2024-02-19T19:12:22.719 INFO:tasks.workunit.client.1.smithi125.stdout:9/770: write d8/d2e/d4c/f5f [676396,70298] 0 2024-02-19T19:12:22.719 INFO:tasks.workunit.client.1.smithi125.stdout:9/771: dread - d8/d2e/d4c/d84/ffb zero size 2024-02-19T19:12:22.720 INFO:tasks.workunit.client.1.smithi125.stdout:9/772: dwrite d8/d15/d32/d4f/d6e/ff3 [643072,8192] 0 2024-02-19T19:12:22.720 INFO:tasks.workunit.client.1.smithi125.stdout:9/773: truncate d8/d15/d32/f2a 215365 0 2024-02-19T19:12:22.720 INFO:tasks.workunit.client.1.smithi125.stdout:9/774: write d8/d15/d32/d4f/d6e/fbf [646177,87259] 0 2024-02-19T19:12:22.721 INFO:tasks.workunit.client.1.smithi125.stdout:9/775: symlink d8/d15/d32/d4f/ddc/l10e 0 2024-02-19T19:12:22.721 INFO:tasks.workunit.client.1.smithi125.stdout:6/831: dwrite d6/db/d5d/d2f/d45/dd9/d3b/dda/f96 [598016,61440] 0 2024-02-19T19:12:22.721 INFO:tasks.workunit.client.1.smithi125.stdout:6/832: rename d6/db/d5d/d2f/f86 to d6/db/d5d/d29/d68/f111 0 2024-02-19T19:12:22.721 INFO:tasks.workunit.client.1.smithi125.stdout:6/833: stat d6/db/d5d/d2f/d45/dd9/d3b/dda/daf/de3 0 2024-02-19T19:12:22.721 INFO:tasks.workunit.client.1.smithi125.stdout:6/834: rename d6/db/d5d/d2f/d45/dd9/d3b/dcc/df3 to d6/db/d5d/d2f/d45/dd9/d3b/dcc/df4/d112 0 2024-02-19T19:12:22.721 INFO:tasks.workunit.client.1.smithi125.stdout:6/835: rename d6/db/da7/f10b to d6/db/d5d/d2f/d7b/d8d/dbc/f113 0 2024-02-19T19:12:22.729 INFO:tasks.workunit.client.1.smithi125.stdout:2/604: write d1/d27/d1d/d2c/f31 [168293,23234] 0 2024-02-19T19:12:22.729 INFO:tasks.workunit.client.1.smithi125.stdout:2/605: dread d1/d27/f11 [348160,102400] 0 2024-02-19T19:12:22.729 INFO:tasks.workunit.client.1.smithi125.stdout:2/606: write d1/d27/d1d/da8/d7b/d91/faf [92195,4264] 0 2024-02-19T19:12:22.729 INFO:tasks.workunit.client.1.smithi125.stdout:2/607: creat d1/fb4 x:0 0 0 2024-02-19T19:12:22.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:22 smithi096 ceph-mon[112483]: pgmap v156: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:12:22.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:22.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-19T19:12:22.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:12:22.846 INFO:tasks.workunit.client.1.smithi125.stdout:6/836: dwrite d6/db/d5d/d2f/f100 [249856,32768] 0 2024-02-19T19:12:22.850 INFO:tasks.workunit.client.1.smithi125.stdout:9/776: dwrite d8/d2e/fbe [118784,86016] 0 2024-02-19T19:12:22.850 INFO:tasks.workunit.client.1.smithi125.stdout:9/777: creat d8/d15/f10f x:0 0 0 2024-02-19T19:12:22.851 INFO:tasks.workunit.client.1.smithi125.stdout:9/778: stat d8/d2e/d6d/lf9 0 2024-02-19T19:12:22.851 INFO:tasks.workunit.client.1.smithi125.stdout:2/608: dwrite d1/d36/d70/d85/da4/fa6 [1888256,122880] 0 2024-02-19T19:12:22.851 INFO:tasks.workunit.client.1.smithi125.stdout:2/609: mknod d1/d36/d70/cb5 0 2024-02-19T19:12:22.851 INFO:tasks.workunit.client.1.smithi125.stdout:2/610: mknod d1/d27/d1d/d25/cb6 0 2024-02-19T19:12:22.851 INFO:tasks.workunit.client.1.smithi125.stdout:6/837: dread d6/db/da7/fb2 [528384,12288] 0 2024-02-19T19:12:22.851 INFO:tasks.workunit.client.1.smithi125.stdout:6/838: write d6/db/d5d/f19 [2158909,120907] 0 2024-02-19T19:12:22.851 INFO:tasks.workunit.client.1.smithi125.stdout:6/839: getdents d6/db/d5d/d2f/d45 0 2024-02-19T19:12:22.897 INFO:tasks.workunit.client.1.smithi125.stdout:3/571: fdatasync d0/d1/d87/f93 0 2024-02-19T19:12:22.897 INFO:tasks.workunit.client.1.smithi125.stdout:1/824: fsync d1/d78/d80/f35 0 2024-02-19T19:12:22.897 INFO:tasks.workunit.client.1.smithi125.stdout:3/572: chown d0/d1/d1e/d60/d7c/db6/d71/f7f 7177407 1 2024-02-19T19:12:22.897 INFO:tasks.workunit.client.1.smithi125.stdout:1/825: mknod d1/dc/d36/d69/c10e 0 2024-02-19T19:12:22.897 INFO:tasks.workunit.client.1.smithi125.stdout:1/826: creat d1/d1a/dd3/f10f x:0 0 0 2024-02-19T19:12:22.897 INFO:tasks.workunit.client.1.smithi125.stdout:8/594: fsync db/d81/d95/fb8 0 2024-02-19T19:12:22.898 INFO:tasks.workunit.client.1.smithi125.stdout:8/595: chown db/d18/d30/d80/dac/fbb 671 1 2024-02-19T19:12:22.900 INFO:tasks.workunit.client.1.smithi125.stdout:1/827: dread d1/d26/d3c/f8f [131072,90112] 0 2024-02-19T19:12:22.900 INFO:tasks.workunit.client.1.smithi125.stdout:9/779: dwrite d8/d15/d22/d4e/d90/f9a [262144,12288] 0 2024-02-19T19:12:22.900 INFO:tasks.workunit.client.1.smithi125.stdout:8/596: creat db/d18/d30/d3c/d4d/d5d/da2/dae/fbe x:0 0 0 2024-02-19T19:12:22.900 INFO:tasks.workunit.client.1.smithi125.stdout:2/611: dwrite d1/d27/d1d/d16/f8e [761856,110592] 0 2024-02-19T19:12:22.900 INFO:tasks.workunit.client.1.smithi125.stdout:8/597: readlink db/l29 0 2024-02-19T19:12:22.900 INFO:tasks.workunit.client.1.smithi125.stdout:9/780: dread d8/d15/d22/d44/f7a [507904,77824] 0 2024-02-19T19:12:22.901 INFO:tasks.workunit.client.1.smithi125.stdout:8/598: dread - db/d18/d30/d80/d9e/fb3 zero size 2024-02-19T19:12:22.901 INFO:tasks.workunit.client.1.smithi125.stdout:9/781: stat d8/d2e/d4c/d84/fd6 0 2024-02-19T19:12:22.901 INFO:tasks.workunit.client.1.smithi125.stdout:9/782: chown d8/d2e/d4c/d84/f8c 1770 1 2024-02-19T19:12:22.901 INFO:tasks.workunit.client.1.smithi125.stdout:3/573: write d0/de/f44 [1156803,109624] 0 2024-02-19T19:12:22.901 INFO:tasks.workunit.client.1.smithi125.stdout:9/783: chown d8/d15/da2/lab 227814 1 2024-02-19T19:12:22.901 INFO:tasks.workunit.client.1.smithi125.stdout:6/840: dwrite d6/db/d5d/d2f/d45/dd9/f51 [2613248,126976] 0 2024-02-19T19:12:22.901 INFO:tasks.workunit.client.1.smithi125.stdout:9/784: unlink d8/l10 0 2024-02-19T19:12:22.902 INFO:tasks.workunit.client.1.smithi125.stdout:3/574: rename d0/d1/d1e/db0/fb5 to d0/d1/d4b/fbb 0 2024-02-19T19:12:22.902 INFO:tasks.workunit.client.1.smithi125.stdout:6/841: rmdir d6/db/d5d/d2f/d45/dd9/d3b/dcc/df4 39 2024-02-19T19:12:22.902 INFO:tasks.workunit.client.1.smithi125.stdout:3/575: dread - d0/d1/d4b/d52/d81/f86 zero size 2024-02-19T19:12:22.905 INFO:tasks.workunit.client.1.smithi125.stdout:3/576: rename d0/c26 to d0/de/cbc 0 2024-02-19T19:12:22.906 INFO:tasks.workunit.client.1.smithi125.stdout:3/577: readlink d0/de/l3f 0 2024-02-19T19:12:22.906 INFO:tasks.workunit.client.1.smithi125.stdout:6/842: symlink d6/db/d5d/d2f/d45/dd9/d16/l114 0 2024-02-19T19:12:22.906 INFO:tasks.workunit.client.1.smithi125.stdout:6/843: creat d6/db/d5d/d2f/d45/dd9/d3b/dda/daf/de3/f115 x:0 0 0 2024-02-19T19:12:22.906 INFO:tasks.workunit.client.1.smithi125.stdout:3/578: symlink d0/lbd 0 2024-02-19T19:12:22.906 INFO:tasks.workunit.client.1.smithi125.stdout:6/844: readlink d6/db/d5d/d2f/d45/dd9/d3b/l101 0 2024-02-19T19:12:22.906 INFO:tasks.workunit.client.1.smithi125.stdout:9/785: unlink d8/d15/fb3 0 2024-02-19T19:12:22.906 INFO:tasks.workunit.client.1.smithi125.stdout:6/845: creat d6/db/d5d/d29/f116 x:0 0 0 2024-02-19T19:12:22.907 INFO:tasks.workunit.client.1.smithi125.stdout:3/579: write d0/d1/f63 [312351,30617] 0 2024-02-19T19:12:22.907 INFO:tasks.workunit.client.1.smithi125.stdout:9/786: creat d8/d15/d32/f110 x:0 0 0 2024-02-19T19:12:22.907 INFO:tasks.workunit.client.1.smithi125.stdout:6/846: creat d6/db/d5d/d2f/d45/dd9/d3b/dda/daf/f117 x:0 0 0 2024-02-19T19:12:22.907 INFO:tasks.workunit.client.1.smithi125.stdout:9/787: readlink d8/d15/d22/d4e/l8a 0 2024-02-19T19:12:22.907 INFO:tasks.workunit.client.1.smithi125.stdout:3/580: unlink d0/d1/l29 0 2024-02-19T19:12:22.907 INFO:tasks.workunit.client.1.smithi125.stdout:3/581: truncate d0/f33 210294 0 2024-02-19T19:12:22.907 INFO:tasks.workunit.client.1.smithi125.stdout:6/847: symlink d6/db/d5d/d29/d68/l118 0 2024-02-19T19:12:22.907 INFO:tasks.workunit.client.1.smithi125.stdout:8/599: truncate db/d18/d2f/f3a 2082056 0 2024-02-19T19:12:22.908 INFO:tasks.workunit.client.1.smithi125.stdout:3/582: rename d0/d1/d1e/d60/d7c/db6/c6b to d0/d1/d4b/d52/cbe 0 2024-02-19T19:12:22.908 INFO:tasks.workunit.client.1.smithi125.stdout:3/583: chown d0/d1/d4b/d52/l9f 958 1 2024-02-19T19:12:22.908 INFO:tasks.workunit.client.1.smithi125.stdout:8/600: write db/f1e [287142,123336] 0 2024-02-19T19:12:22.908 INFO:tasks.workunit.client.1.smithi125.stdout:8/601: chown db/d18/d2f/d3f/l44 7719 1 2024-02-19T19:12:22.908 INFO:tasks.workunit.client.1.smithi125.stdout:8/602: mknod db/d81/cbf 0 2024-02-19T19:12:22.908 INFO:tasks.workunit.client.1.smithi125.stdout:1/828: dwrite d1/d26/d23/d106/f103 [1028096,69632] 0 2024-02-19T19:12:22.908 INFO:tasks.workunit.client.1.smithi125.stdout:1/829: rmdir d1/d78/d8a 39 2024-02-19T19:12:22.908 INFO:tasks.workunit.client.1.smithi125.stdout:1/830: creat d1/d1a/d3d/d6e/f110 x:0 0 0 2024-02-19T19:12:22.909 INFO:tasks.workunit.client.1.smithi125.stdout:1/831: symlink d1/d1a/d3d/d6e/l111 0 2024-02-19T19:12:22.909 INFO:tasks.workunit.client.1.smithi125.stdout:1/832: write d1/d26/fdf [546388,113099] 0 2024-02-19T19:12:22.909 INFO:tasks.workunit.client.1.smithi125.stdout:1/833: getdents d1/dc/d36/d69 0 2024-02-19T19:12:22.909 INFO:tasks.workunit.client.1.smithi125.stdout:1/834: dread d1/d78/d80/fb1 [679936,20480] 0 2024-02-19T19:12:22.909 INFO:tasks.workunit.client.1.smithi125.stdout:1/835: read - d1/d1a/d3d/d6e/d4b/fc9 zero size 2024-02-19T19:12:22.909 INFO:tasks.workunit.client.1.smithi125.stdout:2/612: dwrite d1/d27/d1d/d2c/d2e/f92 [24576,106496] 0 2024-02-19T19:12:22.909 INFO:tasks.workunit.client.1.smithi125.stdout:2/613: rename d1/c19 to d1/d27/d1d/d16/cb7 0 2024-02-19T19:12:22.909 INFO:tasks.workunit.client.1.smithi125.stdout:2/614: symlink d1/d27/d1d/da8/d7b/lb8 0 2024-02-19T19:12:22.909 INFO:tasks.workunit.client.1.smithi125.stdout:2/615: write d1/d27/d1d/d39/f7e [683070,123222] 0 2024-02-19T19:12:22.910 INFO:tasks.workunit.client.1.smithi125.stdout:2/616: mknod d1/d27/d1d/d2c/d2e/cb9 0 2024-02-19T19:12:22.910 INFO:tasks.workunit.client.1.smithi125.stdout:2/617: mkdir d1/d27/d1d/d2c/dba 0 2024-02-19T19:12:22.910 INFO:tasks.workunit.client.1.smithi125.stdout:2/618: chown d1/d36/d70/d4b 611328 1 2024-02-19T19:12:22.910 INFO:tasks.workunit.client.1.smithi125.stdout:2/619: creat d1/d27/da2/fbb x:0 0 0 2024-02-19T19:12:22.910 INFO:tasks.workunit.client.1.smithi125.stdout:2/620: mkdir d1/d27/d1d/da8/d7b/d91/dbc 0 2024-02-19T19:12:22.910 INFO:tasks.workunit.client.1.smithi125.stdout:2/621: rename d1/d27/d45/d7a/f7d to d1/d27/d1d/d16/fbd 0 2024-02-19T19:12:22.910 INFO:tasks.workunit.client.1.smithi125.stdout:2/622: write d1/fb3 [399054,119339] 0 2024-02-19T19:12:22.956 INFO:tasks.workunit.client.1.smithi125.stdout:2/623: dwrite d1/d36/d70/f49 [1294336,65536] 0 2024-02-19T19:12:22.956 INFO:tasks.workunit.client.1.smithi125.stdout:2/624: creat d1/d27/d1d/da8/d7b/fbe x:0 0 0 2024-02-19T19:12:22.957 INFO:tasks.workunit.client.1.smithi125.stdout:2/625: stat d1/d36/d70/d85/da4 0 2024-02-19T19:12:22.957 INFO:tasks.workunit.client.1.smithi125.stdout:2/626: creat d1/d27/d1d/d2c/fbf x:0 0 0 2024-02-19T19:12:22.957 INFO:tasks.workunit.client.1.smithi125.stdout:2/627: stat d1/l18 0 2024-02-19T19:12:22.957 INFO:tasks.workunit.client.1.smithi125.stdout:2/628: dread d1/d27/d1d/da8/d7b/d91/faa [90112,110592] 0 2024-02-19T19:12:22.957 INFO:tasks.workunit.client.1.smithi125.stdout:2/629: truncate d1/ff 121449 0 2024-02-19T19:12:22.957 INFO:tasks.workunit.client.1.smithi125.stdout:2/630: write d1/d27/d1d/da8/d7b/fbe [264303,86848] 0 2024-02-19T19:12:22.957 INFO:tasks.workunit.client.1.smithi125.stdout:2/631: mkdir d1/d36/dc0 0 2024-02-19T19:12:22.957 INFO:tasks.workunit.client.1.smithi125.stdout:2/632: unlink d1/d27/d1d/d25/da3/fad 0 2024-02-19T19:12:22.958 INFO:tasks.workunit.client.1.smithi125.stdout:9/788: dwrite d8/d15/d32/d4f/d85/dcb/fef [638976,118784] 0 2024-02-19T19:12:22.958 INFO:tasks.workunit.client.1.smithi125.stdout:9/789: write d8/d15/d22/d4e/f56 [2032598,114488] 0 2024-02-19T19:12:22.959 INFO:tasks.workunit.client.1.smithi125.stdout:1/836: dread d1/d1a/d3d/fd1 [176128,122880] 0 2024-02-19T19:12:22.959 INFO:tasks.workunit.client.1.smithi125.stdout:1/837: chown d1/dc/d36/d69/f98 8 1 2024-02-19T19:12:23.012 INFO:tasks.workunit.client.1.smithi125.stdout:5/908: fdatasync db/d26/fbf 0 2024-02-19T19:12:23.013 INFO:tasks.workunit.client.1.smithi125.stdout:2/633: dwrite d1/d27/d45/f56 [368640,12288] 0 2024-02-19T19:12:23.013 INFO:tasks.workunit.client.1.smithi125.stdout:2/634: read - d1/fb4 zero size 2024-02-19T19:12:23.013 INFO:tasks.workunit.client.1.smithi125.stdout:2/635: dread d1/d27/d1d/d2c/d2e/f92 [634880,8192] 0 2024-02-19T19:12:23.013 INFO:tasks.workunit.client.1.smithi125.stdout:2/636: write d1/d27/d1d/f24 [1999527,11778] 0 2024-02-19T19:12:23.013 INFO:tasks.workunit.client.1.smithi125.stdout:2/637: mknod d1/d27/d1d/da8/cc1 0 2024-02-19T19:12:23.013 INFO:tasks.workunit.client.1.smithi125.stdout:2/638: truncate d1/d27/d1d/f24 1923416 0 2024-02-19T19:12:23.013 INFO:tasks.workunit.client.1.smithi125.stdout:2/639: rmdir d1/d27/d1d/d2c/dba 0 2024-02-19T19:12:23.014 INFO:tasks.workunit.client.1.smithi125.stdout:9/790: dwrite d8/d2e/fed [352256,57344] 0 2024-02-19T19:12:23.015 INFO:tasks.workunit.client.1.smithi125.stdout:9/791: read d8/d2e/d4c/d84/fce [154068,91665] 0 2024-02-19T19:12:23.015 INFO:tasks.workunit.client.1.smithi125.stdout:9/792: chown d8/d2e/f4b 11037635 1 2024-02-19T19:12:23.015 INFO:tasks.workunit.client.1.smithi125.stdout:9/793: getdents d8/d15/d32/d4f 0 2024-02-19T19:12:23.027 INFO:tasks.workunit.client.1.smithi125.stdout:1/838: dread d1/d1a/f2a [528384,122880] 0 2024-02-19T19:12:23.028 INFO:tasks.workunit.client.1.smithi125.stdout:1/839: truncate d1/d78/d8a/fb6 70934 0 2024-02-19T19:12:23.081 INFO:tasks.workunit.client.1.smithi125.stdout:8/603: fdatasync db/d18/d2f/d3f/f7c 0 2024-02-19T19:12:23.082 INFO:tasks.workunit.client.1.smithi125.stdout:8/604: dread db/f46 [1384448,81920] 0 2024-02-19T19:12:23.082 INFO:tasks.workunit.client.1.smithi125.stdout:8/605: creat db/d81/fc0 x:0 0 0 2024-02-19T19:12:23.082 INFO:tasks.workunit.client.1.smithi125.stdout:8/606: getdents db 0 2024-02-19T19:12:23.082 INFO:tasks.workunit.client.1.smithi125.stdout:8/607: dread - db/d18/d2f/fab zero size 2024-02-19T19:12:23.082 INFO:tasks.workunit.client.1.smithi125.stdout:8/608: rename db/f36 to db/d18/d30/d80/d9e/da3/fc1 0 2024-02-19T19:12:23.082 INFO:tasks.workunit.client.1.smithi125.stdout:8/609: dread db/d18/f21 [921600,98304] 0 2024-02-19T19:12:23.082 INFO:tasks.workunit.client.1.smithi125.stdout:8/610: mknod db/d18/d30/d3c/d4d/cc2 0 2024-02-19T19:12:23.083 INFO:tasks.workunit.client.1.smithi125.stdout:8/611: dread - db/d81/fc0 zero size 2024-02-19T19:12:23.083 INFO:tasks.workunit.client.1.smithi125.stdout:8/612: chown db/d18/l25 796657078 1 2024-02-19T19:12:23.083 INFO:tasks.workunit.client.1.smithi125.stdout:8/613: symlink db/d18/d30/d48/db1/lc3 0 2024-02-19T19:12:23.083 INFO:tasks.workunit.client.1.smithi125.stdout:8/614: rmdir db/d18/d30/d48/d67 39 2024-02-19T19:12:23.083 INFO:tasks.workunit.client.1.smithi125.stdout:8/615: link db/l3d db/db4/lc4 0 2024-02-19T19:12:23.083 INFO:tasks.workunit.client.1.smithi125.stdout:8/616: mkdir db/d81/d95/dc5 0 2024-02-19T19:12:23.083 INFO:tasks.workunit.client.1.smithi125.stdout:8/617: read db/d18/d30/d80/d9e/da3/fa5 [327957,76942] 0 2024-02-19T19:12:23.083 INFO:tasks.workunit.client.1.smithi125.stdout:8/618: mkdir db/d18/d30/d3c/dc6 0 2024-02-19T19:12:23.083 INFO:tasks.workunit.client.1.smithi125.stdout:8/619: truncate db/d18/d30/f4f 2453506 0 2024-02-19T19:12:23.084 INFO:tasks.workunit.client.1.smithi125.stdout:8/620: symlink db/d18/d30/lc7 0 2024-02-19T19:12:23.084 INFO:tasks.workunit.client.1.smithi125.stdout:8/621: link db/d18/d30/d80/dac/fbb db/d18/d30/d3c/d4d/d5d/fc8 0 2024-02-19T19:12:23.084 INFO:tasks.workunit.client.1.smithi125.stdout:8/622: link db/d18/d30/d80/d9e/da3/faa db/fc9 0 2024-02-19T19:12:23.148 INFO:tasks.workunit.client.1.smithi125.stdout:1/840: fsync d1/d26/d3c/fbc 0 2024-02-19T19:12:23.148 INFO:tasks.workunit.client.1.smithi125.stdout:1/841: creat d1/d1a/d3d/de2/f112 x:0 0 0 2024-02-19T19:12:23.149 INFO:tasks.workunit.client.1.smithi125.stdout:1/842: chown d1/dc/f2c 36 1 2024-02-19T19:12:23.153 INFO:tasks.workunit.client.1.smithi125.stdout:1/843: dwrite d1/d26/d3c/fbc [970752,36864] 0 2024-02-19T19:12:23.153 INFO:tasks.workunit.client.1.smithi125.stdout:1/844: symlink d1/d26/d23/d106/de9/l113 0 2024-02-19T19:12:23.153 INFO:tasks.workunit.client.1.smithi125.stdout:8/623: dwrite db/d18/d30/d3c/f4b [1945600,69632] 0 2024-02-19T19:12:23.154 INFO:tasks.workunit.client.1.smithi125.stdout:8/624: creat db/d18/fca x:0 0 0 2024-02-19T19:12:23.154 INFO:tasks.workunit.client.1.smithi125.stdout:1/845: write d1/d26/f73 [228494,3451] 0 2024-02-19T19:12:23.154 INFO:tasks.workunit.client.1.smithi125.stdout:1/846: rmdir d1/d1a/d3d/d6e/d87/ddd 0 2024-02-19T19:12:23.154 INFO:tasks.workunit.client.1.smithi125.stdout:1/847: truncate d1/d26/d3c/d3f/f48 731035 0 2024-02-19T19:12:23.154 INFO:tasks.workunit.client.1.smithi125.stdout:1/848: rename d1/d26/f83 to d1/d1a/d3d/f114 0 2024-02-19T19:12:23.154 INFO:tasks.workunit.client.1.smithi125.stdout:1/849: creat d1/dc/d36/d69/f115 x:0 0 0 2024-02-19T19:12:23.154 INFO:tasks.workunit.client.1.smithi125.stdout:1/850: getdents d1/d1a/d3d/d6e/d87 0 2024-02-19T19:12:23.154 INFO:tasks.workunit.client.1.smithi125.stdout:1/851: chown d1/d26/d23/d106/f103 679361 1 2024-02-19T19:12:23.154 INFO:tasks.workunit.client.1.smithi125.stdout:1/852: symlink d1/d26/d23/d106/de9/l116 0 2024-02-19T19:12:23.205 INFO:tasks.workunit.client.1.smithi125.stdout:2/640: fsync d1/d27/f11 0 2024-02-19T19:12:23.206 INFO:tasks.workunit.client.1.smithi125.stdout:8/625: dwrite db/d18/d30/d80/d9e/da3/faa [724992,53248] 0 2024-02-19T19:12:23.206 INFO:tasks.workunit.client.1.smithi125.stdout:8/626: creat db/d18/d30/d80/d9e/da3/fcb x:0 0 0 2024-02-19T19:12:23.206 INFO:tasks.workunit.client.1.smithi125.stdout:8/627: mknod db/d81/d95/dc5/ccc 0 2024-02-19T19:12:23.209 INFO:tasks.workunit.client.1.smithi125.stdout:2/641: creat d1/d27/d1d/fc2 x:0 0 0 2024-02-19T19:12:23.209 INFO:tasks.workunit.client.1.smithi125.stdout:2/642: mkdir d1/d27/d1d/d25/da0/dc3 0 2024-02-19T19:12:23.254 INFO:tasks.workunit.client.1.smithi125.stdout:1/853: fdatasync d1/d26/d23/d106/f103 0 2024-02-19T19:12:23.254 INFO:tasks.workunit.client.1.smithi125.stdout:2/643: fdatasync d1/d27/d1d/f2b 0 2024-02-19T19:12:23.254 INFO:tasks.workunit.client.1.smithi125.stdout:2/644: chown d1/d36/d70/d85/da4/fa6 345314 1 2024-02-19T19:12:23.259 INFO:tasks.workunit.client.1.smithi125.stdout:8/628: dwrite db/d18/d30/d80/d9e/da3/fc1 [2113536,45056] 0 2024-02-19T19:12:23.259 INFO:tasks.workunit.client.1.smithi125.stdout:8/629: readlink db/d81/la6 0 2024-02-19T19:12:23.259 INFO:tasks.workunit.client.1.smithi125.stdout:8/630: truncate db/d18/d30/d48/fbc 844888 0 2024-02-19T19:12:23.259 INFO:tasks.workunit.client.1.smithi125.stdout:8/631: chown db/f46 40 1 2024-02-19T19:12:23.259 INFO:tasks.workunit.client.1.smithi125.stdout:8/632: getdents db/d18/d30/d3c/d4d/d5d/da2 0 2024-02-19T19:12:23.259 INFO:tasks.workunit.client.1.smithi125.stdout:8/633: truncate db/d18/d30/f89 847485 0 2024-02-19T19:12:23.260 INFO:tasks.workunit.client.1.smithi125.stdout:2/645: dwrite d1/d27/d1d/da8/d7b/d91/f97 [286720,77824] 0 2024-02-19T19:12:23.260 INFO:tasks.workunit.client.1.smithi125.stdout:2/646: write d1/d27/f82 [754910,111256] 0 2024-02-19T19:12:23.260 INFO:tasks.workunit.client.1.smithi125.stdout:1/854: dwrite d1/d26/d23/d106/de9/f101 [1380352,86016] 0 2024-02-19T19:12:23.260 INFO:tasks.workunit.client.1.smithi125.stdout:1/855: dread d1/d1a/d3d/d6e/d87/fb7 [372736,90112] 0 2024-02-19T19:12:23.309 INFO:tasks.workunit.client.1.smithi125.stdout:2/647: dwrite d1/d27/d1d/da8/d7b/d91/faa [794624,4096] 0 2024-02-19T19:12:23.309 INFO:tasks.workunit.client.1.smithi125.stdout:2/648: write d1/d36/d70/f8a [250719,108525] 0 2024-02-19T19:12:23.313 INFO:tasks.workunit.client.1.smithi125.stdout:8/634: dwrite db/d18/d30/d80/f97 [135168,40960] 0 2024-02-19T19:12:23.313 INFO:tasks.workunit.client.1.smithi125.stdout:1/856: dwrite d1/d26/d23/fc8 [835584,110592] 0 2024-02-19T19:12:23.314 INFO:tasks.workunit.client.1.smithi125.stdout:1/857: rename d1/d102 to d1/d26/d23/d106/de9/d117 0 2024-02-19T19:12:23.355 INFO:tasks.workunit.client.1.smithi125.stdout:8/635: fsync db/f41 0 2024-02-19T19:12:23.355 INFO:tasks.workunit.client.1.smithi125.stdout:2/649: fdatasync d1/d27/f22 0 2024-02-19T19:12:23.355 INFO:tasks.workunit.client.1.smithi125.stdout:8/636: symlink db/d18/d30/d80/d9e/lcd 0 2024-02-19T19:12:23.356 INFO:tasks.workunit.client.1.smithi125.stdout:8/637: symlink db/d18/d30/d3c/d4d/lce 0 2024-02-19T19:12:23.356 INFO:tasks.workunit.client.1.smithi125.stdout:2/650: unlink d1/f59 0 2024-02-19T19:12:23.356 INFO:tasks.workunit.client.1.smithi125.stdout:2/651: chown d1/d36/d70/f8a 27048898 1 2024-02-19T19:12:23.356 INFO:tasks.workunit.client.1.smithi125.stdout:2/652: dread d1/d36/d70/f66 [299008,4096] 0 2024-02-19T19:12:23.356 INFO:tasks.workunit.client.1.smithi125.stdout:8/638: symlink db/d18/d30/d48/d67/lcf 0 2024-02-19T19:12:23.357 INFO:tasks.workunit.client.1.smithi125.stdout:4/571: sync 2024-02-19T19:12:23.357 INFO:tasks.workunit.client.1.smithi125.stdout:4/572: creat d0/d7/d30/d42/fc2 x:0 0 0 2024-02-19T19:12:23.357 INFO:tasks.workunit.client.1.smithi125.stdout:4/573: stat d0/d7/d30/d42/l83 0 2024-02-19T19:12:23.357 INFO:tasks.workunit.client.1.smithi125.stdout:4/574: stat d0/d7/d30/d42/l83 0 2024-02-19T19:12:23.358 INFO:tasks.workunit.client.1.smithi125.stdout:4/575: unlink d0/d7/d3b/l6f 0 2024-02-19T19:12:23.361 INFO:tasks.workunit.client.1.smithi125.stdout:8/639: write db/d18/f2d [2921426,2732] 0 2024-02-19T19:12:23.361 INFO:tasks.workunit.client.1.smithi125.stdout:4/576: symlink d0/d7/d30/d58/lc3 0 2024-02-19T19:12:23.362 INFO:tasks.workunit.client.1.smithi125.stdout:8/640: read - db/d18/d2f/d3f/fad zero size 2024-02-19T19:12:23.362 INFO:tasks.workunit.client.1.smithi125.stdout:2/653: unlink d1/d27/d1d/d16/f8e 0 2024-02-19T19:12:23.362 INFO:tasks.workunit.client.1.smithi125.stdout:8/641: symlink db/d18/d30/d3c/ld0 0 2024-02-19T19:12:23.362 INFO:tasks.workunit.client.1.smithi125.stdout:4/577: mkdir d0/d7/dad/dc4 0 2024-02-19T19:12:23.362 INFO:tasks.workunit.client.1.smithi125.stdout:4/578: read - d0/d7/d30/d42/d7b/fb7 zero size 2024-02-19T19:12:23.362 INFO:tasks.workunit.client.1.smithi125.stdout:8/642: creat db/d18/d30/d48/db1/fd1 x:0 0 0 2024-02-19T19:12:23.362 INFO:tasks.workunit.client.1.smithi125.stdout:8/643: unlink db/d18/d30/d48/l63 0 2024-02-19T19:12:23.362 INFO:tasks.workunit.client.1.smithi125.stdout:4/579: creat d0/d7/d30/d58/dac/fc5 x:0 0 0 2024-02-19T19:12:23.363 INFO:tasks.workunit.client.1.smithi125.stdout:8/644: mkdir db/d18/d30/dd2 0 2024-02-19T19:12:23.363 INFO:tasks.workunit.client.1.smithi125.stdout:4/580: read d0/d7/d30/d42/f78 [200448,81597] 0 2024-02-19T19:12:23.363 INFO:tasks.workunit.client.1.smithi125.stdout:8/645: dread db/d18/d30/d48/fbc [442368,77824] 0 2024-02-19T19:12:23.363 INFO:tasks.workunit.client.1.smithi125.stdout:8/646: dread db/d18/d30/d3c/d4d/f61 [241664,106496] 0 2024-02-19T19:12:23.363 INFO:tasks.workunit.client.1.smithi125.stdout:8/647: symlink db/d18/d2f/d3f/ld3 0 2024-02-19T19:12:23.363 INFO:tasks.workunit.client.1.smithi125.stdout:8/648: symlink db/d18/d2f/d99/ld4 0 2024-02-19T19:12:23.364 INFO:tasks.workunit.client.1.smithi125.stdout:2/654: dwrite d1/d27/d1d/d16/fa9 [573440,122880] 0 2024-02-19T19:12:23.364 INFO:tasks.workunit.client.1.smithi125.stdout:8/649: dwrite db/d18/d30/d3c/d4d/d5d/da2/dae/fbe [348160,126976] 0 2024-02-19T19:12:23.378 INFO:tasks.workunit.client.1.smithi125.stdout:4/581: truncate d0/d7/d30/d58/f79 917393 0 2024-02-19T19:12:23.536 INFO:tasks.workunit.client.1.smithi125.stdout:4/582: fdatasync d0/df/f9f 0 2024-02-19T19:12:23.536 INFO:tasks.workunit.client.1.smithi125.stdout:4/583: creat d0/d7/d30/d58/dac/fc6 x:0 0 0 2024-02-19T19:12:23.536 INFO:tasks.workunit.client.1.smithi125.stdout:4/584: chown d0/cb2 3427146 1 2024-02-19T19:12:23.537 INFO:tasks.workunit.client.1.smithi125.stdout:4/585: chown d0/d7/d3b 520492 1 2024-02-19T19:12:23.537 INFO:tasks.workunit.client.1.smithi125.stdout:4/586: dread - d0/d7/d30/d42/f7a zero size 2024-02-19T19:12:23.537 INFO:tasks.workunit.client.1.smithi125.stdout:4/587: dread d0/d7/d30/d58/f24 [212992,24576] 0 2024-02-19T19:12:23.537 INFO:tasks.workunit.client.1.smithi125.stdout:8/650: dwrite db/d18/d2f/d3f/f75 [1736704,81920] 0 2024-02-19T19:12:23.537 INFO:tasks.workunit.client.1.smithi125.stdout:8/651: read db/f1e [1049470,82510] 0 2024-02-19T19:12:23.537 INFO:tasks.workunit.client.1.smithi125.stdout:8/652: readlink db/d18/d30/d48/l7d 0 2024-02-19T19:12:23.538 INFO:tasks.workunit.client.1.smithi125.stdout:8/653: link db/d6d/faf db/d18/d30/d48/d67/d96/fd5 0 2024-02-19T19:12:23.539 INFO:tasks.workunit.client.1.smithi125.stdout:4/588: dwrite d0/d7/dad/dbe/fc1 [364544,94208] 0 2024-02-19T19:12:23.581 INFO:tasks.workunit.client.1.smithi125.stdout:8/654: fdatasync db/d6d/fa7 0 2024-02-19T19:12:23.581 INFO:tasks.workunit.client.1.smithi125.stdout:8/655: chown db/d18/d30/d48/d67/d96 212015 1 2024-02-19T19:12:23.581 INFO:tasks.workunit.client.1.smithi125.stdout:8/656: chown db/d18/d30/d80/d9e/da3/faa 11620 1 2024-02-19T19:12:23.581 INFO:tasks.workunit.client.1.smithi125.stdout:8/657: creat db/d6d/fd6 x:0 0 0 2024-02-19T19:12:23.582 INFO:tasks.workunit.client.1.smithi125.stdout:8/658: rename db/d18/d30/d48/f6c to db/d18/d30/d48/d67/d96/fd7 0 2024-02-19T19:12:23.582 INFO:tasks.workunit.client.1.smithi125.stdout:8/659: mkdir db/d18/d30/d48/dd8 0 2024-02-19T19:12:23.582 INFO:tasks.workunit.client.1.smithi125.stdout:8/660: read - db/d18/d30/d3c/d4d/d5d/f64 zero size 2024-02-19T19:12:23.582 INFO:tasks.workunit.client.1.smithi125.stdout:8/661: chown db/d18/d30/d80/dac/fbb 2 1 2024-02-19T19:12:23.582 INFO:tasks.workunit.client.1.smithi125.stdout:8/662: write db/d18/d2f/d3f/fad [661030,39456] 0 2024-02-19T19:12:23.582 INFO:tasks.workunit.client.1.smithi125.stdout:8/663: dread db/d18/d30/d48/f5c [114688,8192] 0 2024-02-19T19:12:23.584 INFO:tasks.workunit.client.1.smithi125.stdout:8/664: rename db/d81/d95/dc5 to db/d18/d30/d48/dd8/dd9 0 2024-02-19T19:12:23.584 INFO:tasks.workunit.client.1.smithi125.stdout:8/665: dread db/d18/d30/d48/d67/d96/fd7 [430080,81920] 0 2024-02-19T19:12:23.584 INFO:tasks.workunit.client.1.smithi125.stdout:8/666: truncate db/f6b 1052953 0 2024-02-19T19:12:23.584 INFO:tasks.workunit.client.1.smithi125.stdout:8/667: symlink db/d18/d2f/d99/lda 0 2024-02-19T19:12:23.585 INFO:tasks.workunit.client.1.smithi125.stdout:8/668: dwrite db/d18/d30/d80/f97 [512000,32768] 0 2024-02-19T19:12:23.589 INFO:tasks.workunit.client.1.smithi125.stdout:8/669: dwrite db/d18/d30/fa9 [405504,102400] 0 2024-02-19T19:12:23.702 INFO:tasks.workunit.client.1.smithi125.stdout:7/632: sync 2024-02-19T19:12:23.702 INFO:tasks.workunit.client.1.smithi125.stdout:8/670: dwrite db/d18/d30/d80/d9e/da3/fcb [229376,8192] 0 2024-02-19T19:12:23.702 INFO:tasks.workunit.client.1.smithi125.stdout:7/633: write d12/d18/d44/d3b/d59/d2a/d6a/f9e [848192,105597] 0 2024-02-19T19:12:23.745 INFO:tasks.workunit.client.1.smithi125.stdout:7/634: dwrite d12/d18/d44/d3b/d59/d26/d30/d97/fa3 [94208,4096] 0 2024-02-19T19:12:23.745 INFO:tasks.workunit.client.1.smithi125.stdout:8/671: dwrite db/d18/d2f/d3f/f7c [376832,106496] 0 2024-02-19T19:12:23.745 INFO:tasks.workunit.client.1.smithi125.stdout:7/635: dread - d12/d18/d63/f9f zero size 2024-02-19T19:12:23.745 INFO:tasks.workunit.client.1.smithi125.stdout:8/672: creat db/d18/d30/d48/db1/fdb x:0 0 0 2024-02-19T19:12:23.745 INFO:tasks.workunit.client.1.smithi125.stdout:7/636: mknod d12/d18/cb6 0 2024-02-19T19:12:23.745 INFO:tasks.workunit.client.1.smithi125.stdout:7/637: dread - d12/d18/d44/d3b/d59/d26/d30/d37/f8a zero size 2024-02-19T19:12:23.746 INFO:tasks.workunit.client.1.smithi125.stdout:8/673: symlink db/d18/d30/d3c/d4d/ldc 0 2024-02-19T19:12:23.746 INFO:tasks.workunit.client.1.smithi125.stdout:7/638: write d12/d3d/f69 [1013183,33225] 0 2024-02-19T19:12:23.746 INFO:tasks.workunit.client.1.smithi125.stdout:7/639: dread d12/d18/d44/d51/f9b [413696,118784] 0 2024-02-19T19:12:23.746 INFO:tasks.workunit.client.1.smithi125.stdout:7/640: getdents d12/d3d 0 2024-02-19T19:12:23.746 INFO:tasks.workunit.client.1.smithi125.stdout:7/641: creat d12/d18/d44/d3b/d59/d26/d54/d8c/d98/fb7 x:0 0 0 2024-02-19T19:12:23.746 INFO:tasks.workunit.client.1.smithi125.stdout:8/674: write db/d81/fc0 [873174,101393] 0 2024-02-19T19:12:23.746 INFO:tasks.workunit.client.1.smithi125.stdout:8/675: creat db/fdd x:0 0 0 2024-02-19T19:12:23.746 INFO:tasks.workunit.client.1.smithi125.stdout:8/676: read - db/d18/d30/d48/db1/fdb zero size 2024-02-19T19:12:23.747 INFO:tasks.workunit.client.1.smithi125.stdout:8/677: chown db/d18/d2f/d3f/l5f 88027261 1 2024-02-19T19:12:23.747 INFO:tasks.workunit.client.1.smithi125.stdout:8/678: rename db/db4 to db/d81/dde 0 2024-02-19T19:12:23.747 INFO:tasks.workunit.client.1.smithi125.stdout:8/679: symlink db/d18/d30/d48/d67/ldf 0 2024-02-19T19:12:23.747 INFO:tasks.workunit.client.1.smithi125.stdout:8/680: symlink db/d18/d30/d48/db9/le0 0 2024-02-19T19:12:23.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:23 smithi096 ceph-mon[112483]: Upgrade: Updating osd.5 2024-02-19T19:12:23.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:23 smithi096 ceph-mon[112483]: Deploying daemon osd.5 on smithi125 2024-02-19T19:12:23.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:23 smithi096 ceph-mon[112483]: pgmap v157: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:12:23.803 INFO:tasks.workunit.client.1.smithi125.stdout:7/642: dwrite d12/d18/d44/d3b/d59/d26/d30/dad/f49 [1097728,110592] 0 2024-02-19T19:12:23.803 INFO:tasks.workunit.client.1.smithi125.stdout:7/643: dread - d12/d18/d2c/d4e/d82/f8f zero size 2024-02-19T19:12:23.803 INFO:tasks.workunit.client.1.smithi125.stdout:7/644: creat d12/d18/d63/fb8 x:0 0 0 2024-02-19T19:12:23.803 INFO:tasks.workunit.client.1.smithi125.stdout:7/645: mknod d12/d18/d44/d3b/d59/d26/d54/d8c/d98/cb9 0 2024-02-19T19:12:23.803 INFO:tasks.workunit.client.1.smithi125.stdout:7/646: chown d12/d18/d44/d3b/d59/d26/d54/l7d 160 1 2024-02-19T19:12:23.803 INFO:tasks.workunit.client.1.smithi125.stdout:7/647: chown d12/d18/d44/d3b/d59/d3e 1218342 1 2024-02-19T19:12:23.803 INFO:tasks.workunit.client.1.smithi125.stdout:7/648: chown d12/d18/d44/d3b/d59/l80 1409 1 2024-02-19T19:12:23.829 INFO:tasks.workunit.client.1.smithi125.stdout:8/681: fsync db/d18/d30/f4f 0 2024-02-19T19:12:23.829 INFO:tasks.workunit.client.1.smithi125.stdout:7/649: dwrite d12/d18/d44/d51/f56 [393216,90112] 0 2024-02-19T19:12:23.833 INFO:tasks.workunit.client.1.smithi125.stdout:7/650: symlink d12/d18/d44/lba 0 2024-02-19T19:12:23.833 INFO:tasks.workunit.client.1.smithi125.stdout:7/651: truncate d12/d18/d2c/d4e/d82/f8f 576472 0 2024-02-19T19:12:23.833 INFO:tasks.workunit.client.1.smithi125.stdout:7/652: write d12/d18/d44/d3b/d59/d26/f87 [1526720,10648] 0 2024-02-19T19:12:23.833 INFO:tasks.workunit.client.1.smithi125.stdout:7/653: read - d12/d18/d44/d3b/d59/d2a/d31/d50/fa1 zero size 2024-02-19T19:12:23.833 INFO:tasks.workunit.client.1.smithi125.stdout:7/654: write d12/d18/d44/d3b/d59/d26/d30/f35 [1831056,75779] 0 2024-02-19T19:12:23.834 INFO:tasks.workunit.client.1.smithi125.stdout:7/655: rmdir d12/d18/d44 39 2024-02-19T19:12:23.834 INFO:tasks.workunit.client.1.smithi125.stdout:7/656: dwrite d12/d18/d2c/d4e/d82/f8f [757760,126976] 0 2024-02-19T19:12:23.920 INFO:tasks.workunit.client.1.smithi125.stdout:7/657: dwrite d12/d18/d2c/d4e/f99 [991232,36864] 0 2024-02-19T19:12:23.920 INFO:tasks.workunit.client.1.smithi125.stdout:7/658: creat d12/d18/d44/d51/fbb x:0 0 0 2024-02-19T19:12:23.920 INFO:tasks.workunit.client.1.smithi125.stdout:7/659: truncate d12/d18/d44/d3b/d59/d2a/d31/d50/fb2 703934 0 2024-02-19T19:12:23.920 INFO:tasks.workunit.client.1.smithi125.stdout:7/660: dread d12/d18/d44/d3b/d59/d26/d54/f5f [225280,40960] 0 2024-02-19T19:12:23.920 INFO:tasks.workunit.client.1.smithi125.stdout:7/661: truncate d12/d18/d44/d3b/d59/d26/d54/d8c/d98/fb7 430103 0 2024-02-19T19:12:23.920 INFO:tasks.workunit.client.1.smithi125.stdout:7/662: creat d12/d18/d44/d3b/d59/d26/d30/fbc x:0 0 0 2024-02-19T19:12:23.920 INFO:tasks.workunit.client.1.smithi125.stdout:7/663: readlink d12/d18/d44/d3b/d59/l80 0 2024-02-19T19:12:23.921 INFO:tasks.workunit.client.1.smithi125.stdout:7/664: mknod d12/d18/d44/d3b/d59/d26/d30/d37/cbd 0 2024-02-19T19:12:23.921 INFO:tasks.workunit.client.1.smithi125.stdout:7/665: read - d12/f7e zero size 2024-02-19T19:12:23.921 INFO:tasks.workunit.client.1.smithi125.stdout:7/666: stat d12/d18/d44/d3b/d59/d2a/d6a/l55 0 2024-02-19T19:12:23.921 INFO:tasks.workunit.client.1.smithi125.stdout:7/667: mkdir d12/d18/dbe 0 2024-02-19T19:12:23.921 INFO:tasks.workunit.client.1.smithi125.stdout:7/668: dread d12/d18/d44/d3b/d59/d26/d30/d37/f3f [1896448,28672] 0 2024-02-19T19:12:23.921 INFO:tasks.workunit.client.1.smithi125.stdout:7/669: write d12/d18/f3c [1388307,98955] 0 2024-02-19T19:12:23.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:23 smithi125 ceph-mon[86115]: Upgrade: Updating osd.5 2024-02-19T19:12:23.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:23 smithi125 ceph-mon[86115]: Deploying daemon osd.5 on smithi125 2024-02-19T19:12:23.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:23 smithi125 ceph-mon[86115]: pgmap v157: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:12:23.957 INFO:tasks.workunit.client.1.smithi125.stdout:0/757: sync 2024-02-19T19:12:23.957 INFO:tasks.workunit.client.1.smithi125.stdout:0/758: readlink d5/d15/d2c/d80/l53 0 2024-02-19T19:12:23.960 INFO:tasks.workunit.client.1.smithi125.stdout:0/759: dwrite d5/d19/d27/d32/f8d [2027520,8192] 0 2024-02-19T19:12:23.963 INFO:tasks.workunit.client.1.smithi125.stdout:2/655: sync 2024-02-19T19:12:23.964 INFO:tasks.workunit.client.1.smithi125.stdout:5/909: sync 2024-02-19T19:12:23.964 INFO:tasks.workunit.client.1.smithi125.stdout:9/794: sync 2024-02-19T19:12:23.964 INFO:tasks.workunit.client.1.smithi125.stdout:9/795: chown d8/d15/d32/d4f/d6e/f8f 16709512 1 2024-02-19T19:12:23.964 INFO:tasks.workunit.client.1.smithi125.stdout:3/584: sync 2024-02-19T19:12:23.964 INFO:tasks.workunit.client.1.smithi125.stdout:6/848: sync 2024-02-19T19:12:23.964 INFO:tasks.workunit.client.1.smithi125.stdout:2/656: truncate d1/d27/d1d/d2c/d2e/fb2 53149 0 2024-02-19T19:12:23.964 INFO:tasks.workunit.client.1.smithi125.stdout:1/858: sync 2024-02-19T19:12:23.964 INFO:tasks.workunit.client.1.smithi125.stdout:4/589: sync 2024-02-19T19:12:23.965 INFO:tasks.workunit.client.1.smithi125.stdout:2/657: chown d1/d27/d1d/da8/f80 4627 1 2024-02-19T19:12:23.965 INFO:tasks.workunit.client.1.smithi125.stdout:4/590: read d0/d7/d3b/f81 [335206,102510] 0 2024-02-19T19:12:23.965 INFO:tasks.workunit.client.1.smithi125.stdout:0/760: creat d5/d33/d42/d92/da5/f10b x:0 0 0 2024-02-19T19:12:23.965 INFO:tasks.workunit.client.1.smithi125.stdout:4/591: getdents d0/df 0 2024-02-19T19:12:23.965 INFO:tasks.workunit.client.1.smithi125.stdout:9/796: mkdir d8/d15/d22/d4e/d6b/d111 0 2024-02-19T19:12:23.965 INFO:tasks.workunit.client.1.smithi125.stdout:2/658: unlink d1/d27/f82 0 2024-02-19T19:12:23.965 INFO:tasks.workunit.client.1.smithi125.stdout:2/659: chown d1/d27/f5a 272 1 2024-02-19T19:12:23.965 INFO:tasks.workunit.client.1.smithi125.stdout:2/660: stat d1/d27/d45/d7a 0 2024-02-19T19:12:23.966 INFO:tasks.workunit.client.1.smithi125.stdout:9/797: mkdir d8/d2e/d4c/d96/d112 0 2024-02-19T19:12:23.966 INFO:tasks.workunit.client.1.smithi125.stdout:2/661: mknod d1/d36/dc0/cc4 0 2024-02-19T19:12:23.966 INFO:tasks.workunit.client.1.smithi125.stdout:2/662: mkdir d1/d27/d1d/d25/da0/dc3/dc5 0 2024-02-19T19:12:23.966 INFO:tasks.workunit.client.1.smithi125.stdout:0/761: write d5/d9/f26 [119046,87967] 0 2024-02-19T19:12:23.966 INFO:tasks.workunit.client.1.smithi125.stdout:2/663: dread d1/d27/f5a [40960,94208] 0 2024-02-19T19:12:23.966 INFO:tasks.workunit.client.1.smithi125.stdout:0/762: rename d5/d1a/d95 to d5/d33/d10c 0 2024-02-19T19:12:24.057 INFO:tasks.workunit.client.1.smithi125.stdout:6/849: fsync d6/db/d5d/d2f/d45/dd9/f51 0 2024-02-19T19:12:24.057 INFO:tasks.workunit.client.1.smithi125.stdout:6/850: symlink d6/db/d5d/d93/da2/l119 0 2024-02-19T19:12:24.057 INFO:tasks.workunit.client.1.smithi125.stdout:6/851: symlink d6/db/d5d/d2f/d45/dd9/d3b/dda/daf/l11a 0 2024-02-19T19:12:24.057 INFO:tasks.workunit.client.1.smithi125.stdout:1/859: fdatasync d1/d26/d3c/fbc 0 2024-02-19T19:12:24.057 INFO:tasks.workunit.client.1.smithi125.stdout:0/763: fdatasync d5/d15/f8a 0 2024-02-19T19:12:24.057 INFO:tasks.workunit.client.1.smithi125.stdout:6/852: chown d6/db/d5d/d29/d68/c80 7 1 2024-02-19T19:12:24.057 INFO:tasks.workunit.client.1.smithi125.stdout:9/798: fdatasync d8/d15/f61 0 2024-02-19T19:12:24.057 INFO:tasks.workunit.client.1.smithi125.stdout:9/799: dread - d8/d15/d32/f110 zero size 2024-02-19T19:12:24.058 INFO:tasks.workunit.client.1.smithi125.stdout:9/800: dread - d8/d15/f100 zero size 2024-02-19T19:12:24.058 INFO:tasks.workunit.client.1.smithi125.stdout:0/764: unlink d5/d19/d27/d32/d109/db3/dd4/dfb/d106/lb6 0 2024-02-19T19:12:24.058 INFO:tasks.workunit.client.1.smithi125.stdout:1/860: truncate d1/d78/d8a/fab 75360 0 2024-02-19T19:12:24.061 INFO:tasks.workunit.client.1.smithi125.stdout:4/592: dwrite d0/d7/dad/dbe/fc1 [49152,65536] 0 2024-02-19T19:12:24.061 INFO:tasks.workunit.client.1.smithi125.stdout:4/593: unlink d0/df/d5e/cae 0 2024-02-19T19:12:24.061 INFO:tasks.workunit.client.1.smithi125.stdout:5/910: dwrite db/d17/d58/d33/d53/dce/fd0 [311296,4096] 0 2024-02-19T19:12:24.061 INFO:tasks.workunit.client.1.smithi125.stdout:5/911: getdents db/d17/d58/d4f/dad 0 2024-02-19T19:12:24.061 INFO:tasks.workunit.client.1.smithi125.stdout:5/912: symlink db/d17/d58/d33/d53/l120 0 2024-02-19T19:12:24.061 INFO:tasks.workunit.client.1.smithi125.stdout:5/913: rename db/d17/d58/d33/d98/d9c/l119 to db/l121 0 2024-02-19T19:12:24.061 INFO:tasks.workunit.client.1.smithi125.stdout:5/914: creat db/f122 x:0 0 0 2024-02-19T19:12:24.062 INFO:tasks.workunit.client.1.smithi125.stdout:5/915: readlink db/d17/d58/l14 0 2024-02-19T19:12:24.062 INFO:tasks.workunit.client.1.smithi125.stdout:5/916: rename db/d17/d58/d33/d64/c67 to db/d26/c123 0 2024-02-19T19:12:24.062 INFO:tasks.workunit.client.1.smithi125.stdout:5/917: read db/d26/d51/f7c [246888,98512] 0 2024-02-19T19:12:24.062 INFO:tasks.workunit.client.1.smithi125.stdout:5/918: link db/d17/d58/ce9 db/d17/d58/d25/c124 0 2024-02-19T19:12:24.062 INFO:tasks.workunit.client.1.smithi125.stdout:5/919: dread db/d17/d58/f72 [1359872,36864] 0 2024-02-19T19:12:24.062 INFO:tasks.workunit.client.1.smithi125.stdout:6/853: dwrite d6/db/d5d/d2f/d45/dd9/f54 [966656,32768] 0 2024-02-19T19:12:24.062 INFO:tasks.workunit.client.1.smithi125.stdout:5/920: symlink db/d17/d85/dda/l125 0 2024-02-19T19:12:24.062 INFO:tasks.workunit.client.1.smithi125.stdout:6/854: truncate d6/db/d5d/d2f/d7b/d8d/fdf 368489 0 2024-02-19T19:12:24.063 INFO:tasks.workunit.client.1.smithi125.stdout:6/855: creat d6/f11b x:0 0 0 2024-02-19T19:12:24.063 INFO:tasks.workunit.client.1.smithi125.stdout:6/856: rename d6/db/d5d/d2f/d45/dd9/d3b/dda/daf to d6/db/d5d/d2f/d45/dd9/d16/d11c 0 2024-02-19T19:12:24.063 INFO:tasks.workunit.client.1.smithi125.stdout:9/801: dwrite d8/d15/d22/de0/ffe [696320,118784] 0 2024-02-19T19:12:24.063 INFO:tasks.workunit.client.1.smithi125.stdout:9/802: dread - d8/d15/d22/d4e/f54 zero size 2024-02-19T19:12:24.063 INFO:tasks.workunit.client.1.smithi125.stdout:9/803: truncate d8/d15/d22/de0/ffa 511276 0 2024-02-19T19:12:24.063 INFO:tasks.workunit.client.1.smithi125.stdout:1/861: dwrite d1/d26/d23/fc8 [790528,86016] 0 2024-02-19T19:12:24.063 INFO:tasks.workunit.client.1.smithi125.stdout:1/862: rename d1/dc/d36/f93 to d1/d78/f118 0 2024-02-19T19:12:24.063 INFO:tasks.workunit.client.1.smithi125.stdout:1/863: truncate d1/d1a/d3d/d6e/d87/fcd 222834 0 2024-02-19T19:12:24.063 INFO:tasks.workunit.client.1.smithi125.stdout:1/864: unlink d1/d26/d3c/fce 0 2024-02-19T19:12:24.064 INFO:tasks.workunit.client.1.smithi125.stdout:1/865: creat d1/d1a/d3d/d6e/f119 x:0 0 0 2024-02-19T19:12:24.064 INFO:tasks.workunit.client.1.smithi125.stdout:1/866: creat d1/d1a/d3d/dd0/f11a x:0 0 0 2024-02-19T19:12:24.064 INFO:tasks.workunit.client.1.smithi125.stdout:1/867: write d1/d26/d3c/fa8 [575015,94198] 0 2024-02-19T19:12:24.064 INFO:tasks.workunit.client.1.smithi125.stdout:1/868: dread - d1/d1a/d3d/d6e/d4b/fc9 zero size 2024-02-19T19:12:24.123 INFO:tasks.workunit.client.1.smithi125.stdout:0/765: fdatasync d5/d19/d27/fa2 0 2024-02-19T19:12:24.124 INFO:tasks.workunit.client.1.smithi125.stdout:4/594: fsync d0/d7/d30/d58/f9 0 2024-02-19T19:12:24.124 INFO:tasks.workunit.client.1.smithi125.stdout:4/595: mknod d0/d7/dad/cc7 0 2024-02-19T19:12:24.124 INFO:tasks.workunit.client.1.smithi125.stdout:6/857: fsync d6/db/d5d/d2f/d45/dd9/dbb/f110 0 2024-02-19T19:12:24.124 INFO:tasks.workunit.client.1.smithi125.stdout:4/596: truncate d0/d7/d30/d42/fa5 159380 0 2024-02-19T19:12:24.124 INFO:tasks.workunit.client.1.smithi125.stdout:6/858: mkdir d6/db/da7/d11d 0 2024-02-19T19:12:24.124 INFO:tasks.workunit.client.1.smithi125.stdout:4/597: creat d0/d7/dad/fc8 x:0 0 0 2024-02-19T19:12:24.124 INFO:tasks.workunit.client.1.smithi125.stdout:4/598: symlink d0/d7/lc9 0 2024-02-19T19:12:24.128 INFO:tasks.workunit.client.1.smithi125.stdout:5/921: dread db/d47/f7e [1044480,114688] 0 2024-02-19T19:12:24.133 INFO:tasks.workunit.client.1.smithi125.stdout:6/859: creat d6/db/d5d/d2f/d45/dd9/d16/d11c/f11e x:0 0 0 2024-02-19T19:12:24.133 INFO:tasks.workunit.client.1.smithi125.stdout:9/804: dwrite d8/d2e/d4c/fe9 [274432,49152] 0 2024-02-19T19:12:24.133 INFO:tasks.workunit.client.1.smithi125.stdout:1/869: dwrite d1/d1a/d3d/d6e/d4b/f6a [462848,122880] 0 2024-02-19T19:12:24.133 INFO:tasks.workunit.client.1.smithi125.stdout:0/766: dwrite d5/d33/d9b/fef [802816,118784] 0 2024-02-19T19:12:24.133 INFO:tasks.workunit.client.1.smithi125.stdout:5/922: mkdir db/d126 0 2024-02-19T19:12:24.133 INFO:tasks.workunit.client.1.smithi125.stdout:0/767: dread d5/d33/f8b [184320,32768] 0 2024-02-19T19:12:24.133 INFO:tasks.workunit.client.1.smithi125.stdout:9/805: write d8/d15/d32/d4f/d6e/f8d [1080023,14302] 0 2024-02-19T19:12:24.133 INFO:tasks.workunit.client.1.smithi125.stdout:5/923: creat db/d17/d58/d33/d64/f127 x:0 0 0 2024-02-19T19:12:24.134 INFO:tasks.workunit.client.1.smithi125.stdout:6/860: write d6/db/d5d/fa9 [102899,33267] 0 2024-02-19T19:12:24.134 INFO:tasks.workunit.client.1.smithi125.stdout:1/870: symlink d1/da3/l11b 0 2024-02-19T19:12:24.134 INFO:tasks.workunit.client.1.smithi125.stdout:5/924: dread - db/d17/d58/d33/d53/f8f zero size 2024-02-19T19:12:24.134 INFO:tasks.workunit.client.1.smithi125.stdout:1/871: chown d1/d1a/d3d/d6e/d87/cf2 19 1 2024-02-19T19:12:24.134 INFO:tasks.workunit.client.1.smithi125.stdout:5/925: creat db/d17/d58/f128 x:0 0 0 2024-02-19T19:12:24.134 INFO:tasks.workunit.client.1.smithi125.stdout:6/861: creat d6/db/d5d/d2f/d45/dd9/d3b/dcc/df4/f11f x:0 0 0 2024-02-19T19:12:24.134 INFO:tasks.workunit.client.1.smithi125.stdout:5/926: getdents db/d17/d58/d33/d98/dae/dfd/d5d 0 2024-02-19T19:12:24.134 INFO:tasks.workunit.client.1.smithi125.stdout:5/927: truncate db/d17/d58/f37 1591103 0 2024-02-19T19:12:24.135 INFO:tasks.workunit.client.1.smithi125.stdout:6/862: creat d6/db/d5d/d2f/d45/dd9/d3b/dda/f120 x:0 0 0 2024-02-19T19:12:24.135 INFO:tasks.workunit.client.1.smithi125.stdout:5/928: write db/d17/f45 [211409,24219] 0 2024-02-19T19:12:24.135 INFO:tasks.workunit.client.1.smithi125.stdout:6/863: creat d6/db/d5d/d63/f121 x:0 0 0 2024-02-19T19:12:24.135 INFO:tasks.workunit.client.1.smithi125.stdout:5/929: creat db/d17/d106/f129 x:0 0 0 2024-02-19T19:12:24.135 INFO:tasks.workunit.client.1.smithi125.stdout:8/682: sync 2024-02-19T19:12:24.135 INFO:tasks.workunit.client.1.smithi125.stdout:8/683: chown db/d18/d30/d3c/ld0 21226 1 2024-02-19T19:12:24.135 INFO:tasks.workunit.client.1.smithi125.stdout:4/599: dwrite d0/d7/dad/dbe/fc1 [978944,45056] 0 2024-02-19T19:12:24.135 INFO:tasks.workunit.client.1.smithi125.stdout:4/600: mknod d0/d7/d30/cca 0 2024-02-19T19:12:24.224 INFO:tasks.workunit.client.1.smithi125.stdout:0/768: dwrite d5/d19/d27/f5c [1265664,73728] 0 2024-02-19T19:12:24.224 INFO:tasks.workunit.client.1.smithi125.stdout:0/769: symlink d5/d19/d2b/db7/l10d 0 2024-02-19T19:12:24.229 INFO:tasks.workunit.client.1.smithi125.stdout:8/684: dwrite db/d18/d30/d48/d67/d96/fd5 [126976,12288] 0 2024-02-19T19:12:24.229 INFO:tasks.workunit.client.1.smithi125.stdout:8/685: link db/d18/d2f/d72/c7b db/d18/d2f/d3f/ce1 0 2024-02-19T19:12:24.229 INFO:tasks.workunit.client.1.smithi125.stdout:8/686: creat db/d18/d30/d80/d9e/fe2 x:0 0 0 2024-02-19T19:12:24.229 INFO:tasks.workunit.client.1.smithi125.stdout:8/687: unlink db/d18/d30/d3c/d4d/lce 0 2024-02-19T19:12:24.229 INFO:tasks.workunit.client.1.smithi125.stdout:8/688: truncate db/d6d/faf 468881 0 2024-02-19T19:12:24.230 INFO:tasks.workunit.client.1.smithi125.stdout:8/689: dread db/d18/d30/d80/d9e/da3/fc1 [851968,12288] 0 2024-02-19T19:12:24.230 INFO:tasks.workunit.client.1.smithi125.stdout:1/872: dwrite d1/d26/d3c/fa8 [712704,126976] 0 2024-02-19T19:12:24.230 INFO:tasks.workunit.client.1.smithi125.stdout:1/873: mknod d1/d1a/c11c 0 2024-02-19T19:12:24.230 INFO:tasks.workunit.client.1.smithi125.stdout:9/806: dwrite d8/d2e/f45 [585728,12288] 0 2024-02-19T19:12:24.230 INFO:tasks.workunit.client.1.smithi125.stdout:1/874: readlink d1/d26/l8c 0 2024-02-19T19:12:24.230 INFO:tasks.workunit.client.1.smithi125.stdout:1/875: dread d1/d78/d8a/fab [45056,32768] 0 2024-02-19T19:12:24.230 INFO:tasks.workunit.client.1.smithi125.stdout:9/807: creat d8/d15/d9d/f113 x:0 0 0 2024-02-19T19:12:24.230 INFO:tasks.workunit.client.1.smithi125.stdout:9/808: readlink d8/d15/d22/l93 0 2024-02-19T19:12:24.231 INFO:tasks.workunit.client.1.smithi125.stdout:1/876: write d1/d26/d3c/fa8 [1453520,34693] 0 2024-02-19T19:12:24.231 INFO:tasks.workunit.client.1.smithi125.stdout:9/809: rename d8/l42 to d8/d15/da2/l114 0 2024-02-19T19:12:24.231 INFO:tasks.workunit.client.1.smithi125.stdout:9/810: readlink d8/d2e/d4c/l77 0 2024-02-19T19:12:24.231 INFO:tasks.workunit.client.1.smithi125.stdout:9/811: creat d8/d15/d22/de0/f115 x:0 0 0 2024-02-19T19:12:24.231 INFO:tasks.workunit.client.1.smithi125.stdout:1/877: write d1/d1a/d3d/de2/f112 [1038118,12348] 0 2024-02-19T19:12:24.231 INFO:tasks.workunit.client.1.smithi125.stdout:9/812: creat d8/d15/d22/f116 x:0 0 0 2024-02-19T19:12:24.231 INFO:tasks.workunit.client.1.smithi125.stdout:4/601: dwrite d0/d7/dad/dbe/fc1 [233472,65536] 0 2024-02-19T19:12:24.231 INFO:tasks.workunit.client.1.smithi125.stdout:4/602: write d0/d7/d30/d58/f79 [1780158,18393] 0 2024-02-19T19:12:24.231 INFO:tasks.workunit.client.1.smithi125.stdout:4/603: dread - d0/fba zero size 2024-02-19T19:12:24.232 INFO:tasks.workunit.client.1.smithi125.stdout:4/604: creat d0/d32/fcb x:0 0 0 2024-02-19T19:12:24.232 INFO:tasks.workunit.client.1.smithi125.stdout:4/605: symlink d0/lcc 0 2024-02-19T19:12:24.232 INFO:tasks.workunit.client.1.smithi125.stdout:4/606: mkdir d0/d7/d30/d6c/dcd 0 2024-02-19T19:12:24.232 INFO:tasks.workunit.client.1.smithi125.stdout:4/607: creat d0/d7/fce x:0 0 0 2024-02-19T19:12:24.232 INFO:tasks.workunit.client.1.smithi125.stdout:4/608: readlink d0/d7/lc9 0 2024-02-19T19:12:24.232 INFO:tasks.workunit.client.1.smithi125.stdout:4/609: chown d0/d7/d30/d42/f78 141641547 1 2024-02-19T19:12:24.232 INFO:tasks.workunit.client.1.smithi125.stdout:4/610: symlink d0/d7/d30/d42/db3/lcf 0 2024-02-19T19:12:24.232 INFO:tasks.workunit.client.1.smithi125.stdout:4/611: creat d0/d7/d30/fd0 x:0 0 0 2024-02-19T19:12:24.233 INFO:tasks.workunit.client.1.smithi125.stdout:4/612: getdents d0/d7/d30/d42/db3 0 2024-02-19T19:12:24.233 INFO:tasks.workunit.client.1.smithi125.stdout:4/613: write d0/d7/d30/d42/d7b/f99 [1319104,88169] 0 2024-02-19T19:12:24.233 INFO:tasks.workunit.client.1.smithi125.stdout:0/770: dwrite d5/d15/f5b [131072,53248] 0 2024-02-19T19:12:24.243 INFO:tasks.workunit.client.1.smithi125.stdout:6/864: dread d6/db/d49/fdd [1540096,81920] 0 2024-02-19T19:12:24.243 INFO:tasks.workunit.client.1.smithi125.stdout:6/865: dread - d6/db/d5d/fd8 zero size 2024-02-19T19:12:24.243 INFO:tasks.workunit.client.1.smithi125.stdout:6/866: creat d6/db/d5d/d2f/d45/dd9/f122 x:0 0 0 2024-02-19T19:12:24.243 INFO:tasks.workunit.client.1.smithi125.stdout:6/867: dread d6/db/d5d/d2f/d45/dd9/d3b/dda/fcd [40960,90112] 0 2024-02-19T19:12:24.243 INFO:tasks.workunit.client.1.smithi125.stdout:6/868: dread d6/db/d5d/d2f/d45/dd9/d3b/f5a [1220608,110592] 0 2024-02-19T19:12:24.243 INFO:tasks.workunit.client.1.smithi125.stdout:6/869: getdents d6/db/d49 0 2024-02-19T19:12:24.243 INFO:tasks.workunit.client.1.smithi125.stdout:6/870: rename d6/db/d5d/d2f/d45/d107/ffa to d6/db/d5d/d29/f123 0 2024-02-19T19:12:24.244 INFO:tasks.workunit.client.1.smithi125.stdout:6/871: rename d6/db/d5d/d2f/d7b/d8d/fb5 to d6/db/d5d/d2f/d7b/f124 0 2024-02-19T19:12:24.244 INFO:tasks.workunit.client.1.smithi125.stdout:6/872: symlink d6/db/d5d/l125 0 2024-02-19T19:12:24.244 INFO:tasks.workunit.client.1.smithi125.stdout:6/873: chown d6/db/d5d/d2f/d45/dd9/d3b/de1 56808 1 2024-02-19T19:12:24.244 INFO:tasks.workunit.client.1.smithi125.stdout:6/874: mkdir d6/db/d5d/d2f/d45/dd9/d3b/de1/d126 0 2024-02-19T19:12:24.249 INFO:tasks.workunit.client.1.smithi125.stdout:5/930: dread db/f75 [24576,110592] 0 2024-02-19T19:12:24.249 INFO:tasks.workunit.client.1.smithi125.stdout:5/931: chown db/lc 2358 1 2024-02-19T19:12:24.309 INFO:tasks.workunit.client.1.smithi125.stdout:8/690: fsync db/d18/d30/d48/f5c 0 2024-02-19T19:12:24.309 INFO:tasks.workunit.client.1.smithi125.stdout:5/932: fdatasync db/d17/d58/d33/d98/fab 0 2024-02-19T19:12:24.309 INFO:tasks.workunit.client.1.smithi125.stdout:8/691: dread db/f1e [425984,24576] 0 2024-02-19T19:12:24.309 INFO:tasks.workunit.client.1.smithi125.stdout:5/933: truncate db/d17/f1e 338798 0 2024-02-19T19:12:24.309 INFO:tasks.workunit.client.1.smithi125.stdout:8/692: readlink db/d18/d2f/d99/ld4 0 2024-02-19T19:12:24.315 INFO:tasks.workunit.client.1.smithi125.stdout:4/614: dwrite d0/d32/f8b [528384,28672] 0 2024-02-19T19:12:24.315 INFO:tasks.workunit.client.1.smithi125.stdout:9/813: dwrite d8/d15/d22/d44/f89 [2043904,20480] 0 2024-02-19T19:12:24.316 INFO:tasks.workunit.client.1.smithi125.stdout:6/875: dwrite d6/db/d5d/d2f/d45/d4e/d6b/fe4 [569344,94208] 0 2024-02-19T19:12:24.316 INFO:tasks.workunit.client.1.smithi125.stdout:5/934: link db/d17/f55 db/d17/d58/d33/d98/d9c/ddc/f12a 0 2024-02-19T19:12:24.316 INFO:tasks.workunit.client.1.smithi125.stdout:1/878: dwrite d1/d26/d23/f96 [8192,126976] 0 2024-02-19T19:12:24.316 INFO:tasks.workunit.client.1.smithi125.stdout:9/814: symlink d8/d2e/l117 0 2024-02-19T19:12:24.316 INFO:tasks.workunit.client.1.smithi125.stdout:6/876: write d6/f9 [803054,48513] 0 2024-02-19T19:12:24.316 INFO:tasks.workunit.client.1.smithi125.stdout:4/615: dread d0/d7/d30/d58/f29 [61440,86016] 0 2024-02-19T19:12:24.316 INFO:tasks.workunit.client.1.smithi125.stdout:9/815: symlink d8/d15/d22/d44/l118 0 2024-02-19T19:12:24.316 INFO:tasks.workunit.client.1.smithi125.stdout:5/935: write db/d17/d58/d33/d98/d9c/ddc/f11d [464360,88206] 0 2024-02-19T19:12:24.316 INFO:tasks.workunit.client.1.smithi125.stdout:4/616: truncate d0/f40 696097 0 2024-02-19T19:12:24.317 INFO:tasks.workunit.client.1.smithi125.stdout:9/816: chown d8/d15/d22/fb6 5 1 2024-02-19T19:12:24.317 INFO:tasks.workunit.client.1.smithi125.stdout:1/879: symlink d1/d1a/d3d/l11d 0 2024-02-19T19:12:24.317 INFO:tasks.workunit.client.1.smithi125.stdout:5/936: link db/d17/l103 db/d17/d85/l12b 0 2024-02-19T19:12:24.317 INFO:tasks.workunit.client.1.smithi125.stdout:9/817: creat d8/d15/d10d/f119 x:0 0 0 2024-02-19T19:12:24.323 INFO:tasks.workunit.client.1.smithi125.stdout:0/771: write d5/d1a/f20 [142002,44215] 0 2024-02-19T19:12:24.323 INFO:tasks.workunit.client.1.smithi125.stdout:0/772: rmdir d5/d33/d42 39 2024-02-19T19:12:24.408 INFO:tasks.workunit.client.1.smithi125.stdout:0/773: dwrite d5/d33/d46/f6a [294912,65536] 0 2024-02-19T19:12:24.408 INFO:tasks.workunit.client.1.smithi125.stdout:1/880: mknod d1/d26/d23/d106/de9/d117/c11e 0 2024-02-19T19:12:24.409 INFO:tasks.workunit.client.1.smithi125.stdout:4/617: mkdir d0/d7/d76/dd1 0 2024-02-19T19:12:24.409 INFO:tasks.workunit.client.1.smithi125.stdout:9/818: symlink d8/d15/da2/l11a 0 2024-02-19T19:12:24.409 INFO:tasks.workunit.client.1.smithi125.stdout:1/881: creat d1/da3/f11f x:0 0 0 2024-02-19T19:12:24.409 INFO:tasks.workunit.client.1.smithi125.stdout:4/618: creat d0/d7/fd2 x:0 0 0 2024-02-19T19:12:24.409 INFO:tasks.workunit.client.1.smithi125.stdout:4/619: mkdir d0/d7/dd3 0 2024-02-19T19:12:24.452 INFO:tasks.workunit.client.1.smithi125.stdout:4/620: dwrite d0/df/fa7 [663552,16384] 0 2024-02-19T19:12:24.452 INFO:tasks.workunit.client.1.smithi125.stdout:4/621: creat d0/d7/d76/dd1/fd4 x:0 0 0 2024-02-19T19:12:24.452 INFO:tasks.workunit.client.1.smithi125.stdout:4/622: unlink d0/d7/d30/d6c/c8a 0 2024-02-19T19:12:24.452 INFO:tasks.workunit.client.1.smithi125.stdout:4/623: stat d0/c48 0 2024-02-19T19:12:24.453 INFO:tasks.workunit.client.1.smithi125.stdout:4/624: dread d0/d7/f2f [204800,77824] 0 2024-02-19T19:12:24.453 INFO:tasks.workunit.client.1.smithi125.stdout:4/625: write d0/d7/d30/d42/d7b/f99 [1531228,45810] 0 2024-02-19T19:12:24.453 INFO:tasks.workunit.client.1.smithi125.stdout:4/626: mknod d0/d7/d30/d42/cd5 0 2024-02-19T19:12:24.453 INFO:tasks.workunit.client.1.smithi125.stdout:5/937: mkdir db/d17/d58/d33/d98/d9c/d12c 0 2024-02-19T19:12:24.453 INFO:tasks.workunit.client.1.smithi125.stdout:5/938: rename db/d17/f55 to db/d17/d58/d33/d64/df1/f12d 0 2024-02-19T19:12:24.453 INFO:tasks.workunit.client.1.smithi125.stdout:1/882: creat d1/d78/f120 x:0 0 0 2024-02-19T19:12:24.453 INFO:tasks.workunit.client.1.smithi125.stdout:5/939: unlink db/d26/d51/l5c 0 2024-02-19T19:12:24.453 INFO:tasks.workunit.client.1.smithi125.stdout:1/883: symlink d1/d78/d8a/l121 0 2024-02-19T19:12:24.454 INFO:tasks.workunit.client.1.smithi125.stdout:1/884: dread d1/dc/f72 [425984,98304] 0 2024-02-19T19:12:24.454 INFO:tasks.workunit.client.1.smithi125.stdout:1/885: chown d1/d1a/f2e 0 1 2024-02-19T19:12:24.454 INFO:tasks.workunit.client.1.smithi125.stdout:5/940: write db/d17/d58/d33/f80 [329247,84157] 0 2024-02-19T19:12:24.454 INFO:tasks.workunit.client.1.smithi125.stdout:1/886: rmdir d1/dc/d36/d69 39 2024-02-19T19:12:24.454 INFO:tasks.workunit.client.1.smithi125.stdout:1/887: creat d1/d26/d23/d106/de9/f122 x:0 0 0 2024-02-19T19:12:24.454 INFO:tasks.workunit.client.1.smithi125.stdout:1/888: getdents d1/da3 0 2024-02-19T19:12:24.454 INFO:tasks.workunit.client.1.smithi125.stdout:1/889: chown d1/dc/d36/d39/fa1 1829 1 2024-02-19T19:12:24.454 INFO:tasks.workunit.client.1.smithi125.stdout:1/890: symlink d1/d1a/dd3/l123 0 2024-02-19T19:12:24.454 INFO:tasks.workunit.client.1.smithi125.stdout:1/891: chown d1/d78/d80/l7b 7 1 2024-02-19T19:12:24.455 INFO:tasks.workunit.client.1.smithi125.stdout:1/892: truncate d1/d78/d80/fb1 1625874 0 2024-02-19T19:12:24.455 INFO:tasks.workunit.client.1.smithi125.stdout:0/774: symlink d5/d33/d42/d92/da5/l10e 0 2024-02-19T19:12:24.455 INFO:tasks.workunit.client.1.smithi125.stdout:1/893: dread d1/faa [712704,69632] 0 2024-02-19T19:12:24.455 INFO:tasks.workunit.client.1.smithi125.stdout:0/775: chown d5/d9/f108 1 1 2024-02-19T19:12:24.455 INFO:tasks.workunit.client.1.smithi125.stdout:0/776: link d5/d19/d2b/db7/f10a d5/d19/d2b/f10f 0 2024-02-19T19:12:24.455 INFO:tasks.workunit.client.1.smithi125.stdout:1/894: symlink d1/d1a/d3d/de2/l124 0 2024-02-19T19:12:24.455 INFO:tasks.workunit.client.1.smithi125.stdout:0/777: creat d5/d19/d2b/f110 x:0 0 0 2024-02-19T19:12:24.455 INFO:tasks.workunit.client.1.smithi125.stdout:1/895: creat d1/d26/f125 x:0 0 0 2024-02-19T19:12:24.455 INFO:tasks.workunit.client.1.smithi125.stdout:4/627: dwrite d0/d7/d30/d42/d7b/fb7 [643072,16384] 0 2024-02-19T19:12:24.456 INFO:tasks.workunit.client.1.smithi125.stdout:4/628: chown d0/d7/d30/d58/lc3 133 1 2024-02-19T19:12:24.456 INFO:tasks.workunit.client.1.smithi125.stdout:4/629: creat d0/d7/d76/dd1/fd6 x:0 0 0 2024-02-19T19:12:24.456 INFO:tasks.workunit.client.1.smithi125.stdout:4/630: symlink d0/d7/dd3/ld7 0 2024-02-19T19:12:24.456 INFO:tasks.workunit.client.1.smithi125.stdout:4/631: chown d0/d7/d30/d58/f6e 965 1 2024-02-19T19:12:24.456 INFO:tasks.workunit.client.1.smithi125.stdout:1/896: dwrite d1/f45 [1339392,94208] 0 2024-02-19T19:12:24.456 INFO:tasks.workunit.client.1.smithi125.stdout:1/897: creat d1/d1a/d3d/de2/f126 x:0 0 0 2024-02-19T19:12:24.456 INFO:tasks.workunit.client.1.smithi125.stdout:1/898: creat d1/d1a/d3d/d6e/d4b/f127 x:0 0 0 2024-02-19T19:12:24.515 INFO:tasks.workunit.client.1.smithi125.stdout:9/819: fdatasync d8/d15/d22/d44/f92 0 2024-02-19T19:12:24.515 INFO:tasks.workunit.client.1.smithi125.stdout:9/820: dread - d8/d15/d32/f110 zero size 2024-02-19T19:12:24.515 INFO:tasks.workunit.client.1.smithi125.stdout:9/821: read - d8/d15/d32/d4f/d6e/df0/ff1 zero size 2024-02-19T19:12:24.515 INFO:tasks.workunit.client.1.smithi125.stdout:9/822: stat d8/d15/d22/d4e/d90/f9a 0 2024-02-19T19:12:24.516 INFO:tasks.workunit.client.1.smithi125.stdout:0/778: fdatasync d5/d33/d46/f4b 0 2024-02-19T19:12:24.516 INFO:tasks.workunit.client.1.smithi125.stdout:5/941: fdatasync db/d17/d58/d33/d98/d9c/fc4 0 2024-02-19T19:12:24.517 INFO:tasks.workunit.client.1.smithi125.stdout:1/899: readlink d1/d1a/d3d/d6e/d87/lfe 0 2024-02-19T19:12:24.517 INFO:tasks.workunit.client.1.smithi125.stdout:9/823: getdents d8/d2e/d4c/d84/d10c 0 2024-02-19T19:12:24.517 INFO:tasks.workunit.client.1.smithi125.stdout:1/900: rename d1/dc/f2c to d1/d1a/dd3/f128 0 2024-02-19T19:12:24.517 INFO:tasks.workunit.client.1.smithi125.stdout:5/942: symlink db/d47/l12e 0 2024-02-19T19:12:24.517 INFO:tasks.workunit.client.1.smithi125.stdout:5/943: symlink db/d17/d58/d33/l12f 0 2024-02-19T19:12:24.517 INFO:tasks.workunit.client.1.smithi125.stdout:5/944: dread - db/d17/fdd zero size 2024-02-19T19:12:24.518 INFO:tasks.workunit.client.1.smithi125.stdout:5/945: chown db/d17/d58/d33/d53/l120 6583 1 2024-02-19T19:12:24.518 INFO:tasks.workunit.client.1.smithi125.stdout:5/946: getdents db/d126 0 2024-02-19T19:12:24.518 INFO:tasks.workunit.client.1.smithi125.stdout:5/947: creat db/d26/d10b/f130 x:0 0 0 2024-02-19T19:12:24.518 INFO:tasks.workunit.client.1.smithi125.stdout:5/948: link db/d17/d58/d33/f115 db/d17/d58/d33/d64/f131 0 2024-02-19T19:12:24.561 INFO:tasks.workunit.client.1.smithi125.stdout:1/901: fdatasync d1/d78/f118 0 2024-02-19T19:12:24.561 INFO:tasks.workunit.client.1.smithi125.stdout:1/902: stat d1/d1a/d3d/dd0/f11a 0 2024-02-19T19:12:24.562 INFO:tasks.workunit.client.1.smithi125.stdout:0/779: mkdir d5/d19/d27/d32/d109/db3/dd4/dfb/d106/d111 0 2024-02-19T19:12:24.562 INFO:tasks.workunit.client.1.smithi125.stdout:4/632: dwrite d0/d7/d3b/f8e [446464,122880] 0 2024-02-19T19:12:24.563 INFO:tasks.workunit.client.1.smithi125.stdout:5/949: creat db/d17/d58/d33/d98/d9c/d12c/f132 x:0 0 0 2024-02-19T19:12:24.563 INFO:tasks.workunit.client.1.smithi125.stdout:0/780: truncate d5/d15/d2c/f9c 435228 0 2024-02-19T19:12:24.563 INFO:tasks.workunit.client.1.smithi125.stdout:5/950: creat db/d126/f133 x:0 0 0 2024-02-19T19:12:24.563 INFO:tasks.workunit.client.1.smithi125.stdout:4/633: creat d0/d7/d76/dd1/fd8 x:0 0 0 2024-02-19T19:12:24.563 INFO:tasks.workunit.client.1.smithi125.stdout:0/781: write d5/d33/d46/f4b [1329960,23262] 0 2024-02-19T19:12:24.563 INFO:tasks.workunit.client.1.smithi125.stdout:5/951: symlink db/d17/d85/l134 0 2024-02-19T19:12:24.563 INFO:tasks.workunit.client.1.smithi125.stdout:5/952: creat db/d17/d58/d33/d91/dbe/f135 x:0 0 0 2024-02-19T19:12:24.563 INFO:tasks.workunit.client.1.smithi125.stdout:5/953: link db/l35 db/d17/d58/d33/d98/d9c/l136 0 2024-02-19T19:12:24.564 INFO:tasks.workunit.client.1.smithi125.stdout:5/954: write db/d17/d58/d33/d98/dae/dfd/fef [377984,85581] 0 2024-02-19T19:12:24.566 INFO:tasks.workunit.client.1.smithi125.stdout:4/634: unlink d0/d7/d30/d5d/c72 0 2024-02-19T19:12:24.567 INFO:tasks.workunit.client.1.smithi125.stdout:4/635: mknod d0/d7/d30/cd9 0 2024-02-19T19:12:24.567 INFO:tasks.workunit.client.1.smithi125.stdout:4/636: dread - d0/df/f9f zero size 2024-02-19T19:12:24.567 INFO:tasks.workunit.client.1.smithi125.stdout:4/637: stat d0/d7/d30/d58/f39 0 2024-02-19T19:12:24.567 INFO:tasks.workunit.client.1.smithi125.stdout:4/638: read d0/d7/d3b/f81 [361476,76498] 0 2024-02-19T19:12:24.567 INFO:tasks.workunit.client.1.smithi125.stdout:4/639: mkdir d0/df/dda 0 2024-02-19T19:12:24.567 INFO:tasks.workunit.client.1.smithi125.stdout:4/640: mknod d0/d7/d30/d6c/cdb 0 2024-02-19T19:12:24.567 INFO:tasks.workunit.client.1.smithi125.stdout:1/903: creat d1/d26/d23/d106/f129 x:0 0 0 2024-02-19T19:12:24.567 INFO:tasks.workunit.client.1.smithi125.stdout:4/641: mkdir d0/d7/ddc 0 2024-02-19T19:12:24.567 INFO:tasks.workunit.client.1.smithi125.stdout:4/642: chown d0/d7/d3b/d75/f90 92 1 2024-02-19T19:12:24.567 INFO:tasks.workunit.client.1.smithi125.stdout:4/643: truncate d0/d7/d3b/f9c 574978 0 2024-02-19T19:12:24.568 INFO:tasks.workunit.client.1.smithi125.stdout:4/644: write d0/d32/fcb [703226,51804] 0 2024-02-19T19:12:24.568 INFO:tasks.workunit.client.1.smithi125.stdout:4/645: write d0/d7/d3b/f3d [2561470,71932] 0 2024-02-19T19:12:24.568 INFO:tasks.workunit.client.1.smithi125.stdout:4/646: rmdir d0/d7/ddc 0 2024-02-19T19:12:24.568 INFO:tasks.workunit.client.1.smithi125.stdout:4/647: getdents d0/d7/d30 0 2024-02-19T19:12:24.568 INFO:tasks.workunit.client.1.smithi125.stdout:4/648: chown d0/d7/d30/d42/lc0 74 1 2024-02-19T19:12:24.568 INFO:tasks.workunit.client.1.smithi125.stdout:4/649: dread d0/d7/d30/d58/f87 [303104,36864] 0 2024-02-19T19:12:24.568 INFO:tasks.workunit.client.1.smithi125.stdout:0/782: mknod d5/d19/d27/d32/dd7/d107/c112 0 2024-02-19T19:12:24.568 INFO:tasks.workunit.client.1.smithi125.stdout:0/783: mknod d5/d19/d27/d32/d70/c113 0 2024-02-19T19:12:24.569 INFO:tasks.workunit.client.1.smithi125.stdout:0/784: truncate d5/d19/d27/ff5 939739 0 2024-02-19T19:12:24.569 INFO:tasks.workunit.client.1.smithi125.stdout:0/785: creat d5/d19/d27/d32/d109/db3/dd4/dfb/f114 x:0 0 0 2024-02-19T19:12:24.569 INFO:tasks.workunit.client.1.smithi125.stdout:9/824: dwrite d8/d15/d22/fb6 [12288,86016] 0 2024-02-19T19:12:24.569 INFO:tasks.workunit.client.1.smithi125.stdout:9/825: stat d8/d15/d22/f78 0 2024-02-19T19:12:24.569 INFO:tasks.workunit.client.1.smithi125.stdout:9/826: mknod d8/d15/c11b 0 2024-02-19T19:12:24.569 INFO:tasks.workunit.client.1.smithi125.stdout:9/827: write d8/d2e/d4c/fc9 [914015,94277] 0 2024-02-19T19:12:24.569 INFO:tasks.workunit.client.1.smithi125.stdout:5/955: dwrite db/d17/d58/d33/f115 [184320,61440] 0 2024-02-19T19:12:24.569 INFO:tasks.workunit.client.1.smithi125.stdout:5/956: read db/d26/d51/fcb [895492,68797] 0 2024-02-19T19:12:24.569 INFO:tasks.workunit.client.1.smithi125.stdout:1/904: dwrite d1/d26/d23/d106/f103 [389120,57344] 0 2024-02-19T19:12:24.569 INFO:tasks.workunit.client.1.smithi125.stdout:1/905: mkdir d1/d1a/d3d/dd0/d12a 0 2024-02-19T19:12:24.570 INFO:tasks.workunit.client.1.smithi125.stdout:1/906: unlink d1/d78/d8a/lfd 0 2024-02-19T19:12:24.631 INFO:tasks.workunit.client.1.smithi125.stdout:4/650: fdatasync d0/d7/d3b/f5f 0 2024-02-19T19:12:24.632 INFO:tasks.workunit.client.1.smithi125.stdout:4/651: creat d0/d7/d30/d42/d7b/fdd x:0 0 0 2024-02-19T19:12:24.632 INFO:tasks.workunit.client.1.smithi125.stdout:4/652: readlink d0/df/l9d 0 2024-02-19T19:12:24.632 INFO:tasks.workunit.client.1.smithi125.stdout:4/653: mkdir d0/d7/d30/d6c/dcd/dde 0 2024-02-19T19:12:24.632 INFO:tasks.workunit.client.1.smithi125.stdout:4/654: write d0/d7/d30/d58/f39 [418594,813] 0 2024-02-19T19:12:24.632 INFO:tasks.workunit.client.1.smithi125.stdout:4/655: getdents d0/d7/d3b 0 2024-02-19T19:12:24.632 INFO:tasks.workunit.client.1.smithi125.stdout:4/656: write d0/df/d5e/fb4 [819942,96734] 0 2024-02-19T19:12:24.632 INFO:tasks.workunit.client.1.smithi125.stdout:4/657: rename d0/d7/dad/dc4 to d0/d7/d30/d42/db3/ddf 0 2024-02-19T19:12:24.632 INFO:tasks.workunit.client.1.smithi125.stdout:4/658: dread - d0/d7/d76/dd1/fd8 zero size 2024-02-19T19:12:24.633 INFO:tasks.workunit.client.1.smithi125.stdout:4/659: write d0/d7/d30/d58/f39 [400526,81542] 0 2024-02-19T19:12:24.633 INFO:tasks.workunit.client.1.smithi125.stdout:4/660: write d0/d7/d30/d58/f39 [1090390,14833] 0 2024-02-19T19:12:24.634 INFO:tasks.workunit.client.1.smithi125.stdout:9/828: dwrite d8/d15/d32/d4f/d6e/df0/ff1 [249856,61440] 0 2024-02-19T19:12:24.681 INFO:tasks.workunit.client.1.smithi125.stdout:1/907: fsync d1/d1a/d3d/d6e/d4b/fa6 0 2024-02-19T19:12:24.681 INFO:tasks.workunit.client.1.smithi125.stdout:1/908: link d1/dc/d36/d69/fea d1/d26/d23/d106/de9/d117/f12b 0 2024-02-19T19:12:24.681 INFO:tasks.workunit.client.1.smithi125.stdout:1/909: creat d1/d1a/d3d/d6e/d4b/f12c x:0 0 0 2024-02-19T19:12:24.681 INFO:tasks.workunit.client.1.smithi125.stdout:1/910: write d1/d26/d23/d106/de9/d117/f12b [229119,67705] 0 2024-02-19T19:12:24.681 INFO:tasks.workunit.client.1.smithi125.stdout:1/911: link d1/d78/f118 d1/da3/f12d 0 2024-02-19T19:12:24.681 INFO:tasks.workunit.client.1.smithi125.stdout:1/912: symlink d1/d26/d3c/d3f/l12e 0 2024-02-19T19:12:24.681 INFO:tasks.workunit.client.1.smithi125.stdout:1/913: mkdir d1/d26/d12f 0 2024-02-19T19:12:24.682 INFO:tasks.workunit.client.1.smithi125.stdout:9/829: dwrite d8/d15/d32/d4f/d6e/f75 [1638400,122880] 0 2024-02-19T19:12:24.682 INFO:tasks.workunit.client.1.smithi125.stdout:9/830: read d8/d15/f86 [153107,49831] 0 2024-02-19T19:12:24.714 INFO:tasks.workunit.client.1.smithi125.stdout:9/831: fdatasync d8/d15/d22/d4e/d90/ffc 0 2024-02-19T19:12:24.720 INFO:tasks.workunit.client.1.smithi125.stdout:9/832: truncate d8/d15/d22/d4e/d6b/fca 465513 0 2024-02-19T19:12:24.720 INFO:tasks.workunit.client.1.smithi125.stdout:1/914: dwrite d1/d1a/fcc [69632,69632] 0 2024-02-19T19:12:24.720 INFO:tasks.workunit.client.1.smithi125.stdout:9/833: write d8/d15/d10d/f119 [82807,71837] 0 2024-02-19T19:12:24.720 INFO:tasks.workunit.client.1.smithi125.stdout:9/834: readlink d8/lad 0 2024-02-19T19:12:24.721 INFO:tasks.workunit.client.1.smithi125.stdout:9/835: creat d8/d2e/d6d/f11c x:0 0 0 2024-02-19T19:12:24.721 INFO:tasks.workunit.client.1.smithi125.stdout:9/836: getdents d8/d15/d10d 0 2024-02-19T19:12:24.721 INFO:tasks.workunit.client.1.smithi125.stdout:9/837: rmdir d8/d2e 39 2024-02-19T19:12:24.721 INFO:tasks.workunit.client.1.smithi125.stdout:9/838: chown d8/d15/d10d/f119 5210 1 2024-02-19T19:12:24.721 INFO:tasks.workunit.client.1.smithi125.stdout:9/839: creat d8/d15/d32/f11d x:0 0 0 2024-02-19T19:12:24.721 INFO:tasks.workunit.client.1.smithi125.stdout:9/840: truncate d8/d2e/f108 555162 0 2024-02-19T19:12:24.721 INFO:tasks.workunit.client.1.smithi125.stdout:9/841: symlink d8/d15/d32/d4f/d6e/df0/d106/l11e 0 2024-02-19T19:12:24.777 INFO:tasks.workunit.client.1.smithi125.stdout:1/915: dwrite d1/d1a/d3d/d6e/d87/f10b [90112,86016] 0 2024-02-19T19:12:24.777 INFO:tasks.workunit.client.1.smithi125.stdout:1/916: symlink d1/d1a/d3d/dd0/d12a/l130 0 2024-02-19T19:12:24.777 INFO:tasks.workunit.client.1.smithi125.stdout:1/917: dread d1/d78/fd8 [380928,49152] 0 2024-02-19T19:12:24.777 INFO:tasks.workunit.client.1.smithi125.stdout:9/842: dwrite d8/d15/d32/d4f/d85/de2/fee [724992,32768] 0 2024-02-19T19:12:24.777 INFO:tasks.workunit.client.1.smithi125.stdout:1/918: symlink d1/d1a/dd3/l131 0 2024-02-19T19:12:24.778 INFO:tasks.workunit.client.1.smithi125.stdout:9/843: getdents d8/d15/d22/de0 0 2024-02-19T19:12:24.778 INFO:tasks.workunit.client.1.smithi125.stdout:1/919: write d1/d78/d8a/fab [249759,39071] 0 2024-02-19T19:12:24.778 INFO:tasks.workunit.client.1.smithi125.stdout:1/920: creat d1/d1a/d3d/de2/f132 x:0 0 0 2024-02-19T19:12:24.778 INFO:tasks.workunit.client.1.smithi125.stdout:1/921: creat d1/d1a/d3d/dd0/d12a/f133 x:0 0 0 2024-02-19T19:12:24.778 INFO:tasks.workunit.client.1.smithi125.stdout:1/922: truncate d1/d1a/f88 440627 0 2024-02-19T19:12:24.778 INFO:tasks.workunit.client.1.smithi125.stdout:1/923: rename d1/da3/lf9 to d1/d1a/d3d/de2/l134 0 2024-02-19T19:12:24.778 INFO:tasks.workunit.client.1.smithi125.stdout:1/924: mknod d1/d1a/d3d/de2/c135 0 2024-02-19T19:12:24.778 INFO:tasks.workunit.client.1.smithi125.stdout:1/925: symlink d1/d26/d23/d106/de9/d117/l136 0 2024-02-19T19:12:24.778 INFO:tasks.workunit.client.1.smithi125.stdout:1/926: mkdir d1/d26/d23/d106/de9/d137 0 2024-02-19T19:12:24.779 INFO:tasks.workunit.client.1.smithi125.stdout:1/927: write d1/faa [1019329,130099] 0 2024-02-19T19:12:24.779 INFO:tasks.workunit.client.1.smithi125.stdout:1/928: dread d1/d1a/fc4 [208896,24576] 0 2024-02-19T19:12:24.830 INFO:tasks.workunit.client.1.smithi125.stdout:9/844: fdatasync d8/d15/f6a 0 2024-02-19T19:12:24.831 INFO:tasks.workunit.client.1.smithi125.stdout:9/845: mknod d8/c11f 0 2024-02-19T19:12:24.831 INFO:tasks.workunit.client.1.smithi125.stdout:9/846: chown d8/d2e/fe5 42 1 2024-02-19T19:12:24.831 INFO:tasks.workunit.client.1.smithi125.stdout:9/847: write d8/d15/d22/d4e/d90/f103 [1044583,19863] 0 2024-02-19T19:12:24.831 INFO:tasks.workunit.client.1.smithi125.stdout:9/848: creat d8/d15/d32/d4f/ddc/f120 x:0 0 0 2024-02-19T19:12:24.831 INFO:tasks.workunit.client.1.smithi125.stdout:9/849: creat d8/d15/d22/d4e/d6b/f121 x:0 0 0 2024-02-19T19:12:24.831 INFO:tasks.workunit.client.1.smithi125.stdout:9/850: symlink d8/d15/d22/d4e/d90/l122 0 2024-02-19T19:12:24.831 INFO:tasks.workunit.client.1.smithi125.stdout:9/851: mknod d8/d15/d22/d4e/c123 0 2024-02-19T19:12:24.833 INFO:tasks.workunit.client.1.smithi125.stdout:3/585: sync 2024-02-19T19:12:24.833 INFO:tasks.workunit.client.1.smithi125.stdout:2/664: sync 2024-02-19T19:12:24.834 INFO:tasks.workunit.client.1.smithi125.stdout:2/665: rename d1/d27/d1d/d25/f2d to d1/d27/d1d/d2c/d2e/fc6 0 2024-02-19T19:12:24.834 INFO:tasks.workunit.client.1.smithi125.stdout:3/586: write d0/d1/d1e/f9e [716320,63123] 0 2024-02-19T19:12:24.834 INFO:tasks.workunit.client.1.smithi125.stdout:2/666: symlink d1/d27/d1d/d25/d7f/lc7 0 2024-02-19T19:12:24.834 INFO:tasks.workunit.client.1.smithi125.stdout:2/667: chown d1/d27/d1d/d2c/d2e/cb9 0 1 2024-02-19T19:12:24.834 INFO:tasks.workunit.client.1.smithi125.stdout:2/668: getdents d1/d27/d45/d7a 0 2024-02-19T19:12:24.834 INFO:tasks.workunit.client.1.smithi125.stdout:2/669: stat d1/l28 0 2024-02-19T19:12:24.834 INFO:tasks.workunit.client.1.smithi125.stdout:2/670: stat d1/d27/d45/d7a/f95 0 2024-02-19T19:12:24.834 INFO:tasks.workunit.client.1.smithi125.stdout:3/587: mkdir d0/d95/d9c/dbf 0 2024-02-19T19:12:24.834 INFO:tasks.workunit.client.1.smithi125.stdout:3/588: readlink d0/l40 0 2024-02-19T19:12:24.835 INFO:tasks.workunit.client.1.smithi125.stdout:3/589: rename d0/d1/f17 to d0/d1/d4b/db2/fc0 0 2024-02-19T19:12:24.835 INFO:tasks.workunit.client.1.smithi125.stdout:3/590: link d0/de/l22 d0/d1/d4b/lc1 0 2024-02-19T19:12:24.835 INFO:tasks.workunit.client.1.smithi125.stdout:3/591: dread - d0/d95/fa7 zero size 2024-02-19T19:12:24.835 INFO:tasks.workunit.client.1.smithi125.stdout:3/592: readlink d0/d1/d1e/l64 0 2024-02-19T19:12:24.835 INFO:tasks.workunit.client.1.smithi125.stdout:2/671: write d1/d27/d1d/d25/d2a/f41 [1506823,96676] 0 2024-02-19T19:12:24.835 INFO:tasks.workunit.client.1.smithi125.stdout:2/672: mknod d1/d27/d1d/d25/da0/dc3/dc5/cc8 0 2024-02-19T19:12:24.835 INFO:tasks.workunit.client.1.smithi125.stdout:9/852: dwrite d8/d2e/d6d/f11c [839680,53248] 0 2024-02-19T19:12:24.835 INFO:tasks.workunit.client.1.smithi125.stdout:9/853: chown d8/d15/d22/d4e/d90 2520728 1 2024-02-19T19:12:24.835 INFO:tasks.workunit.client.1.smithi125.stdout:9/854: mknod d8/d15/d32/d4f/d85/c124 0 2024-02-19T19:12:24.835 INFO:tasks.workunit.client.1.smithi125.stdout:9/855: creat d8/d15/d22/d4e/d90/f125 x:0 0 0 2024-02-19T19:12:24.836 INFO:tasks.workunit.client.1.smithi125.stdout:9/856: dwrite d8/d15/d32/d4f/d6e/f75 [143360,81920] 0 2024-02-19T19:12:24.838 INFO:tasks.workunit.client.1.smithi125.stdout:1/929: write d1/dc/d36/f66 [803314,47715] 0 2024-02-19T19:12:24.838 INFO:tasks.workunit.client.1.smithi125.stdout:1/930: write d1/d1a/ff0 [436448,38408] 0 2024-02-19T19:12:24.838 INFO:tasks.workunit.client.1.smithi125.stdout:1/931: dread - d1/dc/d36/d69/dc1/fe6 zero size 2024-02-19T19:12:24.839 INFO:tasks.workunit.client.1.smithi125.stdout:1/932: read - d1/d1a/dd3/f10f zero size 2024-02-19T19:12:24.839 INFO:tasks.workunit.client.1.smithi125.stdout:1/933: write d1/f70 [102578,79609] 0 2024-02-19T19:12:24.913 INFO:tasks.workunit.client.1.smithi125.stdout:2/673: fdatasync d1/d27/d45/f56 0 2024-02-19T19:12:24.916 INFO:tasks.workunit.client.1.smithi125.stdout:1/934: rename d1/d26/d3c/f8f to d1/d26/d23/d106/de9/d137/f138 0 2024-02-19T19:12:24.916 INFO:tasks.workunit.client.1.smithi125.stdout:1/935: write d1/d1a/fb4 [70970,49249] 0 2024-02-19T19:12:24.916 INFO:tasks.workunit.client.1.smithi125.stdout:1/936: rename d1/d1a/ded/lf3 to d1/d1a/d3d/d6e/d87/l139 0 2024-02-19T19:12:24.916 INFO:tasks.workunit.client.1.smithi125.stdout:1/937: readlink d1/d26/l38 0 2024-02-19T19:12:24.947 INFO:tasks.workunit.client.1.smithi125.stdout:2/674: fsync d1/d27/d1d/f2b 0 2024-02-19T19:12:24.947 INFO:tasks.workunit.client.1.smithi125.stdout:2/675: readlink d1/d27/d1d/d39/la5 0 2024-02-19T19:12:24.947 INFO:tasks.workunit.client.1.smithi125.stdout:1/938: fsync d1/dc/d36/d69/f115 0 2024-02-19T19:12:24.948 INFO:tasks.workunit.client.1.smithi125.stdout:1/939: chown d1/d1a/d3d/d6e/l111 15104 1 2024-02-19T19:12:24.948 INFO:tasks.workunit.client.1.smithi125.stdout:1/940: readlink d1/d26/d3c/d3f/l12e 0 2024-02-19T19:12:24.948 INFO:tasks.workunit.client.1.smithi125.stdout:1/941: rmdir d1/d1a/d3d 39 2024-02-19T19:12:24.950 INFO:tasks.workunit.client.1.smithi125.stdout:1/942: unlink d1/d26/l21 0 2024-02-19T19:12:24.950 INFO:tasks.workunit.client.1.smithi125.stdout:1/943: mknod d1/da3/c13a 0 2024-02-19T19:12:24.950 INFO:tasks.workunit.client.1.smithi125.stdout:1/944: chown d1/d1a/fcc 2494201 1 2024-02-19T19:12:24.952 INFO:tasks.workunit.client.1.smithi125.stdout:1/945: dwrite d1/f45 [1384448,94208] 0 2024-02-19T19:12:24.952 INFO:tasks.workunit.client.1.smithi125.stdout:1/946: chown d1/da3/fbd 114 1 2024-02-19T19:12:24.952 INFO:tasks.workunit.client.1.smithi125.stdout:1/947: write d1/d1a/d3d/d6e/f110 [829559,100446] 0 2024-02-19T19:12:24.956 INFO:tasks.workunit.client.1.smithi125.stdout:7/670: sync 2024-02-19T19:12:24.957 INFO:tasks.workunit.client.1.smithi125.stdout:7/671: dread d12/d18/d44/d3b/d59/d2a/f4a [581632,106496] 0 2024-02-19T19:12:24.959 INFO:tasks.workunit.client.1.smithi125.stdout:8/693: sync 2024-02-19T19:12:24.959 INFO:tasks.workunit.client.1.smithi125.stdout:8/694: write db/d18/f27 [245871,21792] 0 2024-02-19T19:12:24.961 INFO:tasks.workunit.client.1.smithi125.stdout:7/672: creat d12/d18/d2c/fbf x:0 0 0 2024-02-19T19:12:24.961 INFO:tasks.workunit.client.1.smithi125.stdout:8/695: creat db/d81/dde/fe3 x:0 0 0 2024-02-19T19:12:24.961 INFO:tasks.workunit.client.1.smithi125.stdout:7/673: unlink d12/d18/d44/d3b/d59/d2a/d6a/l79 0 2024-02-19T19:12:24.961 INFO:tasks.workunit.client.1.smithi125.stdout:7/674: dread - d12/d18/d2c/db5/fb0 zero size 2024-02-19T19:12:24.964 INFO:tasks.workunit.client.1.smithi125.stdout:1/948: dread d1/d1a/f2e [65536,36864] 0 2024-02-19T19:12:24.964 INFO:tasks.workunit.client.1.smithi125.stdout:1/949: write d1/d78/f118 [973016,79210] 0 2024-02-19T19:12:24.964 INFO:tasks.workunit.client.1.smithi125.stdout:1/950: creat d1/d1a/d3d/dd0/d12a/f13b x:0 0 0 2024-02-19T19:12:24.964 INFO:tasks.workunit.client.1.smithi125.stdout:1/951: readlink d1/da3/le0 0 2024-02-19T19:12:24.964 INFO:tasks.workunit.client.1.smithi125.stdout:1/952: symlink d1/d1a/d3d/de2/l13c 0 2024-02-19T19:12:24.964 INFO:tasks.workunit.client.1.smithi125.stdout:1/953: truncate d1/dc/d36/d69/dc1/fe6 722989 0 2024-02-19T19:12:24.965 INFO:tasks.workunit.client.1.smithi125.stdout:1/954: dread - d1/d1a/d3d/f44 zero size 2024-02-19T19:12:25.085 INFO:tasks.workunit.client.1.smithi125.stdout:8/696: fsync db/d18/f21 0 2024-02-19T19:12:25.085 INFO:tasks.workunit.client.1.smithi125.stdout:8/697: chown db/d18/d30/d48/f5c 2 1 2024-02-19T19:12:25.085 INFO:tasks.workunit.client.1.smithi125.stdout:8/698: truncate db/d18/f1b 3400245 0 2024-02-19T19:12:25.087 INFO:tasks.workunit.client.1.smithi125.stdout:8/699: dwrite db/f6b [188416,20480] 0 2024-02-19T19:12:25.088 INFO:tasks.workunit.client.1.smithi125.stdout:8/700: dread - db/d6d/fd6 zero size 2024-02-19T19:12:25.088 INFO:tasks.workunit.client.1.smithi125.stdout:8/701: symlink db/d18/d2f/d72/le4 0 2024-02-19T19:12:25.088 INFO:tasks.workunit.client.1.smithi125.stdout:8/702: creat db/d18/d30/d48/d67/d96/fe5 x:0 0 0 2024-02-19T19:12:25.088 INFO:tasks.workunit.client.1.smithi125.stdout:8/703: stat db/d18/d30/d48/f7a 0 2024-02-19T19:12:25.088 INFO:tasks.workunit.client.1.smithi125.stdout:1/955: dwrite d1/d1a/d3d/de2/f112 [626688,4096] 0 2024-02-19T19:12:25.088 INFO:tasks.workunit.client.1.smithi125.stdout:1/956: creat d1/d26/d3c/d3f/f13d x:0 0 0 2024-02-19T19:12:25.088 INFO:tasks.workunit.client.1.smithi125.stdout:1/957: truncate d1/d26/d3c/d3f/f7a 24511 0 2024-02-19T19:12:25.089 INFO:tasks.workunit.client.1.smithi125.stdout:1/958: read d1/dc/f72 [637751,11532] 0 2024-02-19T19:12:25.089 INFO:tasks.workunit.client.1.smithi125.stdout:1/959: rename d1/d26/d3c/fbc to d1/d26/d23/d106/f13e 0 2024-02-19T19:12:25.089 INFO:tasks.workunit.client.1.smithi125.stdout:1/960: symlink d1/dc/d36/d69/dc1/l13f 0 2024-02-19T19:12:25.089 INFO:tasks.workunit.client.1.smithi125.stdout:1/961: dread d1/da3/f12d [241664,12288] 0 2024-02-19T19:12:25.091 INFO:tasks.workunit.client.1.smithi125.stdout:7/675: dread d12/d3d/f69 [49152,90112] 0 2024-02-19T19:12:25.091 INFO:tasks.workunit.client.1.smithi125.stdout:7/676: truncate d12/f7e 908067 0 2024-02-19T19:12:25.091 INFO:tasks.workunit.client.1.smithi125.stdout:7/677: chown d12/d18/d44/d3b/d59/d26/d54/f5b 399373740 1 2024-02-19T19:12:25.118 INFO:tasks.workunit.client.1.smithi125.stdout:2/676: fsync d1/d27/d1d/d25/d2a/f41 0 2024-02-19T19:12:25.118 INFO:tasks.workunit.client.1.smithi125.stdout:2/677: getdents d1/d36/d70/d85 0 2024-02-19T19:12:25.119 INFO:tasks.workunit.client.1.smithi125.stdout:7/678: fsync d12/d18/d63/fb8 0 2024-02-19T19:12:25.123 INFO:tasks.workunit.client.1.smithi125.stdout:1/962: dread d1/dc/d36/d39/f5f [618496,118784] 0 2024-02-19T19:12:25.123 INFO:tasks.workunit.client.1.smithi125.stdout:1/963: rename d1/l3 to d1/d1a/d3d/d6e/d87/l140 0 2024-02-19T19:12:25.129 INFO:tasks.workunit.client.1.smithi125.stdout:8/704: dwrite db/fdd [253952,90112] 0 2024-02-19T19:12:25.129 INFO:tasks.workunit.client.1.smithi125.stdout:1/964: write d1/dc/d36/d69/dc1/fe6 [1192534,43460] 0 2024-02-19T19:12:25.129 INFO:tasks.workunit.client.1.smithi125.stdout:1/965: chown d1/l97 792990 1 2024-02-19T19:12:25.129 INFO:tasks.workunit.client.1.smithi125.stdout:1/966: symlink d1/d78/l141 0 2024-02-19T19:12:25.129 INFO:tasks.workunit.client.1.smithi125.stdout:1/967: dread d1/d1a/fc4 [323584,102400] 0 2024-02-19T19:12:25.130 INFO:tasks.workunit.client.1.smithi125.stdout:1/968: dread d1/dc/f72 [794624,4096] 0 2024-02-19T19:12:25.130 INFO:tasks.workunit.client.1.smithi125.stdout:1/969: unlink d1/d26/d23/l91 0 2024-02-19T19:12:25.130 INFO:tasks.workunit.client.1.smithi125.stdout:1/970: creat d1/dc/d36/d69/f142 x:0 0 0 2024-02-19T19:12:25.130 INFO:tasks.workunit.client.1.smithi125.stdout:1/971: mknod d1/d26/d23/d106/de9/c143 0 2024-02-19T19:12:25.130 INFO:tasks.workunit.client.1.smithi125.stdout:1/972: write d1/d1a/d3d/d6e/d87/fcd [813890,30153] 0 2024-02-19T19:12:25.130 INFO:tasks.workunit.client.1.smithi125.stdout:1/973: readlink d1/d26/d23/l2b 0 2024-02-19T19:12:25.130 INFO:tasks.workunit.client.1.smithi125.stdout:1/974: rename d1/d78/d8a/cec to d1/d26/d23/d106/de9/c144 0 2024-02-19T19:12:25.131 INFO:tasks.workunit.client.1.smithi125.stdout:1/975: unlink d1/f70 0 2024-02-19T19:12:25.131 INFO:tasks.workunit.client.1.smithi125.stdout:1/976: chown d1/d1a/d3d/d6e/d87/fb7 56495847 1 2024-02-19T19:12:25.131 INFO:tasks.workunit.client.1.smithi125.stdout:1/977: truncate d1/d26/d3c/d3f/f13d 716288 0 2024-02-19T19:12:25.131 INFO:tasks.workunit.client.1.smithi125.stdout:1/978: write d1/dc/f17 [1364852,2796] 0 2024-02-19T19:12:25.131 INFO:tasks.workunit.client.1.smithi125.stdout:1/979: mknod d1/d26/d3c/c145 0 2024-02-19T19:12:25.131 INFO:tasks.workunit.client.1.smithi125.stdout:1/980: rename d1/d26/d3c to d1/d1a/d3d/d6e/dbe/d146 0 2024-02-19T19:12:25.131 INFO:tasks.workunit.client.1.smithi125.stdout:1/981: unlink d1/d26/d23/d106/de9/c144 0 2024-02-19T19:12:25.131 INFO:tasks.workunit.client.1.smithi125.stdout:1/982: write d1/d1a/fb4 [211544,111622] 0 2024-02-19T19:12:25.132 INFO:tasks.workunit.client.1.smithi125.stdout:1/983: creat d1/d26/d23/d106/de9/d117/f147 x:0 0 0 2024-02-19T19:12:25.132 INFO:tasks.workunit.client.1.smithi125.stdout:1/984: write d1/d1a/d3d/d6e/d87/ffb [631264,103591] 0 2024-02-19T19:12:25.132 INFO:tasks.workunit.client.1.smithi125.stdout:1/985: mkdir d1/d1a/dd3/d148 0 2024-02-19T19:12:25.132 INFO:tasks.workunit.client.1.smithi125.stdout:1/986: write d1/d1a/ff0 [1246808,16388] 0 2024-02-19T19:12:25.132 INFO:tasks.workunit.client.1.smithi125.stdout:1/987: creat d1/d78/d80/f149 x:0 0 0 2024-02-19T19:12:25.132 INFO:tasks.workunit.client.1.smithi125.stdout:1/988: mkdir d1/d78/d8a/d14a 0 2024-02-19T19:12:25.133 INFO:tasks.workunit.client.1.smithi125.stdout:1/989: dread d1/d1a/d3d/d6e/fa7 [249856,118784] 0 2024-02-19T19:12:25.133 INFO:tasks.workunit.client.1.smithi125.stdout:1/990: chown d1/d26/fdf 2076931 1 2024-02-19T19:12:25.133 INFO:tasks.workunit.client.1.smithi125.stdout:1/991: write d1/d1a/d3d/dd0/d12a/f133 [942136,58612] 0 2024-02-19T19:12:25.133 INFO:tasks.workunit.client.1.smithi125.stdout:1/992: stat d1/d26/d23/d106/de9/l113 0 2024-02-19T19:12:25.133 INFO:tasks.workunit.client.1.smithi125.stdout:1/993: rename d1/d1a/fb4 to d1/da3/f14b 0 2024-02-19T19:12:25.133 INFO:tasks.workunit.client.1.smithi125.stdout:7/679: dwrite d12/d18/d44/d51/fbb [503808,36864] 0 2024-02-19T19:12:25.134 INFO:tasks.workunit.client.1.smithi125.stdout:8/705: dread db/d18/d30/d80/fa4 [614400,90112] 0 2024-02-19T19:12:25.134 INFO:tasks.workunit.client.1.smithi125.stdout:8/706: chown db/d18/d30/d48/db9 17 1 2024-02-19T19:12:25.248 INFO:tasks.workunit.client.1.smithi125.stdout:7/680: rename d12/d18/d44/l2e to d12/d18/d2c/d4e/lc0 0 2024-02-19T19:12:25.249 INFO:tasks.workunit.client.1.smithi125.stdout:7/681: mkdir d12/d18/d44/d3b/d59/d26/d30/d37/dc1 0 2024-02-19T19:12:25.249 INFO:tasks.workunit.client.1.smithi125.stdout:7/682: dread fa [372736,4096] 0 2024-02-19T19:12:25.249 INFO:tasks.workunit.client.1.smithi125.stdout:7/683: read d12/d18/d44/d3b/d59/d2a/d6a/f9e [879506,45803] 0 2024-02-19T19:12:25.249 INFO:tasks.workunit.client.1.smithi125.stdout:7/684: creat d12/d18/d44/d3b/d59/fc2 x:0 0 0 2024-02-19T19:12:25.249 INFO:tasks.workunit.client.1.smithi125.stdout:7/685: write d12/d18/d44/d3b/d59/fac [248703,36709] 0 2024-02-19T19:12:25.249 INFO:tasks.workunit.client.1.smithi125.stdout:7/686: write d12/d18/d44/d3b/d59/d26/d30/d97/fa3 [112775,49552] 0 2024-02-19T19:12:25.249 INFO:tasks.workunit.client.1.smithi125.stdout:7/687: chown d12/d18/d2c/d4e 12 1 2024-02-19T19:12:25.249 INFO:tasks.workunit.client.1.smithi125.stdout:7/688: symlink d12/d18/d44/d3b/d59/lc3 0 2024-02-19T19:12:25.249 INFO:tasks.workunit.client.1.smithi125.stdout:7/689: dread d12/d18/d2c/db5/f83 [339968,114688] 0 2024-02-19T19:12:25.297 INFO:tasks.workunit.client.1.smithi125.stdout:8/707: fsync db/d18/d30/d3c/d4d/d5d/d6f/f74 0 2024-02-19T19:12:25.311 INFO:tasks.workunit.client.1.smithi125.stdout:7/690: truncate d12/d18/d44/d3b/d59/f5e 2212733 0 2024-02-19T19:12:25.312 INFO:tasks.workunit.client.1.smithi125.stdout:8/708: truncate db/d18/d30/d48/f5c 620493 0 2024-02-19T19:12:25.312 INFO:tasks.workunit.client.1.smithi125.stdout:7/691: truncate d12/d18/d44/d3b/d59/d2a/d31/f36 1036353 0 2024-02-19T19:12:25.312 INFO:tasks.workunit.client.1.smithi125.stdout:7/692: readlink d12/d18/d66/laf 0 2024-02-19T19:12:25.312 INFO:tasks.workunit.client.1.smithi125.stdout:7/693: chown d12/d18/d44/c85 3736 1 2024-02-19T19:12:25.312 INFO:tasks.workunit.client.1.smithi125.stdout:7/694: stat d12/d18/d44/d3b/d59/d2a/d31/d50/ca7 0 2024-02-19T19:12:25.312 INFO:tasks.workunit.client.1.smithi125.stdout:7/695: dread d12/d18/d44/d3b/d59/d2a/d6a/d6d/f7f [356352,81920] 0 2024-02-19T19:12:25.312 INFO:tasks.workunit.client.1.smithi125.stdout:7/696: stat d12/d18/d44/d3b/d59/d2a/d31/d50/c91 0 2024-02-19T19:12:25.313 INFO:tasks.workunit.client.1.smithi125.stdout:6/877: sync 2024-02-19T19:12:25.317 INFO:tasks.workunit.client.1.smithi125.stdout:8/709: write db/d18/d30/d48/f51 [1153926,1006] 0 2024-02-19T19:12:25.317 INFO:tasks.workunit.client.1.smithi125.stdout:6/878: mkdir d6/db/d5d/d2f/d45/dd9/d3b/d127 0 2024-02-19T19:12:25.317 INFO:tasks.workunit.client.1.smithi125.stdout:6/879: rmdir d6/db/d5d/d2f/d45/dd9/dbb 39 2024-02-19T19:12:25.317 INFO:tasks.workunit.client.1.smithi125.stdout:8/710: write db/d18/d2f/f3a [1856157,61797] 0 2024-02-19T19:12:25.317 INFO:tasks.workunit.client.1.smithi125.stdout:8/711: mknod db/d18/d2f/d72/ce6 0 2024-02-19T19:12:25.317 INFO:tasks.workunit.client.1.smithi125.stdout:6/880: read d6/db/d5d/f40 [409654,63986] 0 2024-02-19T19:12:25.318 INFO:tasks.workunit.client.1.smithi125.stdout:8/712: link db/l3d db/d18/d30/d48/d67/d96/le7 0 2024-02-19T19:12:25.318 INFO:tasks.workunit.client.1.smithi125.stdout:6/881: getdents d6/db 0 2024-02-19T19:12:25.318 INFO:tasks.workunit.client.1.smithi125.stdout:8/713: creat db/d18/d30/d80/dac/fe8 x:0 0 0 2024-02-19T19:12:25.318 INFO:tasks.workunit.client.1.smithi125.stdout:8/714: readlink db/d18/d30/d3c/d4d/d5d/d6f/lb5 0 2024-02-19T19:12:25.318 INFO:tasks.workunit.client.1.smithi125.stdout:8/715: rename db/d18/d30/d3c/f6a to db/d18/d30/d80/dac/fe9 0 2024-02-19T19:12:25.318 INFO:tasks.workunit.client.1.smithi125.stdout:8/716: write db/f1e [1801446,113149] 0 2024-02-19T19:12:25.318 INFO:tasks.workunit.client.1.smithi125.stdout:7/697: dwrite d12/d18/d2c/f76 [335872,61440] 0 2024-02-19T19:12:25.318 INFO:tasks.workunit.client.1.smithi125.stdout:7/698: rmdir d12/d18/d44/d3b/d59/d2a/d6a 39 2024-02-19T19:12:25.319 INFO:tasks.workunit.client.1.smithi125.stdout:7/699: chown d12/d18/d44/d3b/d59/d26/d30/d37 30742 1 2024-02-19T19:12:25.319 INFO:tasks.workunit.client.1.smithi125.stdout:7/700: write d12/d18/d44/d3b/d59/d2a/d31/d50/d60/f96 [1528598,122019] 0 2024-02-19T19:12:25.319 INFO:tasks.workunit.client.1.smithi125.stdout:7/701: mknod d12/d18/d44/d3b/d59/d2a/d6a/d6d/cc4 0 2024-02-19T19:12:25.319 INFO:tasks.workunit.client.1.smithi125.stdout:7/702: truncate d12/d18/d44/d3b/d59/d26/d30/d37/f8a 845079 0 2024-02-19T19:12:25.319 INFO:tasks.workunit.client.1.smithi125.stdout:7/703: symlink d12/d18/d66/lc5 0 2024-02-19T19:12:25.319 INFO:tasks.workunit.client.1.smithi125.stdout:7/704: mknod d12/d18/d44/d3b/d59/d26/d30/d97/db1/cc6 0 2024-02-19T19:12:25.319 INFO:tasks.workunit.client.1.smithi125.stdout:7/705: readlink d12/d18/l57 0 2024-02-19T19:12:25.320 INFO:tasks.workunit.client.1.smithi125.stdout:7/706: truncate d12/d18/d44/d3b/d59/f5e 1518541 0 2024-02-19T19:12:25.320 INFO:tasks.workunit.client.1.smithi125.stdout:7/707: dread d12/d18/d44/d3b/d59/d2a/d31/d50/f94 [86016,118784] 0 2024-02-19T19:12:25.320 INFO:tasks.workunit.client.1.smithi125.stdout:7/708: mknod d12/d18/d44/cc7 0 2024-02-19T19:12:25.320 INFO:tasks.workunit.client.1.smithi125.stdout:7/709: rename d12/d18/d44/d3b to d12/d18/d44/d3b/d59/d2a/d6a/d6d/dc8 22 2024-02-19T19:12:25.320 INFO:tasks.workunit.client.1.smithi125.stdout:7/710: truncate d12/d18/d44/d3b/d59/d26/d30/f88 2086286 0 2024-02-19T19:12:25.320 INFO:tasks.workunit.client.1.smithi125.stdout:7/711: dread d12/d18/d2c/f42 [1351680,53248] 0 2024-02-19T19:12:25.320 INFO:tasks.workunit.client.1.smithi125.stdout:7/712: rename d12/d18/d44/d3b/d59/d26/d30/d97/c9d to d12/d18/d2c/d4e/d82/cc9 0 2024-02-19T19:12:25.320 INFO:tasks.workunit.client.1.smithi125.stdout:7/713: chown f5 1516089 1 2024-02-19T19:12:25.321 INFO:tasks.workunit.client.1.smithi125.stdout:7/714: rename d12/d18/d44/d3b/d59/d26/d54 to d12/d18/d2c/db5/dca 0 2024-02-19T19:12:25.321 INFO:tasks.workunit.client.1.smithi125.stdout:7/715: dread d12/d18/f68 [20480,86016] 0 2024-02-19T19:12:25.407 INFO:tasks.workunit.client.1.smithi125.stdout:6/882: dwrite d6/db/d5d/d2f/d45/d4e/d6b/fbd [495616,98304] 0 2024-02-19T19:12:25.408 INFO:tasks.workunit.client.1.smithi125.stdout:6/883: write d6/db/d5d/d93/da2/f106 [836573,100264] 0 2024-02-19T19:12:25.408 INFO:tasks.workunit.client.1.smithi125.stdout:6/884: write d6/db/d5d/d2f/d45/dd9/f95 [3253093,21606] 0 2024-02-19T19:12:25.408 INFO:tasks.workunit.client.1.smithi125.stdout:7/716: dwrite d12/d18/d2c/db5/dca/d8c/d98/fb7 [151552,8192] 0 2024-02-19T19:12:25.408 INFO:tasks.workunit.client.1.smithi125.stdout:7/717: creat d12/d18/d44/d3b/d59/d2a/d31/d50/fcb x:0 0 0 2024-02-19T19:12:25.408 INFO:tasks.workunit.client.1.smithi125.stdout:7/718: link d12/d18/d44/d3b/d59/d26/d30/d97/fa3 d12/d18/d44/d3b/d59/d2a/fcc 0 2024-02-19T19:12:25.408 INFO:tasks.workunit.client.1.smithi125.stdout:8/717: dwrite db/d18/d2f/d3f/f75 [1417216,20480] 0 2024-02-19T19:12:25.409 INFO:tasks.workunit.client.1.smithi125.stdout:7/719: unlink d12/c34 0 2024-02-19T19:12:25.409 INFO:tasks.workunit.client.1.smithi125.stdout:7/720: dread d12/f45 [143360,40960] 0 2024-02-19T19:12:25.409 INFO:tasks.workunit.client.1.smithi125.stdout:7/721: creat d12/d18/d44/d3b/d59/d2a/fcd x:0 0 0 2024-02-19T19:12:25.409 INFO:tasks.workunit.client.1.smithi125.stdout:7/722: unlink l6 0 2024-02-19T19:12:25.409 INFO:tasks.workunit.client.1.smithi125.stdout:7/723: chown d12/d18/d44/d3b/d59/d26/c39 15993 1 2024-02-19T19:12:25.409 INFO:tasks.workunit.client.1.smithi125.stdout:7/724: chown d12/d18/d44/d3b/d59/d2a/d31/d50/d60/f96 196 1 2024-02-19T19:12:25.409 INFO:tasks.workunit.client.1.smithi125.stdout:7/725: unlink d12/d18/d44/d3b/d59/d2a/d31/f36 0 2024-02-19T19:12:25.410 INFO:tasks.workunit.client.1.smithi125.stdout:7/726: chown d12/d18/d2c/d4e/f71 150883 1 2024-02-19T19:12:25.410 INFO:tasks.workunit.client.1.smithi125.stdout:7/727: mkdir d12/d18/d44/d3b/d59/d26/d30/d37/dce 0 2024-02-19T19:12:25.410 INFO:tasks.workunit.client.1.smithi125.stdout:7/728: creat d12/d18/d66/da0/fcf x:0 0 0 2024-02-19T19:12:25.410 INFO:tasks.workunit.client.1.smithi125.stdout:7/729: truncate d12/d18/f68 43425 0 2024-02-19T19:12:25.410 INFO:tasks.workunit.client.1.smithi125.stdout:7/730: chown d12/d18/d44/d3b/d59 359 1 2024-02-19T19:12:25.410 INFO:tasks.workunit.client.1.smithi125.stdout:7/731: mkdir d12/d18/dbe/dd0 0 2024-02-19T19:12:25.411 INFO:tasks.workunit.client.1.smithi125.stdout:7/732: mkdir d12/d18/d44/d3b/d59/d26/d30/d37/dd1 0 2024-02-19T19:12:25.432 INFO:tasks.workunit.client.1.smithi125.stdout:1/994: fsync d1/d1a/d3d/d6e/d87/fcd 0 2024-02-19T19:12:25.433 INFO:tasks.workunit.client.1.smithi125.stdout:1/995: truncate d1/d1a/d3d/d6e/dbe/d146/d3f/fa9 617187 0 2024-02-19T19:12:25.433 INFO:tasks.workunit.client.1.smithi125.stdout:1/996: read d1/dc/f17 [223673,95623] 0 2024-02-19T19:12:25.433 INFO:tasks.workunit.client.1.smithi125.stdout:1/997: readlink d1/d1a/d3d/d6e/dbe/d146/d3f/l7e 0 2024-02-19T19:12:25.433 INFO:tasks.workunit.client.1.smithi125.stdout:1/998: write d1/d1a/f2e [78673,114412] 0 2024-02-19T19:12:25.433 INFO:tasks.workunit.client.1.smithi125.stdout:6/885: dwrite d6/db/d5d/d2f/d45/d4e/f53 [327680,94208] 0 2024-02-19T19:12:25.433 INFO:tasks.workunit.client.1.smithi125.stdout:6/886: mkdir d6/db/d5d/d2f/d45/dd9/d16/d128 0 2024-02-19T19:12:25.435 INFO:tasks.workunit.client.1.smithi125.stdout:7/733: dwrite d12/d18/d44/d3b/d59/d2a/d31/d50/fcb [249856,24576] 0 2024-02-19T19:12:25.436 INFO:tasks.workunit.client.1.smithi125.stdout:7/734: rmdir d12/d18/d44/d3b/d59/d26/d30/d37/dce 0 2024-02-19T19:12:25.436 INFO:tasks.workunit.client.1.smithi125.stdout:7/735: rmdir d12/d18/d2c/db5/dca 39 2024-02-19T19:12:25.436 INFO:tasks.workunit.client.1.smithi125.stdout:7/736: chown d12/d18/d2c/f76 2 1 2024-02-19T19:12:25.436 INFO:tasks.workunit.client.1.smithi125.stdout:7/737: stat d12 0 2024-02-19T19:12:25.436 INFO:tasks.workunit.client.1.smithi125.stdout:8/718: dread db/d18/d2f/d3f/f7c [442368,65536] 0 2024-02-19T19:12:25.436 INFO:tasks.workunit.client.1.smithi125.stdout:8/719: chown db/fc9 55956 1 2024-02-19T19:12:25.437 INFO:tasks.workunit.client.1.smithi125.stdout:7/738: creat d12/d18/d44/d3b/d59/d2a/d6a/dab/fd2 x:0 0 0 2024-02-19T19:12:25.437 INFO:tasks.workunit.client.1.smithi125.stdout:7/739: dread - d12/d18/d44/d3b/d59/d26/d30/fbc zero size 2024-02-19T19:12:25.438 INFO:tasks.workunit.client.1.smithi125.stdout:7/740: rename d12/d18 to d12/d18/d2c/d4e/d82/dd3 22 2024-02-19T19:12:25.438 INFO:tasks.workunit.client.1.smithi125.stdout:7/741: link d12/d18/d44/d3b/d59/d26/d30/dad/l4d d12/d18/d44/d3b/d59/d26/d30/d37/dc1/ld4 0 2024-02-19T19:12:25.438 INFO:tasks.workunit.client.1.smithi125.stdout:8/720: write db/d18/d2f/fab [147810,107575] 0 2024-02-19T19:12:25.438 INFO:tasks.workunit.client.1.smithi125.stdout:8/721: write db/d18/d30/f89 [1169014,69948] 0 2024-02-19T19:12:25.438 INFO:tasks.workunit.client.1.smithi125.stdout:8/722: dread db/f46 [135168,24576] 0 2024-02-19T19:12:25.438 INFO:tasks.workunit.client.1.smithi125.stdout:1/999: dwrite d1/d1a/d3d/d6e/f110 [1875968,24576] 0 2024-02-19T19:12:25.505 INFO:tasks.workunit.client.1.smithi125.stdout:6/887: fdatasync d6/db/d5d/d2f/d45/dd9/d3b/dda/f96 0 2024-02-19T19:12:25.558 INFO:tasks.workunit.client.1.smithi125.stdout:6/888: fdatasync d6/db/d5d/d2f/f100 0 2024-02-19T19:12:25.558 INFO:tasks.workunit.client.1.smithi125.stdout:6/889: mkdir d6/db/d98/d129 0 2024-02-19T19:12:25.558 INFO:tasks.workunit.client.1.smithi125.stdout:6/890: creat d6/db/d5d/d2f/d45/f12a x:0 0 0 2024-02-19T19:12:25.588 INFO:tasks.workunit.client.1.smithi125.stdout:6/891: fsync d6/db/d5d/d2f/d45/dd9/d16/f81 0 2024-02-19T19:12:25.589 INFO:tasks.workunit.client.1.smithi125.stdout:6/892: rename d6/db/d49/fed to d6/db/d5d/d2f/d45/dd9/d3b/d10d/f12b 0 2024-02-19T19:12:25.589 INFO:tasks.workunit.client.1.smithi125.stdout:6/893: read - d6/db/d5d/d63/f121 zero size 2024-02-19T19:12:25.589 INFO:tasks.workunit.client.1.smithi125.stdout:6/894: getdents d6/db/d5d/d29/d68 0 2024-02-19T19:12:25.589 INFO:tasks.workunit.client.1.smithi125.stdout:6/895: link d6/db/d5d/d2f/d45/dd9/d16/l1c d6/db/d5d/d2f/d45/dd9/d16/d128/l12c 0 2024-02-19T19:12:25.589 INFO:tasks.workunit.client.1.smithi125.stdout:6/896: mkdir d6/db/d5d/d2f/d7b/d8d/d12d 0 2024-02-19T19:12:25.589 INFO:tasks.workunit.client.1.smithi125.stdout:6/897: mkdir d6/db/d5d/d2f/d45/dd9/d16/d128/d12e 0 2024-02-19T19:12:25.593 INFO:tasks.workunit.client.1.smithi125.stdout:2/678: sync 2024-02-19T19:12:25.593 INFO:tasks.workunit.client.1.smithi125.stdout:4/661: sync 2024-02-19T19:12:25.593 INFO:tasks.workunit.client.1.smithi125.stdout:5/957: sync 2024-02-19T19:12:25.593 INFO:tasks.workunit.client.1.smithi125.stdout:3/593: sync 2024-02-19T19:12:25.593 INFO:tasks.workunit.client.1.smithi125.stdout:0/786: sync 2024-02-19T19:12:25.594 INFO:tasks.workunit.client.1.smithi125.stdout:9/857: sync 2024-02-19T19:12:25.594 INFO:tasks.workunit.client.1.smithi125.stdout:4/662: mknod d0/d7/d30/d58/dac/ce0 0 2024-02-19T19:12:25.594 INFO:tasks.workunit.client.1.smithi125.stdout:2/679: creat d1/d27/d1d/d25/da0/fc9 x:0 0 0 2024-02-19T19:12:25.594 INFO:tasks.workunit.client.1.smithi125.stdout:4/663: rmdir d0/d7/d85 39 2024-02-19T19:12:25.594 INFO:tasks.workunit.client.1.smithi125.stdout:5/958: read db/d47/f7e [335529,67125] 0 2024-02-19T19:12:25.594 INFO:tasks.workunit.client.1.smithi125.stdout:2/680: stat d1/d36/l4a 0 2024-02-19T19:12:25.594 INFO:tasks.workunit.client.1.smithi125.stdout:2/681: chown d1/d36/d70/c9c 184 1 2024-02-19T19:12:25.594 INFO:tasks.workunit.client.1.smithi125.stdout:5/959: write db/d17/d58/d33/d98/dae/dfd/f4e [2892030,14553] 0 2024-02-19T19:12:25.595 INFO:tasks.workunit.client.1.smithi125.stdout:4/664: truncate d0/f40 624650 0 2024-02-19T19:12:25.595 INFO:tasks.workunit.client.1.smithi125.stdout:4/665: unlink d0/d7/d30/d42/l5b 0 2024-02-19T19:12:25.595 INFO:tasks.workunit.client.1.smithi125.stdout:4/666: mknod d0/d7/d3b/d77/ce1 0 2024-02-19T19:12:25.595 INFO:tasks.workunit.client.1.smithi125.stdout:4/667: stat d0/d7/d3b/f81 0 2024-02-19T19:12:25.595 INFO:tasks.workunit.client.1.smithi125.stdout:0/787: write d5/d19/d27/d32/f7d [1374056,121923] 0 2024-02-19T19:12:25.595 INFO:tasks.workunit.client.1.smithi125.stdout:0/788: creat d5/d19/d27/d32/d70/f115 x:0 0 0 2024-02-19T19:12:25.595 INFO:tasks.workunit.client.1.smithi125.stdout:0/789: chown d5/d33/d46/de6 1880 1 2024-02-19T19:12:25.596 INFO:tasks.workunit.client.1.smithi125.stdout:0/790: truncate d5/d33/d46/f6b 53948 0 2024-02-19T19:12:25.596 INFO:tasks.workunit.client.1.smithi125.stdout:0/791: symlink d5/d19/d27/d32/d70/l116 0 2024-02-19T19:12:25.596 INFO:tasks.workunit.client.1.smithi125.stdout:6/898: dwrite d6/db/d5d/d2f/d45/d4e/d6b/fbd [192512,77824] 0 2024-02-19T19:12:25.596 INFO:tasks.workunit.client.1.smithi125.stdout:6/899: unlink d6/ca 0 2024-02-19T19:12:25.596 INFO:tasks.workunit.client.1.smithi125.stdout:6/900: chown d6/db/da7/fb2 169 1 2024-02-19T19:12:25.596 INFO:tasks.workunit.client.1.smithi125.stdout:6/901: unlink d6/db/d5d/d29/d68/fc1 0 2024-02-19T19:12:25.596 INFO:tasks.workunit.client.1.smithi125.stdout:6/902: chown d6/f9 42270 1 2024-02-19T19:12:25.597 INFO:tasks.workunit.client.1.smithi125.stdout:5/960: dwrite db/d17/d58/d4f/fe0 [1441792,4096] 0 2024-02-19T19:12:25.597 INFO:tasks.workunit.client.1.smithi125.stdout:5/961: creat db/d26/d51/d105/f137 x:0 0 0 2024-02-19T19:12:25.597 INFO:tasks.workunit.client.1.smithi125.stdout:5/962: readlink db/d17/d58/d33/lc8 0 2024-02-19T19:12:25.597 INFO:tasks.workunit.client.1.smithi125.stdout:2/682: dwrite d1/ff [487424,36864] 0 2024-02-19T19:12:25.597 INFO:tasks.workunit.client.1.smithi125.stdout:5/963: write db/d17/d58/f3a [2871912,107301] 0 2024-02-19T19:12:25.597 INFO:tasks.workunit.client.1.smithi125.stdout:5/964: write db/d17/d58/d33/d98/dae/dfd/f5a [1434766,55683] 0 2024-02-19T19:12:25.597 INFO:tasks.workunit.client.1.smithi125.stdout:5/965: truncate db/d17/d58/f128 590076 0 2024-02-19T19:12:25.598 INFO:tasks.workunit.client.1.smithi125.stdout:5/966: write db/d17/d58/f3a [1110337,63165] 0 2024-02-19T19:12:25.598 INFO:tasks.workunit.client.1.smithi125.stdout:5/967: readlink db/d17/d58/d33/d64/l9d 0 2024-02-19T19:12:25.598 INFO:tasks.workunit.client.1.smithi125.stdout:5/968: creat db/d17/d58/d33/d53/dce/f138 x:0 0 0 2024-02-19T19:12:25.598 INFO:tasks.workunit.client.1.smithi125.stdout:5/969: chown db/d26/l61 554 1 2024-02-19T19:12:25.598 INFO:tasks.workunit.client.1.smithi125.stdout:5/970: mkdir db/d17/d58/d33/d91/d139 0 2024-02-19T19:12:25.641 INFO:tasks.workunit.client.1.smithi125.stdout:3/594: dwrite d0/d1/d1e/d60/d73/d74/d82/f9b [823296,57344] 0 2024-02-19T19:12:25.641 INFO:tasks.workunit.client.1.smithi125.stdout:3/595: creat d0/d1/d1e/db0/fc2 x:0 0 0 2024-02-19T19:12:25.641 INFO:tasks.workunit.client.1.smithi125.stdout:3/596: link d0/d1/d1e/d60/d73/d74/d82/l8d d0/d1/d1e/lc3 0 2024-02-19T19:12:25.641 INFO:tasks.workunit.client.1.smithi125.stdout:3/597: creat d0/d1/d1e/d60/fc4 x:0 0 0 2024-02-19T19:12:25.641 INFO:tasks.workunit.client.1.smithi125.stdout:3/598: creat d0/d95/d9c/dba/fc5 x:0 0 0 2024-02-19T19:12:25.642 INFO:tasks.workunit.client.1.smithi125.stdout:3/599: truncate d0/d1/d4b/f50 586809 0 2024-02-19T19:12:25.642 INFO:tasks.workunit.client.1.smithi125.stdout:3/600: creat d0/d95/d9c/dba/fc6 x:0 0 0 2024-02-19T19:12:25.642 INFO:tasks.workunit.client.1.smithi125.stdout:3/601: truncate d0/de/f44 1614378 0 2024-02-19T19:12:25.644 INFO:tasks.workunit.client.1.smithi125.stdout:5/971: dwrite db/d26/ff0 [753664,86016] 0 2024-02-19T19:12:25.644 INFO:tasks.workunit.client.1.smithi125.stdout:5/972: rename db/d17/d58/d4f/f7a to db/d47/f13a 0 2024-02-19T19:12:25.644 INFO:tasks.workunit.client.1.smithi125.stdout:0/792: dwrite d5/d33/d9b/feb [1028096,45056] 0 2024-02-19T19:12:25.644 INFO:tasks.workunit.client.1.smithi125.stdout:0/793: write d5/d1a/f79 [1832745,101194] 0 2024-02-19T19:12:25.644 INFO:tasks.workunit.client.1.smithi125.stdout:0/794: readlink d5/d33/d9b/lcb 0 2024-02-19T19:12:25.644 INFO:tasks.workunit.client.1.smithi125.stdout:0/795: stat d5/d33/d9b/lcb 0 2024-02-19T19:12:25.644 INFO:tasks.workunit.client.1.smithi125.stdout:0/796: mknod d5/d1a/c117 0 2024-02-19T19:12:25.645 INFO:tasks.workunit.client.1.smithi125.stdout:0/797: read - d5/d19/d2b/fda zero size 2024-02-19T19:12:25.645 INFO:tasks.workunit.client.1.smithi125.stdout:3/602: dwrite d0/d1/d1e/d60/fc4 [925696,4096] 0 2024-02-19T19:12:25.645 INFO:tasks.workunit.client.1.smithi125.stdout:3/603: getdents d0/d1/d1e/d60 0 2024-02-19T19:12:25.645 INFO:tasks.workunit.client.1.smithi125.stdout:3/604: mknod d0/d1/d4b/db2/cc7 0 2024-02-19T19:12:25.645 INFO:tasks.workunit.client.1.smithi125.stdout:3/605: readlink d0/l8e 0 2024-02-19T19:12:25.645 INFO:tasks.workunit.client.1.smithi125.stdout:3/606: chown d0/d1/f56 80289 1 2024-02-19T19:12:25.645 INFO:tasks.workunit.client.1.smithi125.stdout:5/973: dwrite db/d17/d58/d33/d98/dae/dfd/f5a [118784,36864] 0 2024-02-19T19:12:25.645 INFO:tasks.workunit.client.1.smithi125.stdout:5/974: creat db/d17/d58/d4f/f13b x:0 0 0 2024-02-19T19:12:25.646 INFO:tasks.workunit.client.1.smithi125.stdout:0/798: dwrite d5/d33/d42/fe7 [704512,102400] 0 2024-02-19T19:12:25.653 INFO:tasks.workunit.client.1.smithi125.stdout:9/858: dread d8/d15/d32/d4f/d6e/fc2 [872448,28672] 0 2024-02-19T19:12:25.654 INFO:tasks.workunit.client.1.smithi125.stdout:9/859: dread - d8/d15/d22/d4e/d90/ffc zero size 2024-02-19T19:12:25.660 INFO:tasks.workunit.client.1.smithi125.stdout:6/903: dread d6/db/d5d/d2f/d45/dd9/d3b/f77 [446464,8192] 0 2024-02-19T19:12:25.715 INFO:tasks.workunit.client.1.smithi125.stdout:2/683: fdatasync d1/d27/d1d/d16/fa9 0 2024-02-19T19:12:25.715 INFO:tasks.workunit.client.1.smithi125.stdout:2/684: stat d1/d27/d1d/d25/f88 0 2024-02-19T19:12:25.719 INFO:tasks.workunit.client.1.smithi125.stdout:6/904: truncate d6/db/d5d/d29/f91 219849 0 2024-02-19T19:12:25.719 INFO:tasks.workunit.client.1.smithi125.stdout:5/975: link db/d17/d58/d33/d53/f8f db/d17/d58/d33/d91/d139/f13c 0 2024-02-19T19:12:25.719 INFO:tasks.workunit.client.1.smithi125.stdout:9/860: symlink d8/d15/d32/d4f/d6e/df0/l126 0 2024-02-19T19:12:25.719 INFO:tasks.workunit.client.1.smithi125.stdout:6/905: mkdir d6/db/d5d/d2f/d45/dd9/dbb/d12f 0 2024-02-19T19:12:25.720 INFO:tasks.workunit.client.1.smithi125.stdout:9/861: truncate d8/d2e/d4c/f5f 588724 0 2024-02-19T19:12:25.720 INFO:tasks.workunit.client.1.smithi125.stdout:9/862: link d8/d15/d32/d4f/c10b d8/d2e/d4c/d84/c127 0 2024-02-19T19:12:25.720 INFO:tasks.workunit.client.1.smithi125.stdout:9/863: rename d8/d15/c27 to d8/d2e/d4c/c128 0 2024-02-19T19:12:25.720 INFO:tasks.workunit.client.1.smithi125.stdout:0/799: dwrite d5/d19/d27/f8c [1441792,90112] 0 2024-02-19T19:12:25.720 INFO:tasks.workunit.client.1.smithi125.stdout:0/800: getdents d5 0 2024-02-19T19:12:25.720 INFO:tasks.workunit.client.1.smithi125.stdout:0/801: link d5/d33/d9b/feb d5/d15/d2c/d80/dfa/dc8/f118 0 2024-02-19T19:12:25.720 INFO:tasks.workunit.client.1.smithi125.stdout:0/802: mkdir d5/d19/d2b/d119 0 2024-02-19T19:12:25.720 INFO:tasks.workunit.client.1.smithi125.stdout:0/803: mkdir d5/d19/d27/d11a 0 2024-02-19T19:12:25.721 INFO:tasks.workunit.client.1.smithi125.stdout:2/685: dwrite d1/fb4 [671744,98304] 0 2024-02-19T19:12:25.721 INFO:tasks.workunit.client.1.smithi125.stdout:2/686: unlink d1/d27/d1d/d2c/d2e/f92 0 2024-02-19T19:12:25.721 INFO:tasks.workunit.client.1.smithi125.stdout:2/687: stat d1/d27/d1d/d25/d2a/f34 0 2024-02-19T19:12:25.721 INFO:tasks.workunit.client.1.smithi125.stdout:2/688: symlink d1/d27/d1d/d16/lca 0 2024-02-19T19:12:25.721 INFO:tasks.workunit.client.1.smithi125.stdout:2/689: mknod d1/d36/dc0/ccb 0 2024-02-19T19:12:25.721 INFO:tasks.workunit.client.1.smithi125.stdout:3/607: dwrite d0/d1/d1e/f34 [598016,65536] 0 2024-02-19T19:12:25.721 INFO:tasks.workunit.client.1.smithi125.stdout:2/690: write d1/d27/d1d/d25/da3/fa7 [955495,87139] 0 2024-02-19T19:12:25.721 INFO:tasks.workunit.client.1.smithi125.stdout:3/608: chown d0/l47 107542109 1 2024-02-19T19:12:25.722 INFO:tasks.workunit.client.1.smithi125.stdout:2/691: creat d1/d27/d1d/d25/da0/dc3/dc5/fcc x:0 0 0 2024-02-19T19:12:25.722 INFO:tasks.workunit.client.1.smithi125.stdout:3/609: creat d0/d95/d9c/dbf/fc8 x:0 0 0 2024-02-19T19:12:25.722 INFO:tasks.workunit.client.1.smithi125.stdout:2/692: dread d1/fb4 [471040,126976] 0 2024-02-19T19:12:25.722 INFO:tasks.workunit.client.1.smithi125.stdout:2/693: readlink d1/d36/d70/d4b/l51 0 2024-02-19T19:12:25.722 INFO:tasks.workunit.client.1.smithi125.stdout:2/694: rename d1/d27/d1d/d25/d7f/lc7 to d1/d27/da2/lcd 0 2024-02-19T19:12:25.722 INFO:tasks.workunit.client.1.smithi125.stdout:2/695: chown d1/d27/f22 636593930 1 2024-02-19T19:12:25.756 INFO:tasks.workunit.client.1.smithi125.stdout:3/610: dwrite d0/d1/f41 [1396736,114688] 0 2024-02-19T19:12:25.756 INFO:tasks.workunit.client.1.smithi125.stdout:3/611: write d0/d1/d1e/d60/d73/fa6 [931970,91738] 0 2024-02-19T19:12:25.758 INFO:tasks.workunit.client.1.smithi125.stdout:5/976: dwrite db/d17/d58/d33/d91/dbe/fa0 [1126400,57344] 0 2024-02-19T19:12:25.758 INFO:tasks.workunit.client.1.smithi125.stdout:5/977: truncate db/d17/d58/f81 1070819 0 2024-02-19T19:12:25.758 INFO:tasks.workunit.client.1.smithi125.stdout:5/978: chown db/d17/ca5 1 1 2024-02-19T19:12:25.759 INFO:tasks.workunit.client.1.smithi125.stdout:6/906: dwrite d6/db/d5d/d2f/d45/dd9/d3b/dda/fb1 [499712,114688] 0 2024-02-19T19:12:25.759 INFO:tasks.workunit.client.1.smithi125.stdout:6/907: dread d6/db/d5d/d2f/d45/dd9/f51 [2195456,65536] 0 2024-02-19T19:12:25.759 INFO:tasks.workunit.client.1.smithi125.stdout:6/908: creat d6/db/d5d/d2f/d7b/f130 x:0 0 0 2024-02-19T19:12:25.759 INFO:tasks.workunit.client.1.smithi125.stdout:6/909: rename d6/db/d5d/d2f/d45/dd9/d3b/d10d/f12b to d6/db/f131 0 2024-02-19T19:12:25.771 INFO:tasks.workunit.client.1.smithi125.stdout:9/864: dread d8/d15/d32/d4f/f59 [286720,106496] 0 2024-02-19T19:12:25.771 INFO:tasks.workunit.client.1.smithi125.stdout:9/865: readlink d8/d15/d22/le6 0 2024-02-19T19:12:25.771 INFO:tasks.workunit.client.1.smithi125.stdout:9/866: mkdir d8/d15/d32/d4f/d129 0 2024-02-19T19:12:25.856 INFO:tasks.workunit.client.1.smithi125.stdout:7/742: fsync d12/d18/d44/d3b/d59/d2a/fcc 0 2024-02-19T19:12:25.856 INFO:tasks.workunit.client.1.smithi125.stdout:3/612: fsync d0/d1/d1e/d60/f85 0 2024-02-19T19:12:25.857 INFO:tasks.workunit.client.1.smithi125.stdout:5/979: dwrite db/d17/d58/d33/d64/df1/f12d [249856,12288] 0 2024-02-19T19:12:25.893 INFO:tasks.workunit.client.1.smithi125.stdout:6/910: fdatasync d6/db/d5d/d2f/d45/f12a 0 2024-02-19T19:12:25.893 INFO:tasks.workunit.client.1.smithi125.stdout:9/867: fdatasync d8/d15/d32/d4f/d6e/fdb 0 2024-02-19T19:12:25.899 INFO:tasks.workunit.client.1.smithi125.stdout:3/613: write d0/d1/f23 [649309,1401] 0 2024-02-19T19:12:25.900 INFO:tasks.workunit.client.1.smithi125.stdout:9/868: creat d8/d15/d32/d4f/d6e/f12a x:0 0 0 2024-02-19T19:12:25.900 INFO:tasks.workunit.client.1.smithi125.stdout:9/869: stat d8/c17 0 2024-02-19T19:12:25.900 INFO:tasks.workunit.client.1.smithi125.stdout:5/980: creat db/d17/d58/d33/f13d x:0 0 0 2024-02-19T19:12:25.900 INFO:tasks.workunit.client.1.smithi125.stdout:9/870: creat d8/d15/da2/f12b x:0 0 0 2024-02-19T19:12:25.900 INFO:tasks.workunit.client.1.smithi125.stdout:6/911: write d6/db/d5d/d2f/d45/dd9/d16/f2b [383796,101934] 0 2024-02-19T19:12:25.900 INFO:tasks.workunit.client.1.smithi125.stdout:9/871: truncate d8/d15/d32/f2a 180262 0 2024-02-19T19:12:25.900 INFO:tasks.workunit.client.1.smithi125.stdout:9/872: link d8/d15/d22/d4e/c123 d8/d15/d22/de0/c12c 0 2024-02-19T19:12:25.901 INFO:tasks.workunit.client.1.smithi125.stdout:6/912: rename d6/db/c1d to d6/db/d98/c132 0 2024-02-19T19:12:25.901 INFO:tasks.workunit.client.1.smithi125.stdout:9/873: rename d8/d2e/d4c/d84/f94 to d8/d2e/d4c/f12d 0 2024-02-19T19:12:25.901 INFO:tasks.workunit.client.1.smithi125.stdout:9/874: readlink d8/d15/d22/d4e/l73 0 2024-02-19T19:12:25.901 INFO:tasks.workunit.client.1.smithi125.stdout:6/913: dread d6/db/d5d/d2f/d45/dd9/dbb/fd3 [876544,40960] 0 2024-02-19T19:12:25.901 INFO:tasks.workunit.client.1.smithi125.stdout:9/875: link d8/d15/d32/d4f/f5e d8/f12e 0 2024-02-19T19:12:25.901 INFO:tasks.workunit.client.1.smithi125.stdout:9/876: dread d8/d15/d32/f9b [159744,12288] 0 2024-02-19T19:12:25.901 INFO:tasks.workunit.client.1.smithi125.stdout:9/877: rename d8/f50 to d8/d15/d32/d4f/ddc/f12f 0 2024-02-19T19:12:25.901 INFO:tasks.workunit.client.1.smithi125.stdout:6/914: mkdir d6/db/d5d/dc4/d133 0 2024-02-19T19:12:25.902 INFO:tasks.workunit.client.1.smithi125.stdout:6/915: dread - d6/db/d5d/d2f/d45/d4e/d6b/fd2 zero size 2024-02-19T19:12:25.902 INFO:tasks.workunit.client.1.smithi125.stdout:6/916: dread - d6/db/d5d/d2f/d45/d107/fc9 zero size 2024-02-19T19:12:25.902 INFO:tasks.workunit.client.1.smithi125.stdout:6/917: readlink d6/db/d5d/d2f/d45/dd9/d16/d128/l12c 0 2024-02-19T19:12:25.902 INFO:tasks.workunit.client.1.smithi125.stdout:9/878: symlink d8/d15/d22/d4e/l130 0 2024-02-19T19:12:25.902 INFO:tasks.workunit.client.1.smithi125.stdout:6/918: symlink d6/db/d5d/d2f/d45/dd9/d16/d128/l134 0 2024-02-19T19:12:25.902 INFO:tasks.workunit.client.1.smithi125.stdout:9/879: write d8/d15/d32/d4f/de7/fe8 [520085,6853] 0 2024-02-19T19:12:25.902 INFO:tasks.workunit.client.1.smithi125.stdout:6/919: write d6/db/d49/f59 [1675352,84754] 0 2024-02-19T19:12:25.902 INFO:tasks.workunit.client.1.smithi125.stdout:6/920: read d6/db/d5d/d2f/d45/f8a [166718,2652] 0 2024-02-19T19:12:25.902 INFO:tasks.workunit.client.1.smithi125.stdout:6/921: write d6/db/d5d/fd8 [769016,2530] 0 2024-02-19T19:12:25.903 INFO:tasks.workunit.client.1.smithi125.stdout:6/922: chown d6/db/d5d/d29/d68 4071880 1 2024-02-19T19:12:25.903 INFO:tasks.workunit.client.1.smithi125.stdout:6/923: creat d6/db/d5d/dc4/f135 x:0 0 0 2024-02-19T19:12:25.903 INFO:tasks.workunit.client.1.smithi125.stdout:6/924: mknod d6/db/d5d/d2f/d45/dd9/d3b/dcc/c136 0 2024-02-19T19:12:25.903 INFO:tasks.workunit.client.1.smithi125.stdout:6/925: mknod d6/db/d5d/d2f/d45/dd9/dbb/c137 0 2024-02-19T19:12:25.903 INFO:tasks.workunit.client.1.smithi125.stdout:6/926: truncate d6/db/d5d/d2f/d45/dd9/d3b/f79 2288492 0 2024-02-19T19:12:25.903 INFO:tasks.workunit.client.1.smithi125.stdout:6/927: rename d6/db/d5d/d2f/d45/dd9/d3b/de1/d126 to d6/db/d5d/d2f/d45/dd9/d3b/de1/d138 0 2024-02-19T19:12:25.903 INFO:tasks.workunit.client.1.smithi125.stdout:6/928: rename d6/db/d5d/d2f/d7b/d8d to d6/db/d98/d129/d139 0 2024-02-19T19:12:25.903 INFO:tasks.workunit.client.1.smithi125.stdout:6/929: chown d6/db/f131 153 1 2024-02-19T19:12:25.904 INFO:tasks.workunit.client.1.smithi125.stdout:6/930: chown d6/db/f17 312 1 2024-02-19T19:12:25.904 INFO:tasks.workunit.client.1.smithi125.stdout:6/931: truncate d6/db/d49/f59 698206 0 2024-02-19T19:12:25.904 INFO:tasks.workunit.client.1.smithi125.stdout:6/932: chown d6/db/d5d/d2f/d45/dd9/d3b/de1 15 1 2024-02-19T19:12:25.904 INFO:tasks.workunit.client.1.smithi125.stdout:6/933: write d6/db/d5d/d63/f121 [504763,23990] 0 2024-02-19T19:12:25.904 INFO:tasks.workunit.client.1.smithi125.stdout:6/934: write d6/db/f10e [69630,52768] 0 2024-02-19T19:12:25.904 INFO:tasks.workunit.client.1.smithi125.stdout:7/743: dwrite d12/d18/f3c [3080192,32768] 0 2024-02-19T19:12:25.904 INFO:tasks.workunit.client.1.smithi125.stdout:7/744: creat d12/d18/d2c/db5/fd5 x:0 0 0 2024-02-19T19:12:25.904 INFO:tasks.workunit.client.1.smithi125.stdout:7/745: mkdir d12/d18/d66/dd6 0 2024-02-19T19:12:25.904 INFO:tasks.workunit.client.1.smithi125.stdout:3/614: dwrite d0/d1/d39/f8b [385024,98304] 0 2024-02-19T19:12:25.905 INFO:tasks.workunit.client.1.smithi125.stdout:3/615: mknod d0/cc9 0 2024-02-19T19:12:25.905 INFO:tasks.workunit.client.1.smithi125.stdout:9/880: dwrite d8/d2e/f108 [1261568,73728] 0 2024-02-19T19:12:25.949 INFO:tasks.workunit.client.1.smithi125.stdout:3/616: dread d0/d1/f65 [360448,110592] 0 2024-02-19T19:12:25.950 INFO:tasks.workunit.client.1.smithi125.stdout:3/617: rmdir d0/d95/d9c/dbf 39 2024-02-19T19:12:25.950 INFO:tasks.workunit.client.1.smithi125.stdout:3/618: dread - d0/d1/d1e/d60/f85 zero size 2024-02-19T19:12:25.950 INFO:tasks.workunit.client.1.smithi125.stdout:3/619: dread - d0/d95/d9c/dba/fc6 zero size 2024-02-19T19:12:25.950 INFO:tasks.workunit.client.1.smithi125.stdout:3/620: symlink d0/d1/d4b/d52/lca 0 2024-02-19T19:12:25.950 INFO:tasks.workunit.client.1.smithi125.stdout:3/621: chown d0/d1/d4b/d52/d81/db7/fb8 32176974 1 2024-02-19T19:12:25.950 INFO:tasks.workunit.client.1.smithi125.stdout:3/622: link d0/d1/d4b/c4c d0/d1/d39/ccb 0 2024-02-19T19:12:25.950 INFO:tasks.workunit.client.1.smithi125.stdout:3/623: chown d0/d1/d1e/d60/d7c/db6/d71/f72 791 1 2024-02-19T19:12:26.005 INFO:tasks.workunit.client.1.smithi125.stdout:5/981: fdatasync db/d17/d58/d33/d98/d9c/f9e 0 2024-02-19T19:12:26.005 INFO:tasks.workunit.client.1.smithi125.stdout:9/881: fsync d8/d2e/fb9 0 2024-02-19T19:12:26.005 INFO:tasks.workunit.client.1.smithi125.stdout:9/882: chown d8/d15/da2/l114 1 1 2024-02-19T19:12:26.005 INFO:tasks.workunit.client.1.smithi125.stdout:9/883: unlink d8/d15/d32/d4f/d85/dcb/cd2 0 2024-02-19T19:12:26.005 INFO:tasks.workunit.client.1.smithi125.stdout:5/982: write db/f10e [909952,83485] 0 2024-02-19T19:12:26.055 INFO:tasks.workunit.client.1.smithi125.stdout:3/624: fsync d0/de/f7a 0 2024-02-19T19:12:26.055 INFO:tasks.workunit.client.1.smithi125.stdout:3/625: getdents d0/d95/d9c/daf 0 2024-02-19T19:12:26.055 INFO:tasks.workunit.client.1.smithi125.stdout:3/626: chown d0/d95 24588 1 2024-02-19T19:12:26.057 INFO:tasks.workunit.client.1.smithi125.stdout:9/884: mknod d8/d15/c131 0 2024-02-19T19:12:26.057 INFO:tasks.workunit.client.1.smithi125.stdout:9/885: readlink d8/d2e/l51 0 2024-02-19T19:12:26.061 INFO:tasks.workunit.client.1.smithi125.stdout:5/983: creat db/d17/d58/d33/d98/dae/dfd/f13e x:0 0 0 2024-02-19T19:12:26.061 INFO:tasks.workunit.client.1.smithi125.stdout:3/627: dread d0/d1/d1e/f68 [679936,65536] 0 2024-02-19T19:12:26.061 INFO:tasks.workunit.client.1.smithi125.stdout:3/628: chown d0/d95/d9c/dba 2463569 1 2024-02-19T19:12:26.061 INFO:tasks.workunit.client.1.smithi125.stdout:5/984: symlink db/d17/d58/d33/d53/l13f 0 2024-02-19T19:12:26.061 INFO:tasks.workunit.client.1.smithi125.stdout:3/629: mknod d0/d95/d9c/dbf/ccc 0 2024-02-19T19:12:26.061 INFO:tasks.workunit.client.1.smithi125.stdout:5/985: link db/d17/d58/d33/d98/dae/dfd/d5d/f107 db/d17/d85/f140 0 2024-02-19T19:12:26.061 INFO:tasks.workunit.client.1.smithi125.stdout:5/986: link db/d17/d58/d33/d98/dae/dfd/c5e db/d17/d85/d104/c141 0 2024-02-19T19:12:26.173 INFO:tasks.workunit.client.1.smithi125.stdout:3/630: fsync d0/d1/d39/f49 0 2024-02-19T19:12:26.173 INFO:tasks.workunit.client.1.smithi125.stdout:3/631: chown d0/l47 988 1 2024-02-19T19:12:26.173 INFO:tasks.workunit.client.1.smithi125.stdout:9/886: fsync d8/d2e/f108 0 2024-02-19T19:12:26.174 INFO:tasks.workunit.client.1.smithi125.stdout:3/632: write d0/d1/f41 [889618,25746] 0 2024-02-19T19:12:26.174 INFO:tasks.workunit.client.1.smithi125.stdout:3/633: dread d0/d1/d4b/d52/f5e [634880,90112] 0 2024-02-19T19:12:26.174 INFO:tasks.workunit.client.1.smithi125.stdout:9/887: read d8/d2e/f108 [969600,99001] 0 2024-02-19T19:12:26.174 INFO:tasks.workunit.client.1.smithi125.stdout:9/888: dread d8/d15/d22/d4e/d6b/f76 [520192,126976] 0 2024-02-19T19:12:26.174 INFO:tasks.workunit.client.1.smithi125.stdout:9/889: chown d8/d15/d32/d4f/ddc/f120 204652 1 2024-02-19T19:12:26.174 INFO:tasks.workunit.client.1.smithi125.stdout:3/634: mkdir d0/d1/d39/db4/dcd 0 2024-02-19T19:12:26.178 INFO:tasks.workunit.client.1.smithi125.stdout:9/890: creat d8/d15/d22/f132 x:0 0 0 2024-02-19T19:12:26.178 INFO:tasks.workunit.client.1.smithi125.stdout:3/635: mknod d0/d1/d4b/d52/cce 0 2024-02-19T19:12:26.178 INFO:tasks.workunit.client.1.smithi125.stdout:9/891: dwrite d8/d15/f66 [401408,12288] 0 2024-02-19T19:12:26.248 INFO:tasks.workunit.client.1.smithi125.stdout:3/636: fdatasync d0/f19 0 2024-02-19T19:12:26.249 INFO:tasks.workunit.client.1.smithi125.stdout:3/637: readlink d0/de/l18 0 2024-02-19T19:12:26.249 INFO:tasks.workunit.client.1.smithi125.stdout:3/638: write d0/d95/fa9 [607708,17958] 0 2024-02-19T19:12:26.249 INFO:tasks.workunit.client.1.smithi125.stdout:3/639: link d0/d1/d1e/d60/d7c/db6/d71/f72 d0/d1/d1e/d69/fcf 0 2024-02-19T19:12:26.249 INFO:tasks.workunit.client.1.smithi125.stdout:3/640: mkdir d0/d1/d4b/d52/d81/dd0 0 2024-02-19T19:12:26.249 INFO:tasks.workunit.client.1.smithi125.stdout:3/641: rename d0/de/l22 to d0/d1/d1e/d60/d6a/ld1 0 2024-02-19T19:12:26.249 INFO:tasks.workunit.client.1.smithi125.stdout:3/642: read d0/d1/d1e/f36 [372929,52455] 0 2024-02-19T19:12:26.250 INFO:tasks.workunit.client.1.smithi125.stdout:3/643: truncate d0/d1/d4b/d52/f59 2528495 0 2024-02-19T19:12:26.251 INFO:tasks.workunit.client.1.smithi125.stdout:9/892: dwrite d8/fe [2187264,36864] 0 2024-02-19T19:12:26.251 INFO:tasks.workunit.client.1.smithi125.stdout:9/893: read d8/d15/d32/d4f/f59 [715810,41687] 0 2024-02-19T19:12:26.251 INFO:tasks.workunit.client.1.smithi125.stdout:9/894: symlink d8/d2e/d4c/d96/d112/l133 0 2024-02-19T19:12:26.251 INFO:tasks.workunit.client.1.smithi125.stdout:9/895: symlink d8/d15/d32/l134 0 2024-02-19T19:12:26.252 INFO:tasks.workunit.client.1.smithi125.stdout:9/896: chown d8/d15/d9d 2510 1 2024-02-19T19:12:26.254 INFO:tasks.workunit.client.1.smithi125.stdout:9/897: rename d8/d15/d32/d4f/d6e/df0 to d8/d15/d32/d4f/d85/de2/d135 0 2024-02-19T19:12:26.254 INFO:tasks.workunit.client.1.smithi125.stdout:9/898: read d8/d15/d22/fa6 [42278,105435] 0 2024-02-19T19:12:26.254 INFO:tasks.workunit.client.1.smithi125.stdout:9/899: stat d8/d2e/d4c/d96/fcd 0 2024-02-19T19:12:26.254 INFO:tasks.workunit.client.1.smithi125.stdout:9/900: mknod d8/d15/d32/d4f/ddc/c136 0 2024-02-19T19:12:26.254 INFO:tasks.workunit.client.1.smithi125.stdout:9/901: chown d8/la 17825 1 2024-02-19T19:12:26.255 INFO:tasks.workunit.client.1.smithi125.stdout:3/644: dwrite d0/d1/d1e/d60/fa3 [339968,61440] 0 2024-02-19T19:12:26.255 INFO:tasks.workunit.client.1.smithi125.stdout:3/645: creat d0/d95/d9c/dbf/fd2 x:0 0 0 2024-02-19T19:12:26.255 INFO:tasks.workunit.client.1.smithi125.stdout:3/646: creat d0/d1/d1e/d60/d7c/db6/fd3 x:0 0 0 2024-02-19T19:12:26.255 INFO:tasks.workunit.client.1.smithi125.stdout:3/647: creat d0/d1/d1e/d60/d73/d74/d82/fd4 x:0 0 0 2024-02-19T19:12:26.255 INFO:tasks.workunit.client.1.smithi125.stdout:3/648: symlink d0/d1/d39/ld5 0 2024-02-19T19:12:26.255 INFO:tasks.workunit.client.1.smithi125.stdout:3/649: write d0/f3c [660985,58692] 0 2024-02-19T19:12:26.256 INFO:tasks.workunit.client.1.smithi125.stdout:3/650: symlink d0/d95/d9c/ld6 0 2024-02-19T19:12:26.256 INFO:tasks.workunit.client.1.smithi125.stdout:3/651: chown d0/d1/d4b 73856628 1 2024-02-19T19:12:26.256 INFO:tasks.workunit.client.1.smithi125.stdout:3/652: chown d0/d1/d87 193 1 2024-02-19T19:12:26.256 INFO:tasks.workunit.client.1.smithi125.stdout:3/653: creat d0/d1/d1e/d60/da5/fd7 x:0 0 0 2024-02-19T19:12:26.333 INFO:tasks.workunit.client.1.smithi125.stdout:9/902: dwrite d8/f12e [159744,36864] 0 2024-02-19T19:12:26.333 INFO:tasks.workunit.client.1.smithi125.stdout:3/654: dwrite d0/d1/f65 [790528,4096] 0 2024-02-19T19:12:26.333 INFO:tasks.workunit.client.1.smithi125.stdout:3/655: truncate d0/de/f13 1256010 0 2024-02-19T19:12:26.333 INFO:tasks.workunit.client.1.smithi125.stdout:3/656: dread d0/de/f1c [24576,12288] 0 2024-02-19T19:12:26.336 INFO:tasks.workunit.client.1.smithi125.stdout:3/657: rename d0/d1/d4b/d52/d81/db7/fb8 to d0/d1/d1e/d60/d7c/fd8 0 2024-02-19T19:12:26.338 INFO:tasks.workunit.client.1.smithi125.stdout:9/903: dwrite d8/d15/d32/d4f/d6e/f75 [131072,114688] 0 2024-02-19T19:12:26.338 INFO:tasks.workunit.client.1.smithi125.stdout:9/904: getdents d8/d15/d22/d4e/d90 0 2024-02-19T19:12:26.338 INFO:tasks.workunit.client.1.smithi125.stdout:9/905: rename d8/d2e/d4c/fc9 to d8/d15/da2/f137 0 2024-02-19T19:12:26.338 INFO:tasks.workunit.client.1.smithi125.stdout:9/906: chown d8/d15/d32/d4f/d6e/d99/fa7 137308486 1 2024-02-19T19:12:26.339 INFO:tasks.workunit.client.1.smithi125.stdout:3/658: dwrite d0/d1/d1e/fa8 [458752,61440] 0 2024-02-19T19:12:26.339 INFO:tasks.workunit.client.1.smithi125.stdout:9/907: symlink d8/d2e/d4c/d96/d112/l138 0 2024-02-19T19:12:26.339 INFO:tasks.workunit.client.1.smithi125.stdout:9/908: rename d8/d15/d32/d4f/d6e/f12a to d8/d2e/d4c/d96/f139 0 2024-02-19T19:12:26.339 INFO:tasks.workunit.client.1.smithi125.stdout:3/659: symlink d0/d1/d1e/db0/ld9 0 2024-02-19T19:12:26.339 INFO:tasks.workunit.client.1.smithi125.stdout:9/909: write d8/d15/d22/fb6 [1096985,46339] 0 2024-02-19T19:12:26.339 INFO:tasks.workunit.client.1.smithi125.stdout:9/910: chown d8/d15/d9d/f113 132 1 2024-02-19T19:12:26.339 INFO:tasks.workunit.client.1.smithi125.stdout:3/660: mkdir d0/db1/dda 0 2024-02-19T19:12:26.339 INFO:tasks.workunit.client.1.smithi125.stdout:3/661: stat d0/d1 0 2024-02-19T19:12:26.340 INFO:tasks.workunit.client.1.smithi125.stdout:9/911: mkdir d8/d2e/d4c/d84/d10c/d13a 0 2024-02-19T19:12:26.340 INFO:tasks.workunit.client.1.smithi125.stdout:3/662: mkdir d0/d1/d1e/d60/d6a/ddb 0 2024-02-19T19:12:26.340 INFO:tasks.workunit.client.1.smithi125.stdout:9/912: rmdir d8/d15/d32/d4f/d85/de2 39 2024-02-19T19:12:26.340 INFO:tasks.workunit.client.1.smithi125.stdout:3/663: chown d0/d1/l37 395 1 2024-02-19T19:12:26.340 INFO:tasks.workunit.client.1.smithi125.stdout:3/664: rmdir d0/d1/d4b/d52 39 2024-02-19T19:12:26.340 INFO:tasks.workunit.client.1.smithi125.stdout:9/913: rename d8/d2e/d4c/d84/d10c to d8/d15/d22/de0/d13b 0 2024-02-19T19:12:26.340 INFO:tasks.workunit.client.1.smithi125.stdout:9/914: creat d8/d2e/d4c/d84/f13c x:0 0 0 2024-02-19T19:12:26.340 INFO:tasks.workunit.client.1.smithi125.stdout:3/665: creat d0/d1/d1e/d60/d7c/fdc x:0 0 0 2024-02-19T19:12:26.341 INFO:tasks.workunit.client.1.smithi125.stdout:9/915: read - d8/d15/d32/f110 zero size 2024-02-19T19:12:26.456 INFO:tasks.workunit.client.1.smithi125.stdout:2/696: sync 2024-02-19T19:12:26.456 INFO:tasks.workunit.client.1.smithi125.stdout:8/723: sync 2024-02-19T19:12:26.456 INFO:tasks.workunit.client.1.smithi125.stdout:5/987: sync 2024-02-19T19:12:26.456 INFO:tasks.workunit.client.1.smithi125.stdout:6/935: sync 2024-02-19T19:12:26.456 INFO:tasks.workunit.client.1.smithi125.stdout:7/746: sync 2024-02-19T19:12:26.456 INFO:tasks.workunit.client.1.smithi125.stdout:0/804: sync 2024-02-19T19:12:26.457 INFO:tasks.workunit.client.1.smithi125.stdout:5/988: getdents db/d17/d85 0 2024-02-19T19:12:26.457 INFO:tasks.workunit.client.1.smithi125.stdout:6/936: getdents d6/db/d5d/d2f/d45/dd9/d16/d11c 0 2024-02-19T19:12:26.457 INFO:tasks.workunit.client.1.smithi125.stdout:5/989: stat db/d17/d58/d33/d98/fb8 0 2024-02-19T19:12:26.457 INFO:tasks.workunit.client.1.smithi125.stdout:0/805: creat d5/d19/d27/d32/dd7/f11b x:0 0 0 2024-02-19T19:12:26.457 INFO:tasks.workunit.client.1.smithi125.stdout:7/747: mkdir d12/d3d/dd7 0 2024-02-19T19:12:26.457 INFO:tasks.workunit.client.1.smithi125.stdout:6/937: creat d6/db/d5d/d2f/d45/dd9/d3b/de1/f13a x:0 0 0 2024-02-19T19:12:26.457 INFO:tasks.workunit.client.1.smithi125.stdout:0/806: unlink d5/d19/c30 0 2024-02-19T19:12:26.457 INFO:tasks.workunit.client.1.smithi125.stdout:5/990: mknod db/d17/d58/d33/d98/dae/dfd/c142 0 2024-02-19T19:12:26.458 INFO:tasks.workunit.client.1.smithi125.stdout:7/748: rename d12 to d12/d18/d44/d3b/d59/d2a/d31/d50/d60/dd8 22 2024-02-19T19:12:26.458 INFO:tasks.workunit.client.1.smithi125.stdout:0/807: stat d5/d9/l1e 0 2024-02-19T19:12:26.458 INFO:tasks.workunit.client.1.smithi125.stdout:6/938: stat d6/db/d98/d129/d139/cbf 0 2024-02-19T19:12:26.458 INFO:tasks.workunit.client.1.smithi125.stdout:5/991: rmdir db/d17/d58/d33/d64 39 2024-02-19T19:12:26.458 INFO:tasks.workunit.client.1.smithi125.stdout:7/749: dread d12/d18/d44/d51/f64 [942080,20480] 0 2024-02-19T19:12:26.458 INFO:tasks.workunit.client.1.smithi125.stdout:9/916: dwrite d8/d15/d22/d44/f92 [69632,77824] 0 2024-02-19T19:12:26.458 INFO:tasks.workunit.client.1.smithi125.stdout:9/917: creat d8/d15/d22/d4e/d90/f13d x:0 0 0 2024-02-19T19:12:26.458 INFO:tasks.workunit.client.1.smithi125.stdout:3/666: dwrite d0/d1/d1e/f68 [2158592,8192] 0 2024-02-19T19:12:26.458 INFO:tasks.workunit.client.1.smithi125.stdout:9/918: rmdir d8/d2e/d4c/d96 39 2024-02-19T19:12:26.459 INFO:tasks.workunit.client.1.smithi125.stdout:4/668: sync 2024-02-19T19:12:26.459 INFO:tasks.workunit.client.1.smithi125.stdout:9/919: readlink d8/d15/d22/d44/l118 0 2024-02-19T19:12:26.459 INFO:tasks.workunit.client.1.smithi125.stdout:9/920: rmdir d8/d15/d32/d4f/d6e 39 2024-02-19T19:12:26.459 INFO:tasks.workunit.client.1.smithi125.stdout:4/669: chown d0/d7/d30/d42/d7b/fdd 1814993386 1 2024-02-19T19:12:26.459 INFO:tasks.workunit.client.1.smithi125.stdout:0/808: write d5/d33/d42/f65 [36472,124176] 0 2024-02-19T19:12:26.459 INFO:tasks.workunit.client.1.smithi125.stdout:3/667: creat d0/d1/d4b/d52/d81/dd0/fdd x:0 0 0 2024-02-19T19:12:26.459 INFO:tasks.workunit.client.1.smithi125.stdout:4/670: truncate d0/d7/d85/fa0 597964 0 2024-02-19T19:12:26.459 INFO:tasks.workunit.client.1.smithi125.stdout:3/668: write d0/f3c [1543420,10056] 0 2024-02-19T19:12:26.459 INFO:tasks.workunit.client.1.smithi125.stdout:3/669: rmdir d0/d95/d9c/dba 39 2024-02-19T19:12:26.460 INFO:tasks.workunit.client.1.smithi125.stdout:3/670: chown d0/f24 96 1 2024-02-19T19:12:26.460 INFO:tasks.workunit.client.1.smithi125.stdout:9/921: write d8/d15/d32/d4f/d6e/ff3 [640415,78432] 0 2024-02-19T19:12:26.460 INFO:tasks.workunit.client.1.smithi125.stdout:3/671: mknod d0/d1/d1e/d69/cde 0 2024-02-19T19:12:26.460 INFO:tasks.workunit.client.1.smithi125.stdout:3/672: dread d0/de/f6c [278528,20480] 0 2024-02-19T19:12:26.460 INFO:tasks.workunit.client.1.smithi125.stdout:3/673: mkdir d0/d95/d9c/daf/ddf 0 2024-02-19T19:12:26.460 INFO:tasks.workunit.client.1.smithi125.stdout:3/674: truncate d0/d1/d4b/d52/d81/f86 170892 0 2024-02-19T19:12:26.460 INFO:tasks.workunit.client.1.smithi125.stdout:3/675: mkdir d0/d95/d9c/dbf/de0 0 2024-02-19T19:12:26.461 INFO:tasks.workunit.client.1.smithi125.stdout:3/676: rename d0/d1/d4b/f7b to d0/d1/d1e/d60/d73/d74/d82/fe1 0 2024-02-19T19:12:26.461 INFO:tasks.workunit.client.1.smithi125.stdout:3/677: mkdir d0/d1/d1e/d60/de2 0 2024-02-19T19:12:26.494 INFO:tasks.workunit.client.1.smithi125.stdout:7/750: fdatasync fc 0 2024-02-19T19:12:26.494 INFO:tasks.workunit.client.1.smithi125.stdout:7/751: creat d12/d18/d44/d3b/d59/d2a/d6a/d6d/fd9 x:0 0 0 2024-02-19T19:12:26.494 INFO:tasks.workunit.client.1.smithi125.stdout:7/752: chown d12/d18/d44/d3b/d59/d2a/d6a/l55 1 1 2024-02-19T19:12:26.495 INFO:tasks.workunit.client.1.smithi125.stdout:7/753: symlink d12/d18/d44/d3b/d59/d26/d30/d37/lda 0 2024-02-19T19:12:26.495 INFO:tasks.workunit.client.1.smithi125.stdout:7/754: rename d12/d18/d44/cc7 to d12/d18/d44/d3b/d59/d2a/d6a/d6d/cdb 0 2024-02-19T19:12:26.498 INFO:tasks.workunit.client.1.smithi125.stdout:0/809: write d5/d15/d2c/d80/dfa/dc8/f118 [1049266,4583] 0 2024-02-19T19:12:26.498 INFO:tasks.workunit.client.1.smithi125.stdout:0/810: rmdir d5/d19/d27/d32/d70 39 2024-02-19T19:12:26.498 INFO:tasks.workunit.client.1.smithi125.stdout:0/811: rmdir d5/d15/d2c 39 2024-02-19T19:12:26.498 INFO:tasks.workunit.client.1.smithi125.stdout:0/812: creat d5/d1a/d4c/f11c x:0 0 0 2024-02-19T19:12:26.502 INFO:tasks.workunit.client.1.smithi125.stdout:2/697: dwrite d1/d27/d1d/d16/fbd [417792,45056] 0 2024-02-19T19:12:26.502 INFO:tasks.workunit.client.1.smithi125.stdout:0/813: truncate d5/d33/d9b/fef 1117091 0 2024-02-19T19:12:26.502 INFO:tasks.workunit.client.1.smithi125.stdout:4/671: dwrite d0/d7/d30/d42/d7b/f99 [1261568,118784] 0 2024-02-19T19:12:26.502 INFO:tasks.workunit.client.1.smithi125.stdout:2/698: creat d1/d36/d70/d85/fce x:0 0 0 2024-02-19T19:12:26.502 INFO:tasks.workunit.client.1.smithi125.stdout:0/814: symlink d5/d19/d27/d11a/l11d 0 2024-02-19T19:12:26.502 INFO:tasks.workunit.client.1.smithi125.stdout:4/672: symlink d0/d32/le2 0 2024-02-19T19:12:26.502 INFO:tasks.workunit.client.1.smithi125.stdout:2/699: dread d1/d36/f67 [675840,8192] 0 2024-02-19T19:12:26.503 INFO:tasks.workunit.client.1.smithi125.stdout:4/673: truncate d0/d7/d30/d42/d7b/fb7 1527141 0 2024-02-19T19:12:26.503 INFO:tasks.workunit.client.1.smithi125.stdout:5/992: dwrite db/d17/d58/d33/d98/dae/dfd/d5d/f107 [237568,20480] 0 2024-02-19T19:12:26.503 INFO:tasks.workunit.client.1.smithi125.stdout:8/724: dwrite db/d18/d30/d3c/f53 [811008,57344] 0 2024-02-19T19:12:26.503 INFO:tasks.workunit.client.1.smithi125.stdout:6/939: dwrite d6/db/d5d/d2f/d45/f60 [1691648,28672] 0 2024-02-19T19:12:26.503 INFO:tasks.workunit.client.1.smithi125.stdout:7/755: unlink d12/d18/d44/d3b/d59/d2a/d6a/d6d/cdb 0 2024-02-19T19:12:26.503 INFO:tasks.workunit.client.1.smithi125.stdout:5/993: symlink db/d17/d58/d33/d53/dce/l143 0 2024-02-19T19:12:26.503 INFO:tasks.workunit.client.1.smithi125.stdout:5/994: chown db/f69 1 1 2024-02-19T19:12:26.503 INFO:tasks.workunit.client.1.smithi125.stdout:6/940: creat d6/db/d5d/d2f/d7b/f13b x:0 0 0 2024-02-19T19:12:26.503 INFO:tasks.workunit.client.1.smithi125.stdout:2/700: mkdir d1/d36/dc0/dcf 0 2024-02-19T19:12:26.504 INFO:tasks.workunit.client.1.smithi125.stdout:5/995: rename db/f122 to db/d17/d58/d33/d64/f144 0 2024-02-19T19:12:26.504 INFO:tasks.workunit.client.1.smithi125.stdout:5/996: truncate db/d17/d58/d4f/f13b 570541 0 2024-02-19T19:12:26.504 INFO:tasks.workunit.client.1.smithi125.stdout:6/941: rename d6/db/d5d/dc4/d133 to d6/db/d5d/d29/d13c 0 2024-02-19T19:12:26.504 INFO:tasks.workunit.client.1.smithi125.stdout:5/997: creat db/d26/d51/d105/f145 x:0 0 0 2024-02-19T19:12:26.504 INFO:tasks.workunit.client.1.smithi125.stdout:5/998: truncate db/d17/d58/f128 1440615 0 2024-02-19T19:12:26.504 INFO:tasks.workunit.client.1.smithi125.stdout:5/999: readlink db/d17/d58/l2a 0 2024-02-19T19:12:26.504 INFO:tasks.workunit.client.1.smithi125.stdout:2/701: write d1/fb3 [1262580,67002] 0 2024-02-19T19:12:26.504 INFO:tasks.workunit.client.1.smithi125.stdout:2/702: unlink d1/d36/d70/f49 0 2024-02-19T19:12:26.505 INFO:tasks.workunit.client.1.smithi125.stdout:2/703: getdents d1/d36/d70/d85/da4 0 2024-02-19T19:12:26.505 INFO:tasks.workunit.client.1.smithi125.stdout:2/704: truncate d1/d27/d1d/d2c/d2e/fb2 162075 0 2024-02-19T19:12:26.505 INFO:tasks.workunit.client.1.smithi125.stdout:2/705: link d1/d27/d1d/d2c/d2e/f6c d1/d27/d1d/d25/fd0 0 2024-02-19T19:12:26.505 INFO:tasks.workunit.client.1.smithi125.stdout:2/706: write d1/d27/d1d/d2c/f31 [2724288,17358] 0 2024-02-19T19:12:26.505 INFO:tasks.workunit.client.1.smithi125.stdout:2/707: read d1/d27/f11 [223177,33136] 0 2024-02-19T19:12:26.505 INFO:tasks.workunit.client.1.smithi125.stdout:2/708: chown d1/d27/d1d/d16/fbd 129 1 2024-02-19T19:12:26.505 INFO:tasks.workunit.client.1.smithi125.stdout:2/709: write d1/d27/d1d/d39/f55 [370764,21041] 0 2024-02-19T19:12:26.505 INFO:tasks.workunit.client.1.smithi125.stdout:2/710: write d1/d36/f67 [1302518,57064] 0 2024-02-19T19:12:26.506 INFO:tasks.workunit.client.1.smithi125.stdout:2/711: link d1/d36/d70/c73 d1/d36/d70/d85/da4/cd1 0 2024-02-19T19:12:26.506 INFO:tasks.workunit.client.1.smithi125.stdout:2/712: unlink d1/d27/f8f 0 2024-02-19T19:12:26.506 INFO:tasks.workunit.client.1.smithi125.stdout:3/678: dread d0/d1/d1e/d60/d7c/db6/d71/f7f [950272,122880] 0 2024-02-19T19:12:26.506 INFO:tasks.workunit.client.1.smithi125.stdout:3/679: mknod d0/d1/d1e/d60/d7c/ce3 0 2024-02-19T19:12:26.507 INFO:tasks.workunit.client.1.smithi125.stdout:3/680: getdents d0/d1/d4b/db2 0 2024-02-19T19:12:26.615 INFO:tasks.workunit.client.1.smithi125.stdout:0/815: dwrite d5/d19/d27/de3/fea [581632,106496] 0 2024-02-19T19:12:26.615 INFO:tasks.workunit.client.1.smithi125.stdout:0/816: mknod d5/d19/d48/c11e 0 2024-02-19T19:12:26.615 INFO:tasks.workunit.client.1.smithi125.stdout:0/817: creat d5/d33/d46/de6/f11f x:0 0 0 2024-02-19T19:12:26.616 INFO:tasks.workunit.client.1.smithi125.stdout:0/818: readlink d5/l68 0 2024-02-19T19:12:26.616 INFO:tasks.workunit.client.1.smithi125.stdout:0/819: write d5/d19/d27/dc3/ffd [788251,96391] 0 2024-02-19T19:12:26.616 INFO:tasks.workunit.client.1.smithi125.stdout:0/820: mkdir d5/d1a/d4c/d120 0 2024-02-19T19:12:26.616 INFO:tasks.workunit.client.1.smithi125.stdout:3/681: read d0/d1/d1e/f34 [515189,94872] 0 2024-02-19T19:12:26.616 INFO:tasks.workunit.client.1.smithi125.stdout:3/682: link d0/d1/d4b/f67 d0/d95/d9c/daf/fe4 0 2024-02-19T19:12:26.617 INFO:tasks.workunit.client.1.smithi125.stdout:2/713: dread d1/d27/f5a [200704,118784] 0 2024-02-19T19:12:26.617 INFO:tasks.workunit.client.1.smithi125.stdout:2/714: symlink d1/d27/d1d/ld2 0 2024-02-19T19:12:26.617 INFO:tasks.workunit.client.1.smithi125.stdout:2/715: mknod d1/d36/dc0/cd3 0 2024-02-19T19:12:26.618 INFO:tasks.workunit.client.1.smithi125.stdout:2/716: creat d1/d27/d1d/d25/fd4 x:0 0 0 2024-02-19T19:12:26.618 INFO:tasks.workunit.client.1.smithi125.stdout:2/717: symlink d1/d36/d70/d85/ld5 0 2024-02-19T19:12:26.618 INFO:tasks.workunit.client.1.smithi125.stdout:2/718: chown d1/d27/d1d/d39/fb1 2089933 1 2024-02-19T19:12:26.645 INFO:tasks.workunit.client.1.smithi125.stdout:7/756: fsync d12/d18/d44/d3b/d59/d26/f28 0 2024-02-19T19:12:26.645 INFO:tasks.workunit.client.1.smithi125.stdout:8/725: fdatasync db/d6d/f85 0 2024-02-19T19:12:26.645 INFO:tasks.workunit.client.1.smithi125.stdout:0/821: fdatasync d5/d33/d42/fe7 0 2024-02-19T19:12:26.645 INFO:tasks.workunit.client.1.smithi125.stdout:6/942: fdatasync d6/db/d5d/d2f/d45/dd9/d3b/dda/fb1 0 2024-02-19T19:12:26.645 INFO:tasks.workunit.client.1.smithi125.stdout:6/943: write d6/f11b [618328,56299] 0 2024-02-19T19:12:26.645 INFO:tasks.workunit.client.1.smithi125.stdout:8/726: write db/d18/d30/d3c/d4d/f9f [467246,78919] 0 2024-02-19T19:12:26.646 INFO:tasks.workunit.client.1.smithi125.stdout:8/727: readlink db/l9c 0 2024-02-19T19:12:26.646 INFO:tasks.workunit.client.1.smithi125.stdout:0/822: write d5/d19/d27/d32/d70/f115 [895995,115182] 0 2024-02-19T19:12:26.646 INFO:tasks.workunit.client.1.smithi125.stdout:7/757: write d12/d18/d44/d3b/d59/d26/d30/f35 [1428870,116201] 0 2024-02-19T19:12:26.646 INFO:tasks.workunit.client.1.smithi125.stdout:0/823: readlink d5/d19/d27/l5a 0 2024-02-19T19:12:26.646 INFO:tasks.workunit.client.1.smithi125.stdout:0/824: dread d5/d19/d27/ff5 [335872,98304] 0 2024-02-19T19:12:26.646 INFO:tasks.workunit.client.1.smithi125.stdout:8/728: truncate db/f1e 926853 0 2024-02-19T19:12:26.646 INFO:tasks.workunit.client.1.smithi125.stdout:8/729: readlink db/d18/d2f/l7e 0 2024-02-19T19:12:26.646 INFO:tasks.workunit.client.1.smithi125.stdout:8/730: mkdir db/d18/d30/d3c/d4d/d5d/d6f/dea 0 2024-02-19T19:12:26.647 INFO:tasks.workunit.client.1.smithi125.stdout:3/683: dwrite d0/d1/d4b/d52/f8a [958464,28672] 0 2024-02-19T19:12:26.647 INFO:tasks.workunit.client.1.smithi125.stdout:8/731: dread - db/d18/d30/d3c/d4d/d5d/fc8 zero size 2024-02-19T19:12:26.647 INFO:tasks.workunit.client.1.smithi125.stdout:8/732: chown db/d18/d30/d48/d67/lcf 0 1 2024-02-19T19:12:26.647 INFO:tasks.workunit.client.1.smithi125.stdout:3/684: write d0/d1/d1e/f1f [3466339,87721] 0 2024-02-19T19:12:26.647 INFO:tasks.workunit.client.1.smithi125.stdout:3/685: creat d0/d1/d39/db4/dcd/fe5 x:0 0 0 2024-02-19T19:12:26.647 INFO:tasks.workunit.client.1.smithi125.stdout:3/686: dread d0/d1/d1e/f34 [1413120,106496] 0 2024-02-19T19:12:26.647 INFO:tasks.workunit.client.1.smithi125.stdout:3/687: chown d0/d1/d39/c88 0 1 2024-02-19T19:12:26.647 INFO:tasks.workunit.client.1.smithi125.stdout:3/688: truncate d0/f33 824264 0 2024-02-19T19:12:26.648 INFO:tasks.workunit.client.1.smithi125.stdout:3/689: symlink d0/d1/d4b/d52/d81/db7/le6 0 2024-02-19T19:12:26.648 INFO:tasks.workunit.client.1.smithi125.stdout:3/690: write d0/d1/d4b/d52/d81/f8f [4724,1243] 0 2024-02-19T19:12:26.661 INFO:tasks.workunit.client.1.smithi125.stdout:0/825: truncate d5/d19/d27/d32/d70/fc0 412559 0 2024-02-19T19:12:26.661 INFO:tasks.workunit.client.1.smithi125.stdout:6/944: dwrite d6/db/d5d/f40 [1368064,110592] 0 2024-02-19T19:12:26.661 INFO:tasks.workunit.client.1.smithi125.stdout:7/758: dwrite d12/d18/d2c/d4e/f99 [847872,53248] 0 2024-02-19T19:12:26.662 INFO:tasks.workunit.client.1.smithi125.stdout:2/719: dread d1/d27/d1d/da8/d7b/d91/faf [40960,90112] 0 2024-02-19T19:12:26.662 INFO:tasks.workunit.client.1.smithi125.stdout:0/826: truncate d5/d19/d27/d32/f8d 4264515 0 2024-02-19T19:12:26.662 INFO:tasks.workunit.client.1.smithi125.stdout:2/720: unlink d1/d36/d70/d4b/l84 0 2024-02-19T19:12:26.662 INFO:tasks.workunit.client.1.smithi125.stdout:6/945: creat d6/db/d98/f13d x:0 0 0 2024-02-19T19:12:26.662 INFO:tasks.workunit.client.1.smithi125.stdout:6/946: truncate d6/db/d98/f13d 1043600 0 2024-02-19T19:12:26.662 INFO:tasks.workunit.client.1.smithi125.stdout:6/947: symlink d6/db/d5d/d93/da2/l13e 0 2024-02-19T19:12:26.663 INFO:tasks.workunit.client.1.smithi125.stdout:8/733: dread db/d81/d95/fb8 [12288,90112] 0 2024-02-19T19:12:26.664 INFO:tasks.workunit.client.1.smithi125.stdout:8/734: chown db/d18/c35 4 1 2024-02-19T19:12:26.664 INFO:tasks.workunit.client.1.smithi125.stdout:8/735: chown db/d18/d30/d80/d9e/lcd 6478723 1 2024-02-19T19:12:26.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:26 smithi125 ceph-mon[86115]: pgmap v158: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:12:26.735 INFO:tasks.workunit.client.1.smithi125.stdout:3/691: fdatasync d0/de/f6c 0 2024-02-19T19:12:26.736 INFO:tasks.workunit.client.1.smithi125.stdout:0/827: fsync d5/d33/d46/f66 0 2024-02-19T19:12:26.736 INFO:tasks.workunit.client.1.smithi125.stdout:0/828: stat d5/d19/d27/d32/d70/fc0 0 2024-02-19T19:12:26.736 INFO:tasks.workunit.client.1.smithi125.stdout:0/829: write d5/fbf [881632,116373] 0 2024-02-19T19:12:26.736 INFO:tasks.workunit.client.1.smithi125.stdout:7/759: dwrite d12/d18/d66/da0/fcf [73728,16384] 0 2024-02-19T19:12:26.736 INFO:tasks.workunit.client.1.smithi125.stdout:7/760: write d12/d18/d63/f9f [49360,51539] 0 2024-02-19T19:12:26.737 INFO:tasks.workunit.client.1.smithi125.stdout:2/721: dwrite d1/f47 [1388544,106496] 0 2024-02-19T19:12:26.737 INFO:tasks.workunit.client.1.smithi125.stdout:3/692: dwrite d0/d1/d4b/f50 [1179648,118784] 0 2024-02-19T19:12:26.739 INFO:tasks.workunit.client.1.smithi125.stdout:2/722: creat d1/d27/d1d/da8/d7b/d91/fd6 x:0 0 0 2024-02-19T19:12:26.739 INFO:tasks.workunit.client.1.smithi125.stdout:3/693: write d0/d95/d9c/daf/fe4 [419411,11665] 0 2024-02-19T19:12:26.739 INFO:tasks.workunit.client.1.smithi125.stdout:6/948: symlink d6/db/d98/d129/d139/dbc/l13f 0 2024-02-19T19:12:26.739 INFO:tasks.workunit.client.1.smithi125.stdout:2/723: write d1/d27/d1d/d39/f55 [1189283,26628] 0 2024-02-19T19:12:26.739 INFO:tasks.workunit.client.1.smithi125.stdout:2/724: chown d1/d27/d1d/d25/d2a/c94 65810 1 2024-02-19T19:12:26.739 INFO:tasks.workunit.client.1.smithi125.stdout:6/949: symlink d6/db/d5d/d2f/d45/dd9/d3b/dcc/df4/d112/l140 0 2024-02-19T19:12:26.739 INFO:tasks.workunit.client.1.smithi125.stdout:3/694: write d0/d95/fa7 [269183,129494] 0 2024-02-19T19:12:26.739 INFO:tasks.workunit.client.1.smithi125.stdout:6/950: mkdir d6/db/d5d/d29/d141 0 2024-02-19T19:12:26.750 INFO:tasks.workunit.client.1.smithi125.stdout:8/736: dread db/d18/d30/d3c/d4d/d5d/d6f/f74 [57344,90112] 0 2024-02-19T19:12:26.751 INFO:tasks.workunit.client.1.smithi125.stdout:8/737: rmdir db/d18/d30/d3c/d4d/d5d/d6f 39 2024-02-19T19:12:26.751 INFO:tasks.workunit.client.1.smithi125.stdout:8/738: mkdir db/d18/d30/d48/d67/d96/deb 0 2024-02-19T19:12:26.751 INFO:tasks.workunit.client.1.smithi125.stdout:8/739: write db/d6d/fd6 [60979,5550] 0 2024-02-19T19:12:26.751 INFO:tasks.workunit.client.1.smithi125.stdout:8/740: dread db/d18/d30/d3c/d4d/f56 [2572288,65536] 0 2024-02-19T19:12:26.788 INFO:tasks.workunit.client.1.smithi125.stdout:7/761: fsync d12/d18/d44/d51/fbb 0 2024-02-19T19:12:26.788 INFO:tasks.workunit.client.1.smithi125.stdout:7/762: symlink d12/d18/d44/d3b/d59/ldc 0 2024-02-19T19:12:26.788 INFO:tasks.workunit.client.1.smithi125.stdout:7/763: truncate d12/d18/d44/d3b/d59/d26/d30/f35 2178439 0 2024-02-19T19:12:26.788 INFO:tasks.workunit.client.1.smithi125.stdout:6/951: fdatasync d6/db/d5d/d2f/d45/dd9/d3b/dda/fb1 0 2024-02-19T19:12:26.788 INFO:tasks.workunit.client.1.smithi125.stdout:7/764: symlink d12/d18/d2c/d4e/d82/ldd 0 2024-02-19T19:12:26.788 INFO:tasks.workunit.client.1.smithi125.stdout:7/765: rmdir d12/d18/d44/d3b/d59/d2a 39 2024-02-19T19:12:26.788 INFO:tasks.workunit.client.1.smithi125.stdout:7/766: rename d12/d18/l1d to d12/lde 0 2024-02-19T19:12:26.789 INFO:tasks.workunit.client.1.smithi125.stdout:6/952: mknod d6/db/d5d/d2f/d45/dd9/d3b/dcc/df4/d112/c142 0 2024-02-19T19:12:26.789 INFO:tasks.workunit.client.1.smithi125.stdout:6/953: chown d6/db/d5d/d2f/d45/d107/f92 2 1 2024-02-19T19:12:26.789 INFO:tasks.workunit.client.1.smithi125.stdout:7/767: mkdir d12/d18/d44/d3b/d59/d26/d30/d37/ddf 0 2024-02-19T19:12:26.789 INFO:tasks.workunit.client.1.smithi125.stdout:3/695: dwrite d0/d1/d4b/d52/d81/f8f [65536,122880] 0 2024-02-19T19:12:26.789 INFO:tasks.workunit.client.1.smithi125.stdout:3/696: dread d0/d95/d9c/daf/fe4 [135168,8192] 0 2024-02-19T19:12:26.789 INFO:tasks.workunit.client.1.smithi125.stdout:3/697: dread - d0/d1/d1e/d60/d7c/db6/f75 zero size 2024-02-19T19:12:26.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:26 smithi096 ceph-mon[112483]: pgmap v158: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:12:26.791 INFO:tasks.workunit.client.1.smithi125.stdout:2/725: dwrite d1/d27/d1d/da8/d7b/d91/faa [651264,16384] 0 2024-02-19T19:12:26.791 INFO:tasks.workunit.client.1.smithi125.stdout:7/768: dwrite d12/f45 [425984,12288] 0 2024-02-19T19:12:26.791 INFO:tasks.workunit.client.1.smithi125.stdout:7/769: write d12/f45 [857304,128327] 0 2024-02-19T19:12:26.792 INFO:tasks.workunit.client.1.smithi125.stdout:7/770: readlink d12/d18/d44/d3b/d59/d2a/d6a/d6d/l8d 0 2024-02-19T19:12:26.792 INFO:tasks.workunit.client.1.smithi125.stdout:7/771: mknod d12/d18/d44/d3b/d59/d67/ce0 0 2024-02-19T19:12:26.792 INFO:tasks.workunit.client.1.smithi125.stdout:7/772: readlink d12/d18/d2c/d4e/d82/ldd 0 2024-02-19T19:12:26.792 INFO:tasks.workunit.client.1.smithi125.stdout:7/773: write d12/d18/d44/d3b/d59/d2a/d6a/d6d/fd9 [819162,99423] 0 2024-02-19T19:12:26.805 INFO:tasks.workunit.client.1.smithi125.stdout:8/741: dread db/d18/d30/d48/f51 [589824,73728] 0 2024-02-19T19:12:26.879 INFO:tasks.workunit.client.1.smithi125.stdout:0/830: fdatasync d5/d19/d27/de3/fea 0 2024-02-19T19:12:26.883 INFO:tasks.workunit.client.1.smithi125.stdout:6/954: write d6/db/d5d/d2f/d45/d4e/f53 [328082,79957] 0 2024-02-19T19:12:26.883 INFO:tasks.workunit.client.1.smithi125.stdout:6/955: symlink d6/db/d5d/d2f/d45/dd9/d16/d128/l143 0 2024-02-19T19:12:26.883 INFO:tasks.workunit.client.1.smithi125.stdout:6/956: read - d6/db/d5d/d2f/d45/dd9/d3b/fd5 zero size 2024-02-19T19:12:26.883 INFO:tasks.workunit.client.1.smithi125.stdout:6/957: unlink d6/db/d5d/d2f/d45/dd9/d3b/dda/fcd 0 2024-02-19T19:12:26.884 INFO:tasks.workunit.client.1.smithi125.stdout:6/958: link d6/db/d5d/d29/d68/l118 d6/db/d5d/d2f/d45/dd9/dbb/d12f/l144 0 2024-02-19T19:12:26.884 INFO:tasks.workunit.client.1.smithi125.stdout:6/959: dread - d6/db/d5d/d2f/d45/dd9/f7c zero size 2024-02-19T19:12:26.884 INFO:tasks.workunit.client.1.smithi125.stdout:2/726: dwrite d1/d27/d1d/d2c/f31 [2154496,40960] 0 2024-02-19T19:12:26.884 INFO:tasks.workunit.client.1.smithi125.stdout:6/960: dwrite d6/db/d5d/d2f/d45/dd9/d16/f5c [2760704,53248] 0 2024-02-19T19:12:26.928 INFO:tasks.workunit.client.1.smithi125.stdout:0/831: fsync d5/d15/d2c/d80/dfa/dc8/fb4 0 2024-02-19T19:12:26.933 INFO:tasks.workunit.client.1.smithi125.stdout:0/832: rename d5/d15/d2c/d80/dfa/dc8/f118 to d5/d33/d10c/f121 0 2024-02-19T19:12:26.933 INFO:tasks.workunit.client.1.smithi125.stdout:6/961: mkdir d6/db/d5d/d2f/d45/d107/d145 0 2024-02-19T19:12:26.933 INFO:tasks.workunit.client.1.smithi125.stdout:8/742: dwrite db/d18/d30/d48/d67/d96/fe5 [516096,28672] 0 2024-02-19T19:12:26.933 INFO:tasks.workunit.client.1.smithi125.stdout:6/962: mknod d6/db/d5d/d2f/d45/d4e/def/c146 0 2024-02-19T19:12:26.933 INFO:tasks.workunit.client.1.smithi125.stdout:8/743: creat db/d6d/fec x:0 0 0 2024-02-19T19:12:26.933 INFO:tasks.workunit.client.1.smithi125.stdout:8/744: write db/d18/d30/d3c/d4d/f56 [428316,21921] 0 2024-02-19T19:12:26.933 INFO:tasks.workunit.client.1.smithi125.stdout:2/727: mknod d1/cd7 0 2024-02-19T19:12:26.933 INFO:tasks.workunit.client.1.smithi125.stdout:2/728: readlink d1/d36/d70/d4b/l62 0 2024-02-19T19:12:26.934 INFO:tasks.workunit.client.1.smithi125.stdout:2/729: chown d1/d27/d1d/d25/d2a/f41 461150874 1 2024-02-19T19:12:26.934 INFO:tasks.workunit.client.1.smithi125.stdout:8/745: creat db/fed x:0 0 0 2024-02-19T19:12:26.934 INFO:tasks.workunit.client.1.smithi125.stdout:8/746: readlink db/d18/d30/d3c/d4d/l5b 0 2024-02-19T19:12:26.934 INFO:tasks.workunit.client.1.smithi125.stdout:8/747: write db/d18/d30/d80/dac/fbb [369409,25643] 0 2024-02-19T19:12:26.935 INFO:tasks.workunit.client.1.smithi125.stdout:0/833: dwrite d5/d19/d27/d32/dd7/f11b [843776,73728] 0 2024-02-19T19:12:26.935 INFO:tasks.workunit.client.1.smithi125.stdout:0/834: chown d5/d19/d2b/c6e 74 1 2024-02-19T19:12:26.935 INFO:tasks.workunit.client.1.smithi125.stdout:0/835: read d5/d19/f78 [155553,115829] 0 2024-02-19T19:12:26.935 INFO:tasks.workunit.client.1.smithi125.stdout:0/836: rmdir d5/d19/d2b 39 2024-02-19T19:12:26.935 INFO:tasks.workunit.client.1.smithi125.stdout:2/730: dwrite d1/d27/f10 [2744320,114688] 0 2024-02-19T19:12:27.001 INFO:tasks.workunit.client.1.smithi125.stdout:2/731: dwrite d1/d27/d1d/da8/f80 [1306624,16384] 0 2024-02-19T19:12:27.002 INFO:tasks.workunit.client.1.smithi125.stdout:2/732: creat d1/d27/d45/d7a/fd8 x:0 0 0 2024-02-19T19:12:27.002 INFO:tasks.workunit.client.1.smithi125.stdout:2/733: write d1/d27/d1d/da8/d7b/fbe [48417,64962] 0 2024-02-19T19:12:27.002 INFO:tasks.workunit.client.1.smithi125.stdout:2/734: creat d1/d27/d1d/da8/d7b/fd9 x:0 0 0 2024-02-19T19:12:27.002 INFO:tasks.workunit.client.1.smithi125.stdout:2/735: stat d1/d27/d1d/d25/da0/dc3 0 2024-02-19T19:12:27.002 INFO:tasks.workunit.client.1.smithi125.stdout:2/736: readlink d1/d27/d1d/da8/d7b/d91/l9d 0 2024-02-19T19:12:27.031 INFO:tasks.workunit.client.1.smithi125.stdout:7/774: fdatasync d12/d18/d2c/d4e/f99 0 2024-02-19T19:12:27.035 INFO:tasks.workunit.client.1.smithi125.stdout:2/737: write d1/d27/d1d/da8/fa1 [789478,76677] 0 2024-02-19T19:12:27.045 INFO:tasks.workunit.client.1.smithi125.stdout:2/738: dread d1/d27/d1d/d39/f7e [782336,90112] 0 2024-02-19T19:12:27.046 INFO:tasks.workunit.client.1.smithi125.stdout:7/775: dwrite d12/d18/d44/d3b/d59/d26/d30/d37/f3f [2035712,32768] 0 2024-02-19T19:12:27.046 INFO:tasks.workunit.client.1.smithi125.stdout:7/776: readlink d12/d18/d2c/db5/dca/l7d 0 2024-02-19T19:12:27.051 INFO:tasks.workunit.client.1.smithi125.stdout:7/777: symlink d12/d18/d66/da0/le1 0 2024-02-19T19:12:27.051 INFO:tasks.workunit.client.1.smithi125.stdout:2/739: write d1/d27/d1d/d25/d2a/f34 [2091173,79190] 0 2024-02-19T19:12:27.051 INFO:tasks.workunit.client.1.smithi125.stdout:2/740: dread d1/d27/d1d/d2c/d2e/fc6 [561152,20480] 0 2024-02-19T19:12:27.052 INFO:tasks.workunit.client.1.smithi125.stdout:2/741: chown d1/d27/d1d/da8/d7b/fbe 1473055647 1 2024-02-19T19:12:27.052 INFO:tasks.workunit.client.1.smithi125.stdout:2/742: rename d1/d27/d1d/d25/da3/fa7 to d1/d27/d1d/da8/fda 0 2024-02-19T19:12:27.052 INFO:tasks.workunit.client.1.smithi125.stdout:2/743: creat d1/d27/d1d/da8/fdb x:0 0 0 2024-02-19T19:12:27.052 INFO:tasks.workunit.client.1.smithi125.stdout:2/744: write d1/d36/f67 [843914,113909] 0 2024-02-19T19:12:27.052 INFO:tasks.workunit.client.1.smithi125.stdout:2/745: dread d1/f2 [167936,94208] 0 2024-02-19T19:12:27.054 INFO:tasks.workunit.client.1.smithi125.stdout:7/778: dwrite d12/d18/d44/d3b/d59/d26/d30/d37/f4b [1794048,77824] 0 2024-02-19T19:12:27.054 INFO:tasks.workunit.client.1.smithi125.stdout:7/779: dread d12/d18/d44/d51/f9b [761856,73728] 0 2024-02-19T19:12:27.054 INFO:tasks.workunit.client.1.smithi125.stdout:7/780: chown d12/d18/d44/d3b/d59/d2a/d31/d50/ca6 7 1 2024-02-19T19:12:27.054 INFO:tasks.workunit.client.1.smithi125.stdout:7/781: write d12/d18/d44/d3b/d59/d2a/d31/d50/fa1 [718638,42171] 0 2024-02-19T19:12:27.054 INFO:tasks.workunit.client.1.smithi125.stdout:7/782: rmdir d12/d18/d44/d3b/d59/d3e 39 2024-02-19T19:12:27.054 INFO:tasks.workunit.client.1.smithi125.stdout:7/783: chown d12/d18/d44/d3b/d59/d2a/d31/d50/c91 23748844 1 2024-02-19T19:12:27.054 INFO:tasks.workunit.client.1.smithi125.stdout:2/746: dwrite d1/d27/d1d/d16/fbd [57344,16384] 0 2024-02-19T19:12:27.054 INFO:tasks.workunit.client.1.smithi125.stdout:2/747: rename d1/d27/f22 to d1/d36/d70/fdc 0 2024-02-19T19:12:27.055 INFO:tasks.workunit.client.1.smithi125.stdout:2/748: symlink d1/d27/d1d/d25/da0/dc3/dc5/ldd 0 2024-02-19T19:12:27.055 INFO:tasks.workunit.client.1.smithi125.stdout:2/749: write d1/d27/f33 [2075604,55368] 0 2024-02-19T19:12:27.055 INFO:tasks.workunit.client.1.smithi125.stdout:2/750: mknod d1/d36/cde 0 2024-02-19T19:12:27.159 INFO:tasks.workunit.client.1.smithi125.stdout:7/784: mknod d12/d18/d44/ce2 0 2024-02-19T19:12:27.159 INFO:tasks.workunit.client.1.smithi125.stdout:7/785: write d12/d18/d44/d3b/d59/d2a/d6a/f9e [12978,41733] 0 2024-02-19T19:12:27.159 INFO:tasks.workunit.client.1.smithi125.stdout:7/786: symlink d12/d18/d44/d3b/d59/le3 0 2024-02-19T19:12:27.160 INFO:tasks.workunit.client.1.smithi125.stdout:2/751: dwrite d1/fb3 [77824,4096] 0 2024-02-19T19:12:27.160 INFO:tasks.workunit.client.1.smithi125.stdout:2/752: stat d1/d36/d70/d85 0 2024-02-19T19:12:27.160 INFO:tasks.workunit.client.1.smithi125.stdout:2/753: mkdir d1/d27/d1d/d25/d2a/ddf 0 2024-02-19T19:12:27.208 INFO:tasks.workunit.client.1.smithi125.stdout:2/754: rename d1/d27/d1d/d25/fd4 to d1/d36/dc0/dcf/fe0 0 2024-02-19T19:12:27.208 INFO:tasks.workunit.client.1.smithi125.stdout:2/755: dread - d1/d27/d1d/d16/f78 zero size 2024-02-19T19:12:27.209 INFO:tasks.workunit.client.1.smithi125.stdout:2/756: dread d1/d27/d1d/da8/fa1 [643072,110592] 0 2024-02-19T19:12:27.209 INFO:tasks.workunit.client.1.smithi125.stdout:2/757: stat d1/d27/d1d/l26 0 2024-02-19T19:12:27.209 INFO:tasks.workunit.client.1.smithi125.stdout:2/758: chown d1/d27/d1d/da8/d7b/d91/dbc 111 1 2024-02-19T19:12:27.210 INFO:tasks.workunit.client.1.smithi125.stdout:2/759: dwrite d1/ff [1028096,94208] 0 2024-02-19T19:12:27.211 INFO:tasks.workunit.client.1.smithi125.stdout:2/760: rename d1/d36/d70/c73 to d1/d36/d70/ce1 0 2024-02-19T19:12:27.211 INFO:tasks.workunit.client.1.smithi125.stdout:2/761: write d1/d36/d70/f66 [916684,87833] 0 2024-02-19T19:12:27.211 INFO:tasks.workunit.client.1.smithi125.stdout:2/762: mkdir d1/d27/d1d/d25/da0/de2 0 2024-02-19T19:12:27.211 INFO:tasks.workunit.client.1.smithi125.stdout:2/763: symlink d1/d27/d1d/d25/da3/le3 0 2024-02-19T19:12:27.211 INFO:tasks.workunit.client.1.smithi125.stdout:2/764: chown d1/d27/cb 268862 1 2024-02-19T19:12:27.211 INFO:tasks.workunit.client.1.smithi125.stdout:2/765: write d1/d36/dc0/dcf/fe0 [500097,121411] 0 2024-02-19T19:12:27.211 INFO:tasks.workunit.client.1.smithi125.stdout:2/766: chown d1/d27/d1d/d2c/f31 178 1 2024-02-19T19:12:27.211 INFO:tasks.workunit.client.1.smithi125.stdout:2/767: read d1/d27/d1d/da8/d7b/d91/faf [42225,119031] 0 2024-02-19T19:12:27.211 INFO:tasks.workunit.client.1.smithi125.stdout:2/768: readlink d1/l28 0 2024-02-19T19:12:27.212 INFO:tasks.workunit.client.1.smithi125.stdout:2/769: symlink d1/d27/d1d/le4 2 2024-02-19T19:12:27.212 INFO:tasks.workunit.client.1.smithi125.stdout:2/770: symlink d1/d36/d70/d4b/le5 0 2024-02-19T19:12:27.212 INFO:tasks.workunit.client.1.smithi125.stdout:2/771: write d1/d27/d45/f56 [1309529,56707] 0 2024-02-19T19:12:27.213 INFO:tasks.workunit.client.1.smithi125.stdout:9/922: sync 2024-02-19T19:12:27.213 INFO:tasks.workunit.client.1.smithi125.stdout:4/674: sync 2024-02-19T19:12:27.213 INFO:tasks.workunit.client.1.smithi125.stdout:9/923: chown d8/d15/d22/d44/cfd 543938 1 2024-02-19T19:12:27.213 INFO:tasks.workunit.client.1.smithi125.stdout:9/924: stat d8/d15/d22/d4e/d6b 0 2024-02-19T19:12:27.217 INFO:tasks.workunit.client.1.smithi125.stdout:2/772: dwrite d1/d27/f11 [811008,24576] 0 2024-02-19T19:12:27.332 INFO:tasks.workunit.client.1.smithi125.stdout:4/675: fsync d0/d7/d30/d42/d7b/fb0 0 2024-02-19T19:12:27.333 INFO:tasks.workunit.client.1.smithi125.stdout:4/676: rename d0/d7/d30/d6c to d0/d7/d3b/d75/de3 0 2024-02-19T19:12:27.334 INFO:tasks.workunit.client.1.smithi125.stdout:2/773: write d1/d36/dc0/dcf/fe0 [1599978,11554] 0 2024-02-19T19:12:27.334 INFO:tasks.workunit.client.1.smithi125.stdout:9/925: mkdir d8/d15/d22/d44/d13e 0 2024-02-19T19:12:27.334 INFO:tasks.workunit.client.1.smithi125.stdout:2/774: read - d1/d27/d1d/d2c/fbf zero size 2024-02-19T19:12:27.334 INFO:tasks.workunit.client.1.smithi125.stdout:9/926: mkdir d8/d15/d22/d4e/d6b/d111/d13f 0 2024-02-19T19:12:27.334 INFO:tasks.workunit.client.1.smithi125.stdout:2/775: symlink d1/d27/d1d/d25/d2a/le6 0 2024-02-19T19:12:27.334 INFO:tasks.workunit.client.1.smithi125.stdout:9/927: truncate d8/d15/d22/d4e/d6b/f76 623219 0 2024-02-19T19:12:27.355 INFO:tasks.workunit.client.1.smithi125.stdout:4/677: fdatasync d0/df/f73 0 2024-02-19T19:12:27.355 INFO:tasks.workunit.client.1.smithi125.stdout:4/678: chown d0/d7/d30/d42/f86 479309 1 2024-02-19T19:12:27.355 INFO:tasks.workunit.client.1.smithi125.stdout:4/679: chown d0/d7/d30/d58/fd 3227 1 2024-02-19T19:12:27.355 INFO:tasks.workunit.client.1.smithi125.stdout:4/680: creat d0/d7/d3b/d75/de3/fe4 x:0 0 0 2024-02-19T19:12:27.355 INFO:tasks.workunit.client.1.smithi125.stdout:4/681: getdents d0/df 0 2024-02-19T19:12:27.355 INFO:tasks.workunit.client.1.smithi125.stdout:4/682: truncate d0/d7/d3b/f62 422710 0 2024-02-19T19:12:27.355 INFO:tasks.workunit.client.1.smithi125.stdout:2/776: fsync d1/d27/d1d/da8/d7b/d91/f97 0 2024-02-19T19:12:27.356 INFO:tasks.workunit.client.1.smithi125.stdout:2/777: mknod d1/d36/d70/ce7 0 2024-02-19T19:12:27.356 INFO:tasks.workunit.client.1.smithi125.stdout:2/778: readlink d1/d36/d70/d4b/le5 0 2024-02-19T19:12:27.356 INFO:tasks.workunit.client.1.smithi125.stdout:2/779: chown d1/d36/d70/d4b/l51 4 1 2024-02-19T19:12:27.356 INFO:tasks.workunit.client.1.smithi125.stdout:2/780: write d1/d36/f67 [2302254,19253] 0 2024-02-19T19:12:27.356 INFO:tasks.workunit.client.1.smithi125.stdout:2/781: rmdir d1/d36/dc0 39 2024-02-19T19:12:27.356 INFO:tasks.workunit.client.1.smithi125.stdout:2/782: mkdir d1/d36/d70/de8 0 2024-02-19T19:12:27.356 INFO:tasks.workunit.client.1.smithi125.stdout:2/783: rmdir d1/d36/dc0/dcf 39 2024-02-19T19:12:27.357 INFO:tasks.workunit.client.1.smithi125.stdout:2/784: stat d1/d27/d1d/d25/d2a/f41 0 2024-02-19T19:12:27.357 INFO:tasks.workunit.client.1.smithi125.stdout:2/785: chown d1/d36/dc0/dcf 52 1 2024-02-19T19:12:27.357 INFO:tasks.workunit.client.1.smithi125.stdout:2/786: rename d1/d27/d1d/d25/d2a/l46 to d1/d27/d1d/d39/le9 0 2024-02-19T19:12:27.359 INFO:tasks.workunit.client.1.smithi125.stdout:9/928: dwrite d8/d15/f6a [1261568,24576] 0 2024-02-19T19:12:27.359 INFO:tasks.workunit.client.1.smithi125.stdout:9/929: unlink d8/d15/c38 0 2024-02-19T19:12:27.359 INFO:tasks.workunit.client.1.smithi125.stdout:9/930: link d8/d15/d32/d4f/ldf d8/d15/d32/l140 0 2024-02-19T19:12:27.359 INFO:tasks.workunit.client.1.smithi125.stdout:2/787: creat d1/d27/d1d/da8/d7b/fea x:0 0 0 2024-02-19T19:12:27.359 INFO:tasks.workunit.client.1.smithi125.stdout:2/788: rename d1/d27/d1d/da8/d7b/lb8 to d1/d36/d70/d4b/leb 0 2024-02-19T19:12:27.359 INFO:tasks.workunit.client.1.smithi125.stdout:9/931: creat d8/d15/d22/de0/d13b/d13a/f141 x:0 0 0 2024-02-19T19:12:27.359 INFO:tasks.workunit.client.1.smithi125.stdout:9/932: truncate d8/d15/d22/f67 1512864 0 2024-02-19T19:12:27.360 INFO:tasks.workunit.client.1.smithi125.stdout:9/933: unlink d8/d15/d32/d4f/lb5 0 2024-02-19T19:12:27.360 INFO:tasks.workunit.client.1.smithi125.stdout:9/934: rename d8/d15/d22/d4e/d6b/fca to d8/d2e/f142 0 2024-02-19T19:12:27.360 INFO:tasks.workunit.client.1.smithi125.stdout:9/935: creat d8/d15/d22/de0/f143 x:0 0 0 2024-02-19T19:12:27.360 INFO:tasks.workunit.client.1.smithi125.stdout:9/936: getdents d8 0 2024-02-19T19:12:27.360 INFO:tasks.workunit.client.1.smithi125.stdout:9/937: readlink d8/d15/d32/d4f/lff 0 2024-02-19T19:12:27.371 INFO:tasks.workunit.client.1.smithi125.stdout:4/683: dread d0/d7/f2f [778240,8192] 0 2024-02-19T19:12:27.371 INFO:tasks.workunit.client.1.smithi125.stdout:4/684: mknod d0/d7/d3b/d75/de3/dcd/dde/ce5 0 2024-02-19T19:12:27.442 INFO:tasks.workunit.client.1.smithi125.stdout:2/789: dwrite d1/d27/f44 [1073152,36864] 0 2024-02-19T19:12:27.442 INFO:tasks.workunit.client.1.smithi125.stdout:4/685: dwrite d0/d7/d30/d42/f86 [118784,73728] 0 2024-02-19T19:12:27.442 INFO:tasks.workunit.client.1.smithi125.stdout:4/686: dread - d0/d32/fa1 zero size 2024-02-19T19:12:27.442 INFO:tasks.workunit.client.1.smithi125.stdout:2/790: creat d1/d27/d1d/d25/da0/dc3/fec x:0 0 0 2024-02-19T19:12:27.443 INFO:tasks.workunit.client.1.smithi125.stdout:4/687: rename d0/d7/d3b/d77/cbf to d0/d7/dad/db9/ce6 0 2024-02-19T19:12:27.443 INFO:tasks.workunit.client.1.smithi125.stdout:4/688: creat d0/d7/d3b/d77/fe7 x:0 0 0 2024-02-19T19:12:27.443 INFO:tasks.workunit.client.1.smithi125.stdout:4/689: dread d0/d7/d30/d58/f2d [352256,65536] 0 2024-02-19T19:12:27.443 INFO:tasks.workunit.client.1.smithi125.stdout:4/690: write d0/d7/d30/d5d/f9b [1010313,15768] 0 2024-02-19T19:12:27.443 INFO:tasks.workunit.client.1.smithi125.stdout:4/691: write d0/d7/d3b/d75/de3/f93 [1653983,20635] 0 2024-02-19T19:12:27.443 INFO:tasks.workunit.client.1.smithi125.stdout:4/692: getdents d0 0 2024-02-19T19:12:27.443 INFO:tasks.workunit.client.1.smithi125.stdout:4/693: creat d0/d32/fe8 x:0 0 0 2024-02-19T19:12:27.443 INFO:tasks.workunit.client.1.smithi125.stdout:4/694: creat d0/d7/d3b/d75/fe9 x:0 0 0 2024-02-19T19:12:27.454 INFO:tasks.workunit.client.1.smithi125.stdout:9/938: dread d8/d15/d22/f78 [638976,106496] 0 2024-02-19T19:12:27.454 INFO:tasks.workunit.client.1.smithi125.stdout:9/939: creat d8/d15/f144 x:0 0 0 2024-02-19T19:12:27.454 INFO:tasks.workunit.client.1.smithi125.stdout:9/940: chown d8/d15/d32/d4f/ddc/ff5 3 1 2024-02-19T19:12:27.454 INFO:tasks.workunit.client.1.smithi125.stdout:9/941: dread d8/d2e/f108 [581632,53248] 0 2024-02-19T19:12:27.454 INFO:tasks.workunit.client.1.smithi125.stdout:9/942: read d8/d15/d32/f9b [351106,23978] 0 2024-02-19T19:12:27.455 INFO:tasks.workunit.client.1.smithi125.stdout:9/943: creat d8/d15/d32/f145 x:0 0 0 2024-02-19T19:12:27.517 INFO:tasks.workunit.client.1.smithi125.stdout:2/791: dwrite d1/d36/d70/f7c [921600,114688] 0 2024-02-19T19:12:27.581 INFO:tasks.workunit.client.1.smithi125.stdout:4/695: fsync d0/d7/d85/f8f 0 2024-02-19T19:12:27.581 INFO:tasks.workunit.client.1.smithi125.stdout:4/696: mkdir d0/d7/d30/d42/db3/ddf/dea 0 2024-02-19T19:12:27.581 INFO:tasks.workunit.client.1.smithi125.stdout:4/697: symlink d0/d7/d30/d42/db3/ddf/leb 0 2024-02-19T19:12:27.589 INFO:tasks.workunit.client.1.smithi125.stdout:4/698: readlink d0/df/d5e/l7f 0 2024-02-19T19:12:27.589 INFO:tasks.workunit.client.1.smithi125.stdout:2/792: dwrite d1/d27/d1d/da8/d7b/d91/f97 [991232,110592] 0 2024-02-19T19:12:27.589 INFO:tasks.workunit.client.1.smithi125.stdout:4/699: symlink d0/d7/d85/lec 0 2024-02-19T19:12:27.589 INFO:tasks.workunit.client.1.smithi125.stdout:4/700: truncate d0/d7/f71 1954863 0 2024-02-19T19:12:27.589 INFO:tasks.workunit.client.1.smithi125.stdout:2/793: mknod d1/d27/d1d/d25/d2a/ced 0 2024-02-19T19:12:27.590 INFO:tasks.workunit.client.1.smithi125.stdout:2/794: creat d1/d36/d70/de8/fee x:0 0 0 2024-02-19T19:12:27.590 INFO:tasks.workunit.client.1.smithi125.stdout:2/795: stat d1/d27/d45/d7a 0 2024-02-19T19:12:27.590 INFO:tasks.workunit.client.1.smithi125.stdout:2/796: rmdir d1/d27/d1d/da8/d7b 39 2024-02-19T19:12:27.590 INFO:tasks.workunit.client.1.smithi125.stdout:2/797: mkdir d1/d36/dc0/def 0 2024-02-19T19:12:27.648 INFO:tasks.workunit.client.1.smithi125.stdout:3/698: sync 2024-02-19T19:12:27.648 INFO:tasks.workunit.client.1.smithi125.stdout:3/699: write d0/d1/d4b/d52/d81/f86 [1147364,56091] 0 2024-02-19T19:12:27.649 INFO:tasks.workunit.client.1.smithi125.stdout:3/700: dread - d0/d1/d1e/d69/fad zero size 2024-02-19T19:12:27.649 INFO:tasks.workunit.client.1.smithi125.stdout:3/701: write d0/d1/d4b/d52/d81/f90 [1879109,85763] 0 2024-02-19T19:12:27.693 INFO:tasks.workunit.client.1.smithi125.stdout:4/701: fdatasync d0/d7/d30/d58/f24 0 2024-02-19T19:12:27.700 INFO:tasks.workunit.client.1.smithi125.stdout:3/702: dwrite d0/d1/d1e/d60/d73/d74/d82/f89 [790528,114688] 0 2024-02-19T19:12:27.700 INFO:tasks.workunit.client.1.smithi125.stdout:3/703: dread d0/de/f13 [12288,73728] 0 2024-02-19T19:12:27.701 INFO:tasks.workunit.client.1.smithi125.stdout:4/702: write d0/d7/d30/d42/d7b/fdd [190142,101806] 0 2024-02-19T19:12:27.704 INFO:tasks.workunit.client.1.smithi125.stdout:3/704: creat d0/d1/d1e/d60/d6a/ddb/fe7 x:0 0 0 2024-02-19T19:12:27.704 INFO:tasks.workunit.client.1.smithi125.stdout:3/705: mkdir d0/d1/d1e/de8 0 2024-02-19T19:12:27.704 INFO:tasks.workunit.client.1.smithi125.stdout:3/706: read d0/f24 [646723,72851] 0 2024-02-19T19:12:27.704 INFO:tasks.workunit.client.1.smithi125.stdout:3/707: link d0/d1/d39/c88 d0/d95/d9c/dba/ce9 0 2024-02-19T19:12:27.706 INFO:tasks.workunit.client.1.smithi125.stdout:7/787: sync 2024-02-19T19:12:27.706 INFO:tasks.workunit.client.1.smithi125.stdout:0/837: sync 2024-02-19T19:12:27.706 INFO:tasks.workunit.client.1.smithi125.stdout:7/788: dread - d12/d18/d2c/db5/fd5 zero size 2024-02-19T19:12:27.706 INFO:tasks.workunit.client.1.smithi125.stdout:9/944: sync 2024-02-19T19:12:27.707 INFO:tasks.workunit.client.1.smithi125.stdout:8/748: sync 2024-02-19T19:12:27.707 INFO:tasks.workunit.client.1.smithi125.stdout:6/963: sync 2024-02-19T19:12:27.707 INFO:tasks.workunit.client.1.smithi125.stdout:0/838: creat d5/d1a/f122 x:0 0 0 2024-02-19T19:12:27.707 INFO:tasks.workunit.client.1.smithi125.stdout:0/839: readlink d5/d15/lac 0 2024-02-19T19:12:27.707 INFO:tasks.workunit.client.1.smithi125.stdout:0/840: rmdir d5/d9/dcd/dce 39 2024-02-19T19:12:27.707 INFO:tasks.workunit.client.1.smithi125.stdout:9/945: link d8/d15/d22/fb6 d8/d15/d32/d4f/d129/f146 0 2024-02-19T19:12:27.707 INFO:tasks.workunit.client.1.smithi125.stdout:0/841: mknod d5/d19/c123 0 2024-02-19T19:12:27.707 INFO:tasks.workunit.client.1.smithi125.stdout:8/749: creat db/d18/d30/dd2/fee x:0 0 0 2024-02-19T19:12:27.708 INFO:tasks.workunit.client.1.smithi125.stdout:0/842: link d5/d19/d2b/fd5 d5/d33/d46/de6/f124 0 2024-02-19T19:12:27.708 INFO:tasks.workunit.client.1.smithi125.stdout:8/750: chown db/d18/d2f/f93 26016643 1 2024-02-19T19:12:27.708 INFO:tasks.workunit.client.1.smithi125.stdout:0/843: dread d5/d19/d27/f8c [192512,61440] 0 2024-02-19T19:12:27.708 INFO:tasks.workunit.client.1.smithi125.stdout:0/844: creat d5/d33/d46/f125 x:0 0 0 2024-02-19T19:12:27.708 INFO:tasks.workunit.client.1.smithi125.stdout:8/751: mkdir db/d18/d30/d48/db9/def 0 2024-02-19T19:12:27.708 INFO:tasks.workunit.client.1.smithi125.stdout:9/946: unlink d8/d2e/f45 0 2024-02-19T19:12:27.708 INFO:tasks.workunit.client.1.smithi125.stdout:8/752: write db/d18/d30/d48/d67/d96/fd5 [86549,33097] 0 2024-02-19T19:12:27.708 INFO:tasks.workunit.client.1.smithi125.stdout:8/753: creat db/d18/d30/d48/d67/ff0 x:0 0 0 2024-02-19T19:12:27.709 INFO:tasks.workunit.client.1.smithi125.stdout:9/947: mkdir d8/d2e/d147 0 2024-02-19T19:12:27.709 INFO:tasks.workunit.client.1.smithi125.stdout:9/948: stat d8/fb4 0 2024-02-19T19:12:27.709 INFO:tasks.workunit.client.1.smithi125.stdout:8/754: symlink db/d18/d30/lf1 0 2024-02-19T19:12:27.709 INFO:tasks.workunit.client.1.smithi125.stdout:9/949: dread - d8/d15/d32/f64 zero size 2024-02-19T19:12:27.709 INFO:tasks.workunit.client.1.smithi125.stdout:8/755: mknod db/d18/d30/d3c/d4d/d5d/da2/dae/cf2 0 2024-02-19T19:12:27.811 INFO:tasks.workunit.client.1.smithi125.stdout:4/703: dwrite d0/df/d5e/fb4 [1187840,61440] 0 2024-02-19T19:12:27.811 INFO:tasks.workunit.client.1.smithi125.stdout:4/704: link d0/d7/d30/d42/d7b/fb7 d0/d7/d76/fed 0 2024-02-19T19:12:27.811 INFO:tasks.workunit.client.1.smithi125.stdout:4/705: read - d0/d7/d85/f9e zero size 2024-02-19T19:12:27.811 INFO:tasks.workunit.client.1.smithi125.stdout:4/706: mknod d0/d7/d30/d58/dac/cee 0 2024-02-19T19:12:27.811 INFO:tasks.workunit.client.1.smithi125.stdout:4/707: rmdir d0/df 39 2024-02-19T19:12:27.812 INFO:tasks.workunit.client.1.smithi125.stdout:4/708: rename d0/d7/d30/d58/f29 to d0/d7/d30/d42/db3/ddf/fef 0 2024-02-19T19:12:27.813 INFO:tasks.workunit.client.1.smithi125.stdout:6/964: dwrite d6/db/da7/fb2 [802816,77824] 0 2024-02-19T19:12:27.813 INFO:tasks.workunit.client.1.smithi125.stdout:6/965: link d6/db/d5d/d2f/d45/d107/ff7 d6/db/d5d/d2f/d45/d4e/d6b/f147 0 2024-02-19T19:12:27.813 INFO:tasks.workunit.client.1.smithi125.stdout:6/966: dread - d6/f9c zero size 2024-02-19T19:12:27.814 INFO:tasks.workunit.client.1.smithi125.stdout:7/789: dwrite d12/d18/d63/fb8 [512000,77824] 0 2024-02-19T19:12:27.814 INFO:tasks.workunit.client.1.smithi125.stdout:7/790: getdents d12/d18/d44/d3b/d59/d2a/d6a/dab 0 2024-02-19T19:12:27.814 INFO:tasks.workunit.client.1.smithi125.stdout:9/950: dwrite d8/d15/d32/d4f/d6e/fb1 [1236992,53248] 0 2024-02-19T19:12:27.814 INFO:tasks.workunit.client.1.smithi125.stdout:6/967: write d6/db/d5d/d2f/d45/d107/f66 [2443713,103781] 0 2024-02-19T19:12:27.814 INFO:tasks.workunit.client.1.smithi125.stdout:6/968: truncate d6/db/d5d/d29/f84 727278 0 2024-02-19T19:12:27.814 INFO:tasks.workunit.client.1.smithi125.stdout:9/951: write d8/d15/d22/fa6 [339728,14912] 0 2024-02-19T19:12:27.814 INFO:tasks.workunit.client.1.smithi125.stdout:9/952: truncate d8/d2e/d4c/f91 827449 0 2024-02-19T19:12:27.814 INFO:tasks.workunit.client.1.smithi125.stdout:7/791: write d12/d18/d2c/d4e/f99 [1087481,105742] 0 2024-02-19T19:12:27.814 INFO:tasks.workunit.client.1.smithi125.stdout:7/792: truncate fa 2380506 0 2024-02-19T19:12:27.815 INFO:tasks.workunit.client.1.smithi125.stdout:7/793: chown d12/d18/d63/fb8 337505995 1 2024-02-19T19:12:27.827 INFO:tasks.workunit.client.1.smithi125.stdout:0/845: write d5/d15/d2c/fd1 [442125,71541] 0 2024-02-19T19:12:27.827 INFO:tasks.workunit.client.1.smithi125.stdout:0/846: write d5/d33/d46/f4b [1862212,19378] 0 2024-02-19T19:12:27.827 INFO:tasks.workunit.client.1.smithi125.stdout:0/847: dread d5/d15/d2c/f77 [20480,81920] 0 2024-02-19T19:12:27.827 INFO:tasks.workunit.client.1.smithi125.stdout:0/848: creat d5/d9/dcd/dce/f126 x:0 0 0 2024-02-19T19:12:27.827 INFO:tasks.workunit.client.1.smithi125.stdout:0/849: chown d5/d19/d27/d32/d70/f115 16046627 1 2024-02-19T19:12:27.874 INFO:tasks.workunit.client.1.smithi125.stdout:3/708: fsync d0/d1/d4b/fbb 0 2024-02-19T19:12:27.874 INFO:tasks.workunit.client.1.smithi125.stdout:3/709: getdents d0/d1/d1e/d60/d6a/ddb 0 2024-02-19T19:12:27.874 INFO:tasks.workunit.client.1.smithi125.stdout:6/969: dwrite d6/db/d5d/d29/d68/f111 [1765376,94208] 0 2024-02-19T19:12:27.875 INFO:tasks.workunit.client.1.smithi125.stdout:6/970: chown d6/db/d5d/d2f/d45/dd9/d16 7033 1 2024-02-19T19:12:27.884 INFO:tasks.workunit.client.1.smithi125.stdout:7/794: dread d12/d18/d44/d3b/d59/fac [319488,20480] 0 2024-02-19T19:12:27.884 INFO:tasks.workunit.client.1.smithi125.stdout:7/795: write d12/d18/d2c/fbf [732333,51574] 0 2024-02-19T19:12:27.884 INFO:tasks.workunit.client.1.smithi125.stdout:7/796: unlink d12/d18/d2c/db5/fd5 0 2024-02-19T19:12:27.884 INFO:tasks.workunit.client.1.smithi125.stdout:7/797: write d12/d18/d44/d3b/d59/d26/d30/d97/fa3 [1013480,121780] 0 2024-02-19T19:12:27.884 INFO:tasks.workunit.client.1.smithi125.stdout:7/798: mkdir d12/d18/dbe/de4 0 2024-02-19T19:12:27.884 INFO:tasks.workunit.client.1.smithi125.stdout:7/799: mknod d12/d18/d44/d3b/d59/d67/ce5 0 2024-02-19T19:12:27.887 INFO:tasks.workunit.client.1.smithi125.stdout:4/709: fsync d0/d32/f61 0 2024-02-19T19:12:27.888 INFO:tasks.workunit.client.1.smithi125.stdout:4/710: chown d0/c22 3 1 2024-02-19T19:12:27.888 INFO:tasks.workunit.client.1.smithi125.stdout:4/711: creat d0/d7/d30/d58/ff0 x:0 0 0 2024-02-19T19:12:27.888 INFO:tasks.workunit.client.1.smithi125.stdout:4/712: creat d0/d7/d3b/ff1 x:0 0 0 2024-02-19T19:12:27.888 INFO:tasks.workunit.client.1.smithi125.stdout:4/713: symlink d0/d7/d76/dd1/lf2 0 2024-02-19T19:12:27.891 INFO:tasks.workunit.client.1.smithi125.stdout:0/850: dwrite d5/d15/f5b [843776,110592] 0 2024-02-19T19:12:27.891 INFO:tasks.workunit.client.1.smithi125.stdout:6/971: dwrite d6/db/d5d/d2f/d45/dd9/d16/f5c [2367488,4096] 0 2024-02-19T19:12:27.891 INFO:tasks.workunit.client.1.smithi125.stdout:6/972: dread - d6/db/d5d/d93/da2/fca zero size 2024-02-19T19:12:27.891 INFO:tasks.workunit.client.1.smithi125.stdout:3/710: dwrite d0/d95/d9c/daf/fe4 [663552,4096] 0 2024-02-19T19:12:27.892 INFO:tasks.workunit.client.1.smithi125.stdout:3/711: chown d0/d1/d4b/d52/l53 21 1 2024-02-19T19:12:27.892 INFO:tasks.workunit.client.1.smithi125.stdout:6/973: mkdir d6/db/d5d/d2f/d45/d107/d145/d148 0 2024-02-19T19:12:27.892 INFO:tasks.workunit.client.1.smithi125.stdout:3/712: mknod d0/d95/d9c/dba/cea 0 2024-02-19T19:12:27.892 INFO:tasks.workunit.client.1.smithi125.stdout:3/713: rmdir d0/d1/d1e/d60/d6a/ddb 39 2024-02-19T19:12:27.894 INFO:tasks.workunit.client.1.smithi125.stdout:4/714: dwrite d0/d7/d3b/ff1 [897024,53248] 0 2024-02-19T19:12:27.895 INFO:tasks.workunit.client.1.smithi125.stdout:0/851: dwrite d5/d19/d27/dc3/ffd [1507328,57344] 0 2024-02-19T19:12:27.895 INFO:tasks.workunit.client.1.smithi125.stdout:0/852: stat d5/l68 0 2024-02-19T19:12:27.895 INFO:tasks.workunit.client.1.smithi125.stdout:0/853: mknod d5/d33/d42/d92/c127 0 2024-02-19T19:12:27.895 INFO:tasks.workunit.client.1.smithi125.stdout:0/854: getdents d5/d19/d2b/db7 0 2024-02-19T19:12:27.895 INFO:tasks.workunit.client.1.smithi125.stdout:6/974: dwrite d6/db/d5d/d63/f62 [1544192,57344] 0 2024-02-19T19:12:27.895 INFO:tasks.workunit.client.1.smithi125.stdout:6/975: write d6/db/d5d/d93/da2/fca [186281,11121] 0 2024-02-19T19:12:27.895 INFO:tasks.workunit.client.1.smithi125.stdout:6/976: dread - d6/db/d5d/d2f/d45/fec zero size 2024-02-19T19:12:27.895 INFO:tasks.workunit.client.1.smithi125.stdout:6/977: unlink d6/db/f17 0 2024-02-19T19:12:27.896 INFO:tasks.workunit.client.1.smithi125.stdout:6/978: rename d6/db/d5d/d2f/d45/d4e/d6b/fbd to d6/db/d5d/d2f/d45/dd9/d3b/de1/d138/f149 0 2024-02-19T19:12:27.896 INFO:tasks.workunit.client.1.smithi125.stdout:6/979: getdents d6/db/d49 0 2024-02-19T19:12:27.896 INFO:tasks.workunit.client.1.smithi125.stdout:6/980: creat d6/db/d5d/d2f/d45/dd9/d16/d11c/de3/f14a x:0 0 0 2024-02-19T19:12:27.896 INFO:tasks.workunit.client.1.smithi125.stdout:9/953: dread d8/d15/d32/d4f/d6e/fc2 [1261568,102400] 0 2024-02-19T19:12:27.896 INFO:tasks.workunit.client.1.smithi125.stdout:9/954: mkdir d8/d2e/d4c/d148 0 2024-02-19T19:12:27.896 INFO:tasks.workunit.client.1.smithi125.stdout:9/955: mkdir d8/d2e/d147/d149 0 2024-02-19T19:12:27.896 INFO:tasks.workunit.client.1.smithi125.stdout:9/956: rename d8/d15/d32/d4f/d129/f146 to d8/d2e/d4c/d148/f14a 0 2024-02-19T19:12:27.896 INFO:tasks.workunit.client.1.smithi125.stdout:9/957: symlink d8/d15/d32/d4f/d6e/d99/l14b 0 2024-02-19T19:12:27.897 INFO:tasks.workunit.client.1.smithi125.stdout:9/958: stat d8/d15/d22/de0/ffe 0 2024-02-19T19:12:27.897 INFO:tasks.workunit.client.1.smithi125.stdout:9/959: getdents d8/d15/d22/d4e/d6b 0 2024-02-19T19:12:27.897 INFO:tasks.workunit.client.1.smithi125.stdout:9/960: rmdir d8/d15/d10d 39 2024-02-19T19:12:27.897 INFO:tasks.workunit.client.1.smithi125.stdout:9/961: unlink d8/d15/d22/d4e/ca8 0 2024-02-19T19:12:27.897 INFO:tasks.workunit.client.1.smithi125.stdout:9/962: write d8/d2e/d4c/d84/fce [616656,110722] 0 2024-02-19T19:12:27.897 INFO:tasks.workunit.client.1.smithi125.stdout:9/963: creat d8/d15/d32/d4f/d85/dcb/f14c x:0 0 0 2024-02-19T19:12:27.897 INFO:tasks.workunit.client.1.smithi125.stdout:9/964: stat d8/d15/d32/d4f/de7/c104 0 2024-02-19T19:12:27.975 INFO:tasks.workunit.client.1.smithi125.stdout:7/800: fdatasync d12/d18/d44/d3b/d59/fc2 0 2024-02-19T19:12:27.975 INFO:tasks.workunit.client.1.smithi125.stdout:7/801: creat d12/d18/d44/d3b/d59/d2a/d31/fe6 x:0 0 0 2024-02-19T19:12:27.975 INFO:tasks.workunit.client.1.smithi125.stdout:7/802: chown d12/d18/d44/d3b/d59/d2a/d6a 1 1 2024-02-19T19:12:27.975 INFO:tasks.workunit.client.1.smithi125.stdout:7/803: mknod d12/d18/d44/d3b/d59/d26/d30/dad/ce7 0 2024-02-19T19:12:27.975 INFO:tasks.workunit.client.1.smithi125.stdout:7/804: dread d12/d3d/f69 [655360,53248] 0 2024-02-19T19:12:27.975 INFO:tasks.workunit.client.1.smithi125.stdout:7/805: read d12/d18/d44/d3b/d59/d26/f87 [780641,1484] 0 2024-02-19T19:12:27.976 INFO:tasks.workunit.client.1.smithi125.stdout:7/806: chown d12/d18/d44/d3b/d59/d26/d30 100727363 1 2024-02-19T19:12:27.976 INFO:tasks.workunit.client.1.smithi125.stdout:3/714: fsync d0/d1/f56 0 2024-02-19T19:12:27.976 INFO:tasks.workunit.client.1.smithi125.stdout:7/807: write d12/d18/f3c [3999170,105525] 0 2024-02-19T19:12:27.976 INFO:tasks.workunit.client.1.smithi125.stdout:7/808: chown d12/d18/d44/d3b/d59/fac 1 1 2024-02-19T19:12:27.976 INFO:tasks.workunit.client.1.smithi125.stdout:3/715: write d0/d1/d1e/d60/f85 [15861,26062] 0 2024-02-19T19:12:27.976 INFO:tasks.workunit.client.1.smithi125.stdout:7/809: mknod d12/d18/d44/d3b/d59/d2a/d6a/dab/ce8 0 2024-02-19T19:12:27.976 INFO:tasks.workunit.client.1.smithi125.stdout:3/716: dread d0/d1/d4b/d52/f59 [86016,53248] 0 2024-02-19T19:12:27.976 INFO:tasks.workunit.client.1.smithi125.stdout:3/717: symlink d0/d1/d1e/d60/d73/leb 0 2024-02-19T19:12:27.977 INFO:tasks.workunit.client.1.smithi125.stdout:3/718: dread d0/d1/d1e/f5d [565248,118784] 0 2024-02-19T19:12:27.977 INFO:tasks.workunit.client.1.smithi125.stdout:3/719: getdents d0/d95/d9c/dba 0 2024-02-19T19:12:27.977 INFO:tasks.workunit.client.1.smithi125.stdout:3/720: chown d0/d1/f63 1934511 1 2024-02-19T19:12:27.977 INFO:tasks.workunit.client.1.smithi125.stdout:3/721: chown d0/f3c 1823728 1 2024-02-19T19:12:27.977 INFO:tasks.workunit.client.1.smithi125.stdout:3/722: stat d0/d1/d4b/l55 0 2024-02-19T19:12:27.977 INFO:tasks.workunit.client.1.smithi125.stdout:3/723: chown d0/d1/d1e/d60/d73/d74/d82 684243 1 2024-02-19T19:12:27.977 INFO:tasks.workunit.client.1.smithi125.stdout:3/724: stat d0/d1/d4b/ca0 0 2024-02-19T19:12:27.977 INFO:tasks.workunit.client.1.smithi125.stdout:3/725: symlink d0/d95/d9c/lec 0 2024-02-19T19:12:27.978 INFO:tasks.workunit.client.1.smithi125.stdout:3/726: readlink d0/de/l25 0 2024-02-19T19:12:27.978 INFO:tasks.workunit.client.1.smithi125.stdout:3/727: link d0/cc9 d0/d95/d9c/daf/ddf/ced 0 2024-02-19T19:12:27.978 INFO:tasks.workunit.client.1.smithi125.stdout:3/728: rename d0/d1/d4b/d52/l53 to d0/d1/d1e/db0/lee 0 2024-02-19T19:12:27.978 INFO:tasks.workunit.client.1.smithi125.stdout:3/729: write d0/d1/d1e/d60/d73/fa6 [59421,32510] 0 2024-02-19T19:12:27.978 INFO:tasks.workunit.client.1.smithi125.stdout:3/730: symlink d0/d1/d1e/d60/de2/lef 0 2024-02-19T19:12:27.978 INFO:tasks.workunit.client.1.smithi125.stdout:2/798: sync 2024-02-19T19:12:27.978 INFO:tasks.workunit.client.1.smithi125.stdout:2/799: write d1/d27/d1d/d16/fa9 [1357506,103522] 0 2024-02-19T19:12:27.978 INFO:tasks.workunit.client.1.smithi125.stdout:2/800: mknod d1/d27/d1d/d25/da0/dc3/cf0 0 2024-02-19T19:12:27.979 INFO:tasks.workunit.client.1.smithi125.stdout:2/801: read d1/d27/d1d/d39/f7e [853926,53100] 0 2024-02-19T19:12:27.979 INFO:tasks.workunit.client.1.smithi125.stdout:0/855: dwrite d5/d33/d46/f66 [1867776,40960] 0 2024-02-19T19:12:27.979 INFO:tasks.workunit.client.1.smithi125.stdout:0/856: creat d5/d19/d27/d32/d70/f128 x:0 0 0 2024-02-19T19:12:27.979 INFO:tasks.workunit.client.1.smithi125.stdout:2/802: truncate d1/d27/d45/f56 1225363 0 2024-02-19T19:12:27.979 INFO:tasks.workunit.client.1.smithi125.stdout:0/857: chown d5/d15/d2c/d80/c98 22 1 2024-02-19T19:12:27.979 INFO:tasks.workunit.client.1.smithi125.stdout:0/858: creat d5/d1a/d4c/d120/f129 x:0 0 0 2024-02-19T19:12:27.979 INFO:tasks.workunit.client.1.smithi125.stdout:2/803: write d1/d27/d1d/d2c/fbf [977737,75792] 0 2024-02-19T19:12:27.979 INFO:tasks.workunit.client.1.smithi125.stdout:2/804: rmdir d1/d27/d1d/da8/d7b/d91/dbc 0 2024-02-19T19:12:27.979 INFO:tasks.workunit.client.1.smithi125.stdout:0/859: truncate d5/d1a/d4c/f94 352635 0 2024-02-19T19:12:27.980 INFO:tasks.workunit.client.1.smithi125.stdout:2/805: write d1/d27/f5a [1170794,120620] 0 2024-02-19T19:12:27.980 INFO:tasks.workunit.client.1.smithi125.stdout:4/715: dwrite d0/d7/d3b/f6b [1314816,110592] 0 2024-02-19T19:12:27.980 INFO:tasks.workunit.client.1.smithi125.stdout:2/806: creat d1/d36/ff1 x:0 0 0 2024-02-19T19:12:27.980 INFO:tasks.workunit.client.1.smithi125.stdout:4/716: dread - d0/d7/d3b/d77/fe7 zero size 2024-02-19T19:12:27.980 INFO:tasks.workunit.client.1.smithi125.stdout:4/717: creat d0/d7/d30/d42/ff3 x:0 0 0 2024-02-19T19:12:27.980 INFO:tasks.workunit.client.1.smithi125.stdout:4/718: symlink d0/df/dda/lf4 0 2024-02-19T19:12:27.980 INFO:tasks.workunit.client.1.smithi125.stdout:4/719: mknod d0/d7/dad/dbe/cf5 0 2024-02-19T19:12:27.980 INFO:tasks.workunit.client.1.smithi125.stdout:4/720: dread - d0/d7/d3b/d77/fe7 zero size 2024-02-19T19:12:27.981 INFO:tasks.workunit.client.1.smithi125.stdout:4/721: rename d0/d7/d30/d42/ca8 to d0/d7/d3b/d75/de3/dcd/cf6 0 2024-02-19T19:12:27.981 INFO:tasks.workunit.client.1.smithi125.stdout:4/722: symlink d0/d32/d60/lf7 0 2024-02-19T19:12:27.981 INFO:tasks.workunit.client.1.smithi125.stdout:9/965: dwrite d8/d15/d32/f64 [671744,61440] 0 2024-02-19T19:12:27.981 INFO:tasks.workunit.client.1.smithi125.stdout:9/966: getdents d8/d15/d22/d4e/d6b/d111 0 2024-02-19T19:12:27.982 INFO:tasks.workunit.client.1.smithi125.stdout:0/860: dread d5/d19/d2b/fd5 [49152,24576] 0 2024-02-19T19:12:27.982 INFO:tasks.workunit.client.1.smithi125.stdout:0/861: rename d5/l35 to d5/d33/d42/d92/da5/l12a 0 2024-02-19T19:12:27.982 INFO:tasks.workunit.client.1.smithi125.stdout:2/807: write d1/d27/d1d/d25/d2a/f34 [1077433,54543] 0 2024-02-19T19:12:27.982 INFO:tasks.workunit.client.1.smithi125.stdout:2/808: chown d1/d36/dc0 6129319 1 2024-02-19T19:12:27.982 INFO:tasks.workunit.client.1.smithi125.stdout:2/809: stat d1/d36/dc0/dcf/fe0 0 2024-02-19T19:12:27.982 INFO:tasks.workunit.client.1.smithi125.stdout:2/810: read d1/d36/d70/f66 [814101,73307] 0 2024-02-19T19:12:28.065 INFO:tasks.workunit.client.1.smithi125.stdout:0/862: fdatasync d5/d19/f2f 0 2024-02-19T19:12:28.065 INFO:tasks.workunit.client.1.smithi125.stdout:2/811: fdatasync d1/d27/d1d/da8/fdb 0 2024-02-19T19:12:28.183 INFO:tasks.workunit.client.1.smithi125.stdout:2/812: fdatasync d1/d27/d1d/d16/fa9 0 2024-02-19T19:12:28.184 INFO:tasks.workunit.client.1.smithi125.stdout:2/813: chown d1/d27/d1d/da8/d7b 874753 1 2024-02-19T19:12:28.184 INFO:tasks.workunit.client.1.smithi125.stdout:2/814: rename d1/d27/d45/d7a/fd8 to d1/d27/d1d/da8/d7b/d91/ff2 0 2024-02-19T19:12:28.192 INFO:tasks.workunit.client.1.smithi125.stdout:2/815: fdatasync d1/d27/d1d/da8/fa1 0 2024-02-19T19:12:28.192 INFO:tasks.workunit.client.1.smithi125.stdout:2/816: write d1/d27/da2/fbb [125554,119496] 0 2024-02-19T19:12:28.196 INFO:tasks.workunit.client.1.smithi125.stdout:2/817: mknod d1/d27/da2/cf3 0 2024-02-19T19:12:28.196 INFO:tasks.workunit.client.1.smithi125.stdout:2/818: write d1/d27/d1d/da8/d7b/d91/fd6 [445967,31353] 0 2024-02-19T19:12:28.371 INFO:tasks.workunit.client.1.smithi125.stdout:6/981: sync 2024-02-19T19:12:28.372 INFO:tasks.workunit.client.1.smithi125.stdout:4/723: sync 2024-02-19T19:12:28.372 INFO:tasks.workunit.client.1.smithi125.stdout:7/810: sync 2024-02-19T19:12:28.372 INFO:tasks.workunit.client.1.smithi125.stdout:9/967: sync 2024-02-19T19:12:28.372 INFO:tasks.workunit.client.1.smithi125.stdout:0/863: sync 2024-02-19T19:12:28.372 INFO:tasks.workunit.client.1.smithi125.stdout:8/756: sync 2024-02-19T19:12:28.372 INFO:tasks.workunit.client.1.smithi125.stdout:3/731: sync 2024-02-19T19:12:28.372 INFO:tasks.workunit.client.1.smithi125.stdout:3/732: truncate d0/f24 1811005 0 2024-02-19T19:12:28.373 INFO:tasks.workunit.client.1.smithi125.stdout:0/864: rename d5/d15/d2c/f43 to d5/d19/d27/d11a/f12b 0 2024-02-19T19:12:28.373 INFO:tasks.workunit.client.1.smithi125.stdout:9/968: mkdir d8/d15/d10d/d14d 0 2024-02-19T19:12:28.373 INFO:tasks.workunit.client.1.smithi125.stdout:0/865: mknod d5/d9/c12c 0 2024-02-19T19:12:28.373 INFO:tasks.workunit.client.1.smithi125.stdout:0/866: dread - d5/d1a/d4c/d120/f129 zero size 2024-02-19T19:12:28.373 INFO:tasks.workunit.client.1.smithi125.stdout:7/811: write d12/d18/d44/d3b/d59/d26/d30/d37/fa2 [906133,71923] 0 2024-02-19T19:12:28.373 INFO:tasks.workunit.client.1.smithi125.stdout:9/969: mknod d8/d15/d32/d4f/d85/de2/d135/d106/c14e 0 2024-02-19T19:12:28.373 INFO:tasks.workunit.client.1.smithi125.stdout:0/867: getdents d5/d19/d27/d32/d109/db3/dd4/dfb 0 2024-02-19T19:12:28.373 INFO:tasks.workunit.client.1.smithi125.stdout:3/733: write d0/d1/d1e/f27 [2672920,97931] 0 2024-02-19T19:12:28.374 INFO:tasks.workunit.client.1.smithi125.stdout:3/734: readlink d0/d95/d9c/ld6 0 2024-02-19T19:12:28.374 INFO:tasks.workunit.client.1.smithi125.stdout:7/812: rename d12/d18/d2c/db5/dca/d8c/d98 to d12/d18/d44/d3b/d59/d26/d30/d37/dc1/de9 0 2024-02-19T19:12:28.374 INFO:tasks.workunit.client.1.smithi125.stdout:3/735: mknod d0/d1/d4b/d52/daa/cf0 0 2024-02-19T19:12:28.374 INFO:tasks.workunit.client.1.smithi125.stdout:7/813: write d12/d18/d44/d3b/d59/d2a/d31/d50/fa1 [1537436,6719] 0 2024-02-19T19:12:28.374 INFO:tasks.workunit.client.1.smithi125.stdout:7/814: truncate d12/d18/d2c/fbf 1475063 0 2024-02-19T19:12:28.374 INFO:tasks.workunit.client.1.smithi125.stdout:7/815: stat d12/d18/d44/d3b/d59/d2a/f4a 0 2024-02-19T19:12:28.374 INFO:tasks.workunit.client.1.smithi125.stdout:3/736: unlink d0/d1/d4b/db2/fc0 0 2024-02-19T19:12:28.374 INFO:tasks.workunit.client.1.smithi125.stdout:9/970: write d8/d2e/fb9 [318523,117768] 0 2024-02-19T19:12:28.375 INFO:tasks.workunit.client.1.smithi125.stdout:3/737: symlink d0/d1/d1e/d60/de2/lf1 0 2024-02-19T19:12:28.375 INFO:tasks.workunit.client.1.smithi125.stdout:3/738: creat d0/d1/d4b/d52/d81/dd0/ff2 x:0 0 0 2024-02-19T19:12:28.375 INFO:tasks.workunit.client.1.smithi125.stdout:3/739: dread d0/d1/d4b/d52/f59 [1728512,110592] 0 2024-02-19T19:12:28.375 INFO:tasks.workunit.client.1.smithi125.stdout:3/740: rmdir d0/d1/d1e/d60/d7c/db6/d71 39 2024-02-19T19:12:28.375 INFO:tasks.workunit.client.1.smithi125.stdout:3/741: symlink d0/d1/d4b/d52/d81/lf3 0 2024-02-19T19:12:28.375 INFO:tasks.workunit.client.1.smithi125.stdout:3/742: creat d0/d1/d39/ff4 x:0 0 0 2024-02-19T19:12:28.375 INFO:tasks.workunit.client.1.smithi125.stdout:3/743: chown d0/d1/d1e/d60/d6a/ld1 1563513 1 2024-02-19T19:12:28.375 INFO:tasks.workunit.client.1.smithi125.stdout:3/744: write d0/d1/d1e/d60/d73/d74/d82/fe1 [2225107,1018] 0 2024-02-19T19:12:28.375 INFO:tasks.workunit.client.1.smithi125.stdout:3/745: symlink d0/d95/d9c/daf/lf5 0 2024-02-19T19:12:28.403 INFO:tasks.workunit.client.1.smithi125.stdout:0/868: fsync d5/f8 0 2024-02-19T19:12:28.403 INFO:tasks.workunit.client.1.smithi125.stdout:6/982: fdatasync d6/db/d5d/d29/d68/f111 0 2024-02-19T19:12:28.403 INFO:tasks.workunit.client.1.smithi125.stdout:6/983: unlink d6/db/d5d/d2f/d45/dd9/f51 0 2024-02-19T19:12:28.403 INFO:tasks.workunit.client.1.smithi125.stdout:0/869: write d5/d15/d2c/d80/f4f [888411,25454] 0 2024-02-19T19:12:28.403 INFO:tasks.workunit.client.1.smithi125.stdout:6/984: read d6/db/d5d/f6e [202348,65411] 0 2024-02-19T19:12:28.403 INFO:tasks.workunit.client.1.smithi125.stdout:6/985: link d6/db/d98/d129/d139/l99 d6/db/d49/d108/l14b 0 2024-02-19T19:12:28.404 INFO:tasks.workunit.client.1.smithi125.stdout:0/870: creat d5/d19/f12d x:0 0 0 2024-02-19T19:12:28.404 INFO:tasks.workunit.client.1.smithi125.stdout:0/871: creat d5/d33/d42/f12e x:0 0 0 2024-02-19T19:12:28.404 INFO:tasks.workunit.client.1.smithi125.stdout:6/986: mkdir d6/db/d5d/d2f/d45/d4e/dfb/d14c 0 2024-02-19T19:12:28.404 INFO:tasks.workunit.client.1.smithi125.stdout:0/872: creat d5/d15/d2c/d80/dfa/dc8/f12f x:0 0 0 2024-02-19T19:12:28.404 INFO:tasks.workunit.client.1.smithi125.stdout:0/873: rename d5/d33/l36 to d5/d19/d27/dc3/l130 0 2024-02-19T19:12:28.404 INFO:tasks.workunit.client.1.smithi125.stdout:6/987: mkdir d6/db/d5d/dc4/d14d 0 2024-02-19T19:12:28.404 INFO:tasks.workunit.client.1.smithi125.stdout:6/988: stat d6/db/d5d/d2f/d45/dd9/d3b/dda/f120 0 2024-02-19T19:12:28.407 INFO:tasks.workunit.client.1.smithi125.stdout:3/746: dwrite d0/d1/d1e/f2c [1044480,118784] 0 2024-02-19T19:12:28.408 INFO:tasks.workunit.client.1.smithi125.stdout:3/747: creat d0/d95/d9c/dbf/de0/ff6 x:0 0 0 2024-02-19T19:12:28.408 INFO:tasks.workunit.client.1.smithi125.stdout:3/748: unlink d0/d1/d1e/f9e 0 2024-02-19T19:12:28.408 INFO:tasks.workunit.client.1.smithi125.stdout:3/749: dread d0/d1/d1e/d60/f9d [1363968,81920] 0 2024-02-19T19:12:28.408 INFO:tasks.workunit.client.1.smithi125.stdout:2/819: sync 2024-02-19T19:12:28.412 INFO:tasks.workunit.client.1.smithi125.stdout:8/757: dread db/d18/d30/d80/dac/fe9 [385024,49152] 0 2024-02-19T19:12:28.413 INFO:tasks.workunit.client.1.smithi125.stdout:8/758: read - db/d18/d30/d48/db1/fd1 zero size 2024-02-19T19:12:28.524 INFO:tasks.workunit.client.1.smithi125.stdout:3/750: fdatasync d0/d1/d1e/db0/fc2 0 2024-02-19T19:12:28.527 INFO:tasks.workunit.client.1.smithi125.stdout:7/816: dwrite d12/d18/d2c/f74 [1884160,20480] 0 2024-02-19T19:12:28.527 INFO:tasks.workunit.client.1.smithi125.stdout:6/989: dwrite d6/db/f131 [167936,8192] 0 2024-02-19T19:12:28.527 INFO:tasks.workunit.client.1.smithi125.stdout:4/724: dwrite d0/d7/f26 [1220608,118784] 0 2024-02-19T19:12:28.527 INFO:tasks.workunit.client.1.smithi125.stdout:2/820: creat d1/d27/ff4 x:0 0 0 2024-02-19T19:12:28.527 INFO:tasks.workunit.client.1.smithi125.stdout:3/751: symlink d0/d1/d1e/d69/lf7 0 2024-02-19T19:12:28.528 INFO:tasks.workunit.client.1.smithi125.stdout:6/990: truncate d6/db/d5d/d29/d68/f111 2184890 0 2024-02-19T19:12:28.528 INFO:tasks.workunit.client.1.smithi125.stdout:4/725: rename d0/d7/d3b/d77/ce1 to d0/d7/dd3/cf8 0 2024-02-19T19:12:28.528 INFO:tasks.workunit.client.1.smithi125.stdout:7/817: mknod d12/d18/d44/d3b/d59/d26/d30/d37/ddf/cea 0 2024-02-19T19:12:28.528 INFO:tasks.workunit.client.1.smithi125.stdout:7/818: chown d12/f45 19 1 2024-02-19T19:12:28.528 INFO:tasks.workunit.client.1.smithi125.stdout:4/726: read d0/d7/d3b/f81 [339022,13685] 0 2024-02-19T19:12:28.528 INFO:tasks.workunit.client.1.smithi125.stdout:2/821: read d1/d36/d70/d4b/f75 [1106296,56640] 0 2024-02-19T19:12:28.528 INFO:tasks.workunit.client.1.smithi125.stdout:4/727: chown d0/d32/fcb 4901 1 2024-02-19T19:12:28.528 INFO:tasks.workunit.client.1.smithi125.stdout:2/822: rmdir d1/d27/d1d/d25/da0 39 2024-02-19T19:12:28.529 INFO:tasks.workunit.client.1.smithi125.stdout:6/991: symlink d6/db/d5d/d2f/d45/dd9/l14e 0 2024-02-19T19:12:28.529 INFO:tasks.workunit.client.1.smithi125.stdout:7/819: creat d12/d18/d44/d3b/d59/feb x:0 0 0 2024-02-19T19:12:28.529 INFO:tasks.workunit.client.1.smithi125.stdout:4/728: mknod d0/d32/cf9 0 2024-02-19T19:12:28.529 INFO:tasks.workunit.client.1.smithi125.stdout:7/820: chown d12/d18/d44/d3b/d59/d2a/d31/d50/d60/f6e 426080152 1 2024-02-19T19:12:28.529 INFO:tasks.workunit.client.1.smithi125.stdout:4/729: creat d0/df/d5e/ffa x:0 0 0 2024-02-19T19:12:28.529 INFO:tasks.workunit.client.1.smithi125.stdout:6/992: write d6/db/d5d/d2f/d45/dd9/d3b/dda/f120 [206862,10132] 0 2024-02-19T19:12:28.530 INFO:tasks.workunit.client.1.smithi125.stdout:7/821: dread d12/d18/d44/d3b/d59/d2a/d6a/d6d/fd9 [524288,86016] 0 2024-02-19T19:12:28.530 INFO:tasks.workunit.client.1.smithi125.stdout:2/823: mkdir d1/d36/dc0/def/df5 0 2024-02-19T19:12:28.530 INFO:tasks.workunit.client.1.smithi125.stdout:8/759: dwrite db/d18/d2f/fab [393216,45056] 0 2024-02-19T19:12:28.530 INFO:tasks.workunit.client.1.smithi125.stdout:2/824: truncate d1/d27/f10 3500900 0 2024-02-19T19:12:28.530 INFO:tasks.workunit.client.1.smithi125.stdout:6/993: truncate d6/db/d5d/d2f/f100 67534 0 2024-02-19T19:12:28.530 INFO:tasks.workunit.client.1.smithi125.stdout:7/822: dread d12/d18/d44/d3b/d59/f58 [16384,65536] 0 2024-02-19T19:12:28.530 INFO:tasks.workunit.client.1.smithi125.stdout:4/730: creat d0/d7/dad/db9/ffb x:0 0 0 2024-02-19T19:12:28.530 INFO:tasks.workunit.client.1.smithi125.stdout:8/760: mknod db/d81/cf3 0 2024-02-19T19:12:28.531 INFO:tasks.workunit.client.1.smithi125.stdout:7/823: mkdir d12/d3d/dd7/dec 0 2024-02-19T19:12:28.531 INFO:tasks.workunit.client.1.smithi125.stdout:8/761: rename db/d81/dde/fe3 to db/d18/d30/d48/d67/ff4 0 2024-02-19T19:12:28.531 INFO:tasks.workunit.client.1.smithi125.stdout:4/731: write d0/df/f9f [997633,49292] 0 2024-02-19T19:12:28.531 INFO:tasks.workunit.client.1.smithi125.stdout:7/824: rename d12/d18/d44/d3b/caa to d12/d18/dbe/de4/ced 0 2024-02-19T19:12:28.531 INFO:tasks.workunit.client.1.smithi125.stdout:8/762: read - db/d18/d30/d48/d67/d96/fb2 zero size 2024-02-19T19:12:28.531 INFO:tasks.workunit.client.1.smithi125.stdout:4/732: dread - d0/d7/d76/dd1/fd4 zero size 2024-02-19T19:12:28.531 INFO:tasks.workunit.client.1.smithi125.stdout:8/763: truncate db/d18/d30/d48/d67/ff4 471874 0 2024-02-19T19:12:28.531 INFO:tasks.workunit.client.1.smithi125.stdout:7/825: unlink d12/d18/d44/d3b/d59/d26/d30/f88 0 2024-02-19T19:12:28.531 INFO:tasks.workunit.client.1.smithi125.stdout:7/826: symlink d12/d18/d66/lee 0 2024-02-19T19:12:28.532 INFO:tasks.workunit.client.1.smithi125.stdout:7/827: rename d12/d18/d44/d3b/d59/feb to d12/d18/d44/d3b/d59/d2a/fef 0 2024-02-19T19:12:28.532 INFO:tasks.workunit.client.1.smithi125.stdout:7/828: chown d12/d18/d44/d3b/d59/d2a/d31/c7b 34 1 2024-02-19T19:12:28.547 INFO:tasks.workunit.client.1.smithi125.stdout:4/733: dwrite d0/d32/f36 [905216,110592] 0 2024-02-19T19:12:28.547 INFO:tasks.workunit.client.1.smithi125.stdout:2/825: dwrite d1/d27/d1d/d25/da0/fc9 [815104,24576] 0 2024-02-19T19:12:28.547 INFO:tasks.workunit.client.1.smithi125.stdout:8/764: dwrite db/f16 [2240512,102400] 0 2024-02-19T19:12:28.547 INFO:tasks.workunit.client.1.smithi125.stdout:4/734: write d0/d7/d30/d42/ff3 [764507,121320] 0 2024-02-19T19:12:28.547 INFO:tasks.workunit.client.1.smithi125.stdout:4/735: chown d0/d7/d30/d58 55 1 2024-02-19T19:12:28.547 INFO:tasks.workunit.client.1.smithi125.stdout:4/736: mknod d0/cfc 0 2024-02-19T19:12:28.547 INFO:tasks.workunit.client.1.smithi125.stdout:4/737: mknod d0/df/d5e/cfd 0 2024-02-19T19:12:28.548 INFO:tasks.workunit.client.1.smithi125.stdout:4/738: dread d0/d7/f71 [1724416,45056] 0 2024-02-19T19:12:28.586 INFO:tasks.workunit.client.1.smithi125.stdout:6/994: fdatasync d6/db/d5d/f6e 0 2024-02-19T19:12:28.586 INFO:tasks.workunit.client.1.smithi125.stdout:7/829: fsync d12/d18/d44/d3b/d59/d26/d30/d37/f62 0 2024-02-19T19:12:28.586 INFO:tasks.workunit.client.1.smithi125.stdout:7/830: mknod d12/d18/d44/d3b/d59/d26/d30/d37/dc1/cf0 0 2024-02-19T19:12:28.587 INFO:tasks.workunit.client.1.smithi125.stdout:2/826: fsync d1/d27/d1d/fc2 0 2024-02-19T19:12:28.587 INFO:tasks.workunit.client.1.smithi125.stdout:8/765: fsync db/d18/d30/d3c/f68 0 2024-02-19T19:12:28.587 INFO:tasks.workunit.client.1.smithi125.stdout:8/766: chown db/d18/f62 6227190 1 2024-02-19T19:12:28.587 INFO:tasks.workunit.client.1.smithi125.stdout:6/995: write d6/db/d5d/d29/f116 [904318,78679] 0 2024-02-19T19:12:28.587 INFO:tasks.workunit.client.1.smithi125.stdout:6/996: chown d6/db/d5d/d2f/d45/dd9/d16/d11c/de3/f115 53 1 2024-02-19T19:12:28.587 INFO:tasks.workunit.client.1.smithi125.stdout:4/739: dwrite d0/d7/d30/d42/d7b/f99 [2342912,110592] 0 2024-02-19T19:12:28.588 INFO:tasks.workunit.client.1.smithi125.stdout:2/827: dwrite d1/d36/d70/d4b/f75 [1724416,73728] 0 2024-02-19T19:12:28.588 INFO:tasks.workunit.client.1.smithi125.stdout:7/831: dwrite d12/d18/d44/d3b/d59/d2a/d31/d50/fcb [831488,98304] 0 2024-02-19T19:12:28.588 INFO:tasks.workunit.client.1.smithi125.stdout:7/832: readlink d12/d18/d44/d3b/d59/le3 0 2024-02-19T19:12:28.589 INFO:tasks.workunit.client.1.smithi125.stdout:6/997: dwrite d6/db/d49/f59 [1699840,86016] 0 2024-02-19T19:12:28.589 INFO:tasks.workunit.client.1.smithi125.stdout:6/998: readlink d6/lfd 0 2024-02-19T19:12:28.589 INFO:tasks.workunit.client.1.smithi125.stdout:6/999: unlink d6/db/d5d/d2f/d45/dd9/d16/l1c 0 2024-02-19T19:12:28.591 INFO:tasks.workunit.client.1.smithi125.stdout:7/833: mknod d12/d18/dbe/dd0/cf1 0 2024-02-19T19:12:28.591 INFO:tasks.workunit.client.1.smithi125.stdout:2/828: write d1/d27/ff4 [113894,52438] 0 2024-02-19T19:12:28.591 INFO:tasks.workunit.client.1.smithi125.stdout:4/740: write d0/d7/d3b/f62 [1268721,123102] 0 2024-02-19T19:12:28.591 INFO:tasks.workunit.client.1.smithi125.stdout:4/741: mknod d0/d7/d3b/cfe 0 2024-02-19T19:12:28.591 INFO:tasks.workunit.client.1.smithi125.stdout:2/829: write d1/d27/d1d/da8/d7b/d91/ff2 [276391,88946] 0 2024-02-19T19:12:28.591 INFO:tasks.workunit.client.1.smithi125.stdout:4/742: write d0/d7/d30/d42/f86 [535727,95017] 0 2024-02-19T19:12:28.592 INFO:tasks.workunit.client.1.smithi125.stdout:4/743: stat d0/d7/d76/dd1 0 2024-02-19T19:12:28.592 INFO:tasks.workunit.client.1.smithi125.stdout:4/744: creat d0/d7/d30/d42/db3/fff x:0 0 0 2024-02-19T19:12:28.592 INFO:tasks.workunit.client.1.smithi125.stdout:8/767: dwrite db/d18/d30/d48/d67/d96/fd5 [552960,61440] 0 2024-02-19T19:12:28.592 INFO:tasks.workunit.client.1.smithi125.stdout:4/745: write d0/d7/d30/d58/fd [2133361,69532] 0 2024-02-19T19:12:28.592 INFO:tasks.workunit.client.1.smithi125.stdout:8/768: write db/fed [738521,2523] 0 2024-02-19T19:12:28.592 INFO:tasks.workunit.client.1.smithi125.stdout:4/746: creat d0/d7/d3b/d75/de3/dcd/dde/f100 x:0 0 0 2024-02-19T19:12:28.592 INFO:tasks.workunit.client.1.smithi125.stdout:8/769: rmdir db/d18/d30/d48/dd8/dd9 39 2024-02-19T19:12:28.592 INFO:tasks.workunit.client.1.smithi125.stdout:4/747: rename d0/d7/d3b/f6b to d0/d7/d85/f101 0 2024-02-19T19:12:28.593 INFO:tasks.workunit.client.1.smithi125.stdout:4/748: chown d0/d7/d3b/f5f 2 1 2024-02-19T19:12:28.593 INFO:tasks.workunit.client.1.smithi125.stdout:8/770: rename db/d18/d30/d80/d9e/fe2 to db/d18/d30/d48/d67/d96/deb/ff5 0 2024-02-19T19:12:28.593 INFO:tasks.workunit.client.1.smithi125.stdout:4/749: rename d0/d7/d30/d58 to d0/d32/d60/d102 0 2024-02-19T19:12:28.593 INFO:tasks.workunit.client.1.smithi125.stdout:8/771: write db/d18/d30/d80/d9e/da3/fb6 [609992,67884] 0 2024-02-19T19:12:28.593 INFO:tasks.workunit.client.1.smithi125.stdout:8/772: write db/d18/f1b [1535133,121157] 0 2024-02-19T19:12:28.639 INFO:tasks.workunit.client.1.smithi125.stdout:7/834: dwrite d12/d18/d44/d3b/d59/d3e/f7a [430080,12288] 0 2024-02-19T19:12:28.640 INFO:tasks.workunit.client.1.smithi125.stdout:7/835: chown d12/d18/d44/d3b/d59/d26/c6f 4 1 2024-02-19T19:12:28.640 INFO:tasks.workunit.client.1.smithi125.stdout:7/836: rmdir d12/d18/dbe 39 2024-02-19T19:12:28.640 INFO:tasks.workunit.client.1.smithi125.stdout:7/837: mkdir d12/d18/d2c/db5/df2 0 2024-02-19T19:12:28.641 INFO:tasks.workunit.client.1.smithi125.stdout:8/773: dwrite db/d18/f27 [475136,114688] 0 2024-02-19T19:12:28.641 INFO:tasks.workunit.client.1.smithi125.stdout:8/774: creat db/d18/d30/d3c/d4d/d5d/da2/dae/ff6 x:0 0 0 2024-02-19T19:12:28.641 INFO:tasks.workunit.client.1.smithi125.stdout:2/830: dwrite d1/d27/d1d/d2c/d2e/f63 [1921024,20480] 0 2024-02-19T19:12:28.641 INFO:tasks.workunit.client.1.smithi125.stdout:8/775: rmdir db/d18/d2f/d72 39 2024-02-19T19:12:28.642 INFO:tasks.workunit.client.1.smithi125.stdout:2/831: stat d1/d36/d70/c9c 0 2024-02-19T19:12:28.642 INFO:tasks.workunit.client.1.smithi125.stdout:2/832: truncate d1/d27/d1d/d25/f6e 32032 0 2024-02-19T19:12:28.642 INFO:tasks.workunit.client.1.smithi125.stdout:8/776: getdents db/d18/d30/d3c/d4d 0 2024-02-19T19:12:28.642 INFO:tasks.workunit.client.1.smithi125.stdout:7/838: dread d12/d18/f3c [3997696,12288] 0 2024-02-19T19:12:28.642 INFO:tasks.workunit.client.1.smithi125.stdout:2/833: creat d1/d36/ff6 x:0 0 0 2024-02-19T19:12:28.642 INFO:tasks.workunit.client.1.smithi125.stdout:2/834: creat d1/d27/d45/d7a/ff7 x:0 0 0 2024-02-19T19:12:28.642 INFO:tasks.workunit.client.1.smithi125.stdout:2/835: write d1/d27/d1d/d25/d7f/f93 [672132,50356] 0 2024-02-19T19:12:28.642 INFO:tasks.workunit.client.1.smithi125.stdout:2/836: dread d1/d27/d1d/d2c/d2e/f63 [487424,16384] 0 2024-02-19T19:12:28.666 INFO:tasks.workunit.client.1.smithi125.stdout:4/750: fdatasync d0/d32/fe8 0 2024-02-19T19:12:28.666 INFO:tasks.workunit.client.1.smithi125.stdout:4/751: dread d0/df/f1c [966656,32768] 0 2024-02-19T19:12:28.670 INFO:tasks.workunit.client.1.smithi125.stdout:8/777: dwrite db/d18/d30/d80/f97 [53248,4096] 0 2024-02-19T19:12:28.670 INFO:tasks.workunit.client.1.smithi125.stdout:8/778: chown db/d18/d2f/f3a 0 1 2024-02-19T19:12:28.670 INFO:tasks.workunit.client.1.smithi125.stdout:2/837: dwrite d1/d27/d1d/d25/d2a/f86 [1368064,57344] 0 2024-02-19T19:12:28.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:28 smithi125 ceph-mon[86115]: pgmap v159: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:12:28.731 INFO:tasks.workunit.client.1.smithi125.stdout:4/752: fsync d0/d32/f61 0 2024-02-19T19:12:28.736 INFO:tasks.workunit.client.1.smithi125.stdout:8/779: mknod db/d18/d2f/d99/cf7 0 2024-02-19T19:12:28.736 INFO:tasks.workunit.client.1.smithi125.stdout:4/753: symlink d0/df/l103 0 2024-02-19T19:12:28.736 INFO:tasks.workunit.client.1.smithi125.stdout:8/780: write db/d18/d30/d48/d67/d96/deb/ff5 [172213,107737] 0 2024-02-19T19:12:28.736 INFO:tasks.workunit.client.1.smithi125.stdout:8/781: creat db/d18/d30/d48/d67/d96/deb/ff8 x:0 0 0 2024-02-19T19:12:28.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:28 smithi096 ceph-mon[112483]: pgmap v159: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:12:28.790 INFO:tasks.workunit.client.1.smithi125.stdout:2/838: fsync d1/d36/d70/f66 0 2024-02-19T19:12:28.790 INFO:tasks.workunit.client.1.smithi125.stdout:2/839: symlink d1/d27/da2/lf8 0 2024-02-19T19:12:28.790 INFO:tasks.workunit.client.1.smithi125.stdout:2/840: read - d1/d27/d1d/d2c/d2e/f90 zero size 2024-02-19T19:12:28.790 INFO:tasks.workunit.client.1.smithi125.stdout:2/841: chown d1/d27/d1d/d39/f69 4799 1 2024-02-19T19:12:28.790 INFO:tasks.workunit.client.1.smithi125.stdout:2/842: creat d1/d36/d70/d85/ff9 x:0 0 0 2024-02-19T19:12:28.790 INFO:tasks.workunit.client.1.smithi125.stdout:2/843: creat d1/d27/d1d/d25/da0/ffa x:0 0 0 2024-02-19T19:12:28.790 INFO:tasks.workunit.client.1.smithi125.stdout:2/844: rename d1/d27/d1d/d2c/d2e/fc6 to d1/d27/d45/d7a/ffb 0 2024-02-19T19:12:28.791 INFO:tasks.workunit.client.1.smithi125.stdout:2/845: mkdir d1/d27/d1d/d25/da3/dfc 0 2024-02-19T19:12:28.791 INFO:tasks.workunit.client.1.smithi125.stdout:8/782: truncate db/d18/f62 888486 0 2024-02-19T19:12:28.791 INFO:tasks.workunit.client.1.smithi125.stdout:8/783: dread db/d18/d30/d48/f5c [307200,90112] 0 2024-02-19T19:12:28.791 INFO:tasks.workunit.client.1.smithi125.stdout:8/784: mkdir db/d18/d2f/d72/df9 0 2024-02-19T19:12:28.793 INFO:tasks.workunit.client.1.smithi125.stdout:4/754: truncate d0/d7/d76/dd1/fd6 618166 0 2024-02-19T19:12:28.793 INFO:tasks.workunit.client.1.smithi125.stdout:4/755: truncate d0/d7/f2f 1298848 0 2024-02-19T19:12:28.793 INFO:tasks.workunit.client.1.smithi125.stdout:2/846: dwrite d1/d27/d1d/f24 [1421312,16384] 0 2024-02-19T19:12:28.793 INFO:tasks.workunit.client.1.smithi125.stdout:4/756: creat d0/d32/d60/d102/f104 x:0 0 0 2024-02-19T19:12:28.793 INFO:tasks.workunit.client.1.smithi125.stdout:4/757: rmdir d0/d7/d30/d5d 39 2024-02-19T19:12:28.794 INFO:tasks.workunit.client.1.smithi125.stdout:8/785: dread db/d6d/fd6 [61440,8192] 0 2024-02-19T19:12:28.795 INFO:tasks.workunit.client.1.smithi125.stdout:2/847: dwrite d1/d27/f5a [1740800,126976] 0 2024-02-19T19:12:28.795 INFO:tasks.workunit.client.1.smithi125.stdout:2/848: unlink d1/d27/d1d/d25/da0/dc3/dc5/fcc 0 2024-02-19T19:12:28.795 INFO:tasks.workunit.client.1.smithi125.stdout:2/849: truncate d1/d27/d1d/d39/f7e 826029 0 2024-02-19T19:12:28.795 INFO:tasks.workunit.client.1.smithi125.stdout:2/850: write d1/d27/d1d/d25/da0/dc3/fec [868084,19194] 0 2024-02-19T19:12:28.795 INFO:tasks.workunit.client.1.smithi125.stdout:2/851: truncate d1/d27/d1d/d2c/f31 3517890 0 2024-02-19T19:12:28.795 INFO:tasks.workunit.client.1.smithi125.stdout:2/852: creat d1/d27/d1d/da8/d7b/d91/ffd x:0 0 0 2024-02-19T19:12:28.795 INFO:tasks.workunit.client.1.smithi125.stdout:2/853: mkdir d1/d27/d1d/d25/d2a/dfe 0 2024-02-19T19:12:28.795 INFO:tasks.workunit.client.1.smithi125.stdout:4/758: dwrite d0/d7/d30/d42/d7b/f99 [3223552,73728] 0 2024-02-19T19:12:28.796 INFO:tasks.workunit.client.1.smithi125.stdout:2/854: dread d1/d36/d70/d4b/f75 [1380352,36864] 0 2024-02-19T19:12:28.796 INFO:tasks.workunit.client.1.smithi125.stdout:4/759: write d0/d32/d60/d102/f69 [587439,32052] 0 2024-02-19T19:12:28.833 INFO:tasks.workunit.client.1.smithi125.stdout:4/760: dwrite d0/f1b [1007616,81920] 0 2024-02-19T19:12:28.833 INFO:tasks.workunit.client.1.smithi125.stdout:4/761: unlink d0/fa 0 2024-02-19T19:12:28.834 INFO:tasks.workunit.client.1.smithi125.stdout:4/762: mknod d0/d7/d30/d42/d7b/c105 0 2024-02-19T19:12:28.834 INFO:tasks.workunit.client.1.smithi125.stdout:4/763: mkdir d0/d7/d3b/d75/de3/dcd/d106 0 2024-02-19T19:12:28.834 INFO:tasks.workunit.client.1.smithi125.stdout:4/764: symlink d0/d7/l107 0 2024-02-19T19:12:28.834 INFO:tasks.workunit.client.1.smithi125.stdout:4/765: link d0/d32/fcb d0/d7/d3b/d75/f108 0 2024-02-19T19:12:28.834 INFO:tasks.workunit.client.1.smithi125.stdout:4/766: read - d0/d7/dad/fc8 zero size 2024-02-19T19:12:28.835 INFO:tasks.workunit.client.1.smithi125.stdout:8/786: truncate db/d18/d2f/f3a 76119 0 2024-02-19T19:12:28.835 INFO:tasks.workunit.client.1.smithi125.stdout:8/787: creat db/d18/d30/d80/ffa x:0 0 0 2024-02-19T19:12:28.842 INFO:tasks.workunit.client.1.smithi125.stdout:2/855: write d1/d36/d70/d85/da4/fa6 [1853812,62179] 0 2024-02-19T19:12:28.845 INFO:tasks.workunit.client.1.smithi125.stdout:2/856: dwrite d1/d27/d1d/da8/d7b/d91/ffd [311296,118784] 0 2024-02-19T19:12:28.845 INFO:tasks.workunit.client.1.smithi125.stdout:2/857: dread d1/d36/f67 [2019328,49152] 0 2024-02-19T19:12:28.845 INFO:tasks.workunit.client.1.smithi125.stdout:2/858: stat d1/d36/d70/d4b 0 2024-02-19T19:12:28.845 INFO:tasks.workunit.client.1.smithi125.stdout:2/859: link d1/d27/d1d/d39/f7e d1/d36/d70/d85/da4/fff 0 2024-02-19T19:12:28.847 INFO:tasks.workunit.client.1.smithi125.stdout:8/788: dread db/f6b [73728,114688] 0 2024-02-19T19:12:28.848 INFO:tasks.workunit.client.1.smithi125.stdout:8/789: write db/d18/f21 [1583252,93493] 0 2024-02-19T19:12:28.848 INFO:tasks.workunit.client.1.smithi125.stdout:8/790: mkdir db/d18/d2f/d72/df9/dfb 0 2024-02-19T19:12:28.848 INFO:tasks.workunit.client.1.smithi125.stdout:8/791: dread db/d18/d30/d48/d67/d96/fe5 [315392,12288] 0 2024-02-19T19:12:28.848 INFO:tasks.workunit.client.1.smithi125.stdout:8/792: creat db/d18/d30/d80/dac/ffc x:0 0 0 2024-02-19T19:12:28.989 INFO:tasks.workunit.client.1.smithi125.stdout:8/793: fdatasync db/d18/d30/fa9 0 2024-02-19T19:12:28.993 INFO:tasks.workunit.client.1.smithi125.stdout:8/794: mknod db/d18/d30/dd2/cfd 0 2024-02-19T19:12:28.993 INFO:tasks.workunit.client.1.smithi125.stdout:8/795: truncate db/d18/d2f/d72/f87 1343109 0 2024-02-19T19:12:29.030 INFO:tasks.workunit.client.1.smithi125.stdout:8/796: fdatasync db/d18/d30/d80/dac/fbb 0 2024-02-19T19:12:29.030 INFO:tasks.workunit.client.1.smithi125.stdout:8/797: creat db/d18/d30/d3c/d4d/d5d/d6f/ffe x:0 0 0 2024-02-19T19:12:29.030 INFO:tasks.workunit.client.1.smithi125.stdout:8/798: chown db/d18/d2f/d3f 10 1 2024-02-19T19:12:29.030 INFO:tasks.workunit.client.1.smithi125.stdout:8/799: write db/d18/d30/d48/d67/ff4 [562593,54471] 0 2024-02-19T19:12:29.030 INFO:tasks.workunit.client.1.smithi125.stdout:8/800: dread f4 [1015808,4096] 0 2024-02-19T19:12:29.031 INFO:tasks.workunit.client.1.smithi125.stdout:8/801: write db/d18/d30/d3c/d4d/d5d/da2/dae/ff6 [528723,13444] 0 2024-02-19T19:12:29.031 INFO:tasks.workunit.client.1.smithi125.stdout:8/802: unlink db/d18/d2f/l42 0 2024-02-19T19:12:29.031 INFO:tasks.workunit.client.1.smithi125.stdout:8/803: creat db/d18/d2f/d72/fff x:0 0 0 2024-02-19T19:12:29.031 INFO:tasks.workunit.client.1.smithi125.stdout:8/804: symlink db/d18/d30/d48/d67/d96/deb/l100 0 2024-02-19T19:12:29.031 INFO:tasks.workunit.client.1.smithi125.stdout:8/805: stat db/d18/d30/d80/d9e/da3/fb6 0 2024-02-19T19:12:29.031 INFO:tasks.workunit.client.1.smithi125.stdout:8/806: chown db/d18/d30/d80/d9e 2129 1 2024-02-19T19:12:29.031 INFO:tasks.workunit.client.1.smithi125.stdout:8/807: stat db/d18/d30/d3c 0 2024-02-19T19:12:29.031 INFO:tasks.workunit.client.1.smithi125.stdout:8/808: mkdir db/d18/d30/d48/db9/def/d101 0 2024-02-19T19:12:29.031 INFO:tasks.workunit.client.1.smithi125.stdout:8/809: dread db/fc9 [311296,57344] 0 2024-02-19T19:12:29.032 INFO:tasks.workunit.client.1.smithi125.stdout:8/810: chown db/d18/d2f/d72/ce6 16137179 1 2024-02-19T19:12:29.032 INFO:tasks.workunit.client.1.smithi125.stdout:8/811: mknod db/d81/c102 0 2024-02-19T19:12:29.032 INFO:tasks.workunit.client.1.smithi125.stdout:8/812: mkdir db/d18/d30/d48/d67/d96/d103 0 2024-02-19T19:12:29.032 INFO:tasks.workunit.client.1.smithi125.stdout:8/813: dread db/d18/d2f/f93 [32768,102400] 0 2024-02-19T19:12:29.032 INFO:tasks.workunit.client.1.smithi125.stdout:8/814: chown db/d18/d30/d48/f7a 7022065 1 2024-02-19T19:12:29.035 INFO:tasks.workunit.client.1.smithi125.stdout:0/874: sync 2024-02-19T19:12:29.035 INFO:tasks.workunit.client.1.smithi125.stdout:9/971: sync 2024-02-19T19:12:29.035 INFO:tasks.workunit.client.1.smithi125.stdout:3/752: sync 2024-02-19T19:12:29.035 INFO:tasks.workunit.client.1.smithi125.stdout:0/875: link d5/d19/l31 d5/d15/l131 0 2024-02-19T19:12:29.035 INFO:tasks.workunit.client.1.smithi125.stdout:0/876: chown d5/d33/d42/f12e 49082750 1 2024-02-19T19:12:29.035 INFO:tasks.workunit.client.1.smithi125.stdout:0/877: dread - d5/d1a/fba zero size 2024-02-19T19:12:29.036 INFO:tasks.workunit.client.1.smithi125.stdout:9/972: creat d8/d15/d22/de0/d13b/f14f x:0 0 0 2024-02-19T19:12:29.036 INFO:tasks.workunit.client.1.smithi125.stdout:0/878: truncate d5/d33/d42/fa7 1438591 0 2024-02-19T19:12:29.036 INFO:tasks.workunit.client.1.smithi125.stdout:3/753: read d0/d1/d1e/d60/d7c/db6/d71/f7f [239052,124443] 0 2024-02-19T19:12:29.036 INFO:tasks.workunit.client.1.smithi125.stdout:0/879: creat d5/d19/d27/d32/d109/db3/f132 x:0 0 0 2024-02-19T19:12:29.036 INFO:tasks.workunit.client.1.smithi125.stdout:0/880: read - d5/d1a/fba zero size 2024-02-19T19:12:29.036 INFO:tasks.workunit.client.1.smithi125.stdout:9/973: symlink d8/d15/d32/d4f/d85/de2/d135/d106/l150 0 2024-02-19T19:12:29.036 INFO:tasks.workunit.client.1.smithi125.stdout:3/754: mknod d0/d1/d1e/cf8 0 2024-02-19T19:12:29.036 INFO:tasks.workunit.client.1.smithi125.stdout:9/974: dread - d8/d15/d22/f116 zero size 2024-02-19T19:12:29.037 INFO:tasks.workunit.client.1.smithi125.stdout:0/881: mkdir d5/d33/d42/d92/d133 0 2024-02-19T19:12:29.037 INFO:tasks.workunit.client.1.smithi125.stdout:3/755: symlink d0/d95/lf9 0 2024-02-19T19:12:29.037 INFO:tasks.workunit.client.1.smithi125.stdout:9/975: symlink d8/d15/d22/d4e/d90/l151 0 2024-02-19T19:12:29.037 INFO:tasks.workunit.client.1.smithi125.stdout:0/882: symlink d5/d33/d42/d92/da5/l134 0 2024-02-19T19:12:29.037 INFO:tasks.workunit.client.1.smithi125.stdout:9/976: unlink d8/d15/f1c 0 2024-02-19T19:12:29.037 INFO:tasks.workunit.client.1.smithi125.stdout:3/756: creat d0/d1/d1e/d60/da5/ffa x:0 0 0 2024-02-19T19:12:29.037 INFO:tasks.workunit.client.1.smithi125.stdout:9/977: chown d8/d15/d22/d4e/f47 1766289 1 2024-02-19T19:12:29.037 INFO:tasks.workunit.client.1.smithi125.stdout:9/978: stat d8/d15/d32/f9b 0 2024-02-19T19:12:29.037 INFO:tasks.workunit.client.1.smithi125.stdout:0/883: read d5/d19/f62 [1857212,77958] 0 2024-02-19T19:12:29.038 INFO:tasks.workunit.client.1.smithi125.stdout:3/757: symlink d0/d95/lfb 0 2024-02-19T19:12:29.038 INFO:tasks.workunit.client.1.smithi125.stdout:9/979: write d8/d15/d22/d4e/d90/ffc [663638,28344] 0 2024-02-19T19:12:29.038 INFO:tasks.workunit.client.1.smithi125.stdout:0/884: write d5/d19/d27/d32/f3a [344193,31188] 0 2024-02-19T19:12:29.038 INFO:tasks.workunit.client.1.smithi125.stdout:9/980: symlink d8/d15/l152 0 2024-02-19T19:12:29.038 INFO:tasks.workunit.client.1.smithi125.stdout:9/981: truncate d8/d15/d22/d4e/f47 865205 0 2024-02-19T19:12:29.038 INFO:tasks.workunit.client.1.smithi125.stdout:3/758: write d0/d1/d4b/fbb [93373,123730] 0 2024-02-19T19:12:29.038 INFO:tasks.workunit.client.1.smithi125.stdout:9/982: creat d8/d15/d32/d4f/f153 x:0 0 0 2024-02-19T19:12:29.038 INFO:tasks.workunit.client.1.smithi125.stdout:9/983: dread - d8/d15/d22/de0/f143 zero size 2024-02-19T19:12:29.039 INFO:tasks.workunit.client.1.smithi125.stdout:3/759: getdents d0/d95 0 2024-02-19T19:12:29.039 INFO:tasks.workunit.client.1.smithi125.stdout:3/760: mknod d0/d1/d1e/d60/d7c/db6/cfc 0 2024-02-19T19:12:29.039 INFO:tasks.workunit.client.1.smithi125.stdout:9/984: write d8/d15/d32/d4f/f5e [362717,53582] 0 2024-02-19T19:12:29.039 INFO:tasks.workunit.client.1.smithi125.stdout:3/761: write d0/d1/d4b/d52/f8a [1768430,66943] 0 2024-02-19T19:12:29.039 INFO:tasks.workunit.client.1.smithi125.stdout:8/815: dwrite db/d6d/fa7 [1302528,77824] 0 2024-02-19T19:12:29.083 INFO:tasks.workunit.client.1.smithi125.stdout:9/985: fdatasync d8/d15/d22/fcf 0 2024-02-19T19:12:29.084 INFO:tasks.workunit.client.1.smithi125.stdout:3/762: fsync d0/d1/f63 0 2024-02-19T19:12:29.084 INFO:tasks.workunit.client.1.smithi125.stdout:3/763: dread - d0/d1/d4b/f4f zero size 2024-02-19T19:12:29.084 INFO:tasks.workunit.client.1.smithi125.stdout:3/764: chown d0/d1/d4b/d52/d81/lf3 108209 1 2024-02-19T19:12:29.084 INFO:tasks.workunit.client.1.smithi125.stdout:3/765: read d0/d95/fa9 [78296,3404] 0 2024-02-19T19:12:29.084 INFO:tasks.workunit.client.1.smithi125.stdout:3/766: stat d0/d1/c66 0 2024-02-19T19:12:29.084 INFO:tasks.workunit.client.1.smithi125.stdout:3/767: chown d0/d95/fa7 11853 1 2024-02-19T19:12:29.136 INFO:tasks.workunit.client.1.smithi125.stdout:3/768: fdatasync d0/d1/d4b/d52/d81/dd0/fdd 0 2024-02-19T19:12:29.138 INFO:tasks.workunit.client.1.smithi125.stdout:0/885: dwrite d5/d15/d2c/d80/f4f [1482752,53248] 0 2024-02-19T19:12:29.138 INFO:tasks.workunit.client.1.smithi125.stdout:8/816: dwrite db/d18/d2f/f93 [1032192,98304] 0 2024-02-19T19:12:29.138 INFO:tasks.workunit.client.1.smithi125.stdout:3/769: creat d0/ffd x:0 0 0 2024-02-19T19:12:29.138 INFO:tasks.workunit.client.1.smithi125.stdout:3/770: rmdir d0/d1/d4b/d52/d81 39 2024-02-19T19:12:29.138 INFO:tasks.workunit.client.1.smithi125.stdout:9/986: write d8/d2e/d6d/f88 [449827,36445] 0 2024-02-19T19:12:29.138 INFO:tasks.workunit.client.1.smithi125.stdout:0/886: write d5/d1a/f34 [167918,68397] 0 2024-02-19T19:12:29.139 INFO:tasks.workunit.client.1.smithi125.stdout:0/887: chown d5/d19/d27/dc3/ffd 925 1 2024-02-19T19:12:29.139 INFO:tasks.workunit.client.1.smithi125.stdout:0/888: getdents d5/d9/dcd 0 2024-02-19T19:12:29.139 INFO:tasks.workunit.client.1.smithi125.stdout:0/889: mknod d5/d19/d27/d11a/c135 0 2024-02-19T19:12:29.139 INFO:tasks.workunit.client.1.smithi125.stdout:9/987: rename d8/d15/f144 to d8/d15/d32/d4f/d85/dcb/f154 0 2024-02-19T19:12:29.140 INFO:tasks.workunit.client.1.smithi125.stdout:9/988: mknod d8/d15/d22/d44/c155 0 2024-02-19T19:12:29.140 INFO:tasks.workunit.client.1.smithi125.stdout:9/989: creat d8/d15/d32/d4f/de7/f156 x:0 0 0 2024-02-19T19:12:29.140 INFO:tasks.workunit.client.1.smithi125.stdout:9/990: chown f2 82 1 2024-02-19T19:12:29.140 INFO:tasks.workunit.client.1.smithi125.stdout:8/817: dwrite db/d18/d30/d48/d67/d96/fb2 [589824,45056] 0 2024-02-19T19:12:29.205 INFO:tasks.workunit.client.1.smithi125.stdout:3/771: fdatasync d0/d1/d1e/f5d 0 2024-02-19T19:12:29.205 INFO:tasks.workunit.client.1.smithi125.stdout:9/991: fdatasync d8/d15/f70 0 2024-02-19T19:12:29.205 INFO:tasks.workunit.client.1.smithi125.stdout:9/992: creat d8/d15/f157 x:0 0 0 2024-02-19T19:12:29.206 INFO:tasks.workunit.client.1.smithi125.stdout:9/993: write d8/d15/d22/de0/f143 [864028,7963] 0 2024-02-19T19:12:29.206 INFO:tasks.workunit.client.1.smithi125.stdout:9/994: write d8/d15/d22/f78 [157567,66674] 0 2024-02-19T19:12:29.206 INFO:tasks.workunit.client.1.smithi125.stdout:9/995: dread d8/d15/d22/fa6 [167936,16384] 0 2024-02-19T19:12:29.206 INFO:tasks.workunit.client.1.smithi125.stdout:9/996: write d8/d15/d32/f64 [308413,41241] 0 2024-02-19T19:12:29.206 INFO:tasks.workunit.client.1.smithi125.stdout:9/997: write d8/d15/d22/d4e/d90/f13d [617,62973] 0 2024-02-19T19:12:29.206 INFO:tasks.workunit.client.1.smithi125.stdout:9/998: write d8/d15/d32/f9b [384444,120455] 0 2024-02-19T19:12:29.206 INFO:tasks.workunit.client.1.smithi125.stdout:9/999: truncate d8/d15/d32/d4f/d85/de2/fee 922597 0 2024-02-19T19:12:29.208 INFO:tasks.workunit.client.1.smithi125.stdout:7/839: sync 2024-02-19T19:12:29.208 INFO:tasks.workunit.client.1.smithi125.stdout:8/818: dwrite db/d81/fc0 [675840,106496] 0 2024-02-19T19:12:29.208 INFO:tasks.workunit.client.1.smithi125.stdout:8/819: rename db/d18/d30/d48/d67 to db/d18/d30/d3c/dc6/d104 0 2024-02-19T19:12:29.216 INFO:tasks.workunit.client.1.smithi125.stdout:3/772: dread d0/d1/d1e/f5d [1146880,36864] 0 2024-02-19T19:12:29.216 INFO:tasks.workunit.client.1.smithi125.stdout:3/773: getdents d0 0 2024-02-19T19:12:29.274 INFO:tasks.workunit.client.1.smithi125.stdout:7/840: dwrite d12/d3d/f4f [593920,49152] 0 2024-02-19T19:12:29.274 INFO:tasks.workunit.client.1.smithi125.stdout:3/774: dwrite d0/d1/f56 [1093632,90112] 0 2024-02-19T19:12:29.275 INFO:tasks.workunit.client.1.smithi125.stdout:7/841: mknod d12/d3d/dd7/dec/cf3 0 2024-02-19T19:12:29.275 INFO:tasks.workunit.client.1.smithi125.stdout:7/842: rename d12/d18/d44/d3b/d59/d67/ce0 to d12/d18/d63/cf4 0 2024-02-19T19:12:29.275 INFO:tasks.workunit.client.1.smithi125.stdout:3/775: read d0/d1/f6e [31965,87781] 0 2024-02-19T19:12:29.275 INFO:tasks.workunit.client.1.smithi125.stdout:7/843: creat d12/d18/d44/d3b/d59/d67/ff5 x:0 0 0 2024-02-19T19:12:29.275 INFO:tasks.workunit.client.1.smithi125.stdout:3/776: getdents d0/d1/d1e/d60 0 2024-02-19T19:12:29.275 INFO:tasks.workunit.client.1.smithi125.stdout:7/844: creat d12/d18/d63/ff6 x:0 0 0 2024-02-19T19:12:29.277 INFO:tasks.workunit.client.1.smithi125.stdout:7/845: dwrite d12/d18/d44/d3b/d59/f5e [2256896,20480] 0 2024-02-19T19:12:29.277 INFO:tasks.workunit.client.1.smithi125.stdout:7/846: stat d12/d18/d66/laf 0 2024-02-19T19:12:29.277 INFO:tasks.workunit.client.1.smithi125.stdout:7/847: symlink d12/d18/d44/d3b/d59/d26/d30/d37/dc1/de9/lf7 0 2024-02-19T19:12:29.277 INFO:tasks.workunit.client.1.smithi125.stdout:7/848: chown d12/d18/d44/d3b/d59/d26/f3a 2 1 2024-02-19T19:12:29.277 INFO:tasks.workunit.client.1.smithi125.stdout:7/849: write d12/d3d/f4f [306153,77176] 0 2024-02-19T19:12:29.277 INFO:tasks.workunit.client.1.smithi125.stdout:7/850: creat d12/d18/d44/d3b/d59/d2a/d6a/dab/ff8 x:0 0 0 2024-02-19T19:12:29.278 INFO:tasks.workunit.client.1.smithi125.stdout:7/851: mkdir d12/d18/d2c/d4e/d82/df9 0 2024-02-19T19:12:29.278 INFO:tasks.workunit.client.1.smithi125.stdout:7/852: link fa d12/d18/d44/d3b/d59/d2a/d6a/dab/ffa 0 2024-02-19T19:12:29.525 INFO:tasks.workunit.client.1.smithi125.stdout:4/767: sync 2024-02-19T19:12:29.525 INFO:tasks.workunit.client.1.smithi125.stdout:2/860: sync 2024-02-19T19:12:29.526 INFO:tasks.workunit.client.1.smithi125.stdout:4/768: creat d0/d7/d3b/d75/de3/dcd/d106/f109 x:0 0 0 2024-02-19T19:12:29.526 INFO:tasks.workunit.client.1.smithi125.stdout:4/769: mknod d0/d7/d30/d42/d7b/c10a 0 2024-02-19T19:12:29.526 INFO:tasks.workunit.client.1.smithi125.stdout:4/770: readlink d0/df/lbd 0 2024-02-19T19:12:29.526 INFO:tasks.workunit.client.1.smithi125.stdout:4/771: getdents d0/d7/d3b/d75/de3/dcd/dde 0 2024-02-19T19:12:29.526 INFO:tasks.workunit.client.1.smithi125.stdout:4/772: dread d0/d32/f55 [225280,24576] 0 2024-02-19T19:12:29.526 INFO:tasks.workunit.client.1.smithi125.stdout:4/773: mkdir d0/d7/d3b/d77/d10b 0 2024-02-19T19:12:29.526 INFO:tasks.workunit.client.1.smithi125.stdout:4/774: mknod d0/d7/d3b/c10c 0 2024-02-19T19:12:29.526 INFO:tasks.workunit.client.1.smithi125.stdout:4/775: mknod d0/d32/c10d 0 2024-02-19T19:12:29.526 INFO:tasks.workunit.client.1.smithi125.stdout:4/776: rmdir d0/d7/d3b/d75/de3/dcd/dde 39 2024-02-19T19:12:29.527 INFO:tasks.workunit.client.1.smithi125.stdout:4/777: chown d0/d7/f13 781081066 1 2024-02-19T19:12:29.527 INFO:tasks.workunit.client.1.smithi125.stdout:4/778: truncate d0/d7/d30/d42/f78 1017618 0 2024-02-19T19:12:29.527 INFO:tasks.workunit.client.1.smithi125.stdout:4/779: readlink d0/d7/dad/db9/lbc 0 2024-02-19T19:12:29.527 INFO:tasks.workunit.client.1.smithi125.stdout:4/780: link d0/d7/d76/fed d0/d7/d30/d42/f10e 0 2024-02-19T19:12:29.527 INFO:tasks.workunit.client.1.smithi125.stdout:4/781: chown d0/d7/d3b/d77/l8d 0 1 2024-02-19T19:12:29.527 INFO:tasks.workunit.client.1.smithi125.stdout:4/782: chown d0/d7/d3b/d75/fe9 3 1 2024-02-19T19:12:29.527 INFO:tasks.workunit.client.1.smithi125.stdout:4/783: truncate d0/df/f52 864076 0 2024-02-19T19:12:29.527 INFO:tasks.workunit.client.1.smithi125.stdout:4/784: symlink d0/d32/d60/l10f 0 2024-02-19T19:12:29.605 INFO:tasks.workunit.client.1.smithi125.stdout:4/785: dwrite d0/d32/d60/d102/f9 [3723264,32768] 0 2024-02-19T19:12:29.606 INFO:tasks.workunit.client.1.smithi125.stdout:4/786: dwrite d0/d7/d30/d42/fc2 [147456,118784] 0 2024-02-19T19:12:29.675 INFO:tasks.workunit.client.1.smithi125.stdout:0/890: sync 2024-02-19T19:12:29.705 INFO:tasks.workunit.client.1.smithi125.stdout:4/787: fsync d0/d32/d60/d102/fb1 0 2024-02-19T19:12:29.709 INFO:tasks.workunit.client.1.smithi125.stdout:4/788: dwrite d0/df/fab [618496,106496] 0 2024-02-19T19:12:29.710 INFO:tasks.workunit.client.1.smithi125.stdout:4/789: mkdir d0/d32/d60/d102/d110 0 2024-02-19T19:12:29.710 INFO:tasks.workunit.client.1.smithi125.stdout:4/790: creat d0/d7/d3b/d75/de3/dcd/f111 x:0 0 0 2024-02-19T19:12:29.713 INFO:tasks.workunit.client.1.smithi125.stdout:8/820: sync 2024-02-19T19:12:29.713 INFO:tasks.workunit.client.1.smithi125.stdout:2/861: sync 2024-02-19T19:12:29.713 INFO:tasks.workunit.client.1.smithi125.stdout:7/853: sync 2024-02-19T19:12:29.713 INFO:tasks.workunit.client.1.smithi125.stdout:3/777: sync 2024-02-19T19:12:29.713 INFO:tasks.workunit.client.1.smithi125.stdout:8/821: dread db/d18/d30/d3c/d4d/f9f [401408,16384] 0 2024-02-19T19:12:29.713 INFO:tasks.workunit.client.1.smithi125.stdout:8/822: dread db/f41 [950272,12288] 0 2024-02-19T19:12:29.714 INFO:tasks.workunit.client.1.smithi125.stdout:8/823: readlink db/l9b 0 2024-02-19T19:12:29.714 INFO:tasks.workunit.client.1.smithi125.stdout:7/854: rename d12/d18/d66/da0/fcf to d12/d18/d44/d3b/d59/d3e/ffb 0 2024-02-19T19:12:29.714 INFO:tasks.workunit.client.1.smithi125.stdout:8/824: chown db/d18/d30/d3c/f68 44331225 1 2024-02-19T19:12:29.714 INFO:tasks.workunit.client.1.smithi125.stdout:4/791: unlink d0/d7/d3b/f5f 0 2024-02-19T19:12:29.714 INFO:tasks.workunit.client.1.smithi125.stdout:7/855: symlink d12/d18/dbe/de4/lfc 0 2024-02-19T19:12:29.714 INFO:tasks.workunit.client.1.smithi125.stdout:7/856: rename d12/d18/dbe/dd0 to d12/d18/d44/d3b/d59/d2a/d31/dfd 0 2024-02-19T19:12:29.714 INFO:tasks.workunit.client.1.smithi125.stdout:7/857: rename d12/d18/d44/d3b/d59/d2a/d31/d50/c91 to d12/d18/d44/d3b/d59/d26/d30/dad/cfe 0 2024-02-19T19:12:29.714 INFO:tasks.workunit.client.1.smithi125.stdout:4/792: write d0/d32/d60/d102/f39 [457089,66233] 0 2024-02-19T19:12:29.715 INFO:tasks.workunit.client.1.smithi125.stdout:4/793: mkdir d0/d7/dad/db9/d112 0 2024-02-19T19:12:29.715 INFO:tasks.workunit.client.1.smithi125.stdout:4/794: getdents d0/d32 0 2024-02-19T19:12:29.715 INFO:tasks.workunit.client.1.smithi125.stdout:4/795: write d0/df/f73 [594302,121489] 0 2024-02-19T19:12:29.716 INFO:tasks.workunit.client.1.smithi125.stdout:0/891: dread d5/d19/d2b/f7a [192512,45056] 0 2024-02-19T19:12:29.716 INFO:tasks.workunit.client.1.smithi125.stdout:0/892: dread - d5/d33/f97 zero size 2024-02-19T19:12:29.716 INFO:tasks.workunit.client.1.smithi125.stdout:0/893: dread d5/d33/d42/f61 [45056,98304] 0 2024-02-19T19:12:29.716 INFO:tasks.workunit.client.1.smithi125.stdout:0/894: readlink d5/d9/lde 0 2024-02-19T19:12:29.716 INFO:tasks.workunit.client.1.smithi125.stdout:0/895: readlink d5/d15/d2c/d80/l93 0 2024-02-19T19:12:29.805 INFO:tasks.workunit.client.1.smithi125.stdout:4/796: dwrite d0/d7/fce [663552,65536] 0 2024-02-19T19:12:29.805 INFO:tasks.workunit.client.1.smithi125.stdout:4/797: symlink d0/d7/d30/l113 0 2024-02-19T19:12:29.805 INFO:tasks.workunit.client.1.smithi125.stdout:4/798: write d0/d7/f26 [18404,85339] 0 2024-02-19T19:12:29.805 INFO:tasks.workunit.client.1.smithi125.stdout:4/799: chown d0/d7/d3b/ff1 4243153 1 2024-02-19T19:12:29.806 INFO:tasks.workunit.client.1.smithi125.stdout:4/800: write d0/df/f9f [785552,71245] 0 2024-02-19T19:12:29.806 INFO:tasks.workunit.client.1.smithi125.stdout:4/801: write d0/d7/dad/db9/ffb [803402,61034] 0 2024-02-19T19:12:29.806 INFO:tasks.workunit.client.1.smithi125.stdout:4/802: unlink d0/d32/d60/l10f 0 2024-02-19T19:12:29.806 INFO:tasks.workunit.client.1.smithi125.stdout:4/803: write d0/df/f9f [1790364,70374] 0 2024-02-19T19:12:29.810 INFO:tasks.workunit.client.1.smithi125.stdout:7/858: dread d12/d18/d44/d3b/d59/d26/d30/dad/f49 [1093632,122880] 0 2024-02-19T19:12:29.810 INFO:tasks.workunit.client.1.smithi125.stdout:7/859: symlink d12/d18/lff 0 2024-02-19T19:12:29.822 INFO:tasks.workunit.client.1.smithi125.stdout:0/896: fdatasync d5/d19/d27/d32/f7d 0 2024-02-19T19:12:29.822 INFO:tasks.workunit.client.1.smithi125.stdout:0/897: write d5/d33/d9b/feb [1397744,95599] 0 2024-02-19T19:12:29.847 INFO:tasks.workunit.client.1.smithi125.stdout:4/804: fsync d0/df/fab 0 2024-02-19T19:12:29.847 INFO:tasks.workunit.client.1.smithi125.stdout:0/898: fsync d5/d19/f78 0 2024-02-19T19:12:29.848 INFO:tasks.workunit.client.1.smithi125.stdout:0/899: creat d5/d19/d27/d32/d109/db3/dd4/dfb/f136 x:0 0 0 2024-02-19T19:12:29.851 INFO:tasks.workunit.client.1.smithi125.stdout:0/900: symlink d5/d15/l137 0 2024-02-19T19:12:29.851 INFO:tasks.workunit.client.1.smithi125.stdout:0/901: rmdir d5/d33/d42/d92/d133 0 2024-02-19T19:12:29.851 INFO:tasks.workunit.client.1.smithi125.stdout:0/902: creat d5/d33/d46/f138 x:0 0 0 2024-02-19T19:12:29.851 INFO:tasks.workunit.client.1.smithi125.stdout:0/903: mkdir d5/d9/dcd/dce/d139 0 2024-02-19T19:12:29.851 INFO:tasks.workunit.client.1.smithi125.stdout:0/904: stat d5/d9/f108 0 2024-02-19T19:12:29.851 INFO:tasks.workunit.client.1.smithi125.stdout:0/905: creat d5/d19/d48/f13a x:0 0 0 2024-02-19T19:12:29.851 INFO:tasks.workunit.client.1.smithi125.stdout:0/906: chown d5/d19/d2b/fda 52 1 2024-02-19T19:12:29.852 INFO:tasks.workunit.client.1.smithi125.stdout:0/907: creat d5/d9/f13b x:0 0 0 2024-02-19T19:12:29.852 INFO:tasks.workunit.client.1.smithi125.stdout:0/908: write d5/d33/d46/f138 [368059,74470] 0 2024-02-19T19:12:29.852 INFO:tasks.workunit.client.1.smithi125.stdout:0/909: creat d5/d19/d27/d32/dd7/d107/f13c x:0 0 0 2024-02-19T19:12:29.852 INFO:tasks.workunit.client.1.smithi125.stdout:0/910: symlink d5/d15/l13d 0 2024-02-19T19:12:29.852 INFO:tasks.workunit.client.1.smithi125.stdout:0/911: write d5/d33/d9b/feb [871471,30295] 0 2024-02-19T19:12:29.852 INFO:tasks.workunit.client.1.smithi125.stdout:0/912: creat d5/d33/d9b/de5/f13e x:0 0 0 2024-02-19T19:12:29.852 INFO:tasks.workunit.client.1.smithi125.stdout:0/913: dread - d5/d19/d2b/fda zero size 2024-02-19T19:12:29.853 INFO:tasks.workunit.client.1.smithi125.stdout:0/914: write d5/d19/d27/d32/f3a [785027,12638] 0 2024-02-19T19:12:29.861 INFO:tasks.workunit.client.1.smithi125.stdout:4/805: dread d0/d7/d85/f8f [630784,126976] 0 2024-02-19T19:12:29.862 INFO:tasks.workunit.client.1.smithi125.stdout:4/806: read d0/f40 [348711,63624] 0 2024-02-19T19:12:29.862 INFO:tasks.workunit.client.1.smithi125.stdout:4/807: symlink d0/d7/d30/d42/db3/ddf/l114 0 2024-02-19T19:12:29.862 INFO:tasks.workunit.client.1.smithi125.stdout:4/808: chown d0/d32/d60/d102/f9 0 1 2024-02-19T19:12:29.862 INFO:tasks.workunit.client.1.smithi125.stdout:4/809: write d0/d7/d3b/f62 [1932461,29574] 0 2024-02-19T19:12:29.862 INFO:tasks.workunit.client.1.smithi125.stdout:4/810: rename d0/d7/d30/cca to d0/d7/d76/c115 0 2024-02-19T19:12:29.862 INFO:tasks.workunit.client.1.smithi125.stdout:4/811: stat d0/d7/d30/l9a 0 2024-02-19T19:12:29.862 INFO:tasks.workunit.client.1.smithi125.stdout:4/812: stat d0/d32 0 2024-02-19T19:12:29.862 INFO:tasks.workunit.client.1.smithi125.stdout:4/813: write d0/d32/f8b [631931,70314] 0 2024-02-19T19:12:29.862 INFO:tasks.workunit.client.1.smithi125.stdout:4/814: unlink d0/d7/d30/d42/db3/ddf/l114 0 2024-02-19T19:12:29.863 INFO:tasks.workunit.client.1.smithi125.stdout:4/815: chown d0/df/lbd 5162397 1 2024-02-19T19:12:29.863 INFO:tasks.workunit.client.1.smithi125.stdout:4/816: dread - d0/d7/d85/f9e zero size 2024-02-19T19:12:29.863 INFO:tasks.workunit.client.1.smithi125.stdout:4/817: rename d0/d7/d85/f101 to d0/df/dda/f116 0 2024-02-19T19:12:29.899 INFO:tasks.workunit.client.1.smithi125.stdout:0/915: dwrite d5/d19/d27/d32/d109/db3/dd4/dfb/d106/f101 [180224,110592] 0 2024-02-19T19:12:29.900 INFO:tasks.workunit.client.1.smithi125.stdout:0/916: mknod d5/d1a/d4c/c13f 0 2024-02-19T19:12:29.926 INFO:tasks.workunit.client.1.smithi125.stdout:4/818: fdatasync d0/d32/f46 0 2024-02-19T19:12:29.926 INFO:tasks.workunit.client.1.smithi125.stdout:4/819: creat d0/d7/d85/f117 x:0 0 0 2024-02-19T19:12:29.927 INFO:tasks.workunit.client.1.smithi125.stdout:4/820: read d0/d32/d60/d102/f1e [953006,4006] 0 2024-02-19T19:12:29.927 INFO:tasks.workunit.client.1.smithi125.stdout:4/821: creat d0/d7/d3b/d75/de3/dcd/f118 x:0 0 0 2024-02-19T19:12:29.927 INFO:tasks.workunit.client.1.smithi125.stdout:4/822: chown d0/df/l9d 769 1 2024-02-19T19:12:29.933 INFO:tasks.workunit.client.1.smithi125.stdout:2/862: sync 2024-02-19T19:12:29.934 INFO:tasks.workunit.client.1.smithi125.stdout:3/778: sync 2024-02-19T19:12:29.934 INFO:tasks.workunit.client.1.smithi125.stdout:8/825: sync 2024-02-19T19:12:29.934 INFO:tasks.workunit.client.1.smithi125.stdout:2/863: stat d1/d27/f44 0 2024-02-19T19:12:29.934 INFO:tasks.workunit.client.1.smithi125.stdout:8/826: mknod db/d18/d30/d3c/d4d/d5d/da2/c105 0 2024-02-19T19:12:29.934 INFO:tasks.workunit.client.1.smithi125.stdout:2/864: creat d1/d27/d1d/d25/d2a/ddf/f100 x:0 0 0 2024-02-19T19:12:29.934 INFO:tasks.workunit.client.1.smithi125.stdout:2/865: symlink d1/d36/d70/d85/da4/l101 0 2024-02-19T19:12:29.934 INFO:tasks.workunit.client.1.smithi125.stdout:2/866: rename d1/d27/cb to d1/d36/dc0/dcf/c102 0 2024-02-19T19:12:29.934 INFO:tasks.workunit.client.1.smithi125.stdout:2/867: rename d1/c83 to d1/d27/d1d/d25/da3/c103 0 2024-02-19T19:12:29.935 INFO:tasks.workunit.client.1.smithi125.stdout:2/868: mkdir d1/d27/d1d/d25/d2a/dfe/d104 0 2024-02-19T19:12:29.935 INFO:tasks.workunit.client.1.smithi125.stdout:2/869: chown d1/d27/d1d/da8/fda 3196 1 2024-02-19T19:12:29.935 INFO:tasks.workunit.client.1.smithi125.stdout:2/870: symlink d1/d27/d1d/l105 0 2024-02-19T19:12:29.935 INFO:tasks.workunit.client.1.smithi125.stdout:2/871: write d1/d27/d1d/d25/da0/fc9 [293078,25201] 0 2024-02-19T19:12:29.935 INFO:tasks.workunit.client.1.smithi125.stdout:2/872: symlink d1/d27/d1d/d16/l106 0 2024-02-19T19:12:29.935 INFO:tasks.workunit.client.1.smithi125.stdout:2/873: mknod d1/d36/dc0/def/df5/c107 0 2024-02-19T19:12:30.000 INFO:tasks.workunit.client.1.smithi125.stdout:0/917: dread d5/d15/f89 [761856,126976] 0 2024-02-19T19:12:30.001 INFO:tasks.workunit.client.1.smithi125.stdout:0/918: dread d5/d19/d27/d32/d70/f115 [155648,110592] 0 2024-02-19T19:12:30.001 INFO:tasks.workunit.client.1.smithi125.stdout:0/919: stat d5/d19/d27/d32/d70/f115 0 2024-02-19T19:12:30.001 INFO:tasks.workunit.client.1.smithi125.stdout:0/920: chown d5/d33/d42/f12e 428036 1 2024-02-19T19:12:30.001 INFO:tasks.workunit.client.1.smithi125.stdout:0/921: truncate d5/d19/d27/d32/f3a 1588623 0 2024-02-19T19:12:30.001 INFO:tasks.workunit.client.1.smithi125.stdout:0/922: readlink d5/d33/d9b/lcb 0 2024-02-19T19:12:30.001 INFO:tasks.workunit.client.1.smithi125.stdout:0/923: rename d5/d15/d2c/d80/c98 to d5/d19/d27/d32/d109/c140 0 2024-02-19T19:12:30.002 INFO:tasks.workunit.client.1.smithi125.stdout:0/924: truncate d5/d15/d2c/d80/dfa/dc8/f12f 127578 0 2024-02-19T19:12:30.002 INFO:tasks.workunit.client.1.smithi125.stdout:0/925: write d5/d1a/d4c/f94 [978811,74973] 0 2024-02-19T19:12:30.002 INFO:tasks.workunit.client.1.smithi125.stdout:0/926: write d5/d33/d46/f125 [748820,5011] 0 2024-02-19T19:12:30.002 INFO:tasks.workunit.client.1.smithi125.stdout:0/927: write d5/d33/f7e [77140,29489] 0 2024-02-19T19:12:30.002 INFO:tasks.workunit.client.1.smithi125.stdout:0/928: write d5/d1a/fe4 [819503,50722] 0 2024-02-19T19:12:30.002 INFO:tasks.workunit.client.1.smithi125.stdout:0/929: chown d5/d15/ca3 31907014 1 2024-02-19T19:12:30.002 INFO:tasks.workunit.client.1.smithi125.stdout:0/930: rmdir d5/d33/d46/de6 39 2024-02-19T19:12:30.002 INFO:tasks.workunit.client.1.smithi125.stdout:0/931: dread d5/d15/d2c/d80/dfa/dc8/f12f [57344,73728] 0 2024-02-19T19:12:30.012 INFO:tasks.workunit.client.1.smithi125.stdout:3/779: dread d0/d1/d1e/f1f [3530752,65536] 0 2024-02-19T19:12:30.012 INFO:tasks.workunit.client.1.smithi125.stdout:3/780: truncate d0/ffd 48194 0 2024-02-19T19:12:30.012 INFO:tasks.workunit.client.1.smithi125.stdout:3/781: truncate d0/d1/f6e 1348869 0 2024-02-19T19:12:30.012 INFO:tasks.workunit.client.1.smithi125.stdout:3/782: getdents d0/d1/d1e/d60/d6a/ddb 0 2024-02-19T19:12:30.041 INFO:tasks.workunit.client.1.smithi125.stdout:8/827: fdatasync db/d18/d30/d3c/d4d/d5d/f64 0 2024-02-19T19:12:30.041 INFO:tasks.workunit.client.1.smithi125.stdout:4/823: fsync d0/df/f9f 0 2024-02-19T19:12:30.041 INFO:tasks.workunit.client.1.smithi125.stdout:8/828: creat db/d18/d30/d80/d9e/f106 x:0 0 0 2024-02-19T19:12:30.041 INFO:tasks.workunit.client.1.smithi125.stdout:4/824: readlink d0/df/la9 0 2024-02-19T19:12:30.041 INFO:tasks.workunit.client.1.smithi125.stdout:8/829: mkdir db/d18/d30/d3c/d4d/d5d/da2/d107 0 2024-02-19T19:12:30.041 INFO:tasks.workunit.client.1.smithi125.stdout:8/830: write db/d6d/fa7 [2195569,81999] 0 2024-02-19T19:12:30.044 INFO:tasks.workunit.client.1.smithi125.stdout:3/783: dread d0/d1/d1e/d60/fa3 [352256,8192] 0 2024-02-19T19:12:30.048 INFO:tasks.workunit.client.1.smithi125.stdout:3/784: creat d0/d1/d4b/d52/ffe x:0 0 0 2024-02-19T19:12:30.048 INFO:tasks.workunit.client.1.smithi125.stdout:3/785: creat d0/d1/d4b/d52/d81/db7/fff x:0 0 0 2024-02-19T19:12:30.049 INFO:tasks.workunit.client.1.smithi125.stdout:8/831: dwrite db/f16 [2961408,61440] 0 2024-02-19T19:12:30.051 INFO:tasks.workunit.client.1.smithi125.stdout:4/825: dwrite d0/df/d5e/ffa [114688,94208] 0 2024-02-19T19:12:30.051 INFO:tasks.workunit.client.1.smithi125.stdout:3/786: dread d0/d1/d4b/fbb [28672,77824] 0 2024-02-19T19:12:30.051 INFO:tasks.workunit.client.1.smithi125.stdout:4/826: dread d0/d7/d3b/f9c [356352,28672] 0 2024-02-19T19:12:30.051 INFO:tasks.workunit.client.1.smithi125.stdout:4/827: unlink d0/d7/d30/d5d/cb5 0 2024-02-19T19:12:30.052 INFO:tasks.workunit.client.1.smithi125.stdout:4/828: mknod d0/d7/d3b/d75/c119 0 2024-02-19T19:12:30.052 INFO:tasks.workunit.client.1.smithi125.stdout:4/829: chown d0/d7/d85/cbb 775181196 1 2024-02-19T19:12:30.052 INFO:tasks.workunit.client.1.smithi125.stdout:4/830: getdents d0/d7/d30/d42/db3 0 2024-02-19T19:12:30.052 INFO:tasks.workunit.client.1.smithi125.stdout:4/831: dread d0/d7/d3b/d75/f108 [458752,40960] 0 2024-02-19T19:12:30.052 INFO:tasks.workunit.client.1.smithi125.stdout:4/832: readlink d0/df/lbd 0 2024-02-19T19:12:30.052 INFO:tasks.workunit.client.1.smithi125.stdout:4/833: write d0/d32/f46 [36428,69492] 0 2024-02-19T19:12:30.052 INFO:tasks.workunit.client.1.smithi125.stdout:4/834: rename d0/d7/d3b/d75/f90 to d0/d7/d3b/d75/de3/dcd/f11a 0 2024-02-19T19:12:30.053 INFO:tasks.workunit.client.1.smithi125.stdout:4/835: chown d0/df/d5e/l7f 136183 1 2024-02-19T19:12:30.053 INFO:tasks.workunit.client.1.smithi125.stdout:4/836: stat d0/d7/dad/db9/ffb 0 2024-02-19T19:12:30.053 INFO:tasks.workunit.client.1.smithi125.stdout:4/837: dread - d0/d32/d60/d102/dac/fb6 zero size 2024-02-19T19:12:30.053 INFO:tasks.workunit.client.1.smithi125.stdout:4/838: dread d0/d7/d30/d5d/f9b [823296,110592] 0 2024-02-19T19:12:30.053 INFO:tasks.workunit.client.1.smithi125.stdout:4/839: write d0/d7/d3b/d75/de3/f93 [1190825,108756] 0 2024-02-19T19:12:30.053 INFO:tasks.workunit.client.1.smithi125.stdout:4/840: mknod d0/d7/d30/d42/db3/ddf/dea/c11b 0 2024-02-19T19:12:30.053 INFO:tasks.workunit.client.1.smithi125.stdout:4/841: mkdir d0/d7/d30/d42/db3/ddf/dea/d11c 0 2024-02-19T19:12:30.054 INFO:tasks.workunit.client.1.smithi125.stdout:4/842: write d0/f1b [178715,114398] 0 2024-02-19T19:12:30.054 INFO:tasks.workunit.client.1.smithi125.stdout:4/843: symlink d0/d7/d3b/d75/de3/l11d 0 2024-02-19T19:12:30.054 INFO:tasks.workunit.client.1.smithi125.stdout:4/844: truncate d0/d7/d30/d42/fc2 1205897 0 2024-02-19T19:12:30.054 INFO:tasks.workunit.client.1.smithi125.stdout:4/845: truncate d0/d7/d76/fed 97067 0 2024-02-19T19:12:30.054 INFO:tasks.workunit.client.1.smithi125.stdout:4/846: readlink d0/d7/dad/db9/lbc 0 2024-02-19T19:12:30.155 INFO:tasks.workunit.client.1.smithi125.stdout:4/847: dwrite d0/d7/d3b/f81 [1695744,118784] 0 2024-02-19T19:12:30.155 INFO:tasks.workunit.client.1.smithi125.stdout:4/848: rmdir d0/d7/d3b/d75 39 2024-02-19T19:12:30.155 INFO:tasks.workunit.client.1.smithi125.stdout:4/849: stat d0/d7/d3b/d75/de3/dcd/dde 0 2024-02-19T19:12:30.155 INFO:tasks.workunit.client.1.smithi125.stdout:4/850: chown d0/f2e 11078999 1 2024-02-19T19:12:30.187 INFO:tasks.workunit.client.1.smithi125.stdout:3/787: fdatasync d0/d1/d4b/fbb 0 2024-02-19T19:12:30.187 INFO:tasks.workunit.client.1.smithi125.stdout:8/832: fdatasync db/d18/f32 0 2024-02-19T19:12:30.187 INFO:tasks.workunit.client.1.smithi125.stdout:8/833: creat db/d18/d30/d48/db1/f108 x:0 0 0 2024-02-19T19:12:30.187 INFO:tasks.workunit.client.1.smithi125.stdout:3/788: write d0/d1/d1e/d60/d73/d74/f79 [898244,100483] 0 2024-02-19T19:12:30.190 INFO:tasks.workunit.client.1.smithi125.stdout:4/851: symlink d0/df/dda/l11e 0 2024-02-19T19:12:30.191 INFO:tasks.workunit.client.1.smithi125.stdout:4/852: dread d0/d32/d60/d102/f79 [1048576,94208] 0 2024-02-19T19:12:30.191 INFO:tasks.workunit.client.1.smithi125.stdout:7/860: sync 2024-02-19T19:12:30.191 INFO:tasks.workunit.client.1.smithi125.stdout:7/861: mkdir d12/d18/dbe/de4/d100 0 2024-02-19T19:12:30.292 INFO:tasks.workunit.client.1.smithi125.stdout:8/834: fdatasync db/d18/fca 0 2024-02-19T19:12:30.295 INFO:tasks.workunit.client.1.smithi125.stdout:7/862: dwrite d12/d3d/f69 [380928,32768] 0 2024-02-19T19:12:30.295 INFO:tasks.workunit.client.1.smithi125.stdout:8/835: creat db/d81/d95/f109 x:0 0 0 2024-02-19T19:12:30.295 INFO:tasks.workunit.client.1.smithi125.stdout:4/853: dwrite d0/d7/d85/f8f [679936,8192] 0 2024-02-19T19:12:30.295 INFO:tasks.workunit.client.1.smithi125.stdout:4/854: getdents d0/d32/d60 0 2024-02-19T19:12:30.295 INFO:tasks.workunit.client.1.smithi125.stdout:3/789: write d0/d1/d1e/f2c [1100699,104073] 0 2024-02-19T19:12:30.296 INFO:tasks.workunit.client.1.smithi125.stdout:8/836: write db/d18/d30/d3c/d4d/d5d/da2/dae/fbe [158010,15000] 0 2024-02-19T19:12:30.296 INFO:tasks.workunit.client.1.smithi125.stdout:8/837: dread db/d18/f1b [32768,16384] 0 2024-02-19T19:12:30.296 INFO:tasks.workunit.client.1.smithi125.stdout:8/838: rmdir db/d18/d2f/d72 39 2024-02-19T19:12:30.296 INFO:tasks.workunit.client.1.smithi125.stdout:3/790: creat d0/d1/d1e/d60/d6a/f100 x:0 0 0 2024-02-19T19:12:30.296 INFO:tasks.workunit.client.1.smithi125.stdout:3/791: stat d0/d1/d1e/d60/d7c/db6/f75 0 2024-02-19T19:12:30.296 INFO:tasks.workunit.client.1.smithi125.stdout:7/863: write d12/d18/d44/d3b/d59/d26/f87 [985361,99425] 0 2024-02-19T19:12:30.297 INFO:tasks.workunit.client.1.smithi125.stdout:3/792: write d0/d95/fa9 [1664312,3322] 0 2024-02-19T19:12:30.297 INFO:tasks.workunit.client.1.smithi125.stdout:7/864: chown f5 17243 1 2024-02-19T19:12:30.297 INFO:tasks.workunit.client.1.smithi125.stdout:3/793: rename d0/d1/d1e/d60/d7c to d0/d1/d4b/d52/d81/db7/d101 0 2024-02-19T19:12:30.297 INFO:tasks.workunit.client.1.smithi125.stdout:7/865: rename d12/d18/d2c/db5/dca/d8c to d12/d18/d44/d3b/d59/d26/d30/d97/d101 0 2024-02-19T19:12:30.297 INFO:tasks.workunit.client.1.smithi125.stdout:7/866: read - d12/d18/d44/d3b/d59/d26/d30/fbc zero size 2024-02-19T19:12:30.297 INFO:tasks.workunit.client.1.smithi125.stdout:3/794: mkdir d0/d1/d1e/d60/de2/d102 0 2024-02-19T19:12:30.297 INFO:tasks.workunit.client.1.smithi125.stdout:3/795: getdents d0/d1/d4b/d52/d81/dd0 0 2024-02-19T19:12:30.297 INFO:tasks.workunit.client.1.smithi125.stdout:3/796: mkdir d0/d1/d1e/d60/de2/d103 0 2024-02-19T19:12:30.297 INFO:tasks.workunit.client.1.smithi125.stdout:3/797: unlink d0/d1/f23 0 2024-02-19T19:12:30.298 INFO:tasks.workunit.client.1.smithi125.stdout:3/798: creat d0/d1/d39/db4/f104 x:0 0 0 2024-02-19T19:12:30.298 INFO:tasks.workunit.client.1.smithi125.stdout:3/799: rename d0/d1/d1e/d60/l7e to d0/d1/d4b/d52/daa/l105 0 2024-02-19T19:12:30.298 INFO:tasks.workunit.client.1.smithi125.stdout:3/800: creat d0/d1/d87/f106 x:0 0 0 2024-02-19T19:12:30.298 INFO:tasks.workunit.client.1.smithi125.stdout:3/801: dread - d0/d95/d9c/dba/fc6 zero size 2024-02-19T19:12:30.302 INFO:tasks.workunit.client.1.smithi125.stdout:4/855: dwrite d0/d7/d30/d42/f86 [1658880,118784] 0 2024-02-19T19:12:30.302 INFO:tasks.workunit.client.1.smithi125.stdout:4/856: symlink d0/d7/d85/l11f 0 2024-02-19T19:12:30.302 INFO:tasks.workunit.client.1.smithi125.stdout:4/857: getdents d0/d7/d30/d42 0 2024-02-19T19:12:30.302 INFO:tasks.workunit.client.1.smithi125.stdout:4/858: rmdir d0/d7/d30/d42/db3/ddf/dea 39 2024-02-19T19:12:30.307 INFO:tasks.workunit.client.1.smithi125.stdout:7/867: dwrite d12/d18/d2c/fbf [688128,73728] 0 2024-02-19T19:12:30.307 INFO:tasks.workunit.client.1.smithi125.stdout:7/868: link d12/d18/d44/d3b/d59/d26/d30/c38 d12/d18/d44/d51/c102 0 2024-02-19T19:12:30.307 INFO:tasks.workunit.client.1.smithi125.stdout:7/869: dread d12/d18/d44/d3b/d59/fac [126976,49152] 0 2024-02-19T19:12:30.307 INFO:tasks.workunit.client.1.smithi125.stdout:7/870: link d12/d18/d44/d3b/d59/d26/d30/d37/lda d12/d18/d44/d51/l103 0 2024-02-19T19:12:30.307 INFO:tasks.workunit.client.1.smithi125.stdout:3/802: dwrite d0/d1/d4b/d52/d81/dd0/ff2 [880640,8192] 0 2024-02-19T19:12:30.308 INFO:tasks.workunit.client.1.smithi125.stdout:3/803: rename d0/d1/d39/db4 to d0/d1/d87/d107 0 2024-02-19T19:12:30.308 INFO:tasks.workunit.client.1.smithi125.stdout:3/804: unlink d0/d1/d1e/lc3 0 2024-02-19T19:12:30.308 INFO:tasks.workunit.client.1.smithi125.stdout:3/805: dread d0/de/f7a [409600,106496] 0 2024-02-19T19:12:30.308 INFO:tasks.workunit.client.1.smithi125.stdout:3/806: dread - d0/d95/d9c/dbf/fc8 zero size 2024-02-19T19:12:30.308 INFO:tasks.workunit.client.1.smithi125.stdout:3/807: mknod d0/c108 0 2024-02-19T19:12:30.308 INFO:tasks.workunit.client.1.smithi125.stdout:3/808: mkdir d0/d1/d1e/d60/de2/d109 0 2024-02-19T19:12:30.308 INFO:tasks.workunit.client.1.smithi125.stdout:4/859: dwrite d0/d7/f26 [2027520,102400] 0 2024-02-19T19:12:30.308 INFO:tasks.workunit.client.1.smithi125.stdout:3/809: stat d0/d1/d1e/d60/d73/d74/d82/l8d 0 2024-02-19T19:12:30.309 INFO:tasks.workunit.client.1.smithi125.stdout:3/810: chown d0/d1/f41 507458207 1 2024-02-19T19:12:30.309 INFO:tasks.workunit.client.1.smithi125.stdout:4/860: unlink d0/d7/d30/c37 0 2024-02-19T19:12:30.309 INFO:tasks.workunit.client.1.smithi125.stdout:3/811: mkdir d0/d1/d87/d107/d10a 0 2024-02-19T19:12:30.309 INFO:tasks.workunit.client.1.smithi125.stdout:3/812: mknod d0/d1/d87/c10b 0 2024-02-19T19:12:30.309 INFO:tasks.workunit.client.1.smithi125.stdout:4/861: dread d0/d7/d30/d42/f78 [413696,16384] 0 2024-02-19T19:12:30.309 INFO:tasks.workunit.client.1.smithi125.stdout:3/813: getdents d0/d1/d4b/d52/d81/db7/d101 0 2024-02-19T19:12:30.309 INFO:tasks.workunit.client.1.smithi125.stdout:3/814: mkdir d0/d1/d1e/d60/d73/d74/d82/d10c 0 2024-02-19T19:12:30.309 INFO:tasks.workunit.client.1.smithi125.stdout:4/862: write d0/d7/fd2 [127948,28648] 0 2024-02-19T19:12:30.310 INFO:tasks.workunit.client.1.smithi125.stdout:3/815: creat d0/db1/f10d x:0 0 0 2024-02-19T19:12:30.310 INFO:tasks.workunit.client.1.smithi125.stdout:3/816: chown d0/c4e 3188236 1 2024-02-19T19:12:30.310 INFO:tasks.workunit.client.1.smithi125.stdout:3/817: truncate d0/d1/d87/d107/f104 961711 0 2024-02-19T19:12:30.310 INFO:tasks.workunit.client.1.smithi125.stdout:3/818: truncate d0/d1/d4b/d52/d81/db7/d101/db6/f75 705595 0 2024-02-19T19:12:30.310 INFO:tasks.workunit.client.1.smithi125.stdout:4/863: mkdir d0/d7/d3b/d77/d120 0 2024-02-19T19:12:30.310 INFO:tasks.workunit.client.1.smithi125.stdout:3/819: creat d0/d95/d9c/dbf/de0/f10e x:0 0 0 2024-02-19T19:12:30.310 INFO:tasks.workunit.client.1.smithi125.stdout:3/820: mknod d0/d1/d4b/d52/d81/db7/d101/db6/c10f 0 2024-02-19T19:12:30.310 INFO:tasks.workunit.client.1.smithi125.stdout:3/821: rmdir d0 39 2024-02-19T19:12:30.310 INFO:tasks.workunit.client.1.smithi125.stdout:4/864: read d0/d32/d60/d102/f39 [790652,83124] 0 2024-02-19T19:12:30.385 INFO:tasks.workunit.client.1.smithi125.stdout:3/822: dread d0/d1/d1e/d60/f85 [32768,110592] 0 2024-02-19T19:12:30.385 INFO:tasks.workunit.client.1.smithi125.stdout:4/865: dwrite d0/df/f23 [737280,81920] 0 2024-02-19T19:12:30.385 INFO:tasks.workunit.client.1.smithi125.stdout:7/871: dwrite d12/d3d/f69 [73728,126976] 0 2024-02-19T19:12:30.385 INFO:tasks.workunit.client.1.smithi125.stdout:3/823: write d0/d1/d1e/d60/d73/d74/d82/f9a [275393,46357] 0 2024-02-19T19:12:30.385 INFO:tasks.workunit.client.1.smithi125.stdout:3/824: rmdir d0/d1/d1e/d60/de2 39 2024-02-19T19:12:30.385 INFO:tasks.workunit.client.1.smithi125.stdout:7/872: creat d12/d18/d2c/db5/df2/f104 x:0 0 0 2024-02-19T19:12:30.385 INFO:tasks.workunit.client.1.smithi125.stdout:7/873: readlink d12/d18/d44/d3b/d59/d2a/d6a/d6d/l8d 0 2024-02-19T19:12:30.457 INFO:tasks.workunit.client.1.smithi125.stdout:4/866: dwrite d0/d7/d30/d42/f7a [421888,90112] 0 2024-02-19T19:12:30.457 INFO:tasks.workunit.client.1.smithi125.stdout:3/825: dwrite d0/d1/d4b/d52/d81/dd0/fdd [557056,98304] 0 2024-02-19T19:12:30.507 INFO:tasks.workunit.client.1.smithi125.stdout:2/874: sync 2024-02-19T19:12:30.508 INFO:tasks.workunit.client.1.smithi125.stdout:3/826: dwrite d0/d95/d9c/dba/fc5 [524288,4096] 0 2024-02-19T19:12:30.508 INFO:tasks.workunit.client.1.smithi125.stdout:3/827: dread - d0/d1/d1e/db0/fc2 zero size 2024-02-19T19:12:30.511 INFO:tasks.workunit.client.1.smithi125.stdout:2/875: symlink d1/d36/d70/d4b/l108 0 2024-02-19T19:12:30.511 INFO:tasks.workunit.client.1.smithi125.stdout:2/876: dread - d1/d27/d1d/d25/da0/ffa zero size 2024-02-19T19:12:30.511 INFO:tasks.workunit.client.1.smithi125.stdout:2/877: symlink d1/d27/d1d/d39/l109 0 2024-02-19T19:12:30.520 INFO:tasks.workunit.client.1.smithi125.stdout:4/867: dread d0/d7/f2f [729088,24576] 0 2024-02-19T19:12:30.520 INFO:tasks.workunit.client.1.smithi125.stdout:4/868: mknod d0/d32/d60/d102/d110/c121 0 2024-02-19T19:12:30.630 INFO:tasks.workunit.client.1.smithi125.stdout:3/828: fdatasync d0/f6d 0 2024-02-19T19:12:30.630 INFO:tasks.workunit.client.1.smithi125.stdout:3/829: write d0/d1/d1e/d60/da5/ffa [429881,84374] 0 2024-02-19T19:12:30.630 INFO:tasks.workunit.client.1.smithi125.stdout:3/830: dread d0/d1/f4d [765952,69632] 0 2024-02-19T19:12:30.630 INFO:tasks.workunit.client.1.smithi125.stdout:3/831: readlink d0/d1/d1e/d60/de2/lf1 0 2024-02-19T19:12:30.634 INFO:tasks.workunit.client.1.smithi125.stdout:3/832: dwrite d0/d95/fa7 [368640,110592] 0 2024-02-19T19:12:30.634 INFO:tasks.workunit.client.1.smithi125.stdout:3/833: truncate d0/d1/d87/f93 421688 0 2024-02-19T19:12:30.691 INFO:tasks.workunit.client.1.smithi125.stdout:0/932: sync 2024-02-19T19:12:30.692 INFO:tasks.workunit.client.1.smithi125.stdout:0/933: dread d5/d33/d46/f6b [49152,4096] 0 2024-02-19T19:12:30.692 INFO:tasks.workunit.client.1.smithi125.stdout:3/834: rename d0/d1/d1e/f5a to d0/d1/d1e/d60/de2/f110 0 2024-02-19T19:12:30.692 INFO:tasks.workunit.client.1.smithi125.stdout:3/835: write d0/d1/d87/f93 [170872,106861] 0 2024-02-19T19:12:30.692 INFO:tasks.workunit.client.1.smithi125.stdout:3/836: mkdir d0/d1/d1e/d60/d6a/d111 0 2024-02-19T19:12:30.694 INFO:tasks.workunit.client.1.smithi125.stdout:0/934: rename d5/d1a/f79 to d5/d19/d27/d32/d70/dd2/f141 0 2024-02-19T19:12:30.694 INFO:tasks.workunit.client.1.smithi125.stdout:3/837: rename d0/d1/d4b/d52/d81/db7/d101/db6 to d0/d1/d1e/d60/d73/d112 0 2024-02-19T19:12:30.694 INFO:tasks.workunit.client.1.smithi125.stdout:0/935: mknod d5/d33/d9b/de5/c142 0 2024-02-19T19:12:30.694 INFO:tasks.workunit.client.1.smithi125.stdout:0/936: mknod d5/d19/d2b/c143 0 2024-02-19T19:12:30.695 INFO:tasks.workunit.client.1.smithi125.stdout:0/937: stat d5/d33/f102 0 2024-02-19T19:12:30.695 INFO:tasks.workunit.client.1.smithi125.stdout:0/938: symlink d5/d19/d27/d11a/l144 0 2024-02-19T19:12:30.695 INFO:tasks.workunit.client.1.smithi125.stdout:0/939: getdents d5/d33/d42/d92/da5 0 2024-02-19T19:12:30.695 INFO:tasks.workunit.client.1.smithi125.stdout:0/940: symlink d5/d19/d27/de3/l145 0 2024-02-19T19:12:30.695 INFO:tasks.workunit.client.1.smithi125.stdout:0/941: link d5/d19/d27/d32/d109/db3/dd4/dfb/d106/lb2 d5/d15/d2c/l146 0 2024-02-19T19:12:30.695 INFO:tasks.workunit.client.1.smithi125.stdout:0/942: stat d5/d33/d46/f66 0 2024-02-19T19:12:30.695 INFO:tasks.workunit.client.1.smithi125.stdout:0/943: symlink d5/d19/d27/dc3/l147 0 2024-02-19T19:12:30.695 INFO:tasks.workunit.client.1.smithi125.stdout:0/944: rename d5/d19/d2b/fda to d5/d19/d2b/db7/f148 0 2024-02-19T19:12:30.696 INFO:tasks.workunit.client.1.smithi125.stdout:8/839: sync 2024-02-19T19:12:30.696 INFO:tasks.workunit.client.1.smithi125.stdout:8/840: truncate f4 1459944 0 2024-02-19T19:12:30.696 INFO:tasks.workunit.client.1.smithi125.stdout:0/945: rename d5/d1a/f55 to d5/d19/d27/d32/d70/dd2/f149 0 2024-02-19T19:12:30.696 INFO:tasks.workunit.client.1.smithi125.stdout:8/841: dread db/d18/d30/d3c/d4d/d5d/fc8 [114688,65536] 0 2024-02-19T19:12:30.696 INFO:tasks.workunit.client.1.smithi125.stdout:8/842: chown db/d18/d30/d3c/d4d/d5d/d6f/ffe 5 1 2024-02-19T19:12:30.696 INFO:tasks.workunit.client.1.smithi125.stdout:8/843: mkdir db/d18/d30/d48/db9/d10a 0 2024-02-19T19:12:30.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:30 smithi125 ceph-mon[86115]: pgmap v160: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:12:30.764 INFO:tasks.workunit.client.1.smithi125.stdout:3/838: dwrite d0/d1/d4b/d52/f5e [937984,94208] 0 2024-02-19T19:12:30.764 INFO:tasks.workunit.client.1.smithi125.stdout:3/839: dread d0/d1/d1e/d60/d73/d74/f79 [53248,73728] 0 2024-02-19T19:12:30.765 INFO:tasks.workunit.client.1.smithi125.stdout:3/840: rename d0/d1/d4b/f96 to d0/d1/d87/d107/f113 0 2024-02-19T19:12:30.765 INFO:tasks.workunit.client.1.smithi125.stdout:3/841: getdents d0/d1/d1e/d60/de2/d102 0 2024-02-19T19:12:30.766 INFO:tasks.workunit.client.1.smithi125.stdout:0/946: dwrite d5/d15/f5b [1396736,8192] 0 2024-02-19T19:12:30.766 INFO:tasks.workunit.client.1.smithi125.stdout:0/947: rename d5/d33/d46/f138 to d5/d19/d27/de3/f14a 0 2024-02-19T19:12:30.766 INFO:tasks.workunit.client.1.smithi125.stdout:0/948: dread - d5/d33/d9b/de5/f13e zero size 2024-02-19T19:12:30.767 INFO:tasks.workunit.client.1.smithi125.stdout:0/949: chown d5/d19/d27/d32/l85 11927127 1 2024-02-19T19:12:30.767 INFO:tasks.workunit.client.1.smithi125.stdout:3/842: dwrite d0/d1/d1e/f5d [1048576,49152] 0 2024-02-19T19:12:30.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:30 smithi096 ceph-mon[112483]: pgmap v160: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:12:30.813 INFO:tasks.workunit.client.1.smithi125.stdout:4/869: fsync d0/d7/f2f 0 2024-02-19T19:12:30.813 INFO:tasks.workunit.client.1.smithi125.stdout:4/870: rmdir d0/d7/dd3 39 2024-02-19T19:12:30.815 INFO:tasks.workunit.client.1.smithi125.stdout:7/874: sync 2024-02-19T19:12:30.816 INFO:tasks.workunit.client.1.smithi125.stdout:4/871: truncate d0/d7/d30/d42/d7b/f99 2416862 0 2024-02-19T19:12:30.817 INFO:tasks.workunit.client.1.smithi125.stdout:4/872: readlink d0/df/la3 0 2024-02-19T19:12:30.865 INFO:tasks.workunit.client.1.smithi125.stdout:3/843: fsync d0/d95/d9c/daf/fe4 0 2024-02-19T19:12:30.866 INFO:tasks.workunit.client.1.smithi125.stdout:0/950: fsync d5/faa 0 2024-02-19T19:12:30.866 INFO:tasks.workunit.client.1.smithi125.stdout:0/951: getdents d5/d19/d27/de3 0 2024-02-19T19:12:30.866 INFO:tasks.workunit.client.1.smithi125.stdout:0/952: chown d5/d15/d2c/d80/dfa/dc8/ce9 21349 1 2024-02-19T19:12:30.866 INFO:tasks.workunit.client.1.smithi125.stdout:3/844: symlink d0/d1/d1e/d60/de2/l114 0 2024-02-19T19:12:30.866 INFO:tasks.workunit.client.1.smithi125.stdout:0/953: mkdir d5/d9/dcd/dd3/d14b 0 2024-02-19T19:12:30.866 INFO:tasks.workunit.client.1.smithi125.stdout:3/845: mkdir d0/d1/d1e/d60/de2/d102/d115 0 2024-02-19T19:12:30.866 INFO:tasks.workunit.client.1.smithi125.stdout:7/875: fsync d12/d18/d44/d3b/d59/d26/d30/f35 0 2024-02-19T19:12:30.867 INFO:tasks.workunit.client.1.smithi125.stdout:0/954: mkdir d5/d33/d9b/d14c 0 2024-02-19T19:12:30.867 INFO:tasks.workunit.client.1.smithi125.stdout:0/955: mknod d5/d19/d27/d32/d109/db3/dd4/dfb/d106/c14d 0 2024-02-19T19:12:30.867 INFO:tasks.workunit.client.1.smithi125.stdout:0/956: mknod d5/d19/d27/de3/c14e 0 2024-02-19T19:12:30.867 INFO:tasks.workunit.client.1.smithi125.stdout:0/957: getdents d5/d19/d27/d32/d109/db3/dd4/dfb 0 2024-02-19T19:12:30.867 INFO:tasks.workunit.client.1.smithi125.stdout:7/876: mknod d12/d18/d2c/db5/df2/c105 0 2024-02-19T19:12:30.867 INFO:tasks.workunit.client.1.smithi125.stdout:0/958: write d5/d33/d42/f65 [482122,41453] 0 2024-02-19T19:12:30.867 INFO:tasks.workunit.client.1.smithi125.stdout:0/959: chown d5/d19/d27/dc3/l147 906413 1 2024-02-19T19:12:30.867 INFO:tasks.workunit.client.1.smithi125.stdout:0/960: mknod d5/d19/d27/d32/d109/c14f 0 2024-02-19T19:12:30.867 INFO:tasks.workunit.client.1.smithi125.stdout:0/961: creat d5/d19/d27/d32/f150 x:0 0 0 2024-02-19T19:12:30.868 INFO:tasks.workunit.client.1.smithi125.stdout:0/962: dread - d5/d33/d42/d92/da5/f10b zero size 2024-02-19T19:12:30.868 INFO:tasks.workunit.client.1.smithi125.stdout:0/963: getdents d5/d19/d27/d11a 0 2024-02-19T19:12:30.868 INFO:tasks.workunit.client.1.smithi125.stdout:0/964: creat d5/d9/f151 x:0 0 0 2024-02-19T19:12:30.868 INFO:tasks.workunit.client.1.smithi125.stdout:0/965: creat d5/d33/d9b/de5/f152 x:0 0 0 2024-02-19T19:12:30.868 INFO:tasks.workunit.client.1.smithi125.stdout:0/966: creat d5/d19/d48/f153 x:0 0 0 2024-02-19T19:12:30.868 INFO:tasks.workunit.client.1.smithi125.stdout:4/873: dwrite d0/d32/d60/d102/f2d [421888,90112] 0 2024-02-19T19:12:30.868 INFO:tasks.workunit.client.1.smithi125.stdout:4/874: write d0/d7/d30/d42/fc2 [1667921,3040] 0 2024-02-19T19:12:30.879 INFO:tasks.workunit.client.1.smithi125.stdout:7/877: dread d12/d18/d44/f40 [192512,126976] 0 2024-02-19T19:12:30.879 INFO:tasks.workunit.client.1.smithi125.stdout:7/878: symlink d12/d3d/dd7/dec/l106 0 2024-02-19T19:12:30.879 INFO:tasks.workunit.client.1.smithi125.stdout:7/879: stat d12/d18/d44/d3b/d59/d2a/c84 0 2024-02-19T19:12:30.879 INFO:tasks.workunit.client.1.smithi125.stdout:7/880: creat d12/d18/d44/d3b/d59/d2a/d6a/d6d/f107 x:0 0 0 2024-02-19T19:12:30.880 INFO:tasks.workunit.client.1.smithi125.stdout:7/881: symlink d12/d18/dbe/de4/d100/l108 0 2024-02-19T19:12:30.880 INFO:tasks.workunit.client.1.smithi125.stdout:7/882: rmdir d12/d18/d44/d3b/d59/d2a/d6a/dab 39 2024-02-19T19:12:30.924 INFO:tasks.workunit.client.1.smithi125.stdout:3/846: fdatasync d0/d1/d4b/d52/d81/db7/d101/fdc 0 2024-02-19T19:12:30.924 INFO:tasks.workunit.client.1.smithi125.stdout:3/847: mkdir d0/d95/d9c/dbf/d116 0 2024-02-19T19:12:30.924 INFO:tasks.workunit.client.1.smithi125.stdout:3/848: dread - d0/d1/d1e/d60/d73/d112/fd3 zero size 2024-02-19T19:12:30.924 INFO:tasks.workunit.client.1.smithi125.stdout:3/849: mknod d0/d1/d87/d107/dcd/c117 0 2024-02-19T19:12:30.924 INFO:tasks.workunit.client.1.smithi125.stdout:3/850: creat d0/d1/d1e/d60/de2/f118 x:0 0 0 2024-02-19T19:12:30.924 INFO:tasks.workunit.client.1.smithi125.stdout:3/851: chown d0/d1/d4b/d52/f59 746779909 1 2024-02-19T19:12:30.929 INFO:tasks.workunit.client.1.smithi125.stdout:4/875: fdatasync d0/d7/d3b/d75/de3/dcd/f111 0 2024-02-19T19:12:30.929 INFO:tasks.workunit.client.1.smithi125.stdout:4/876: creat d0/df/f122 x:0 0 0 2024-02-19T19:12:30.941 INFO:tasks.workunit.client.1.smithi125.stdout:7/883: dwrite d12/d18/d2c/db5/dca/f5f [446464,53248] 0 2024-02-19T19:12:30.941 INFO:tasks.workunit.client.1.smithi125.stdout:3/852: dread d0/d1/d87/d107/f104 [258048,77824] 0 2024-02-19T19:12:30.941 INFO:tasks.workunit.client.1.smithi125.stdout:7/884: stat d12/d3d/dd7/dec 0 2024-02-19T19:12:30.941 INFO:tasks.workunit.client.1.smithi125.stdout:4/877: symlink d0/d7/d30/d42/db3/ddf/dea/d11c/l123 0 2024-02-19T19:12:30.941 INFO:tasks.workunit.client.1.smithi125.stdout:4/878: rename d0/df/f52 to d0/d7/dad/dbe/f124 0 2024-02-19T19:12:30.941 INFO:tasks.workunit.client.1.smithi125.stdout:7/885: rename d12/d18/d44/d3b/d59/d2a/c75 to d12/d18/d44/d3b/d59/d2a/d6a/dab/c109 0 2024-02-19T19:12:30.941 INFO:tasks.workunit.client.1.smithi125.stdout:4/879: getdents d0/d7/d85 0 2024-02-19T19:12:30.941 INFO:tasks.workunit.client.1.smithi125.stdout:7/886: symlink d12/d18/d44/d3b/d59/d26/d30/d37/dd1/l10a 0 2024-02-19T19:12:30.942 INFO:tasks.workunit.client.1.smithi125.stdout:4/880: mkdir d0/d7/d30/d5d/d125 0 2024-02-19T19:12:30.942 INFO:tasks.workunit.client.1.smithi125.stdout:4/881: unlink d0/d32/d60/c67 0 2024-02-19T19:12:30.942 INFO:tasks.workunit.client.1.smithi125.stdout:7/887: creat d12/d3d/dd7/dec/f10b x:0 0 0 2024-02-19T19:12:30.942 INFO:tasks.workunit.client.1.smithi125.stdout:7/888: creat d12/d18/d44/d3b/d59/d2a/d31/dfd/f10c x:0 0 0 2024-02-19T19:12:30.942 INFO:tasks.workunit.client.1.smithi125.stdout:7/889: mkdir d12/d18/d2c/d4e/d10d 0 2024-02-19T19:12:30.942 INFO:tasks.workunit.client.1.smithi125.stdout:7/890: truncate d12/d18/f68 992984 0 2024-02-19T19:12:30.942 INFO:tasks.workunit.client.1.smithi125.stdout:7/891: readlink d12/d18/d44/d3b/d59/lc3 0 2024-02-19T19:12:30.943 INFO:tasks.workunit.client.1.smithi125.stdout:7/892: dread d12/d18/d2c/f76 [139264,57344] 0 2024-02-19T19:12:30.943 INFO:tasks.workunit.client.1.smithi125.stdout:3/853: dwrite d0/d1/d1e/d60/d73/d74/d82/f9a [528384,106496] 0 2024-02-19T19:12:30.943 INFO:tasks.workunit.client.1.smithi125.stdout:3/854: mknod d0/d1/d1e/d60/d6a/ddb/c119 0 2024-02-19T19:12:30.952 INFO:tasks.workunit.client.1.smithi125.stdout:7/893: dread d12/d18/d2c/f74 [155648,94208] 0 2024-02-19T19:12:31.032 INFO:tasks.workunit.client.1.smithi125.stdout:2/878: sync 2024-02-19T19:12:31.032 INFO:tasks.workunit.client.1.smithi125.stdout:8/844: sync 2024-02-19T19:12:31.058 INFO:tasks.workunit.client.1.smithi125.stdout:3/855: fdatasync d0/f19 0 2024-02-19T19:12:31.058 INFO:tasks.workunit.client.1.smithi125.stdout:4/882: fdatasync d0/d7/d76/dd1/fd6 0 2024-02-19T19:12:31.059 INFO:tasks.workunit.client.1.smithi125.stdout:4/883: creat d0/df/dda/f126 x:0 0 0 2024-02-19T19:12:31.059 INFO:tasks.workunit.client.1.smithi125.stdout:3/856: creat d0/d1/d1e/d60/d6a/f11a x:0 0 0 2024-02-19T19:12:31.059 INFO:tasks.workunit.client.1.smithi125.stdout:3/857: creat d0/d1/d1e/d60/d6a/f11b x:0 0 0 2024-02-19T19:12:31.062 INFO:tasks.workunit.client.1.smithi125.stdout:4/884: mknod d0/d7/d3b/d77/d120/c127 0 2024-02-19T19:12:31.062 INFO:tasks.workunit.client.1.smithi125.stdout:8/845: dwrite db/d81/d95/f109 [462848,86016] 0 2024-02-19T19:12:31.062 INFO:tasks.workunit.client.1.smithi125.stdout:4/885: readlink d0/d7/d30/d5d/la6 0 2024-02-19T19:12:31.062 INFO:tasks.workunit.client.1.smithi125.stdout:8/846: truncate db/d18/d30/d48/db1/fd1 557475 0 2024-02-19T19:12:31.062 INFO:tasks.workunit.client.1.smithi125.stdout:8/847: stat db/d18/d2f/d3f 0 2024-02-19T19:12:31.062 INFO:tasks.workunit.client.1.smithi125.stdout:4/886: write d0/d7/d30/d42/ff3 [1810565,37873] 0 2024-02-19T19:12:31.064 INFO:tasks.workunit.client.1.smithi125.stdout:8/848: symlink db/d18/d30/d48/db9/d10a/l10b 0 2024-02-19T19:12:31.064 INFO:tasks.workunit.client.1.smithi125.stdout:4/887: dwrite d0/d7/d3b/d75/de3/dcd/f111 [385024,16384] 0 2024-02-19T19:12:31.064 INFO:tasks.workunit.client.1.smithi125.stdout:8/849: dwrite db/d18/d30/d3c/d4d/f9f [1228800,4096] 0 2024-02-19T19:12:31.064 INFO:tasks.workunit.client.1.smithi125.stdout:4/888: write d0/d7/d30/d42/f7a [1017143,27944] 0 2024-02-19T19:12:31.064 INFO:tasks.workunit.client.1.smithi125.stdout:8/850: creat db/d18/d2f/d72/df9/f10c x:0 0 0 2024-02-19T19:12:31.065 INFO:tasks.workunit.client.1.smithi125.stdout:4/889: symlink d0/d32/d60/d102/d110/l128 0 2024-02-19T19:12:31.065 INFO:tasks.workunit.client.1.smithi125.stdout:4/890: dread d0/d7/d30/d42/fc2 [540672,81920] 0 2024-02-19T19:12:31.065 INFO:tasks.workunit.client.1.smithi125.stdout:8/851: write db/d18/d30/d80/d9e/da3/fc1 [1212127,4738] 0 2024-02-19T19:12:31.065 INFO:tasks.workunit.client.1.smithi125.stdout:4/891: write d0/d7/d3b/f81 [664284,118765] 0 2024-02-19T19:12:31.065 INFO:tasks.workunit.client.1.smithi125.stdout:8/852: write db/d6d/faf [1332829,93877] 0 2024-02-19T19:12:31.065 INFO:tasks.workunit.client.1.smithi125.stdout:4/892: link d0/d7/d3b/c10c d0/d7/d30/d42/db3/ddf/c129 0 2024-02-19T19:12:31.065 INFO:tasks.workunit.client.1.smithi125.stdout:4/893: creat d0/d7/d3b/d75/f12a x:0 0 0 2024-02-19T19:12:31.065 INFO:tasks.workunit.client.1.smithi125.stdout:8/853: symlink db/d18/d30/d3c/d4d/d5d/da2/d107/l10d 0 2024-02-19T19:12:31.066 INFO:tasks.workunit.client.1.smithi125.stdout:8/854: dread - db/d18/d30/d80/dac/ffc zero size 2024-02-19T19:12:31.142 INFO:tasks.workunit.client.1.smithi125.stdout:8/855: dwrite db/f6b [2371584,53248] 0 2024-02-19T19:12:31.142 INFO:tasks.workunit.client.1.smithi125.stdout:8/856: getdents db/d18/d30/d3c/d70 0 2024-02-19T19:12:31.142 INFO:tasks.workunit.client.1.smithi125.stdout:8/857: dread db/d18/f2d [24576,61440] 0 2024-02-19T19:12:31.142 INFO:tasks.workunit.client.1.smithi125.stdout:8/858: getdents db/d18/d30/d3c/dc6 0 2024-02-19T19:12:31.142 INFO:tasks.workunit.client.1.smithi125.stdout:8/859: write db/d18/d30/d3c/d4d/d5d/d6f/f74 [660092,73120] 0 2024-02-19T19:12:31.142 INFO:tasks.workunit.client.1.smithi125.stdout:8/860: creat db/d18/d30/dd2/f10e x:0 0 0 2024-02-19T19:12:31.142 INFO:tasks.workunit.client.1.smithi125.stdout:8/861: dread db/d18/d30/d80/d9e/da3/fb6 [552960,20480] 0 2024-02-19T19:12:31.143 INFO:tasks.workunit.client.1.smithi125.stdout:8/862: rename db/lf to db/d18/l10f 0 2024-02-19T19:12:31.143 INFO:tasks.workunit.client.1.smithi125.stdout:8/863: read - db/d18/d30/d80/d9e/f106 zero size 2024-02-19T19:12:31.143 INFO:tasks.workunit.client.1.smithi125.stdout:8/864: mkdir db/d18/d30/d48/db1/d110 0 2024-02-19T19:12:31.143 INFO:tasks.workunit.client.1.smithi125.stdout:8/865: write db/d18/d30/d48/f57 [1357841,44134] 0 2024-02-19T19:12:31.143 INFO:tasks.workunit.client.1.smithi125.stdout:4/894: dwrite d0/d7/d3b/d75/fe9 [622592,49152] 0 2024-02-19T19:12:31.143 INFO:tasks.workunit.client.1.smithi125.stdout:4/895: truncate d0/d7/d76/dd1/fd8 579576 0 2024-02-19T19:12:31.143 INFO:tasks.workunit.client.1.smithi125.stdout:4/896: getdents d0/d7/d30/d42/db3/ddf/dea 0 2024-02-19T19:12:31.143 INFO:tasks.workunit.client.1.smithi125.stdout:4/897: unlink d0/df/d5e/l7f 0 2024-02-19T19:12:31.143 INFO:tasks.workunit.client.1.smithi125.stdout:4/898: chown d0/df/dda/l11e 0 1 2024-02-19T19:12:31.198 INFO:tasks.workunit.client.1.smithi125.stdout:7/894: fdatasync d12/d18/f68 0 2024-02-19T19:12:31.198 INFO:tasks.workunit.client.1.smithi125.stdout:7/895: chown d12/d18/d44/d51/l5a 216 1 2024-02-19T19:12:31.206 INFO:tasks.workunit.client.1.smithi125.stdout:8/866: dwrite db/d18/d30/dd2/f10e [667648,102400] 0 2024-02-19T19:12:31.206 INFO:tasks.workunit.client.1.smithi125.stdout:8/867: stat db/d18/d30/d3c/d4d/d5d/fc8 0 2024-02-19T19:12:31.206 INFO:tasks.workunit.client.1.smithi125.stdout:7/896: mkdir d12/d18/d44/d3b/d59/d67/d10e 0 2024-02-19T19:12:31.206 INFO:tasks.workunit.client.1.smithi125.stdout:7/897: chown d12/d18/d2c/db5/df2/c105 191 1 2024-02-19T19:12:31.207 INFO:tasks.workunit.client.1.smithi125.stdout:7/898: stat d12/d18/d44/d3b/d59/lc3 0 2024-02-19T19:12:31.207 INFO:tasks.workunit.client.1.smithi125.stdout:8/868: symlink db/d18/d30/d48/db9/l111 0 2024-02-19T19:12:31.207 INFO:tasks.workunit.client.1.smithi125.stdout:7/899: dread - d12/d3d/dd7/dec/f10b zero size 2024-02-19T19:12:31.207 INFO:tasks.workunit.client.1.smithi125.stdout:7/900: stat d12/d18/d44/d51/l5a 0 2024-02-19T19:12:31.207 INFO:tasks.workunit.client.1.smithi125.stdout:4/899: dwrite d0/d32/d60/d102/f6e [225280,102400] 0 2024-02-19T19:12:31.207 INFO:tasks.workunit.client.1.smithi125.stdout:7/901: unlink d12/d18/d44/d3b/d59/d2a/d31/d50/d60/f96 0 2024-02-19T19:12:31.207 INFO:tasks.workunit.client.1.smithi125.stdout:7/902: creat d12/d18/d44/d3b/d59/d26/d30/d97/d101/f10f x:0 0 0 2024-02-19T19:12:31.207 INFO:tasks.workunit.client.1.smithi125.stdout:7/903: getdents d12/d18/d2c/d4e/d10d 0 2024-02-19T19:12:31.208 INFO:tasks.workunit.client.1.smithi125.stdout:4/900: rename d0/df/la9 to d0/d7/d3b/d75/de3/l12b 0 2024-02-19T19:12:31.208 INFO:tasks.workunit.client.1.smithi125.stdout:4/901: rename d0/d7/dad/dbe/cf5 to d0/df/dda/c12c 0 2024-02-19T19:12:31.209 INFO:tasks.workunit.client.1.smithi125.stdout:4/902: dread - d0/d32/d60/d102/f104 zero size 2024-02-19T19:12:31.209 INFO:tasks.workunit.client.1.smithi125.stdout:4/903: dread d0/d32/f8b [188416,32768] 0 2024-02-19T19:12:31.271 INFO:tasks.workunit.client.1.smithi125.stdout:7/904: fdatasync f5 0 2024-02-19T19:12:31.271 INFO:tasks.workunit.client.1.smithi125.stdout:7/905: getdents d12/d18/d44/d3b/d59/d67 0 2024-02-19T19:12:31.271 INFO:tasks.workunit.client.1.smithi125.stdout:7/906: dread d12/d18/d44/d3b/d59/d2a/d31/d50/f94 [221184,61440] 0 2024-02-19T19:12:31.273 INFO:tasks.workunit.client.1.smithi125.stdout:0/967: sync 2024-02-19T19:12:31.273 INFO:tasks.workunit.client.1.smithi125.stdout:0/968: dread - d5/d1a/d4c/f11c zero size 2024-02-19T19:12:31.273 INFO:tasks.workunit.client.1.smithi125.stdout:4/904: dwrite d0/d7/d3b/d75/de3/dcd/dde/f100 [348160,90112] 0 2024-02-19T19:12:31.274 INFO:tasks.workunit.client.1.smithi125.stdout:4/905: link d0/d7/d30/d42/d7b/c10a d0/d32/d60/d102/c12d 0 2024-02-19T19:12:31.274 INFO:tasks.workunit.client.1.smithi125.stdout:8/869: dread db/d18/d30/d3c/d4d/f9f [503808,73728] 0 2024-02-19T19:12:31.274 INFO:tasks.workunit.client.1.smithi125.stdout:4/906: rmdir d0/d7/d3b 39 2024-02-19T19:12:31.275 INFO:tasks.workunit.client.1.smithi125.stdout:8/870: mknod db/d18/d30/d3c/dc6/d104/c112 0 2024-02-19T19:12:31.275 INFO:tasks.workunit.client.1.smithi125.stdout:4/907: mkdir d0/d7/d3b/d77/d120/d12e 0 2024-02-19T19:12:31.275 INFO:tasks.workunit.client.1.smithi125.stdout:4/908: link d0/d7/l107 d0/d7/d30/d42/db3/ddf/dea/l12f 0 2024-02-19T19:12:31.275 INFO:tasks.workunit.client.1.smithi125.stdout:7/907: dwrite d12/d18/d44/d3b/d59/d2a/fef [176128,24576] 0 2024-02-19T19:12:31.279 INFO:tasks.workunit.client.1.smithi125.stdout:0/969: dread d5/d19/d27/d32/d70/dd2/f149 [249856,45056] 0 2024-02-19T19:12:31.279 INFO:tasks.workunit.client.1.smithi125.stdout:0/970: truncate d5/d33/d42/f45 1895871 0 2024-02-19T19:12:31.320 INFO:tasks.workunit.client.1.smithi125.stdout:8/871: creat db/d18/d30/d48/dd8/f113 x:0 0 0 2024-02-19T19:12:31.321 INFO:tasks.workunit.client.1.smithi125.stdout:7/908: creat d12/d18/d44/d3b/d59/d67/f110 x:0 0 0 2024-02-19T19:12:31.321 INFO:tasks.workunit.client.1.smithi125.stdout:4/909: creat d0/d7/d85/f130 x:0 0 0 2024-02-19T19:12:31.321 INFO:tasks.workunit.client.1.smithi125.stdout:7/909: dread - d12/d18/d2c/db5/fb0 zero size 2024-02-19T19:12:31.321 INFO:tasks.workunit.client.1.smithi125.stdout:4/910: truncate d0/d7/d30/fd0 513293 0 2024-02-19T19:12:31.321 INFO:tasks.workunit.client.1.smithi125.stdout:4/911: dread d0/d32/d60/d102/f87 [135168,20480] 0 2024-02-19T19:12:31.321 INFO:tasks.workunit.client.1.smithi125.stdout:4/912: stat d0/d7/d3b/f8e 0 2024-02-19T19:12:31.321 INFO:tasks.workunit.client.1.smithi125.stdout:4/913: truncate d0/d32/fe8 924353 0 2024-02-19T19:12:31.321 INFO:tasks.workunit.client.1.smithi125.stdout:7/910: symlink d12/d18/d44/d3b/d59/d2a/l111 0 2024-02-19T19:12:31.322 INFO:tasks.workunit.client.1.smithi125.stdout:4/914: getdents d0/d32 0 2024-02-19T19:12:31.322 INFO:tasks.workunit.client.1.smithi125.stdout:7/911: chown d12/d18/d44/d51/l5a 325 1 2024-02-19T19:12:31.322 INFO:tasks.workunit.client.1.smithi125.stdout:7/912: unlink d12/d18/d2c/d4e/f71 0 2024-02-19T19:12:31.322 INFO:tasks.workunit.client.1.smithi125.stdout:7/913: rmdir d12/d18/dbe 39 2024-02-19T19:12:31.322 INFO:tasks.workunit.client.1.smithi125.stdout:7/914: creat d12/d18/d44/d3b/d59/d26/f112 x:0 0 0 2024-02-19T19:12:31.322 INFO:tasks.workunit.client.1.smithi125.stdout:7/915: creat d12/d18/f113 x:0 0 0 2024-02-19T19:12:31.322 INFO:tasks.workunit.client.1.smithi125.stdout:7/916: readlink d12/d18/d44/d3b/d59/ldc 0 2024-02-19T19:12:31.322 INFO:tasks.workunit.client.1.smithi125.stdout:7/917: stat d12/d18 0 2024-02-19T19:12:31.379 INFO:tasks.workunit.client.1.smithi125.stdout:4/915: fsync d0/d7/d76/faa 0 2024-02-19T19:12:31.384 INFO:tasks.workunit.client.1.smithi125.stdout:8/872: dwrite db/d18/d30/d48/f51 [1835008,86016] 0 2024-02-19T19:12:31.388 INFO:tasks.workunit.client.1.smithi125.stdout:2/879: sync 2024-02-19T19:12:31.388 INFO:tasks.workunit.client.1.smithi125.stdout:3/858: sync 2024-02-19T19:12:31.388 INFO:tasks.workunit.client.1.smithi125.stdout:2/880: mknod d1/d27/d1d/da8/c10a 0 2024-02-19T19:12:31.389 INFO:tasks.workunit.client.1.smithi125.stdout:3/859: write d0/d1/d4b/d52/d81/db7/fff [168432,21765] 0 2024-02-19T19:12:31.389 INFO:tasks.workunit.client.1.smithi125.stdout:3/860: creat d0/d95/f11c x:0 0 0 2024-02-19T19:12:31.389 INFO:tasks.workunit.client.1.smithi125.stdout:8/873: dread db/d18/d30/d80/f97 [290816,81920] 0 2024-02-19T19:12:31.389 INFO:tasks.workunit.client.1.smithi125.stdout:8/874: chown db/d81/cf3 11267711 1 2024-02-19T19:12:31.389 INFO:tasks.workunit.client.1.smithi125.stdout:4/916: truncate d0/d7/d3b/d75/fe9 1010297 0 2024-02-19T19:12:31.389 INFO:tasks.workunit.client.1.smithi125.stdout:7/918: dwrite d12/d18/d44/d3b/d59/f58 [163840,102400] 0 2024-02-19T19:12:31.389 INFO:tasks.workunit.client.1.smithi125.stdout:8/875: dread db/d81/fc0 [40960,4096] 0 2024-02-19T19:12:31.390 INFO:tasks.workunit.client.1.smithi125.stdout:4/917: dread - d0/d32/d60/d102/f104 zero size 2024-02-19T19:12:31.390 INFO:tasks.workunit.client.1.smithi125.stdout:7/919: mknod d12/d18/d44/d3b/d59/d26/d30/d97/db1/c114 0 2024-02-19T19:12:31.390 INFO:tasks.workunit.client.1.smithi125.stdout:8/876: mkdir db/d18/d30/d48/d114 0 2024-02-19T19:12:31.390 INFO:tasks.workunit.client.1.smithi125.stdout:7/920: creat d12/d18/d66/da0/f115 x:0 0 0 2024-02-19T19:12:31.390 INFO:tasks.workunit.client.1.smithi125.stdout:8/877: creat db/d81/d95/f115 x:0 0 0 2024-02-19T19:12:31.390 INFO:tasks.workunit.client.1.smithi125.stdout:7/921: dread d12/d18/d44/d3b/d59/d2a/d31/d50/f89 [319488,77824] 0 2024-02-19T19:12:31.390 INFO:tasks.workunit.client.1.smithi125.stdout:3/861: dwrite d0/d1/d1e/f1f [4030464,90112] 0 2024-02-19T19:12:31.390 INFO:tasks.workunit.client.1.smithi125.stdout:2/881: dwrite d1/d36/d70/de8/fee [536576,106496] 0 2024-02-19T19:12:31.391 INFO:tasks.workunit.client.1.smithi125.stdout:2/882: link d1/d27/d1d/d2c/d2e/f90 d1/d27/d1d/d25/da3/f10b 0 2024-02-19T19:12:31.391 INFO:tasks.workunit.client.1.smithi125.stdout:2/883: write d1/d36/d70/f66 [759140,34029] 0 2024-02-19T19:12:31.391 INFO:tasks.workunit.client.1.smithi125.stdout:2/884: chown d1/d27/d1d/d25/da0/dc3/cf0 2 1 2024-02-19T19:12:31.391 INFO:tasks.workunit.client.1.smithi125.stdout:2/885: truncate d1/d27/d1d/f2b 1955568 0 2024-02-19T19:12:31.463 INFO:tasks.workunit.client.1.smithi125.stdout:8/878: dwrite db/d18/d30/d80/dac/fbb [593920,73728] 0 2024-02-19T19:12:31.463 INFO:tasks.workunit.client.1.smithi125.stdout:8/879: dread db/d18/d30/d48/db1/fd1 [98304,86016] 0 2024-02-19T19:12:31.464 INFO:tasks.workunit.client.1.smithi125.stdout:8/880: creat db/d18/d30/d48/f116 x:0 0 0 2024-02-19T19:12:31.464 INFO:tasks.workunit.client.1.smithi125.stdout:8/881: symlink db/d18/d30/d3c/l117 0 2024-02-19T19:12:31.464 INFO:tasks.workunit.client.1.smithi125.stdout:8/882: rename db/d18/d30/d3c/dc6/d104/ldf to db/d18/d2f/d99/l118 0 2024-02-19T19:12:31.464 INFO:tasks.workunit.client.1.smithi125.stdout:8/883: stat db/d18/d2f/d72/df9 0 2024-02-19T19:12:31.465 INFO:tasks.workunit.client.1.smithi125.stdout:2/886: dwrite d1/d36/d70/fdc [757760,118784] 0 2024-02-19T19:12:31.465 INFO:tasks.workunit.client.1.smithi125.stdout:2/887: stat d1/d36/d70/d4b/le5 0 2024-02-19T19:12:31.466 INFO:tasks.workunit.client.1.smithi125.stdout:2/888: truncate d1/d36/f67 996813 0 2024-02-19T19:12:31.466 INFO:tasks.workunit.client.1.smithi125.stdout:2/889: mkdir d1/d27/d1d/d25/d2a/ddf/d10c 0 2024-02-19T19:12:31.466 INFO:tasks.workunit.client.1.smithi125.stdout:2/890: creat d1/f10d x:0 0 0 2024-02-19T19:12:31.466 INFO:tasks.workunit.client.1.smithi125.stdout:2/891: mknod d1/d27/d1d/d25/d2a/ddf/d10c/c10e 0 2024-02-19T19:12:31.466 INFO:tasks.workunit.client.1.smithi125.stdout:2/892: symlink d1/d27/d1d/da8/l10f 0 2024-02-19T19:12:31.466 INFO:tasks.workunit.client.1.smithi125.stdout:4/918: dwrite d0/d7/d3b/f81 [1040384,102400] 0 2024-02-19T19:12:31.506 INFO:tasks.workunit.client.1.smithi125.stdout:3/862: fdatasync d0/d1/d1e/d60/de2/f110 0 2024-02-19T19:12:31.506 INFO:tasks.workunit.client.1.smithi125.stdout:8/884: fsync db/d18/d30/d3c/d4d/d5d/d6f/f77 0 2024-02-19T19:12:31.508 INFO:tasks.workunit.client.1.smithi125.stdout:7/922: write d12/d18/d44/d3b/d59/f58 [296321,50832] 0 2024-02-19T19:12:31.555 INFO:tasks.workunit.client.1.smithi125.stdout:8/885: fsync db/d18/d30/d48/fbc 0 2024-02-19T19:12:31.555 INFO:tasks.workunit.client.1.smithi125.stdout:8/886: dread db/d18/d2f/d3f/f7c [86016,106496] 0 2024-02-19T19:12:31.563 INFO:tasks.workunit.client.1.smithi125.stdout:3/863: dwrite d0/d1/d4b/f67 [1372160,90112] 0 2024-02-19T19:12:31.563 INFO:tasks.workunit.client.1.smithi125.stdout:2/893: dread d1/d27/d45/d7a/f95 [839680,16384] 0 2024-02-19T19:12:31.563 INFO:tasks.workunit.client.1.smithi125.stdout:8/887: write db/f46 [1979782,21127] 0 2024-02-19T19:12:31.563 INFO:tasks.workunit.client.1.smithi125.stdout:2/894: mknod d1/d27/d1d/d25/d2a/ddf/d10c/c110 0 2024-02-19T19:12:31.563 INFO:tasks.workunit.client.1.smithi125.stdout:3/864: truncate d0/d1/d4b/d52/d81/dd0/ff2 519126 0 2024-02-19T19:12:31.563 INFO:tasks.workunit.client.1.smithi125.stdout:3/865: symlink d0/d1/d1e/d60/l11d 0 2024-02-19T19:12:31.563 INFO:tasks.workunit.client.1.smithi125.stdout:2/895: write d1/d36/d70/f8a [540983,74292] 0 2024-02-19T19:12:31.563 INFO:tasks.workunit.client.1.smithi125.stdout:2/896: stat d1/d36/f67 0 2024-02-19T19:12:31.564 INFO:tasks.workunit.client.1.smithi125.stdout:2/897: link d1/d27/d1d/d39/f7e d1/d27/da2/f111 0 2024-02-19T19:12:31.566 INFO:tasks.workunit.client.1.smithi125.stdout:7/923: dwrite d12/d18/d44/d3b/d59/d26/d30/f35 [2170880,73728] 0 2024-02-19T19:12:31.566 INFO:tasks.workunit.client.1.smithi125.stdout:7/924: creat d12/d18/d2c/f116 x:0 0 0 2024-02-19T19:12:31.567 INFO:tasks.workunit.client.1.smithi125.stdout:7/925: rmdir d12/d18/d44/d3b/d59/d2a/d31/dfd 39 2024-02-19T19:12:31.567 INFO:tasks.workunit.client.1.smithi125.stdout:8/888: dwrite db/d81/d95/f109 [704512,61440] 0 2024-02-19T19:12:31.567 INFO:tasks.workunit.client.1.smithi125.stdout:7/926: write d12/d18/d44/d3b/d59/f58 [1010155,65451] 0 2024-02-19T19:12:31.567 INFO:tasks.workunit.client.1.smithi125.stdout:7/927: readlink d12/d18/dbe/de4/d100/l108 0 2024-02-19T19:12:31.567 INFO:tasks.workunit.client.1.smithi125.stdout:7/928: stat d12/d18/d44/d3b/d59/d2a/d31/dfd/cf1 0 2024-02-19T19:12:31.567 INFO:tasks.workunit.client.1.smithi125.stdout:8/889: mknod db/d18/d2f/c119 0 2024-02-19T19:12:31.567 INFO:tasks.workunit.client.1.smithi125.stdout:3/866: dwrite d0/f51 [1822720,8192] 0 2024-02-19T19:12:31.567 INFO:tasks.workunit.client.1.smithi125.stdout:3/867: write d0/f19 [1075009,12374] 0 2024-02-19T19:12:31.567 INFO:tasks.workunit.client.1.smithi125.stdout:3/868: symlink d0/d1/d4b/d52/d81/db7/l11e 0 2024-02-19T19:12:31.568 INFO:tasks.workunit.client.1.smithi125.stdout:3/869: getdents d0/db1/dda 0 2024-02-19T19:12:31.568 INFO:tasks.workunit.client.1.smithi125.stdout:3/870: unlink d0/d1/d1e/d60/d6a/f11b 0 2024-02-19T19:12:31.568 INFO:tasks.workunit.client.1.smithi125.stdout:3/871: link d0/d1/d1e/d60/d73/leb d0/d1/d87/l11f 0 2024-02-19T19:12:31.568 INFO:tasks.workunit.client.1.smithi125.stdout:3/872: getdents d0/db1 0 2024-02-19T19:12:31.568 INFO:tasks.workunit.client.1.smithi125.stdout:2/898: dwrite d1/d27/d1d/d25/f38 [2023424,122880] 0 2024-02-19T19:12:31.568 INFO:tasks.workunit.client.1.smithi125.stdout:2/899: mknod d1/d27/d45/d7a/c112 0 2024-02-19T19:12:31.568 INFO:tasks.workunit.client.1.smithi125.stdout:2/900: chown d1/d36/dc0/cc4 12149 1 2024-02-19T19:12:31.568 INFO:tasks.workunit.client.1.smithi125.stdout:2/901: chown d1/d36/dc0/dcf 0 1 2024-02-19T19:12:31.569 INFO:tasks.workunit.client.1.smithi125.stdout:2/902: dread d1/d27/d1d/da8/fa1 [401408,8192] 0 2024-02-19T19:12:31.569 INFO:tasks.workunit.client.1.smithi125.stdout:2/903: read d1/d36/d70/d85/da4/fa6 [1465777,104918] 0 2024-02-19T19:12:31.569 INFO:tasks.workunit.client.1.smithi125.stdout:2/904: mkdir d1/d36/dc0/def/df5/d113 0 2024-02-19T19:12:31.569 INFO:tasks.workunit.client.1.smithi125.stdout:2/905: unlink d1/d27/d1d/d25/da0/dc3/dc5/ldd 0 2024-02-19T19:12:31.569 INFO:tasks.workunit.client.1.smithi125.stdout:2/906: rmdir d1/d27/d1d/d25/da0/dc3 39 2024-02-19T19:12:31.569 INFO:tasks.workunit.client.1.smithi125.stdout:2/907: symlink d1/d27/d1d/da8/d7b/d91/l114 0 2024-02-19T19:12:31.569 INFO:tasks.workunit.client.1.smithi125.stdout:2/908: stat d1/d27/d1d/d25/d7f/fac 0 2024-02-19T19:12:31.664 INFO:tasks.workunit.client.1.smithi125.stdout:8/890: dwrite db/d18/d30/d3c/d4d/f94 [1482752,32768] 0 2024-02-19T19:12:31.664 INFO:tasks.workunit.client.1.smithi125.stdout:8/891: symlink db/d18/d30/d48/db9/d10a/l11a 0 2024-02-19T19:12:31.665 INFO:tasks.workunit.client.1.smithi125.stdout:8/892: link db/l3d db/d18/d30/d3c/dc6/d104/l11b 0 2024-02-19T19:12:31.665 INFO:tasks.workunit.client.1.smithi125.stdout:8/893: stat db/d81/dde 0 2024-02-19T19:12:31.665 INFO:tasks.workunit.client.1.smithi125.stdout:8/894: creat db/f11c x:0 0 0 2024-02-19T19:12:31.668 INFO:tasks.workunit.client.1.smithi125.stdout:2/909: dwrite d1/d36/d70/d4b/f75 [548864,49152] 0 2024-02-19T19:12:31.668 INFO:tasks.workunit.client.1.smithi125.stdout:2/910: rename d1/d27/da2/lcd to d1/d27/d45/d7a/l115 0 2024-02-19T19:12:31.668 INFO:tasks.workunit.client.1.smithi125.stdout:2/911: chown d1/d27/d1d/d25/d7f 514625830 1 2024-02-19T19:12:31.668 INFO:tasks.workunit.client.1.smithi125.stdout:2/912: write d1/d27/d1d/d39/f55 [1226773,71511] 0 2024-02-19T19:12:31.668 INFO:tasks.workunit.client.1.smithi125.stdout:2/913: write d1/d36/d70/de8/fee [371202,129632] 0 2024-02-19T19:12:31.668 INFO:tasks.workunit.client.1.smithi125.stdout:2/914: truncate d1/d27/d45/d7a/ff7 290200 0 2024-02-19T19:12:31.668 INFO:tasks.workunit.client.1.smithi125.stdout:2/915: mknod d1/d27/d1d/da8/c116 0 2024-02-19T19:12:31.669 INFO:tasks.workunit.client.1.smithi125.stdout:2/916: mknod d1/d27/d1d/c117 0 2024-02-19T19:12:31.669 INFO:tasks.workunit.client.1.smithi125.stdout:2/917: rmdir d1/d27/d1d/da8/d7b/d91 39 2024-02-19T19:12:31.669 INFO:tasks.workunit.client.1.smithi125.stdout:2/918: mkdir d1/d27/d1d/d25/d2a/ddf/d118 0 2024-02-19T19:12:31.669 INFO:tasks.workunit.client.1.smithi125.stdout:2/919: dread d1/d27/d1d/d2c/fbf [843776,28672] 0 2024-02-19T19:12:31.669 INFO:tasks.workunit.client.1.smithi125.stdout:2/920: dread - d1/d27/d1d/d25/f88 zero size 2024-02-19T19:12:31.669 INFO:tasks.workunit.client.1.smithi125.stdout:0/971: sync 2024-02-19T19:12:31.669 INFO:tasks.workunit.client.1.smithi125.stdout:0/972: readlink d5/d15/d2c/d80/l93 0 2024-02-19T19:12:31.669 INFO:tasks.workunit.client.1.smithi125.stdout:0/973: write d5/d19/d27/d32/d109/db3/dd4/dfb/f114 [83781,10745] 0 2024-02-19T19:12:31.669 INFO:tasks.workunit.client.1.smithi125.stdout:0/974: dread d5/d1a/d4c/fa1 [315392,36864] 0 2024-02-19T19:12:31.670 INFO:tasks.workunit.client.1.smithi125.stdout:8/895: dwrite db/d18/d30/d3c/f53 [1282048,36864] 0 2024-02-19T19:12:31.670 INFO:tasks.workunit.client.1.smithi125.stdout:0/975: rename d5/l13 to d5/d19/l154 0 2024-02-19T19:12:31.678 INFO:tasks.workunit.client.1.smithi125.stdout:3/873: dread d0/f24 [520192,86016] 0 2024-02-19T19:12:31.725 INFO:tasks.workunit.client.1.smithi125.stdout:3/874: fsync d0/d95/d9c/dbf/de0/ff6 0 2024-02-19T19:12:31.782 INFO:tasks.workunit.client.1.smithi125.stdout:7/929: fsync d12/d18/d66/da0/f115 0 2024-02-19T19:12:31.782 INFO:tasks.workunit.client.1.smithi125.stdout:7/930: chown d12/d18/d44/d3b/d59/d26/d30/d37/lda 808 1 2024-02-19T19:12:31.782 INFO:tasks.workunit.client.1.smithi125.stdout:3/875: fdatasync d0/d1/d1e/d60/d73/d112/fd3 0 2024-02-19T19:12:31.784 INFO:tasks.workunit.client.1.smithi125.stdout:0/976: dwrite d5/d1a/fe4 [1798144,65536] 0 2024-02-19T19:12:31.784 INFO:tasks.workunit.client.1.smithi125.stdout:2/921: dwrite d1/d27/d1d/d39/fb1 [405504,45056] 0 2024-02-19T19:12:31.784 INFO:tasks.workunit.client.1.smithi125.stdout:7/931: creat d12/d18/d44/d51/f117 x:0 0 0 2024-02-19T19:12:31.784 INFO:tasks.workunit.client.1.smithi125.stdout:3/876: creat d0/d1/d1e/d60/de2/d103/f120 x:0 0 0 2024-02-19T19:12:31.784 INFO:tasks.workunit.client.1.smithi125.stdout:7/932: chown d12/d18/d44 39 1 2024-02-19T19:12:31.784 INFO:tasks.workunit.client.1.smithi125.stdout:3/877: chown d0/d1/d4b/lc1 1396 1 2024-02-19T19:12:31.785 INFO:tasks.workunit.client.1.smithi125.stdout:3/878: chown d0/d1/d1e/d60/d6a 250658 1 2024-02-19T19:12:31.785 INFO:tasks.workunit.client.1.smithi125.stdout:7/933: truncate f8 2122536 0 2024-02-19T19:12:31.785 INFO:tasks.workunit.client.1.smithi125.stdout:0/977: dread d5/d19/d27/d32/f8d [3264512,20480] 0 2024-02-19T19:12:31.785 INFO:tasks.workunit.client.1.smithi125.stdout:0/978: read d5/d15/d2c/f77 [15819,31551] 0 2024-02-19T19:12:31.785 INFO:tasks.workunit.client.1.smithi125.stdout:7/934: creat d12/d18/d44/d3b/d59/f118 x:0 0 0 2024-02-19T19:12:31.785 INFO:tasks.workunit.client.1.smithi125.stdout:7/935: write d12/d18/d2c/db5/dca/f5f [1508516,18132] 0 2024-02-19T19:12:31.785 INFO:tasks.workunit.client.1.smithi125.stdout:7/936: chown d12/d18/d44/d3b/d59/d26/d30/d37/dd1/l10a 212758718 1 2024-02-19T19:12:31.791 INFO:tasks.workunit.client.1.smithi125.stdout:2/922: fdatasync d1/d27/d1d/d2c/d2e/f90 0 2024-02-19T19:12:31.791 INFO:tasks.workunit.client.1.smithi125.stdout:2/923: mknod d1/d27/d1d/d39/c119 0 2024-02-19T19:12:31.792 INFO:tasks.workunit.client.1.smithi125.stdout:3/879: dwrite d0/d1/d1e/d60/d73/d74/f79 [704512,40960] 0 2024-02-19T19:12:31.797 INFO:tasks.workunit.client.1.smithi125.stdout:0/979: dwrite d5/d19/d27/de3/fea [196608,81920] 0 2024-02-19T19:12:31.797 INFO:tasks.workunit.client.1.smithi125.stdout:0/980: rename d5/d19/d27/d32/d109/db3/dd4/dfb/d106/c103 to d5/d19/c155 0 2024-02-19T19:12:31.798 INFO:tasks.workunit.client.1.smithi125.stdout:0/981: read d5/d19/d48/ffc [989150,77496] 0 2024-02-19T19:12:31.798 INFO:tasks.workunit.client.1.smithi125.stdout:0/982: chown d5/d19/d27/fa2 3 1 2024-02-19T19:12:31.798 INFO:tasks.workunit.client.1.smithi125.stdout:0/983: read - d5/d33/d42/d92/da5/f10b zero size 2024-02-19T19:12:31.798 INFO:tasks.workunit.client.1.smithi125.stdout:0/984: write d5/d19/d27/d32/d70/fa9 [273742,31450] 0 2024-02-19T19:12:31.798 INFO:tasks.workunit.client.1.smithi125.stdout:0/985: creat d5/d19/d27/d32/d109/db3/dd4/dfb/f156 x:0 0 0 2024-02-19T19:12:31.798 INFO:tasks.workunit.client.1.smithi125.stdout:0/986: write d5/d1a/fba [998865,117305] 0 2024-02-19T19:12:31.798 INFO:tasks.workunit.client.1.smithi125.stdout:0/987: read d5/d33/d42/fe7 [142765,6006] 0 2024-02-19T19:12:31.798 INFO:tasks.workunit.client.1.smithi125.stdout:0/988: creat d5/d9/dcd/f157 x:0 0 0 2024-02-19T19:12:31.799 INFO:tasks.workunit.client.1.smithi125.stdout:0/989: rename d5/d19/d27/d32/d109/db3/cd0 to d5/d15/d2c/d80/c158 0 2024-02-19T19:12:31.799 INFO:tasks.workunit.client.1.smithi125.stdout:0/990: chown d5/d19/d27/d32/d109 489 1 2024-02-19T19:12:31.799 INFO:tasks.workunit.client.1.smithi125.stdout:0/991: truncate d5/d19/d27/d32/d70/fc0 286672 0 2024-02-19T19:12:31.799 INFO:tasks.workunit.client.1.smithi125.stdout:0/992: creat d5/d19/d27/d32/f159 x:0 0 0 2024-02-19T19:12:31.799 INFO:tasks.workunit.client.1.smithi125.stdout:0/993: link d5/d1a/l2a d5/d33/d46/de6/l15a 0 2024-02-19T19:12:31.799 INFO:tasks.workunit.client.1.smithi125.stdout:2/924: dwrite d1/d27/d1d/d25/f6e [241664,24576] 0 2024-02-19T19:12:31.799 INFO:tasks.workunit.client.1.smithi125.stdout:2/925: rmdir d1/d27/d45/d7a 39 2024-02-19T19:12:31.800 INFO:tasks.workunit.client.1.smithi125.stdout:2/926: getdents d1/d36/dc0 0 2024-02-19T19:12:31.800 INFO:tasks.workunit.client.1.smithi125.stdout:2/927: write d1/d27/f44 [294802,49182] 0 2024-02-19T19:12:31.800 INFO:tasks.workunit.client.1.smithi125.stdout:2/928: write d1/ff [653589,87377] 0 2024-02-19T19:12:31.800 INFO:tasks.workunit.client.1.smithi125.stdout:2/929: mkdir d1/d27/d1d/d25/da3/dfc/d11a 0 2024-02-19T19:12:31.800 INFO:tasks.workunit.client.1.smithi125.stdout:2/930: write d1/d27/d45/d7a/ff7 [801083,42548] 0 2024-02-19T19:12:31.864 INFO:tasks.workunit.client.1.smithi125.stdout:3/880: fdatasync d0/d1/d1e/d60/d6a/f11a 0 2024-02-19T19:12:31.864 INFO:tasks.workunit.client.1.smithi125.stdout:3/881: creat d0/d1/d1e/d60/d73/d112/f121 x:0 0 0 2024-02-19T19:12:31.864 INFO:tasks.workunit.client.1.smithi125.stdout:3/882: creat d0/d1/d1e/d60/d73/d74/d82/d10c/f122 x:0 0 0 2024-02-19T19:12:31.866 INFO:tasks.workunit.client.1.smithi125.stdout:3/883: dwrite d0/d1/d1e/d60/d73/d74/d82/fd4 [385024,4096] 0 2024-02-19T19:12:31.922 INFO:tasks.workunit.client.1.smithi125.stdout:2/931: fsync d1/d27/d1d/da8/fdb 0 2024-02-19T19:12:31.926 INFO:tasks.workunit.client.1.smithi125.stdout:2/932: rename d1/d27/d1d/c117 to d1/d27/d1d/c11b 0 2024-02-19T19:12:31.926 INFO:tasks.workunit.client.1.smithi125.stdout:2/933: rmdir d1/d36/d70/d85/da4 39 2024-02-19T19:12:31.971 INFO:tasks.workunit.client.1.smithi125.stdout:2/934: fsync d1/d27/d1d/fc2 0 2024-02-19T19:12:31.972 INFO:tasks.workunit.client.1.smithi125.stdout:2/935: mkdir d1/d27/d1d/d25/d2a/d11c 0 2024-02-19T19:12:31.972 INFO:tasks.workunit.client.1.smithi125.stdout:2/936: chown d1/d27/d1d/d16/l3a 64971 1 2024-02-19T19:12:31.972 INFO:tasks.workunit.client.1.smithi125.stdout:2/937: creat d1/d36/dc0/dcf/f11d x:0 0 0 2024-02-19T19:12:31.972 INFO:tasks.workunit.client.1.smithi125.stdout:2/938: mknod d1/d27/d1d/d25/da3/c11e 0 2024-02-19T19:12:31.972 INFO:tasks.workunit.client.1.smithi125.stdout:2/939: mkdir d1/d27/d1d/d11f 0 2024-02-19T19:12:31.972 INFO:tasks.workunit.client.1.smithi125.stdout:2/940: rename d1/fb4 to d1/d27/d1d/d25/da0/f120 0 2024-02-19T19:12:31.972 INFO:tasks.workunit.client.1.smithi125.stdout:2/941: write d1/d27/d1d/d25/d2a/ddf/f100 [419550,23537] 0 2024-02-19T19:12:31.972 INFO:tasks.workunit.client.1.smithi125.stdout:2/942: dread - d1/d27/d1d/d25/da3/f10b zero size 2024-02-19T19:12:31.973 INFO:tasks.workunit.client.1.smithi125.stdout:2/943: chown d1/d27/d1d/d25/cb6 3599 1 2024-02-19T19:12:31.973 INFO:tasks.workunit.client.1.smithi125.stdout:2/944: dread d1/d27/d1d/d25/d2a/f41 [868352,77824] 0 2024-02-19T19:12:31.973 INFO:tasks.workunit.client.1.smithi125.stdout:2/945: dread - d1/d36/d70/d85/fce zero size 2024-02-19T19:12:31.973 INFO:tasks.workunit.client.1.smithi125.stdout:2/946: write d1/f47 [2537176,100268] 0 2024-02-19T19:12:31.974 INFO:tasks.workunit.client.1.smithi125.stdout:2/947: rename d1/d27/d1d/d25/l8d to d1/d36/d70/de8/l121 0 2024-02-19T19:12:31.974 INFO:tasks.workunit.client.1.smithi125.stdout:2/948: creat d1/d36/dc0/def/df5/f122 x:0 0 0 2024-02-19T19:12:31.974 INFO:tasks.workunit.client.1.smithi125.stdout:2/949: mknod d1/d27/d1d/da8/d7b/c123 0 2024-02-19T19:12:31.975 INFO:tasks.workunit.client.1.smithi125.stdout:2/950: stat d1/d27/d1d/d25/d2a/le6 0 2024-02-19T19:12:31.975 INFO:tasks.workunit.client.1.smithi125.stdout:2/951: rename d1/d27/d1d/d25/da0/ffa to d1/d27/d1d/d2c/d2e/f124 0 2024-02-19T19:12:31.975 INFO:tasks.workunit.client.1.smithi125.stdout:2/952: mknod d1/d27/d1d/d25/da0/c125 0 2024-02-19T19:12:31.975 INFO:tasks.workunit.client.1.smithi125.stdout:2/953: unlink d1/d27/d1d/da8/cc1 0 2024-02-19T19:12:31.975 INFO:tasks.workunit.client.1.smithi125.stdout:2/954: readlink d1/d27/d1d/d2c/d2e/l58 0 2024-02-19T19:12:32.013 INFO:tasks.workunit.client.1.smithi125.stdout:2/955: dwrite d1/d27/d1d/d25/d2a/f34 [118784,118784] 0 2024-02-19T19:12:32.013 INFO:tasks.workunit.client.1.smithi125.stdout:2/956: mknod d1/d27/d1d/d2c/c126 0 2024-02-19T19:12:32.013 INFO:tasks.workunit.client.1.smithi125.stdout:2/957: symlink d1/d27/d1d/d11f/l127 0 2024-02-19T19:12:32.013 INFO:tasks.workunit.client.1.smithi125.stdout:2/958: readlink d1/d36/d70/de8/l121 0 2024-02-19T19:12:32.013 INFO:tasks.workunit.client.1.smithi125.stdout:2/959: stat d1/d36/cde 0 2024-02-19T19:12:32.013 INFO:tasks.workunit.client.1.smithi125.stdout:2/960: mknod d1/d36/d70/de8/c128 0 2024-02-19T19:12:32.014 INFO:tasks.workunit.client.1.smithi125.stdout:2/961: creat d1/d27/d1d/da8/d7b/d91/f129 x:0 0 0 2024-02-19T19:12:32.014 INFO:tasks.workunit.client.1.smithi125.stdout:2/962: creat d1/d36/d70/f12a x:0 0 0 2024-02-19T19:12:32.024 INFO:tasks.workunit.client.1.smithi125.stdout:2/963: dread d1/d36/d70/f8a [221184,49152] 0 2024-02-19T19:12:32.024 INFO:tasks.workunit.client.1.smithi125.stdout:2/964: rmdir d1/d27/d1d/d25/da0/de2 0 2024-02-19T19:12:32.024 INFO:tasks.workunit.client.1.smithi125.stdout:2/965: chown d1/d27/d1d/d2c/l81 32 1 2024-02-19T19:12:32.025 INFO:tasks.workunit.client.1.smithi125.stdout:4/919: sync 2024-02-19T19:12:32.026 INFO:tasks.workunit.client.1.smithi125.stdout:4/920: chown d0/d32/d60/d102/d110/l128 3 1 2024-02-19T19:12:32.026 INFO:tasks.workunit.client.1.smithi125.stdout:4/921: dread d0/d7/d3b/f9c [32768,110592] 0 2024-02-19T19:12:32.026 INFO:tasks.workunit.client.1.smithi125.stdout:4/922: link d0/d7/d30/d42/fc2 d0/df/d5e/f131 0 2024-02-19T19:12:32.032 INFO:tasks.workunit.client.1.smithi125.stdout:2/966: dwrite d1/d36/f67 [335872,36864] 0 2024-02-19T19:12:32.032 INFO:tasks.workunit.client.1.smithi125.stdout:2/967: stat d1/d36/d70/ce1 0 2024-02-19T19:12:32.161 INFO:tasks.workunit.client.1.smithi125.stdout:2/968: mkdir d1/d36/d70/d85/da4/d12b 0 2024-02-19T19:12:32.161 INFO:tasks.workunit.client.1.smithi125.stdout:2/969: mknod d1/d36/d70/c12c 0 2024-02-19T19:12:32.210 INFO:tasks.workunit.client.1.smithi125.stdout:8/896: sync 2024-02-19T19:12:32.210 INFO:tasks.workunit.client.1.smithi125.stdout:2/970: dwrite d1/d27/d1d/d25/da0/dc3/fec [155648,4096] 0 2024-02-19T19:12:32.210 INFO:tasks.workunit.client.1.smithi125.stdout:8/897: mkdir db/d18/d2f/d11d 0 2024-02-19T19:12:32.210 INFO:tasks.workunit.client.1.smithi125.stdout:8/898: readlink db/d18/d2f/l7e 0 2024-02-19T19:12:32.210 INFO:tasks.workunit.client.1.smithi125.stdout:8/899: rmdir db/d18/d30/d3c/d4d/d5d/da2/d107 39 2024-02-19T19:12:32.210 INFO:tasks.workunit.client.1.smithi125.stdout:8/900: write db/d6d/fd6 [542038,52189] 0 2024-02-19T19:12:32.240 INFO:tasks.workunit.client.1.smithi125.stdout:8/901: dwrite db/fdd [1335296,94208] 0 2024-02-19T19:12:32.247 INFO:tasks.workunit.client.1.smithi125.stdout:2/971: dread d1/d27/d1d/d2c/d2e/f65 [1327104,114688] 0 2024-02-19T19:12:32.248 INFO:tasks.workunit.client.1.smithi125.stdout:2/972: symlink d1/d36/d70/l12d 0 2024-02-19T19:12:32.248 INFO:tasks.workunit.client.1.smithi125.stdout:2/973: write d1/d27/d45/d7a/f95 [1622244,108113] 0 2024-02-19T19:12:32.248 INFO:tasks.workunit.client.1.smithi125.stdout:2/974: dread d1/d27/d1d/d25/da0/f120 [319488,86016] 0 2024-02-19T19:12:32.248 INFO:tasks.workunit.client.1.smithi125.stdout:2/975: mknod d1/d36/dc0/def/df5/c12e 0 2024-02-19T19:12:32.248 INFO:tasks.workunit.client.1.smithi125.stdout:2/976: truncate d1/d27/d1d/da8/d7b/d91/ff2 1375557 0 2024-02-19T19:12:32.265 INFO:tasks.workunit.client.1.smithi125.stdout:2/977: fsync d1/d27/d1d/d2c/d2e/f124 0 2024-02-19T19:12:32.265 INFO:tasks.workunit.client.1.smithi125.stdout:2/978: readlink d1/d27/d1d/da8/d7b/d91/l9d 0 2024-02-19T19:12:32.265 INFO:tasks.workunit.client.1.smithi125.stdout:8/902: dwrite db/d18/d2f/d3f/fad [561152,8192] 0 2024-02-19T19:12:32.265 INFO:tasks.workunit.client.1.smithi125.stdout:8/903: stat db/d18/lb7 0 2024-02-19T19:12:32.265 INFO:tasks.workunit.client.1.smithi125.stdout:8/904: creat db/d18/d30/d3c/dc6/d104/d96/f11e x:0 0 0 2024-02-19T19:12:32.272 INFO:tasks.workunit.client.1.smithi125.stdout:8/905: dwrite db/d18/d30/d3c/d4d/d5d/da2/dae/fbe [512000,32768] 0 2024-02-19T19:12:32.272 INFO:tasks.workunit.client.1.smithi125.stdout:8/906: dread db/d18/d2f/d72/f87 [1163264,118784] 0 2024-02-19T19:12:32.275 INFO:tasks.workunit.client.1.smithi125.stdout:8/907: rename db/d18/d30/d3c/dc6 to db/d18/d30/d80/d9e/d11f 0 2024-02-19T19:12:32.275 INFO:tasks.workunit.client.1.smithi125.stdout:8/908: write f4 [1502998,107279] 0 2024-02-19T19:12:32.275 INFO:tasks.workunit.client.1.smithi125.stdout:8/909: mkdir db/d18/d30/d48/d120 0 2024-02-19T19:12:32.413 INFO:tasks.workunit.client.1.smithi125.stdout:8/910: fsync db/d18/d30/d3c/f53 0 2024-02-19T19:12:32.420 INFO:tasks.workunit.client.1.smithi125.stdout:3/884: sync 2024-02-19T19:12:32.420 INFO:tasks.workunit.client.1.smithi125.stdout:4/923: sync 2024-02-19T19:12:32.421 INFO:tasks.workunit.client.1.smithi125.stdout:7/937: sync 2024-02-19T19:12:32.421 INFO:tasks.workunit.client.1.smithi125.stdout:0/994: sync 2024-02-19T19:12:32.421 INFO:tasks.workunit.client.1.smithi125.stdout:7/938: chown d12/d18/d44/d51 12119 1 2024-02-19T19:12:32.421 INFO:tasks.workunit.client.1.smithi125.stdout:0/995: truncate d5/d19/d27/d32/f150 979876 0 2024-02-19T19:12:32.421 INFO:tasks.workunit.client.1.smithi125.stdout:0/996: dread - d5/d1a/f122 zero size 2024-02-19T19:12:32.421 INFO:tasks.workunit.client.1.smithi125.stdout:4/924: rename d0/d7/d30 to d0/d32/d60/d102/d132 0 2024-02-19T19:12:32.421 INFO:tasks.workunit.client.1.smithi125.stdout:0/997: chown d5/d19/cd6 227776 1 2024-02-19T19:12:32.421 INFO:tasks.workunit.client.1.smithi125.stdout:3/885: symlink d0/de/l123 0 2024-02-19T19:12:32.421 INFO:tasks.workunit.client.1.smithi125.stdout:4/925: chown d0/d32/d60/d102/d132/d42/db3/ddf/dea/c11b 3 1 2024-02-19T19:12:32.422 INFO:tasks.workunit.client.1.smithi125.stdout:4/926: rename d0/d7/dad/db9/ce6 to d0/df/dda/c133 0 2024-02-19T19:12:32.422 INFO:tasks.workunit.client.1.smithi125.stdout:4/927: chown d0/d7/d3b/d77/c95 9 1 2024-02-19T19:12:32.422 INFO:tasks.workunit.client.1.smithi125.stdout:3/886: unlink d0/d1/d1e/d60/d73/d74/d82/f9a 0 2024-02-19T19:12:32.422 INFO:tasks.workunit.client.1.smithi125.stdout:3/887: getdents d0/db1/dda 0 2024-02-19T19:12:32.422 INFO:tasks.workunit.client.1.smithi125.stdout:3/888: dread - d0/d1/d1e/d60/d6a/f11a zero size 2024-02-19T19:12:32.423 INFO:tasks.workunit.client.1.smithi125.stdout:8/911: dread db/d18/d30/d3c/f68 [364544,122880] 0 2024-02-19T19:12:32.423 INFO:tasks.workunit.client.1.smithi125.stdout:8/912: dread db/d18/d30/d48/f5c [462848,8192] 0 2024-02-19T19:12:32.423 INFO:tasks.workunit.client.1.smithi125.stdout:8/913: stat db/d18/d30/d80/dac 0 2024-02-19T19:12:32.423 INFO:tasks.workunit.client.1.smithi125.stdout:8/914: stat db/d18/d30/d3c/d4d/d5d/da2/d107/l10d 0 2024-02-19T19:12:32.508 INFO:tasks.workunit.client.1.smithi125.stdout:3/889: dwrite d0/d1/d39/f84 [1974272,73728] 0 2024-02-19T19:12:32.508 INFO:tasks.workunit.client.1.smithi125.stdout:3/890: read d0/d1/d1e/f1f [1746191,37916] 0 2024-02-19T19:12:32.508 INFO:tasks.workunit.client.1.smithi125.stdout:3/891: creat d0/d1/d1e/db0/f124 x:0 0 0 2024-02-19T19:12:32.508 INFO:tasks.workunit.client.1.smithi125.stdout:3/892: mknod d0/d95/d9c/dbf/de0/c125 0 2024-02-19T19:12:32.508 INFO:tasks.workunit.client.1.smithi125.stdout:3/893: symlink d0/d95/d9c/l126 0 2024-02-19T19:12:32.547 INFO:tasks.workunit.client.1.smithi125.stdout:7/939: fsync d12/d18/d44/d3b/d59/d67/ff5 0 2024-02-19T19:12:32.547 INFO:tasks.workunit.client.1.smithi125.stdout:4/928: fdatasync d0/d32/d60/d102/d132/d42/d7b/fb0 0 2024-02-19T19:12:32.547 INFO:tasks.workunit.client.1.smithi125.stdout:7/940: mknod d12/d18/d63/c119 0 2024-02-19T19:12:32.547 INFO:tasks.workunit.client.1.smithi125.stdout:7/941: chown d12/d18/d2c/db5/fb0 0 1 2024-02-19T19:12:32.548 INFO:tasks.workunit.client.1.smithi125.stdout:7/942: link d12/d18/d44/d51/c102 d12/d18/d44/d3b/c11a 0 2024-02-19T19:12:32.548 INFO:tasks.workunit.client.1.smithi125.stdout:4/929: creat d0/d7/d76/dd1/f134 x:0 0 0 2024-02-19T19:12:32.548 INFO:tasks.workunit.client.1.smithi125.stdout:4/930: chown d0/d7/d3b/d75/de3/dcd/dde/f100 812 1 2024-02-19T19:12:32.548 INFO:tasks.workunit.client.1.smithi125.stdout:4/931: readlink d0/df/l9d 0 2024-02-19T19:12:32.548 INFO:tasks.workunit.client.1.smithi125.stdout:3/894: fdatasync d0/d1/d1e/f27 0 2024-02-19T19:12:32.548 INFO:tasks.workunit.client.1.smithi125.stdout:4/932: write d0/d32/d60/d102/d132/d42/db3/fff [26617,846] 0 2024-02-19T19:12:32.548 INFO:tasks.workunit.client.1.smithi125.stdout:4/933: dread d0/d7/dad/dbe/f124 [565248,32768] 0 2024-02-19T19:12:32.551 INFO:tasks.workunit.client.1.smithi125.stdout:7/943: mkdir d12/d18/d44/d3b/d59/d2a/d31/d11b 0 2024-02-19T19:12:32.552 INFO:tasks.workunit.client.1.smithi125.stdout:7/944: creat d12/d18/d44/d3b/d59/d26/f11c x:0 0 0 2024-02-19T19:12:32.552 INFO:tasks.workunit.client.1.smithi125.stdout:7/945: symlink d12/d18/d44/l11d 0 2024-02-19T19:12:32.552 INFO:tasks.workunit.client.1.smithi125.stdout:7/946: creat d12/d18/d44/d3b/d59/d26/d30/d37/f11e x:0 0 0 2024-02-19T19:12:32.552 INFO:tasks.workunit.client.1.smithi125.stdout:7/947: symlink d12/d18/d44/d3b/l11f 0 2024-02-19T19:12:32.552 INFO:tasks.workunit.client.1.smithi125.stdout:7/948: creat d12/d18/d2c/db5/f120 x:0 0 0 2024-02-19T19:12:32.552 INFO:tasks.workunit.client.1.smithi125.stdout:7/949: rmdir d12/d18/d44/d3b/d59/d26/d30/d37/dd1 39 2024-02-19T19:12:32.552 INFO:tasks.workunit.client.1.smithi125.stdout:7/950: mkdir d12/d18/d44/d3b/d59/d26/d30/d37/dc1/d121 0 2024-02-19T19:12:32.552 INFO:tasks.workunit.client.1.smithi125.stdout:7/951: dread f8 [741376,20480] 0 2024-02-19T19:12:32.553 INFO:tasks.workunit.client.1.smithi125.stdout:7/952: symlink d12/d18/d44/d3b/d59/d26/d30/d97/l122 0 2024-02-19T19:12:32.553 INFO:tasks.workunit.client.1.smithi125.stdout:2/979: sync 2024-02-19T19:12:32.553 INFO:tasks.workunit.client.1.smithi125.stdout:2/980: mkdir d1/d27/d1d/d39/d12f 0 2024-02-19T19:12:32.553 INFO:tasks.workunit.client.1.smithi125.stdout:2/981: rmdir d1/d27/d1d/d25/da0/dc3 39 2024-02-19T19:12:32.553 INFO:tasks.workunit.client.1.smithi125.stdout:2/982: getdents d1/d36/dc0/def/df5/d113 0 2024-02-19T19:12:32.553 INFO:tasks.workunit.client.1.smithi125.stdout:3/895: dwrite d0/d1/d1e/db0/f124 [315392,24576] 0 2024-02-19T19:12:32.553 INFO:tasks.workunit.client.1.smithi125.stdout:3/896: readlink d0/l40 0 2024-02-19T19:12:32.553 INFO:tasks.workunit.client.1.smithi125.stdout:2/983: getdents d1/d27/d1d/d25/da0 0 2024-02-19T19:12:32.553 INFO:tasks.workunit.client.1.smithi125.stdout:3/897: write d0/d1/d1e/d60/d73/d112/d71/f7f [1152853,62959] 0 2024-02-19T19:12:32.554 INFO:tasks.workunit.client.1.smithi125.stdout:3/898: chown d0/d1/d1e/d60/de2/f118 6153204 1 2024-02-19T19:12:32.556 INFO:tasks.workunit.client.1.smithi125.stdout:8/915: write f4 [256550,105959] 0 2024-02-19T19:12:32.557 INFO:tasks.workunit.client.1.smithi125.stdout:8/916: mknod db/d18/d30/d80/d9e/d11f/c121 0 2024-02-19T19:12:32.557 INFO:tasks.workunit.client.1.smithi125.stdout:8/917: chown db/d18/d30/d3c/d70 377430 1 2024-02-19T19:12:32.557 INFO:tasks.workunit.client.1.smithi125.stdout:8/918: truncate db/d18/d30/d80/d9e/d11f/d104/ff4 189142 0 2024-02-19T19:12:32.557 INFO:tasks.workunit.client.1.smithi125.stdout:8/919: mkdir db/d18/d2f/d99/d122 0 2024-02-19T19:12:32.557 INFO:tasks.workunit.client.1.smithi125.stdout:8/920: write db/d18/d30/d3c/d4d/d5d/f64 [131829,121884] 0 2024-02-19T19:12:32.564 INFO:tasks.workunit.client.1.smithi125.stdout:4/934: dread d0/d32/d60/d102/d132/d5d/f64 [647168,65536] 0 2024-02-19T19:12:32.598 INFO:tasks.workunit.client.1.smithi125.stdout:7/953: dwrite d12/d18/f113 [937984,8192] 0 2024-02-19T19:12:32.598 INFO:tasks.workunit.client.1.smithi125.stdout:7/954: write d12/d18/d44/d3b/d59/d26/d30/d37/f3f [649082,54586] 0 2024-02-19T19:12:32.598 INFO:tasks.workunit.client.1.smithi125.stdout:7/955: write d12/d18/d44/d3b/d59/d26/d30/d97/fa3 [700327,69160] 0 2024-02-19T19:12:32.601 INFO:tasks.workunit.client.1.smithi125.stdout:8/921: dwrite db/d18/d2f/f39 [106496,73728] 0 2024-02-19T19:12:32.602 INFO:tasks.workunit.client.1.smithi125.stdout:8/922: creat db/d6d/f123 x:0 0 0 2024-02-19T19:12:32.602 INFO:tasks.workunit.client.1.smithi125.stdout:8/923: unlink db/d18/d30/d48/db1/fdb 0 2024-02-19T19:12:32.602 INFO:tasks.workunit.client.1.smithi125.stdout:8/924: rmdir db/d81 39 2024-02-19T19:12:32.602 INFO:tasks.workunit.client.1.smithi125.stdout:8/925: creat db/d81/f124 x:0 0 0 2024-02-19T19:12:32.602 INFO:tasks.workunit.client.1.smithi125.stdout:8/926: creat db/d18/d30/d3c/f125 x:0 0 0 2024-02-19T19:12:32.602 INFO:tasks.workunit.client.1.smithi125.stdout:3/899: dwrite d0/d1/d1e/d60/d73/fa6 [2056192,98304] 0 2024-02-19T19:12:32.602 INFO:tasks.workunit.client.1.smithi125.stdout:3/900: rmdir d0/d1/d1e/d60/d73/d112/d71 39 2024-02-19T19:12:32.602 INFO:tasks.workunit.client.1.smithi125.stdout:7/956: dread d12/d18/d44/d3b/d59/fac [344064,57344] 0 2024-02-19T19:12:32.603 INFO:tasks.workunit.client.1.smithi125.stdout:3/901: write d0/f19 [1649428,39325] 0 2024-02-19T19:12:32.603 INFO:tasks.workunit.client.1.smithi125.stdout:7/957: creat d12/d18/d44/d51/f123 x:0 0 0 2024-02-19T19:12:32.603 INFO:tasks.workunit.client.1.smithi125.stdout:7/958: truncate d12/d18/d44/d3b/d59/d26/d30/d37/f62 2120052 0 2024-02-19T19:12:32.603 INFO:tasks.workunit.client.1.smithi125.stdout:7/959: write d12/d18/d44/d3b/d59/d2a/d31/d50/f89 [564650,48369] 0 2024-02-19T19:12:32.603 INFO:tasks.workunit.client.1.smithi125.stdout:7/960: unlink d12/d18/d44/d3b/d59/d26/f3a 0 2024-02-19T19:12:32.603 INFO:tasks.workunit.client.1.smithi125.stdout:7/961: stat d12/d18/d2c/db5/dca/l7d 0 2024-02-19T19:12:32.603 INFO:tasks.workunit.client.1.smithi125.stdout:7/962: creat d12/d18/d44/d3b/d59/d26/d30/dad/f124 x:0 0 0 2024-02-19T19:12:32.603 INFO:tasks.workunit.client.1.smithi125.stdout:7/963: link d12/d18/d44/d3b/d59/d2a/d6a/d6d/l8d d12/d18/d44/d3b/d59/d2a/d31/l125 0 2024-02-19T19:12:32.603 INFO:tasks.workunit.client.1.smithi125.stdout:7/964: rename d12/d18/d44/d3b/d59/d26/d30 to d12/d18/d44/d3b/d59/d2a/d6a/d6d/d126 0 2024-02-19T19:12:32.604 INFO:tasks.workunit.client.1.smithi125.stdout:7/965: rename d12/d18/d66/da0/le1 to d12/d18/d2c/d4e/l127 0 2024-02-19T19:12:32.604 INFO:tasks.workunit.client.1.smithi125.stdout:7/966: truncate d12/d18/d44/d3b/d59/d2a/d6a/d6d/d126/d37/f3f 3414189 0 2024-02-19T19:12:32.604 INFO:tasks.workunit.client.1.smithi125.stdout:7/967: mknod d12/d18/d44/d3b/d59/d2a/d6a/d6d/d126/d97/d101/c128 0 2024-02-19T19:12:32.604 INFO:tasks.workunit.client.1.smithi125.stdout:7/968: creat d12/d18/d44/d3b/d59/d67/d10e/f129 x:0 0 0 2024-02-19T19:12:32.604 INFO:tasks.workunit.client.1.smithi125.stdout:7/969: stat d12/d18/d44/d3b/d59/d2a/d6a/d6d/d126/d37/lb4 0 2024-02-19T19:12:32.605 INFO:tasks.workunit.client.1.smithi125.stdout:7/970: link d12/f1f d12/d18/d66/da0/f12a 0 2024-02-19T19:12:32.605 INFO:tasks.workunit.client.1.smithi125.stdout:7/971: chown d12/d18/d44/c8b 36479131 1 2024-02-19T19:12:32.605 INFO:tasks.workunit.client.1.smithi125.stdout:7/972: truncate d12/d18/d2c/db5/dca/f5b 247798 0 2024-02-19T19:12:32.605 INFO:tasks.workunit.client.1.smithi125.stdout:7/973: creat d12/d18/d2c/d4e/d10d/f12b x:0 0 0 2024-02-19T19:12:32.605 INFO:tasks.workunit.client.1.smithi125.stdout:7/974: write d12/d18/d44/d3b/d59/d2a/d6a/d6d/d126/d37/f8a [1549048,59900] 0 2024-02-19T19:12:32.605 INFO:tasks.workunit.client.1.smithi125.stdout:7/975: dread d12/d18/d44/d3b/d59/d2a/fef [8192,94208] 0 2024-02-19T19:12:32.605 INFO:tasks.workunit.client.1.smithi125.stdout:7/976: dread - d12/d18/d44/d51/f117 zero size 2024-02-19T19:12:32.605 INFO:tasks.workunit.client.1.smithi125.stdout:7/977: symlink d12/d18/d2c/db5/dca/l12c 0 2024-02-19T19:12:32.605 INFO:tasks.workunit.client.1.smithi125.stdout:7/978: creat d12/d18/d44/d3b/d59/d2a/f12d x:0 0 0 2024-02-19T19:12:32.623 INFO:tasks.workunit.client.1.smithi125.stdout:2/984: fdatasync d1/d36/d70/f12a 0 2024-02-19T19:12:32.623 INFO:tasks.workunit.client.1.smithi125.stdout:4/935: fdatasync d0/df/dda/f116 0 2024-02-19T19:12:32.623 INFO:tasks.workunit.client.1.smithi125.stdout:2/985: mkdir d1/d27/d45/d130 0 2024-02-19T19:12:32.623 INFO:tasks.workunit.client.1.smithi125.stdout:2/986: chown d1/d27/d1d/d25/da0/f120 198668628 1 2024-02-19T19:12:32.623 INFO:tasks.workunit.client.1.smithi125.stdout:4/936: write d0/d7/d3b/d75/de3/dcd/f111 [203950,78345] 0 2024-02-19T19:12:32.624 INFO:tasks.workunit.client.1.smithi125.stdout:2/987: creat d1/d36/dc0/def/f131 x:0 0 0 2024-02-19T19:12:32.624 INFO:tasks.workunit.client.1.smithi125.stdout:7/979: fdatasync d12/d18/d44/d3b/d59/d26/f87 0 2024-02-19T19:12:32.628 INFO:tasks.workunit.client.1.smithi125.stdout:7/980: dwrite d12/d18/d44/d3b/d59/d2a/d31/d50/d60/f6e [528384,8192] 0 2024-02-19T19:12:32.628 INFO:tasks.workunit.client.1.smithi125.stdout:4/937: rename d0/d32/d60/d102/f2d to d0/d32/d60/d102/d132/d5d/d125/f135 0 2024-02-19T19:12:32.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:32 smithi125 ceph-mon[86115]: pgmap v161: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:12:32.720 INFO:tasks.workunit.client.1.smithi125.stdout:4/938: fdatasync d0/df/f23 0 2024-02-19T19:12:32.721 INFO:tasks.workunit.client.1.smithi125.stdout:2/988: fsync d1/d27/d1d/d2c/d2e/fb2 0 2024-02-19T19:12:32.744 INFO:tasks.workunit.client.1.smithi125.stdout:4/939: fdatasync d0/df/d5e/fb4 0 2024-02-19T19:12:32.747 INFO:tasks.workunit.client.1.smithi125.stdout:3/902: dread d0/d1/d87/d107/f113 [1564672,57344] 0 2024-02-19T19:12:32.747 INFO:tasks.workunit.client.1.smithi125.stdout:4/940: creat d0/d32/d60/d102/d132/d42/db3/ddf/dea/f136 x:0 0 0 2024-02-19T19:12:32.747 INFO:tasks.workunit.client.1.smithi125.stdout:3/903: write d0/d95/d9c/dba/fc5 [1307487,15463] 0 2024-02-19T19:12:32.747 INFO:tasks.workunit.client.1.smithi125.stdout:4/941: chown d0/d7/d3b/d77/d10b 106884485 1 2024-02-19T19:12:32.748 INFO:tasks.workunit.client.1.smithi125.stdout:2/989: symlink d1/d36/dc0/def/df5/l132 0 2024-02-19T19:12:32.748 INFO:tasks.workunit.client.1.smithi125.stdout:7/981: dwrite d12/d18/d2c/f116 [770048,77824] 0 2024-02-19T19:12:32.748 INFO:tasks.workunit.client.1.smithi125.stdout:2/990: readlink d1/l28 0 2024-02-19T19:12:32.748 INFO:tasks.workunit.client.1.smithi125.stdout:0/998: sync 2024-02-19T19:12:32.748 INFO:tasks.workunit.client.1.smithi125.stdout:4/942: creat d0/d7/d3b/d75/de3/dcd/d106/f137 x:0 0 0 2024-02-19T19:12:32.748 INFO:tasks.workunit.client.1.smithi125.stdout:4/943: read d0/d7/d3b/f8e [130119,42533] 0 2024-02-19T19:12:32.748 INFO:tasks.workunit.client.1.smithi125.stdout:2/991: chown d1/d27/d1d/da8/c10a 1 1 2024-02-19T19:12:32.748 INFO:tasks.workunit.client.1.smithi125.stdout:2/992: truncate d1/d27/f33 246458 0 2024-02-19T19:12:32.749 INFO:tasks.workunit.client.1.smithi125.stdout:2/993: truncate d1/d36/ff1 21461 0 2024-02-19T19:12:32.749 INFO:tasks.workunit.client.1.smithi125.stdout:3/904: write d0/d1/d4b/d52/d81/dd0/fdd [1107707,42073] 0 2024-02-19T19:12:32.749 INFO:tasks.workunit.client.1.smithi125.stdout:2/994: symlink d1/d36/d70/d4b/l133 0 2024-02-19T19:12:32.749 INFO:tasks.workunit.client.1.smithi125.stdout:2/995: truncate d1/d27/d1d/da8/d7b/d91/faf 816200 0 2024-02-19T19:12:32.783 INFO:tasks.workunit.client.1.smithi125.stdout:2/996: dwrite d1/d27/d45/d7a/f95 [2035712,94208] 0 2024-02-19T19:12:32.784 INFO:tasks.workunit.client.1.smithi125.stdout:0/999: dwrite d5/d33/d46/de6/f11f [901120,12288] 0 2024-02-19T19:12:32.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:32 smithi096 ceph-mon[112483]: pgmap v161: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:12:32.843 INFO:tasks.workunit.client.1.smithi125.stdout:4/944: fdatasync d0/d32/fa1 0 2024-02-19T19:12:32.844 INFO:tasks.workunit.client.1.smithi125.stdout:3/905: fdatasync d0/d1/d1e/d60/f85 0 2024-02-19T19:12:32.844 INFO:tasks.workunit.client.1.smithi125.stdout:4/945: mknod d0/d7/dd3/c138 0 2024-02-19T19:12:32.844 INFO:tasks.workunit.client.1.smithi125.stdout:3/906: mknod d0/d1/d1e/d60/da5/c127 0 2024-02-19T19:12:32.844 INFO:tasks.workunit.client.1.smithi125.stdout:3/907: creat d0/d1/d1e/de8/f128 x:0 0 0 2024-02-19T19:12:32.844 INFO:tasks.workunit.client.1.smithi125.stdout:3/908: write d0/d1/d4b/d52/d81/f92 [2119278,71982] 0 2024-02-19T19:12:32.849 INFO:tasks.workunit.client.1.smithi125.stdout:2/997: dwrite d1/d27/d1d/d39/f7e [401408,102400] 0 2024-02-19T19:12:32.849 INFO:tasks.workunit.client.1.smithi125.stdout:3/909: mkdir d0/d1/d87/d107/d129 0 2024-02-19T19:12:32.849 INFO:tasks.workunit.client.1.smithi125.stdout:3/910: write d0/d1/d4b/d52/d81/f86 [1563420,65267] 0 2024-02-19T19:12:32.849 INFO:tasks.workunit.client.1.smithi125.stdout:3/911: rename d0/d1/d1e/d60/d73/d74/d82/d10c to d0/d1/d1e/d60/d6a/ddb/d12a 0 2024-02-19T19:12:32.932 INFO:tasks.workunit.client.1.smithi125.stdout:3/912: dwrite d0/d1/d1e/d60/de2/d103/f120 [323584,36864] 0 2024-02-19T19:12:32.932 INFO:tasks.workunit.client.1.smithi125.stdout:3/913: creat d0/d1/d1e/d60/d73/d112/d71/f12b x:0 0 0 2024-02-19T19:12:32.932 INFO:tasks.workunit.client.1.smithi125.stdout:3/914: truncate d0/d1/f4d 2609875 0 2024-02-19T19:12:32.969 INFO:tasks.workunit.client.1.smithi125.stdout:3/915: fdatasync d0/d1/d39/f8b 0 2024-02-19T19:12:32.977 INFO:tasks.workunit.client.1.smithi125.stdout:3/916: rename d0/d1/d4b/d52/d81/db7/d101/fd8 to d0/de/f12c 0 2024-02-19T19:12:32.977 INFO:tasks.workunit.client.1.smithi125.stdout:3/917: read - d0/d1/d1e/d60/de2/f118 zero size 2024-02-19T19:12:32.977 INFO:tasks.workunit.client.1.smithi125.stdout:3/918: stat d0/c4e 0 2024-02-19T19:12:32.977 INFO:tasks.workunit.client.1.smithi125.stdout:3/919: truncate d0/d1/d4b/d52/f5e 584518 0 2024-02-19T19:12:32.977 INFO:tasks.workunit.client.1.smithi125.stdout:3/920: dread d0/de/f44 [1855488,102400] 0 2024-02-19T19:12:32.977 INFO:tasks.workunit.client.1.smithi125.stdout:3/921: readlink d0/d1/d4b/d52/d81/lf3 0 2024-02-19T19:12:32.978 INFO:tasks.workunit.client.1.smithi125.stdout:3/922: creat d0/d1/d1e/d69/f12d x:0 0 0 2024-02-19T19:12:32.978 INFO:tasks.workunit.client.1.smithi125.stdout:3/923: getdents d0/d1/d1e/d60 0 2024-02-19T19:12:32.978 INFO:tasks.workunit.client.1.smithi125.stdout:3/924: chown d0/d1/d4b/d52/f59 8 1 2024-02-19T19:12:32.978 INFO:tasks.workunit.client.1.smithi125.stdout:3/925: write d0/d1/d1e/d60/d73/d112/d71/f12b [380914,89021] 0 2024-02-19T19:12:32.978 INFO:tasks.workunit.client.1.smithi125.stdout:3/926: symlink d0/d1/d4b/d52/d81/dd0/l12e 0 2024-02-19T19:12:32.978 INFO:tasks.workunit.client.1.smithi125.stdout:3/927: creat d0/d1/d1e/d60/d6a/d111/f12f x:0 0 0 2024-02-19T19:12:32.978 INFO:tasks.workunit.client.1.smithi125.stdout:3/928: creat d0/d95/d9c/daf/f130 x:0 0 0 2024-02-19T19:12:32.978 INFO:tasks.workunit.client.1.smithi125.stdout:3/929: creat d0/d1/d87/f131 x:0 0 0 2024-02-19T19:12:32.979 INFO:tasks.workunit.client.1.smithi125.stdout:3/930: link d0/d1/d1e/db0/lee d0/d1/d4b/db2/l132 0 2024-02-19T19:12:32.979 INFO:tasks.workunit.client.1.smithi125.stdout:3/931: read d0/d1/d1e/f1f [2510754,20766] 0 2024-02-19T19:12:32.979 INFO:tasks.workunit.client.1.smithi125.stdout:3/932: creat d0/d95/f133 x:0 0 0 2024-02-19T19:12:32.979 INFO:tasks.workunit.client.1.smithi125.stdout:3/933: dread d0/d1/d39/f49 [155648,126976] 0 2024-02-19T19:12:32.979 INFO:tasks.workunit.client.1.smithi125.stdout:3/934: dread d0/d1/d4b/d52/d81/dd0/ff2 [139264,8192] 0 2024-02-19T19:12:32.979 INFO:tasks.workunit.client.1.smithi125.stdout:3/935: dread d0/f24 [1503232,36864] 0 2024-02-19T19:12:33.047 INFO:tasks.workunit.client.1.smithi125.stdout:3/936: dwrite d0/d95/d9c/fb9 [901120,106496] 0 2024-02-19T19:12:33.047 INFO:tasks.workunit.client.1.smithi125.stdout:3/937: readlink d0/d1/d4b/d52/l9f 0 2024-02-19T19:12:33.047 INFO:tasks.workunit.client.1.smithi125.stdout:3/938: mknod d0/d95/d9c/dbf/de0/c134 0 2024-02-19T19:12:33.059 INFO:tasks.workunit.client.1.smithi125.stdout:3/939: truncate d0/d1/d1e/d60/d73/d74/d82/f89 892619 0 2024-02-19T19:12:33.059 INFO:tasks.workunit.client.1.smithi125.stdout:3/940: creat d0/d1/d87/f135 x:0 0 0 2024-02-19T19:12:33.059 INFO:tasks.workunit.client.1.smithi125.stdout:3/941: readlink d0/l47 0 2024-02-19T19:12:33.060 INFO:tasks.workunit.client.1.smithi125.stdout:3/942: symlink d0/d1/d1e/d60/de2/d103/l136 0 2024-02-19T19:12:33.060 INFO:tasks.workunit.client.1.smithi125.stdout:3/943: rename d0/d1/d1e/d60/d73/d112/d71/f7f to d0/d1/d4b/d52/d81/dd0/f137 0 2024-02-19T19:12:33.137 INFO:tasks.workunit.client.1.smithi125.stdout:8/927: sync 2024-02-19T19:12:33.138 INFO:tasks.workunit.client.1.smithi125.stdout:8/928: truncate db/d18/d30/dd2/fee 447913 0 2024-02-19T19:12:33.138 INFO:tasks.workunit.client.1.smithi125.stdout:8/929: write db/d18/f62 [1446436,101502] 0 2024-02-19T19:12:33.138 INFO:tasks.workunit.client.1.smithi125.stdout:8/930: symlink db/d18/d30/d3c/d4d/d5d/d6f/l126 0 2024-02-19T19:12:33.138 INFO:tasks.workunit.client.1.smithi125.stdout:8/931: symlink db/d18/d30/d80/d9e/da3/l127 0 2024-02-19T19:12:33.138 INFO:tasks.workunit.client.1.smithi125.stdout:8/932: truncate db/d18/d30/d80/d9e/fb3 881030 0 2024-02-19T19:12:33.138 INFO:tasks.workunit.client.1.smithi125.stdout:8/933: rename db/d18/d30/d3c/d4d/d5d/d6f to db/d18/d30/d80/d9e/da3/d128 0 2024-02-19T19:12:33.138 INFO:tasks.workunit.client.1.smithi125.stdout:8/934: mknod db/d18/d2f/d99/d122/c129 0 2024-02-19T19:12:33.140 INFO:tasks.workunit.client.1.smithi125.stdout:8/935: dwrite db/d18/d30/d80/d9e/d11f/d104/d96/fe5 [937984,36864] 0 2024-02-19T19:12:33.142 INFO:tasks.workunit.client.1.smithi125.stdout:8/936: symlink db/d18/d30/d3c/l12a 0 2024-02-19T19:12:33.143 INFO:tasks.workunit.client.1.smithi125.stdout:4/946: sync 2024-02-19T19:12:33.143 INFO:tasks.workunit.client.1.smithi125.stdout:7/982: sync 2024-02-19T19:12:33.143 INFO:tasks.workunit.client.1.smithi125.stdout:4/947: write d0/d7/d76/dd1/fd6 [1361138,71068] 0 2024-02-19T19:12:33.143 INFO:tasks.workunit.client.1.smithi125.stdout:4/948: chown d0/d32/d60/d102/d132/c31 1 1 2024-02-19T19:12:33.143 INFO:tasks.workunit.client.1.smithi125.stdout:4/949: chown d0/d7/dad/db9/d112 36 1 2024-02-19T19:12:33.144 INFO:tasks.workunit.client.1.smithi125.stdout:8/937: dwrite db/d18/d30/d48/f57 [1257472,90112] 0 2024-02-19T19:12:33.144 INFO:tasks.workunit.client.1.smithi125.stdout:8/938: chown db/d18/d30/d80/dac 198244363 1 2024-02-19T19:12:33.149 INFO:tasks.workunit.client.1.smithi125.stdout:3/944: dread d0/d1/f56 [405504,36864] 0 2024-02-19T19:12:33.149 INFO:tasks.workunit.client.1.smithi125.stdout:3/945: chown d0/de 732315 1 2024-02-19T19:12:33.149 INFO:tasks.workunit.client.1.smithi125.stdout:3/946: stat d0/de/c45 0 2024-02-19T19:12:33.256 INFO:tasks.workunit.client.1.smithi125.stdout:7/983: fsync d12/d18/d2c/f42 0 2024-02-19T19:12:33.257 INFO:tasks.workunit.client.1.smithi125.stdout:7/984: chown d12/d18/d44/d3b/d59/d2a/d6a/d6d/d126/d97/db1 919 1 2024-02-19T19:12:33.257 INFO:tasks.workunit.client.1.smithi125.stdout:7/985: read d12/d18/d2c/db5/f83 [332524,121192] 0 2024-02-19T19:12:33.258 INFO:tasks.workunit.client.1.smithi125.stdout:8/939: link db/d18/d2f/f39 db/d18/d2f/d99/d122/f12b 0 2024-02-19T19:12:33.258 INFO:tasks.workunit.client.1.smithi125.stdout:3/947: creat d0/d1/d87/d107/dcd/f138 x:0 0 0 2024-02-19T19:12:33.259 INFO:tasks.workunit.client.1.smithi125.stdout:3/948: creat d0/d1/d87/d107/f139 x:0 0 0 2024-02-19T19:12:33.259 INFO:tasks.workunit.client.1.smithi125.stdout:3/949: read - d0/d1/d1e/d69/fcf zero size 2024-02-19T19:12:33.259 INFO:tasks.workunit.client.1.smithi125.stdout:3/950: creat d0/d95/f13a x:0 0 0 2024-02-19T19:12:33.259 INFO:tasks.workunit.client.1.smithi125.stdout:3/951: write d0/d1/d1e/d60/d73/d112/f121 [1008832,121239] 0 2024-02-19T19:12:33.287 INFO:tasks.workunit.client.1.smithi125.stdout:7/986: fsync d12/d18/d2c/f76 0 2024-02-19T19:12:33.288 INFO:tasks.workunit.client.1.smithi125.stdout:7/987: mknod d12/d18/d44/d3b/d59/d2a/d6a/d6d/d126/d37/dc1/d121/c12e 0 2024-02-19T19:12:33.288 INFO:tasks.workunit.client.1.smithi125.stdout:7/988: getdents d12/d18/d44/d3b/d59/d2a/d6a/d6d/d126/dad 0 2024-02-19T19:12:33.288 INFO:tasks.workunit.client.1.smithi125.stdout:7/989: creat d12/d18/d44/d3b/d59/d2a/d6a/dab/f12f x:0 0 0 2024-02-19T19:12:33.288 INFO:tasks.workunit.client.1.smithi125.stdout:7/990: write d12/d18/d44/d3b/d59/d2a/d6a/f9e [897081,124547] 0 2024-02-19T19:12:33.288 INFO:tasks.workunit.client.1.smithi125.stdout:7/991: write d12/d18/d44/d3b/d59/d2a/d31/d50/d60/f6e [1121746,2751] 0 2024-02-19T19:12:33.289 INFO:tasks.workunit.client.1.smithi125.stdout:7/992: dwrite d12/d18/d44/d3b/d59/d2a/d6a/d6d/f7f [118784,114688] 0 2024-02-19T19:12:33.290 INFO:tasks.workunit.client.1.smithi125.stdout:7/993: chown d12/d18/d44/l11d 17 1 2024-02-19T19:12:33.290 INFO:tasks.workunit.client.1.smithi125.stdout:7/994: creat d12/d18/d66/f130 x:0 0 0 2024-02-19T19:12:33.333 INFO:tasks.workunit.client.1.smithi125.stdout:7/995: fdatasync d12/d18/d44/d51/f123 0 2024-02-19T19:12:33.336 INFO:tasks.workunit.client.1.smithi125.stdout:7/996: truncate d12/d18/d44/d3b/d59/d26/f28 473623 0 2024-02-19T19:12:33.337 INFO:tasks.workunit.client.1.smithi125.stdout:7/997: creat d12/d18/d44/d3b/d59/d2a/d6a/d6d/d126/d97/d101/f131 x:0 0 0 2024-02-19T19:12:33.337 INFO:tasks.workunit.client.1.smithi125.stdout:7/998: mknod d12/d18/d2c/d4e/d82/c132 0 2024-02-19T19:12:33.337 INFO:tasks.workunit.client.1.smithi125.stdout:7/999: unlink d12/d18/dbe/de4/lfc 0 2024-02-19T19:12:33.495 INFO:tasks.workunit.client.1.smithi125.stdout:2/998: sync 2024-02-19T19:12:33.495 INFO:tasks.workunit.client.1.smithi125.stdout:2/999: dread d1/d27/d1d/d25/f38 [1634304,28672] 0 2024-02-19T19:12:33.500 INFO:tasks.workunit.client.1.smithi125.stdout:4/950: sync 2024-02-19T19:12:33.500 INFO:tasks.workunit.client.1.smithi125.stdout:8/940: sync 2024-02-19T19:12:33.500 INFO:tasks.workunit.client.1.smithi125.stdout:3/952: sync 2024-02-19T19:12:33.500 INFO:tasks.workunit.client.1.smithi125.stdout:4/951: getdents d0/d7/d3b/d77/d120/d12e 0 2024-02-19T19:12:33.501 INFO:tasks.workunit.client.1.smithi125.stdout:8/941: dread db/f46 [692224,81920] 0 2024-02-19T19:12:33.501 INFO:tasks.workunit.client.1.smithi125.stdout:3/953: creat d0/d1/d1e/d60/da5/f13b x:0 0 0 2024-02-19T19:12:33.501 INFO:tasks.workunit.client.1.smithi125.stdout:4/952: mknod d0/d32/d60/d102/d132/d42/db3/c139 0 2024-02-19T19:12:33.501 INFO:tasks.workunit.client.1.smithi125.stdout:3/954: dread d0/d1/f65 [249856,12288] 0 2024-02-19T19:12:33.501 INFO:tasks.workunit.client.1.smithi125.stdout:8/942: unlink db/d18/d30/d3c/ld0 0 2024-02-19T19:12:33.501 INFO:tasks.workunit.client.1.smithi125.stdout:3/955: creat d0/d1/d4b/d52/d81/dd0/f13c x:0 0 0 2024-02-19T19:12:33.501 INFO:tasks.workunit.client.1.smithi125.stdout:8/943: mknod db/d18/d30/d80/d9e/c12c 0 2024-02-19T19:12:33.501 INFO:tasks.workunit.client.1.smithi125.stdout:8/944: readlink db/d18/lb7 0 2024-02-19T19:12:33.502 INFO:tasks.workunit.client.1.smithi125.stdout:3/956: mkdir d0/d1/d87/d107/d10a/d13d 0 2024-02-19T19:12:33.592 INFO:tasks.workunit.client.1.smithi125.stdout:4/953: dwrite d0/d32/d60/d102/d132/d42/db3/fff [315392,40960] 0 2024-02-19T19:12:33.592 INFO:tasks.workunit.client.1.smithi125.stdout:4/954: mknod d0/d32/d60/d102/d132/d42/db3/ddf/dea/c13a 0 2024-02-19T19:12:33.592 INFO:tasks.workunit.client.1.smithi125.stdout:4/955: symlink d0/d32/d60/d102/d132/d5d/l13b 0 2024-02-19T19:12:33.593 INFO:tasks.workunit.client.1.smithi125.stdout:4/956: dread d0/d32/d60/d102/d132/d5d/f64 [1540096,65536] 0 2024-02-19T19:12:33.593 INFO:tasks.workunit.client.1.smithi125.stdout:4/957: dread d0/d7/f2f [507904,81920] 0 2024-02-19T19:12:33.593 INFO:tasks.workunit.client.1.smithi125.stdout:4/958: dread - d0/d7/d3b/d75/de3/dcd/d106/f109 zero size 2024-02-19T19:12:33.593 INFO:tasks.workunit.client.1.smithi125.stdout:3/957: dwrite d0/de/f44 [421888,57344] 0 2024-02-19T19:12:33.593 INFO:tasks.workunit.client.1.smithi125.stdout:3/958: read d0/d1/d39/f84 [706520,14046] 0 2024-02-19T19:12:33.593 INFO:tasks.workunit.client.1.smithi125.stdout:8/945: dwrite db/d81/fc0 [1163264,94208] 0 2024-02-19T19:12:33.593 INFO:tasks.workunit.client.1.smithi125.stdout:4/959: dwrite d0/df/f33 [499712,102400] 0 2024-02-19T19:12:33.618 INFO:tasks.workunit.client.1.smithi125.stdout:8/946: fsync db/d18/d30/d80/d9e/da3/fb6 0 2024-02-19T19:12:33.618 INFO:tasks.workunit.client.1.smithi125.stdout:3/959: fdatasync d0/d1/d87/d107/f113 0 2024-02-19T19:12:33.618 INFO:tasks.workunit.client.1.smithi125.stdout:8/947: symlink db/d18/d30/dd2/l12d 0 2024-02-19T19:12:33.618 INFO:tasks.workunit.client.1.smithi125.stdout:3/960: creat d0/d95/d9c/daf/ddf/f13e x:0 0 0 2024-02-19T19:12:33.622 INFO:tasks.workunit.client.1.smithi125.stdout:3/961: dwrite d0/d1/d87/d107/f104 [262144,98304] 0 2024-02-19T19:12:33.622 INFO:tasks.workunit.client.1.smithi125.stdout:3/962: write d0/d1/d1e/d60/d73/d112/f121 [624412,95979] 0 2024-02-19T19:12:33.622 INFO:tasks.workunit.client.1.smithi125.stdout:3/963: mknod d0/d1/d4b/db2/c13f 0 2024-02-19T19:12:33.622 INFO:tasks.workunit.client.1.smithi125.stdout:3/964: rmdir d0/d1/d1e/d60/de2/d109 0 2024-02-19T19:12:33.622 INFO:tasks.workunit.client.1.smithi125.stdout:3/965: chown d0/d1/d1e/d60/de2 516 1 2024-02-19T19:12:33.622 INFO:tasks.workunit.client.1.smithi125.stdout:3/966: creat d0/d1/d1e/d60/d6a/ddb/d12a/f140 x:0 0 0 2024-02-19T19:12:33.622 INFO:tasks.workunit.client.1.smithi125.stdout:3/967: unlink d0/d95/fab 0 2024-02-19T19:12:33.623 INFO:tasks.workunit.client.1.smithi125.stdout:3/968: symlink d0/d1/d1e/d69/l141 0 2024-02-19T19:12:33.628 INFO:tasks.workunit.client.1.smithi125.stdout:4/960: dread d0/d7/fd2 [147456,57344] 0 2024-02-19T19:12:33.629 INFO:tasks.workunit.client.1.smithi125.stdout:4/961: symlink d0/d7/dad/dbe/l13c 0 2024-02-19T19:12:33.629 INFO:tasks.workunit.client.1.smithi125.stdout:4/962: truncate d0/d7/d76/dd1/fd4 591669 0 2024-02-19T19:12:33.629 INFO:tasks.workunit.client.1.smithi125.stdout:4/963: unlink d0/f2e 0 2024-02-19T19:12:33.629 INFO:tasks.workunit.client.1.smithi125.stdout:4/964: mknod d0/d7/d3b/d77/d120/d12e/c13d 0 2024-02-19T19:12:33.629 INFO:tasks.workunit.client.1.smithi125.stdout:4/965: chown d0/d32/d60/d102/d132/d42/caf 779748684 1 2024-02-19T19:12:33.629 INFO:tasks.workunit.client.1.smithi125.stdout:4/966: getdents d0/d32/d60/d102/d132/d42/db3/ddf/dea 0 2024-02-19T19:12:33.629 INFO:tasks.workunit.client.1.smithi125.stdout:4/967: mknod d0/d7/d3b/d75/c13e 0 2024-02-19T19:12:33.630 INFO:tasks.workunit.client.1.smithi125.stdout:4/968: dread d0/d32/f8b [393216,24576] 0 2024-02-19T19:12:33.630 INFO:tasks.workunit.client.1.smithi125.stdout:4/969: mkdir d0/d32/d60/d13f 0 2024-02-19T19:12:33.630 INFO:tasks.workunit.client.1.smithi125.stdout:4/970: unlink d0/d7/d3b/l92 0 2024-02-19T19:12:33.630 INFO:tasks.workunit.client.1.smithi125.stdout:4/971: write d0/d32/d60/d102/f87 [574838,11719] 0 2024-02-19T19:12:33.691 INFO:tasks.workunit.client.1.smithi125.stdout:3/969: fdatasync d0/d95/fa7 0 2024-02-19T19:12:33.691 INFO:tasks.workunit.client.1.smithi125.stdout:3/970: unlink d0/d1/d1e/d60/d6a/ddb/d12a/f122 0 2024-02-19T19:12:33.691 INFO:tasks.workunit.client.1.smithi125.stdout:3/971: write d0/d1/d87/f131 [541188,61411] 0 2024-02-19T19:12:33.691 INFO:tasks.workunit.client.1.smithi125.stdout:3/972: getdents d0/d1/d1e/d60/da5 0 2024-02-19T19:12:33.692 INFO:tasks.workunit.client.1.smithi125.stdout:4/972: dwrite d0/d7/d3b/f62 [540672,4096] 0 2024-02-19T19:12:33.692 INFO:tasks.workunit.client.1.smithi125.stdout:4/973: readlink d0/d32/d60/d102/d132/l113 0 2024-02-19T19:12:33.692 INFO:tasks.workunit.client.1.smithi125.stdout:4/974: creat d0/d7/dad/db9/f140 x:0 0 0 2024-02-19T19:12:33.734 INFO:tasks.workunit.client.1.smithi125.stdout:4/975: fsync d0/d7/d85/f117 0 2024-02-19T19:12:33.738 INFO:tasks.workunit.client.1.smithi125.stdout:4/976: creat d0/d7/dad/f141 x:0 0 0 2024-02-19T19:12:33.738 INFO:tasks.workunit.client.1.smithi125.stdout:4/977: unlink d0/d7/d3b/d75/c119 0 2024-02-19T19:12:33.739 INFO:tasks.workunit.client.1.smithi125.stdout:4/978: chown d0/d32/d60/d102/dac/cee 1122049740 1 2024-02-19T19:12:33.782 INFO:tasks.workunit.client.1.smithi125.stdout:8/948: sync 2024-02-19T19:12:33.782 INFO:tasks.workunit.client.1.smithi125.stdout:8/949: mknod db/d81/dde/c12e 0 2024-02-19T19:12:33.782 INFO:tasks.workunit.client.1.smithi125.stdout:8/950: write db/d18/d30/d80/fa4 [1290864,83462] 0 2024-02-19T19:12:33.790 INFO:tasks.workunit.client.1.smithi125.stdout:4/979: dread d0/d32/f36 [655360,110592] 0 2024-02-19T19:12:33.790 INFO:tasks.workunit.client.1.smithi125.stdout:4/980: truncate d0/d32/d60/d102/fd 1325579 0 2024-02-19T19:12:33.790 INFO:tasks.workunit.client.1.smithi125.stdout:4/981: write d0/d32/d60/d102/f104 [571275,71031] 0 2024-02-19T19:12:33.790 INFO:tasks.workunit.client.1.smithi125.stdout:4/982: getdents d0/d7/d3b/d75/de3/dcd/dde 0 2024-02-19T19:12:33.790 INFO:tasks.workunit.client.1.smithi125.stdout:4/983: unlink d0/d7/d3b/d75/de3/dcd/f111 0 2024-02-19T19:12:33.790 INFO:tasks.workunit.client.1.smithi125.stdout:4/984: write d0/d32/d60/d102/fd [1263397,3318] 0 2024-02-19T19:12:33.791 INFO:tasks.workunit.client.1.smithi125.stdout:4/985: chown d0/d7/d85 28864958 1 2024-02-19T19:12:33.829 INFO:tasks.workunit.client.1.smithi125.stdout:8/951: dwrite db/d18/d30/d80/d9e/fb3 [163840,110592] 0 2024-02-19T19:12:33.829 INFO:tasks.workunit.client.1.smithi125.stdout:4/986: dwrite d0/d7/d76/faa [974848,106496] 0 2024-02-19T19:12:33.829 INFO:tasks.workunit.client.1.smithi125.stdout:8/952: unlink db/d18/d30/d48/f57 0 2024-02-19T19:12:33.829 INFO:tasks.workunit.client.1.smithi125.stdout:8/953: rename db/d18/d30/d80/d9e/f106 to db/d18/d30/f12f 0 2024-02-19T19:12:33.830 INFO:tasks.workunit.client.1.smithi125.stdout:3/973: sync 2024-02-19T19:12:33.830 INFO:tasks.workunit.client.1.smithi125.stdout:3/974: dread - d0/d1/d1e/de8/f128 zero size 2024-02-19T19:12:33.830 INFO:tasks.workunit.client.1.smithi125.stdout:3/975: write d0/d1/d4b/d52/d81/db7/d101/fdc [804362,59892] 0 2024-02-19T19:12:33.831 INFO:tasks.workunit.client.1.smithi125.stdout:3/976: link d0/d1/d1e/fa8 d0/d1/d87/d107/f142 0 2024-02-19T19:12:33.831 INFO:tasks.workunit.client.1.smithi125.stdout:3/977: mknod d0/d1/d1e/d60/de2/d103/c143 0 2024-02-19T19:12:33.931 INFO:tasks.workunit.client.1.smithi125.stdout:8/954: dwrite db/d18/d30/d80/dac/fe8 [24576,81920] 0 2024-02-19T19:12:33.931 INFO:tasks.workunit.client.1.smithi125.stdout:8/955: write db/d18/f62 [1032646,122228] 0 2024-02-19T19:12:33.931 INFO:tasks.workunit.client.1.smithi125.stdout:8/956: rmdir db/d18/d2f/d99 39 2024-02-19T19:12:33.931 INFO:tasks.workunit.client.1.smithi125.stdout:8/957: creat db/d18/d30/f130 x:0 0 0 2024-02-19T19:12:33.931 INFO:tasks.workunit.client.1.smithi125.stdout:8/958: rename db/c34 to db/d18/d30/d80/d9e/c131 0 2024-02-19T19:12:33.931 INFO:tasks.workunit.client.1.smithi125.stdout:4/987: dwrite d0/d32/d60/d102/f9 [872448,98304] 0 2024-02-19T19:12:33.931 INFO:tasks.workunit.client.1.smithi125.stdout:4/988: creat d0/d7/d3b/d75/de3/dcd/d106/f142 x:0 0 0 2024-02-19T19:12:33.932 INFO:tasks.workunit.client.1.smithi125.stdout:4/989: creat d0/d7/d85/f143 x:0 0 0 2024-02-19T19:12:33.932 INFO:tasks.workunit.client.1.smithi125.stdout:4/990: rmdir d0/d7/dad/db9 39 2024-02-19T19:12:33.932 INFO:tasks.workunit.client.1.smithi125.stdout:4/991: symlink d0/d7/dad/l144 0 2024-02-19T19:12:33.932 INFO:tasks.workunit.client.1.smithi125.stdout:3/978: dwrite d0/d1/d4b/d52/f5e [733184,77824] 0 2024-02-19T19:12:33.952 INFO:tasks.workunit.client.1.smithi125.stdout:8/959: fsync db/d18/d2f/d72/df9/f10c 0 2024-02-19T19:12:33.953 INFO:tasks.workunit.client.1.smithi125.stdout:8/960: mkdir db/d18/d30/d80/d9e/d132 0 2024-02-19T19:12:33.953 INFO:tasks.workunit.client.1.smithi125.stdout:8/961: dread db/d18/d30/dd2/fee [167936,102400] 0 2024-02-19T19:12:33.953 INFO:tasks.workunit.client.1.smithi125.stdout:8/962: stat db/d18/d30/d80/d9e/d11f/d104/d96/f11e 0 2024-02-19T19:12:33.953 INFO:tasks.workunit.client.1.smithi125.stdout:8/963: write db/d18/d30/d80/d9e/d11f/d104/ff0 [662535,68775] 0 2024-02-19T19:12:33.953 INFO:tasks.workunit.client.1.smithi125.stdout:8/964: dread - db/d18/d30/f130 zero size 2024-02-19T19:12:33.953 INFO:tasks.workunit.client.1.smithi125.stdout:8/965: mknod db/d18/d30/d80/c133 0 2024-02-19T19:12:33.953 INFO:tasks.workunit.client.1.smithi125.stdout:8/966: dread db/d18/d30/d48/f7a [188416,36864] 0 2024-02-19T19:12:33.954 INFO:tasks.workunit.client.1.smithi125.stdout:8/967: write db/fdd [1763775,79437] 0 2024-02-19T19:12:33.954 INFO:tasks.workunit.client.1.smithi125.stdout:8/968: creat db/d18/d30/d3c/f134 x:0 0 0 2024-02-19T19:12:33.954 INFO:tasks.workunit.client.1.smithi125.stdout:8/969: creat db/d18/d30/d48/db9/def/d101/f135 x:0 0 0 2024-02-19T19:12:33.954 INFO:tasks.workunit.client.1.smithi125.stdout:8/970: stat db/l2e 0 2024-02-19T19:12:33.954 INFO:tasks.workunit.client.1.smithi125.stdout:8/971: symlink db/d18/d30/d48/d120/l136 0 2024-02-19T19:12:33.954 INFO:tasks.workunit.client.1.smithi125.stdout:8/972: chown db/d18/d30/d80/d9e/da3/fb6 521 1 2024-02-19T19:12:33.954 INFO:tasks.workunit.client.1.smithi125.stdout:4/992: dwrite d0/d7/d3b/d75/fe9 [483328,57344] 0 2024-02-19T19:12:33.954 INFO:tasks.workunit.client.1.smithi125.stdout:8/973: mknod db/d6d/c137 0 2024-02-19T19:12:33.954 INFO:tasks.workunit.client.1.smithi125.stdout:8/974: mknod db/d18/d30/d3c/c138 0 2024-02-19T19:12:33.955 INFO:tasks.workunit.client.1.smithi125.stdout:8/975: truncate db/d81/d95/f109 1085101 0 2024-02-19T19:12:33.955 INFO:tasks.workunit.client.1.smithi125.stdout:8/976: creat db/d18/f139 x:0 0 0 2024-02-19T19:12:33.955 INFO:tasks.workunit.client.1.smithi125.stdout:8/977: readlink db/d18/d30/dd2/l12d 0 2024-02-19T19:12:33.967 INFO:tasks.workunit.client.1.smithi125.stdout:4/993: fdatasync d0/d32/d60/f7e 0 2024-02-19T19:12:33.968 INFO:tasks.workunit.client.1.smithi125.stdout:4/994: dread d0/d7/d85/fa0 [188416,122880] 0 2024-02-19T19:12:33.968 INFO:tasks.workunit.client.1.smithi125.stdout:4/995: write d0/df/fa7 [1397773,83706] 0 2024-02-19T19:12:33.971 INFO:tasks.workunit.client.1.smithi125.stdout:3/979: dwrite d0/d1/d1e/db0/f124 [1249280,81920] 0 2024-02-19T19:12:33.971 INFO:tasks.workunit.client.1.smithi125.stdout:3/980: creat d0/d1/d87/d107/dcd/f144 x:0 0 0 2024-02-19T19:12:34.047 INFO:tasks.workunit.client.1.smithi125.stdout:3/981: dwrite d0/d1/d1e/d60/de2/d103/f120 [831488,16384] 0 2024-02-19T19:12:34.047 INFO:tasks.workunit.client.1.smithi125.stdout:3/982: mkdir d0/d1/d1e/d60/da5/d145 0 2024-02-19T19:12:34.047 INFO:tasks.workunit.client.1.smithi125.stdout:3/983: write d0/d1/d1e/d69/fad [400901,123347] 0 2024-02-19T19:12:34.067 INFO:tasks.workunit.client.1.smithi125.stdout:3/984: dwrite d0/d1/d1e/d60/d73/d74/d82/f9b [1130496,106496] 0 2024-02-19T19:12:34.096 INFO:tasks.workunit.client.1.smithi125.stdout:3/985: dwrite d0/d1/d1e/f5d [835584,69632] 0 2024-02-19T19:12:34.096 INFO:tasks.workunit.client.1.smithi125.stdout:3/986: dread - d0/d1/d1e/de8/f128 zero size 2024-02-19T19:12:34.096 INFO:tasks.workunit.client.1.smithi125.stdout:3/987: mkdir d0/d1/d1e/d60/de2/d102/d115/d146 0 2024-02-19T19:12:34.096 INFO:tasks.workunit.client.1.smithi125.stdout:3/988: read - d0/db1/f10d zero size 2024-02-19T19:12:34.096 INFO:tasks.workunit.client.1.smithi125.stdout:3/989: getdents d0/d95/d9c/daf/ddf 0 2024-02-19T19:12:34.242 INFO:tasks.workunit.client.1.smithi125.stdout:4/996: sync 2024-02-19T19:12:34.243 INFO:tasks.workunit.client.1.smithi125.stdout:8/978: sync 2024-02-19T19:12:34.243 INFO:tasks.workunit.client.1.smithi125.stdout:8/979: link db/d18/f27 db/d18/d30/d3c/d4d/f13a 0 2024-02-19T19:12:34.243 INFO:tasks.workunit.client.1.smithi125.stdout:8/980: symlink db/d81/d95/l13b 0 2024-02-19T19:12:34.243 INFO:tasks.workunit.client.1.smithi125.stdout:8/981: mknod db/d18/c13c 0 2024-02-19T19:12:34.310 INFO:tasks.workunit.client.1.smithi125.stdout:4/997: dwrite d0/d7/dad/fc8 [667648,61440] 0 2024-02-19T19:12:34.311 INFO:tasks.workunit.client.1.smithi125.stdout:8/982: dwrite db/d18/d30/d3c/d4d/f9f [1507328,86016] 0 2024-02-19T19:12:34.311 INFO:tasks.workunit.client.1.smithi125.stdout:8/983: rename db/c54 to db/d18/d30/d80/d9e/da3/d128/dea/c13d 0 2024-02-19T19:12:34.311 INFO:tasks.workunit.client.1.smithi125.stdout:4/998: write d0/d7/dad/db9/f140 [3731,45807] 0 2024-02-19T19:12:34.311 INFO:tasks.workunit.client.1.smithi125.stdout:4/999: dread - d0/d32/d60/d102/d132/d42/d7b/fb0 zero size 2024-02-19T19:12:34.331 INFO:tasks.workunit.client.1.smithi125.stdout:3/990: sync 2024-02-19T19:12:34.332 INFO:tasks.workunit.client.1.smithi125.stdout:8/984: dwrite db/d18/d30/d80/d9e/da3/fb6 [1527808,86016] 0 2024-02-19T19:12:34.332 INFO:tasks.workunit.client.1.smithi125.stdout:3/991: creat d0/de/f147 x:0 0 0 2024-02-19T19:12:34.364 INFO:tasks.workunit.client.1.smithi125.stdout:8/985: dwrite db/d6d/fd6 [1110016,4096] 0 2024-02-19T19:12:34.365 INFO:tasks.workunit.client.1.smithi125.stdout:3/992: dwrite d0/d1/d4b/fbb [925696,94208] 0 2024-02-19T19:12:34.365 INFO:tasks.workunit.client.1.smithi125.stdout:3/993: write d0/d95/d9c/daf/ddf/f13e [903162,5184] 0 2024-02-19T19:12:34.366 INFO:tasks.workunit.client.1.smithi125.stdout:3/994: truncate d0/d1/d1e/d60/da5/fd7 541089 0 2024-02-19T19:12:34.366 INFO:tasks.workunit.client.1.smithi125.stdout:3/995: getdents d0/d1/d87 0 2024-02-19T19:12:34.366 INFO:tasks.workunit.client.1.smithi125.stdout:8/986: dwrite db/d18/d30/d48/f5c [1437696,57344] 0 2024-02-19T19:12:34.366 INFO:tasks.workunit.client.1.smithi125.stdout:3/996: symlink d0/d1/d1e/d60/de2/d102/d115/d146/l148 0 2024-02-19T19:12:34.366 INFO:tasks.workunit.client.1.smithi125.stdout:3/997: rename d0/d1/d87/d107/dcd to d0/d95/d9c/dbf/de0/d149 0 2024-02-19T19:12:34.366 INFO:tasks.workunit.client.1.smithi125.stdout:3/998: symlink d0/d1/d4b/d52/l14a 0 2024-02-19T19:12:34.366 INFO:tasks.workunit.client.1.smithi125.stdout:8/987: write db/d18/d30/d80/d9e/da3/faa [1650262,98645] 0 2024-02-19T19:12:34.366 INFO:tasks.workunit.client.1.smithi125.stdout:3/999: write d0/d95/d9c/dba/fc6 [497687,4792] 0 2024-02-19T19:12:34.367 INFO:tasks.workunit.client.1.smithi125.stdout:8/988: write db/d81/d95/fb8 [28791,90014] 0 2024-02-19T19:12:34.367 INFO:tasks.workunit.client.1.smithi125.stdout:8/989: rename db/d18/d30/d3c/c138 to db/d81/d95/c13e 0 2024-02-19T19:12:34.381 INFO:tasks.workunit.client.1.smithi125.stdout:8/990: dwrite db/d18/d2f/d72/f87 [1949696,90112] 0 2024-02-19T19:12:34.402 INFO:tasks.workunit.client.1.smithi125.stdout:8/991: dwrite db/d81/d95/fb8 [622592,12288] 0 2024-02-19T19:12:34.403 INFO:tasks.workunit.client.1.smithi125.stdout:8/992: dwrite db/f46 [1060864,102400] 0 2024-02-19T19:12:34.403 INFO:tasks.workunit.client.1.smithi125.stdout:8/993: chown db/d18/d30/f130 2127188 1 2024-02-19T19:12:34.403 INFO:tasks.workunit.client.1.smithi125.stdout:8/994: readlink db/d18/d30/d48/db1/lc3 0 2024-02-19T19:12:34.403 INFO:tasks.workunit.client.1.smithi125.stdout:8/995: stat db/d18/d30/lf1 0 2024-02-19T19:12:34.404 INFO:tasks.workunit.client.1.smithi125.stdout:8/996: getdents db/d18/d2f/d72/df9/dfb 0 2024-02-19T19:12:34.423 INFO:tasks.workunit.client.1.smithi125.stdout:8/997: dwrite db/d18/d30/d80/d9e/da3/fc1 [3248128,28672] 0 2024-02-19T19:12:34.423 INFO:tasks.workunit.client.1.smithi125.stdout:8/998: symlink db/d18/d30/d3c/d4d/d5d/da2/l13f 0 2024-02-19T19:12:34.424 INFO:tasks.workunit.client.1.smithi125.stdout:8/999: dwrite db/f16 [241664,118784] 0 2024-02-19T19:12:34.426 INFO:tasks.workunit.client.1.smithi125.stderr:+ rm -rf -- ./tmp.b5cgBkzP6r 2024-02-19T19:12:34.467 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-19T19:12:34.467 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-02-19T19:12:34.605 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:34 smithi125 ceph-mon[86115]: pgmap v162: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:12:34.661 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-02-19T19:12:34.661 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-02-19T19:12:34.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:34 smithi096 ceph-mon[112483]: pgmap v162: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:12:35.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:12:35.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:12:36.030 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:35 smithi125 systemd[1]: Stopping Ceph osd.5 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T19:12:36.429 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:36 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[57512]: 2024-02-19T19:12:36.007+0000 7ff2cb811700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T19:12:36.429 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:36 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[57512]: 2024-02-19T19:12:36.007+0000 7ff2cb811700 -1 osd.5 74 *** Got signal Terminated *** 2024-02-19T19:12:36.429 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:36 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[57512]: 2024-02-19T19:12:36.007+0000 7ff2cb811700 -1 osd.5 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T19:12:36.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:36 smithi125 ceph-mon[86115]: pgmap v163: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:12:36.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:36 smithi125 ceph-mon[86115]: osd.5 marked itself down and dead 2024-02-19T19:12:36.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:36 smithi096 ceph-mon[112483]: pgmap v163: 65 pgs: 65 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:12:36.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:36 smithi096 ceph-mon[112483]: osd.5 marked itself down and dead 2024-02-19T19:12:37.113 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:36 smithi125 podman[105090]: 2024-02-19 19:12:36.743409819 +0000 UTC m=+0.834857964 container died e5731974b46aeccd6e8edf93b0a1db33be35c8b8fb83b83599daf026ef6820b7 (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=-18.2.1, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.29.1) 2024-02-19T19:12:37.431 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:37 smithi125 podman[105090]: 2024-02-19 19:12:37.091444961 +0000 UTC m=+1.182893097 container cleanup e5731974b46aeccd6e8edf93b0a1db33be35c8b8fb83b83599daf026ef6820b7 (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214) 2024-02-19T19:12:37.431 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:37 smithi125 bash[105090]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5 2024-02-19T19:12:37.431 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:37 smithi125 podman[105109]: 2024-02-19 19:12:37.292742992 +0000 UTC m=+0.544955022 container remove e5731974b46aeccd6e8edf93b0a1db33be35c8b8fb83b83599daf026ef6820b7 (image=quay.io/ceph/ceph@sha256:6176526d5ef4047f148d47c951653dcc6b0de49091fda006d3a088e7a1f404d0, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.license=GPLv2, ceph=True) 2024-02-19T19:12:37.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:37 smithi125 ceph-mon[86115]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:12:37.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:37 smithi125 ceph-mon[86115]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-02-19T19:12:37.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:37 smithi125 ceph-mon[86115]: osdmap e75: 6 total, 5 up, 6 in 2024-02-19T19:12:37.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:37 smithi096 ceph-mon[112483]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-19T19:12:37.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:37 smithi096 ceph-mon[112483]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-02-19T19:12:37.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:37 smithi096 ceph-mon[112483]: osdmap e75: 6 total, 5 up, 6 in 2024-02-19T19:12:38.080 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:37 smithi125 podman[105198]: 2024-02-19 19:12:37.613206063 +0000 UTC m=+0.018416319 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:12:38.083 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:37 smithi125 podman[105198]: 2024-02-19 19:12:37.718808465 +0000 UTC m=+0.124018716 container create eab5d56e53eadbebaae089e5011c144ed9835f9bfdee7a9587b9992535204dd5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-19T19:12:38.083 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:37 smithi125 podman[105198]: 2024-02-19 19:12:37.950825496 +0000 UTC m=+0.356035748 container init eab5d56e53eadbebaae089e5011c144ed9835f9bfdee7a9587b9992535204dd5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-19T19:12:38.083 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:37 smithi125 podman[105198]: 2024-02-19 19:12:37.95420521 +0000 UTC m=+0.359415462 container start eab5d56e53eadbebaae089e5011c144ed9835f9bfdee7a9587b9992535204dd5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-02-19T19:12:38.083 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:38 smithi125 podman[105198]: 2024-02-19 19:12:38.059098543 +0000 UTC m=+0.464308803 container attach eab5d56e53eadbebaae089e5011c144ed9835f9bfdee7a9587b9992535204dd5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-deactivate, org.label-schema.build-date=20240214, GIT_CLEAN=True, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-02-19T19:12:38.440 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:38 smithi125 podman[105198]: 2024-02-19 19:12:38.237866278 +0000 UTC m=+0.643076522 container died eab5d56e53eadbebaae089e5011c144ed9835f9bfdee7a9587b9992535204dd5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-deactivate, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-02-19T19:12:38.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:38 smithi125 ceph-mon[86115]: pgmap v165: 65 pgs: 13 stale+active+clean, 52 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:12:38.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:38 smithi125 ceph-mon[86115]: osdmap e76: 6 total, 5 up, 6 in 2024-02-19T19:12:38.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:38 smithi096 ceph-mon[112483]: pgmap v165: 65 pgs: 13 stale+active+clean, 52 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:12:38.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:38 smithi096 ceph-mon[112483]: osdmap e76: 6 total, 5 up, 6 in 2024-02-19T19:12:39.204 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:38 smithi125 podman[105224]: 2024-02-19 19:12:38.787786003 +0000 UTC m=+0.544670431 container remove eab5d56e53eadbebaae089e5011c144ed9835f9bfdee7a9587b9992535204dd5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-02-19T19:12:39.204 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:38 smithi125 systemd[1]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.5.service: Deactivated successfully. 2024-02-19T19:12:39.204 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:38 smithi125 systemd[1]: Stopped Ceph osd.5 for 06580d2c-cf58-11ee-95bb-87774f69a715. 2024-02-19T19:12:39.204 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:38 smithi125 systemd[1]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.5.service: Consumed 11.888s CPU time. 2024-02-19T19:12:39.204 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:39 smithi125 systemd[1]: Starting Ceph osd.5 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T19:12:39.529 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:39 smithi125 ceph-mon[86115]: pgmap v167: 65 pgs: 25 active+undersized+degraded, 1 stale+active+clean, 39 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 4306/32076 objects degraded (13.424%) 2024-02-19T19:12:39.529 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:39 smithi125 ceph-mon[86115]: Health check failed: Degraded data redundancy: 4306/32076 objects degraded (13.424%), 25 pgs degraded (PG_DEGRADED) 2024-02-19T19:12:39.530 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:39 smithi125 podman[105330]: 2024-02-19 19:12:39.221836447 +0000 UTC m=+0.108883384 container create c8b216513553fd06e6efc43f2c92ca9532bc10de4ea5a14bd05e082fffe0c684 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-activate, ceph=True, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-02-19T19:12:39.530 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:39 smithi125 podman[105330]: 2024-02-19 19:12:39.131391442 +0000 UTC m=+0.018438379 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:12:39.530 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:39 smithi125 podman[105330]: 2024-02-19 19:12:39.415850599 +0000 UTC m=+0.302897536 container init c8b216513553fd06e6efc43f2c92ca9532bc10de4ea5a14bd05e082fffe0c684 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-activate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-02-19T19:12:39.530 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:39 smithi125 podman[105330]: 2024-02-19 19:12:39.419165568 +0000 UTC m=+0.306212511 container start c8b216513553fd06e6efc43f2c92ca9532bc10de4ea5a14bd05e082fffe0c684 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-activate, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-02-19T19:12:39.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:39 smithi096 ceph-mon[112483]: pgmap v167: 65 pgs: 25 active+undersized+degraded, 1 stale+active+clean, 39 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 4306/32076 objects degraded (13.424%) 2024-02-19T19:12:39.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:39 smithi096 ceph-mon[112483]: Health check failed: Degraded data redundancy: 4306/32076 objects degraded (13.424%), 25 pgs degraded (PG_DEGRADED) 2024-02-19T19:12:39.881 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:39 smithi125 podman[105330]: 2024-02-19 19:12:39.507597167 +0000 UTC m=+0.394644120 container attach c8b216513553fd06e6efc43f2c92ca9532bc10de4ea5a14bd05e082fffe0c684 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-activate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240214) 2024-02-19T19:12:40.191 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:39 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-activate[105345]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-19T19:12:40.191 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:39 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-activate[105345]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-19T19:12:40.192 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:39 smithi125 bash[105330]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-19T19:12:40.192 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:39 smithi125 bash[105330]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-19T19:12:40.192 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:39 smithi125 bash[105330]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-19T19:12:40.192 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:39 smithi125 bash[105330]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-19T19:12:40.192 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:39 smithi125 bash[105330]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-19T19:12:40.192 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:39 smithi125 bash[105330]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-19T19:12:40.192 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:39 smithi125 bash[105330]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-19T19:12:40.192 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:39 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-activate[105345]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-19T19:12:40.193 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:39 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-activate[105345]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-19T19:12:40.193 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:39 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-activate[105345]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-19T19:12:40.193 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:39 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-activate[105345]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-19T19:12:40.193 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:39 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-activate[105345]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-19T19:12:40.193 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:39 smithi125 podman[105330]: 2024-02-19 19:12:39.883521356 +0000 UTC m=+0.770568297 container died c8b216513553fd06e6efc43f2c92ca9532bc10de4ea5a14bd05e082fffe0c684 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-activate, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-02-19T19:12:40.807 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:40 smithi125 podman[105462]: 2024-02-19 19:12:40.453451227 +0000 UTC m=+0.564938945 container remove c8b216513553fd06e6efc43f2c92ca9532bc10de4ea5a14bd05e082fffe0c684 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-02-19T19:12:40.813 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:40 smithi125 podman[105528]: 2024-02-19 19:12:40.569580794 +0000 UTC m=+0.017979917 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T19:12:40.813 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:40 smithi125 podman[105528]: 2024-02-19 19:12:40.679222545 +0000 UTC m=+0.127621670 container create 247b0927920be087bd1eaa6057164fecf739479407202f095354a9c51fd48ca5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214) 2024-02-19T19:12:41.203 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:40 smithi125 podman[105528]: 2024-02-19 19:12:40.856659325 +0000 UTC m=+0.305058447 container init 247b0927920be087bd1eaa6057164fecf739479407202f095354a9c51fd48ca5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T19:12:41.203 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:40 smithi125 podman[105528]: 2024-02-19 19:12:40.859582927 +0000 UTC m=+0.307982050 container start 247b0927920be087bd1eaa6057164fecf739479407202f095354a9c51fd48ca5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-19T19:12:41.204 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:40 smithi125 ceph-osd[105546]: -- 172.21.15.125:0/2200963521 <== mon.1 v2:172.21.15.125:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5639f99d91e0 con 0x5639f99aac00 2024-02-19T19:12:41.204 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:40 smithi125 bash[105528]: 247b0927920be087bd1eaa6057164fecf739479407202f095354a9c51fd48ca5 2024-02-19T19:12:41.204 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:40 smithi125 systemd[1]: Started Ceph osd.5 for 06580d2c-cf58-11ee-95bb-87774f69a715. 2024-02-19T19:12:41.703 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:41 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T19:12:41.399+0000 7f60423ae7c0 -1 Falling back to public interface 2024-02-19T19:12:42.173 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:41 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:42.173 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:41 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:42.174 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:41 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:12:42.174 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:41 smithi125 ceph-mon[86115]: pgmap v168: 65 pgs: 28 active+undersized+degraded, 37 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 4656/32076 objects degraded (14.516%) 2024-02-19T19:12:42.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:41 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:42.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:41 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:42.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:41 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:12:42.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:41 smithi096 ceph-mon[112483]: pgmap v168: 65 pgs: 28 active+undersized+degraded, 37 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 4656/32076 objects degraded (14.516%) 2024-02-19T19:12:43.948 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.925+0000 7ff2441aa700 1 -- 172.21.15.96:0/2827889246 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff23c105350 msgr2=0x7ff23c105730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:43.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.925+0000 7ff2441aa700 1 --2- 172.21.15.96:0/2827889246 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff23c105350 0x7ff23c105730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff23400c210 tx=0x7ff23400c520 comp rx=0 tx=0).stop 2024-02-19T19:12:43.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.925+0000 7ff2441aa700 1 -- 172.21.15.96:0/2827889246 shutdown_connections 2024-02-19T19:12:43.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.925+0000 7ff2441aa700 1 --2- 172.21.15.96:0/2827889246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff23c0ff340 0x7ff23c0ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:43.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.925+0000 7ff2441aa700 1 --2- 172.21.15.96:0/2827889246 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff23c105350 0x7ff23c105730 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:43.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.925+0000 7ff2441aa700 1 -- 172.21.15.96:0/2827889246 >> 172.21.15.96:0/2827889246 conn(0x7ff23c074e30 msgr2=0x7ff23c075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:43.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.926+0000 7ff2441aa700 1 -- 172.21.15.96:0/2827889246 shutdown_connections 2024-02-19T19:12:43.949 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.926+0000 7ff2441aa700 1 -- 172.21.15.96:0/2827889246 wait complete. 2024-02-19T19:12:43.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.926+0000 7ff2441aa700 1 Processor -- start 2024-02-19T19:12:43.950 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.926+0000 7ff2441aa700 1 -- start start 2024-02-19T19:12:43.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.926+0000 7ff2441aa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff23c0ff340 0x7ff23c19e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:43.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.926+0000 7ff2441aa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff23c105350 0x7ff23c19eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:43.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.927+0000 7ff2441aa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c19f430 con 0x7ff23c105350 2024-02-19T19:12:43.951 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.927+0000 7ff2441aa700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c1988e0 con 0x7ff23c0ff340 2024-02-19T19:12:43.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.927+0000 7ff241745700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff23c105350 0x7ff23c19eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:43.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.927+0000 7ff241745700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff23c105350 0x7ff23c19eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47204/0 (socket says 172.21.15.96:47204) 2024-02-19T19:12:43.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.927+0000 7ff241745700 1 -- 172.21.15.96:0/3840636451 learned_addr learned my addr 172.21.15.96:0/3840636451 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:12:43.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.927+0000 7ff241f46700 1 --2- 172.21.15.96:0/3840636451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff23c0ff340 0x7ff23c19e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:43.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.927+0000 7ff241745700 1 -- 172.21.15.96:0/3840636451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff23c0ff340 msgr2=0x7ff23c19e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:43.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.927+0000 7ff241745700 1 --2- 172.21.15.96:0/3840636451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff23c0ff340 0x7ff23c19e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:43.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.927+0000 7ff241745700 1 -- 172.21.15.96:0/3840636451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23400ae10 con 0x7ff23c105350 2024-02-19T19:12:43.952 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.927+0000 7ff241745700 1 --2- 172.21.15.96:0/3840636451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff23c105350 0x7ff23c19eda0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff23000d8d0 tx=0x7ff23000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:43.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.927+0000 7ff23affd700 1 -- 172.21.15.96:0/3840636451 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2300098a0 con 0x7ff23c105350 2024-02-19T19:12:43.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.927+0000 7ff23affd700 1 -- 172.21.15.96:0/3840636451 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff230010460 con 0x7ff23c105350 2024-02-19T19:12:43.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.927+0000 7ff2441aa700 1 -- 172.21.15.96:0/3840636451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23c198bc0 con 0x7ff23c105350 2024-02-19T19:12:43.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.927+0000 7ff23affd700 1 -- 172.21.15.96:0/3840636451 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff23000f5f0 con 0x7ff23c105350 2024-02-19T19:12:43.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.927+0000 7ff2441aa700 1 -- 172.21.15.96:0/3840636451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23c199110 con 0x7ff23c105350 2024-02-19T19:12:43.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.928+0000 7ff2441aa700 1 -- 172.21.15.96:0/3840636451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23c04f2e0 con 0x7ff23c105350 2024-02-19T19:12:43.953 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.929+0000 7ff23affd700 1 -- 172.21.15.96:0/3840636451 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7ff230009a00 con 0x7ff23c105350 2024-02-19T19:12:43.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.929+0000 7ff23affd700 1 --2- 172.21.15.96:0/3840636451 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff22406d8a0 0x7ff22406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:43.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.929+0000 7ff23affd700 1 -- 172.21.15.96:0/3840636451 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff23008d360 con 0x7ff23c105350 2024-02-19T19:12:43.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.929+0000 7ff241f46700 1 --2- 172.21.15.96:0/3840636451 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff22406d8a0 0x7ff22406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:43.954 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.930+0000 7ff241f46700 1 --2- 172.21.15.96:0/3840636451 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff22406d8a0 0x7ff22406fd60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff234006130 tx=0x7ff2340060c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:43.956 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:43.934+0000 7ff23affd700 1 -- 172.21.15.96:0/3840636451 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff23005a6f0 con 0x7ff23c105350 2024-02-19T19:12:44.167 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.144+0000 7ff2441aa700 1 -- 172.21.15.96:0/3840636451 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff23c1993a0 con 0x7ff22406d8a0 2024-02-19T19:12:44.168 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.146+0000 7ff23affd700 1 -- 172.21.15.96:0/3840636451 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff23c1993a0 con 0x7ff22406d8a0 2024-02-19T19:12:44.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.147+0000 7ff2441aa700 1 -- 172.21.15.96:0/3840636451 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff22406d8a0 msgr2=0x7ff22406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:44.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.147+0000 7ff2441aa700 1 --2- 172.21.15.96:0/3840636451 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff22406d8a0 0x7ff22406fd60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff234006130 tx=0x7ff2340060c0 comp rx=0 tx=0).stop 2024-02-19T19:12:44.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.147+0000 7ff2441aa700 1 -- 172.21.15.96:0/3840636451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff23c105350 msgr2=0x7ff23c19eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:44.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.148+0000 7ff2441aa700 1 --2- 172.21.15.96:0/3840636451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff23c105350 0x7ff23c19eda0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff23000d8d0 tx=0x7ff23000dbe0 comp rx=0 tx=0).stop 2024-02-19T19:12:44.170 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.148+0000 7ff2441aa700 1 -- 172.21.15.96:0/3840636451 shutdown_connections 2024-02-19T19:12:44.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.148+0000 7ff2441aa700 1 --2- 172.21.15.96:0/3840636451 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff22406d8a0 0x7ff22406fd60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:44.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.148+0000 7ff2441aa700 1 --2- 172.21.15.96:0/3840636451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff23c0ff340 0x7ff23c19e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:44.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.148+0000 7ff2441aa700 1 --2- 172.21.15.96:0/3840636451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff23c105350 0x7ff23c19eda0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:44.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.148+0000 7ff2441aa700 1 -- 172.21.15.96:0/3840636451 >> 172.21.15.96:0/3840636451 conn(0x7ff23c074e30 msgr2=0x7ff23c1036f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:44.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.148+0000 7ff2441aa700 1 -- 172.21.15.96:0/3840636451 shutdown_connections 2024-02-19T19:12:44.171 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.148+0000 7ff2441aa700 1 -- 172.21.15.96:0/3840636451 wait complete. 2024-02-19T19:12:44.180 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:12:44.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.251+0000 7f0a95a6a700 1 -- 172.21.15.96:0/2190747126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a90100750 msgr2=0x7f0a901047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:44.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.251+0000 7f0a95a6a700 1 --2- 172.21.15.96:0/2190747126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a90100750 0x7f0a901047a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009910 tx=0x7f0a84009c20 comp rx=0 tx=0).stop 2024-02-19T19:12:44.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.251+0000 7f0a95a6a700 1 -- 172.21.15.96:0/2190747126 shutdown_connections 2024-02-19T19:12:44.274 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.251+0000 7f0a95a6a700 1 --2- 172.21.15.96:0/2190747126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a90100750 0x7f0a901047a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:44.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.251+0000 7f0a95a6a700 1 --2- 172.21.15.96:0/2190747126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a900ffda0 0x7f0a90100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:44.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.251+0000 7f0a95a6a700 1 -- 172.21.15.96:0/2190747126 >> 172.21.15.96:0/2190747126 conn(0x7f0a900fb650 msgr2=0x7f0a900fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:44.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.251+0000 7f0a95a6a700 1 -- 172.21.15.96:0/2190747126 shutdown_connections 2024-02-19T19:12:44.275 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.251+0000 7f0a95a6a700 1 -- 172.21.15.96:0/2190747126 wait complete. 2024-02-19T19:12:44.276 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.252+0000 7f0a95a6a700 1 Processor -- start 2024-02-19T19:12:44.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.252+0000 7f0a95a6a700 1 -- start start 2024-02-19T19:12:44.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.253+0000 7f0a95a6a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a900ffda0 0x7f0a901977c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:44.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.253+0000 7f0a95a6a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a90100750 0x7f0a90197d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:44.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.253+0000 7f0a95a6a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a90198320 con 0x7f0a900ffda0 2024-02-19T19:12:44.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.253+0000 7f0a95a6a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a90198460 con 0x7f0a90100750 2024-02-19T19:12:44.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.253+0000 7f0a8f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a900ffda0 0x7f0a901977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:44.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.253+0000 7f0a8f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a900ffda0 0x7f0a901977c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47218/0 (socket says 172.21.15.96:47218) 2024-02-19T19:12:44.277 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.253+0000 7f0a8f7fe700 1 -- 172.21.15.96:0/1406587246 learned_addr learned my addr 172.21.15.96:0/1406587246 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:12:44.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.253+0000 7f0a8effd700 1 --2- 172.21.15.96:0/1406587246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a90100750 0x7f0a90197d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:44.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.253+0000 7f0a8f7fe700 1 -- 172.21.15.96:0/1406587246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a90100750 msgr2=0x7f0a90197d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:44.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.253+0000 7f0a8f7fe700 1 --2- 172.21.15.96:0/1406587246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a90100750 0x7f0a90197d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:44.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.253+0000 7f0a8f7fe700 1 -- 172.21.15.96:0/1406587246 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a840095f0 con 0x7f0a900ffda0 2024-02-19T19:12:44.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.253+0000 7f0a8f7fe700 1 --2- 172.21.15.96:0/1406587246 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a900ffda0 0x7f0a901977c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000d900 tx=0x7f0a8000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:44.278 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.254+0000 7f0a8cff9700 1 -- 172.21.15.96:0/1406587246 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a800041f0 con 0x7f0a900ffda0 2024-02-19T19:12:44.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.254+0000 7f0a8cff9700 1 -- 172.21.15.96:0/1406587246 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0a80004cf0 con 0x7f0a900ffda0 2024-02-19T19:12:44.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.254+0000 7f0a8cff9700 1 -- 172.21.15.96:0/1406587246 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a8000b750 con 0x7f0a900ffda0 2024-02-19T19:12:44.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.254+0000 7f0a95a6a700 1 -- 172.21.15.96:0/1406587246 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a901a0830 con 0x7f0a900ffda0 2024-02-19T19:12:44.279 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.254+0000 7f0a95a6a700 1 -- 172.21.15.96:0/1406587246 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a901a0cf0 con 0x7f0a900ffda0 2024-02-19T19:12:44.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.255+0000 7f0a95a6a700 1 -- 172.21.15.96:0/1406587246 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a901081a0 con 0x7f0a900ffda0 2024-02-19T19:12:44.280 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.255+0000 7f0a8cff9700 1 -- 172.21.15.96:0/1406587246 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f0a80004830 con 0x7f0a900ffda0 2024-02-19T19:12:44.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.256+0000 7f0a8cff9700 1 --2- 172.21.15.96:0/1406587246 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f0a7806d8a0 0x7f0a7806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:44.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.256+0000 7f0a8cff9700 1 -- 172.21.15.96:0/1406587246 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0a8008d3f0 con 0x7f0a900ffda0 2024-02-19T19:12:44.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.256+0000 7f0a8effd700 1 --2- 172.21.15.96:0/1406587246 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f0a7806d8a0 0x7f0a7806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:44.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.256+0000 7f0a8effd700 1 --2- 172.21.15.96:0/1406587246 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f0a7806d8a0 0x7f0a7806fd60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0a84006010 tx=0x7f0a8401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:44.282 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.260+0000 7f0a8cff9700 1 -- 172.21.15.96:0/1406587246 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0a80056bb0 con 0x7f0a900ffda0 2024-02-19T19:12:44.496 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.474+0000 7f0a95a6a700 1 -- 172.21.15.96:0/1406587246 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a900611d0 con 0x7f0a7806d8a0 2024-02-19T19:12:44.497 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.475+0000 7f0a8cff9700 1 -- 172.21.15.96:0/1406587246 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f0a900611d0 con 0x7f0a7806d8a0 2024-02-19T19:12:44.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.477+0000 7f0a95a6a700 1 -- 172.21.15.96:0/1406587246 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f0a7806d8a0 msgr2=0x7f0a7806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:44.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.477+0000 7f0a95a6a700 1 --2- 172.21.15.96:0/1406587246 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f0a7806d8a0 0x7f0a7806fd60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f0a84006010 tx=0x7f0a8401a040 comp rx=0 tx=0).stop 2024-02-19T19:12:44.500 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.477+0000 7f0a95a6a700 1 -- 172.21.15.96:0/1406587246 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a900ffda0 msgr2=0x7f0a901977c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:44.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.477+0000 7f0a95a6a700 1 --2- 172.21.15.96:0/1406587246 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a900ffda0 0x7f0a901977c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0a8000d900 tx=0x7f0a8000dc10 comp rx=0 tx=0).stop 2024-02-19T19:12:44.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.477+0000 7f0a95a6a700 1 -- 172.21.15.96:0/1406587246 shutdown_connections 2024-02-19T19:12:44.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.477+0000 7f0a95a6a700 1 --2- 172.21.15.96:0/1406587246 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f0a7806d8a0 0x7f0a7806fd60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:44.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.477+0000 7f0a95a6a700 1 --2- 172.21.15.96:0/1406587246 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a900ffda0 0x7f0a901977c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:44.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.477+0000 7f0a95a6a700 1 --2- 172.21.15.96:0/1406587246 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0a90100750 0x7f0a90197d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:44.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.478+0000 7f0a95a6a700 1 -- 172.21.15.96:0/1406587246 >> 172.21.15.96:0/1406587246 conn(0x7f0a900fb650 msgr2=0x7f0a900fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:44.501 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.478+0000 7f0a95a6a700 1 -- 172.21.15.96:0/1406587246 shutdown_connections 2024-02-19T19:12:44.502 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.478+0000 7f0a95a6a700 1 -- 172.21.15.96:0/1406587246 wait complete. 2024-02-19T19:12:44.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:44 smithi096 ceph-mon[112483]: pgmap v169: 65 pgs: 28 active+undersized+degraded, 37 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 4656/32076 objects degraded (14.516%) 2024-02-19T19:12:44.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:44 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:44.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:44 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:44.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.582+0000 7fe5df9ba700 1 -- 172.21.15.96:0/3646941721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5d80ffda0 msgr2=0x7fe5d8100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:44.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.582+0000 7fe5df9ba700 1 --2- 172.21.15.96:0/3646941721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5d80ffda0 0x7fe5d8100180 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4009910 tx=0x7fe5d4009c20 comp rx=0 tx=0).stop 2024-02-19T19:12:44.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.582+0000 7fe5df9ba700 1 -- 172.21.15.96:0/3646941721 shutdown_connections 2024-02-19T19:12:44.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.582+0000 7fe5df9ba700 1 --2- 172.21.15.96:0/3646941721 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5d8100750 0x7fe5d81047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:44.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.582+0000 7fe5df9ba700 1 --2- 172.21.15.96:0/3646941721 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5d80ffda0 0x7fe5d8100180 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:44.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.582+0000 7fe5df9ba700 1 -- 172.21.15.96:0/3646941721 >> 172.21.15.96:0/3646941721 conn(0x7fe5d80fb650 msgr2=0x7fe5d80fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:44.606 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.582+0000 7fe5df9ba700 1 -- 172.21.15.96:0/3646941721 shutdown_connections 2024-02-19T19:12:44.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.582+0000 7fe5df9ba700 1 -- 172.21.15.96:0/3646941721 wait complete. 2024-02-19T19:12:44.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.582+0000 7fe5df9ba700 1 Processor -- start 2024-02-19T19:12:44.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.582+0000 7fe5df9ba700 1 -- start start 2024-02-19T19:12:44.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.583+0000 7fe5df9ba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5d80ffda0 0x7fe5d81976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:44.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.583+0000 7fe5df9ba700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5d8100750 0x7fe5d8197c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:44.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.583+0000 7fe5df9ba700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d8198250 con 0x7fe5d8100750 2024-02-19T19:12:44.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.583+0000 7fe5df9ba700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d8198390 con 0x7fe5d80ffda0 2024-02-19T19:12:44.607 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.583+0000 7fe5dcf55700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5d8100750 0x7fe5d8197c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:44.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.583+0000 7fe5dcf55700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5d8100750 0x7fe5d8197c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47244/0 (socket says 172.21.15.96:47244) 2024-02-19T19:12:44.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.583+0000 7fe5dcf55700 1 -- 172.21.15.96:0/2366634994 learned_addr learned my addr 172.21.15.96:0/2366634994 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:12:44.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.583+0000 7fe5dd756700 1 --2- 172.21.15.96:0/2366634994 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5d80ffda0 0x7fe5d81976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:44.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.583+0000 7fe5dcf55700 1 -- 172.21.15.96:0/2366634994 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5d80ffda0 msgr2=0x7fe5d81976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:44.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.583+0000 7fe5dcf55700 1 --2- 172.21.15.96:0/2366634994 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5d80ffda0 0x7fe5d81976f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:44.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.583+0000 7fe5dcf55700 1 -- 172.21.15.96:0/2366634994 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d40095f0 con 0x7fe5d8100750 2024-02-19T19:12:44.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.583+0000 7fe5dcf55700 1 --2- 172.21.15.96:0/2366634994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5d8100750 0x7fe5d8197c30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800d900 tx=0x7fe5c800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:44.608 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.583+0000 7fe5ce7fc700 1 -- 172.21.15.96:0/2366634994 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5c8009900 con 0x7fe5d8100750 2024-02-19T19:12:44.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.583+0000 7fe5ce7fc700 1 -- 172.21.15.96:0/2366634994 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe5c8010460 con 0x7fe5d8100750 2024-02-19T19:12:44.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.583+0000 7fe5df9ba700 1 -- 172.21.15.96:0/2366634994 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d81a0760 con 0x7fe5d8100750 2024-02-19T19:12:44.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.583+0000 7fe5ce7fc700 1 -- 172.21.15.96:0/2366634994 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5c800f5f0 con 0x7fe5d8100750 2024-02-19T19:12:44.609 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.583+0000 7fe5df9ba700 1 -- 172.21.15.96:0/2366634994 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d81a0c20 con 0x7fe5d8100750 2024-02-19T19:12:44.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.584+0000 7fe5df9ba700 1 -- 172.21.15.96:0/2366634994 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d8108140 con 0x7fe5d8100750 2024-02-19T19:12:44.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.585+0000 7fe5ce7fc700 1 -- 172.21.15.96:0/2366634994 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fe5c80105d0 con 0x7fe5d8100750 2024-02-19T19:12:44.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.585+0000 7fe5ce7fc700 1 --2- 172.21.15.96:0/2366634994 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe5c406d8a0 0x7fe5c406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:44.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.585+0000 7fe5dd756700 1 --2- 172.21.15.96:0/2366634994 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe5c406d8a0 0x7fe5c406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:44.610 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.585+0000 7fe5ce7fc700 1 -- 172.21.15.96:0/2366634994 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fe5c808cf20 con 0x7fe5d8100750 2024-02-19T19:12:44.611 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.586+0000 7fe5dd756700 1 --2- 172.21.15.96:0/2366634994 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe5c406d8a0 0x7fe5c406fd60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4006010 tx=0x7fe5d401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:44.612 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.590+0000 7fe5ce7fc700 1 -- 172.21.15.96:0/2366634994 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe5c80c0d20 con 0x7fe5d8100750 2024-02-19T19:12:44.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:44 smithi125 ceph-mon[86115]: pgmap v169: 65 pgs: 28 active+undersized+degraded, 37 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 4656/32076 objects degraded (14.516%) 2024-02-19T19:12:44.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:44 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:44.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:44 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:44.818 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.795+0000 7fe5df9ba700 1 -- 172.21.15.96:0/2366634994 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5d80611d0 con 0x7fe5c406d8a0 2024-02-19T19:12:44.828 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.806+0000 7fe5ce7fc700 1 -- 172.21.15.96:0/2366634994 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fe5d80611d0 con 0x7fe5c406d8a0 2024-02-19T19:12:44.829 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:12:44.829 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (6m) 2m ago 16m 24.9M - 0.25.0 c8568f914cd2 bbaf83a1e476 2024-02-19T19:12:44.829 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (16m) 2m ago 16m 8652k - 18.2.1 94eadd990e0a b41bff2e0043 2024-02-19T19:12:44.829 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (15m) 0s ago 15m 8720k - 18.2.1 94eadd990e0a 254ab7e7a040 2024-02-19T19:12:44.829 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (3m) 2m ago 16m 6669k - 19.0.0-1450-gf78a58c0 f081f847070a deea0ffefa0f 2024-02-19T19:12:44.830 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (3m) 0s ago 15m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 3421965dc5b0 2024-02-19T19:12:44.830 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (6m) 2m ago 16m 86.6M - 9.4.12 a0ea5e3c46d9 0102d90938e4 2024-02-19T19:12:44.830 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (10m) 2m ago 10m 27.6M - 18.2.1 94eadd990e0a 0a61d9cd40d1 2024-02-19T19:12:44.830 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (10m) 2m ago 10m 24.6M - 18.2.1 94eadd990e0a 58db3e7a7d75 2024-02-19T19:12:44.830 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (10m) 0s ago 10m 53.9M - 18.2.1 94eadd990e0a 211d64de8a63 2024-02-19T19:12:44.830 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (10m) 0s ago 10m 75.0M - 18.2.1 94eadd990e0a 2a04b5a8eaf4 2024-02-19T19:12:44.830 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:8443,9283,8765 running (8m) 2m ago 18m 500M - 19.0.0-1450-gf78a58c0 f081f847070a a86fbe94fe3f 2024-02-19T19:12:44.830 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (7m) 0s ago 15m 450M - 19.0.0-1450-gf78a58c0 f081f847070a e250486d572d 2024-02-19T19:12:44.831 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (4m) 2m ago 18m 50.6M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d70090d516e3 2024-02-19T19:12:44.831 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (4m) 0s ago 15m 43.4M 2048M 19.0.0-1450-gf78a58c0 f081f847070a f56b17bdc9a0 2024-02-19T19:12:44.831 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (7m) 2m ago 16m 15.1M - 1.5.0 0da6a335fe13 51f622ea33d6 2024-02-19T19:12:44.831 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (7m) 0s ago 15m 17.3M - 1.5.0 0da6a335fe13 464e076a52a1 2024-02-19T19:12:44.831 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3m) 2m ago 14m 46.9M 1216M 19.0.0-1450-gf78a58c0 f081f847070a b3dffd6a3fb2 2024-02-19T19:12:44.831 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (2m) 2m ago 14m 44.4M 1216M 19.0.0-1450-gf78a58c0 f081f847070a f0dd6d8f952f 2024-02-19T19:12:44.831 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2m) 2m ago 13m 14.8M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 51b70eaaa7a9 2024-02-19T19:12:44.831 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (91s) 0s ago 13m 77.9M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 73b832b7b243 2024-02-19T19:12:44.832 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (57s) 0s ago 12m 80.5M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 1309ffc459f9 2024-02-19T19:12:44.832 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (4s) 0s ago 12m 14.9M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 247b0927920b 2024-02-19T19:12:44.832 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (7m) 2m ago 15m 64.9M - 2.43.0 a07b618ecd1d a4edcf6ed669 2024-02-19T19:12:44.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.808+0000 7fe5df9ba700 1 -- 172.21.15.96:0/2366634994 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe5c406d8a0 msgr2=0x7fe5c406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:44.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.808+0000 7fe5df9ba700 1 --2- 172.21.15.96:0/2366634994 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe5c406d8a0 0x7fe5c406fd60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4006010 tx=0x7fe5d401a040 comp rx=0 tx=0).stop 2024-02-19T19:12:44.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.808+0000 7fe5df9ba700 1 -- 172.21.15.96:0/2366634994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5d8100750 msgr2=0x7fe5d8197c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:44.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.808+0000 7fe5df9ba700 1 --2- 172.21.15.96:0/2366634994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5d8100750 0x7fe5d8197c30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800d900 tx=0x7fe5c800dc10 comp rx=0 tx=0).stop 2024-02-19T19:12:44.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.808+0000 7fe5df9ba700 1 -- 172.21.15.96:0/2366634994 shutdown_connections 2024-02-19T19:12:44.833 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.808+0000 7fe5df9ba700 1 --2- 172.21.15.96:0/2366634994 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fe5c406d8a0 0x7fe5c406fd60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:44.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.808+0000 7fe5df9ba700 1 --2- 172.21.15.96:0/2366634994 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5d80ffda0 0x7fe5d81976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:44.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.808+0000 7fe5df9ba700 1 --2- 172.21.15.96:0/2366634994 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe5d8100750 0x7fe5d8197c30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:44.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.808+0000 7fe5df9ba700 1 -- 172.21.15.96:0/2366634994 >> 172.21.15.96:0/2366634994 conn(0x7fe5d80fb650 msgr2=0x7fe5d80fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:44.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.809+0000 7fe5df9ba700 1 -- 172.21.15.96:0/2366634994 shutdown_connections 2024-02-19T19:12:44.834 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.809+0000 7fe5df9ba700 1 -- 172.21.15.96:0/2366634994 wait complete. 2024-02-19T19:12:44.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.911+0000 7f30091c5700 1 -- 172.21.15.96:0/142913895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3004106db0 msgr2=0x7f3004107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:44.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.911+0000 7f30091c5700 1 --2- 172.21.15.96:0/142913895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3004106db0 0x7f3004107190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc00b0a0 tx=0x7f2ffc00b3b0 comp rx=0 tx=0).stop 2024-02-19T19:12:44.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.911+0000 7f30091c5700 1 -- 172.21.15.96:0/142913895 shutdown_connections 2024-02-19T19:12:44.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.911+0000 7f30091c5700 1 --2- 172.21.15.96:0/142913895 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f30040ff410 0x7f30040ff890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:44.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.911+0000 7f30091c5700 1 --2- 172.21.15.96:0/142913895 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3004106db0 0x7f3004107190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:44.934 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.911+0000 7f30091c5700 1 -- 172.21.15.96:0/142913895 >> 172.21.15.96:0/142913895 conn(0x7f3004074e30 msgr2=0x7f3004075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:44.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.911+0000 7f30091c5700 1 -- 172.21.15.96:0/142913895 shutdown_connections 2024-02-19T19:12:44.935 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.911+0000 7f30091c5700 1 -- 172.21.15.96:0/142913895 wait complete. 2024-02-19T19:12:44.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.912+0000 7f30091c5700 1 Processor -- start 2024-02-19T19:12:44.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.912+0000 7f30091c5700 1 -- start start 2024-02-19T19:12:44.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.912+0000 7f30091c5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30040ff410 0x7f30041005f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:44.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.912+0000 7f30091c5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3004106db0 0x7f3004100b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:44.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.912+0000 7f30091c5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3004101100 con 0x7f30040ff410 2024-02-19T19:12:44.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.912+0000 7f30091c5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3004101270 con 0x7f3004106db0 2024-02-19T19:12:44.937 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.913+0000 7f3002d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30040ff410 0x7f30041005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:44.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.913+0000 7f3002d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30040ff410 0x7f30041005f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47258/0 (socket says 172.21.15.96:47258) 2024-02-19T19:12:44.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.913+0000 7f3002d9d700 1 -- 172.21.15.96:0/1980016066 learned_addr learned my addr 172.21.15.96:0/1980016066 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:12:44.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.913+0000 7f300259c700 1 --2- 172.21.15.96:0/1980016066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3004106db0 0x7f3004100b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:44.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.913+0000 7f300259c700 1 -- 172.21.15.96:0/1980016066 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30040ff410 msgr2=0x7f30041005f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:44.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.913+0000 7f300259c700 1 --2- 172.21.15.96:0/1980016066 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30040ff410 0x7f30041005f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:44.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.913+0000 7f300259c700 1 -- 172.21.15.96:0/1980016066 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc009d00 con 0x7f3004106db0 2024-02-19T19:12:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.913+0000 7f3002d9d700 1 --2- 172.21.15.96:0/1980016066 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30040ff410 0x7f30041005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:12:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.913+0000 7f300259c700 1 --2- 172.21.15.96:0/1980016066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3004106db0 0x7f3004100b30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2fec00d8d0 tx=0x7f2fec00dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.913+0000 7f2ffbfff700 1 -- 172.21.15.96:0/1980016066 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fec00f860 con 0x7f3004106db0 2024-02-19T19:12:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.913+0000 7f2ffbfff700 1 -- 172.21.15.96:0/1980016066 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2fec00fe80 con 0x7f3004106db0 2024-02-19T19:12:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.913+0000 7f30091c5700 1 -- 172.21.15.96:0/1980016066 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30041a2b90 con 0x7f3004106db0 2024-02-19T19:12:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.913+0000 7f2ffbfff700 1 -- 172.21.15.96:0/1980016066 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fec010ea0 con 0x7f3004106db0 2024-02-19T19:12:44.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.914+0000 7f30091c5700 1 -- 172.21.15.96:0/1980016066 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30041a3000 con 0x7f3004106db0 2024-02-19T19:12:44.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.914+0000 7f30091c5700 1 -- 172.21.15.96:0/1980016066 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3004109300 con 0x7f3004106db0 2024-02-19T19:12:44.940 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.916+0000 7f2ffbfff700 1 -- 172.21.15.96:0/1980016066 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f2fec010460 con 0x7f3004106db0 2024-02-19T19:12:44.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.916+0000 7f2ffbfff700 1 --2- 172.21.15.96:0/1980016066 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f2ff006d8a0 0x7f2ff006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:44.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.916+0000 7f2ffbfff700 1 -- 172.21.15.96:0/1980016066 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f2fec08d0f0 con 0x7f3004106db0 2024-02-19T19:12:44.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.916+0000 7f3002d9d700 1 --2- 172.21.15.96:0/1980016066 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f2ff006d8a0 0x7f2ff006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:44.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.916+0000 7f3002d9d700 1 --2- 172.21.15.96:0/1980016066 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f2ff006d8a0 0x7f2ff006fd60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009480 tx=0x7f2ffc00b7b0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:44.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:44.920+0000 7f2ffbfff700 1 -- 172.21.15.96:0/1980016066 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2fec0569b0 con 0x7f3004106db0 2024-02-19T19:12:45.203 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:44 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T19:12:44.928+0000 7f60423ae7c0 -1 osd.5 0 read_superblock omap replica is missing. 2024-02-19T19:12:45.203 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:45 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T19:12:45.105+0000 7f60423ae7c0 -1 osd.5 74 log_to_monitors true 2024-02-19T19:12:45.217 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.195+0000 7f30091c5700 1 -- 172.21.15.96:0/1980016066 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3004101400 con 0x7f3004106db0 2024-02-19T19:12:45.218 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.196+0000 7f2ffbfff700 1 -- 172.21.15.96:0/1980016066 <== mon.1 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+700 (secure 0 0 0) 0x7f2fec05a070 con 0x7f3004106db0 2024-02-19T19:12:45.218 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:12:45.218 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:12:45.219 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:12:45.219 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:12:45.219 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:12:45.219 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:12:45.219 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:12:45.219 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:12:45.219 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 5 2024-02-19T19:12:45.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:12:45.220 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:12:45.220 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-19T19:12:45.220 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:12:45.220 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:12:45.220 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4, 2024-02-19T19:12:45.220 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 9 2024-02-19T19:12:45.220 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:12:45.221 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:12:45.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.198+0000 7f30091c5700 1 -- 172.21.15.96:0/1980016066 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f2ff006d8a0 msgr2=0x7f2ff006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:45.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.198+0000 7f30091c5700 1 --2- 172.21.15.96:0/1980016066 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f2ff006d8a0 0x7f2ff006fd60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009480 tx=0x7f2ffc00b7b0 comp rx=0 tx=0).stop 2024-02-19T19:12:45.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.198+0000 7f30091c5700 1 -- 172.21.15.96:0/1980016066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3004106db0 msgr2=0x7f3004100b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:45.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.198+0000 7f30091c5700 1 --2- 172.21.15.96:0/1980016066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3004106db0 0x7f3004100b30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2fec00d8d0 tx=0x7f2fec00dbe0 comp rx=0 tx=0).stop 2024-02-19T19:12:45.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.198+0000 7f30091c5700 1 -- 172.21.15.96:0/1980016066 shutdown_connections 2024-02-19T19:12:45.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.198+0000 7f30091c5700 1 --2- 172.21.15.96:0/1980016066 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f2ff006d8a0 0x7f2ff006fd60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:45.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.198+0000 7f30091c5700 1 --2- 172.21.15.96:0/1980016066 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f30040ff410 0x7f30041005f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:45.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.198+0000 7f30091c5700 1 --2- 172.21.15.96:0/1980016066 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3004106db0 0x7f3004100b30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:45.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.198+0000 7f30091c5700 1 -- 172.21.15.96:0/1980016066 >> 172.21.15.96:0/1980016066 conn(0x7f3004074e30 msgr2=0x7f30040fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:45.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.198+0000 7f30091c5700 1 -- 172.21.15.96:0/1980016066 shutdown_connections 2024-02-19T19:12:45.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.198+0000 7f30091c5700 1 -- 172.21.15.96:0/1980016066 wait complete. 2024-02-19T19:12:45.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.301+0000 7f2499861700 1 -- 172.21.15.96:0/2623798548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2494100ea0 msgr2=0x7f2494101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:45.325 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.301+0000 7f2499861700 1 --2- 172.21.15.96:0/2623798548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2494100ea0 0x7f2494101280 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2484009910 tx=0x7f2484009c20 comp rx=0 tx=0).stop 2024-02-19T19:12:45.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.301+0000 7f2499861700 1 -- 172.21.15.96:0/2623798548 shutdown_connections 2024-02-19T19:12:45.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.301+0000 7f2499861700 1 --2- 172.21.15.96:0/2623798548 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2494101850 0x7f24941058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:45.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.301+0000 7f2499861700 1 --2- 172.21.15.96:0/2623798548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2494100ea0 0x7f2494101280 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:45.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.301+0000 7f2499861700 1 -- 172.21.15.96:0/2623798548 >> 172.21.15.96:0/2623798548 conn(0x7f24940fc750 msgr2=0x7f24940feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:45.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.301+0000 7f2499861700 1 -- 172.21.15.96:0/2623798548 shutdown_connections 2024-02-19T19:12:45.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.301+0000 7f2499861700 1 -- 172.21.15.96:0/2623798548 wait complete. 2024-02-19T19:12:45.326 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.301+0000 7f2499861700 1 Processor -- start 2024-02-19T19:12:45.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.302+0000 7f2499861700 1 -- start start 2024-02-19T19:12:45.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.302+0000 7f2499861700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2494100ea0 0x7f2494073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:45.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.302+0000 7f2499861700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2494101850 0x7f24940735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:45.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.302+0000 7f2499861700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2494073b10 con 0x7f2494101850 2024-02-19T19:12:45.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.302+0000 7f2499861700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2494073c50 con 0x7f2494100ea0 2024-02-19T19:12:45.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.302+0000 7f24927fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2494101850 0x7f24940735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:45.327 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.302+0000 7f24927fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2494101850 0x7f24940735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47274/0 (socket says 172.21.15.96:47274) 2024-02-19T19:12:45.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.302+0000 7f24927fc700 1 -- 172.21.15.96:0/4181500928 learned_addr learned my addr 172.21.15.96:0/4181500928 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:12:45.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.302+0000 7f2492ffd700 1 --2- 172.21.15.96:0/4181500928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2494100ea0 0x7f2494073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:45.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.302+0000 7f24927fc700 1 -- 172.21.15.96:0/4181500928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2494100ea0 msgr2=0x7f2494073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:45.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.302+0000 7f24927fc700 1 --2- 172.21.15.96:0/4181500928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2494100ea0 0x7f2494073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:45.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.302+0000 7f24927fc700 1 -- 172.21.15.96:0/4181500928 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24840095f0 con 0x7f2494101850 2024-02-19T19:12:45.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.302+0000 7f24927fc700 1 --2- 172.21.15.96:0/4181500928 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2494101850 0x7f24940735d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f248800d8d0 tx=0x7f248800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:45.328 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.303+0000 7f249885f700 1 -- 172.21.15.96:0/4181500928 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24880041f0 con 0x7f2494101850 2024-02-19T19:12:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.303+0000 7f249885f700 1 -- 172.21.15.96:0/4181500928 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2488007620 con 0x7f2494101850 2024-02-19T19:12:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.303+0000 7f2499861700 1 -- 172.21.15.96:0/4181500928 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24941a2b10 con 0x7f2494101850 2024-02-19T19:12:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.303+0000 7f249885f700 1 -- 172.21.15.96:0/4181500928 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24880056b0 con 0x7f2494101850 2024-02-19T19:12:45.329 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.303+0000 7f2499861700 1 -- 172.21.15.96:0/4181500928 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24941a2f20 con 0x7f2494101850 2024-02-19T19:12:45.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.304+0000 7f2499861700 1 -- 172.21.15.96:0/4181500928 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2494109240 con 0x7f2494101850 2024-02-19T19:12:45.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.304+0000 7f249885f700 1 -- 172.21.15.96:0/4181500928 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f2488004750 con 0x7f2494101850 2024-02-19T19:12:45.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.304+0000 7f249885f700 1 --2- 172.21.15.96:0/4181500928 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f247c06d8a0 0x7f247c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:45.330 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.305+0000 7f249885f700 1 -- 172.21.15.96:0/4181500928 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f248808d210 con 0x7f2494101850 2024-02-19T19:12:45.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.305+0000 7f2492ffd700 1 --2- 172.21.15.96:0/4181500928 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f247c06d8a0 0x7f247c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:45.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.305+0000 7f2492ffd700 1 --2- 172.21.15.96:0/4181500928 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f247c06d8a0 0x7f247c06fd60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2484006010 tx=0x7f248401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:45.331 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.309+0000 7f249885f700 1 -- 172.21.15.96:0/4181500928 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2488056af0 con 0x7f2494101850 2024-02-19T19:12:45.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:45 smithi096 ceph-mon[112483]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:12:45.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:45 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:45.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:45 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:45.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:45 smithi096 ceph-mon[112483]: from='osd.5 [v2:172.21.15.125:6816/1863352846,v1:172.21.15.125:6817/1863352846]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T19:12:45.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:45 smithi096 ceph-mon[112483]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T19:12:45.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:45 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/1980016066' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:45.570 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:45 smithi125 ceph-mon[86115]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:12:45.570 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:45 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:45.570 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:45 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:45.570 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:45 smithi125 ceph-mon[86115]: from='osd.5 [v2:172.21.15.125:6816/1863352846,v1:172.21.15.125:6817/1863352846]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T19:12:45.570 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:45 smithi125 ceph-mon[86115]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-19T19:12:45.571 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:45 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/1980016066' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:45.571 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.549+0000 7f2499861700 1 -- 172.21.15.96:0/4181500928 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f249404f2e0 con 0x7f2494101850 2024-02-19T19:12:45.572 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.550+0000 7f249885f700 1 -- 172.21.15.96:0/4181500928 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1886 (secure 0 0 0) 0x7f2488016770 con 0x7f2494101850 2024-02-19T19:12:45.572 INFO:teuthology.orchestra.run.smithi096.stdout:e20 2024-02-19T19:12:45.572 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:12:45.573 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:12:45.573 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2024-02-19T19:12:45.573 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:12:45.573 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:12:45.573 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2024-02-19T19:12:45.573 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 20 2024-02-19T19:12:45.573 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-19T19:12:45.574 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-02-19T19:01:42.881136+0000 2024-02-19T19:12:45.574 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2024-02-19T19:10:58.917735+0000 2024-02-19T19:12:45.574 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2024-02-19T19:12:45.574 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2024-02-19T19:12:45.574 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2024-02-19T19:12:45.574 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2024-02-19T19:12:45.574 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2024-02-19T19:12:45.575 INFO:teuthology.orchestra.run.smithi096.stdout:max_xattr_size 65536 2024-02-19T19:12:45.575 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2024-02-19T19:12:45.575 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2024-02-19T19:12:45.575 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 46 2024-02-19T19:12:45.575 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:12:45.575 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2024-02-19T19:12:45.575 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2024-02-19T19:12:45.575 INFO:teuthology.orchestra.run.smithi096.stdout:up {0=14490,1=24267} 2024-02-19T19:12:45.576 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2024-02-19T19:12:45.576 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2024-02-19T19:12:45.576 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2024-02-19T19:12:45.576 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2024-02-19T19:12:45.576 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2024-02-19T19:12:45.576 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data enabled 2024-02-19T19:12:45.576 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2024-02-19T19:12:45.576 INFO:teuthology.orchestra.run.smithi096.stdout:bal_rank_mask -1 2024-02-19T19:12:45.577 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2024-02-19T19:12:45.577 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pccmys{0:14490} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.96:6828/2109698145,v1:172.21.15.96:6829/2109698145] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:12:45.577 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.usrmcg{0:14502} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/413113741,v1:172.21.15.96:6827/413113741] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:12:45.577 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.srnlol{1:24267} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.125:6824/3084054986,v1:172.21.15.125:6825/3084054986] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:12:45.577 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.pwyuga{1:24275} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.125:6826/3098247423,v1:172.21.15.125:6827/3098247423] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:12:45.577 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:12:45.577 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:12:45.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.552+0000 7f2499861700 1 -- 172.21.15.96:0/4181500928 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f247c06d8a0 msgr2=0x7f247c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:45.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.552+0000 7f2499861700 1 --2- 172.21.15.96:0/4181500928 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f247c06d8a0 0x7f247c06fd60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2484006010 tx=0x7f248401a040 comp rx=0 tx=0).stop 2024-02-19T19:12:45.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.552+0000 7f2499861700 1 -- 172.21.15.96:0/4181500928 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2494101850 msgr2=0x7f24940735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:45.578 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.552+0000 7f2499861700 1 --2- 172.21.15.96:0/4181500928 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2494101850 0x7f24940735d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f248800d8d0 tx=0x7f248800dbe0 comp rx=0 tx=0).stop 2024-02-19T19:12:45.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.552+0000 7f2499861700 1 -- 172.21.15.96:0/4181500928 shutdown_connections 2024-02-19T19:12:45.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.552+0000 7f2499861700 1 --2- 172.21.15.96:0/4181500928 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f247c06d8a0 0x7f247c06fd60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:45.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.552+0000 7f2499861700 1 --2- 172.21.15.96:0/4181500928 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2494100ea0 0x7f2494073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:45.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.552+0000 7f2499861700 1 --2- 172.21.15.96:0/4181500928 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2494101850 0x7f24940735d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:45.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.552+0000 7f2499861700 1 -- 172.21.15.96:0/4181500928 >> 172.21.15.96:0/4181500928 conn(0x7f24940fc750 msgr2=0x7f24940fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:45.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.552+0000 7f2499861700 1 -- 172.21.15.96:0/4181500928 shutdown_connections 2024-02-19T19:12:45.579 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.552+0000 7f2499861700 1 -- 172.21.15.96:0/4181500928 wait complete. 2024-02-19T19:12:45.579 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 20 2024-02-19T19:12:45.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.656+0000 7f4da8829700 1 -- 172.21.15.96:0/1123147669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da4100750 msgr2=0x7f4da41047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:45.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.656+0000 7f4da8829700 1 --2- 172.21.15.96:0/1123147669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da4100750 0x7f4da41047a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4d98009910 tx=0x7f4d98009c20 comp rx=0 tx=0).stop 2024-02-19T19:12:45.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.656+0000 7f4da8829700 1 -- 172.21.15.96:0/1123147669 shutdown_connections 2024-02-19T19:12:45.679 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.656+0000 7f4da8829700 1 --2- 172.21.15.96:0/1123147669 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da4100750 0x7f4da41047a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:45.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.656+0000 7f4da8829700 1 --2- 172.21.15.96:0/1123147669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4da40ffda0 0x7f4da4100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:45.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.656+0000 7f4da8829700 1 -- 172.21.15.96:0/1123147669 >> 172.21.15.96:0/1123147669 conn(0x7f4da40fb650 msgr2=0x7f4da40fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:45.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.656+0000 7f4da8829700 1 -- 172.21.15.96:0/1123147669 shutdown_connections 2024-02-19T19:12:45.680 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.657+0000 7f4da8829700 1 -- 172.21.15.96:0/1123147669 wait complete. 2024-02-19T19:12:45.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.657+0000 7f4da8829700 1 Processor -- start 2024-02-19T19:12:45.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.657+0000 7f4da8829700 1 -- start start 2024-02-19T19:12:45.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.657+0000 7f4da8829700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da40ffda0 0x7f4da4101840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:45.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.657+0000 7f4da8829700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4da4100750 0x7f4da4101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:45.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.657+0000 7f4da8829700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da41022c0 con 0x7f4da40ffda0 2024-02-19T19:12:45.682 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.657+0000 7f4da8829700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da4102400 con 0x7f4da4100750 2024-02-19T19:12:45.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.658+0000 7f4da259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da40ffda0 0x7f4da4101840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:45.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.658+0000 7f4da259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da40ffda0 0x7f4da4101840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47300/0 (socket says 172.21.15.96:47300) 2024-02-19T19:12:45.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.658+0000 7f4da259c700 1 -- 172.21.15.96:0/1661537307 learned_addr learned my addr 172.21.15.96:0/1661537307 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:12:45.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.658+0000 7f4da1d9b700 1 --2- 172.21.15.96:0/1661537307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4da4100750 0x7f4da4101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:45.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.658+0000 7f4da259c700 1 -- 172.21.15.96:0/1661537307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4da4100750 msgr2=0x7f4da4101d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:45.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.658+0000 7f4da259c700 1 --2- 172.21.15.96:0/1661537307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4da4100750 0x7f4da4101d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:45.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.658+0000 7f4da259c700 1 -- 172.21.15.96:0/1661537307 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d980095f0 con 0x7f4da40ffda0 2024-02-19T19:12:45.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.658+0000 7f4da259c700 1 --2- 172.21.15.96:0/1661537307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da40ffda0 0x7f4da4101840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400c8a0 tx=0x7f4d9400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:45.683 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.658+0000 7f4d937fe700 1 -- 172.21.15.96:0/1661537307 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d940078e0 con 0x7f4da40ffda0 2024-02-19T19:12:45.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.658+0000 7f4d937fe700 1 -- 172.21.15.96:0/1661537307 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4d9400f450 con 0x7f4da40ffda0 2024-02-19T19:12:45.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.658+0000 7f4da8829700 1 -- 172.21.15.96:0/1661537307 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da41a2ab0 con 0x7f4da40ffda0 2024-02-19T19:12:45.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.658+0000 7f4d937fe700 1 -- 172.21.15.96:0/1661537307 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d9400e5e0 con 0x7f4da40ffda0 2024-02-19T19:12:45.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.658+0000 7f4da8829700 1 -- 172.21.15.96:0/1661537307 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da41a2ec0 con 0x7f4da40ffda0 2024-02-19T19:12:45.684 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.659+0000 7f4da8829700 1 -- 172.21.15.96:0/1661537307 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da404f2e0 con 0x7f4da40ffda0 2024-02-19T19:12:45.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.660+0000 7f4d937fe700 1 -- 172.21.15.96:0/1661537307 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f4d9400f5c0 con 0x7f4da40ffda0 2024-02-19T19:12:45.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.660+0000 7f4d937fe700 1 --2- 172.21.15.96:0/1661537307 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f4d8c06d8a0 0x7f4d8c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:45.685 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.660+0000 7f4da1d9b700 1 --2- 172.21.15.96:0/1661537307 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f4d8c06d8a0 0x7f4d8c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:45.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.660+0000 7f4d937fe700 1 -- 172.21.15.96:0/1661537307 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4d9408d460 con 0x7f4da40ffda0 2024-02-19T19:12:45.686 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.661+0000 7f4da1d9b700 1 --2- 172.21.15.96:0/1661537307 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f4d8c06d8a0 0x7f4d8c06fd60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4da4103030 tx=0x7f4d9801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:45.687 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.665+0000 7f4d937fe700 1 -- 172.21.15.96:0/1661537307 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4d94056cc0 con 0x7f4da40ffda0 2024-02-19T19:12:45.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.875+0000 7f4da8829700 1 -- 172.21.15.96:0/1661537307 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4da4103960 con 0x7f4d8c06d8a0 2024-02-19T19:12:45.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.877+0000 7f4d937fe700 1 -- 172.21.15.96:0/1661537307 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f4da4103960 con 0x7f4d8c06d8a0 2024-02-19T19:12:45.900 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:12:45.901 INFO:teuthology.orchestra.run.smithi096.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:12:45.901 INFO:teuthology.orchestra.run.smithi096.stdout: "in_progress": true, 2024-02-19T19:12:45.902 INFO:teuthology.orchestra.run.smithi096.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:12:45.902 INFO:teuthology.orchestra.run.smithi096.stdout: "services_complete": [ 2024-02-19T19:12:45.902 INFO:teuthology.orchestra.run.smithi096.stdout: "crash", 2024-02-19T19:12:45.902 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr", 2024-02-19T19:12:45.903 INFO:teuthology.orchestra.run.smithi096.stdout: "osd", 2024-02-19T19:12:45.903 INFO:teuthology.orchestra.run.smithi096.stdout: "mon" 2024-02-19T19:12:45.904 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-02-19T19:12:45.904 INFO:teuthology.orchestra.run.smithi096.stdout: "progress": "12/23 daemons upgraded", 2024-02-19T19:12:45.904 INFO:teuthology.orchestra.run.smithi096.stdout: "message": "Currently upgrading osd daemons", 2024-02-19T19:12:45.905 INFO:teuthology.orchestra.run.smithi096.stdout: "is_paused": false 2024-02-19T19:12:45.905 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:12:45.906 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.879+0000 7f4da8829700 1 -- 172.21.15.96:0/1661537307 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f4d8c06d8a0 msgr2=0x7f4d8c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:45.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.879+0000 7f4da8829700 1 --2- 172.21.15.96:0/1661537307 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f4d8c06d8a0 0x7f4d8c06fd60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4da4103030 tx=0x7f4d9801a040 comp rx=0 tx=0).stop 2024-02-19T19:12:45.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.879+0000 7f4da8829700 1 -- 172.21.15.96:0/1661537307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da40ffda0 msgr2=0x7f4da4101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:45.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.879+0000 7f4da8829700 1 --2- 172.21.15.96:0/1661537307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da40ffda0 0x7f4da4101840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4d9400c8a0 tx=0x7f4d9400cbb0 comp rx=0 tx=0).stop 2024-02-19T19:12:45.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.879+0000 7f4da8829700 1 -- 172.21.15.96:0/1661537307 shutdown_connections 2024-02-19T19:12:45.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.879+0000 7f4da8829700 1 --2- 172.21.15.96:0/1661537307 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f4d8c06d8a0 0x7f4d8c06fd60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:45.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.879+0000 7f4da8829700 1 --2- 172.21.15.96:0/1661537307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4da40ffda0 0x7f4da4101840 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:45.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.879+0000 7f4da8829700 1 --2- 172.21.15.96:0/1661537307 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4da4100750 0x7f4da4101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:45.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.879+0000 7f4da8829700 1 -- 172.21.15.96:0/1661537307 >> 172.21.15.96:0/1661537307 conn(0x7f4da40fb650 msgr2=0x7f4da40fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:45.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.879+0000 7f4da8829700 1 -- 172.21.15.96:0/1661537307 shutdown_connections 2024-02-19T19:12:45.909 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.879+0000 7f4da8829700 1 -- 172.21.15.96:0/1661537307 wait complete. 2024-02-19T19:12:46.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.985+0000 7f9224250700 1 -- 172.21.15.96:0/2961696559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f921c101830 msgr2=0x7f921c105880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:46.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.985+0000 7f9224250700 1 --2- 172.21.15.96:0/2961696559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f921c101830 0x7f921c105880 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f920c009910 tx=0x7f920c009c20 comp rx=0 tx=0).stop 2024-02-19T19:12:46.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.985+0000 7f9224250700 1 -- 172.21.15.96:0/2961696559 shutdown_connections 2024-02-19T19:12:46.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.985+0000 7f9224250700 1 --2- 172.21.15.96:0/2961696559 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f921c101830 0x7f921c105880 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:46.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.985+0000 7f9224250700 1 --2- 172.21.15.96:0/2961696559 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f921c100e80 0x7f921c101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:46.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.985+0000 7f9224250700 1 -- 172.21.15.96:0/2961696559 >> 172.21.15.96:0/2961696559 conn(0x7f921c0fc730 msgr2=0x7f921c0feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:46.008 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.985+0000 7f9224250700 1 -- 172.21.15.96:0/2961696559 shutdown_connections 2024-02-19T19:12:46.009 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.985+0000 7f9224250700 1 -- 172.21.15.96:0/2961696559 wait complete. 2024-02-19T19:12:46.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.986+0000 7f9224250700 1 Processor -- start 2024-02-19T19:12:46.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.986+0000 7f9224250700 1 -- start start 2024-02-19T19:12:46.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.986+0000 7f9224250700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f921c100e80 0x7f921c073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:46.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.986+0000 7f9224250700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f921c101830 0x7f921c0735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:46.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.986+0000 7f9224250700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c073b10 con 0x7f921c101830 2024-02-19T19:12:46.011 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.986+0000 7f9224250700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921c073c50 con 0x7f921c100e80 2024-02-19T19:12:46.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.986+0000 7f92217eb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f921c101830 0x7f921c0735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:46.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.986+0000 7f92217eb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f921c101830 0x7f921c0735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:47316/0 (socket says 172.21.15.96:47316) 2024-02-19T19:12:46.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.986+0000 7f92217eb700 1 -- 172.21.15.96:0/3093021283 learned_addr learned my addr 172.21.15.96:0/3093021283 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:12:46.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.986+0000 7f9221fec700 1 --2- 172.21.15.96:0/3093021283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f921c100e80 0x7f921c073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:46.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.986+0000 7f92217eb700 1 -- 172.21.15.96:0/3093021283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f921c100e80 msgr2=0x7f921c073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:46.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.986+0000 7f92217eb700 1 --2- 172.21.15.96:0/3093021283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f921c100e80 0x7f921c073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:46.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.986+0000 7f92217eb700 1 -- 172.21.15.96:0/3093021283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920c0095f0 con 0x7f921c101830 2024-02-19T19:12:46.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.987+0000 7f92217eb700 1 --2- 172.21.15.96:0/3093021283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f921c101830 0x7f921c0735d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f920c0059d0 tx=0x7f920c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:46.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.987+0000 7f9212ffd700 1 -- 172.21.15.96:0/3093021283 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f920c01d070 con 0x7f921c101830 2024-02-19T19:12:46.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.987+0000 7f9224250700 1 -- 172.21.15.96:0/3093021283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921c073ed0 con 0x7f921c101830 2024-02-19T19:12:46.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.987+0000 7f9212ffd700 1 -- 172.21.15.96:0/3093021283 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f920c00b610 con 0x7f921c101830 2024-02-19T19:12:46.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.987+0000 7f9212ffd700 1 -- 172.21.15.96:0/3093021283 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f920c022470 con 0x7f921c101830 2024-02-19T19:12:46.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.987+0000 7f9224250700 1 -- 172.21.15.96:0/3093021283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921c1a2d70 con 0x7f921c101830 2024-02-19T19:12:46.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.988+0000 7f9224250700 1 -- 172.21.15.96:0/3093021283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921c109280 con 0x7f921c101830 2024-02-19T19:12:46.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.988+0000 7f9212ffd700 1 -- 172.21.15.96:0/3093021283 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f920c003710 con 0x7f921c101830 2024-02-19T19:12:46.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.988+0000 7f9212ffd700 1 --2- 172.21.15.96:0/3093021283 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f920806d8a0 0x7f920806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:12:46.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.989+0000 7f9212ffd700 1 -- 172.21.15.96:0/3093021283 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f920c08e930 con 0x7f921c101830 2024-02-19T19:12:46.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.989+0000 7f9221fec700 1 --2- 172.21.15.96:0/3093021283 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f920806d8a0 0x7f920806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:12:46.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.989+0000 7f9221fec700 1 --2- 172.21.15.96:0/3093021283 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f920806d8a0 0x7f920806fd60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f921400f540 tx=0x7f921400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:12:46.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:45.993+0000 7f9212ffd700 1 -- 172.21.15.96:0/3093021283 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f920c058190 con 0x7f921c101830 2024-02-19T19:12:46.287 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:46.264+0000 7f9224250700 1 -- 172.21.15.96:0/3093021283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f921c04f2e0 con 0x7f921c101830 2024-02-19T19:12:46.288 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:46.265+0000 7f9212ffd700 1 -- 172.21.15.96:0/3093021283 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+2265 (secure 0 0 0) 0x7f920c05b850 con 0x7f921c101830 2024-02-19T19:12:46.288 INFO:teuthology.orchestra.run.smithi096.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 4656/32076 objects degraded (14.516%), 28 pgs degraded 2024-02-19T19:12:46.288 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-19T19:12:46.288 INFO:teuthology.orchestra.run.smithi096.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-19T19:12:46.288 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-19T19:12:46.288 INFO:teuthology.orchestra.run.smithi096.stdout: osd.5 (root=default,host=smithi125) is down 2024-02-19T19:12:46.289 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-02-19T19:12:46.289 INFO:teuthology.orchestra.run.smithi096.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-02-19T19:12:46.289 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 4656/32076 objects degraded (14.516%), 28 pgs degraded 2024-02-19T19:12:46.289 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-02-19T19:12:46.289 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-02-19T19:12:46.289 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-02-19T19:12:46.289 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-02-19T19:12:46.289 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-02-19T19:12:46.290 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-02-19T19:12:46.290 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-02-19T19:12:46.290 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.17 is active+undersized+degraded, acting [2,1] 2024-02-19T19:12:46.290 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-02-19T19:12:46.290 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-02-19T19:12:46.290 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-02-19T19:12:46.290 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-02-19T19:12:46.290 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-02-19T19:12:46.291 INFO:teuthology.orchestra.run.smithi096.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-02-19T19:12:46.291 INFO:teuthology.orchestra.run.smithi096.stdout: pg 3.2 is active+undersized+degraded, acting [1,3] 2024-02-19T19:12:46.291 INFO:teuthology.orchestra.run.smithi096.stdout: pg 3.5 is active+undersized+degraded, acting [2,3] 2024-02-19T19:12:46.291 INFO:teuthology.orchestra.run.smithi096.stdout: pg 3.8 is active+undersized+degraded, acting [2,1] 2024-02-19T19:12:46.291 INFO:teuthology.orchestra.run.smithi096.stdout: pg 3.9 is active+undersized+degraded, acting [4,2] 2024-02-19T19:12:46.291 INFO:teuthology.orchestra.run.smithi096.stdout: pg 3.c is active+undersized+degraded, acting [0,3] 2024-02-19T19:12:46.291 INFO:teuthology.orchestra.run.smithi096.stdout: pg 3.e is active+undersized+degraded, acting [4,1] 2024-02-19T19:12:46.291 INFO:teuthology.orchestra.run.smithi096.stdout: pg 3.f is active+undersized+degraded, acting [3,0] 2024-02-19T19:12:46.291 INFO:teuthology.orchestra.run.smithi096.stdout: pg 3.10 is active+undersized+degraded, acting [0,1] 2024-02-19T19:12:46.292 INFO:teuthology.orchestra.run.smithi096.stdout: pg 3.13 is active+undersized+degraded, acting [3,2] 2024-02-19T19:12:46.292 INFO:teuthology.orchestra.run.smithi096.stdout: pg 3.14 is active+undersized+degraded, acting [3,4] 2024-02-19T19:12:46.292 INFO:teuthology.orchestra.run.smithi096.stdout: pg 3.16 is active+undersized+degraded, acting [3,1] 2024-02-19T19:12:46.292 INFO:teuthology.orchestra.run.smithi096.stdout: pg 3.17 is active+undersized+degraded, acting [0,2] 2024-02-19T19:12:46.292 INFO:teuthology.orchestra.run.smithi096.stdout: pg 3.1c is active+undersized+degraded, acting [4,1] 2024-02-19T19:12:46.292 INFO:teuthology.orchestra.run.smithi096.stdout: pg 3.1d is active+undersized+degraded, acting [4,1] 2024-02-19T19:12:46.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:46.267+0000 7f9224250700 1 -- 172.21.15.96:0/3093021283 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f920806d8a0 msgr2=0x7f920806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:46.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:46.267+0000 7f9224250700 1 --2- 172.21.15.96:0/3093021283 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f920806d8a0 0x7f920806fd60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f921400f540 tx=0x7f921400b040 comp rx=0 tx=0).stop 2024-02-19T19:12:46.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:46.267+0000 7f9224250700 1 -- 172.21.15.96:0/3093021283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f921c101830 msgr2=0x7f921c0735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:12:46.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:46.267+0000 7f9224250700 1 --2- 172.21.15.96:0/3093021283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f921c101830 0x7f921c0735d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f920c0059d0 tx=0x7f920c00f690 comp rx=0 tx=0).stop 2024-02-19T19:12:46.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:46.267+0000 7f9224250700 1 -- 172.21.15.96:0/3093021283 shutdown_connections 2024-02-19T19:12:46.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:46.267+0000 7f9224250700 1 --2- 172.21.15.96:0/3093021283 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f920806d8a0 0x7f920806fd60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:46.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:46.267+0000 7f9224250700 1 --2- 172.21.15.96:0/3093021283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f921c100e80 0x7f921c073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:46.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:46.267+0000 7f9224250700 1 --2- 172.21.15.96:0/3093021283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f921c101830 0x7f921c0735d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:12:46.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:46.267+0000 7f9224250700 1 -- 172.21.15.96:0/3093021283 >> 172.21.15.96:0/3093021283 conn(0x7f921c0fc730 msgr2=0x7f921c0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:12:46.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:46.267+0000 7f9224250700 1 -- 172.21.15.96:0/3093021283 shutdown_connections 2024-02-19T19:12:46.294 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:12:46.267+0000 7f9224250700 1 -- 172.21.15.96:0/3093021283 wait complete. 2024-02-19T19:12:46.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:46 smithi096 ceph-mon[112483]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:12:46.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:46 smithi096 ceph-mon[112483]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:12:46.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:46 smithi096 ceph-mon[112483]: pgmap v170: 65 pgs: 28 active+undersized+degraded, 37 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 4656/32076 objects degraded (14.516%) 2024-02-19T19:12:46.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:46 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/4181500928' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:12:46.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:46 smithi096 ceph-mon[112483]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-19T19:12:46.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:46 smithi096 ceph-mon[112483]: osdmap e77: 6 total, 5 up, 6 in 2024-02-19T19:12:46.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:46 smithi096 ceph-mon[112483]: from='osd.5 [v2:172.21.15.125:6816/1863352846,v1:172.21.15.125:6817/1863352846]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2024-02-19T19:12:46.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:46 smithi096 ceph-mon[112483]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2024-02-19T19:12:46.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:46 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/3093021283' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:12:46.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:46 smithi125 ceph-mon[86115]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:12:46.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:46 smithi125 ceph-mon[86115]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:12:46.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:46 smithi125 ceph-mon[86115]: pgmap v170: 65 pgs: 28 active+undersized+degraded, 37 active+clean; 128 MiB data, 691 MiB used, 536 GiB / 536 GiB avail; 4656/32076 objects degraded (14.516%) 2024-02-19T19:12:46.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:46 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/4181500928' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:12:46.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:46 smithi125 ceph-mon[86115]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-19T19:12:46.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:46 smithi125 ceph-mon[86115]: osdmap e77: 6 total, 5 up, 6 in 2024-02-19T19:12:46.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:46 smithi125 ceph-mon[86115]: from='osd.5 [v2:172.21.15.125:6816/1863352846,v1:172.21.15.125:6817/1863352846]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2024-02-19T19:12:46.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:46 smithi125 ceph-mon[86115]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi125", "root=default"]}]: dispatch 2024-02-19T19:12:46.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:46 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/3093021283' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:12:47.055 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 19:12:46 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T19:12:46.812+0000 7f602f7fe700 -1 osd.5 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-19T19:12:47.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:47 smithi125 ceph-mon[86115]: from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:12:47.701 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:47 smithi125 ceph-mon[86115]: from='osd.5 ' entity='osd.5' 2024-02-19T19:12:47.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:47 smithi125 ceph-mon[86115]: Health check update: Degraded data redundancy: 4656/32076 objects degraded (14.516%), 28 pgs degraded (PG_DEGRADED) 2024-02-19T19:12:47.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:47 smithi096 ceph-mon[112483]: from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:12:47.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:47 smithi096 ceph-mon[112483]: from='osd.5 ' entity='osd.5' 2024-02-19T19:12:47.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:47 smithi096 ceph-mon[112483]: Health check update: Degraded data redundancy: 4656/32076 objects degraded (14.516%), 28 pgs degraded (PG_DEGRADED) 2024-02-19T19:12:48.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:48 smithi125 ceph-mon[86115]: pgmap v172: 65 pgs: 28 active+undersized+degraded, 37 active+clean; 128 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 4656/32076 objects degraded (14.516%) 2024-02-19T19:12:48.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:48 smithi125 ceph-mon[86115]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:12:48.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:48 smithi125 ceph-mon[86115]: osd.5 [v2:172.21.15.125:6816/1863352846,v1:172.21.15.125:6817/1863352846] boot 2024-02-19T19:12:48.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:48 smithi125 ceph-mon[86115]: osdmap e78: 6 total, 6 up, 6 in 2024-02-19T19:12:48.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:48 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:12:48.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:48 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:48.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:48 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:48.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:48 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:12:48.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:48 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:12:48.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:48 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:48.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:48 smithi096 ceph-mon[112483]: pgmap v172: 65 pgs: 28 active+undersized+degraded, 37 active+clean; 128 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 4656/32076 objects degraded (14.516%) 2024-02-19T19:12:48.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:48 smithi096 ceph-mon[112483]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-19T19:12:48.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:48 smithi096 ceph-mon[112483]: osd.5 [v2:172.21.15.125:6816/1863352846,v1:172.21.15.125:6817/1863352846] boot 2024-02-19T19:12:48.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:48 smithi096 ceph-mon[112483]: osdmap e78: 6 total, 6 up, 6 in 2024-02-19T19:12:48.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:48 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-19T19:12:48.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:48 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:48.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:48 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:48.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:48 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:12:48.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:48 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:12:48.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:48 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:49.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:12:49.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:49.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:49.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:49.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:49.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:49.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-19T19:12:49.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-19T19:12:49.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-19T19:12:49.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-19T19:12:49.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-19T19:12:49.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-19T19:12:49.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-19T19:12:49.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-19T19:12:49.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-19T19:12:49.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-19T19:12:49.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-19T19:12:49.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-19T19:12:49.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-02-19T19:12:49.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-02-19T19:12:49.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-02-19T19:12:49.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: osdmap e79: 6 total, 6 up, 6 in 2024-02-19T19:12:49.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:49.707 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-02-19T19:12:49.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:12:49.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:49.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:49.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:49.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:49.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:49.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-19T19:12:49.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-19T19:12:49.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-19T19:12:49.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-19T19:12:49.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-19T19:12:49.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-19T19:12:49.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-19T19:12:49.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-19T19:12:49.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-19T19:12:49.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-19T19:12:49.792 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-19T19:12:49.792 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-19T19:12:49.792 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-02-19T19:12:49.792 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-02-19T19:12:49.792 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-02-19T19:12:49.792 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: osdmap e79: 6 total, 6 up, 6 in 2024-02-19T19:12:49.792 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:49.792 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-02-19T19:12:50.562 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:50 smithi096 ceph-mon[112483]: Upgrade: Setting container_image for all osd 2024-02-19T19:12:50.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:50 smithi096 ceph-mon[112483]: Upgrade: Setting require_osd_release to 19 squid 2024-02-19T19:12:50.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:50 smithi096 ceph-mon[112483]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-02-19T19:12:50.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:50 smithi096 ceph-mon[112483]: pgmap v175: 65 pgs: 11 peering, 15 active+undersized+degraded, 39 active+clean; 128 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 3004/32076 objects degraded (9.365%) 2024-02-19T19:12:50.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:50 smithi096 ceph-mon[112483]: osdmap e80: 6 total, 6 up, 6 in 2024-02-19T19:12:50.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:50 smithi096 ceph-mon[112483]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-19T19:12:50.563 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-02-19T19:12:50.564 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:50 smithi096 ceph-mon[112483]: fsmap cephfs:2 {0=cephfs.smithi096.pccmys=up:active,1=cephfs.smithi125.srnlol=up:active} 2024-02-19T19:12:50.564 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:12:50.564 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:50.564 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:12:50.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:50 smithi125 ceph-mon[86115]: Upgrade: Setting container_image for all osd 2024-02-19T19:12:50.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:50 smithi125 ceph-mon[86115]: Upgrade: Setting require_osd_release to 19 squid 2024-02-19T19:12:50.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:50 smithi125 ceph-mon[86115]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-02-19T19:12:50.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:50 smithi125 ceph-mon[86115]: pgmap v175: 65 pgs: 11 peering, 15 active+undersized+degraded, 39 active+clean; 128 MiB data, 684 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 3004/32076 objects degraded (9.365%) 2024-02-19T19:12:50.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:50 smithi125 ceph-mon[86115]: osdmap e80: 6 total, 6 up, 6 in 2024-02-19T19:12:50.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:50 smithi125 ceph-mon[86115]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-02-19T19:12:50.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-02-19T19:12:50.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:50 smithi125 ceph-mon[86115]: fsmap cephfs:2 {0=cephfs.smithi096.pccmys=up:active,1=cephfs.smithi125.srnlol=up:active} 2024-02-19T19:12:50.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:12:50.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:50.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:12:51.038 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:50 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096[112479]: 2024-02-19T19:12:50.539+0000 7f3a872a3700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-19T19:12:51.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:12:51.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:12:51.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:51.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:12:51.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:51.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:51.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:51.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:51.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-02-19T19:12:51.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:51 smithi125 ceph-mon[86115]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-19T19:12:51.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:51 smithi125 ceph-mon[86115]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-19T19:12:51.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:51 smithi125 ceph-mon[86115]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-19T19:12:51.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-02-19T19:12:51.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:51 smithi125 ceph-mon[86115]: osdmap e81: 6 total, 6 up, 6 in 2024-02-19T19:12:51.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:51 smithi125 ceph-mon[86115]: mds.? [v2:172.21.15.125:6826/1056749509,v1:172.21.15.125:6827/1056749509] up:boot 2024-02-19T19:12:51.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:51 smithi125 ceph-mon[86115]: mds.? [v2:172.21.15.96:6826/2521991256,v1:172.21.15.96:6827/2521991256] up:boot 2024-02-19T19:12:51.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:51 smithi125 ceph-mon[86115]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-02-19T19:12:51.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.usrmcg"}]: dispatch 2024-02-19T19:12:51.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.pwyuga"}]: dispatch 2024-02-19T19:12:51.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:12:51.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:12:51.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:51.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:12:51.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:51.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:51.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:51.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:12:51.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-02-19T19:12:51.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:51 smithi096 ceph-mon[112483]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-19T19:12:51.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:51 smithi096 ceph-mon[112483]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-19T19:12:51.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:51 smithi096 ceph-mon[112483]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-02-19T19:12:51.792 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-02-19T19:12:51.792 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:51 smithi096 ceph-mon[112483]: osdmap e81: 6 total, 6 up, 6 in 2024-02-19T19:12:51.792 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:51 smithi096 ceph-mon[112483]: mds.? [v2:172.21.15.125:6826/1056749509,v1:172.21.15.125:6827/1056749509] up:boot 2024-02-19T19:12:51.792 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:51 smithi096 ceph-mon[112483]: mds.? [v2:172.21.15.96:6826/2521991256,v1:172.21.15.96:6827/2521991256] up:boot 2024-02-19T19:12:51.793 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:51 smithi096 ceph-mon[112483]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-02-19T19:12:51.793 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.usrmcg"}]: dispatch 2024-02-19T19:12:51.793 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.pwyuga"}]: dispatch 2024-02-19T19:12:52.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:52 smithi125 ceph-mon[86115]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-02-19T19:12:52.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:52 smithi125 ceph-mon[86115]: pgmap v178: 65 pgs: 11 peering, 54 active+clean; 128 MiB data, 688 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:12:52.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:52 smithi125 ceph-mon[86115]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3004/32076 objects degraded (9.365%), 15 pgs degraded) 2024-02-19T19:12:52.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:52 smithi125 ceph-mon[86115]: mds.? [v2:172.21.15.125:6824/4095955007,v1:172.21.15.125:6825/4095955007] up:boot 2024-02-19T19:12:52.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:52 smithi125 ceph-mon[86115]: mds.? [v2:172.21.15.96:6828/3591142469,v1:172.21.15.96:6829/3591142469] up:boot 2024-02-19T19:12:52.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:52 smithi125 ceph-mon[86115]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:12:52.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:52 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pccmys"}]: dispatch 2024-02-19T19:12:52.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:52 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.srnlol"}]: dispatch 2024-02-19T19:12:52.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:52 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:52.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:52 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.usrmcg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:12:52.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:52 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:12:52.749 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:52 smithi096 ceph-mon[112483]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-02-19T19:12:52.749 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:52 smithi096 ceph-mon[112483]: pgmap v178: 65 pgs: 11 peering, 54 active+clean; 128 MiB data, 688 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:12:52.749 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:52 smithi096 ceph-mon[112483]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3004/32076 objects degraded (9.365%), 15 pgs degraded) 2024-02-19T19:12:52.749 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:52 smithi096 ceph-mon[112483]: mds.? [v2:172.21.15.125:6824/4095955007,v1:172.21.15.125:6825/4095955007] up:boot 2024-02-19T19:12:52.750 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:52 smithi096 ceph-mon[112483]: mds.? [v2:172.21.15.96:6828/3591142469,v1:172.21.15.96:6829/3591142469] up:boot 2024-02-19T19:12:52.750 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:52 smithi096 ceph-mon[112483]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:12:52.750 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:52 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pccmys"}]: dispatch 2024-02-19T19:12:52.750 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:52 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.srnlol"}]: dispatch 2024-02-19T19:12:52.750 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:52 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:12:52.750 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:52 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.usrmcg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:12:52.750 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:52 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:12:53.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:53 smithi125 ceph-mon[86115]: Upgrade: Updating mds.cephfs.smithi096.usrmcg 2024-02-19T19:12:53.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:53 smithi125 ceph-mon[86115]: Deploying daemon mds.cephfs.smithi096.usrmcg on smithi096 2024-02-19T19:12:53.775 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:53 smithi096 ceph-mon[112483]: Upgrade: Updating mds.cephfs.smithi096.usrmcg 2024-02-19T19:12:53.775 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:53 smithi096 ceph-mon[112483]: Deploying daemon mds.cephfs.smithi096.usrmcg on smithi096 2024-02-19T19:12:54.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:54 smithi125 ceph-mon[86115]: pgmap v179: 65 pgs: 11 peering, 54 active+clean; 128 MiB data, 688 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:12:54.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:54 smithi096 ceph-mon[112483]: pgmap v179: 65 pgs: 11 peering, 54 active+clean; 128 MiB data, 688 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:12:55.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:55 smithi125 ceph-mon[86115]: osdmap e82: 6 total, 6 up, 6 in 2024-02-19T19:12:55.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:55 smithi125 ceph-mon[86115]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-19T19:12:55.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:55 smithi096 ceph-mon[112483]: osdmap e82: 6 total, 6 up, 6 in 2024-02-19T19:12:55.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:55 smithi096 ceph-mon[112483]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-19T19:12:56.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:56 smithi125 ceph-mon[86115]: pgmap v181: 65 pgs: 65 active+clean; 128 MiB data, 688 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:12:56.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:56 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.usrmcg"}]: dispatch 2024-02-19T19:12:56.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:56 smithi096 ceph-mon[112483]: pgmap v181: 65 pgs: 65 active+clean; 128 MiB data, 688 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:12:56.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:56 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.usrmcg"}]: dispatch 2024-02-19T19:12:58.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:12:58 smithi125 ceph-mon[86115]: pgmap v182: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:12:58.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:12:58 smithi096 ceph-mon[112483]: pgmap v182: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:00.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:00 smithi125 ceph-mon[86115]: pgmap v183: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:00.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:00.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:00.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:13:00.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:00.719 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:00 smithi096 ceph-mon[112483]: pgmap v183: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:00.719 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:00.720 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:00.720 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:13:00.720 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:01.575 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:01 smithi096 ceph-mon[112483]: mds.? [v2:172.21.15.96:6826/3847593496,v1:172.21.15.96:6827/3847593496] up:boot 2024-02-19T19:13:01.575 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:01 smithi096 ceph-mon[112483]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:13:01.575 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:01 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.usrmcg"}]: dispatch 2024-02-19T19:13:01.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:01 smithi125 ceph-mon[86115]: mds.? [v2:172.21.15.96:6826/3847593496,v1:172.21.15.96:6827/3847593496] up:boot 2024-02-19T19:13:01.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:01 smithi125 ceph-mon[86115]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:13:01.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:01 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.usrmcg"}]: dispatch 2024-02-19T19:13:02.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:02 smithi125 ceph-mon[86115]: pgmap v184: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-02-19T19:13:02.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:02 smithi096 ceph-mon[112483]: pgmap v184: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-02-19T19:13:03.716 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:03 smithi096 ceph-mon[112483]: pgmap v185: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-02-19T19:13:03.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:03 smithi125 ceph-mon[86115]: pgmap v185: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-02-19T19:13:06.203 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:06.204 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:06.204 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:05 smithi125 ceph-mon[86115]: pgmap v186: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:06.204 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:06.204 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:13:06.288 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:06.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:06.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:05 smithi096 ceph-mon[112483]: pgmap v186: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:06.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:06.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:13:07.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:07.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:07.453 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:07.454 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:08.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:07 smithi096 ceph-mon[112483]: pgmap v187: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:08.453 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:07 smithi125 ceph-mon[86115]: pgmap v187: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:10.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:10 smithi125 ceph-mon[86115]: pgmap v188: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:10.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:10 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:10.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:10 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:10.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:10 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:13:10.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:10 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:13:10.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:10 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:10.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:10 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:13:10.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:10 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:10.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:10 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:10.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:10 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:10.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:10 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:10.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:10 smithi096 ceph-mon[112483]: pgmap v188: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:10.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:10 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:10.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:10 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:10.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:10 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:13:10.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:10 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:13:10.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:10 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:10.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:10 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:13:10.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:10 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:10.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:10 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:10.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:10 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:10.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:10 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:12.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:12 smithi096 ceph-mon[112483]: Upgrade: Updating mds.cephfs.smithi096.pccmys 2024-02-19T19:13:12.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:12 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:12.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:12 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.pccmys", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:13:12.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:12 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:13:12.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:12 smithi096 ceph-mon[112483]: Deploying daemon mds.cephfs.smithi096.pccmys on smithi096 2024-02-19T19:13:12.290 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:12 smithi096 ceph-mon[112483]: pgmap v189: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:12.453 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:12 smithi125 ceph-mon[86115]: Upgrade: Updating mds.cephfs.smithi096.pccmys 2024-02-19T19:13:12.454 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:12 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:12.454 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:12 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi096.pccmys", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:13:12.454 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:12 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:13:12.454 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:12 smithi125 ceph-mon[86115]: Deploying daemon mds.cephfs.smithi096.pccmys on smithi096 2024-02-19T19:13:12.454 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:12 smithi125 ceph-mon[86115]: pgmap v189: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:14.625 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:14 smithi096 ceph-mon[112483]: osdmap e83: 6 total, 6 up, 6 in 2024-02-19T19:13:14.626 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:14 smithi096 ceph-mon[112483]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-19T19:13:14.626 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:14 smithi096 ceph-mon[112483]: pgmap v191: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:14.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:14 smithi125 ceph-mon[86115]: osdmap e83: 6 total, 6 up, 6 in 2024-02-19T19:13:14.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:14 smithi125 ceph-mon[86115]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-19T19:13:14.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:14 smithi125 ceph-mon[86115]: pgmap v191: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:16.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.396+0000 7f5e7e0fa700 1 -- 172.21.15.96:0/2146484905 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e78102700 msgr2=0x7f5e7810abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:16.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.396+0000 7f5e7e0fa700 1 --2- 172.21.15.96:0/2146484905 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e78102700 0x7f5e7810abf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009910 tx=0x7f5e60009c20 comp rx=0 tx=0).stop 2024-02-19T19:13:16.421 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.396+0000 7f5e7e0fa700 1 -- 172.21.15.96:0/2146484905 shutdown_connections 2024-02-19T19:13:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.396+0000 7f5e7e0fa700 1 --2- 172.21.15.96:0/2146484905 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e78102700 0x7f5e7810abf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.396+0000 7f5e7e0fa700 1 --2- 172.21.15.96:0/2146484905 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e78101de0 0x7f5e781021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.396+0000 7f5e7e0fa700 1 -- 172.21.15.96:0/2146484905 >> 172.21.15.96:0/2146484905 conn(0x7f5e780fb610 msgr2=0x7f5e780fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.396+0000 7f5e7e0fa700 1 -- 172.21.15.96:0/2146484905 shutdown_connections 2024-02-19T19:13:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.396+0000 7f5e7e0fa700 1 -- 172.21.15.96:0/2146484905 wait complete. 2024-02-19T19:13:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.397+0000 7f5e7e0fa700 1 Processor -- start 2024-02-19T19:13:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.397+0000 7f5e7e0fa700 1 -- start start 2024-02-19T19:13:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.397+0000 7f5e7e0fa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e78101de0 0x7f5e7819c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:16.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.397+0000 7f5e7e0fa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e78102700 0x7f5e7819cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:16.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.397+0000 7f5e7e0fa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7819d220 con 0x7f5e78102700 2024-02-19T19:13:16.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.397+0000 7f5e7e0fa700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e78196720 con 0x7f5e78101de0 2024-02-19T19:13:16.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.397+0000 7f5e76ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e78102700 0x7f5e7819cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:16.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.397+0000 7f5e76ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e78102700 0x7f5e7819cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46864/0 (socket says 172.21.15.96:46864) 2024-02-19T19:13:16.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.397+0000 7f5e76ffd700 1 -- 172.21.15.96:0/2018769996 learned_addr learned my addr 172.21.15.96:0/2018769996 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:13:16.423 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.397+0000 7f5e777fe700 1 --2- 172.21.15.96:0/2018769996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e78101de0 0x7f5e7819c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:16.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.398+0000 7f5e777fe700 1 -- 172.21.15.96:0/2018769996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e78102700 msgr2=0x7f5e7819cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:16.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.398+0000 7f5e777fe700 1 --2- 172.21.15.96:0/2018769996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e78102700 0x7f5e7819cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:16.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.398+0000 7f5e777fe700 1 -- 172.21.15.96:0/2018769996 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e600095f0 con 0x7f5e78101de0 2024-02-19T19:13:16.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.398+0000 7f5e76ffd700 1 --2- 172.21.15.96:0/2018769996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e78102700 0x7f5e7819cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:13:16.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.398+0000 7f5e777fe700 1 --2- 172.21.15.96:0/2018769996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e78101de0 0x7f5e7819c650 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5e7000ada0 tx=0x7f5e7000c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:16.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.398+0000 7f5e74ff9700 1 -- 172.21.15.96:0/2018769996 <== mon.1 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e7000f070 con 0x7f5e78101de0 2024-02-19T19:13:16.424 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.398+0000 7f5e7e0fa700 1 -- 172.21.15.96:0/2018769996 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e78196a00 con 0x7f5e78101de0 2024-02-19T19:13:16.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.398+0000 7f5e74ff9700 1 -- 172.21.15.96:0/2018769996 <== mon.1 v2:172.21.15.125:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5e7000a2a0 con 0x7f5e78101de0 2024-02-19T19:13:16.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.399+0000 7f5e74ff9700 1 -- 172.21.15.96:0/2018769996 <== mon.1 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e70005580 con 0x7f5e78101de0 2024-02-19T19:13:16.425 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.399+0000 7f5e7e0fa700 1 -- 172.21.15.96:0/2018769996 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e78196f50 con 0x7f5e78101de0 2024-02-19T19:13:16.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.400+0000 7f5e7e0fa700 1 -- 172.21.15.96:0/2018769996 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e781082f0 con 0x7f5e78101de0 2024-02-19T19:13:16.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.400+0000 7f5e74ff9700 1 -- 172.21.15.96:0/2018769996 <== mon.1 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f5e7000c900 con 0x7f5e78101de0 2024-02-19T19:13:16.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.401+0000 7f5e74ff9700 1 --2- 172.21.15.96:0/2018769996 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f5e6406d8a0 0x7f5e6406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:16.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.401+0000 7f5e74ff9700 1 -- 172.21.15.96:0/2018769996 <== mon.1 v2:172.21.15.125:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5e7008ce90 con 0x7f5e78101de0 2024-02-19T19:13:16.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.401+0000 7f5e76ffd700 1 --2- 172.21.15.96:0/2018769996 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f5e6406d8a0 0x7f5e6406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:16.426 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.401+0000 7f5e76ffd700 1 --2- 172.21.15.96:0/2018769996 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f5e6406d8a0 0x7f5e6406fd60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5e78197b40 tx=0x7f5e6001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:16.429 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.406+0000 7f5e74ff9700 1 -- 172.21.15.96:0/2018769996 <== mon.1 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5e7005a150 con 0x7f5e78101de0 2024-02-19T19:13:16.651 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.628+0000 7f5e7e0fa700 1 -- 172.21.15.96:0/2018769996 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e781971c0 con 0x7f5e6406d8a0 2024-02-19T19:13:16.652 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.630+0000 7f5e74ff9700 1 -- 172.21.15.96:0/2018769996 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5e781971c0 con 0x7f5e6406d8a0 2024-02-19T19:13:16.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.632+0000 7f5e7e0fa700 1 -- 172.21.15.96:0/2018769996 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f5e6406d8a0 msgr2=0x7f5e6406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:16.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.632+0000 7f5e7e0fa700 1 --2- 172.21.15.96:0/2018769996 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f5e6406d8a0 0x7f5e6406fd60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5e78197b40 tx=0x7f5e6001a040 comp rx=0 tx=0).stop 2024-02-19T19:13:16.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.632+0000 7f5e7e0fa700 1 -- 172.21.15.96:0/2018769996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e78101de0 msgr2=0x7f5e7819c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:16.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.632+0000 7f5e7e0fa700 1 --2- 172.21.15.96:0/2018769996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e78101de0 0x7f5e7819c650 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5e7000ada0 tx=0x7f5e7000c330 comp rx=0 tx=0).stop 2024-02-19T19:13:16.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.632+0000 7f5e7e0fa700 1 -- 172.21.15.96:0/2018769996 shutdown_connections 2024-02-19T19:13:16.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.632+0000 7f5e7e0fa700 1 --2- 172.21.15.96:0/2018769996 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f5e6406d8a0 0x7f5e6406fd60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:16.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.632+0000 7f5e7e0fa700 1 --2- 172.21.15.96:0/2018769996 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5e78101de0 0x7f5e7819c650 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:16.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.632+0000 7f5e7e0fa700 1 --2- 172.21.15.96:0/2018769996 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5e78102700 0x7f5e7819cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:16.655 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.632+0000 7f5e7e0fa700 1 -- 172.21.15.96:0/2018769996 >> 172.21.15.96:0/2018769996 conn(0x7f5e780fb610 msgr2=0x7f5e78105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:16.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.632+0000 7f5e7e0fa700 1 -- 172.21.15.96:0/2018769996 shutdown_connections 2024-02-19T19:13:16.656 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.632+0000 7f5e7e0fa700 1 -- 172.21.15.96:0/2018769996 wait complete. 2024-02-19T19:13:16.666 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:13:16.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:16 smithi125 ceph-mon[86115]: pgmap v192: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:16.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:16 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:16.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:16 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:16.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:16 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:13:16.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.742+0000 7fd289de6700 1 -- 172.21.15.96:0/1605304982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd284105bd0 msgr2=0x7fd284105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:16.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.742+0000 7fd289de6700 1 --2- 172.21.15.96:0/1605304982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd284105bd0 0x7fd284105fb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd274009910 tx=0x7fd274009c20 comp rx=0 tx=0).stop 2024-02-19T19:13:16.764 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.742+0000 7fd289de6700 1 -- 172.21.15.96:0/1605304982 shutdown_connections 2024-02-19T19:13:16.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.742+0000 7fd289de6700 1 --2- 172.21.15.96:0/1605304982 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd2840ffc20 0x7fd284100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:16.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.742+0000 7fd289de6700 1 --2- 172.21.15.96:0/1605304982 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd284105bd0 0x7fd284105fb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:16.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.742+0000 7fd289de6700 1 -- 172.21.15.96:0/1605304982 >> 172.21.15.96:0/1605304982 conn(0x7fd284075670 msgr2=0x7fd284075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:16.765 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:16 smithi096 ceph-mon[112483]: pgmap v192: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:16.765 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:16 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:16.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:16 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:16.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:16 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:13:16.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.742+0000 7fd289de6700 1 -- 172.21.15.96:0/1605304982 shutdown_connections 2024-02-19T19:13:16.767 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.742+0000 7fd289de6700 1 -- 172.21.15.96:0/1605304982 wait complete. 2024-02-19T19:13:16.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.743+0000 7fd289de6700 1 Processor -- start 2024-02-19T19:13:16.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.743+0000 7fd289de6700 1 -- start start 2024-02-19T19:13:16.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.743+0000 7fd289de6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2840ffc20 0x7fd2841976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:16.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.743+0000 7fd289de6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd284105bd0 0x7fd284197bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:16.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.743+0000 7fd289de6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd284198240 con 0x7fd2840ffc20 2024-02-19T19:13:16.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.743+0000 7fd289de6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2841983b0 con 0x7fd284105bd0 2024-02-19T19:13:16.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.743+0000 7fd2837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2840ffc20 0x7fd2841976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:16.768 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.743+0000 7fd2837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2840ffc20 0x7fd2841976b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46886/0 (socket says 172.21.15.96:46886) 2024-02-19T19:13:16.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.743+0000 7fd2837fe700 1 -- 172.21.15.96:0/2159060126 learned_addr learned my addr 172.21.15.96:0/2159060126 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:13:16.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.743+0000 7fd282ffd700 1 --2- 172.21.15.96:0/2159060126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd284105bd0 0x7fd284197bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:16.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.744+0000 7fd2837fe700 1 -- 172.21.15.96:0/2159060126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd284105bd0 msgr2=0x7fd284197bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:16.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.744+0000 7fd2837fe700 1 --2- 172.21.15.96:0/2159060126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd284105bd0 0x7fd284197bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:16.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.744+0000 7fd2837fe700 1 -- 172.21.15.96:0/2159060126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2740095f0 con 0x7fd2840ffc20 2024-02-19T19:13:16.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.744+0000 7fd2837fe700 1 --2- 172.21.15.96:0/2159060126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2840ffc20 0x7fd2841976b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd274006010 tx=0x7fd27400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:16.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.744+0000 7fd280ff9700 1 -- 172.21.15.96:0/2159060126 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd27401d070 con 0x7fd2840ffc20 2024-02-19T19:13:16.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.744+0000 7fd280ff9700 1 -- 172.21.15.96:0/2159060126 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd27400f460 con 0x7fd2840ffc20 2024-02-19T19:13:16.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.744+0000 7fd289de6700 1 -- 172.21.15.96:0/2159060126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2841a0720 con 0x7fd2840ffc20 2024-02-19T19:13:16.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.744+0000 7fd280ff9700 1 -- 172.21.15.96:0/2159060126 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd274017630 con 0x7fd2840ffc20 2024-02-19T19:13:16.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.744+0000 7fd289de6700 1 -- 172.21.15.96:0/2159060126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2841a0b30 con 0x7fd2840ffc20 2024-02-19T19:13:16.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.745+0000 7fd289de6700 1 -- 172.21.15.96:0/2159060126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2841080f0 con 0x7fd2840ffc20 2024-02-19T19:13:16.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.746+0000 7fd280ff9700 1 -- 172.21.15.96:0/2159060126 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fd274003a60 con 0x7fd2840ffc20 2024-02-19T19:13:16.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.746+0000 7fd280ff9700 1 --2- 172.21.15.96:0/2159060126 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd26c06d8a0 0x7fd26c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:16.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.747+0000 7fd280ff9700 1 -- 172.21.15.96:0/2159060126 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd27408ea90 con 0x7fd2840ffc20 2024-02-19T19:13:16.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.747+0000 7fd282ffd700 1 --2- 172.21.15.96:0/2159060126 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd26c06d8a0 0x7fd26c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:16.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.747+0000 7fd282ffd700 1 --2- 172.21.15.96:0/2159060126 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd26c06d8a0 0x7fd26c06fd60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd2840691d0 tx=0x7fd27800a380 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:16.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.750+0000 7fd280ff9700 1 -- 172.21.15.96:0/2159060126 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd2740582e0 con 0x7fd2840ffc20 2024-02-19T19:13:17.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.992+0000 7fd289de6700 1 -- 172.21.15.96:0/2159060126 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd284068cd0 con 0x7fd26c06d8a0 2024-02-19T19:13:17.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.993+0000 7fd280ff9700 1 -- 172.21.15.96:0/2159060126 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd284068cd0 con 0x7fd26c06d8a0 2024-02-19T19:13:17.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.995+0000 7fd289de6700 1 -- 172.21.15.96:0/2159060126 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd26c06d8a0 msgr2=0x7fd26c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:17.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.995+0000 7fd289de6700 1 --2- 172.21.15.96:0/2159060126 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd26c06d8a0 0x7fd26c06fd60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd2840691d0 tx=0x7fd27800a380 comp rx=0 tx=0).stop 2024-02-19T19:13:17.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.995+0000 7fd289de6700 1 -- 172.21.15.96:0/2159060126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2840ffc20 msgr2=0x7fd2841976b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:17.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.995+0000 7fd289de6700 1 --2- 172.21.15.96:0/2159060126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2840ffc20 0x7fd2841976b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd274006010 tx=0x7fd27400bd70 comp rx=0 tx=0).stop 2024-02-19T19:13:17.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.995+0000 7fd289de6700 1 -- 172.21.15.96:0/2159060126 shutdown_connections 2024-02-19T19:13:17.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.995+0000 7fd289de6700 1 --2- 172.21.15.96:0/2159060126 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd26c06d8a0 0x7fd26c06fd60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:17.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.995+0000 7fd289de6700 1 --2- 172.21.15.96:0/2159060126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd2840ffc20 0x7fd2841976b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:17.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.995+0000 7fd289de6700 1 --2- 172.21.15.96:0/2159060126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd284105bd0 0x7fd284197bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:17.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.995+0000 7fd289de6700 1 -- 172.21.15.96:0/2159060126 >> 172.21.15.96:0/2159060126 conn(0x7fd284075670 msgr2=0x7fd2840feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:17.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.996+0000 7fd289de6700 1 -- 172.21.15.96:0/2159060126 shutdown_connections 2024-02-19T19:13:17.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:16.996+0000 7fd289de6700 1 -- 172.21.15.96:0/2159060126 wait complete. 2024-02-19T19:13:17.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.100+0000 7fd164f95700 1 -- 172.21.15.96:0/1688615644 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd160101850 msgr2=0x7fd1601058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:17.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.100+0000 7fd164f95700 1 --2- 172.21.15.96:0/1688615644 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd160101850 0x7fd1601058a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd15400b0a0 tx=0x7fd15400b3b0 comp rx=0 tx=0).stop 2024-02-19T19:13:17.123 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.100+0000 7fd164f95700 1 -- 172.21.15.96:0/1688615644 shutdown_connections 2024-02-19T19:13:17.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.100+0000 7fd164f95700 1 --2- 172.21.15.96:0/1688615644 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd160101850 0x7fd1601058a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:17.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.100+0000 7fd164f95700 1 --2- 172.21.15.96:0/1688615644 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd160100ea0 0x7fd160101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:17.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.100+0000 7fd164f95700 1 -- 172.21.15.96:0/1688615644 >> 172.21.15.96:0/1688615644 conn(0x7fd1600fc750 msgr2=0x7fd1600feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:17.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.100+0000 7fd164f95700 1 -- 172.21.15.96:0/1688615644 shutdown_connections 2024-02-19T19:13:17.124 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.100+0000 7fd164f95700 1 -- 172.21.15.96:0/1688615644 wait complete. 2024-02-19T19:13:17.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.101+0000 7fd164f95700 1 Processor -- start 2024-02-19T19:13:17.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.101+0000 7fd164f95700 1 -- start start 2024-02-19T19:13:17.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.101+0000 7fd164f95700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd160100ea0 0x7fd16019c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:17.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.101+0000 7fd164f95700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd160101850 0x7fd16019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:17.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.101+0000 7fd164f95700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16019d2d0 con 0x7fd160101850 2024-02-19T19:13:17.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.101+0000 7fd164f95700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd160196780 con 0x7fd160100ea0 2024-02-19T19:13:17.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.101+0000 7fd15dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd160101850 0x7fd16019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:17.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.102+0000 7fd15dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd160101850 0x7fd16019cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46918/0 (socket says 172.21.15.96:46918) 2024-02-19T19:13:17.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.102+0000 7fd15dd9b700 1 -- 172.21.15.96:0/3036786034 learned_addr learned my addr 172.21.15.96:0/3036786034 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:13:17.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.102+0000 7fd15dd9b700 1 -- 172.21.15.96:0/3036786034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd160100ea0 msgr2=0x7fd16019c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:17.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.102+0000 7fd15e59c700 1 --2- 172.21.15.96:0/3036786034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd160100ea0 0x7fd16019c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:17.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.102+0000 7fd15dd9b700 1 --2- 172.21.15.96:0/3036786034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd160100ea0 0x7fd16019c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:17.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.102+0000 7fd15dd9b700 1 -- 172.21.15.96:0/3036786034 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd154009d00 con 0x7fd160101850 2024-02-19T19:13:17.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.102+0000 7fd15dd9b700 1 --2- 172.21.15.96:0/3036786034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd160101850 0x7fd16019cc40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd154006130 tx=0x7fd15400cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:17.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.102+0000 7fd14f7fe700 1 -- 172.21.15.96:0/3036786034 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd15400e040 con 0x7fd160101850 2024-02-19T19:13:17.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.102+0000 7fd14f7fe700 1 -- 172.21.15.96:0/3036786034 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd154003de0 con 0x7fd160101850 2024-02-19T19:13:17.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.102+0000 7fd14f7fe700 1 -- 172.21.15.96:0/3036786034 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd15401d8e0 con 0x7fd160101850 2024-02-19T19:13:17.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.102+0000 7fd164f95700 1 -- 172.21.15.96:0/3036786034 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd160196a00 con 0x7fd160101850 2024-02-19T19:13:17.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.102+0000 7fd164f95700 1 -- 172.21.15.96:0/3036786034 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd160196ef0 con 0x7fd160101850 2024-02-19T19:13:17.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.103+0000 7fd164f95700 1 -- 172.21.15.96:0/3036786034 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1601092a0 con 0x7fd160101850 2024-02-19T19:13:17.128 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.104+0000 7fd14f7fe700 1 -- 172.21.15.96:0/3036786034 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fd154004820 con 0x7fd160101850 2024-02-19T19:13:17.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.104+0000 7fd14f7fe700 1 --2- 172.21.15.96:0/3036786034 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd14806d8a0 0x7fd14806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:17.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.104+0000 7fd14f7fe700 1 -- 172.21.15.96:0/3036786034 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd15408edb0 con 0x7fd160101850 2024-02-19T19:13:17.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.104+0000 7fd15e59c700 1 --2- 172.21.15.96:0/3036786034 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd14806d8a0 0x7fd14806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:17.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.105+0000 7fd15e59c700 1 --2- 172.21.15.96:0/3036786034 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd14806d8a0 0x7fd14806fd60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd158005950 tx=0x7fd158005cf0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:17.131 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.109+0000 7fd14f7fe700 1 -- 172.21.15.96:0/3036786034 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd15405c110 con 0x7fd160101850 2024-02-19T19:13:17.341 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.318+0000 7fd164f95700 1 -- 172.21.15.96:0/3036786034 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd160197160 con 0x7fd14806d8a0 2024-02-19T19:13:17.352 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.329+0000 7fd14f7fe700 1 -- 172.21.15.96:0/3036786034 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd160197160 con 0x7fd14806d8a0 2024-02-19T19:13:17.352 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:13:17.352 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (7m) 12s ago 17m 24.9M - 0.25.0 c8568f914cd2 bbaf83a1e476 2024-02-19T19:13:17.352 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (17m) 12s ago 17m 9177k - 18.2.1 94eadd990e0a b41bff2e0043 2024-02-19T19:13:17.352 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (16m) 33s ago 16m 8720k - 18.2.1 94eadd990e0a 254ab7e7a040 2024-02-19T19:13:17.353 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4m) 12s ago 17m 6669k - 19.0.0-1450-gf78a58c0 f081f847070a deea0ffefa0f 2024-02-19T19:13:17.353 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (4m) 33s ago 16m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 3421965dc5b0 2024-02-19T19:13:17.353 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (6m) 12s ago 16m 85.2M - 9.4.12 a0ea5e3c46d9 0102d90938e4 2024-02-19T19:13:17.353 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 starting - - - - 2024-02-19T19:13:17.353 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (17s) 12s ago 11m 10.4M - 19.0.0-1450-gf78a58c0 f081f847070a a24f6ad0b131 2024-02-19T19:13:17.353 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (11m) 33s ago 11m 53.9M - 18.2.1 94eadd990e0a 211d64de8a63 2024-02-19T19:13:17.353 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (11m) 33s ago 11m 75.0M - 18.2.1 94eadd990e0a 2a04b5a8eaf4 2024-02-19T19:13:17.354 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:8443,9283,8765 running (8m) 12s ago 18m 508M - 19.0.0-1450-gf78a58c0 f081f847070a a86fbe94fe3f 2024-02-19T19:13:17.354 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (8m) 33s ago 15m 450M - 19.0.0-1450-gf78a58c0 f081f847070a e250486d572d 2024-02-19T19:13:17.354 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (5m) 12s ago 18m 55.2M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d70090d516e3 2024-02-19T19:13:17.354 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (4m) 33s ago 15m 43.4M 2048M 19.0.0-1450-gf78a58c0 f081f847070a f56b17bdc9a0 2024-02-19T19:13:17.354 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (8m) 12s ago 17m 15.4M - 1.5.0 0da6a335fe13 51f622ea33d6 2024-02-19T19:13:17.354 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (8m) 33s ago 16m 17.3M - 1.5.0 0da6a335fe13 464e076a52a1 2024-02-19T19:13:17.354 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (3m) 12s ago 15m 105M 1216M 19.0.0-1450-gf78a58c0 f081f847070a b3dffd6a3fb2 2024-02-19T19:13:17.355 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3m) 12s ago 14m 107M 1216M 19.0.0-1450-gf78a58c0 f081f847070a f0dd6d8f952f 2024-02-19T19:13:17.355 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (2m) 12s ago 14m 96.2M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 51b70eaaa7a9 2024-02-19T19:13:17.355 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (2m) 33s ago 13m 77.9M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 73b832b7b243 2024-02-19T19:13:17.355 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (89s) 33s ago 13m 80.5M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 1309ffc459f9 2024-02-19T19:13:17.355 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (36s) 33s ago 12m 14.9M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 247b0927920b 2024-02-19T19:13:17.355 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (7m) 12s ago 16m 67.0M - 2.43.0 a07b618ecd1d a4edcf6ed669 2024-02-19T19:13:17.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.332+0000 7fd164f95700 1 -- 172.21.15.96:0/3036786034 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd14806d8a0 msgr2=0x7fd14806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:17.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.332+0000 7fd164f95700 1 --2- 172.21.15.96:0/3036786034 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd14806d8a0 0x7fd14806fd60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd158005950 tx=0x7fd158005cf0 comp rx=0 tx=0).stop 2024-02-19T19:13:17.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.332+0000 7fd164f95700 1 -- 172.21.15.96:0/3036786034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd160101850 msgr2=0x7fd16019cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:17.356 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.332+0000 7fd164f95700 1 --2- 172.21.15.96:0/3036786034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd160101850 0x7fd16019cc40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd154006130 tx=0x7fd15400cdd0 comp rx=0 tx=0).stop 2024-02-19T19:13:17.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.332+0000 7fd164f95700 1 -- 172.21.15.96:0/3036786034 shutdown_connections 2024-02-19T19:13:17.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.332+0000 7fd164f95700 1 --2- 172.21.15.96:0/3036786034 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd14806d8a0 0x7fd14806fd60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:17.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.332+0000 7fd164f95700 1 --2- 172.21.15.96:0/3036786034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd160100ea0 0x7fd16019c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:17.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.332+0000 7fd164f95700 1 --2- 172.21.15.96:0/3036786034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd160101850 0x7fd16019cc40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:17.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.332+0000 7fd164f95700 1 -- 172.21.15.96:0/3036786034 >> 172.21.15.96:0/3036786034 conn(0x7fd1600fc750 msgr2=0x7fd1600fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:17.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.332+0000 7fd164f95700 1 -- 172.21.15.96:0/3036786034 shutdown_connections 2024-02-19T19:13:17.357 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.332+0000 7fd164f95700 1 -- 172.21.15.96:0/3036786034 wait complete. 2024-02-19T19:13:17.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.447+0000 7fefa9123700 1 -- 172.21.15.96:0/3324262860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa40ffc20 msgr2=0x7fefa4100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:17.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.447+0000 7fefa9123700 1 --2- 172.21.15.96:0/3324262860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa40ffc20 0x7fefa4100080 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fef98009910 tx=0x7fef98009c20 comp rx=0 tx=0).stop 2024-02-19T19:13:17.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.447+0000 7fefa9123700 1 -- 172.21.15.96:0/3324262860 shutdown_connections 2024-02-19T19:13:17.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.447+0000 7fefa9123700 1 --2- 172.21.15.96:0/3324262860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa40ffc20 0x7fefa4100080 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:17.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.447+0000 7fefa9123700 1 --2- 172.21.15.96:0/3324262860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefa4105bd0 0x7fefa4105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:17.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.447+0000 7fefa9123700 1 -- 172.21.15.96:0/3324262860 >> 172.21.15.96:0/3324262860 conn(0x7fefa4075670 msgr2=0x7fefa4075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:17.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.447+0000 7fefa9123700 1 -- 172.21.15.96:0/3324262860 shutdown_connections 2024-02-19T19:13:17.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.447+0000 7fefa9123700 1 -- 172.21.15.96:0/3324262860 wait complete. 2024-02-19T19:13:17.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.448+0000 7fefa9123700 1 Processor -- start 2024-02-19T19:13:17.472 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.448+0000 7fefa9123700 1 -- start start 2024-02-19T19:13:17.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.449+0000 7fefa9123700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefa40ffc20 0x7fefa4197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:17.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.449+0000 7fefa9123700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa4105bd0 0x7fefa4197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:17.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.449+0000 7fefa9123700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa4198380 con 0x7fefa4105bd0 2024-02-19T19:13:17.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.449+0000 7fefa9123700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa41984f0 con 0x7fefa40ffc20 2024-02-19T19:13:17.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.449+0000 7fefa259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa4105bd0 0x7fefa4197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:17.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.449+0000 7fefa259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa4105bd0 0x7fefa4197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46940/0 (socket says 172.21.15.96:46940) 2024-02-19T19:13:17.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.449+0000 7fefa259c700 1 -- 172.21.15.96:0/2939607356 learned_addr learned my addr 172.21.15.96:0/2939607356 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:13:17.476 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.449+0000 7fefa2d9d700 1 --2- 172.21.15.96:0/2939607356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefa40ffc20 0x7fefa4197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:17.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.449+0000 7fefa259c700 1 -- 172.21.15.96:0/2939607356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefa40ffc20 msgr2=0x7fefa4197760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:17.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.449+0000 7fefa259c700 1 --2- 172.21.15.96:0/2939607356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefa40ffc20 0x7fefa4197760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:17.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.449+0000 7fefa259c700 1 -- 172.21.15.96:0/2939607356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef980095f0 con 0x7fefa4105bd0 2024-02-19T19:13:17.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.449+0000 7fefa259c700 1 --2- 172.21.15.96:0/2939607356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa4105bd0 0x7fefa4197ca0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fef98006010 tx=0x7fef9800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:17.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.449+0000 7fef8bfff700 1 -- 172.21.15.96:0/2939607356 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef9801d070 con 0x7fefa4105bd0 2024-02-19T19:13:17.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.450+0000 7fefa9123700 1 -- 172.21.15.96:0/2939607356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa41a07d0 con 0x7fefa4105bd0 2024-02-19T19:13:17.477 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.450+0000 7fef8bfff700 1 -- 172.21.15.96:0/2939607356 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef98004fb0 con 0x7fefa4105bd0 2024-02-19T19:13:17.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.450+0000 7fef8bfff700 1 -- 172.21.15.96:0/2939607356 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef98022ea0 con 0x7fefa4105bd0 2024-02-19T19:13:17.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.450+0000 7fefa9123700 1 -- 172.21.15.96:0/2939607356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa41a0c40 con 0x7fefa4105bd0 2024-02-19T19:13:17.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.451+0000 7fefa9123700 1 -- 172.21.15.96:0/2939607356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa41080d0 con 0x7fefa4105bd0 2024-02-19T19:13:17.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.451+0000 7fef8bfff700 1 -- 172.21.15.96:0/2939607356 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fef98022470 con 0x7fefa4105bd0 2024-02-19T19:13:17.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.451+0000 7fef8bfff700 1 --2- 172.21.15.96:0/2939607356 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fef8c06d8a0 0x7fef8c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:17.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.452+0000 7fef8bfff700 1 -- 172.21.15.96:0/2939607356 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fef9808ec30 con 0x7fefa4105bd0 2024-02-19T19:13:17.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.452+0000 7fefa2d9d700 1 --2- 172.21.15.96:0/2939607356 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fef8c06d8a0 0x7fef8c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:17.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.452+0000 7fefa2d9d700 1 --2- 172.21.15.96:0/2939607356 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fef8c06d8a0 0x7fef8c06fd60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fef94005fd0 tx=0x7fef9400a560 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:17.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.456+0000 7fef8bfff700 1 -- 172.21.15.96:0/2939607356 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fef98058630 con 0x7fefa4105bd0 2024-02-19T19:13:17.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:17 smithi125 ceph-mon[86115]: mds.? [v2:172.21.15.96:6828/2639702047,v1:172.21.15.96:6829/2639702047] up:boot 2024-02-19T19:13:17.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:17 smithi125 ceph-mon[86115]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:13:17.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:17 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pccmys"}]: dispatch 2024-02-19T19:13:17.765 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.742+0000 7fefa9123700 1 -- 172.21.15.96:0/2939607356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fefa404f2e0 con 0x7fefa4105bd0 2024-02-19T19:13:17.765 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:17 smithi096 ceph-mon[112483]: mds.? [v2:172.21.15.96:6828/2639702047,v1:172.21.15.96:6829/2639702047] up:boot 2024-02-19T19:13:17.765 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:17 smithi096 ceph-mon[112483]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:13:17.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi096.pccmys"}]: dispatch 2024-02-19T19:13:17.766 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.743+0000 7fef8bfff700 1 -- 172.21.15.96:0/2939607356 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+805 (secure 0 0 0) 0x7fef98027340 con 0x7fefa4105bd0 2024-02-19T19:13:17.766 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:13:17.766 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:13:17.766 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:13:17.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:13:17.767 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:13:17.767 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:13:17.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:13:17.767 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:13:17.767 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-19T19:13:17.767 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:13:17.767 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:13:17.768 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2, 2024-02-19T19:13:17.768 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:13:17.768 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:13:17.768 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:13:17.768 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2, 2024-02-19T19:13:17.768 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 12 2024-02-19T19:13:17.768 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:13:17.768 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:13:17.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.745+0000 7fefa9123700 1 -- 172.21.15.96:0/2939607356 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fef8c06d8a0 msgr2=0x7fef8c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:17.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.745+0000 7fefa9123700 1 --2- 172.21.15.96:0/2939607356 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fef8c06d8a0 0x7fef8c06fd60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fef94005fd0 tx=0x7fef9400a560 comp rx=0 tx=0).stop 2024-02-19T19:13:17.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.745+0000 7fefa9123700 1 -- 172.21.15.96:0/2939607356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa4105bd0 msgr2=0x7fefa4197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:17.769 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.745+0000 7fefa9123700 1 --2- 172.21.15.96:0/2939607356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa4105bd0 0x7fefa4197ca0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fef98006010 tx=0x7fef9800be20 comp rx=0 tx=0).stop 2024-02-19T19:13:17.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.745+0000 7fefa9123700 1 -- 172.21.15.96:0/2939607356 shutdown_connections 2024-02-19T19:13:17.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.745+0000 7fefa9123700 1 --2- 172.21.15.96:0/2939607356 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fef8c06d8a0 0x7fef8c06fd60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:17.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.745+0000 7fefa9123700 1 --2- 172.21.15.96:0/2939607356 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fefa40ffc20 0x7fefa4197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:17.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.745+0000 7fefa9123700 1 --2- 172.21.15.96:0/2939607356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefa4105bd0 0x7fefa4197ca0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:17.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.745+0000 7fefa9123700 1 -- 172.21.15.96:0/2939607356 >> 172.21.15.96:0/2939607356 conn(0x7fefa4075670 msgr2=0x7fefa40fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:17.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.746+0000 7fefa9123700 1 -- 172.21.15.96:0/2939607356 shutdown_connections 2024-02-19T19:13:17.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.746+0000 7fefa9123700 1 -- 172.21.15.96:0/2939607356 wait complete. 2024-02-19T19:13:17.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.859+0000 7fd4d364f700 1 -- 172.21.15.96:0/1134260753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4cc0ffb40 msgr2=0x7fd4cc0fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:17.883 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.859+0000 7fd4d364f700 1 --2- 172.21.15.96:0/1134260753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4cc0ffb40 0x7fd4cc0fffc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009910 tx=0x7fd4bc009c20 comp rx=0 tx=0).stop 2024-02-19T19:13:17.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.859+0000 7fd4d364f700 1 -- 172.21.15.96:0/1134260753 shutdown_connections 2024-02-19T19:13:17.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.859+0000 7fd4d364f700 1 --2- 172.21.15.96:0/1134260753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4cc0ffb40 0x7fd4cc0fffc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:17.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.859+0000 7fd4d364f700 1 --2- 172.21.15.96:0/1134260753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4cc105bf0 0x7fd4cc105fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:17.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.859+0000 7fd4d364f700 1 -- 172.21.15.96:0/1134260753 >> 172.21.15.96:0/1134260753 conn(0x7fd4cc0fb610 msgr2=0x7fd4cc0fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:17.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.859+0000 7fd4d364f700 1 -- 172.21.15.96:0/1134260753 shutdown_connections 2024-02-19T19:13:17.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.859+0000 7fd4d364f700 1 -- 172.21.15.96:0/1134260753 wait complete. 2024-02-19T19:13:17.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.860+0000 7fd4d364f700 1 Processor -- start 2024-02-19T19:13:17.884 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.860+0000 7fd4d364f700 1 -- start start 2024-02-19T19:13:17.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.860+0000 7fd4d364f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4cc0ffb40 0x7fd4cc197770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:17.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.860+0000 7fd4d364f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4cc105bf0 0x7fd4cc197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:17.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.860+0000 7fd4d364f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4cc1982d0 con 0x7fd4cc0ffb40 2024-02-19T19:13:17.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.860+0000 7fd4d364f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4cc198410 con 0x7fd4cc105bf0 2024-02-19T19:13:17.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.860+0000 7fd4d13eb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4cc0ffb40 0x7fd4cc197770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:17.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.860+0000 7fd4d13eb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4cc0ffb40 0x7fd4cc197770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46956/0 (socket says 172.21.15.96:46956) 2024-02-19T19:13:17.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.860+0000 7fd4d13eb700 1 -- 172.21.15.96:0/2555750510 learned_addr learned my addr 172.21.15.96:0/2555750510 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:13:17.885 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.860+0000 7fd4d0bea700 1 --2- 172.21.15.96:0/2555750510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4cc105bf0 0x7fd4cc197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:17.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.860+0000 7fd4d13eb700 1 -- 172.21.15.96:0/2555750510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4cc105bf0 msgr2=0x7fd4cc197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:17.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.860+0000 7fd4d13eb700 1 --2- 172.21.15.96:0/2555750510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4cc105bf0 0x7fd4cc197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:17.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.860+0000 7fd4d13eb700 1 -- 172.21.15.96:0/2555750510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc0095f0 con 0x7fd4cc0ffb40 2024-02-19T19:13:17.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.860+0000 7fd4d13eb700 1 --2- 172.21.15.96:0/2555750510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4cc0ffb40 0x7fd4cc197770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800b4b0 tx=0x7fd4c800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:17.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.861+0000 7fd4c27fc700 1 -- 172.21.15.96:0/2555750510 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4c8011800 con 0x7fd4cc0ffb40 2024-02-19T19:13:17.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.861+0000 7fd4c27fc700 1 -- 172.21.15.96:0/2555750510 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd4c8011e20 con 0x7fd4cc0ffb40 2024-02-19T19:13:17.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.861+0000 7fd4d364f700 1 -- 172.21.15.96:0/2555750510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4cc1a07e0 con 0x7fd4cc0ffb40 2024-02-19T19:13:17.886 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.861+0000 7fd4c27fc700 1 -- 172.21.15.96:0/2555750510 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4c800f2e0 con 0x7fd4cc0ffb40 2024-02-19T19:13:17.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.861+0000 7fd4d364f700 1 -- 172.21.15.96:0/2555750510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4cc1a0ca0 con 0x7fd4cc0ffb40 2024-02-19T19:13:17.887 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.862+0000 7fd4d364f700 1 -- 172.21.15.96:0/2555750510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4cc108020 con 0x7fd4cc0ffb40 2024-02-19T19:13:17.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.862+0000 7fd4c27fc700 1 -- 172.21.15.96:0/2555750510 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fd4c8010380 con 0x7fd4cc0ffb40 2024-02-19T19:13:17.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.863+0000 7fd4c27fc700 1 --2- 172.21.15.96:0/2555750510 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd4b806d8a0 0x7fd4b806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:17.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.863+0000 7fd4c27fc700 1 -- 172.21.15.96:0/2555750510 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd4c808d060 con 0x7fd4cc0ffb40 2024-02-19T19:13:17.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.863+0000 7fd4d0bea700 1 --2- 172.21.15.96:0/2555750510 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd4b806d8a0 0x7fd4b806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:17.888 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.863+0000 7fd4d0bea700 1 --2- 172.21.15.96:0/2555750510 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd4b806d8a0 0x7fd4b806fd60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0696c0 tx=0x7fd4bc01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:17.889 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:17.867+0000 7fd4c27fc700 1 -- 172.21.15.96:0/2555750510 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd4c8056940 con 0x7fd4cc0ffb40 2024-02-19T19:13:18.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.106+0000 7fd4d364f700 1 -- 172.21.15.96:0/2555750510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd4cc0679c0 con 0x7fd4cc0ffb40 2024-02-19T19:13:18.129 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.107+0000 7fd4c27fc700 1 -- 172.21.15.96:0/2555750510 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+1840 (secure 0 0 0) 0x7fd4c805a000 con 0x7fd4cc0ffb40 2024-02-19T19:13:18.129 INFO:teuthology.orchestra.run.smithi096.stdout:e27 2024-02-19T19:13:18.130 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:13:18.130 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:13:18.130 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2024-02-19T19:13:18.130 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:13:18.130 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:13:18.130 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2024-02-19T19:13:18.130 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 22 2024-02-19T19:13:18.130 INFO:teuthology.orchestra.run.smithi096.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-19T19:13:18.131 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-02-19T19:01:42.881136+0000 2024-02-19T19:13:18.131 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2024-02-19T19:12:50.540695+0000 2024-02-19T19:13:18.131 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2024-02-19T19:13:18.131 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2024-02-19T19:13:18.131 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2024-02-19T19:13:18.131 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2024-02-19T19:13:18.131 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2024-02-19T19:13:18.131 INFO:teuthology.orchestra.run.smithi096.stdout:max_xattr_size 65536 2024-02-19T19:13:18.131 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2024-02-19T19:13:18.132 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2024-02-19T19:13:18.132 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 81 2024-02-19T19:13:18.132 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:13:18.132 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2024-02-19T19:13:18.132 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2024-02-19T19:13:18.132 INFO:teuthology.orchestra.run.smithi096.stdout:up {} 2024-02-19T19:13:18.132 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0,1 2024-02-19T19:13:18.132 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2024-02-19T19:13:18.133 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2024-02-19T19:13:18.133 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2024-02-19T19:13:18.133 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2024-02-19T19:13:18.133 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data enabled 2024-02-19T19:13:18.133 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2024-02-19T19:13:18.133 INFO:teuthology.orchestra.run.smithi096.stdout:bal_rank_mask -1 2024-02-19T19:13:18.133 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2024-02-19T19:13:18.133 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:13:18.133 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:13:18.133 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2024-02-19T19:13:18.134 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:13:18.134 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.usrmcg{-1:34458} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/3847593496,v1:172.21.15.96:6827/3847593496] compat {c=[1],r=[1],i=[fff]}] 2024-02-19T19:13:18.134 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pccmys{-1:34462} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/2639702047,v1:172.21.15.96:6829/2639702047] compat {c=[1],r=[1],i=[fff]}] 2024-02-19T19:13:18.134 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.pwyuga{-1:44347} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.125:6826/1056749509,v1:172.21.15.125:6827/1056749509] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:13:18.134 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.srnlol{-1:44357} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.125:6824/4095955007,v1:172.21.15.125:6825/4095955007] compat {c=[1],r=[1],i=[7ff]}] 2024-02-19T19:13:18.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.109+0000 7fd4d364f700 1 -- 172.21.15.96:0/2555750510 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd4b806d8a0 msgr2=0x7fd4b806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:18.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.109+0000 7fd4d364f700 1 --2- 172.21.15.96:0/2555750510 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd4b806d8a0 0x7fd4b806fd60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0696c0 tx=0x7fd4bc01a040 comp rx=0 tx=0).stop 2024-02-19T19:13:18.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.109+0000 7fd4d364f700 1 -- 172.21.15.96:0/2555750510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4cc0ffb40 msgr2=0x7fd4cc197770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:18.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.109+0000 7fd4d364f700 1 --2- 172.21.15.96:0/2555750510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4cc0ffb40 0x7fd4cc197770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd4c800b4b0 tx=0x7fd4c800b870 comp rx=0 tx=0).stop 2024-02-19T19:13:18.135 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.109+0000 7fd4d364f700 1 -- 172.21.15.96:0/2555750510 shutdown_connections 2024-02-19T19:13:18.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.109+0000 7fd4d364f700 1 --2- 172.21.15.96:0/2555750510 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd4b806d8a0 0x7fd4b806fd60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:18.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.109+0000 7fd4d364f700 1 --2- 172.21.15.96:0/2555750510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4cc0ffb40 0x7fd4cc197770 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:18.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.109+0000 7fd4d364f700 1 --2- 172.21.15.96:0/2555750510 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4cc105bf0 0x7fd4cc197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:18.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.109+0000 7fd4d364f700 1 -- 172.21.15.96:0/2555750510 >> 172.21.15.96:0/2555750510 conn(0x7fd4cc0fb610 msgr2=0x7fd4cc0fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:18.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.109+0000 7fd4d364f700 1 -- 172.21.15.96:0/2555750510 shutdown_connections 2024-02-19T19:13:18.136 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.109+0000 7fd4d364f700 1 -- 172.21.15.96:0/2555750510 wait complete. 2024-02-19T19:13:18.136 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 27 2024-02-19T19:13:18.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.222+0000 7f672dbe2700 1 -- 172.21.15.96:0/2921042161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67281006b0 msgr2=0x7f6728100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:18.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.222+0000 7f672dbe2700 1 --2- 172.21.15.96:0/2921042161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67281006b0 0x7f6728100a90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6710009910 tx=0x7f6710009c20 comp rx=0 tx=0).stop 2024-02-19T19:13:18.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.222+0000 7f672dbe2700 1 -- 172.21.15.96:0/2921042161 shutdown_connections 2024-02-19T19:13:18.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.222+0000 7f672dbe2700 1 --2- 172.21.15.96:0/2921042161 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6728101060 0x7f67281047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:18.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.222+0000 7f672dbe2700 1 --2- 172.21.15.96:0/2921042161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67281006b0 0x7f6728100a90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:18.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.222+0000 7f672dbe2700 1 -- 172.21.15.96:0/2921042161 >> 172.21.15.96:0/2921042161 conn(0x7f6728074e30 msgr2=0x7f6728075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:18.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.222+0000 7f672dbe2700 1 -- 172.21.15.96:0/2921042161 shutdown_connections 2024-02-19T19:13:18.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.222+0000 7f672dbe2700 1 -- 172.21.15.96:0/2921042161 wait complete. 2024-02-19T19:13:18.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.223+0000 7f672dbe2700 1 Processor -- start 2024-02-19T19:13:18.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.223+0000 7f672dbe2700 1 -- start start 2024-02-19T19:13:18.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.223+0000 7f672dbe2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67281006b0 0x7f6728196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:18.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.223+0000 7f672dbe2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6728101060 0x7f6728196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:18.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.223+0000 7f672dbe2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6728197550 con 0x7f67281006b0 2024-02-19T19:13:18.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.223+0000 7f672dbe2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672819b360 con 0x7f6728101060 2024-02-19T19:13:18.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.223+0000 7f67277fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67281006b0 0x7f6728196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.223+0000 7f67277fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67281006b0 0x7f6728196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46970/0 (socket says 172.21.15.96:46970) 2024-02-19T19:13:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.223+0000 7f67277fe700 1 -- 172.21.15.96:0/4119826842 learned_addr learned my addr 172.21.15.96:0/4119826842 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:13:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.224+0000 7f6726ffd700 1 --2- 172.21.15.96:0/4119826842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6728101060 0x7f6728196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.224+0000 7f67277fe700 1 -- 172.21.15.96:0/4119826842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6728101060 msgr2=0x7f6728196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.224+0000 7f67277fe700 1 --2- 172.21.15.96:0/4119826842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6728101060 0x7f6728196ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.224+0000 7f67277fe700 1 -- 172.21.15.96:0/4119826842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67100095f0 con 0x7f67281006b0 2024-02-19T19:13:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.224+0000 7f67277fe700 1 --2- 172.21.15.96:0/4119826842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67281006b0 0x7f6728196980 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6710006010 tx=0x7f671000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.224+0000 7f6724ff9700 1 -- 172.21.15.96:0/4119826842 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f671001d070 con 0x7f67281006b0 2024-02-19T19:13:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.224+0000 7f6724ff9700 1 -- 172.21.15.96:0/4119826842 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f671000f460 con 0x7f67281006b0 2024-02-19T19:13:18.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.224+0000 7f672dbe2700 1 -- 172.21.15.96:0/4119826842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672819b5e0 con 0x7f67281006b0 2024-02-19T19:13:18.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.224+0000 7f6724ff9700 1 -- 172.21.15.96:0/4119826842 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67100175f0 con 0x7f67281006b0 2024-02-19T19:13:18.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.224+0000 7f672dbe2700 1 -- 172.21.15.96:0/4119826842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672819bad0 con 0x7f67281006b0 2024-02-19T19:13:18.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.225+0000 7f672dbe2700 1 -- 172.21.15.96:0/4119826842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6728108120 con 0x7f67281006b0 2024-02-19T19:13:18.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.226+0000 7f6724ff9700 1 -- 172.21.15.96:0/4119826842 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f671000f5d0 con 0x7f67281006b0 2024-02-19T19:13:18.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.226+0000 7f6724ff9700 1 --2- 172.21.15.96:0/4119826842 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f671406d8a0 0x7f671406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:18.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.226+0000 7f6724ff9700 1 -- 172.21.15.96:0/4119826842 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f671008e9f0 con 0x7f67281006b0 2024-02-19T19:13:18.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.226+0000 7f6726ffd700 1 --2- 172.21.15.96:0/4119826842 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f671406d8a0 0x7f671406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:18.251 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.226+0000 7f6726ffd700 1 --2- 172.21.15.96:0/4119826842 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f671406d8a0 0x7f671406fd60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6718006fd0 tx=0x7f6718008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:18.253 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.231+0000 7f6724ff9700 1 -- 172.21.15.96:0/4119826842 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6710090e60 con 0x7f67281006b0 2024-02-19T19:13:18.470 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.448+0000 7f672dbe2700 1 -- 172.21.15.96:0/4119826842 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6728197df0 con 0x7f671406d8a0 2024-02-19T19:13:18.471 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.449+0000 7f6724ff9700 1 -- 172.21.15.96:0/4119826842 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6728197df0 con 0x7f671406d8a0 2024-02-19T19:13:18.472 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:13:18.472 INFO:teuthology.orchestra.run.smithi096.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:13:18.472 INFO:teuthology.orchestra.run.smithi096.stdout: "in_progress": true, 2024-02-19T19:13:18.472 INFO:teuthology.orchestra.run.smithi096.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:13:18.472 INFO:teuthology.orchestra.run.smithi096.stdout: "services_complete": [ 2024-02-19T19:13:18.472 INFO:teuthology.orchestra.run.smithi096.stdout: "crash", 2024-02-19T19:13:18.473 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr", 2024-02-19T19:13:18.473 INFO:teuthology.orchestra.run.smithi096.stdout: "osd", 2024-02-19T19:13:18.473 INFO:teuthology.orchestra.run.smithi096.stdout: "mon" 2024-02-19T19:13:18.473 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-02-19T19:13:18.473 INFO:teuthology.orchestra.run.smithi096.stdout: "progress": "13/23 daemons upgraded", 2024-02-19T19:13:18.473 INFO:teuthology.orchestra.run.smithi096.stdout: "message": "Currently upgrading mds daemons", 2024-02-19T19:13:18.473 INFO:teuthology.orchestra.run.smithi096.stdout: "is_paused": false 2024-02-19T19:13:18.473 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:13:18.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.451+0000 7f672dbe2700 1 -- 172.21.15.96:0/4119826842 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f671406d8a0 msgr2=0x7f671406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:18.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.451+0000 7f672dbe2700 1 --2- 172.21.15.96:0/4119826842 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f671406d8a0 0x7f671406fd60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6718006fd0 tx=0x7f6718008040 comp rx=0 tx=0).stop 2024-02-19T19:13:18.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.451+0000 7f672dbe2700 1 -- 172.21.15.96:0/4119826842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67281006b0 msgr2=0x7f6728196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:18.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.451+0000 7f672dbe2700 1 --2- 172.21.15.96:0/4119826842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67281006b0 0x7f6728196980 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6710006010 tx=0x7f671000be20 comp rx=0 tx=0).stop 2024-02-19T19:13:18.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.451+0000 7f672dbe2700 1 -- 172.21.15.96:0/4119826842 shutdown_connections 2024-02-19T19:13:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.451+0000 7f672dbe2700 1 --2- 172.21.15.96:0/4119826842 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f671406d8a0 0x7f671406fd60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.451+0000 7f672dbe2700 1 --2- 172.21.15.96:0/4119826842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f67281006b0 0x7f6728196980 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.451+0000 7f672dbe2700 1 --2- 172.21.15.96:0/4119826842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6728101060 0x7f6728196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.451+0000 7f672dbe2700 1 -- 172.21.15.96:0/4119826842 >> 172.21.15.96:0/4119826842 conn(0x7f6728074e30 msgr2=0x7f67280fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.451+0000 7f672dbe2700 1 -- 172.21.15.96:0/4119826842 shutdown_connections 2024-02-19T19:13:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.452+0000 7f672dbe2700 1 -- 172.21.15.96:0/4119826842 wait complete. 2024-02-19T19:13:18.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.573+0000 7f616930e700 1 -- 172.21.15.96:0/3470898250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61640ff5a0 msgr2=0x7f61640ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:18.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.573+0000 7f616930e700 1 --2- 172.21.15.96:0/3470898250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61640ff5a0 0x7f61640ff980 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6154009910 tx=0x7f6154009c20 comp rx=0 tx=0).stop 2024-02-19T19:13:18.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.573+0000 7f616930e700 1 -- 172.21.15.96:0/3470898250 shutdown_connections 2024-02-19T19:13:18.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.573+0000 7f616930e700 1 --2- 172.21.15.96:0/3470898250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61640fff50 0x7f6164105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:18.596 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.573+0000 7f616930e700 1 --2- 172.21.15.96:0/3470898250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61640ff5a0 0x7f61640ff980 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:18.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.573+0000 7f616930e700 1 -- 172.21.15.96:0/3470898250 >> 172.21.15.96:0/3470898250 conn(0x7f6164074e30 msgr2=0x7f6164075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:18.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.573+0000 7f616930e700 1 -- 172.21.15.96:0/3470898250 shutdown_connections 2024-02-19T19:13:18.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.573+0000 7f616930e700 1 -- 172.21.15.96:0/3470898250 wait complete. 2024-02-19T19:13:18.597 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.573+0000 7f616930e700 1 Processor -- start 2024-02-19T19:13:18.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.574+0000 7f616930e700 1 -- start start 2024-02-19T19:13:18.598 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.574+0000 7f616930e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61640ff5a0 0x7f616419c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:18.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.574+0000 7f616930e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61640fff50 0x7f616419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:18.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.574+0000 7f616930e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616419d2d0 con 0x7f61640ff5a0 2024-02-19T19:13:18.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.574+0000 7f616930e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6164196780 con 0x7f61640fff50 2024-02-19T19:13:18.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.574+0000 7f6162ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61640ff5a0 0x7f616419c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:18.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.574+0000 7f6162ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61640ff5a0 0x7f616419c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:46980/0 (socket says 172.21.15.96:46980) 2024-02-19T19:13:18.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.574+0000 7f6162ffd700 1 -- 172.21.15.96:0/1002782270 learned_addr learned my addr 172.21.15.96:0/1002782270 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:13:18.599 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.574+0000 7f61627fc700 1 --2- 172.21.15.96:0/1002782270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61640fff50 0x7f616419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:18.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.575+0000 7f6162ffd700 1 -- 172.21.15.96:0/1002782270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61640fff50 msgr2=0x7f616419cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:18.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.575+0000 7f6162ffd700 1 --2- 172.21.15.96:0/1002782270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61640fff50 0x7f616419cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:18.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.575+0000 7f6162ffd700 1 -- 172.21.15.96:0/1002782270 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61540095f0 con 0x7f61640ff5a0 2024-02-19T19:13:18.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.575+0000 7f6162ffd700 1 --2- 172.21.15.96:0/1002782270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61640ff5a0 0x7f616419c700 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6154006010 tx=0x7f615400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:18.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.575+0000 7f614bfff700 1 -- 172.21.15.96:0/1002782270 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f615401d070 con 0x7f61640ff5a0 2024-02-19T19:13:18.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.575+0000 7f614bfff700 1 -- 172.21.15.96:0/1002782270 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6154005dc0 con 0x7f61640ff5a0 2024-02-19T19:13:18.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.575+0000 7f616930e700 1 -- 172.21.15.96:0/1002782270 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6164196a00 con 0x7f61640ff5a0 2024-02-19T19:13:18.600 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.575+0000 7f614bfff700 1 -- 172.21.15.96:0/1002782270 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6154017400 con 0x7f61640ff5a0 2024-02-19T19:13:18.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.575+0000 7f616930e700 1 -- 172.21.15.96:0/1002782270 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6164196ef0 con 0x7f61640ff5a0 2024-02-19T19:13:18.601 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.576+0000 7f616930e700 1 -- 172.21.15.96:0/1002782270 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6164109270 con 0x7f61640ff5a0 2024-02-19T19:13:18.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.577+0000 7f614bfff700 1 -- 172.21.15.96:0/1002782270 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f6154003a60 con 0x7f61640ff5a0 2024-02-19T19:13:18.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.577+0000 7f614bfff700 1 --2- 172.21.15.96:0/1002782270 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f614c06d8a0 0x7f614c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:18.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.577+0000 7f614bfff700 1 -- 172.21.15.96:0/1002782270 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f615408e9e0 con 0x7f61640ff5a0 2024-02-19T19:13:18.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.577+0000 7f61627fc700 1 --2- 172.21.15.96:0/1002782270 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f614c06d8a0 0x7f614c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:18.602 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.578+0000 7f61627fc700 1 --2- 172.21.15.96:0/1002782270 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f614c06d8a0 0x7f614c06fd60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6164197bf0 tx=0x7f615800b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:18.605 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.582+0000 7f614bfff700 1 -- 172.21.15.96:0/1002782270 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f615405bcc0 con 0x7f61640ff5a0 2024-02-19T19:13:18.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:18 smithi125 ceph-mon[86115]: from='client.44365 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:13:18.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:18 smithi125 ceph-mon[86115]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:13:18.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:18 smithi125 ceph-mon[86115]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:13:18.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:18 smithi125 ceph-mon[86115]: pgmap v193: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:18.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:18 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/2939607356' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:18.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:18 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/2555750510' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:13:18.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:18 smithi096 ceph-mon[112483]: from='client.44365 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:13:18.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:18 smithi096 ceph-mon[112483]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:13:18.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:18 smithi096 ceph-mon[112483]: from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:13:18.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:18 smithi096 ceph-mon[112483]: pgmap v193: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:18.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:18 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/2939607356' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:18.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:18 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/2555750510' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:13:18.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.871+0000 7f616930e700 1 -- 172.21.15.96:0/1002782270 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6164197ce0 con 0x7f61640ff5a0 2024-02-19T19:13:18.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.871+0000 7f614bfff700 1 -- 172.21.15.96:0/1002782270 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f615405b850 con 0x7f61640ff5a0 2024-02-19T19:13:18.894 INFO:teuthology.orchestra.run.smithi096.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-02-19T19:13:18.894 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-19T19:13:18.895 INFO:teuthology.orchestra.run.smithi096.stdout: fs cephfs is degraded 2024-02-19T19:13:18.895 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-19T19:13:18.895 INFO:teuthology.orchestra.run.smithi096.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-19T19:13:18.895 INFO:teuthology.orchestra.run.smithi096.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-19T19:13:18.895 INFO:teuthology.orchestra.run.smithi096.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-19T19:13:18.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.873+0000 7f616930e700 1 -- 172.21.15.96:0/1002782270 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f614c06d8a0 msgr2=0x7f614c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:18.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.873+0000 7f616930e700 1 --2- 172.21.15.96:0/1002782270 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f614c06d8a0 0x7f614c06fd60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6164197bf0 tx=0x7f615800b410 comp rx=0 tx=0).stop 2024-02-19T19:13:18.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.873+0000 7f616930e700 1 -- 172.21.15.96:0/1002782270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61640ff5a0 msgr2=0x7f616419c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:18.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.873+0000 7f616930e700 1 --2- 172.21.15.96:0/1002782270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61640ff5a0 0x7f616419c700 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6154006010 tx=0x7f615400bd70 comp rx=0 tx=0).stop 2024-02-19T19:13:18.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.873+0000 7f616930e700 1 -- 172.21.15.96:0/1002782270 shutdown_connections 2024-02-19T19:13:18.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.873+0000 7f616930e700 1 --2- 172.21.15.96:0/1002782270 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f614c06d8a0 0x7f614c06fd60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:18.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.873+0000 7f616930e700 1 --2- 172.21.15.96:0/1002782270 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f61640ff5a0 0x7f616419c700 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:18.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.873+0000 7f616930e700 1 --2- 172.21.15.96:0/1002782270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f61640fff50 0x7f616419cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:18.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.873+0000 7f616930e700 1 -- 172.21.15.96:0/1002782270 >> 172.21.15.96:0/1002782270 conn(0x7f6164074e30 msgr2=0x7f61640fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:18.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.874+0000 7f616930e700 1 -- 172.21.15.96:0/1002782270 shutdown_connections 2024-02-19T19:13:18.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:18.874+0000 7f616930e700 1 -- 172.21.15.96:0/1002782270 wait complete. 2024-02-19T19:13:19.695 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:19 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/1002782270' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:13:19.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:19 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/1002782270' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:13:20.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:20 smithi125 ceph-mon[86115]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:13:20.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:20 smithi125 ceph-mon[86115]: pgmap v194: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:20.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:13:20.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:20 smithi096 ceph-mon[112483]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:13:20.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:20 smithi096 ceph-mon[112483]: pgmap v194: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:20.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:13:22.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:22 smithi096 ceph-mon[112483]: pgmap v195: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:22.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:22.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:22.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:22 smithi125 ceph-mon[86115]: pgmap v195: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:22.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:22.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:24.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:24.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:24.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:23 smithi096 ceph-mon[112483]: pgmap v196: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:24.204 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:24.204 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:24.204 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:23 smithi125 ceph-mon[86115]: pgmap v196: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:26.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:26 smithi125 ceph-mon[86115]: pgmap v197: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:26.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:26 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:26.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:26 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:26.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:26 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:13:26.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:26 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:13:26.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:26 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:26.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:26 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:13:26.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:26 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:26.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:26 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:26.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:26 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:26.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:26 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:26.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:26 smithi096 ceph-mon[112483]: pgmap v197: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:26.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:26 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:26.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:26 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:26.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:26 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:13:26.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:26 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:13:26.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:26 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:26.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:26 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:13:26.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:26 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:26.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:26 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:26.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:26 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:26.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:26 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:28.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:28 smithi125 ceph-mon[86115]: pgmap v198: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:28.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:28 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:28.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:28 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi125.srnlol", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:13:28.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:28 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:13:28.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:28 smithi096 ceph-mon[112483]: pgmap v198: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:28.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:28 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:28.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:28 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi125.srnlol", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:13:28.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:28 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:13:29.511 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:29 smithi125 ceph-mon[86115]: Upgrade: Updating mds.cephfs.smithi125.srnlol 2024-02-19T19:13:29.512 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:29 smithi125 ceph-mon[86115]: Deploying daemon mds.cephfs.smithi125.srnlol on smithi125 2024-02-19T19:13:29.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:29 smithi096 ceph-mon[112483]: Upgrade: Updating mds.cephfs.smithi125.srnlol 2024-02-19T19:13:29.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:29 smithi096 ceph-mon[112483]: Deploying daemon mds.cephfs.smithi125.srnlol on smithi125 2024-02-19T19:13:30.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:30 smithi125 ceph-mon[86115]: pgmap v199: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:30.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:30 smithi096 ceph-mon[112483]: pgmap v199: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:31.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:31 smithi125 ceph-mon[86115]: osdmap e84: 6 total, 6 up, 6 in 2024-02-19T19:13:31.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:31 smithi125 ceph-mon[86115]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-19T19:13:31.761 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:31 smithi096 ceph-mon[112483]: osdmap e84: 6 total, 6 up, 6 in 2024-02-19T19:13:31.762 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:31 smithi096 ceph-mon[112483]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-19T19:13:32.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:32 smithi125 ceph-mon[86115]: pgmap v201: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:32.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:32 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.srnlol"}]: dispatch 2024-02-19T19:13:32.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:32 smithi096 ceph-mon[112483]: pgmap v201: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:32.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:32 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.srnlol"}]: dispatch 2024-02-19T19:13:34.643 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:34 smithi125 ceph-mon[86115]: pgmap v202: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:34.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:34 smithi096 ceph-mon[112483]: pgmap v202: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:35.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:13:35.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:35.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:35.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:13:35.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:13:35.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:35.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:35.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:13:36.737 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:36 smithi125 ceph-mon[86115]: pgmap v203: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:36.737 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:36 smithi125 ceph-mon[86115]: mds.? [v2:172.21.15.125:6824/3852344857,v1:172.21.15.125:6825/3852344857] up:boot 2024-02-19T19:13:36.738 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:36 smithi125 ceph-mon[86115]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:13:36.738 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.srnlol"}]: dispatch 2024-02-19T19:13:36.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:36 smithi096 ceph-mon[112483]: pgmap v203: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:36.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:36 smithi096 ceph-mon[112483]: mds.? [v2:172.21.15.125:6824/3852344857,v1:172.21.15.125:6825/3852344857] up:boot 2024-02-19T19:13:36.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:36 smithi096 ceph-mon[112483]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:13:36.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.srnlol"}]: dispatch 2024-02-19T19:13:38.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:38 smithi096 ceph-mon[112483]: pgmap v204: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:38.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:38 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:38.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:38 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:38.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:38 smithi125 ceph-mon[86115]: pgmap v204: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:38.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:38 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:38.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:38 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:40.454 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:40 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:40.454 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:40 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:40.454 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:40 smithi125 ceph-mon[86115]: pgmap v205: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:40.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:40 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:40.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:40 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:40.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:40 smithi096 ceph-mon[112483]: pgmap v205: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:42.454 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:42 smithi125 ceph-mon[86115]: pgmap v206: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:42.698 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:42 smithi096 ceph-mon[112483]: pgmap v206: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:43.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:43 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:43.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:43 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:43.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:43 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:13:43.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:43 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:13:43.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:43 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:43.955 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:43 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:13:43.955 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:43 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:43.955 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:43 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:43.955 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:43 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:43.955 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:43 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:43.955 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:43 smithi125 ceph-mon[86115]: pgmap v207: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:44.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:43 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:44.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:43 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:44.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:43 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:13:44.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:43 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:13:44.040 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:43 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:44.040 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:43 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:13:44.040 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:43 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:44.040 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:43 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:44.040 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:43 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:44.040 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:43 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:44.043 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:43 smithi096 ceph-mon[112483]: pgmap v207: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:45.386 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:45 smithi125 ceph-mon[86115]: Upgrade: Updating mds.cephfs.smithi125.pwyuga 2024-02-19T19:13:45.386 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:45 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:45.386 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:45 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi125.pwyuga", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:13:45.386 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:45 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:13:45.386 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:45 smithi125 ceph-mon[86115]: Deploying daemon mds.cephfs.smithi125.pwyuga on smithi125 2024-02-19T19:13:45.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:45 smithi096 ceph-mon[112483]: Upgrade: Updating mds.cephfs.smithi125.pwyuga 2024-02-19T19:13:45.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:45 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:45.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:45 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi125.pwyuga", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-19T19:13:45.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:45 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:13:45.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:45 smithi096 ceph-mon[112483]: Deploying daemon mds.cephfs.smithi125.pwyuga on smithi125 2024-02-19T19:13:46.454 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:46 smithi125 ceph-mon[86115]: pgmap v208: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:46.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:46 smithi096 ceph-mon[112483]: pgmap v208: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:47.453 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:47 smithi125 ceph-mon[86115]: osdmap e85: 6 total, 6 up, 6 in 2024-02-19T19:13:47.454 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:47 smithi125 ceph-mon[86115]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-19T19:13:47.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:47 smithi096 ceph-mon[112483]: osdmap e85: 6 total, 6 up, 6 in 2024-02-19T19:13:47.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:47 smithi096 ceph-mon[112483]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-02-19T19:13:48.463 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:48 smithi125 ceph-mon[86115]: pgmap v210: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:48.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:48 smithi096 ceph-mon[112483]: pgmap v210: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:49.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.991+0000 7ff02d79e700 1 -- 172.21.15.96:0/2540313519 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff028101850 msgr2=0x7ff0281058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:49.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.991+0000 7ff02d79e700 1 --2- 172.21.15.96:0/2540313519 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff028101850 0x7ff0281058a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff010009910 tx=0x7ff010009c20 comp rx=0 tx=0).stop 2024-02-19T19:13:49.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.991+0000 7ff02d79e700 1 -- 172.21.15.96:0/2540313519 shutdown_connections 2024-02-19T19:13:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.991+0000 7ff02d79e700 1 --2- 172.21.15.96:0/2540313519 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff028101850 0x7ff0281058a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.991+0000 7ff02d79e700 1 --2- 172.21.15.96:0/2540313519 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff028100ea0 0x7ff028101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.991+0000 7ff02d79e700 1 -- 172.21.15.96:0/2540313519 >> 172.21.15.96:0/2540313519 conn(0x7ff0280fc750 msgr2=0x7ff0280feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.991+0000 7ff02d79e700 1 -- 172.21.15.96:0/2540313519 shutdown_connections 2024-02-19T19:13:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.991+0000 7ff02d79e700 1 -- 172.21.15.96:0/2540313519 wait complete. 2024-02-19T19:13:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.992+0000 7ff02d79e700 1 Processor -- start 2024-02-19T19:13:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.992+0000 7ff02d79e700 1 -- start start 2024-02-19T19:13:49.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.992+0000 7ff02d79e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff028100ea0 0x7ff028073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.992+0000 7ff02d79e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff028101850 0x7ff0280735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.992+0000 7ff02d79e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff028073b10 con 0x7ff028100ea0 2024-02-19T19:13:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.992+0000 7ff02d79e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff028073c50 con 0x7ff028101850 2024-02-19T19:13:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.992+0000 7ff026ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff028100ea0 0x7ff028073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.992+0000 7ff01e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff028101850 0x7ff0280735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.992+0000 7ff026ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff028100ea0 0x7ff028073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38056/0 (socket says 172.21.15.96:38056) 2024-02-19T19:13:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.992+0000 7ff026ffd700 1 -- 172.21.15.96:0/954213842 learned_addr learned my addr 172.21.15.96:0/954213842 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:13:49.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.993+0000 7ff026ffd700 1 -- 172.21.15.96:0/954213842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff028101850 msgr2=0x7ff0280735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:49.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.993+0000 7ff026ffd700 1 --2- 172.21.15.96:0/954213842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff028101850 0x7ff0280735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.993+0000 7ff026ffd700 1 -- 172.21.15.96:0/954213842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0100095f0 con 0x7ff028100ea0 2024-02-19T19:13:49.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.993+0000 7ff01e7fc700 1 --2- 172.21.15.96:0/954213842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff028101850 0x7ff0280735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-19T19:13:49.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.993+0000 7ff026ffd700 1 --2- 172.21.15.96:0/954213842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff028100ea0 0x7ff028073090 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff01800e920 tx=0x7ff01800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:49.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.993+0000 7ff024ff9700 1 -- 172.21.15.96:0/954213842 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff01800c9d0 con 0x7ff028100ea0 2024-02-19T19:13:49.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.993+0000 7ff02d79e700 1 -- 172.21.15.96:0/954213842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0281a2b00 con 0x7ff028100ea0 2024-02-19T19:13:49.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.993+0000 7ff024ff9700 1 -- 172.21.15.96:0/954213842 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff018010430 con 0x7ff028100ea0 2024-02-19T19:13:49.019 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.993+0000 7ff024ff9700 1 -- 172.21.15.96:0/954213842 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff018018630 con 0x7ff028100ea0 2024-02-19T19:13:49.020 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.993+0000 7ff02d79e700 1 -- 172.21.15.96:0/954213842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0281a2eb0 con 0x7ff028100ea0 2024-02-19T19:13:49.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.994+0000 7ff02d79e700 1 -- 172.21.15.96:0/954213842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0281092a0 con 0x7ff028100ea0 2024-02-19T19:13:49.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.995+0000 7ff024ff9700 1 -- 172.21.15.96:0/954213842 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7ff0180105a0 con 0x7ff028100ea0 2024-02-19T19:13:49.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.995+0000 7ff024ff9700 1 --2- 172.21.15.96:0/954213842 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff01406d8a0 0x7ff01406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:49.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.995+0000 7ff024ff9700 1 -- 172.21.15.96:0/954213842 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7ff018014070 con 0x7ff028100ea0 2024-02-19T19:13:49.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.995+0000 7ff01e7fc700 1 --2- 172.21.15.96:0/954213842 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff01406d8a0 0x7ff01406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:49.021 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:48.995+0000 7ff01e7fc700 1 --2- 172.21.15.96:0/954213842 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff01406d8a0 0x7ff01406fd60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff010005b40 tx=0x7ff010005a90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:49.022 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.000+0000 7ff024ff9700 1 -- 172.21.15.96:0/954213842 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff018052d20 con 0x7ff028100ea0 2024-02-19T19:13:49.233 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.210+0000 7ff02d79e700 1 -- 172.21.15.96:0/954213842 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0280611d0 con 0x7ff01406d8a0 2024-02-19T19:13:49.234 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.211+0000 7ff024ff9700 1 -- 172.21.15.96:0/954213842 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff0280611d0 con 0x7ff01406d8a0 2024-02-19T19:13:49.236 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.213+0000 7ff02d79e700 1 -- 172.21.15.96:0/954213842 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff01406d8a0 msgr2=0x7ff01406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:49.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.213+0000 7ff02d79e700 1 --2- 172.21.15.96:0/954213842 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff01406d8a0 0x7ff01406fd60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff010005b40 tx=0x7ff010005a90 comp rx=0 tx=0).stop 2024-02-19T19:13:49.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.213+0000 7ff02d79e700 1 -- 172.21.15.96:0/954213842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff028100ea0 msgr2=0x7ff028073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:49.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.213+0000 7ff02d79e700 1 --2- 172.21.15.96:0/954213842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff028100ea0 0x7ff028073090 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff01800e920 tx=0x7ff01800ec30 comp rx=0 tx=0).stop 2024-02-19T19:13:49.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.214+0000 7ff02d79e700 1 -- 172.21.15.96:0/954213842 shutdown_connections 2024-02-19T19:13:49.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.214+0000 7ff02d79e700 1 --2- 172.21.15.96:0/954213842 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7ff01406d8a0 0x7ff01406fd60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.214+0000 7ff02d79e700 1 --2- 172.21.15.96:0/954213842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff028100ea0 0x7ff028073090 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.214+0000 7ff02d79e700 1 --2- 172.21.15.96:0/954213842 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff028101850 0x7ff0280735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.237 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.214+0000 7ff02d79e700 1 -- 172.21.15.96:0/954213842 >> 172.21.15.96:0/954213842 conn(0x7ff0280fc750 msgr2=0x7ff0280fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:49.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.214+0000 7ff02d79e700 1 -- 172.21.15.96:0/954213842 shutdown_connections 2024-02-19T19:13:49.238 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.214+0000 7ff02d79e700 1 -- 172.21.15.96:0/954213842 wait complete. 2024-02-19T19:13:49.247 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:13:49.344 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.320+0000 7f5f3465d700 1 -- 172.21.15.96:0/3068626667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f2c100ea0 msgr2=0x7f5f2c101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:49.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.320+0000 7f5f3465d700 1 --2- 172.21.15.96:0/3068626667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f2c100ea0 0x7f5f2c101280 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5f2800b0a0 tx=0x7f5f2800b3b0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.320+0000 7f5f3465d700 1 -- 172.21.15.96:0/3068626667 shutdown_connections 2024-02-19T19:13:49.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.320+0000 7f5f3465d700 1 --2- 172.21.15.96:0/3068626667 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f2c101850 0x7f5f2c1058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.320+0000 7f5f3465d700 1 --2- 172.21.15.96:0/3068626667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f2c100ea0 0x7f5f2c101280 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.320+0000 7f5f3465d700 1 -- 172.21.15.96:0/3068626667 >> 172.21.15.96:0/3068626667 conn(0x7f5f2c0fc750 msgr2=0x7f5f2c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:49.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.320+0000 7f5f3465d700 1 -- 172.21.15.96:0/3068626667 shutdown_connections 2024-02-19T19:13:49.345 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.320+0000 7f5f3465d700 1 -- 172.21.15.96:0/3068626667 wait complete. 2024-02-19T19:13:49.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.321+0000 7f5f3465d700 1 Processor -- start 2024-02-19T19:13:49.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.321+0000 7f5f3465d700 1 -- start start 2024-02-19T19:13:49.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.321+0000 7f5f3465d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f2c100ea0 0x7f5f2c19c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:49.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.321+0000 7f5f3465d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f2c101850 0x7f5f2c19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:49.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.321+0000 7f5f3465d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c19d2e0 con 0x7f5f2c100ea0 2024-02-19T19:13:49.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.321+0000 7f5f3465d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c196790 con 0x7f5f2c101850 2024-02-19T19:13:49.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.321+0000 7f5f323f9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f2c100ea0 0x7f5f2c19c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:49.346 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.321+0000 7f5f323f9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f2c100ea0 0x7f5f2c19c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38076/0 (socket says 172.21.15.96:38076) 2024-02-19T19:13:49.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.321+0000 7f5f323f9700 1 -- 172.21.15.96:0/173357991 learned_addr learned my addr 172.21.15.96:0/173357991 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:13:49.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.321+0000 7f5f31bf8700 1 --2- 172.21.15.96:0/173357991 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f2c101850 0x7f5f2c19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:49.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.321+0000 7f5f323f9700 1 -- 172.21.15.96:0/173357991 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f2c101850 msgr2=0x7f5f2c19cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:49.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.321+0000 7f5f323f9700 1 --2- 172.21.15.96:0/173357991 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f2c101850 0x7f5f2c19cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.321+0000 7f5f323f9700 1 -- 172.21.15.96:0/173357991 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f28009d00 con 0x7f5f2c100ea0 2024-02-19T19:13:49.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.321+0000 7f5f323f9700 1 --2- 172.21.15.96:0/173357991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f2c100ea0 0x7f5f2c19c710 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5f28000f80 tx=0x7f5f2800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:49.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.322+0000 7f5f237fe700 1 -- 172.21.15.96:0/173357991 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f2800e040 con 0x7f5f2c100ea0 2024-02-19T19:13:49.347 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.322+0000 7f5f237fe700 1 -- 172.21.15.96:0/173357991 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5f28003c10 con 0x7f5f2c100ea0 2024-02-19T19:13:49.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.322+0000 7f5f237fe700 1 -- 172.21.15.96:0/173357991 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f2801d6b0 con 0x7f5f2c100ea0 2024-02-19T19:13:49.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.322+0000 7f5f3465d700 1 -- 172.21.15.96:0/173357991 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2c196a10 con 0x7f5f2c100ea0 2024-02-19T19:13:49.348 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.322+0000 7f5f3465d700 1 -- 172.21.15.96:0/173357991 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2c196f00 con 0x7f5f2c100ea0 2024-02-19T19:13:49.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.323+0000 7f5f3465d700 1 -- 172.21.15.96:0/173357991 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f2c109240 con 0x7f5f2c100ea0 2024-02-19T19:13:49.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.323+0000 7f5f237fe700 1 -- 172.21.15.96:0/173357991 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f5f28004040 con 0x7f5f2c100ea0 2024-02-19T19:13:49.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.323+0000 7f5f237fe700 1 --2- 172.21.15.96:0/173357991 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f5f1806d8a0 0x7f5f1806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:49.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.324+0000 7f5f237fe700 1 -- 172.21.15.96:0/173357991 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f5f2808ec80 con 0x7f5f2c100ea0 2024-02-19T19:13:49.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.324+0000 7f5f31bf8700 1 --2- 172.21.15.96:0/173357991 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f5f1806d8a0 0x7f5f1806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:49.349 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.324+0000 7f5f31bf8700 1 --2- 172.21.15.96:0/173357991 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f5f1806d8a0 0x7f5f1806fd60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c197c00 tx=0x7f5f1c0073d0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:49.351 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.328+0000 7f5f237fe700 1 -- 172.21.15.96:0/173357991 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5f2805bf60 con 0x7f5f2c100ea0 2024-02-19T19:13:49.562 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.539+0000 7f5f3465d700 1 -- 172.21.15.96:0/173357991 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f2c197cf0 con 0x7f5f1806d8a0 2024-02-19T19:13:49.563 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.540+0000 7f5f237fe700 1 -- 172.21.15.96:0/173357991 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f5f2c197cf0 con 0x7f5f1806d8a0 2024-02-19T19:13:49.565 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.542+0000 7f5f3465d700 1 -- 172.21.15.96:0/173357991 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f5f1806d8a0 msgr2=0x7f5f1806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:49.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.542+0000 7f5f3465d700 1 --2- 172.21.15.96:0/173357991 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f5f1806d8a0 0x7f5f1806fd60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c197c00 tx=0x7f5f1c0073d0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.542+0000 7f5f3465d700 1 -- 172.21.15.96:0/173357991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f2c100ea0 msgr2=0x7f5f2c19c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:49.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.542+0000 7f5f3465d700 1 --2- 172.21.15.96:0/173357991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f2c100ea0 0x7f5f2c19c710 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5f28000f80 tx=0x7f5f2800cd20 comp rx=0 tx=0).stop 2024-02-19T19:13:49.566 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.542+0000 7f5f3465d700 1 -- 172.21.15.96:0/173357991 shutdown_connections 2024-02-19T19:13:49.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.542+0000 7f5f3465d700 1 --2- 172.21.15.96:0/173357991 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f5f1806d8a0 0x7f5f1806fd60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.542+0000 7f5f3465d700 1 --2- 172.21.15.96:0/173357991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f2c100ea0 0x7f5f2c19c710 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.542+0000 7f5f3465d700 1 --2- 172.21.15.96:0/173357991 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5f2c101850 0x7f5f2c19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.567 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.543+0000 7f5f3465d700 1 -- 172.21.15.96:0/173357991 >> 172.21.15.96:0/173357991 conn(0x7f5f2c0fc750 msgr2=0x7f5f2c0fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:49.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.543+0000 7f5f3465d700 1 -- 172.21.15.96:0/173357991 shutdown_connections 2024-02-19T19:13:49.568 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.543+0000 7f5f3465d700 1 -- 172.21.15.96:0/173357991 wait complete. 2024-02-19T19:13:49.668 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.646+0000 7fd42a901700 1 -- 172.21.15.96:0/2099000881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4240ff670 msgr2=0x7fd4240ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:49.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.646+0000 7fd42a901700 1 --2- 172.21.15.96:0/2099000881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4240ff670 0x7fd4240ffa50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd414009910 tx=0x7fd414009c20 comp rx=0 tx=0).stop 2024-02-19T19:13:49.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.646+0000 7fd42a901700 1 -- 172.21.15.96:0/2099000881 shutdown_connections 2024-02-19T19:13:49.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.646+0000 7fd42a901700 1 --2- 172.21.15.96:0/2099000881 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd424100020 0x7fd424103f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.669 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.646+0000 7fd42a901700 1 --2- 172.21.15.96:0/2099000881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4240ff670 0x7fd4240ffa50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.646+0000 7fd42a901700 1 -- 172.21.15.96:0/2099000881 >> 172.21.15.96:0/2099000881 conn(0x7fd424074e30 msgr2=0x7fd424075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:49.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.646+0000 7fd42a901700 1 -- 172.21.15.96:0/2099000881 shutdown_connections 2024-02-19T19:13:49.670 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.646+0000 7fd42a901700 1 -- 172.21.15.96:0/2099000881 wait complete. 2024-02-19T19:13:49.672 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.646+0000 7fd42a901700 1 Processor -- start 2024-02-19T19:13:49.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.647+0000 7fd42a901700 1 -- start start 2024-02-19T19:13:49.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.647+0000 7fd42a901700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4240ff670 0x7fd424197700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:49.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.647+0000 7fd42a901700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd424100020 0x7fd424197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:49.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.647+0000 7fd42a901700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd424198290 con 0x7fd4240ff670 2024-02-19T19:13:49.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.647+0000 7fd42a901700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd424198400 con 0x7fd424100020 2024-02-19T19:13:49.673 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.647+0000 7fd423fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4240ff670 0x7fd424197700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:49.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.647+0000 7fd423fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4240ff670 0x7fd424197700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38090/0 (socket says 172.21.15.96:38090) 2024-02-19T19:13:49.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.647+0000 7fd423fff700 1 -- 172.21.15.96:0/3621573007 learned_addr learned my addr 172.21.15.96:0/3621573007 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:13:49.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.647+0000 7fd4237fe700 1 --2- 172.21.15.96:0/3621573007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd424100020 0x7fd424197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:49.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.647+0000 7fd423fff700 1 -- 172.21.15.96:0/3621573007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd424100020 msgr2=0x7fd424197c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:49.674 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.647+0000 7fd423fff700 1 --2- 172.21.15.96:0/3621573007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd424100020 0x7fd424197c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.647+0000 7fd423fff700 1 -- 172.21.15.96:0/3621573007 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4140095f0 con 0x7fd4240ff670 2024-02-19T19:13:49.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.647+0000 7fd4237fe700 1 --2- 172.21.15.96:0/3621573007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd424100020 0x7fd424197c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:13:49.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.648+0000 7fd423fff700 1 --2- 172.21.15.96:0/3621573007 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4240ff670 0x7fd424197700 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd414006010 tx=0x7fd41400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:49.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.648+0000 7fd4217fa700 1 -- 172.21.15.96:0/3621573007 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd41401d070 con 0x7fd4240ff670 2024-02-19T19:13:49.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.648+0000 7fd4217fa700 1 -- 172.21.15.96:0/3621573007 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd414004fb0 con 0x7fd4240ff670 2024-02-19T19:13:49.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.648+0000 7fd4217fa700 1 -- 172.21.15.96:0/3621573007 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd414022ea0 con 0x7fd4240ff670 2024-02-19T19:13:49.675 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.648+0000 7fd42a901700 1 -- 172.21.15.96:0/3621573007 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4241a0770 con 0x7fd4240ff670 2024-02-19T19:13:49.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.648+0000 7fd42a901700 1 -- 172.21.15.96:0/3621573007 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4241a0b80 con 0x7fd4240ff670 2024-02-19T19:13:49.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.649+0000 7fd42a901700 1 -- 172.21.15.96:0/3621573007 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42404f2e0 con 0x7fd4240ff670 2024-02-19T19:13:49.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.649+0000 7fd4217fa700 1 -- 172.21.15.96:0/3621573007 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fd414022470 con 0x7fd4240ff670 2024-02-19T19:13:49.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.650+0000 7fd4217fa700 1 --2- 172.21.15.96:0/3621573007 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd40c06d8a0 0x7fd40c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:49.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.650+0000 7fd4217fa700 1 -- 172.21.15.96:0/3621573007 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd41408ea20 con 0x7fd4240ff670 2024-02-19T19:13:49.676 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.650+0000 7fd4237fe700 1 --2- 172.21.15.96:0/3621573007 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd40c06d8a0 0x7fd40c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:49.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.650+0000 7fd4237fe700 1 --2- 172.21.15.96:0/3621573007 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd40c06d8a0 0x7fd40c06fd60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd418005fd0 tx=0x7fd418005e20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:49.677 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.654+0000 7fd4217fa700 1 -- 172.21.15.96:0/3621573007 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd414058420 con 0x7fd4240ff670 2024-02-19T19:13:49.879 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.856+0000 7fd42a901700 1 -- 172.21.15.96:0/3621573007 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd424103600 con 0x7fd40c06d8a0 2024-02-19T19:13:49.890 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.867+0000 7fd4217fa700 1 -- 172.21.15.96:0/3621573007 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd424103600 con 0x7fd40c06d8a0 2024-02-19T19:13:49.890 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:13:49.890 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (8m) 28s ago 17m 24.9M - 0.25.0 c8568f914cd2 bbaf83a1e476 2024-02-19T19:13:49.890 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (17m) 28s ago 17m 9198k - 18.2.1 94eadd990e0a b41bff2e0043 2024-02-19T19:13:49.890 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (16m) 11s ago 16m 8875k - 18.2.1 94eadd990e0a 254ab7e7a040 2024-02-19T19:13:49.891 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (4m) 28s ago 17m 6669k - 19.0.0-1450-gf78a58c0 f081f847070a deea0ffefa0f 2024-02-19T19:13:49.891 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (4m) 11s ago 16m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 3421965dc5b0 2024-02-19T19:13:49.891 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (7m) 28s ago 17m 85.2M - 9.4.12 a0ea5e3c46d9 0102d90938e4 2024-02-19T19:13:49.891 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (34s) 28s ago 11m 11.4M - 19.0.0-1450-gf78a58c0 f081f847070a 26f13e1700e9 2024-02-19T19:13:49.891 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (50s) 28s ago 12m 12.5M - 19.0.0-1450-gf78a58c0 f081f847070a a24f6ad0b131 2024-02-19T19:13:49.891 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (11m) 11s ago 11m 11.9M - 18.2.1 94eadd990e0a 211d64de8a63 2024-02-19T19:13:49.891 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (14s) 11s ago 11m 14.8M - 19.0.0-1450-gf78a58c0 f081f847070a d0d33ee245a0 2024-02-19T19:13:49.891 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:8443,9283,8765 running (9m) 28s ago 19m 508M - 19.0.0-1450-gf78a58c0 f081f847070a a86fbe94fe3f 2024-02-19T19:13:49.891 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (8m) 11s ago 16m 450M - 19.0.0-1450-gf78a58c0 f081f847070a e250486d572d 2024-02-19T19:13:49.891 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (5m) 28s ago 19m 56.3M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d70090d516e3 2024-02-19T19:13:49.892 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (5m) 11s ago 16m 45.6M 2048M 19.0.0-1450-gf78a58c0 f081f847070a f56b17bdc9a0 2024-02-19T19:13:49.892 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (8m) 28s ago 17m 15.6M - 1.5.0 0da6a335fe13 51f622ea33d6 2024-02-19T19:13:49.892 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (8m) 11s ago 16m 17.4M - 1.5.0 0da6a335fe13 464e076a52a1 2024-02-19T19:13:49.892 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4m) 28s ago 15m 105M 1216M 19.0.0-1450-gf78a58c0 f081f847070a b3dffd6a3fb2 2024-02-19T19:13:49.892 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (3m) 28s ago 15m 107M 1216M 19.0.0-1450-gf78a58c0 f081f847070a f0dd6d8f952f 2024-02-19T19:13:49.892 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3m) 28s ago 14m 96.3M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 51b70eaaa7a9 2024-02-19T19:13:49.892 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (2m) 11s ago 14m 78.9M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 73b832b7b243 2024-02-19T19:13:49.892 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (2m) 11s ago 13m 81.6M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 1309ffc459f9 2024-02-19T19:13:49.893 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (69s) 11s ago 13m 75.8M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 247b0927920b 2024-02-19T19:13:49.893 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (8m) 28s ago 16m 67.0M - 2.43.0 a07b618ecd1d a4edcf6ed669 2024-02-19T19:13:49.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.869+0000 7fd42a901700 1 -- 172.21.15.96:0/3621573007 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd40c06d8a0 msgr2=0x7fd40c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:49.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.869+0000 7fd42a901700 1 --2- 172.21.15.96:0/3621573007 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd40c06d8a0 0x7fd40c06fd60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd418005fd0 tx=0x7fd418005e20 comp rx=0 tx=0).stop 2024-02-19T19:13:49.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.869+0000 7fd42a901700 1 -- 172.21.15.96:0/3621573007 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4240ff670 msgr2=0x7fd424197700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:49.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.869+0000 7fd42a901700 1 --2- 172.21.15.96:0/3621573007 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4240ff670 0x7fd424197700 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd414006010 tx=0x7fd41400be20 comp rx=0 tx=0).stop 2024-02-19T19:13:49.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.869+0000 7fd42a901700 1 -- 172.21.15.96:0/3621573007 shutdown_connections 2024-02-19T19:13:49.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.869+0000 7fd42a901700 1 --2- 172.21.15.96:0/3621573007 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd40c06d8a0 0x7fd40c06fd60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.894 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.869+0000 7fd42a901700 1 --2- 172.21.15.96:0/3621573007 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd4240ff670 0x7fd424197700 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.869+0000 7fd42a901700 1 --2- 172.21.15.96:0/3621573007 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd424100020 0x7fd424197c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.869+0000 7fd42a901700 1 -- 172.21.15.96:0/3621573007 >> 172.21.15.96:0/3621573007 conn(0x7fd424074e30 msgr2=0x7fd424102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:49.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.870+0000 7fd42a901700 1 -- 172.21.15.96:0/3621573007 shutdown_connections 2024-02-19T19:13:49.895 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.870+0000 7fd42a901700 1 -- 172.21.15.96:0/3621573007 wait complete. 2024-02-19T19:13:49.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.972+0000 7f8016cf1700 1 -- 172.21.15.96:0/3961835262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8010102720 msgr2=0x7f801010ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:49.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.972+0000 7f8016cf1700 1 --2- 172.21.15.96:0/3961835262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8010102720 0x7f801010ac10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8004009910 tx=0x7f8004009c20 comp rx=0 tx=0).stop 2024-02-19T19:13:49.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.972+0000 7f8016cf1700 1 -- 172.21.15.96:0/3961835262 shutdown_connections 2024-02-19T19:13:49.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.972+0000 7f8016cf1700 1 --2- 172.21.15.96:0/3961835262 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8010102720 0x7f801010ac10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.972+0000 7f8016cf1700 1 --2- 172.21.15.96:0/3961835262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8010101e00 0x7f80101021e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.972+0000 7f8016cf1700 1 -- 172.21.15.96:0/3961835262 >> 172.21.15.96:0/3961835262 conn(0x7f80100fb650 msgr2=0x7f80100fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:49.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.972+0000 7f8016cf1700 1 -- 172.21.15.96:0/3961835262 shutdown_connections 2024-02-19T19:13:49.996 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.972+0000 7f8016cf1700 1 -- 172.21.15.96:0/3961835262 wait complete. 2024-02-19T19:13:49.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.972+0000 7f8016cf1700 1 Processor -- start 2024-02-19T19:13:49.997 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.972+0000 7f8016cf1700 1 -- start start 2024-02-19T19:13:49.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.973+0000 7f8016cf1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8010101e00 0x7f801019c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:49.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.973+0000 7f8016cf1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8010102720 0x7f801019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:49.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.973+0000 7f8016cf1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801019d260 con 0x7f8010101e00 2024-02-19T19:13:49.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.973+0000 7f8016cf1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8010196710 con 0x7f8010102720 2024-02-19T19:13:49.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.973+0000 7f8014a8d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8010101e00 0x7f801019c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:49.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.973+0000 7f8014a8d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8010101e00 0x7f801019c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38114/0 (socket says 172.21.15.96:38114) 2024-02-19T19:13:49.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.973+0000 7f8014a8d700 1 -- 172.21.15.96:0/248986218 learned_addr learned my addr 172.21.15.96:0/248986218 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:13:49.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.973+0000 7f800ffff700 1 --2- 172.21.15.96:0/248986218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8010102720 0x7f801019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:49.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.973+0000 7f8014a8d700 1 -- 172.21.15.96:0/248986218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8010102720 msgr2=0x7f801019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:49.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.973+0000 7f8014a8d700 1 --2- 172.21.15.96:0/248986218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8010102720 0x7f801019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:49.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.973+0000 7f8014a8d700 1 -- 172.21.15.96:0/248986218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80040095f0 con 0x7f8010101e00 2024-02-19T19:13:49.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.973+0000 7f8014a8d700 1 --2- 172.21.15.96:0/248986218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8010101e00 0x7f801019c690 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f80000060b0 tx=0x7f800000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:49.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.973+0000 7f800dffb700 1 -- 172.21.15.96:0/248986218 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f800000dda0 con 0x7f8010101e00 2024-02-19T19:13:49.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.974+0000 7f8016cf1700 1 -- 172.21.15.96:0/248986218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80101969f0 con 0x7f8010101e00 2024-02-19T19:13:49.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.974+0000 7f800dffb700 1 -- 172.21.15.96:0/248986218 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f800000f040 con 0x7f8010101e00 2024-02-19T19:13:49.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.974+0000 7f800dffb700 1 -- 172.21.15.96:0/248986218 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8000014790 con 0x7f8010101e00 2024-02-19T19:13:49.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.974+0000 7f8016cf1700 1 -- 172.21.15.96:0/248986218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8010196f10 con 0x7f8010101e00 2024-02-19T19:13:50.000 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.975+0000 7f800dffb700 1 -- 172.21.15.96:0/248986218 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f8000004ad0 con 0x7f8010101e00 2024-02-19T19:13:50.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.975+0000 7f8016cf1700 1 -- 172.21.15.96:0/248986218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8010108310 con 0x7f8010101e00 2024-02-19T19:13:50.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.975+0000 7f800dffb700 1 --2- 172.21.15.96:0/248986218 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7ff806d8a0 0x7f7ff806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:50.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.976+0000 7f800dffb700 1 -- 172.21.15.96:0/248986218 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f800008cf70 con 0x7f8010101e00 2024-02-19T19:13:50.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.976+0000 7f800ffff700 1 --2- 172.21.15.96:0/248986218 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7ff806d8a0 0x7f7ff806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:50.001 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.976+0000 7f800ffff700 1 --2- 172.21.15.96:0/248986218 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7ff806d8a0 0x7f7ff806fd60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8004006010 tx=0x7f800401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:50.004 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:49.981+0000 7f800dffb700 1 -- 172.21.15.96:0/248986218 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f80000c0d20 con 0x7f8010101e00 2024-02-19T19:13:50.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.258+0000 7f8016cf1700 1 -- 172.21.15.96:0/248986218 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f80101971b0 con 0x7f8010101e00 2024-02-19T19:13:50.281 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.259+0000 7f800dffb700 1 -- 172.21.15.96:0/248986218 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f800005a2d0 con 0x7f8010101e00 2024-02-19T19:13:50.281 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:13:50.282 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:13:50.282 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:13:50.282 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:13:50.282 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:13:50.282 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:13:50.282 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:13:50.282 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:13:50.282 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-19T19:13:50.283 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:13:50.283 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:13:50.283 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 3 2024-02-19T19:13:50.283 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:13:50.283 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:13:50.283 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 13 2024-02-19T19:13:50.283 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:13:50.283 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:13:50.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.262+0000 7f8016cf1700 1 -- 172.21.15.96:0/248986218 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7ff806d8a0 msgr2=0x7f7ff806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:50.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.262+0000 7f8016cf1700 1 --2- 172.21.15.96:0/248986218 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7ff806d8a0 0x7f7ff806fd60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8004006010 tx=0x7f800401a040 comp rx=0 tx=0).stop 2024-02-19T19:13:50.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.262+0000 7f8016cf1700 1 -- 172.21.15.96:0/248986218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8010101e00 msgr2=0x7f801019c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:50.285 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.262+0000 7f8016cf1700 1 --2- 172.21.15.96:0/248986218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8010101e00 0x7f801019c690 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f80000060b0 tx=0x7f800000d3b0 comp rx=0 tx=0).stop 2024-02-19T19:13:50.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.262+0000 7f8016cf1700 1 -- 172.21.15.96:0/248986218 shutdown_connections 2024-02-19T19:13:50.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.262+0000 7f8016cf1700 1 --2- 172.21.15.96:0/248986218 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f7ff806d8a0 0x7f7ff806fd60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:50.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.262+0000 7f8016cf1700 1 --2- 172.21.15.96:0/248986218 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8010101e00 0x7f801019c690 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:50.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.262+0000 7f8016cf1700 1 --2- 172.21.15.96:0/248986218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8010102720 0x7f801019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:50.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.262+0000 7f8016cf1700 1 -- 172.21.15.96:0/248986218 >> 172.21.15.96:0/248986218 conn(0x7f80100fb650 msgr2=0x7f8010105450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:50.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.262+0000 7f8016cf1700 1 -- 172.21.15.96:0/248986218 shutdown_connections 2024-02-19T19:13:50.286 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.262+0000 7f8016cf1700 1 -- 172.21.15.96:0/248986218 wait complete. 2024-02-19T19:13:50.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.370+0000 7fa33cde8700 1 -- 172.21.15.96:0/1658039535 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa338101850 msgr2=0x7fa3381058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:50.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.370+0000 7fa33cde8700 1 --2- 172.21.15.96:0/1658039535 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa338101850 0x7fa3381058a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa32c009910 tx=0x7fa32c009c20 comp rx=0 tx=0).stop 2024-02-19T19:13:50.393 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.370+0000 7fa33cde8700 1 -- 172.21.15.96:0/1658039535 shutdown_connections 2024-02-19T19:13:50.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.370+0000 7fa33cde8700 1 --2- 172.21.15.96:0/1658039535 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa338101850 0x7fa3381058a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:50.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.370+0000 7fa33cde8700 1 --2- 172.21.15.96:0/1658039535 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa338100ea0 0x7fa338101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:50.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.370+0000 7fa33cde8700 1 -- 172.21.15.96:0/1658039535 >> 172.21.15.96:0/1658039535 conn(0x7fa3380fc750 msgr2=0x7fa3380feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:50.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.370+0000 7fa33cde8700 1 -- 172.21.15.96:0/1658039535 shutdown_connections 2024-02-19T19:13:50.394 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.371+0000 7fa33cde8700 1 -- 172.21.15.96:0/1658039535 wait complete. 2024-02-19T19:13:50.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.371+0000 7fa33cde8700 1 Processor -- start 2024-02-19T19:13:50.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.371+0000 7fa33cde8700 1 -- start start 2024-02-19T19:13:50.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.371+0000 7fa33cde8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa338100ea0 0x7fa33819e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:50.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.371+0000 7fa33cde8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa338101850 0x7fa33819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:50.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.371+0000 7fa33cde8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33819f520 con 0x7fa338100ea0 2024-02-19T19:13:50.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.371+0000 7fa33cde8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3381989d0 con 0x7fa338101850 2024-02-19T19:13:50.396 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.372+0000 7fa33659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa338100ea0 0x7fa33819e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:50.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.372+0000 7fa33659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa338100ea0 0x7fa33819e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38130/0 (socket says 172.21.15.96:38130) 2024-02-19T19:13:50.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.372+0000 7fa33659c700 1 -- 172.21.15.96:0/3268783950 learned_addr learned my addr 172.21.15.96:0/3268783950 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:13:50.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.372+0000 7fa335d9b700 1 --2- 172.21.15.96:0/3268783950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa338101850 0x7fa33819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:50.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.372+0000 7fa33659c700 1 -- 172.21.15.96:0/3268783950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa338101850 msgr2=0x7fa33819ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:50.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.372+0000 7fa33659c700 1 --2- 172.21.15.96:0/3268783950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa338101850 0x7fa33819ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:50.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.372+0000 7fa33659c700 1 -- 172.21.15.96:0/3268783950 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c0095f0 con 0x7fa338100ea0 2024-02-19T19:13:50.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.372+0000 7fa33659c700 1 --2- 172.21.15.96:0/3268783950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa338100ea0 0x7fa33819e950 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa32800b4b0 tx=0x7fa32800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:50.397 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.372+0000 7fa3277fe700 1 -- 172.21.15.96:0/3268783950 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa328011800 con 0x7fa338100ea0 2024-02-19T19:13:50.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.372+0000 7fa33cde8700 1 -- 172.21.15.96:0/3268783950 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa338198cb0 con 0x7fa338100ea0 2024-02-19T19:13:50.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.372+0000 7fa3277fe700 1 -- 172.21.15.96:0/3268783950 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa328011e20 con 0x7fa338100ea0 2024-02-19T19:13:50.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.372+0000 7fa3277fe700 1 -- 172.21.15.96:0/3268783950 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa32800f2e0 con 0x7fa338100ea0 2024-02-19T19:13:50.398 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.372+0000 7fa33cde8700 1 -- 172.21.15.96:0/3268783950 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa338199200 con 0x7fa338100ea0 2024-02-19T19:13:50.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.374+0000 7fa33cde8700 1 -- 172.21.15.96:0/3268783950 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa338105020 con 0x7fa338100ea0 2024-02-19T19:13:50.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.374+0000 7fa3277fe700 1 -- 172.21.15.96:0/3268783950 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fa32800f510 con 0x7fa338100ea0 2024-02-19T19:13:50.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.374+0000 7fa3277fe700 1 --2- 172.21.15.96:0/3268783950 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa32006d8a0 0x7fa32006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:50.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.374+0000 7fa3277fe700 1 -- 172.21.15.96:0/3268783950 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa32808d150 con 0x7fa338100ea0 2024-02-19T19:13:50.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.374+0000 7fa335d9b700 1 --2- 172.21.15.96:0/3268783950 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa32006d8a0 0x7fa32006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:50.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.375+0000 7fa335d9b700 1 --2- 172.21.15.96:0/3268783950 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa32006d8a0 0x7fa32006fd60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa3380fd080 tx=0x7fa32c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:50.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.383+0000 7fa3277fe700 1 -- 172.21.15.96:0/3268783950 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa32805a430 con 0x7fa338100ea0 2024-02-19T19:13:50.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:50 smithi096 ceph-mon[112483]: from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:13:50.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:50 smithi096 ceph-mon[112483]: pgmap v211: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:50.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:50 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/248986218' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:50.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:13:50.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.631+0000 7fa33cde8700 1 -- 172.21.15.96:0/3268783950 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa33804f2e0 con 0x7fa338100ea0 2024-02-19T19:13:50.654 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.631+0000 7fa3277fe700 1 -- 172.21.15.96:0/3268783950 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1662 (secure 0 0 0) 0x7fa328059fc0 con 0x7fa338100ea0 2024-02-19T19:13:50.654 INFO:teuthology.orchestra.run.smithi096.stdout:e30 2024-02-19T19:13:50.654 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:13:50.655 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:13:50.655 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2024-02-19T19:13:50.655 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:13:50.655 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:13:50.655 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2024-02-19T19:13:50.655 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 22 2024-02-19T19:13:50.655 INFO:teuthology.orchestra.run.smithi096.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-02-19T19:13:50.655 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-02-19T19:01:42.881136+0000 2024-02-19T19:13:50.656 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2024-02-19T19:12:50.540695+0000 2024-02-19T19:13:50.656 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2024-02-19T19:13:50.656 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2024-02-19T19:13:50.656 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2024-02-19T19:13:50.656 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2024-02-19T19:13:50.656 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2024-02-19T19:13:50.656 INFO:teuthology.orchestra.run.smithi096.stdout:max_xattr_size 65536 2024-02-19T19:13:50.656 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2024-02-19T19:13:50.657 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2024-02-19T19:13:50.657 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 81 2024-02-19T19:13:50.657 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:13:50.657 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2024-02-19T19:13:50.657 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2024-02-19T19:13:50.657 INFO:teuthology.orchestra.run.smithi096.stdout:up {} 2024-02-19T19:13:50.657 INFO:teuthology.orchestra.run.smithi096.stdout:failed 0,1 2024-02-19T19:13:50.657 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2024-02-19T19:13:50.657 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2024-02-19T19:13:50.658 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2024-02-19T19:13:50.658 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2024-02-19T19:13:50.658 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data enabled 2024-02-19T19:13:50.658 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2024-02-19T19:13:50.658 INFO:teuthology.orchestra.run.smithi096.stdout:bal_rank_mask -1 2024-02-19T19:13:50.658 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2024-02-19T19:13:50.658 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:13:50.658 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:13:50.658 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2024-02-19T19:13:50.658 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:13:50.659 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.usrmcg{-1:34458} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6826/3847593496,v1:172.21.15.96:6827/3847593496] compat {c=[1],r=[1],i=[fff]}] 2024-02-19T19:13:50.659 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pccmys{-1:34462} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.96:6828/2639702047,v1:172.21.15.96:6829/2639702047] compat {c=[1],r=[1],i=[fff]}] 2024-02-19T19:13:50.659 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.srnlol{-1:44381} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.125:6824/3852344857,v1:172.21.15.125:6825/3852344857] compat {c=[1],r=[1],i=[fff]}] 2024-02-19T19:13:50.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.635+0000 7fa33cde8700 1 -- 172.21.15.96:0/3268783950 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa32006d8a0 msgr2=0x7fa32006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:50.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.635+0000 7fa33cde8700 1 --2- 172.21.15.96:0/3268783950 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa32006d8a0 0x7fa32006fd60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa3380fd080 tx=0x7fa32c01a040 comp rx=0 tx=0).stop 2024-02-19T19:13:50.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.635+0000 7fa33cde8700 1 -- 172.21.15.96:0/3268783950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa338100ea0 msgr2=0x7fa33819e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:50.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.635+0000 7fa33cde8700 1 --2- 172.21.15.96:0/3268783950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa338100ea0 0x7fa33819e950 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa32800b4b0 tx=0x7fa32800b870 comp rx=0 tx=0).stop 2024-02-19T19:13:50.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.635+0000 7fa33cde8700 1 -- 172.21.15.96:0/3268783950 shutdown_connections 2024-02-19T19:13:50.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.635+0000 7fa33cde8700 1 --2- 172.21.15.96:0/3268783950 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa32006d8a0 0x7fa32006fd60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:50.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.635+0000 7fa33cde8700 1 --2- 172.21.15.96:0/3268783950 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa338100ea0 0x7fa33819e950 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:50.660 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.635+0000 7fa33cde8700 1 --2- 172.21.15.96:0/3268783950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa338101850 0x7fa33819ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:50.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.635+0000 7fa33cde8700 1 -- 172.21.15.96:0/3268783950 >> 172.21.15.96:0/3268783950 conn(0x7fa3380fc750 msgr2=0x7fa3380fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:50.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.635+0000 7fa33cde8700 1 -- 172.21.15.96:0/3268783950 shutdown_connections 2024-02-19T19:13:50.661 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.635+0000 7fa33cde8700 1 -- 172.21.15.96:0/3268783950 wait complete. 2024-02-19T19:13:50.661 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 30 2024-02-19T19:13:50.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:50 smithi125 ceph-mon[86115]: from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:13:50.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:50 smithi125 ceph-mon[86115]: pgmap v211: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:50.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:50 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/248986218' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:13:50.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:13:50.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.747+0000 7f9ee96d8700 1 -- 172.21.15.96:0/1899012382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee40ff5a0 msgr2=0x7f9ee40ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:50.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.747+0000 7f9ee96d8700 1 --2- 172.21.15.96:0/1899012382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee40ff5a0 0x7f9ee40ff980 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400b0a0 tx=0x7f9ed400b3b0 comp rx=0 tx=0).stop 2024-02-19T19:13:50.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.747+0000 7f9ee96d8700 1 -- 172.21.15.96:0/1899012382 shutdown_connections 2024-02-19T19:13:50.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.747+0000 7f9ee96d8700 1 --2- 172.21.15.96:0/1899012382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ee40fff50 0x7f9ee4105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:50.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.747+0000 7f9ee96d8700 1 --2- 172.21.15.96:0/1899012382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee40ff5a0 0x7f9ee40ff980 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:50.770 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.747+0000 7f9ee96d8700 1 -- 172.21.15.96:0/1899012382 >> 172.21.15.96:0/1899012382 conn(0x7f9ee4074e30 msgr2=0x7f9ee4075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:50.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.747+0000 7f9ee96d8700 1 -- 172.21.15.96:0/1899012382 shutdown_connections 2024-02-19T19:13:50.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.747+0000 7f9ee96d8700 1 -- 172.21.15.96:0/1899012382 wait complete. 2024-02-19T19:13:50.771 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.747+0000 7f9ee96d8700 1 Processor -- start 2024-02-19T19:13:50.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.748+0000 7f9ee96d8700 1 -- start start 2024-02-19T19:13:50.772 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.748+0000 7f9ee96d8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ee40ff5a0 0x7f9ee4100520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:50.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.748+0000 7f9ee96d8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee40fff50 0x7f9ee4100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:50.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.748+0000 7f9ee96d8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee4100fa0 con 0x7f9ee40fff50 2024-02-19T19:13:50.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.748+0000 7f9ee96d8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee41010e0 con 0x7f9ee40ff5a0 2024-02-19T19:13:50.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.748+0000 7f9ee27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee40fff50 0x7f9ee4100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:50.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.748+0000 7f9ee2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ee40ff5a0 0x7f9ee4100520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:50.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.748+0000 7f9ee27fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee40fff50 0x7f9ee4100a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38160/0 (socket says 172.21.15.96:38160) 2024-02-19T19:13:50.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.748+0000 7f9ee27fc700 1 -- 172.21.15.96:0/1045076261 learned_addr learned my addr 172.21.15.96:0/1045076261 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:13:50.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.748+0000 7f9ee27fc700 1 -- 172.21.15.96:0/1045076261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ee40ff5a0 msgr2=0x7f9ee4100520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:50.773 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.748+0000 7f9ee27fc700 1 --2- 172.21.15.96:0/1045076261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ee40ff5a0 0x7f9ee4100520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:50.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.748+0000 7f9ee27fc700 1 -- 172.21.15.96:0/1045076261 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed4009d00 con 0x7f9ee40fff50 2024-02-19T19:13:50.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.749+0000 7f9ee27fc700 1 --2- 172.21.15.96:0/1045076261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee40fff50 0x7f9ee4100a60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00d8d0 tx=0x7f9ecc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:50.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.749+0000 7f9edbfff700 1 -- 172.21.15.96:0/1045076261 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ecc004a00 con 0x7f9ee40fff50 2024-02-19T19:13:50.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.749+0000 7f9ee96d8700 1 -- 172.21.15.96:0/1045076261 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee41a2b40 con 0x7f9ee40fff50 2024-02-19T19:13:50.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.749+0000 7f9edbfff700 1 -- 172.21.15.96:0/1045076261 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ecc0054e0 con 0x7f9ee40fff50 2024-02-19T19:13:50.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.749+0000 7f9edbfff700 1 -- 172.21.15.96:0/1045076261 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ecc00fc20 con 0x7f9ee40fff50 2024-02-19T19:13:50.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.749+0000 7f9ee96d8700 1 -- 172.21.15.96:0/1045076261 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee41a2f50 con 0x7f9ee40fff50 2024-02-19T19:13:50.774 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.750+0000 7f9ee96d8700 1 -- 172.21.15.96:0/1045076261 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee4109270 con 0x7f9ee40fff50 2024-02-19T19:13:50.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.750+0000 7f9edbfff700 1 -- 172.21.15.96:0/1045076261 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f9ecc005020 con 0x7f9ee40fff50 2024-02-19T19:13:50.775 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.751+0000 7f9edbfff700 1 --2- 172.21.15.96:0/1045076261 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9ed006d8a0 0x7f9ed006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:50.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.751+0000 7f9edbfff700 1 -- 172.21.15.96:0/1045076261 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f9ecc08cd90 con 0x7f9ee40fff50 2024-02-19T19:13:50.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.751+0000 7f9ee2ffd700 1 --2- 172.21.15.96:0/1045076261 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9ed006d8a0 0x7f9ed006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:50.776 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.751+0000 7f9ee2ffd700 1 --2- 172.21.15.96:0/1045076261 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9ed006d8a0 0x7f9ed006fd60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4000f80 tx=0x7f9ed40060c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:50.783 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.760+0000 7f9edbfff700 1 -- 172.21.15.96:0/1045076261 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9ecc056540 con 0x7f9ee40fff50 2024-02-19T19:13:51.002 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.979+0000 7f9ee96d8700 1 -- 172.21.15.96:0/1045076261 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ee40611d0 con 0x7f9ed006d8a0 2024-02-19T19:13:51.003 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.980+0000 7f9edbfff700 1 -- 172.21.15.96:0/1045076261 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f9ee40611d0 con 0x7f9ed006d8a0 2024-02-19T19:13:51.003 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:13:51.003 INFO:teuthology.orchestra.run.smithi096.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526", 2024-02-19T19:13:51.004 INFO:teuthology.orchestra.run.smithi096.stdout: "in_progress": true, 2024-02-19T19:13:51.004 INFO:teuthology.orchestra.run.smithi096.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-19T19:13:51.004 INFO:teuthology.orchestra.run.smithi096.stdout: "services_complete": [ 2024-02-19T19:13:51.004 INFO:teuthology.orchestra.run.smithi096.stdout: "crash", 2024-02-19T19:13:51.004 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr", 2024-02-19T19:13:51.004 INFO:teuthology.orchestra.run.smithi096.stdout: "osd", 2024-02-19T19:13:51.004 INFO:teuthology.orchestra.run.smithi096.stdout: "mon" 2024-02-19T19:13:51.004 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-02-19T19:13:51.005 INFO:teuthology.orchestra.run.smithi096.stdout: "progress": "15/23 daemons upgraded", 2024-02-19T19:13:51.005 INFO:teuthology.orchestra.run.smithi096.stdout: "message": "Currently upgrading mds daemons", 2024-02-19T19:13:51.005 INFO:teuthology.orchestra.run.smithi096.stdout: "is_paused": false 2024-02-19T19:13:51.005 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:13:51.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.982+0000 7f9ee96d8700 1 -- 172.21.15.96:0/1045076261 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9ed006d8a0 msgr2=0x7f9ed006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:51.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.982+0000 7f9ee96d8700 1 --2- 172.21.15.96:0/1045076261 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9ed006d8a0 0x7f9ed006fd60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4000f80 tx=0x7f9ed40060c0 comp rx=0 tx=0).stop 2024-02-19T19:13:51.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.982+0000 7f9ee96d8700 1 -- 172.21.15.96:0/1045076261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee40fff50 msgr2=0x7f9ee4100a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:51.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.982+0000 7f9ee96d8700 1 --2- 172.21.15.96:0/1045076261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee40fff50 0x7f9ee4100a60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00d8d0 tx=0x7f9ecc00dbe0 comp rx=0 tx=0).stop 2024-02-19T19:13:51.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.982+0000 7f9ee96d8700 1 -- 172.21.15.96:0/1045076261 shutdown_connections 2024-02-19T19:13:51.006 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.983+0000 7f9ee96d8700 1 --2- 172.21.15.96:0/1045076261 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f9ed006d8a0 0x7f9ed006fd60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:51.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.983+0000 7f9ee96d8700 1 --2- 172.21.15.96:0/1045076261 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ee40ff5a0 0x7f9ee4100520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:51.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.983+0000 7f9ee96d8700 1 --2- 172.21.15.96:0/1045076261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee40fff50 0x7f9ee4100a60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:51.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.983+0000 7f9ee96d8700 1 -- 172.21.15.96:0/1045076261 >> 172.21.15.96:0/1045076261 conn(0x7f9ee4074e30 msgr2=0x7f9ee40fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:51.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.983+0000 7f9ee96d8700 1 -- 172.21.15.96:0/1045076261 shutdown_connections 2024-02-19T19:13:51.007 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:50.983+0000 7f9ee96d8700 1 -- 172.21.15.96:0/1045076261 wait complete. 2024-02-19T19:13:51.111 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.089+0000 7f161dd3d700 1 -- 172.21.15.96:0/3707991225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1618105bd0 msgr2=0x7f1618105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:51.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.089+0000 7f161dd3d700 1 --2- 172.21.15.96:0/3707991225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1618105bd0 0x7f1618105fb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f160c009910 tx=0x7f160c009c20 comp rx=0 tx=0).stop 2024-02-19T19:13:51.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.089+0000 7f161dd3d700 1 -- 172.21.15.96:0/3707991225 shutdown_connections 2024-02-19T19:13:51.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.089+0000 7f161dd3d700 1 --2- 172.21.15.96:0/3707991225 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16180ffc20 0x7f1618100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:51.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.089+0000 7f161dd3d700 1 --2- 172.21.15.96:0/3707991225 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1618105bd0 0x7f1618105fb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:51.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.089+0000 7f161dd3d700 1 -- 172.21.15.96:0/3707991225 >> 172.21.15.96:0/3707991225 conn(0x7f1618075670 msgr2=0x7f1618075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:51.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.089+0000 7f161dd3d700 1 -- 172.21.15.96:0/3707991225 shutdown_connections 2024-02-19T19:13:51.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.089+0000 7f161dd3d700 1 -- 172.21.15.96:0/3707991225 wait complete. 2024-02-19T19:13:51.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.090+0000 7f161dd3d700 1 Processor -- start 2024-02-19T19:13:51.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.090+0000 7f161dd3d700 1 -- start start 2024-02-19T19:13:51.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.090+0000 7f161dd3d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16180ffc20 0x7f161819b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:51.114 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.090+0000 7f161dd3d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1618105bd0 0x7f161819bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:51.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.090+0000 7f161dd3d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1618195590 con 0x7f1618105bd0 2024-02-19T19:13:51.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.090+0000 7f161dd3d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1618195700 con 0x7f16180ffc20 2024-02-19T19:13:51.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.090+0000 7f1616ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1618105bd0 0x7f161819bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:51.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.090+0000 7f1616ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1618105bd0 0x7f161819bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:38188/0 (socket says 172.21.15.96:38188) 2024-02-19T19:13:51.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.090+0000 7f1616ffd700 1 -- 172.21.15.96:0/3760824342 learned_addr learned my addr 172.21.15.96:0/3760824342 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:13:51.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.090+0000 7f16177fe700 1 --2- 172.21.15.96:0/3760824342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16180ffc20 0x7f161819b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:51.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.091+0000 7f1616ffd700 1 -- 172.21.15.96:0/3760824342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16180ffc20 msgr2=0x7f161819b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:51.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.091+0000 7f1616ffd700 1 --2- 172.21.15.96:0/3760824342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16180ffc20 0x7f161819b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:51.115 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.091+0000 7f1616ffd700 1 -- 172.21.15.96:0/3760824342 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c0095f0 con 0x7f1618105bd0 2024-02-19T19:13:51.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.091+0000 7f1616ffd700 1 --2- 172.21.15.96:0/3760824342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1618105bd0 0x7f161819bae0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f160800d8d0 tx=0x7f160800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:51.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.091+0000 7f1614ff9700 1 -- 172.21.15.96:0/3760824342 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f16080098a0 con 0x7f1618105bd0 2024-02-19T19:13:51.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.091+0000 7f161dd3d700 1 -- 172.21.15.96:0/3760824342 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1618195980 con 0x7f1618105bd0 2024-02-19T19:13:51.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.091+0000 7f1614ff9700 1 -- 172.21.15.96:0/3760824342 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1608010460 con 0x7f1618105bd0 2024-02-19T19:13:51.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.091+0000 7f1614ff9700 1 -- 172.21.15.96:0/3760824342 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f160800f5f0 con 0x7f1618105bd0 2024-02-19T19:13:51.116 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.091+0000 7f161dd3d700 1 -- 172.21.15.96:0/3760824342 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1618195ed0 con 0x7f1618105bd0 2024-02-19T19:13:51.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.092+0000 7f161dd3d700 1 -- 172.21.15.96:0/3760824342 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f161804f2e0 con 0x7f1618105bd0 2024-02-19T19:13:51.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.092+0000 7f1614ff9700 1 -- 172.21.15.96:0/3760824342 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f1608009a00 con 0x7f1618105bd0 2024-02-19T19:13:51.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.093+0000 7f1614ff9700 1 --2- 172.21.15.96:0/3760824342 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f160006d8a0 0x7f160006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:13:51.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.093+0000 7f1614ff9700 1 -- 172.21.15.96:0/3760824342 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f160808d430 con 0x7f1618105bd0 2024-02-19T19:13:51.117 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.093+0000 7f16177fe700 1 --2- 172.21.15.96:0/3760824342 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f160006d8a0 0x7f160006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:13:51.118 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.093+0000 7f16177fe700 1 --2- 172.21.15.96:0/3760824342 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f160006d8a0 0x7f160006fd60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f160c006010 tx=0x7f160c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:13:51.120 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.097+0000 7f1614ff9700 1 -- 172.21.15.96:0/3760824342 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1608056be0 con 0x7f1618105bd0 2024-02-19T19:13:51.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.380+0000 7f161dd3d700 1 -- 172.21.15.96:0/3760824342 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f16181960b0 con 0x7f1618105bd0 2024-02-19T19:13:51.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.381+0000 7f1614ff9700 1 -- 172.21.15.96:0/3760824342 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+423 (secure 0 0 0) 0x7f160805a2a0 con 0x7f1618105bd0 2024-02-19T19:13:51.404 INFO:teuthology.orchestra.run.smithi096.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-02-19T19:13:51.404 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-19T19:13:51.404 INFO:teuthology.orchestra.run.smithi096.stdout: fs cephfs is degraded 2024-02-19T19:13:51.404 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-19T19:13:51.404 INFO:teuthology.orchestra.run.smithi096.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-19T19:13:51.404 INFO:teuthology.orchestra.run.smithi096.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-02-19T19:13:51.404 INFO:teuthology.orchestra.run.smithi096.stdout: fs cephfs is offline because no MDS is active for it. 2024-02-19T19:13:51.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.383+0000 7f161dd3d700 1 -- 172.21.15.96:0/3760824342 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f160006d8a0 msgr2=0x7f160006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:51.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.383+0000 7f161dd3d700 1 --2- 172.21.15.96:0/3760824342 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f160006d8a0 0x7f160006fd60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f160c006010 tx=0x7f160c01a040 comp rx=0 tx=0).stop 2024-02-19T19:13:51.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.383+0000 7f161dd3d700 1 -- 172.21.15.96:0/3760824342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1618105bd0 msgr2=0x7f161819bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:13:51.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.383+0000 7f161dd3d700 1 --2- 172.21.15.96:0/3760824342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1618105bd0 0x7f161819bae0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f160800d8d0 tx=0x7f160800dbe0 comp rx=0 tx=0).stop 2024-02-19T19:13:51.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.383+0000 7f161dd3d700 1 -- 172.21.15.96:0/3760824342 shutdown_connections 2024-02-19T19:13:51.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.383+0000 7f161dd3d700 1 --2- 172.21.15.96:0/3760824342 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f160006d8a0 0x7f160006fd60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:51.406 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.383+0000 7f161dd3d700 1 --2- 172.21.15.96:0/3760824342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16180ffc20 0x7f161819b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:51.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.383+0000 7f161dd3d700 1 --2- 172.21.15.96:0/3760824342 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1618105bd0 0x7f161819bae0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:13:51.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.383+0000 7f161dd3d700 1 -- 172.21.15.96:0/3760824342 >> 172.21.15.96:0/3760824342 conn(0x7f1618075670 msgr2=0x7f16180feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:13:51.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.383+0000 7f161dd3d700 1 -- 172.21.15.96:0/3760824342 shutdown_connections 2024-02-19T19:13:51.407 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:13:51.383+0000 7f161dd3d700 1 -- 172.21.15.96:0/3760824342 wait complete. 2024-02-19T19:13:51.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:51 smithi125 ceph-mon[86115]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:13:51.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:51 smithi125 ceph-mon[86115]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:13:51.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:51 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/3268783950' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:13:51.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:51 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/3760824342' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:13:51.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:51 smithi096 ceph-mon[112483]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:13:51.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:51 smithi096 ceph-mon[112483]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:13:51.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:51 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/3268783950' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:13:51.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:51 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/3760824342' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:13:52.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:52 smithi125 ceph-mon[86115]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:13:52.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:52 smithi125 ceph-mon[86115]: pgmap v212: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:52.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:52 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:52.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:52 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:52.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:52 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:13:52.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:52 smithi096 ceph-mon[112483]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:13:52.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:52 smithi096 ceph-mon[112483]: pgmap v212: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:52.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:52 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:52.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:52 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:52.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:52 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:13:53.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:53 smithi125 ceph-mon[86115]: mds.? [v2:172.21.15.125:6826/95704371,v1:172.21.15.125:6827/95704371] up:boot 2024-02-19T19:13:53.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:53 smithi125 ceph-mon[86115]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:13:53.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:53 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.pwyuga"}]: dispatch 2024-02-19T19:13:53.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:53 smithi096 ceph-mon[112483]: mds.? [v2:172.21.15.125:6826/95704371,v1:172.21.15.125:6827/95704371] up:boot 2024-02-19T19:13:53.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:53 smithi096 ceph-mon[112483]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:13:53.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:53 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi125.pwyuga"}]: dispatch 2024-02-19T19:13:54.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:54 smithi096 ceph-mon[112483]: pgmap v213: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:54.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:54 smithi125 ceph-mon[86115]: pgmap v213: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:55.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:55 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:55.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:55 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:55.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:55 smithi125 ceph-mon[86115]: pgmap v214: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:56.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:55 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:56.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:55 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:56.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:55 smithi096 ceph-mon[112483]: pgmap v214: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:56.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:56 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:56.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:56 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:57.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:56 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:57.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:56 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:13:57.795 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:13:57 smithi125 ceph-mon[86115]: pgmap v215: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:13:57.863 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:13:57 smithi096 ceph-mon[112483]: pgmap v215: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:00.454 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:00.455 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:00.455 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:14:00.455 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:14:00.455 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:00.455 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:14:00.455 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:00.456 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:00.456 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:00.456 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:00.456 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:00.456 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: Upgrade: Setting container_image for all mds 2024-02-19T19:14:00.456 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:00.456 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi096.pccmys"}]: dispatch 2024-02-19T19:14:00.456 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi096.pccmys"}]': finished 2024-02-19T19:14:00.457 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi096.usrmcg"}]: dispatch 2024-02-19T19:14:00.457 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi096.usrmcg"}]': finished 2024-02-19T19:14:00.457 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi125.pwyuga"}]: dispatch 2024-02-19T19:14:00.457 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi125.pwyuga"}]': finished 2024-02-19T19:14:00.457 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi125.srnlol"}]: dispatch 2024-02-19T19:14:00.457 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi125.srnlol"}]': finished 2024-02-19T19:14:00.457 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: Upgrade: Setting filesystem cephfs Joinable 2024-02-19T19:14:00.457 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-19T19:14:00.458 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:00 smithi125 ceph-mon[86115]: pgmap v216: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:00.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:00.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:00.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:14:00.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:14:00.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:00.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:14:00.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:00.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:00.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:00.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:00.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:00.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: Upgrade: Setting container_image for all mds 2024-02-19T19:14:00.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:00.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi096.pccmys"}]: dispatch 2024-02-19T19:14:00.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi096.pccmys"}]': finished 2024-02-19T19:14:00.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi096.usrmcg"}]: dispatch 2024-02-19T19:14:00.541 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi096.usrmcg"}]': finished 2024-02-19T19:14:00.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi125.pwyuga"}]: dispatch 2024-02-19T19:14:00.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi125.pwyuga"}]': finished 2024-02-19T19:14:00.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi125.srnlol"}]: dispatch 2024-02-19T19:14:00.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi125.srnlol"}]': finished 2024-02-19T19:14:00.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: Upgrade: Setting filesystem cephfs Joinable 2024-02-19T19:14:00.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-19T19:14:00.542 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:00 smithi096 ceph-mon[112483]: pgmap v216: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:01.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:01 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-19T19:14:01.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:01 smithi125 ceph-mon[86115]: Standby daemon mds.cephfs.smithi096.usrmcg assigned to filesystem cephfs as rank 0 2024-02-19T19:14:01.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:01 smithi125 ceph-mon[86115]: Standby daemon mds.cephfs.smithi096.pccmys assigned to filesystem cephfs as rank 1 2024-02-19T19:14:01.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:01 smithi125 ceph-mon[86115]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-19T19:14:01.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:01 smithi125 ceph-mon[86115]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:14:01.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:01 smithi125 ceph-mon[86115]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-02-19T19:14:01.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:01 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-02-19T19:14:01.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:01 smithi125 ceph-mon[86115]: fsmap cephfs:2/2 {0=cephfs.smithi096.usrmcg=up:replay,1=cephfs.smithi096.pccmys=up:replay} 2 up:standby 2024-02-19T19:14:01.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:01 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-19T19:14:01.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:01 smithi096 ceph-mon[112483]: Standby daemon mds.cephfs.smithi096.usrmcg assigned to filesystem cephfs as rank 0 2024-02-19T19:14:01.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:01 smithi096 ceph-mon[112483]: Standby daemon mds.cephfs.smithi096.pccmys assigned to filesystem cephfs as rank 1 2024-02-19T19:14:01.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:01 smithi096 ceph-mon[112483]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-19T19:14:01.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:01 smithi096 ceph-mon[112483]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-02-19T19:14:01.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:01 smithi096 ceph-mon[112483]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-02-19T19:14:01.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:01 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-02-19T19:14:01.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:01 smithi096 ceph-mon[112483]: fsmap cephfs:2/2 {0=cephfs.smithi096.usrmcg=up:replay,1=cephfs.smithi096.pccmys=up:replay} 2 up:standby 2024-02-19T19:14:02.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:02 smithi125 ceph-mon[86115]: pgmap v217: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 683 KiB/s rd, 0 op/s 2024-02-19T19:14:02.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:02 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-02-19T19:14:02.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:02 smithi125 ceph-mon[86115]: mds.? [v2:172.21.15.96:6828/2639702047,v1:172.21.15.96:6829/2639702047] up:resolve 2024-02-19T19:14:02.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:02 smithi125 ceph-mon[86115]: fsmap cephfs:2/2 {0=cephfs.smithi096.usrmcg=up:replay,1=cephfs.smithi096.pccmys=up:resolve} 2 up:standby 2024-02-19T19:14:02.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:02 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:02.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:02 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:02.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:02 smithi125 ceph-mon[86115]: Upgrade: Setting container_image for all rgw 2024-02-19T19:14:02.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:02 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:02.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:02 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:02.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:02 smithi125 ceph-mon[86115]: Upgrade: Setting container_image for all rbd-mirror 2024-02-19T19:14:02.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:02 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:02.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:02 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:02.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:02 smithi096 ceph-mon[112483]: pgmap v217: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 683 KiB/s rd, 0 op/s 2024-02-19T19:14:02.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:02 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-02-19T19:14:02.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:02 smithi096 ceph-mon[112483]: mds.? [v2:172.21.15.96:6828/2639702047,v1:172.21.15.96:6829/2639702047] up:resolve 2024-02-19T19:14:02.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:02 smithi096 ceph-mon[112483]: fsmap cephfs:2/2 {0=cephfs.smithi096.usrmcg=up:replay,1=cephfs.smithi096.pccmys=up:resolve} 2 up:standby 2024-02-19T19:14:02.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:02 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:02.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:02 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:02.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:02 smithi096 ceph-mon[112483]: Upgrade: Setting container_image for all rgw 2024-02-19T19:14:02.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:02 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:02.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:02 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:02.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:02 smithi096 ceph-mon[112483]: Upgrade: Setting container_image for all rbd-mirror 2024-02-19T19:14:02.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:02 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:02.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:02 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:04.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:04 smithi096 ceph-mon[112483]: Upgrade: Updating ceph-exporter.smithi096 (1/2) 2024-02-19T19:14:04.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:04 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:04.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:04 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi096", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:14:04.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:04 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:14:04.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:04 smithi096 ceph-mon[112483]: Deploying daemon ceph-exporter.smithi096 on smithi096 2024-02-19T19:14:04.290 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:04 smithi096 ceph-mon[112483]: pgmap v218: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 683 KiB/s rd, 0 op/s 2024-02-19T19:14:04.290 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:04 smithi096 ceph-mon[112483]: mds.? [v2:172.21.15.96:6826/3847593496,v1:172.21.15.96:6827/3847593496] up:resolve 2024-02-19T19:14:04.290 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:04 smithi096 ceph-mon[112483]: fsmap cephfs:2/2 {0=cephfs.smithi096.usrmcg=up:resolve,1=cephfs.smithi096.pccmys=up:resolve} 2 up:standby 2024-02-19T19:14:04.454 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:04 smithi125 ceph-mon[86115]: Upgrade: Updating ceph-exporter.smithi096 (1/2) 2024-02-19T19:14:04.454 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:04 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:04.454 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:04 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi096", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:14:04.454 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:04 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:14:04.454 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:04 smithi125 ceph-mon[86115]: Deploying daemon ceph-exporter.smithi096 on smithi096 2024-02-19T19:14:04.455 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:04 smithi125 ceph-mon[86115]: pgmap v218: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 683 KiB/s rd, 0 op/s 2024-02-19T19:14:04.455 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:04 smithi125 ceph-mon[86115]: mds.? [v2:172.21.15.96:6826/3847593496,v1:172.21.15.96:6827/3847593496] up:resolve 2024-02-19T19:14:04.455 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:04 smithi125 ceph-mon[86115]: fsmap cephfs:2/2 {0=cephfs.smithi096.usrmcg=up:resolve,1=cephfs.smithi096.pccmys=up:resolve} 2 up:standby 2024-02-19T19:14:05.593 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:05 smithi096 ceph-mon[112483]: mds.? [v2:172.21.15.96:6826/3847593496,v1:172.21.15.96:6827/3847593496] up:reconnect 2024-02-19T19:14:05.593 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:05 smithi096 ceph-mon[112483]: mds.? [v2:172.21.15.96:6828/2639702047,v1:172.21.15.96:6829/2639702047] up:reconnect 2024-02-19T19:14:05.593 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:05 smithi096 ceph-mon[112483]: fsmap cephfs:2/2 {0=cephfs.smithi096.usrmcg=up:reconnect,1=cephfs.smithi096.pccmys=up:reconnect} 2 up:standby 2024-02-19T19:14:05.593 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:05.593 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:14:05.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:05 smithi125 ceph-mon[86115]: mds.? [v2:172.21.15.96:6826/3847593496,v1:172.21.15.96:6827/3847593496] up:reconnect 2024-02-19T19:14:05.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:05 smithi125 ceph-mon[86115]: mds.? [v2:172.21.15.96:6828/2639702047,v1:172.21.15.96:6829/2639702047] up:reconnect 2024-02-19T19:14:05.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:05 smithi125 ceph-mon[86115]: fsmap cephfs:2/2 {0=cephfs.smithi096.usrmcg=up:reconnect,1=cephfs.smithi096.pccmys=up:reconnect} 2 up:standby 2024-02-19T19:14:05.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:05.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:14:06.577 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:06 smithi096 ceph-mon[112483]: pgmap v219: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 5.1 MiB/s rd, 3 op/s 2024-02-19T19:14:06.578 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:06 smithi096 ceph-mon[112483]: mds.? [v2:172.21.15.96:6826/3847593496,v1:172.21.15.96:6827/3847593496] up:rejoin 2024-02-19T19:14:06.578 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:06 smithi096 ceph-mon[112483]: fsmap cephfs:2/2 {0=cephfs.smithi096.usrmcg=up:rejoin,1=cephfs.smithi096.pccmys=up:reconnect} 2 up:standby 2024-02-19T19:14:06.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:06 smithi125 ceph-mon[86115]: pgmap v219: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 5.1 MiB/s rd, 3 op/s 2024-02-19T19:14:06.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:06 smithi125 ceph-mon[86115]: mds.? [v2:172.21.15.96:6826/3847593496,v1:172.21.15.96:6827/3847593496] up:rejoin 2024-02-19T19:14:06.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:06 smithi125 ceph-mon[86115]: fsmap cephfs:2/2 {0=cephfs.smithi096.usrmcg=up:rejoin,1=cephfs.smithi096.pccmys=up:reconnect} 2 up:standby 2024-02-19T19:14:08.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:07 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:08.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:07 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:08.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:07 smithi125 ceph-mon[86115]: pgmap v220: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 5.1 MiB/s rd, 3 op/s 2024-02-19T19:14:08.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:07 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:08.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:07 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:08.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:07 smithi096 ceph-mon[112483]: pgmap v220: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 5.1 MiB/s rd, 3 op/s 2024-02-19T19:14:09.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:09 smithi125 ceph-mon[86115]: Upgrade: Updating ceph-exporter.smithi125 (2/2) 2024-02-19T19:14:09.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:09 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:09.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:09 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi125", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:14:09.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:09 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:14:09.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:09 smithi125 ceph-mon[86115]: Deploying daemon ceph-exporter.smithi125 on smithi125 2024-02-19T19:14:09.955 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:09 smithi125 ceph-mon[86115]: pgmap v221: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 5.1 MiB/s rd, 3 op/s 2024-02-19T19:14:10.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:09 smithi096 ceph-mon[112483]: Upgrade: Updating ceph-exporter.smithi125 (2/2) 2024-02-19T19:14:10.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:09 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:10.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:09 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi125", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-19T19:14:10.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:09 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:14:10.040 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:09 smithi096 ceph-mon[112483]: Deploying daemon ceph-exporter.smithi125 on smithi125 2024-02-19T19:14:10.040 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:09 smithi096 ceph-mon[112483]: pgmap v221: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 5.1 MiB/s rd, 3 op/s 2024-02-19T19:14:12.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:12 smithi125 ceph-mon[86115]: pgmap v222: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 5.1 MiB/s rd, 3 op/s 2024-02-19T19:14:12.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:12 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:12.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:12 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:12.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:12 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:14:12.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:12 smithi096 ceph-mon[112483]: pgmap v222: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 5.1 MiB/s rd, 3 op/s 2024-02-19T19:14:12.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:12 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:12.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:12 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:12.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:12 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:14:14.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:14 smithi125 ceph-mon[86115]: pgmap v223: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 4.4 MiB/s rd, 2 op/s 2024-02-19T19:14:14.713 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:14 smithi096 ceph-mon[112483]: pgmap v223: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 4.4 MiB/s rd, 2 op/s 2024-02-19T19:14:15.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:15 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:15.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:15 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:15.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:15 smithi096 ceph-mon[112483]: pgmap v224: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 4.4 MiB/s rd, 2 op/s 2024-02-19T19:14:15.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:15 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:15.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:15 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:15.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:15 smithi125 ceph-mon[86115]: pgmap v224: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 4.4 MiB/s rd, 2 op/s 2024-02-19T19:14:16.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:16 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:16.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:16 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:17.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:16 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:17.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:16 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:17.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:17 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:17.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:17 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:17.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:17 smithi125 ceph-mon[86115]: pgmap v225: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:18.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:18.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:18.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:17 smithi096 ceph-mon[112483]: pgmap v225: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:19.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:18 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:19.039 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:18 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:19.070 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:18 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:19.070 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:18 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:20.454 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:20.454 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:20.454 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:20 smithi125 ceph-mon[86115]: pgmap v226: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:20.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:20.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:20.540 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:20 smithi096 ceph-mon[112483]: pgmap v226: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:21.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:14:21.454 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:14:21.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.494+0000 7fb82c827700 1 -- 172.21.15.96:0/3968105782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb828101850 msgr2=0x7fb8281058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:21.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.494+0000 7fb82c827700 1 --2- 172.21.15.96:0/3968105782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb828101850 0x7fb8281058a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009910 tx=0x7fb81c009c20 comp rx=0 tx=0).stop 2024-02-19T19:14:21.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.494+0000 7fb82c827700 1 -- 172.21.15.96:0/3968105782 shutdown_connections 2024-02-19T19:14:21.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.494+0000 7fb82c827700 1 --2- 172.21.15.96:0/3968105782 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb828101850 0x7fb8281058a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:21.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.494+0000 7fb82c827700 1 --2- 172.21.15.96:0/3968105782 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb828100ea0 0x7fb828101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:21.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.494+0000 7fb82c827700 1 -- 172.21.15.96:0/3968105782 >> 172.21.15.96:0/3968105782 conn(0x7fb8280fc750 msgr2=0x7fb8280feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:21.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.494+0000 7fb82c827700 1 -- 172.21.15.96:0/3968105782 shutdown_connections 2024-02-19T19:14:21.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.494+0000 7fb82c827700 1 -- 172.21.15.96:0/3968105782 wait complete. 2024-02-19T19:14:21.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.495+0000 7fb82c827700 1 Processor -- start 2024-02-19T19:14:21.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.495+0000 7fb82c827700 1 -- start start 2024-02-19T19:14:21.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.495+0000 7fb82c827700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb828100ea0 0x7fb82819e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:21.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.495+0000 7fb82c827700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb828101850 0x7fb82819ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:21.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.495+0000 7fb82c827700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82819f4a0 con 0x7fb828100ea0 2024-02-19T19:14:21.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.495+0000 7fb82c827700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb828198950 con 0x7fb828101850 2024-02-19T19:14:21.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.495+0000 7fb82659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb828100ea0 0x7fb82819e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:21.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.495+0000 7fb82659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb828100ea0 0x7fb82819e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50010/0 (socket says 172.21.15.96:50010) 2024-02-19T19:14:21.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.495+0000 7fb82659c700 1 -- 172.21.15.96:0/3485037460 learned_addr learned my addr 172.21.15.96:0/3485037460 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:14:21.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.496+0000 7fb825d9b700 1 --2- 172.21.15.96:0/3485037460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb828101850 0x7fb82819ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:21.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.496+0000 7fb82659c700 1 -- 172.21.15.96:0/3485037460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb828101850 msgr2=0x7fb82819ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:21.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.496+0000 7fb82659c700 1 --2- 172.21.15.96:0/3485037460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb828101850 0x7fb82819ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:21.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.496+0000 7fb82659c700 1 -- 172.21.15.96:0/3485037460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c0095f0 con 0x7fb828100ea0 2024-02-19T19:14:21.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.496+0000 7fb825d9b700 1 --2- 172.21.15.96:0/3485037460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb828101850 0x7fb82819ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:14:21.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.496+0000 7fb82659c700 1 --2- 172.21.15.96:0/3485037460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb828100ea0 0x7fb82819e8d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb81800d8d0 tx=0x7fb81800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:21.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.496+0000 7fb8177fe700 1 -- 172.21.15.96:0/3485037460 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb818009940 con 0x7fb828100ea0 2024-02-19T19:14:21.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.496+0000 7fb82c827700 1 -- 172.21.15.96:0/3485037460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb828198c30 con 0x7fb828100ea0 2024-02-19T19:14:21.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.496+0000 7fb8177fe700 1 -- 172.21.15.96:0/3485037460 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb818010460 con 0x7fb828100ea0 2024-02-19T19:14:21.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.496+0000 7fb8177fe700 1 -- 172.21.15.96:0/3485037460 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb81800f5f0 con 0x7fb828100ea0 2024-02-19T19:14:21.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.496+0000 7fb82c827700 1 -- 172.21.15.96:0/3485037460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb828199180 con 0x7fb828100ea0 2024-02-19T19:14:21.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.497+0000 7fb82c827700 1 -- 172.21.15.96:0/3485037460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb828105020 con 0x7fb828100ea0 2024-02-19T19:14:21.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.498+0000 7fb8177fe700 1 -- 172.21.15.96:0/3485037460 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fb8180105d0 con 0x7fb828100ea0 2024-02-19T19:14:21.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.498+0000 7fb8177fe700 1 --2- 172.21.15.96:0/3485037460 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb81006d8a0 0x7fb81006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:21.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.498+0000 7fb8177fe700 1 -- 172.21.15.96:0/3485037460 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fb81808d540 con 0x7fb828100ea0 2024-02-19T19:14:21.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.498+0000 7fb825d9b700 1 --2- 172.21.15.96:0/3485037460 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb81006d8a0 0x7fb81006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:21.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.498+0000 7fb825d9b700 1 --2- 172.21.15.96:0/3485037460 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb81006d8a0 0x7fb81006fd60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb8280fcee0 tx=0x7fb81c01a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:21.526 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.503+0000 7fb8177fe700 1 -- 172.21.15.96:0/3485037460 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb81805a820 con 0x7fb828100ea0 2024-02-19T19:14:21.738 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.714+0000 7fb82c827700 1 -- 172.21.15.96:0/3485037460 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8281993a0 con 0x7fb81006d8a0 2024-02-19T19:14:21.739 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.715+0000 7fb8177fe700 1 -- 172.21.15.96:0/3485037460 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7fb8281993a0 con 0x7fb81006d8a0 2024-02-19T19:14:21.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.717+0000 7fb82c827700 1 -- 172.21.15.96:0/3485037460 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb81006d8a0 msgr2=0x7fb81006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:21.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.717+0000 7fb82c827700 1 --2- 172.21.15.96:0/3485037460 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb81006d8a0 0x7fb81006fd60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb8280fcee0 tx=0x7fb81c01a040 comp rx=0 tx=0).stop 2024-02-19T19:14:21.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.717+0000 7fb82c827700 1 -- 172.21.15.96:0/3485037460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb828100ea0 msgr2=0x7fb82819e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:21.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.717+0000 7fb82c827700 1 --2- 172.21.15.96:0/3485037460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb828100ea0 0x7fb82819e8d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb81800d8d0 tx=0x7fb81800dc90 comp rx=0 tx=0).stop 2024-02-19T19:14:21.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.717+0000 7fb82c827700 1 -- 172.21.15.96:0/3485037460 shutdown_connections 2024-02-19T19:14:21.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.717+0000 7fb82c827700 1 --2- 172.21.15.96:0/3485037460 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fb81006d8a0 0x7fb81006fd60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:21.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.717+0000 7fb82c827700 1 --2- 172.21.15.96:0/3485037460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb828100ea0 0x7fb82819e8d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:21.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.717+0000 7fb82c827700 1 --2- 172.21.15.96:0/3485037460 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb828101850 0x7fb82819ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:21.742 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.717+0000 7fb82c827700 1 -- 172.21.15.96:0/3485037460 >> 172.21.15.96:0/3485037460 conn(0x7fb8280fc750 msgr2=0x7fb8280feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:21.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.718+0000 7fb82c827700 1 -- 172.21.15.96:0/3485037460 shutdown_connections 2024-02-19T19:14:21.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.718+0000 7fb82c827700 1 -- 172.21.15.96:0/3485037460 wait complete. 2024-02-19T19:14:21.752 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:14:21.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.823+0000 7fac4ee0f700 1 -- 172.21.15.96:0/1785727469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac481027c0 msgr2=0x7fac4810acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:21.847 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.823+0000 7fac4ee0f700 1 --2- 172.21.15.96:0/1785727469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac481027c0 0x7fac4810acb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fac38009910 tx=0x7fac38009c20 comp rx=0 tx=0).stop 2024-02-19T19:14:21.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.823+0000 7fac4ee0f700 1 -- 172.21.15.96:0/1785727469 shutdown_connections 2024-02-19T19:14:21.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.823+0000 7fac4ee0f700 1 --2- 172.21.15.96:0/1785727469 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac481027c0 0x7fac4810acb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:21.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.823+0000 7fac4ee0f700 1 --2- 172.21.15.96:0/1785727469 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac48101ea0 0x7fac48102280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:21.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.823+0000 7fac4ee0f700 1 -- 172.21.15.96:0/1785727469 >> 172.21.15.96:0/1785727469 conn(0x7fac480fb650 msgr2=0x7fac480fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:21.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.823+0000 7fac4ee0f700 1 -- 172.21.15.96:0/1785727469 shutdown_connections 2024-02-19T19:14:21.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.823+0000 7fac4ee0f700 1 -- 172.21.15.96:0/1785727469 wait complete. 2024-02-19T19:14:21.848 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.823+0000 7fac4ee0f700 1 Processor -- start 2024-02-19T19:14:21.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.823+0000 7fac4ee0f700 1 -- start start 2024-02-19T19:14:21.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.823+0000 7fac4ee0f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac48101ea0 0x7fac4819c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:21.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.823+0000 7fac4ee0f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac481027c0 0x7fac4819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:21.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.824+0000 7fac4ee0f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4819d390 con 0x7fac48101ea0 2024-02-19T19:14:21.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.824+0000 7fac4ee0f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac48196840 con 0x7fac481027c0 2024-02-19T19:14:21.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.824+0000 7fac4cbab700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac48101ea0 0x7fac4819c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:21.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.824+0000 7fac4cbab700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac48101ea0 0x7fac4819c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50022/0 (socket says 172.21.15.96:50022) 2024-02-19T19:14:21.849 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.824+0000 7fac4cbab700 1 -- 172.21.15.96:0/3652406667 learned_addr learned my addr 172.21.15.96:0/3652406667 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:14:21.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.824+0000 7fac3ffff700 1 --2- 172.21.15.96:0/3652406667 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac481027c0 0x7fac4819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:21.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.824+0000 7fac4cbab700 1 -- 172.21.15.96:0/3652406667 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac481027c0 msgr2=0x7fac4819cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:21.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.824+0000 7fac4cbab700 1 --2- 172.21.15.96:0/3652406667 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac481027c0 0x7fac4819cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:21.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.824+0000 7fac4cbab700 1 -- 172.21.15.96:0/3652406667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac380095f0 con 0x7fac48101ea0 2024-02-19T19:14:21.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.824+0000 7fac4cbab700 1 --2- 172.21.15.96:0/3652406667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac48101ea0 0x7fac4819c7c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fac4400b4b0 tx=0x7fac4400b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:21.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.824+0000 7fac3dffb700 1 -- 172.21.15.96:0/3652406667 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac44011800 con 0x7fac48101ea0 2024-02-19T19:14:21.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.824+0000 7fac3dffb700 1 -- 172.21.15.96:0/3652406667 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fac44011e20 con 0x7fac48101ea0 2024-02-19T19:14:21.850 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.824+0000 7fac4ee0f700 1 -- 172.21.15.96:0/3652406667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac48196b20 con 0x7fac48101ea0 2024-02-19T19:14:21.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.824+0000 7fac3dffb700 1 -- 172.21.15.96:0/3652406667 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac4400f2e0 con 0x7fac48101ea0 2024-02-19T19:14:21.851 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.825+0000 7fac4ee0f700 1 -- 172.21.15.96:0/3652406667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac48197070 con 0x7fac48101ea0 2024-02-19T19:14:21.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.825+0000 7fac4ee0f700 1 -- 172.21.15.96:0/3652406667 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac48108340 con 0x7fac48101ea0 2024-02-19T19:14:21.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.826+0000 7fac3dffb700 1 -- 172.21.15.96:0/3652406667 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fac44010380 con 0x7fac48101ea0 2024-02-19T19:14:21.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.826+0000 7fac3dffb700 1 --2- 172.21.15.96:0/3652406667 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fac3006d8a0 0x7fac3006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:21.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.826+0000 7fac3dffb700 1 -- 172.21.15.96:0/3652406667 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fac4408d090 con 0x7fac48101ea0 2024-02-19T19:14:21.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.826+0000 7fac3ffff700 1 --2- 172.21.15.96:0/3652406667 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fac3006d8a0 0x7fac3006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:21.852 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.827+0000 7fac3ffff700 1 --2- 172.21.15.96:0/3652406667 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fac3006d8a0 0x7fac3006fd60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fac480fcf30 tx=0x7fac3801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:21.853 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:21.831+0000 7fac3dffb700 1 -- 172.21.15.96:0/3652406667 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fac4405a370 con 0x7fac48101ea0 2024-02-19T19:14:22.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.044+0000 7fac4ee0f700 1 -- 172.21.15.96:0/3652406667 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fac48197dc0 con 0x7fac3006d8a0 2024-02-19T19:14:22.067 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.045+0000 7fac3dffb700 1 -- 172.21.15.96:0/3652406667 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+466 (secure 0 0 0) 0x7fac48197dc0 con 0x7fac3006d8a0 2024-02-19T19:14:22.070 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.047+0000 7fac4ee0f700 1 -- 172.21.15.96:0/3652406667 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fac3006d8a0 msgr2=0x7fac3006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:22.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.047+0000 7fac4ee0f700 1 --2- 172.21.15.96:0/3652406667 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fac3006d8a0 0x7fac3006fd60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fac480fcf30 tx=0x7fac3801a040 comp rx=0 tx=0).stop 2024-02-19T19:14:22.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.047+0000 7fac4ee0f700 1 -- 172.21.15.96:0/3652406667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac48101ea0 msgr2=0x7fac4819c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:22.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.047+0000 7fac4ee0f700 1 --2- 172.21.15.96:0/3652406667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac48101ea0 0x7fac4819c7c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fac4400b4b0 tx=0x7fac4400b7c0 comp rx=0 tx=0).stop 2024-02-19T19:14:22.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.047+0000 7fac4ee0f700 1 -- 172.21.15.96:0/3652406667 shutdown_connections 2024-02-19T19:14:22.071 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.047+0000 7fac4ee0f700 1 --2- 172.21.15.96:0/3652406667 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fac3006d8a0 0x7fac3006fd60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:22.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.047+0000 7fac4ee0f700 1 --2- 172.21.15.96:0/3652406667 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fac48101ea0 0x7fac4819c7c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:22.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.047+0000 7fac4ee0f700 1 --2- 172.21.15.96:0/3652406667 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fac481027c0 0x7fac4819cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:22.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.047+0000 7fac4ee0f700 1 -- 172.21.15.96:0/3652406667 >> 172.21.15.96:0/3652406667 conn(0x7fac480fb650 msgr2=0x7fac48105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:22.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.047+0000 7fac4ee0f700 1 -- 172.21.15.96:0/3652406667 shutdown_connections 2024-02-19T19:14:22.072 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.047+0000 7fac4ee0f700 1 -- 172.21.15.96:0/3652406667 wait complete. 2024-02-19T19:14:22.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.154+0000 7f048f55d700 1 -- 172.21.15.96:0/3944113002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04880ffc20 msgr2=0x7f0488100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:22.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.154+0000 7f048f55d700 1 --2- 172.21.15.96:0/3944113002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04880ffc20 0x7f0488100080 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0478009910 tx=0x7f0478009c20 comp rx=0 tx=0).stop 2024-02-19T19:14:22.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.154+0000 7f048f55d700 1 -- 172.21.15.96:0/3944113002 shutdown_connections 2024-02-19T19:14:22.178 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.154+0000 7f048f55d700 1 --2- 172.21.15.96:0/3944113002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04880ffc20 0x7f0488100080 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:22.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.154+0000 7f048f55d700 1 --2- 172.21.15.96:0/3944113002 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0488105bd0 0x7f0488105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:22.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.154+0000 7f048f55d700 1 -- 172.21.15.96:0/3944113002 >> 172.21.15.96:0/3944113002 conn(0x7f0488075670 msgr2=0x7f0488075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:22.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.154+0000 7f048f55d700 1 -- 172.21.15.96:0/3944113002 shutdown_connections 2024-02-19T19:14:22.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.154+0000 7f048f55d700 1 -- 172.21.15.96:0/3944113002 wait complete. 2024-02-19T19:14:22.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.154+0000 7f048f55d700 1 Processor -- start 2024-02-19T19:14:22.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.154+0000 7f048f55d700 1 -- start start 2024-02-19T19:14:22.179 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.155+0000 7f048f55d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04880ffc20 0x7f0488197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:22.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.155+0000 7f048f55d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0488105bd0 0x7f0488197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:22.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.155+0000 7f048f55d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0488198380 con 0x7f04880ffc20 2024-02-19T19:14:22.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.155+0000 7f048f55d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04881984f0 con 0x7f0488105bd0 2024-02-19T19:14:22.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.155+0000 7f048d2f9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04880ffc20 0x7f0488197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:22.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.155+0000 7f048d2f9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04880ffc20 0x7f0488197760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50036/0 (socket says 172.21.15.96:50036) 2024-02-19T19:14:22.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.155+0000 7f048d2f9700 1 -- 172.21.15.96:0/3398534322 learned_addr learned my addr 172.21.15.96:0/3398534322 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:14:22.180 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.155+0000 7f048d2f9700 1 -- 172.21.15.96:0/3398534322 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0488105bd0 msgr2=0x7f0488197ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:22.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.155+0000 7f048d2f9700 1 --2- 172.21.15.96:0/3398534322 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0488105bd0 0x7f0488197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:22.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.155+0000 7f048d2f9700 1 -- 172.21.15.96:0/3398534322 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04780095f0 con 0x7f04880ffc20 2024-02-19T19:14:22.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.155+0000 7f048d2f9700 1 --2- 172.21.15.96:0/3398534322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04880ffc20 0x7f0488197760 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f048400d8d0 tx=0x7f048400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:22.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.155+0000 7f047e7fc700 1 -- 172.21.15.96:0/3398534322 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0484009940 con 0x7f04880ffc20 2024-02-19T19:14:22.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.155+0000 7f047e7fc700 1 -- 172.21.15.96:0/3398534322 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0484010460 con 0x7f04880ffc20 2024-02-19T19:14:22.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.155+0000 7f048f55d700 1 -- 172.21.15.96:0/3398534322 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04881a07d0 con 0x7f04880ffc20 2024-02-19T19:14:22.181 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.155+0000 7f047e7fc700 1 -- 172.21.15.96:0/3398534322 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f048400f5f0 con 0x7f04880ffc20 2024-02-19T19:14:22.182 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.155+0000 7f048f55d700 1 -- 172.21.15.96:0/3398534322 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04881a0d20 con 0x7f04880ffc20 2024-02-19T19:14:22.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.156+0000 7f048f55d700 1 -- 172.21.15.96:0/3398534322 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04881080d0 con 0x7f04880ffc20 2024-02-19T19:14:22.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.157+0000 7f047e7fc700 1 -- 172.21.15.96:0/3398534322 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f04840105d0 con 0x7f04880ffc20 2024-02-19T19:14:22.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.157+0000 7f047e7fc700 1 --2- 172.21.15.96:0/3398534322 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f047406d8a0 0x7f047406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:22.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.157+0000 7f047e7fc700 1 -- 172.21.15.96:0/3398534322 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f048408d430 con 0x7f04880ffc20 2024-02-19T19:14:22.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.157+0000 7f048caf8700 1 --2- 172.21.15.96:0/3398534322 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f047406d8a0 0x7f047406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:22.183 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.158+0000 7f048caf8700 1 --2- 172.21.15.96:0/3398534322 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f047406d8a0 0x7f047406fd60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f047800b5c0 tx=0x7f0478005960 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:22.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.162+0000 7f047e7fc700 1 -- 172.21.15.96:0/3398534322 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0484056c60 con 0x7f04880ffc20 2024-02-19T19:14:22.388 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.365+0000 7f048f55d700 1 -- 172.21.15.96:0/3398534322 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f04880611d0 con 0x7f047406d8a0 2024-02-19T19:14:22.399 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.376+0000 7f047e7fc700 1 -- 172.21.15.96:0/3398534322 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f04880611d0 con 0x7f047406d8a0 2024-02-19T19:14:22.399 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:14:22.399 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (8m) 5s ago 18m 24.9M - 0.25.0 c8568f914cd2 bbaf83a1e476 2024-02-19T19:14:22.399 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (15s) 5s ago 18m 7788k - 19.0.0-1450-gf78a58c0 f081f847070a 29198555e2a7 2024-02-19T19:14:22.400 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (10s) 7s ago 17m 6916k - 19.0.0-1450-gf78a58c0 f081f847070a 0fb4dbdd3442 2024-02-19T19:14:22.400 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (5m) 5s ago 18m 6669k - 19.0.0-1450-gf78a58c0 f081f847070a deea0ffefa0f 2024-02-19T19:14:22.400 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (5m) 7s ago 17m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 3421965dc5b0 2024-02-19T19:14:22.400 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (7m) 5s ago 17m 86.7M - 9.4.12 a0ea5e3c46d9 0102d90938e4 2024-02-19T19:14:22.400 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (66s) 5s ago 12m 50.4M - 19.0.0-1450-gf78a58c0 f081f847070a 26f13e1700e9 2024-02-19T19:14:22.400 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (83s) 5s ago 12m 57.9M - 19.0.0-1450-gf78a58c0 f081f847070a a24f6ad0b131 2024-02-19T19:14:22.400 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (31s) 7s ago 12m 14.8M - 19.0.0-1450-gf78a58c0 f081f847070a c1bb02a0982a 2024-02-19T19:14:22.401 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (47s) 7s ago 12m 15.9M - 19.0.0-1450-gf78a58c0 f081f847070a d0d33ee245a0 2024-02-19T19:14:22.401 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:8443,9283,8765 running (10m) 5s ago 19m 510M - 19.0.0-1450-gf78a58c0 f081f847070a a86fbe94fe3f 2024-02-19T19:14:22.401 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (9m) 7s ago 17m 451M - 19.0.0-1450-gf78a58c0 f081f847070a e250486d572d 2024-02-19T19:14:22.401 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (6m) 5s ago 19m 59.6M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d70090d516e3 2024-02-19T19:14:22.401 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (6m) 7s ago 16m 48.2M 2048M 19.0.0-1450-gf78a58c0 f081f847070a f56b17bdc9a0 2024-02-19T19:14:22.401 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (9m) 5s ago 18m 15.3M - 1.5.0 0da6a335fe13 51f622ea33d6 2024-02-19T19:14:22.401 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (9m) 7s ago 17m 17.3M - 1.5.0 0da6a335fe13 464e076a52a1 2024-02-19T19:14:22.401 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (4m) 5s ago 16m 106M 1216M 19.0.0-1450-gf78a58c0 f081f847070a b3dffd6a3fb2 2024-02-19T19:14:22.402 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4m) 5s ago 15m 108M 1216M 19.0.0-1450-gf78a58c0 f081f847070a f0dd6d8f952f 2024-02-19T19:14:22.402 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (3m) 5s ago 15m 97.4M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 51b70eaaa7a9 2024-02-19T19:14:22.402 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (3m) 7s ago 14m 82.8M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 73b832b7b243 2024-02-19T19:14:22.402 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (2m) 7s ago 14m 81.8M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 1309ffc459f9 2024-02-19T19:14:22.402 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (101s) 7s ago 14m 78.7M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 247b0927920b 2024-02-19T19:14:22.402 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (8m) 5s ago 17m 67.0M - 2.43.0 a07b618ecd1d a4edcf6ed669 2024-02-19T19:14:22.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.378+0000 7f048f55d700 1 -- 172.21.15.96:0/3398534322 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f047406d8a0 msgr2=0x7f047406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:22.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.378+0000 7f048f55d700 1 --2- 172.21.15.96:0/3398534322 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f047406d8a0 0x7f047406fd60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f047800b5c0 tx=0x7f0478005960 comp rx=0 tx=0).stop 2024-02-19T19:14:22.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.378+0000 7f048f55d700 1 -- 172.21.15.96:0/3398534322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04880ffc20 msgr2=0x7f0488197760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:22.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.378+0000 7f048f55d700 1 --2- 172.21.15.96:0/3398534322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04880ffc20 0x7f0488197760 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f048400d8d0 tx=0x7f048400dc90 comp rx=0 tx=0).stop 2024-02-19T19:14:22.403 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.378+0000 7f048f55d700 1 -- 172.21.15.96:0/3398534322 shutdown_connections 2024-02-19T19:14:22.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.378+0000 7f048f55d700 1 --2- 172.21.15.96:0/3398534322 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f047406d8a0 0x7f047406fd60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:22.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.378+0000 7f048f55d700 1 --2- 172.21.15.96:0/3398534322 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04880ffc20 0x7f0488197760 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:22.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.378+0000 7f048f55d700 1 --2- 172.21.15.96:0/3398534322 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0488105bd0 0x7f0488197ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:22.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.378+0000 7f048f55d700 1 -- 172.21.15.96:0/3398534322 >> 172.21.15.96:0/3398534322 conn(0x7f0488075670 msgr2=0x7f04880fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:22.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.378+0000 7f048f55d700 1 -- 172.21.15.96:0/3398534322 shutdown_connections 2024-02-19T19:14:22.404 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.378+0000 7f048f55d700 1 -- 172.21.15.96:0/3398534322 wait complete. 2024-02-19T19:14:22.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.494+0000 7fa3bdfeb700 1 -- 172.21.15.96:0/1083536593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3b80ffa30 msgr2=0x7fa3b80ffeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:22.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.494+0000 7fa3bdfeb700 1 --2- 172.21.15.96:0/1083536593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3b80ffa30 0x7fa3b80ffeb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac009910 tx=0x7fa3ac009c20 comp rx=0 tx=0).stop 2024-02-19T19:14:22.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.494+0000 7fa3bdfeb700 1 -- 172.21.15.96:0/1083536593 shutdown_connections 2024-02-19T19:14:22.518 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.494+0000 7fa3bdfeb700 1 --2- 172.21.15.96:0/1083536593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3b80ffa30 0x7fa3b80ffeb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:22.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.494+0000 7fa3bdfeb700 1 --2- 172.21.15.96:0/1083536593 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3b8105a30 0x7fa3b8105e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:22.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.494+0000 7fa3bdfeb700 1 -- 172.21.15.96:0/1083536593 >> 172.21.15.96:0/1083536593 conn(0x7fa3b80fb520 msgr2=0x7fa3b80fd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:22.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.494+0000 7fa3bdfeb700 1 -- 172.21.15.96:0/1083536593 shutdown_connections 2024-02-19T19:14:22.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.494+0000 7fa3bdfeb700 1 -- 172.21.15.96:0/1083536593 wait complete. 2024-02-19T19:14:22.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.495+0000 7fa3bdfeb700 1 Processor -- start 2024-02-19T19:14:22.519 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.495+0000 7fa3bdfeb700 1 -- start start 2024-02-19T19:14:22.520 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.495+0000 7fa3bdfeb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3b80ffa30 0x7fa3b8196690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:22.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.495+0000 7fa3bdfeb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3b8105a30 0x7fa3b8196bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:22.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.495+0000 7fa3bdfeb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b8197260 con 0x7fa3b8105a30 2024-02-19T19:14:22.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.495+0000 7fa3bdfeb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b8199f90 con 0x7fa3b80ffa30 2024-02-19T19:14:22.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.496+0000 7fa3b6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3b8105a30 0x7fa3b8196bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:22.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.496+0000 7fa3b6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3b8105a30 0x7fa3b8196bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50058/0 (socket says 172.21.15.96:50058) 2024-02-19T19:14:22.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.496+0000 7fa3b6ffd700 1 -- 172.21.15.96:0/326879324 learned_addr learned my addr 172.21.15.96:0/326879324 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:14:22.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.496+0000 7fa3b77fe700 1 --2- 172.21.15.96:0/326879324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3b80ffa30 0x7fa3b8196690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:22.521 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.496+0000 7fa3b6ffd700 1 -- 172.21.15.96:0/326879324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3b80ffa30 msgr2=0x7fa3b8196690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:22.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.496+0000 7fa3b6ffd700 1 --2- 172.21.15.96:0/326879324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3b80ffa30 0x7fa3b8196690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:22.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.496+0000 7fa3b6ffd700 1 -- 172.21.15.96:0/326879324 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ac0095f0 con 0x7fa3b8105a30 2024-02-19T19:14:22.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.496+0000 7fa3b6ffd700 1 --2- 172.21.15.96:0/326879324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3b8105a30 0x7fa3b8196bd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00f690 tx=0x7fa3ac00f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:22.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.498+0000 7fa3b4ff9700 1 -- 172.21.15.96:0/326879324 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3ac01d070 con 0x7fa3b8105a30 2024-02-19T19:14:22.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.498+0000 7fa3bdfeb700 1 -- 172.21.15.96:0/326879324 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b819a210 con 0x7fa3b8105a30 2024-02-19T19:14:22.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.498+0000 7fa3b4ff9700 1 -- 172.21.15.96:0/326879324 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa3ac0050d0 con 0x7fa3b8105a30 2024-02-19T19:14:22.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.498+0000 7fa3b4ff9700 1 -- 172.21.15.96:0/326879324 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3ac022470 con 0x7fa3b8105a30 2024-02-19T19:14:22.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.498+0000 7fa3bdfeb700 1 -- 172.21.15.96:0/326879324 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b819a700 con 0x7fa3b8105a30 2024-02-19T19:14:22.523 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.499+0000 7fa3bdfeb700 1 -- 172.21.15.96:0/326879324 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b8108fd0 con 0x7fa3b8105a30 2024-02-19T19:14:22.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.501+0000 7fa3b4ff9700 1 -- 172.21.15.96:0/326879324 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fa3ac003780 con 0x7fa3b8105a30 2024-02-19T19:14:22.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.501+0000 7fa3b4ff9700 1 --2- 172.21.15.96:0/326879324 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa3a006d8a0 0x7fa3a006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:22.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.501+0000 7fa3b4ff9700 1 -- 172.21.15.96:0/326879324 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa3ac08e930 con 0x7fa3b8105a30 2024-02-19T19:14:22.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.501+0000 7fa3b77fe700 1 --2- 172.21.15.96:0/326879324 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa3a006d8a0 0x7fa3a006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:22.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.501+0000 7fa3b77fe700 1 --2- 172.21.15.96:0/326879324 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa3a006d8a0 0x7fa3a006fd60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009c60 tx=0x7fa3a8009260 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:22.527 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.504+0000 7fa3b4ff9700 1 -- 172.21.15.96:0/326879324 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa3ac058220 con 0x7fa3b8105a30 2024-02-19T19:14:22.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:22 smithi125 ceph-mon[86115]: pgmap v227: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:22.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:22.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:22.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:14:22.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:14:22.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:22.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:14:22.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:22.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:22.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:22.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:22.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:22.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-19T19:14:22.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:22 smithi096 ceph-mon[112483]: pgmap v227: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:22.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:22.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:22.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:14:22.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:14:22.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:22.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:14:22.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:22.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:22.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:22.790 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:22.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:22.791 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-19T19:14:22.831 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.809+0000 7fa3bdfeb700 1 -- 172.21.15.96:0/326879324 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa3b804f2e0 con 0x7fa3b8105a30 2024-02-19T19:14:22.832 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.809+0000 7fa3b4ff9700 1 -- 172.21.15.96:0/326879324 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fa3ac05b8e0 con 0x7fa3b8105a30 2024-02-19T19:14:22.833 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:14:22.833 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:14:22.833 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:14:22.833 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:14:22.833 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:14:22.834 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:14:22.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:14:22.834 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:14:22.834 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-19T19:14:22.834 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:14:22.835 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:14:22.835 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-19T19:14:22.835 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:14:22.835 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:14:22.835 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 14 2024-02-19T19:14:22.835 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:14:22.835 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:14:22.836 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.812+0000 7fa3bdfeb700 1 -- 172.21.15.96:0/326879324 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa3a006d8a0 msgr2=0x7fa3a006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:22.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.812+0000 7fa3bdfeb700 1 --2- 172.21.15.96:0/326879324 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa3a006d8a0 0x7fa3a006fd60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8009c60 tx=0x7fa3a8009260 comp rx=0 tx=0).stop 2024-02-19T19:14:22.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.812+0000 7fa3bdfeb700 1 -- 172.21.15.96:0/326879324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3b8105a30 msgr2=0x7fa3b8196bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:22.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.812+0000 7fa3bdfeb700 1 --2- 172.21.15.96:0/326879324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3b8105a30 0x7fa3b8196bd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac00f690 tx=0x7fa3ac00f6c0 comp rx=0 tx=0).stop 2024-02-19T19:14:22.837 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.812+0000 7fa3bdfeb700 1 -- 172.21.15.96:0/326879324 shutdown_connections 2024-02-19T19:14:22.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.812+0000 7fa3bdfeb700 1 --2- 172.21.15.96:0/326879324 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa3a006d8a0 0x7fa3a006fd60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:22.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.812+0000 7fa3bdfeb700 1 --2- 172.21.15.96:0/326879324 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3b80ffa30 0x7fa3b8196690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:22.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.812+0000 7fa3bdfeb700 1 --2- 172.21.15.96:0/326879324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3b8105a30 0x7fa3b8196bd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:22.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.812+0000 7fa3bdfeb700 1 -- 172.21.15.96:0/326879324 >> 172.21.15.96:0/326879324 conn(0x7fa3b80fb520 msgr2=0x7fa3b8068ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:22.838 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.812+0000 7fa3bdfeb700 1 -- 172.21.15.96:0/326879324 shutdown_connections 2024-02-19T19:14:22.839 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.812+0000 7fa3bdfeb700 1 -- 172.21.15.96:0/326879324 wait complete. 2024-02-19T19:14:22.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.915+0000 7fd33ad47700 1 -- 172.21.15.96:0/3135643380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd334105350 msgr2=0x7fd334105730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:22.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.915+0000 7fd33ad47700 1 --2- 172.21.15.96:0/3135643380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd334105350 0x7fd334105730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd328009910 tx=0x7fd328009c20 comp rx=0 tx=0).stop 2024-02-19T19:14:22.938 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.915+0000 7fd33ad47700 1 -- 172.21.15.96:0/3135643380 shutdown_connections 2024-02-19T19:14:22.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.915+0000 7fd33ad47700 1 --2- 172.21.15.96:0/3135643380 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3340ff340 0x7fd3340ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:22.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.915+0000 7fd33ad47700 1 --2- 172.21.15.96:0/3135643380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd334105350 0x7fd334105730 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:22.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.915+0000 7fd33ad47700 1 -- 172.21.15.96:0/3135643380 >> 172.21.15.96:0/3135643380 conn(0x7fd334074e30 msgr2=0x7fd334075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:22.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.915+0000 7fd33ad47700 1 -- 172.21.15.96:0/3135643380 shutdown_connections 2024-02-19T19:14:22.939 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.915+0000 7fd33ad47700 1 -- 172.21.15.96:0/3135643380 wait complete. 2024-02-19T19:14:22.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.916+0000 7fd33ad47700 1 Processor -- start 2024-02-19T19:14:22.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.916+0000 7fd33ad47700 1 -- start start 2024-02-19T19:14:22.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.916+0000 7fd33ad47700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3340ff340 0x7fd334100fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:22.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.916+0000 7fd33ad47700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd334105350 0x7fd334101500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:22.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.916+0000 7fd33ad47700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd334101a40 con 0x7fd3340ff340 2024-02-19T19:14:22.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.916+0000 7fd33ad47700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd334101b80 con 0x7fd334105350 2024-02-19T19:14:22.941 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.916+0000 7fd338ae3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3340ff340 0x7fd334100fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:22.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.916+0000 7fd338ae3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3340ff340 0x7fd334100fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50068/0 (socket says 172.21.15.96:50068) 2024-02-19T19:14:22.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.916+0000 7fd338ae3700 1 -- 172.21.15.96:0/4128349121 learned_addr learned my addr 172.21.15.96:0/4128349121 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:14:22.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.916+0000 7fd333fff700 1 --2- 172.21.15.96:0/4128349121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd334105350 0x7fd334101500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:22.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.917+0000 7fd338ae3700 1 -- 172.21.15.96:0/4128349121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd334105350 msgr2=0x7fd334101500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:22.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.917+0000 7fd338ae3700 1 --2- 172.21.15.96:0/4128349121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd334105350 0x7fd334101500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:22.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.917+0000 7fd338ae3700 1 -- 172.21.15.96:0/4128349121 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3280095f0 con 0x7fd3340ff340 2024-02-19T19:14:22.942 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.917+0000 7fd338ae3700 1 --2- 172.21.15.96:0/4128349121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3340ff340 0x7fd334100fc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd32800b5c0 tx=0x7fd32800bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:22.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.917+0000 7fd331ffb700 1 -- 172.21.15.96:0/4128349121 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd32801d070 con 0x7fd3340ff340 2024-02-19T19:14:22.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.917+0000 7fd33ad47700 1 -- 172.21.15.96:0/4128349121 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd334101e00 con 0x7fd3340ff340 2024-02-19T19:14:22.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.917+0000 7fd331ffb700 1 -- 172.21.15.96:0/4128349121 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd32800f460 con 0x7fd3340ff340 2024-02-19T19:14:22.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.917+0000 7fd331ffb700 1 -- 172.21.15.96:0/4128349121 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd328017630 con 0x7fd3340ff340 2024-02-19T19:14:22.943 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.917+0000 7fd33ad47700 1 -- 172.21.15.96:0/4128349121 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3341a2e60 con 0x7fd3340ff340 2024-02-19T19:14:22.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.918+0000 7fd33ad47700 1 -- 172.21.15.96:0/4128349121 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd334109880 con 0x7fd3340ff340 2024-02-19T19:14:22.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.919+0000 7fd331ffb700 1 -- 172.21.15.96:0/4128349121 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fd32800f5d0 con 0x7fd3340ff340 2024-02-19T19:14:22.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.919+0000 7fd331ffb700 1 --2- 172.21.15.96:0/4128349121 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd32406d8a0 0x7fd32406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:22.944 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.920+0000 7fd333fff700 1 --2- 172.21.15.96:0/4128349121 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd32406d8a0 0x7fd32406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:22.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.920+0000 7fd331ffb700 1 -- 172.21.15.96:0/4128349121 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fd32808eaa0 con 0x7fd3340ff340 2024-02-19T19:14:22.945 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.920+0000 7fd333fff700 1 --2- 172.21.15.96:0/4128349121 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd32406d8a0 0x7fd32406fd60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd3341027b0 tx=0x7fd320009190 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:22.947 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:22.924+0000 7fd331ffb700 1 -- 172.21.15.96:0/4128349121 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd328058250 con 0x7fd3340ff340 2024-02-19T19:14:23.184 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.161+0000 7fd33ad47700 1 -- 172.21.15.96:0/4128349121 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd33404f2e0 con 0x7fd3340ff340 2024-02-19T19:14:23.185 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.162+0000 7fd331ffb700 1 -- 172.21.15.96:0/4128349121 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) v1 ==== 76+0+1901 (secure 0 0 0) 0x7fd32805b910 con 0x7fd3340ff340 2024-02-19T19:14:23.185 INFO:teuthology.orchestra.run.smithi096.stdout:e38 2024-02-19T19:14:23.185 INFO:teuthology.orchestra.run.smithi096.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-19T19:14:23.185 INFO:teuthology.orchestra.run.smithi096.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-19T19:14:23.185 INFO:teuthology.orchestra.run.smithi096.stdout:legacy client fscid: 1 2024-02-19T19:14:23.185 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:14:23.186 INFO:teuthology.orchestra.run.smithi096.stdout:Filesystem 'cephfs' (1) 2024-02-19T19:14:23.186 INFO:teuthology.orchestra.run.smithi096.stdout:fs_name cephfs 2024-02-19T19:14:23.186 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 38 2024-02-19T19:14:23.186 INFO:teuthology.orchestra.run.smithi096.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-19T19:14:23.186 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-02-19T19:01:42.881136+0000 2024-02-19T19:14:23.186 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2024-02-19T19:14:21.548782+0000 2024-02-19T19:14:23.186 INFO:teuthology.orchestra.run.smithi096.stdout:tableserver 0 2024-02-19T19:14:23.186 INFO:teuthology.orchestra.run.smithi096.stdout:root 0 2024-02-19T19:14:23.187 INFO:teuthology.orchestra.run.smithi096.stdout:session_timeout 60 2024-02-19T19:14:23.187 INFO:teuthology.orchestra.run.smithi096.stdout:session_autoclose 300 2024-02-19T19:14:23.187 INFO:teuthology.orchestra.run.smithi096.stdout:max_file_size 1099511627776 2024-02-19T19:14:23.187 INFO:teuthology.orchestra.run.smithi096.stdout:max_xattr_size 65536 2024-02-19T19:14:23.187 INFO:teuthology.orchestra.run.smithi096.stdout:required_client_features {} 2024-02-19T19:14:23.187 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure 0 2024-02-19T19:14:23.188 INFO:teuthology.orchestra.run.smithi096.stdout:last_failure_osd_epoch 81 2024-02-19T19:14:23.188 INFO:teuthology.orchestra.run.smithi096.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-19T19:14:23.188 INFO:teuthology.orchestra.run.smithi096.stdout:max_mds 2 2024-02-19T19:14:23.188 INFO:teuthology.orchestra.run.smithi096.stdout:in 0,1 2024-02-19T19:14:23.188 INFO:teuthology.orchestra.run.smithi096.stdout:up {0=34458,1=34462} 2024-02-19T19:14:23.188 INFO:teuthology.orchestra.run.smithi096.stdout:failed 2024-02-19T19:14:23.188 INFO:teuthology.orchestra.run.smithi096.stdout:damaged 2024-02-19T19:14:23.188 INFO:teuthology.orchestra.run.smithi096.stdout:stopped 2024-02-19T19:14:23.189 INFO:teuthology.orchestra.run.smithi096.stdout:data_pools [3] 2024-02-19T19:14:23.189 INFO:teuthology.orchestra.run.smithi096.stdout:metadata_pool 2 2024-02-19T19:14:23.189 INFO:teuthology.orchestra.run.smithi096.stdout:inline_data enabled 2024-02-19T19:14:23.189 INFO:teuthology.orchestra.run.smithi096.stdout:balancer 2024-02-19T19:14:23.189 INFO:teuthology.orchestra.run.smithi096.stdout:bal_rank_mask -1 2024-02-19T19:14:23.189 INFO:teuthology.orchestra.run.smithi096.stdout:standby_count_wanted 1 2024-02-19T19:14:23.189 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.usrmcg{0:34458} state up:rejoin seq 19 join_fscid=1 addr [v2:172.21.15.96:6826/3847593496,v1:172.21.15.96:6827/3847593496] compat {c=[1],r=[1],i=[fff]}] 2024-02-19T19:14:23.189 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi096.pccmys{1:34462} state up:reconnect seq 14 join_fscid=1 addr [v2:172.21.15.96:6828/2639702047,v1:172.21.15.96:6829/2639702047] compat {c=[1],r=[1],i=[fff]}] 2024-02-19T19:14:23.190 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:14:23.190 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:14:23.190 INFO:teuthology.orchestra.run.smithi096.stdout:Standby daemons: 2024-02-19T19:14:23.190 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-02-19T19:14:23.190 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.srnlol{-1:44381} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.125:6824/3852344857,v1:172.21.15.125:6825/3852344857] compat {c=[1],r=[1],i=[fff]}] 2024-02-19T19:14:23.190 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.cephfs.smithi125.pwyuga{-1:44407} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.125:6826/95704371,v1:172.21.15.125:6827/95704371] compat {c=[1],r=[1],i=[fff]}] 2024-02-19T19:14:23.191 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.165+0000 7fd33ad47700 1 -- 172.21.15.96:0/4128349121 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd32406d8a0 msgr2=0x7fd32406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:23.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.165+0000 7fd33ad47700 1 --2- 172.21.15.96:0/4128349121 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd32406d8a0 0x7fd32406fd60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd3341027b0 tx=0x7fd320009190 comp rx=0 tx=0).stop 2024-02-19T19:14:23.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.165+0000 7fd33ad47700 1 -- 172.21.15.96:0/4128349121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3340ff340 msgr2=0x7fd334100fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:23.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.165+0000 7fd33ad47700 1 --2- 172.21.15.96:0/4128349121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3340ff340 0x7fd334100fc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd32800b5c0 tx=0x7fd32800bd50 comp rx=0 tx=0).stop 2024-02-19T19:14:23.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.165+0000 7fd33ad47700 1 -- 172.21.15.96:0/4128349121 shutdown_connections 2024-02-19T19:14:23.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.165+0000 7fd33ad47700 1 --2- 172.21.15.96:0/4128349121 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fd32406d8a0 0x7fd32406fd60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:23.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.165+0000 7fd33ad47700 1 --2- 172.21.15.96:0/4128349121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3340ff340 0x7fd334100fc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:23.192 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.165+0000 7fd33ad47700 1 --2- 172.21.15.96:0/4128349121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd334105350 0x7fd334101500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:23.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.165+0000 7fd33ad47700 1 -- 172.21.15.96:0/4128349121 >> 172.21.15.96:0/4128349121 conn(0x7fd334074e30 msgr2=0x7fd334103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:23.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.165+0000 7fd33ad47700 1 -- 172.21.15.96:0/4128349121 shutdown_connections 2024-02-19T19:14:23.193 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.165+0000 7fd33ad47700 1 -- 172.21.15.96:0/4128349121 wait complete. 2024-02-19T19:14:23.193 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 38 2024-02-19T19:14:23.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.269+0000 7fa60fc02700 1 -- 172.21.15.96:0/1562950819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6080ffc20 msgr2=0x7fa608100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:23.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.269+0000 7fa60fc02700 1 --2- 172.21.15.96:0/1562950819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6080ffc20 0x7fa608100080 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa604009910 tx=0x7fa604009c20 comp rx=0 tx=0).stop 2024-02-19T19:14:23.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.269+0000 7fa60fc02700 1 -- 172.21.15.96:0/1562950819 shutdown_connections 2024-02-19T19:14:23.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.269+0000 7fa60fc02700 1 --2- 172.21.15.96:0/1562950819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6080ffc20 0x7fa608100080 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:23.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.269+0000 7fa60fc02700 1 --2- 172.21.15.96:0/1562950819 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa608105bd0 0x7fa608105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:23.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.269+0000 7fa60fc02700 1 -- 172.21.15.96:0/1562950819 >> 172.21.15.96:0/1562950819 conn(0x7fa608075670 msgr2=0x7fa608075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:23.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.269+0000 7fa60fc02700 1 -- 172.21.15.96:0/1562950819 shutdown_connections 2024-02-19T19:14:23.293 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.269+0000 7fa60fc02700 1 -- 172.21.15.96:0/1562950819 wait complete. 2024-02-19T19:14:23.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.270+0000 7fa60fc02700 1 Processor -- start 2024-02-19T19:14:23.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.270+0000 7fa60fc02700 1 -- start start 2024-02-19T19:14:23.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.270+0000 7fa60fc02700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6080ffc20 0x7fa6081977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:23.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.270+0000 7fa60fc02700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa608105bd0 0x7fa608197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:23.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.270+0000 7fa60fc02700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa608198350 con 0x7fa608105bd0 2024-02-19T19:14:23.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.270+0000 7fa60fc02700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa608198490 con 0x7fa6080ffc20 2024-02-19T19:14:23.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.270+0000 7fa60d19d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa608105bd0 0x7fa608197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:23.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.270+0000 7fa60d19d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa608105bd0 0x7fa608197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:50086/0 (socket says 172.21.15.96:50086) 2024-02-19T19:14:23.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.270+0000 7fa60d19d700 1 -- 172.21.15.96:0/1405045771 learned_addr learned my addr 172.21.15.96:0/1405045771 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:14:23.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.270+0000 7fa60d19d700 1 -- 172.21.15.96:0/1405045771 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6080ffc20 msgr2=0x7fa6081977f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:23.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.270+0000 7fa60d19d700 1 --2- 172.21.15.96:0/1405045771 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6080ffc20 0x7fa6081977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:23.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.270+0000 7fa60d19d700 1 -- 172.21.15.96:0/1405045771 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6040095f0 con 0x7fa608105bd0 2024-02-19T19:14:23.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.270+0000 7fa60d19d700 1 --2- 172.21.15.96:0/1405045771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa608105bd0 0x7fa608197d30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa604006010 tx=0x7fa60400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:23.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.270+0000 7fa5feffd700 1 -- 172.21.15.96:0/1405045771 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa60401d070 con 0x7fa608105bd0 2024-02-19T19:14:23.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.270+0000 7fa5feffd700 1 -- 172.21.15.96:0/1405045771 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa604004fb0 con 0x7fa608105bd0 2024-02-19T19:14:23.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.270+0000 7fa5feffd700 1 -- 172.21.15.96:0/1405045771 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa604022ea0 con 0x7fa608105bd0 2024-02-19T19:14:23.297 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.271+0000 7fa60fc02700 1 -- 172.21.15.96:0/1405045771 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6081a0860 con 0x7fa608105bd0 2024-02-19T19:14:23.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.271+0000 7fa60fc02700 1 -- 172.21.15.96:0/1405045771 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6081a0c70 con 0x7fa608105bd0 2024-02-19T19:14:23.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.271+0000 7fa60fc02700 1 -- 172.21.15.96:0/1405045771 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6081080f0 con 0x7fa608105bd0 2024-02-19T19:14:23.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.272+0000 7fa5feffd700 1 -- 172.21.15.96:0/1405045771 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fa604022470 con 0x7fa608105bd0 2024-02-19T19:14:23.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.272+0000 7fa5feffd700 1 --2- 172.21.15.96:0/1405045771 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa5f406d8a0 0x7fa5f406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:23.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.273+0000 7fa60d99e700 1 --2- 172.21.15.96:0/1405045771 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa5f406d8a0 0x7fa5f406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:23.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.273+0000 7fa5feffd700 1 -- 172.21.15.96:0/1405045771 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7fa60408ebb0 con 0x7fa608105bd0 2024-02-19T19:14:23.298 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.273+0000 7fa60d99e700 1 --2- 172.21.15.96:0/1405045771 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa5f406d8a0 0x7fa5f406fd60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80097b0 tx=0x7fa5f8006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:23.300 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.277+0000 7fa5feffd700 1 -- 172.21.15.96:0/1405045771 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa604095080 con 0x7fa608105bd0 2024-02-19T19:14:23.512 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.489+0000 7fa60fc02700 1 -- 172.21.15.96:0/1405045771 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6080611d0 con 0x7fa5f406d8a0 2024-02-19T19:14:23.513 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: Upgrade: Setting filesystem cephfs Joinable 2024-02-19T19:14:23.513 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:14:23.513 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:14:23.513 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:14:23.514 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-19T19:14:23.514 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: fsmap cephfs:2/2 {0=cephfs.smithi096.usrmcg=up:rejoin,1=cephfs.smithi096.pccmys=up:reconnect} 2 up:standby 2024-02-19T19:14:23.514 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.514 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.514 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.514 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.514 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: Upgrade: Setting container_image for all ceph-exporter 2024-02-19T19:14:23.514 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:23.515 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi096"}]: dispatch 2024-02-19T19:14:23.515 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi096"}]': finished 2024-02-19T19:14:23.515 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi125"}]: dispatch 2024-02-19T19:14:23.515 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi125"}]': finished 2024-02-19T19:14:23.515 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.515 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: Upgrade: Setting container_image for all iscsi 2024-02-19T19:14:23.515 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:23.515 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.515 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: Upgrade: Setting container_image for all nfs 2024-02-19T19:14:23.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:23.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: Upgrade: Setting container_image for all nvmeof 2024-02-19T19:14:23.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:23.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-19T19:14:23.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-19T19:14:23.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:14:23.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-19T19:14:23.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-19T19:14:23.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-19T19:14:23.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-19T19:14:23.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-19T19:14:23.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-19T19:14:23.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-19T19:14:23.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-19T19:14:23.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-19T19:14:23.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-19T19:14:23.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-19T19:14:23.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:14:23.519 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-19T19:14:23.519 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-19T19:14:23.519 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-19T19:14:23.519 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-19T19:14:23.519 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-19T19:14:23.519 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-19T19:14:23.519 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-19T19:14:23.519 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-19T19:14:23.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:14:23.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:14:23.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:14:23.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:14:23.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:14:23.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:14:23.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-19T19:14:23.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-19T19:14:23.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:14:23.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:14:23.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:14:23.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:23.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:14:23.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:14:23.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:14:23.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:23.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/326879324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.522 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:23 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/4128349121' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:14:23.522 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.490+0000 7fa5feffd700 1 -- 172.21.15.96:0/1405045771 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fa6080611d0 con 0x7fa5f406d8a0 2024-02-19T19:14:23.522 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:14:23.522 INFO:teuthology.orchestra.run.smithi096.stdout: "target_image": null, 2024-02-19T19:14:23.523 INFO:teuthology.orchestra.run.smithi096.stdout: "in_progress": false, 2024-02-19T19:14:23.523 INFO:teuthology.orchestra.run.smithi096.stdout: "which": "", 2024-02-19T19:14:23.523 INFO:teuthology.orchestra.run.smithi096.stdout: "services_complete": [], 2024-02-19T19:14:23.523 INFO:teuthology.orchestra.run.smithi096.stdout: "progress": null, 2024-02-19T19:14:23.523 INFO:teuthology.orchestra.run.smithi096.stdout: "message": "", 2024-02-19T19:14:23.523 INFO:teuthology.orchestra.run.smithi096.stdout: "is_paused": false 2024-02-19T19:14:23.523 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:14:23.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.492+0000 7fa60fc02700 1 -- 172.21.15.96:0/1405045771 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa5f406d8a0 msgr2=0x7fa5f406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:23.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.492+0000 7fa60fc02700 1 --2- 172.21.15.96:0/1405045771 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa5f406d8a0 0x7fa5f406fd60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80097b0 tx=0x7fa5f8006d20 comp rx=0 tx=0).stop 2024-02-19T19:14:23.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.492+0000 7fa60fc02700 1 -- 172.21.15.96:0/1405045771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa608105bd0 msgr2=0x7fa608197d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:23.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.492+0000 7fa60fc02700 1 --2- 172.21.15.96:0/1405045771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa608105bd0 0x7fa608197d30 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa604006010 tx=0x7fa60400be20 comp rx=0 tx=0).stop 2024-02-19T19:14:23.524 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.492+0000 7fa60fc02700 1 -- 172.21.15.96:0/1405045771 shutdown_connections 2024-02-19T19:14:23.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.492+0000 7fa60fc02700 1 --2- 172.21.15.96:0/1405045771 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa5f406d8a0 0x7fa5f406fd60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:23.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.492+0000 7fa60fc02700 1 --2- 172.21.15.96:0/1405045771 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6080ffc20 0x7fa6081977f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:23.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.492+0000 7fa60fc02700 1 --2- 172.21.15.96:0/1405045771 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa608105bd0 0x7fa608197d30 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:23.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.492+0000 7fa60fc02700 1 -- 172.21.15.96:0/1405045771 >> 172.21.15.96:0/1405045771 conn(0x7fa608075670 msgr2=0x7fa6080fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:23.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.492+0000 7fa60fc02700 1 -- 172.21.15.96:0/1405045771 shutdown_connections 2024-02-19T19:14:23.525 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.492+0000 7fa60fc02700 1 -- 172.21.15.96:0/1405045771 wait complete. 2024-02-19T19:14:23.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.597+0000 7f6f5939f700 1 -- 172.21.15.96:0/40893184 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f540fff50 msgr2=0x7f6f54105840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:23.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.597+0000 7f6f5939f700 1 --2- 172.21.15.96:0/40893184 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f540fff50 0x7f6f54105840 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009910 tx=0x7f6f48009c20 comp rx=0 tx=0).stop 2024-02-19T19:14:23.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.597+0000 7f6f5939f700 1 -- 172.21.15.96:0/40893184 shutdown_connections 2024-02-19T19:14:23.620 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.597+0000 7f6f5939f700 1 --2- 172.21.15.96:0/40893184 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f540fff50 0x7f6f54105840 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:23.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.597+0000 7f6f5939f700 1 --2- 172.21.15.96:0/40893184 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f540ff5a0 0x7f6f540ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:23.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.597+0000 7f6f5939f700 1 -- 172.21.15.96:0/40893184 >> 172.21.15.96:0/40893184 conn(0x7f6f54074e30 msgr2=0x7f6f54075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:23.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.597+0000 7f6f5939f700 1 -- 172.21.15.96:0/40893184 shutdown_connections 2024-02-19T19:14:23.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.597+0000 7f6f5939f700 1 -- 172.21.15.96:0/40893184 wait complete. 2024-02-19T19:14:23.621 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.597+0000 7f6f5939f700 1 Processor -- start 2024-02-19T19:14:23.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.598+0000 7f6f5939f700 1 -- start start 2024-02-19T19:14:23.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.598+0000 7f6f5939f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f540ff5a0 0x7f6f5419c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:23.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.598+0000 7f6f5939f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f540fff50 0x7f6f5419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:23.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.598+0000 7f6f5939f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5419d210 con 0x7f6f540fff50 2024-02-19T19:14:23.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.598+0000 7f6f5939f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f541966c0 con 0x7f6f540ff5a0 2024-02-19T19:14:23.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.598+0000 7f6f527fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f540fff50 0x7f6f5419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:23.623 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.598+0000 7f6f527fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f540fff50 0x7f6f5419cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:35032/0 (socket says 172.21.15.96:35032) 2024-02-19T19:14:23.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.598+0000 7f6f527fc700 1 -- 172.21.15.96:0/2063066365 learned_addr learned my addr 172.21.15.96:0/2063066365 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:14:23.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.598+0000 7f6f52ffd700 1 --2- 172.21.15.96:0/2063066365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f540ff5a0 0x7f6f5419c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:23.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.598+0000 7f6f527fc700 1 -- 172.21.15.96:0/2063066365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f540ff5a0 msgr2=0x7f6f5419c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:23.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.598+0000 7f6f527fc700 1 --2- 172.21.15.96:0/2063066365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f540ff5a0 0x7f6f5419c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:23.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.598+0000 7f6f527fc700 1 -- 172.21.15.96:0/2063066365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f480095f0 con 0x7f6f540fff50 2024-02-19T19:14:23.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.598+0000 7f6f527fc700 1 --2- 172.21.15.96:0/2063066365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f540fff50 0x7f6f5419cb80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800bd70 tx=0x7f6f4800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:23.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.599+0000 7f6f3bfff700 1 -- 172.21.15.96:0/2063066365 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f4801d070 con 0x7f6f540fff50 2024-02-19T19:14:23.624 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.599+0000 7f6f3bfff700 1 -- 172.21.15.96:0/2063066365 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f48005dc0 con 0x7f6f540fff50 2024-02-19T19:14:23.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.599+0000 7f6f3bfff700 1 -- 172.21.15.96:0/2063066365 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6f48017400 con 0x7f6f540fff50 2024-02-19T19:14:23.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.599+0000 7f6f5939f700 1 -- 172.21.15.96:0/2063066365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f54196940 con 0x7f6f540fff50 2024-02-19T19:14:23.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.599+0000 7f6f5939f700 1 -- 172.21.15.96:0/2063066365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f54196e30 con 0x7f6f540fff50 2024-02-19T19:14:23.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.600+0000 7f6f5939f700 1 -- 172.21.15.96:0/2063066365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f54109200 con 0x7f6f540fff50 2024-02-19T19:14:23.625 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.600+0000 7f6f3bfff700 1 -- 172.21.15.96:0/2063066365 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f6f4800f460 con 0x7f6f540fff50 2024-02-19T19:14:23.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.601+0000 7f6f3bfff700 1 --2- 172.21.15.96:0/2063066365 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f6f3c06d8a0 0x7f6f3c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:23.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.601+0000 7f6f52ffd700 1 --2- 172.21.15.96:0/2063066365 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f6f3c06d8a0 0x7f6f3c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:23.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.601+0000 7f6f3bfff700 1 -- 172.21.15.96:0/2063066365 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6586+0+0 (secure 0 0 0) 0x7f6f4808ea20 con 0x7f6f540fff50 2024-02-19T19:14:23.626 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.601+0000 7f6f52ffd700 1 --2- 172.21.15.96:0/2063066365 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f6f3c06d8a0 0x7f6f3c06fd60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6f44005950 tx=0x7f6f4400b410 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:23.628 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.605+0000 7f6f3bfff700 1 -- 172.21.15.96:0/2063066365 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6f4805bd00 con 0x7f6f540fff50 2024-02-19T19:14:23.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: Upgrade: Setting filesystem cephfs Joinable 2024-02-19T19:14:23.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:14:23.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:14:23.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:14:23.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-19T19:14:23.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: fsmap cephfs:2/2 {0=cephfs.smithi096.usrmcg=up:rejoin,1=cephfs.smithi096.pccmys=up:reconnect} 2 up:standby 2024-02-19T19:14:23.705 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: Upgrade: Setting container_image for all ceph-exporter 2024-02-19T19:14:23.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:23.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi096"}]: dispatch 2024-02-19T19:14:23.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi096"}]': finished 2024-02-19T19:14:23.706 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi125"}]: dispatch 2024-02-19T19:14:23.707 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi125"}]': finished 2024-02-19T19:14:23.707 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.707 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: Upgrade: Setting container_image for all iscsi 2024-02-19T19:14:23.707 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:23.707 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.707 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: Upgrade: Setting container_image for all nfs 2024-02-19T19:14:23.707 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:23.707 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.708 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: Upgrade: Setting container_image for all nvmeof 2024-02-19T19:14:23.708 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:23.708 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.708 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.708 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.708 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.708 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.708 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-19T19:14:23.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-19T19:14:23.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:14:23.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-19T19:14:23.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-19T19:14:23.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-19T19:14:23.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-19T19:14:23.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-19T19:14:23.709 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-19T19:14:23.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-19T19:14:23.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-19T19:14:23.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-19T19:14:23.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-19T19:14:23.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-19T19:14:23.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:14:23.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-19T19:14:23.710 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-19T19:14:23.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-19T19:14:23.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-19T19:14:23.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-19T19:14:23.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-19T19:14:23.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-19T19:14:23.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-19T19:14:23.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:14:23.711 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:14:23.712 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:14:23.712 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:14:23.712 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:14:23.712 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-19T19:14:23.712 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-19T19:14:23.712 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-19T19:14:23.712 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:14:23.712 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:14:23.713 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:14:23.713 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:23.713 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:14:23.713 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:14:23.713 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:14:23.713 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:23.713 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/326879324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:14:23.713 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:23 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/4128349121' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-19T19:14:23.904 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.881+0000 7f6f5939f700 1 -- 172.21.15.96:0/2063066365 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6f5404f2e0 con 0x7f6f540fff50 2024-02-19T19:14:23.905 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.882+0000 7f6f3bfff700 1 -- 172.21.15.96:0/2063066365 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+297 (secure 0 0 0) 0x7f6f4805b890 con 0x7f6f540fff50 2024-02-19T19:14:23.905 INFO:teuthology.orchestra.run.smithi096.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-02-19T19:14:23.905 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-19T19:14:23.905 INFO:teuthology.orchestra.run.smithi096.stdout: fs cephfs is degraded 2024-02-19T19:14:23.905 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-19T19:14:23.905 INFO:teuthology.orchestra.run.smithi096.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-19T19:14:23.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.884+0000 7f6f5939f700 1 -- 172.21.15.96:0/2063066365 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f6f3c06d8a0 msgr2=0x7f6f3c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:23.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.884+0000 7f6f5939f700 1 --2- 172.21.15.96:0/2063066365 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f6f3c06d8a0 0x7f6f3c06fd60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6f44005950 tx=0x7f6f4400b410 comp rx=0 tx=0).stop 2024-02-19T19:14:23.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.884+0000 7f6f5939f700 1 -- 172.21.15.96:0/2063066365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f540fff50 msgr2=0x7f6f5419cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:23.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.884+0000 7f6f5939f700 1 --2- 172.21.15.96:0/2063066365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f540fff50 0x7f6f5419cb80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6f4800bd70 tx=0x7f6f4800bda0 comp rx=0 tx=0).stop 2024-02-19T19:14:23.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.884+0000 7f6f5939f700 1 -- 172.21.15.96:0/2063066365 shutdown_connections 2024-02-19T19:14:23.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.884+0000 7f6f5939f700 1 --2- 172.21.15.96:0/2063066365 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f6f3c06d8a0 0x7f6f3c06fd60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:23.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.884+0000 7f6f5939f700 1 --2- 172.21.15.96:0/2063066365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f540ff5a0 0x7f6f5419c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:23.907 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.884+0000 7f6f5939f700 1 --2- 172.21.15.96:0/2063066365 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f540fff50 0x7f6f5419cb80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:23.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.884+0000 7f6f5939f700 1 -- 172.21.15.96:0/2063066365 >> 172.21.15.96:0/2063066365 conn(0x7f6f54074e30 msgr2=0x7f6f540fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:23.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.884+0000 7f6f5939f700 1 -- 172.21.15.96:0/2063066365 shutdown_connections 2024-02-19T19:14:23.908 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:23.884+0000 7f6f5939f700 1 -- 172.21.15.96:0/2063066365 wait complete. 2024-02-19T19:14:24.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:24 smithi125 ceph-mon[86115]: Upgrade: Finalizing container_image settings 2024-02-19T19:14:24.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:24 smithi125 ceph-mon[86115]: Upgrade: Complete! 2024-02-19T19:14:24.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:24 smithi125 ceph-mon[86115]: pgmap v228: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:24.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:24 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/2063066365' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:14:24.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:24 smithi096 ceph-mon[112483]: Upgrade: Finalizing container_image settings 2024-02-19T19:14:24.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:24 smithi096 ceph-mon[112483]: Upgrade: Complete! 2024-02-19T19:14:24.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:24 smithi096 ceph-mon[112483]: pgmap v228: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:24.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:24 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/2063066365' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:14:25.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:25 smithi125 ceph-mon[86115]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:14:25.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:25 smithi096 ceph-mon[112483]: from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:14:26.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:26 smithi125 ceph-mon[86115]: pgmap v229: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:26.704 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:26 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:26.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:26 smithi096 ceph-mon[112483]: pgmap v229: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:26.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:26 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:14:28.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:28 smithi096 ceph-mon[112483]: pgmap v230: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:28.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:28 smithi125 ceph-mon[86115]: pgmap v230: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:30.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:30 smithi096 ceph-mon[112483]: pgmap v231: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:30.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:30 smithi125 ceph-mon[86115]: pgmap v231: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:32.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:32 smithi096 ceph-mon[112483]: pgmap v232: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:32.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:32 smithi125 ceph-mon[86115]: pgmap v232: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:34.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:34 smithi096 ceph-mon[112483]: pgmap v233: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:34.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:34 smithi125 ceph-mon[86115]: pgmap v233: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:35.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:14:35.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:14:36.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:36 smithi096 ceph-mon[112483]: pgmap v234: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:36.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:36 smithi125 ceph-mon[86115]: pgmap v234: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:38.289 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:37 smithi096 ceph-mon[112483]: pgmap v235: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:38.453 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:37 smithi125 ceph-mon[86115]: pgmap v235: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:40.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:40 smithi125 ceph-mon[86115]: pgmap v236: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:40.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:40 smithi096 ceph-mon[112483]: pgmap v236: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:42.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:42 smithi096 ceph-mon[112483]: pgmap v237: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:42.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:42 smithi125 ceph-mon[86115]: pgmap v237: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:44.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:44 smithi125 ceph-mon[86115]: pgmap v238: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:44.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:44 smithi096 ceph-mon[112483]: pgmap v238: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:46.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:46 smithi125 ceph-mon[86115]: pgmap v239: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:46.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:46 smithi096 ceph-mon[112483]: pgmap v239: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:48.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:48 smithi096 ceph-mon[112483]: pgmap v240: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:48.854 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:48 smithi125 ceph-mon[86115]: pgmap v240: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:50.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:50 smithi096 ceph-mon[112483]: pgmap v241: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:50.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:14:50.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:50 smithi125 ceph-mon[86115]: pgmap v241: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:50.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:14:51.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:51 smithi096 ceph-mon[112483]: evicting unresponsive client (24301), after waiting 46.8429 seconds during MDS startup 2024-02-19T19:14:51.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:51 smithi096 ceph-mon[112483]: Evicting (and blocklisting) client session 24301 (v1:172.21.15.96:0/2099652410) 2024-02-19T19:14:51.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:51 smithi096 ceph-mon[112483]: from='mds.? [v2:172.21.15.96:6828/2639702047,v1:172.21.15.96:6829/2639702047]' entity='mds.cephfs.smithi096.pccmys' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"v1:172.21.15.96:0/2099652410"}]: dispatch 2024-02-19T19:14:51.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:51 smithi125 ceph-mon[86115]: evicting unresponsive client (24301), after waiting 46.8429 seconds during MDS startup 2024-02-19T19:14:51.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:51 smithi125 ceph-mon[86115]: Evicting (and blocklisting) client session 24301 (v1:172.21.15.96:0/2099652410) 2024-02-19T19:14:51.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:51 smithi125 ceph-mon[86115]: from='mds.? [v2:172.21.15.96:6828/2639702047,v1:172.21.15.96:6829/2639702047]' entity='mds.cephfs.smithi096.pccmys' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"v1:172.21.15.96:0/2099652410"}]: dispatch 2024-02-19T19:14:52.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:52 smithi096 ceph-mon[112483]: pgmap v242: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:52.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:52 smithi096 ceph-mon[112483]: from='mds.? [v2:172.21.15.96:6828/2639702047,v1:172.21.15.96:6829/2639702047]' entity='mds.cephfs.smithi096.pccmys' cmd='[{"prefix":"osd blocklist", "blocklistop":"add","addr":"v1:172.21.15.96:0/2099652410"}]': finished 2024-02-19T19:14:52.789 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:52 smithi096 ceph-mon[112483]: osdmap e86: 6 total, 6 up, 6 in 2024-02-19T19:14:52.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:52 smithi125 ceph-mon[86115]: pgmap v242: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:52.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:52 smithi125 ceph-mon[86115]: from='mds.? [v2:172.21.15.96:6828/2639702047,v1:172.21.15.96:6829/2639702047]' entity='mds.cephfs.smithi096.pccmys' cmd='[{"prefix":"osd blocklist", "blocklistop":"add","addr":"v1:172.21.15.96:0/2099652410"}]': finished 2024-02-19T19:14:52.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:52 smithi125 ceph-mon[86115]: osdmap e86: 6 total, 6 up, 6 in 2024-02-19T19:14:53.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:53 smithi096 ceph-mon[112483]: mds.? [v2:172.21.15.96:6828/2639702047,v1:172.21.15.96:6829/2639702047] up:rejoin 2024-02-19T19:14:53.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:53 smithi096 ceph-mon[112483]: fsmap cephfs:2/2 {0=cephfs.smithi096.usrmcg=up:rejoin,1=cephfs.smithi096.pccmys=up:rejoin} 2 up:standby 2024-02-19T19:14:53.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:53 smithi096 ceph-mon[112483]: daemon mds.cephfs.smithi096.pccmys is now active in filesystem cephfs as rank 1 2024-02-19T19:14:53.788 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:53 smithi096 ceph-mon[112483]: daemon mds.cephfs.smithi096.usrmcg is now active in filesystem cephfs as rank 0 2024-02-19T19:14:53.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:53 smithi125 ceph-mon[86115]: mds.? [v2:172.21.15.96:6828/2639702047,v1:172.21.15.96:6829/2639702047] up:rejoin 2024-02-19T19:14:53.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:53 smithi125 ceph-mon[86115]: fsmap cephfs:2/2 {0=cephfs.smithi096.usrmcg=up:rejoin,1=cephfs.smithi096.pccmys=up:rejoin} 2 up:standby 2024-02-19T19:14:53.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:53 smithi125 ceph-mon[86115]: daemon mds.cephfs.smithi096.pccmys is now active in filesystem cephfs as rank 1 2024-02-19T19:14:53.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:53 smithi125 ceph-mon[86115]: daemon mds.cephfs.smithi096.usrmcg is now active in filesystem cephfs as rank 0 2024-02-19T19:14:54.027 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.004+0000 7f0075fed700 1 -- 172.21.15.96:0/1910440980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00700ffc20 msgr2=0x7f0070100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:54.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.004+0000 7f0075fed700 1 --2- 172.21.15.96:0/1910440980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00700ffc20 0x7f0070100080 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0058009910 tx=0x7f0058009c20 comp rx=0 tx=0).stop 2024-02-19T19:14:54.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.004+0000 7f0075fed700 1 -- 172.21.15.96:0/1910440980 shutdown_connections 2024-02-19T19:14:54.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.004+0000 7f0075fed700 1 --2- 172.21.15.96:0/1910440980 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00700ffc20 0x7f0070100080 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:54.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.004+0000 7f0075fed700 1 --2- 172.21.15.96:0/1910440980 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0070105bd0 0x7f0070105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:54.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.004+0000 7f0075fed700 1 -- 172.21.15.96:0/1910440980 >> 172.21.15.96:0/1910440980 conn(0x7f0070075670 msgr2=0x7f0070075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:54.028 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.004+0000 7f0075fed700 1 -- 172.21.15.96:0/1910440980 shutdown_connections 2024-02-19T19:14:54.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.004+0000 7f0075fed700 1 -- 172.21.15.96:0/1910440980 wait complete. 2024-02-19T19:14:54.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.005+0000 7f0075fed700 1 Processor -- start 2024-02-19T19:14:54.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.005+0000 7f0075fed700 1 -- start start 2024-02-19T19:14:54.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.005+0000 7f0075fed700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00700ffc20 0x7f0070197740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:54.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.005+0000 7f0075fed700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0070105bd0 0x7f0070197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:54.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.005+0000 7f0075fed700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0070198360 con 0x7f00700ffc20 2024-02-19T19:14:54.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.005+0000 7f0075fed700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00701984d0 con 0x7f0070105bd0 2024-02-19T19:14:54.029 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.005+0000 7f006f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00700ffc20 0x7f0070197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:54.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.005+0000 7f006f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00700ffc20 0x7f0070197740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34380/0 (socket says 172.21.15.96:34380) 2024-02-19T19:14:54.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.005+0000 7f006f7fe700 1 -- 172.21.15.96:0/3637543315 learned_addr learned my addr 172.21.15.96:0/3637543315 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:14:54.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.005+0000 7f0066ffd700 1 --2- 172.21.15.96:0/3637543315 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0070105bd0 0x7f0070197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:54.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.005+0000 7f006f7fe700 1 -- 172.21.15.96:0/3637543315 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0070105bd0 msgr2=0x7f0070197c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:54.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.005+0000 7f006f7fe700 1 --2- 172.21.15.96:0/3637543315 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0070105bd0 0x7f0070197c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:54.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.005+0000 7f006f7fe700 1 -- 172.21.15.96:0/3637543315 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00580095f0 con 0x7f00700ffc20 2024-02-19T19:14:54.030 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.006+0000 7f006f7fe700 1 --2- 172.21.15.96:0/3637543315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00700ffc20 0x7f0070197740 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f006000e920 tx=0x7f006000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:54.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.006+0000 7f006d7fa700 1 -- 172.21.15.96:0/3637543315 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f006000c9d0 con 0x7f00700ffc20 2024-02-19T19:14:54.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.006+0000 7f0075fed700 1 -- 172.21.15.96:0/3637543315 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00701a07b0 con 0x7f00700ffc20 2024-02-19T19:14:54.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.006+0000 7f006d7fa700 1 -- 172.21.15.96:0/3637543315 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0060010430 con 0x7f00700ffc20 2024-02-19T19:14:54.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.006+0000 7f006d7fa700 1 -- 172.21.15.96:0/3637543315 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0060018630 con 0x7f00700ffc20 2024-02-19T19:14:54.031 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.006+0000 7f0075fed700 1 -- 172.21.15.96:0/3637543315 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00701a0d00 con 0x7f00700ffc20 2024-02-19T19:14:54.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.007+0000 7f0075fed700 1 -- 172.21.15.96:0/3637543315 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00701080d0 con 0x7f00700ffc20 2024-02-19T19:14:54.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.007+0000 7f006d7fa700 1 -- 172.21.15.96:0/3637543315 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f00600188a0 con 0x7f00700ffc20 2024-02-19T19:14:54.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.008+0000 7f006d7fa700 1 --2- 172.21.15.96:0/3637543315 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f005c06d8a0 0x7f005c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:54.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.008+0000 7f006d7fa700 1 -- 172.21.15.96:0/3637543315 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6629+0+0 (secure 0 0 0) 0x7f0060014070 con 0x7f00700ffc20 2024-02-19T19:14:54.032 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.008+0000 7f0066ffd700 1 --2- 172.21.15.96:0/3637543315 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f005c06d8a0 0x7f005c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:54.033 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.008+0000 7f0066ffd700 1 --2- 172.21.15.96:0/3637543315 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f005c06d8a0 0x7f005c06fd60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f00700691d0 tx=0x7f0058005940 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:54.034 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.012+0000 7f006d7fa700 1 -- 172.21.15.96:0/3637543315 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0060052d20 con 0x7f00700ffc20 2024-02-19T19:14:54.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.223+0000 7f0075fed700 1 -- 172.21.15.96:0/3637543315 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f00700611d0 con 0x7f005c06d8a0 2024-02-19T19:14:54.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.224+0000 7f006d7fa700 1 -- 172.21.15.96:0/3637543315 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f00700611d0 con 0x7f005c06d8a0 2024-02-19T19:14:54.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.226+0000 7f0075fed700 1 -- 172.21.15.96:0/3637543315 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f005c06d8a0 msgr2=0x7f005c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:54.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.226+0000 7f0075fed700 1 --2- 172.21.15.96:0/3637543315 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f005c06d8a0 0x7f005c06fd60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f00700691d0 tx=0x7f0058005940 comp rx=0 tx=0).stop 2024-02-19T19:14:54.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.226+0000 7f0075fed700 1 -- 172.21.15.96:0/3637543315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00700ffc20 msgr2=0x7f0070197740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:54.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.226+0000 7f0075fed700 1 --2- 172.21.15.96:0/3637543315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00700ffc20 0x7f0070197740 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f006000e920 tx=0x7f006000ec30 comp rx=0 tx=0).stop 2024-02-19T19:14:54.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.227+0000 7f0075fed700 1 -- 172.21.15.96:0/3637543315 shutdown_connections 2024-02-19T19:14:54.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.227+0000 7f0075fed700 1 --2- 172.21.15.96:0/3637543315 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f005c06d8a0 0x7f005c06fd60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:54.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.227+0000 7f0075fed700 1 --2- 172.21.15.96:0/3637543315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f00700ffc20 0x7f0070197740 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:54.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.227+0000 7f0075fed700 1 --2- 172.21.15.96:0/3637543315 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0070105bd0 0x7f0070197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:54.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.227+0000 7f0075fed700 1 -- 172.21.15.96:0/3637543315 >> 172.21.15.96:0/3637543315 conn(0x7f0070075670 msgr2=0x7f00700fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:54.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.227+0000 7f0075fed700 1 -- 172.21.15.96:0/3637543315 shutdown_connections 2024-02-19T19:14:54.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:54.227+0000 7f0075fed700 1 -- 172.21.15.96:0/3637543315 wait complete. 2024-02-19T19:14:54.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:54 smithi096 ceph-mon[112483]: pgmap v244: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:54.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:54 smithi096 ceph-mon[112483]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-19T19:14:54.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:54 smithi096 ceph-mon[112483]: mds.? [v2:172.21.15.96:6828/2639702047,v1:172.21.15.96:6829/2639702047] up:active 2024-02-19T19:14:54.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:54 smithi096 ceph-mon[112483]: mds.? [v2:172.21.15.96:6826/3847593496,v1:172.21.15.96:6827/3847593496] up:active 2024-02-19T19:14:54.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:54 smithi096 ceph-mon[112483]: fsmap cephfs:2 {0=cephfs.smithi096.usrmcg=up:active,1=cephfs.smithi096.pccmys=up:active} 2 up:standby 2024-02-19T19:14:54.539 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:54 smithi096 ceph-mon[112483]: fsmap cephfs:2 {0=cephfs.smithi096.usrmcg=up:active,1=cephfs.smithi096.pccmys=up:active} 2 up:standby-replay 2024-02-19T19:14:54.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:54 smithi125 ceph-mon[86115]: pgmap v244: 65 pgs: 65 active+clean; 128 MiB data, 689 MiB used, 536 GiB / 536 GiB avail 2024-02-19T19:14:54.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:54 smithi125 ceph-mon[86115]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-19T19:14:54.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:54 smithi125 ceph-mon[86115]: mds.? [v2:172.21.15.96:6828/2639702047,v1:172.21.15.96:6829/2639702047] up:active 2024-02-19T19:14:54.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:54 smithi125 ceph-mon[86115]: mds.? [v2:172.21.15.96:6826/3847593496,v1:172.21.15.96:6827/3847593496] up:active 2024-02-19T19:14:54.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:54 smithi125 ceph-mon[86115]: fsmap cephfs:2 {0=cephfs.smithi096.usrmcg=up:active,1=cephfs.smithi096.pccmys=up:active} 2 up:standby 2024-02-19T19:14:54.954 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:54 smithi125 ceph-mon[86115]: fsmap cephfs:2 {0=cephfs.smithi096.usrmcg=up:active,1=cephfs.smithi096.pccmys=up:active} 2 up:standby-replay 2024-02-19T19:14:55.009 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch ps' 2024-02-19T19:14:55.236 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:14:55.599 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:55 smithi096 ceph-mon[112483]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:14:55.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:55 smithi125 ceph-mon[86115]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:14:56.677 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:56 smithi096 ceph-mon[112483]: pgmap v245: 65 pgs: 65 active+clean; 132 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 370 KiB/s wr, 101 op/s 2024-02-19T19:14:56.953 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:56 smithi125 ceph-mon[86115]: pgmap v245: 65 pgs: 65 active+clean; 132 MiB data, 689 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 370 KiB/s wr, 101 op/s 2024-02-19T19:14:57.242 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.220+0000 7fa01c49b700 1 -- 172.21.15.96:0/4130753350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa014100ea0 msgr2=0x7fa014101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.220+0000 7fa01c49b700 1 --2- 172.21.15.96:0/4130753350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa014100ea0 0x7fa014101280 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa004009910 tx=0x7fa004009c20 comp rx=0 tx=0).stop 2024-02-19T19:14:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.220+0000 7fa01c49b700 1 -- 172.21.15.96:0/4130753350 shutdown_connections 2024-02-19T19:14:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.220+0000 7fa01c49b700 1 --2- 172.21.15.96:0/4130753350 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa014101850 0x7fa0141058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.220+0000 7fa01c49b700 1 --2- 172.21.15.96:0/4130753350 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa014100ea0 0x7fa014101280 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.220+0000 7fa01c49b700 1 -- 172.21.15.96:0/4130753350 >> 172.21.15.96:0/4130753350 conn(0x7fa0140fc750 msgr2=0x7fa0140feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.220+0000 7fa01c49b700 1 -- 172.21.15.96:0/4130753350 shutdown_connections 2024-02-19T19:14:57.243 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.221+0000 7fa01c49b700 1 -- 172.21.15.96:0/4130753350 wait complete. 2024-02-19T19:14:57.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.221+0000 7fa01c49b700 1 Processor -- start 2024-02-19T19:14:57.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.221+0000 7fa01c49b700 1 -- start start 2024-02-19T19:14:57.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.221+0000 7fa01c49b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa014100ea0 0x7fa014196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:57.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.221+0000 7fa01c49b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa014101850 0x7fa014196ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:57.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.221+0000 7fa01c49b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa014197560 con 0x7fa014101850 2024-02-19T19:14:57.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.221+0000 7fa01c49b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01419b370 con 0x7fa014100ea0 2024-02-19T19:14:57.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.222+0000 7fa019a36700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa014101850 0x7fa014196ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:57.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.222+0000 7fa019a36700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa014101850 0x7fa014196ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34404/0 (socket says 172.21.15.96:34404) 2024-02-19T19:14:57.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.222+0000 7fa019a36700 1 -- 172.21.15.96:0/1338535823 learned_addr learned my addr 172.21.15.96:0/1338535823 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:14:57.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.222+0000 7fa01a237700 1 --2- 172.21.15.96:0/1338535823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa014100ea0 0x7fa014196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:57.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.222+0000 7fa019a36700 1 -- 172.21.15.96:0/1338535823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa014100ea0 msgr2=0x7fa014196990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:57.246 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.222+0000 7fa019a36700 1 --2- 172.21.15.96:0/1338535823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa014100ea0 0x7fa014196990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:57.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.222+0000 7fa019a36700 1 -- 172.21.15.96:0/1338535823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0040095f0 con 0x7fa014101850 2024-02-19T19:14:57.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.222+0000 7fa01a237700 1 --2- 172.21.15.96:0/1338535823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa014100ea0 0x7fa014196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-19T19:14:57.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.222+0000 7fa019a36700 1 --2- 172.21.15.96:0/1338535823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa014101850 0x7fa014196ed0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa01000b480 tx=0x7fa01000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:57.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.222+0000 7fa00b7fe700 1 -- 172.21.15.96:0/1338535823 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0100118c0 con 0x7fa014101850 2024-02-19T19:14:57.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.222+0000 7fa00b7fe700 1 -- 172.21.15.96:0/1338535823 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa010010380 con 0x7fa014101850 2024-02-19T19:14:57.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.222+0000 7fa01c49b700 1 -- 172.21.15.96:0/1338535823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01419b650 con 0x7fa014101850 2024-02-19T19:14:57.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.222+0000 7fa00b7fe700 1 -- 172.21.15.96:0/1338535823 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa01000f4f0 con 0x7fa014101850 2024-02-19T19:14:57.247 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.222+0000 7fa01c49b700 1 -- 172.21.15.96:0/1338535823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa01419bba0 con 0x7fa014101850 2024-02-19T19:14:57.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.223+0000 7fa01c49b700 1 -- 172.21.15.96:0/1338535823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa014109240 con 0x7fa014101850 2024-02-19T19:14:57.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.224+0000 7fa00b7fe700 1 -- 172.21.15.96:0/1338535823 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fa0100104f0 con 0x7fa014101850 2024-02-19T19:14:57.248 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.224+0000 7fa00b7fe700 1 --2- 172.21.15.96:0/1338535823 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa00006d8a0 0x7fa00006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:14:57.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.224+0000 7fa00b7fe700 1 -- 172.21.15.96:0/1338535823 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6629+0+0 (secure 0 0 0) 0x7fa01008d1b0 con 0x7fa014101850 2024-02-19T19:14:57.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.224+0000 7fa01a237700 1 --2- 172.21.15.96:0/1338535823 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa00006d8a0 0x7fa00006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:14:57.249 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.225+0000 7fa01a237700 1 --2- 172.21.15.96:0/1338535823 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa00006d8a0 0x7fa00006fd60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa004005b40 tx=0x7fa00401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:14:57.250 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.229+0000 7fa00b7fe700 1 -- 172.21.15.96:0/1338535823 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa01005a460 con 0x7fa014101850 2024-02-19T19:14:57.464 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.442+0000 7fa01c49b700 1 -- 172.21.15.96:0/1338535823 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa014197e00 con 0x7fa00006d8a0 2024-02-19T19:14:57.474 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.453+0000 7fa00b7fe700 1 -- 172.21.15.96:0/1338535823 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fa014197e00 con 0x7fa00006d8a0 2024-02-19T19:14:57.475 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:14:57.475 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (9m) 40s ago 18m 24.9M - 0.25.0 c8568f914cd2 bbaf83a1e476 2024-02-19T19:14:57.475 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (51s) 40s ago 19m 7788k - 19.0.0-1450-gf78a58c0 f081f847070a 29198555e2a7 2024-02-19T19:14:57.475 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (45s) 42s ago 17m 6916k - 19.0.0-1450-gf78a58c0 f081f847070a 0fb4dbdd3442 2024-02-19T19:14:57.475 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (5m) 40s ago 19m 6669k - 19.0.0-1450-gf78a58c0 f081f847070a deea0ffefa0f 2024-02-19T19:14:57.475 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (5m) 42s ago 17m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 3421965dc5b0 2024-02-19T19:14:57.475 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (8m) 40s ago 18m 86.7M - 9.4.12 a0ea5e3c46d9 0102d90938e4 2024-02-19T19:14:57.476 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (101s) 40s ago 13m 50.4M - 19.0.0-1450-gf78a58c0 f081f847070a 26f13e1700e9 2024-02-19T19:14:57.476 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (118s) 40s ago 13m 57.9M - 19.0.0-1450-gf78a58c0 f081f847070a a24f6ad0b131 2024-02-19T19:14:57.476 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (66s) 42s ago 13m 14.8M - 19.0.0-1450-gf78a58c0 f081f847070a c1bb02a0982a 2024-02-19T19:14:57.476 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (82s) 42s ago 13m 15.9M - 19.0.0-1450-gf78a58c0 f081f847070a d0d33ee245a0 2024-02-19T19:14:57.476 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:8443,9283,8765 running (10m) 40s ago 20m 510M - 19.0.0-1450-gf78a58c0 f081f847070a a86fbe94fe3f 2024-02-19T19:14:57.476 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (10m) 42s ago 17m 451M - 19.0.0-1450-gf78a58c0 f081f847070a e250486d572d 2024-02-19T19:14:57.476 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (7m) 40s ago 20m 59.6M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d70090d516e3 2024-02-19T19:14:57.476 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (6m) 42s ago 17m 48.2M 2048M 19.0.0-1450-gf78a58c0 f081f847070a f56b17bdc9a0 2024-02-19T19:14:57.477 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (9m) 40s ago 18m 15.3M - 1.5.0 0da6a335fe13 51f622ea33d6 2024-02-19T19:14:57.477 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (9m) 42s ago 17m 17.3M - 1.5.0 0da6a335fe13 464e076a52a1 2024-02-19T19:14:57.477 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (5m) 40s ago 16m 106M 1216M 19.0.0-1450-gf78a58c0 f081f847070a b3dffd6a3fb2 2024-02-19T19:14:57.477 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (4m) 40s ago 16m 108M 1216M 19.0.0-1450-gf78a58c0 f081f847070a f0dd6d8f952f 2024-02-19T19:14:57.477 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (4m) 40s ago 15m 97.4M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 51b70eaaa7a9 2024-02-19T19:14:57.477 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (3m) 42s ago 15m 82.8M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 73b832b7b243 2024-02-19T19:14:57.477 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (3m) 42s ago 15m 81.8M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 1309ffc459f9 2024-02-19T19:14:57.477 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (2m) 42s ago 14m 78.7M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 247b0927920b 2024-02-19T19:14:57.478 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (9m) 40s ago 18m 67.0M - 2.43.0 a07b618ecd1d a4edcf6ed669 2024-02-19T19:14:57.478 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.455+0000 7fa01c49b700 1 -- 172.21.15.96:0/1338535823 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa00006d8a0 msgr2=0x7fa00006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.455+0000 7fa01c49b700 1 --2- 172.21.15.96:0/1338535823 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa00006d8a0 0x7fa00006fd60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa004005b40 tx=0x7fa00401a040 comp rx=0 tx=0).stop 2024-02-19T19:14:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.455+0000 7fa01c49b700 1 -- 172.21.15.96:0/1338535823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa014101850 msgr2=0x7fa014196ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:14:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.455+0000 7fa01c49b700 1 --2- 172.21.15.96:0/1338535823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa014101850 0x7fa014196ed0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa01000b480 tx=0x7fa01000b840 comp rx=0 tx=0).stop 2024-02-19T19:14:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.455+0000 7fa01c49b700 1 -- 172.21.15.96:0/1338535823 shutdown_connections 2024-02-19T19:14:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.455+0000 7fa01c49b700 1 --2- 172.21.15.96:0/1338535823 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa00006d8a0 0x7fa00006fd60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.455+0000 7fa01c49b700 1 --2- 172.21.15.96:0/1338535823 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa014100ea0 0x7fa014196990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.455+0000 7fa01c49b700 1 --2- 172.21.15.96:0/1338535823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa014101850 0x7fa014196ed0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:14:57.479 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.455+0000 7fa01c49b700 1 -- 172.21.15.96:0/1338535823 >> 172.21.15.96:0/1338535823 conn(0x7fa0140fc750 msgr2=0x7fa0140fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:14:57.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.455+0000 7fa01c49b700 1 -- 172.21.15.96:0/1338535823 shutdown_connections 2024-02-19T19:14:57.480 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:14:57.455+0000 7fa01c49b700 1 -- 172.21.15.96:0/1338535823 wait complete. 2024-02-19T19:14:57.515 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:57 smithi096 ceph-mon[112483]: pgmap v246: 65 pgs: 65 active+clean; 132 MiB data, 693 MiB used, 536 GiB / 536 GiB avail; 4.8 MiB/s rd, 371 KiB/s wr, 146 op/s 2024-02-19T19:14:57.515 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:14:57 smithi096 ceph-mon[112483]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:14:57.753 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:57 smithi125 ceph-mon[86115]: pgmap v246: 65 pgs: 65 active+clean; 132 MiB data, 693 MiB used, 536 GiB / 536 GiB avail; 4.8 MiB/s rd, 371 KiB/s wr, 146 op/s 2024-02-19T19:14:57.754 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:14:57 smithi125 ceph-mon[86115]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:14:58.140 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch upgrade status' 2024-02-19T19:14:58.358 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:15:00.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.194+0000 7efc0efc9700 1 -- 172.21.15.96:0/2564498540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc08100750 msgr2=0x7efc081047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:15:00.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.194+0000 7efc0efc9700 1 --2- 172.21.15.96:0/2564498540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc08100750 0x7efc081047a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009910 tx=0x7efbf4009c20 comp rx=0 tx=0).stop 2024-02-19T19:15:00.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.194+0000 7efc0efc9700 1 -- 172.21.15.96:0/2564498540 shutdown_connections 2024-02-19T19:15:00.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.194+0000 7efc0efc9700 1 --2- 172.21.15.96:0/2564498540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc08100750 0x7efc081047a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:15:00.219 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.194+0000 7efc0efc9700 1 --2- 172.21.15.96:0/2564498540 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc080ffda0 0x7efc08100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:15:00.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.194+0000 7efc0efc9700 1 -- 172.21.15.96:0/2564498540 >> 172.21.15.96:0/2564498540 conn(0x7efc080fb650 msgr2=0x7efc080fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:15:00.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.194+0000 7efc0efc9700 1 -- 172.21.15.96:0/2564498540 shutdown_connections 2024-02-19T19:15:00.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.194+0000 7efc0efc9700 1 -- 172.21.15.96:0/2564498540 wait complete. 2024-02-19T19:15:00.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.195+0000 7efc0efc9700 1 Processor -- start 2024-02-19T19:15:00.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.195+0000 7efc0efc9700 1 -- start start 2024-02-19T19:15:00.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.195+0000 7efc0efc9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc080ffda0 0x7efc0819b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:15:00.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.195+0000 7efc0efc9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc08100750 0x7efc0819bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:15:00.220 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.195+0000 7efc0efc9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0819c280 con 0x7efc080ffda0 2024-02-19T19:15:00.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.195+0000 7efc0efc9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc08195730 con 0x7efc08100750 2024-02-19T19:15:00.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.196+0000 7efc0cd65700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc080ffda0 0x7efc0819b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:15:00.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.196+0000 7efc0cd65700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc080ffda0 0x7efc0819b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34428/0 (socket says 172.21.15.96:34428) 2024-02-19T19:15:00.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.196+0000 7efc0cd65700 1 -- 172.21.15.96:0/14855863 learned_addr learned my addr 172.21.15.96:0/14855863 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:15:00.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.196+0000 7efc07fff700 1 --2- 172.21.15.96:0/14855863 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc08100750 0x7efc0819bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:15:00.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.196+0000 7efc0cd65700 1 -- 172.21.15.96:0/14855863 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc08100750 msgr2=0x7efc0819bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:15:00.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.196+0000 7efc0cd65700 1 --2- 172.21.15.96:0/14855863 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc08100750 0x7efc0819bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:15:00.221 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.196+0000 7efc0cd65700 1 -- 172.21.15.96:0/14855863 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf40095f0 con 0x7efc080ffda0 2024-02-19T19:15:00.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.196+0000 7efc0cd65700 1 --2- 172.21.15.96:0/14855863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc080ffda0 0x7efc0819b6b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efbfc00b4b0 tx=0x7efbfc00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:15:00.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.196+0000 7efc05ffb700 1 -- 172.21.15.96:0/14855863 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efbfc011800 con 0x7efc080ffda0 2024-02-19T19:15:00.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.196+0000 7efc05ffb700 1 -- 172.21.15.96:0/14855863 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efbfc011e20 con 0x7efc080ffda0 2024-02-19T19:15:00.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.196+0000 7efc0efc9700 1 -- 172.21.15.96:0/14855863 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc08195a10 con 0x7efc080ffda0 2024-02-19T19:15:00.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.196+0000 7efc05ffb700 1 -- 172.21.15.96:0/14855863 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efbfc00f2e0 con 0x7efc080ffda0 2024-02-19T19:15:00.222 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.196+0000 7efc0efc9700 1 -- 172.21.15.96:0/14855863 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc08195f60 con 0x7efc080ffda0 2024-02-19T19:15:00.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.197+0000 7efc0efc9700 1 -- 172.21.15.96:0/14855863 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc081080d0 con 0x7efc080ffda0 2024-02-19T19:15:00.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.198+0000 7efc05ffb700 1 -- 172.21.15.96:0/14855863 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7efbfc010380 con 0x7efc080ffda0 2024-02-19T19:15:00.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.198+0000 7efc05ffb700 1 --2- 172.21.15.96:0/14855863 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7efbf806d8a0 0x7efbf806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:15:00.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.198+0000 7efc05ffb700 1 -- 172.21.15.96:0/14855863 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6629+0+0 (secure 0 0 0) 0x7efbfc08d090 con 0x7efc080ffda0 2024-02-19T19:15:00.223 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.198+0000 7efc07fff700 1 --2- 172.21.15.96:0/14855863 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7efbf806d8a0 0x7efbf806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:15:00.224 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.199+0000 7efc07fff700 1 --2- 172.21.15.96:0/14855863 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7efbf806d8a0 0x7efbf806fd60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efc08196ba0 tx=0x7efbf401a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:15:00.225 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.203+0000 7efc05ffb700 1 -- 172.21.15.96:0/14855863 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efbfc05a470 con 0x7efc080ffda0 2024-02-19T19:15:00.441 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.418+0000 7efc0efc9700 1 -- 172.21.15.96:0/14855863 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efc08196230 con 0x7efbf806d8a0 2024-02-19T19:15:00.442 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.419+0000 7efc05ffb700 1 -- 172.21.15.96:0/14855863 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7efc08196230 con 0x7efbf806d8a0 2024-02-19T19:15:00.442 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:15:00.442 INFO:teuthology.orchestra.run.smithi096.stdout: "target_image": null, 2024-02-19T19:15:00.442 INFO:teuthology.orchestra.run.smithi096.stdout: "in_progress": false, 2024-02-19T19:15:00.443 INFO:teuthology.orchestra.run.smithi096.stdout: "which": "", 2024-02-19T19:15:00.443 INFO:teuthology.orchestra.run.smithi096.stdout: "services_complete": [], 2024-02-19T19:15:00.443 INFO:teuthology.orchestra.run.smithi096.stdout: "progress": null, 2024-02-19T19:15:00.443 INFO:teuthology.orchestra.run.smithi096.stdout: "message": "", 2024-02-19T19:15:00.443 INFO:teuthology.orchestra.run.smithi096.stdout: "is_paused": false 2024-02-19T19:15:00.443 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:15:00.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.421+0000 7efc0efc9700 1 -- 172.21.15.96:0/14855863 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7efbf806d8a0 msgr2=0x7efbf806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:15:00.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.421+0000 7efc0efc9700 1 --2- 172.21.15.96:0/14855863 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7efbf806d8a0 0x7efbf806fd60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7efc08196ba0 tx=0x7efbf401a040 comp rx=0 tx=0).stop 2024-02-19T19:15:00.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.421+0000 7efc0efc9700 1 -- 172.21.15.96:0/14855863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc080ffda0 msgr2=0x7efc0819b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:15:00.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.421+0000 7efc0efc9700 1 --2- 172.21.15.96:0/14855863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc080ffda0 0x7efc0819b6b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efbfc00b4b0 tx=0x7efbfc00b870 comp rx=0 tx=0).stop 2024-02-19T19:15:00.444 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.421+0000 7efc0efc9700 1 -- 172.21.15.96:0/14855863 shutdown_connections 2024-02-19T19:15:00.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.421+0000 7efc0efc9700 1 --2- 172.21.15.96:0/14855863 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7efbf806d8a0 0x7efbf806fd60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:15:00.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.421+0000 7efc0efc9700 1 --2- 172.21.15.96:0/14855863 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efc080ffda0 0x7efc0819b6b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:15:00.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.421+0000 7efc0efc9700 1 --2- 172.21.15.96:0/14855863 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efc08100750 0x7efc0819bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:15:00.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.421+0000 7efc0efc9700 1 -- 172.21.15.96:0/14855863 >> 172.21.15.96:0/14855863 conn(0x7efc080fb650 msgr2=0x7efc080fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:15:00.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.421+0000 7efc0efc9700 1 -- 172.21.15.96:0/14855863 shutdown_connections 2024-02-19T19:15:00.445 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:00.421+0000 7efc0efc9700 1 -- 172.21.15.96:0/14855863 wait complete. 2024-02-19T19:15:00.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:00 smithi125 ceph-mon[86115]: pgmap v247: 65 pgs: 65 active+clean; 132 MiB data, 697 MiB used, 536 GiB / 536 GiB avail; 6.1 MiB/s rd, 405 KiB/s wr, 227 op/s 2024-02-19T19:15:00.758 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:00 smithi096 ceph-mon[112483]: pgmap v247: 65 pgs: 65 active+clean; 132 MiB data, 697 MiB used, 536 GiB / 536 GiB avail; 6.1 MiB/s rd, 405 KiB/s wr, 227 op/s 2024-02-19T19:15:01.138 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph health detail' 2024-02-19T19:15:01.410 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:15:01.701 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:01 smithi096 ceph-mon[112483]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:15:01.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:01 smithi125 ceph-mon[86115]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:15:02.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:02 smithi125 ceph-mon[86115]: pgmap v248: 65 pgs: 65 active+clean; 132 MiB data, 701 MiB used, 536 GiB / 536 GiB avail; 6.5 MiB/s rd, 408 KiB/s wr, 230 op/s 2024-02-19T19:15:02.755 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:02 smithi096 ceph-mon[112483]: pgmap v248: 65 pgs: 65 active+clean; 132 MiB data, 701 MiB used, 536 GiB / 536 GiB avail; 6.5 MiB/s rd, 408 KiB/s wr, 230 op/s 2024-02-19T19:15:03.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.988+0000 7f0ed2e94700 1 -- 172.21.15.96:0/3470380209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ecc105bd0 msgr2=0x7f0ecc105fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:15:03.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.988+0000 7f0ed2e94700 1 --2- 172.21.15.96:0/3470380209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ecc105bd0 0x7f0ecc105fb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0009910 tx=0x7f0ec0009c20 comp rx=0 tx=0).stop 2024-02-19T19:15:03.012 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.988+0000 7f0ed2e94700 1 -- 172.21.15.96:0/3470380209 shutdown_connections 2024-02-19T19:15:03.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.988+0000 7f0ed2e94700 1 --2- 172.21.15.96:0/3470380209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ecc0ffc20 0x7f0ecc100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:15:03.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.988+0000 7f0ed2e94700 1 --2- 172.21.15.96:0/3470380209 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ecc105bd0 0x7f0ecc105fb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:15:03.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.988+0000 7f0ed2e94700 1 -- 172.21.15.96:0/3470380209 >> 172.21.15.96:0/3470380209 conn(0x7f0ecc075670 msgr2=0x7f0ecc075a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:15:03.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.988+0000 7f0ed2e94700 1 -- 172.21.15.96:0/3470380209 shutdown_connections 2024-02-19T19:15:03.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.988+0000 7f0ed2e94700 1 -- 172.21.15.96:0/3470380209 wait complete. 2024-02-19T19:15:03.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.988+0000 7f0ed2e94700 1 Processor -- start 2024-02-19T19:15:03.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.989+0000 7f0ed2e94700 1 -- start start 2024-02-19T19:15:03.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.989+0000 7f0ed2e94700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ecc0ffc20 0x7f0ecc19e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:15:03.013 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.989+0000 7f0ed2e94700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ecc105bd0 0x7f0ecc19ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:15:03.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.989+0000 7f0ed2e94700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc19f3f0 con 0x7f0ecc105bd0 2024-02-19T19:15:03.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.989+0000 7f0ed2e94700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc1988a0 con 0x7f0ecc0ffc20 2024-02-19T19:15:03.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.989+0000 7f0ecbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ecc105bd0 0x7f0ecc19ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:15:03.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.989+0000 7f0ecbfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ecc105bd0 0x7f0ecc19ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34436/0 (socket says 172.21.15.96:34436) 2024-02-19T19:15:03.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.989+0000 7f0ecbfff700 1 -- 172.21.15.96:0/4066148377 learned_addr learned my addr 172.21.15.96:0/4066148377 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:15:03.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.989+0000 7f0ed0c30700 1 --2- 172.21.15.96:0/4066148377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ecc0ffc20 0x7f0ecc19e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:15:03.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.989+0000 7f0ecbfff700 1 -- 172.21.15.96:0/4066148377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ecc0ffc20 msgr2=0x7f0ecc19e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:15:03.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.989+0000 7f0ecbfff700 1 --2- 172.21.15.96:0/4066148377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ecc0ffc20 0x7f0ecc19e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:15:03.014 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.989+0000 7f0ecbfff700 1 -- 172.21.15.96:0/4066148377 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec00095f0 con 0x7f0ecc105bd0 2024-02-19T19:15:03.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.989+0000 7f0ecbfff700 1 --2- 172.21.15.96:0/4066148377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ecc105bd0 0x7f0ecc19ed60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0eb800c8a0 tx=0x7f0eb800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:15:03.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.989+0000 7f0ec9ffb700 1 -- 172.21.15.96:0/4066148377 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0eb80078e0 con 0x7f0ecc105bd0 2024-02-19T19:15:03.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.990+0000 7f0ec9ffb700 1 -- 172.21.15.96:0/4066148377 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0eb800f450 con 0x7f0ecc105bd0 2024-02-19T19:15:03.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.990+0000 7f0ed2e94700 1 -- 172.21.15.96:0/4066148377 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ecc198b80 con 0x7f0ecc105bd0 2024-02-19T19:15:03.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.990+0000 7f0ec9ffb700 1 -- 172.21.15.96:0/4066148377 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0eb800e5e0 con 0x7f0ecc105bd0 2024-02-19T19:15:03.015 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.990+0000 7f0ed2e94700 1 -- 172.21.15.96:0/4066148377 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ecc1990d0 con 0x7f0ecc105bd0 2024-02-19T19:15:03.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.991+0000 7f0ed2e94700 1 -- 172.21.15.96:0/4066148377 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ecc04f2e0 con 0x7f0ecc105bd0 2024-02-19T19:15:03.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.991+0000 7f0ec9ffb700 1 -- 172.21.15.96:0/4066148377 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f0eb800f5c0 con 0x7f0ecc105bd0 2024-02-19T19:15:03.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.992+0000 7f0ec9ffb700 1 --2- 172.21.15.96:0/4066148377 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f0ebc06d8a0 0x7f0ebc06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:15:03.016 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.992+0000 7f0ec9ffb700 1 -- 172.21.15.96:0/4066148377 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6629+0+0 (secure 0 0 0) 0x7f0eb808d400 con 0x7f0ecc105bd0 2024-02-19T19:15:03.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.992+0000 7f0ed0c30700 1 --2- 172.21.15.96:0/4066148377 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f0ebc06d8a0 0x7f0ebc06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:15:03.017 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.992+0000 7f0ed0c30700 1 --2- 172.21.15.96:0/4066148377 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f0ebc06d8a0 0x7f0ebc06fd60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0006010 tx=0x7f0ec001a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:15:03.018 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:02.996+0000 7f0ec9ffb700 1 -- 172.21.15.96:0/4066148377 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0eb805a730 con 0x7f0ecc105bd0 2024-02-19T19:15:03.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:03.270+0000 7f0ed2e94700 1 -- 172.21.15.96:0/4066148377 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0ecc1993a0 con 0x7f0ecc105bd0 2024-02-19T19:15:03.292 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:03.270+0000 7f0ec9ffb700 1 -- 172.21.15.96:0/4066148377 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+201 (secure 0 0 0) 0x7f0eb805a2c0 con 0x7f0ecc105bd0 2024-02-19T19:15:03.293 INFO:teuthology.orchestra.run.smithi096.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T19:15:03.293 INFO:teuthology.orchestra.run.smithi096.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-02-19T19:15:03.293 INFO:teuthology.orchestra.run.smithi096.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-02-19T19:15:03.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:03.272+0000 7f0ed2e94700 1 -- 172.21.15.96:0/4066148377 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f0ebc06d8a0 msgr2=0x7f0ebc06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:15:03.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:03.272+0000 7f0ed2e94700 1 --2- 172.21.15.96:0/4066148377 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f0ebc06d8a0 0x7f0ebc06fd60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0006010 tx=0x7f0ec001a040 comp rx=0 tx=0).stop 2024-02-19T19:15:03.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:03.272+0000 7f0ed2e94700 1 -- 172.21.15.96:0/4066148377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ecc105bd0 msgr2=0x7f0ecc19ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:15:03.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:03.272+0000 7f0ed2e94700 1 --2- 172.21.15.96:0/4066148377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ecc105bd0 0x7f0ecc19ed60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0eb800c8a0 tx=0x7f0eb800cbb0 comp rx=0 tx=0).stop 2024-02-19T19:15:03.295 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:03.272+0000 7f0ed2e94700 1 -- 172.21.15.96:0/4066148377 shutdown_connections 2024-02-19T19:15:03.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:03.272+0000 7f0ed2e94700 1 --2- 172.21.15.96:0/4066148377 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f0ebc06d8a0 0x7f0ebc06fd60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:15:03.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:03.272+0000 7f0ed2e94700 1 --2- 172.21.15.96:0/4066148377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ecc0ffc20 0x7f0ecc19e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:15:03.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:03.272+0000 7f0ed2e94700 1 --2- 172.21.15.96:0/4066148377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ecc105bd0 0x7f0ecc19ed60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:15:03.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:03.272+0000 7f0ed2e94700 1 -- 172.21.15.96:0/4066148377 >> 172.21.15.96:0/4066148377 conn(0x7f0ecc075670 msgr2=0x7f0ecc0686e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:15:03.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:03.273+0000 7f0ed2e94700 1 -- 172.21.15.96:0/4066148377 shutdown_connections 2024-02-19T19:15:03.296 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:03.273+0000 7f0ed2e94700 1 -- 172.21.15.96:0/4066148377 wait complete. 2024-02-19T19:15:03.590 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:03 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/4066148377' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:15:03.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:03 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/4066148377' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-19T19:15:03.987 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions' 2024-02-19T19:15:04.196 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:15:04.669 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:04 smithi096 ceph-mon[112483]: pgmap v249: 65 pgs: 65 active+clean; 132 MiB data, 701 MiB used, 536 GiB / 536 GiB avail; 5.5 MiB/s rd, 342 KiB/s wr, 192 op/s 2024-02-19T19:15:04.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:04 smithi125 ceph-mon[86115]: pgmap v249: 65 pgs: 65 active+clean; 132 MiB data, 701 MiB used, 536 GiB / 536 GiB avail; 5.5 MiB/s rd, 342 KiB/s wr, 192 op/s 2024-02-19T19:15:05.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.937+0000 7f8b65b9a700 1 -- 172.21.15.96:0/2488584159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b60101cd0 msgr2=0x7f8b601020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:15:05.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.937+0000 7f8b65b9a700 1 --2- 172.21.15.96:0/2488584159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b60101cd0 0x7f8b601020b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009910 tx=0x7f8b50009c20 comp rx=0 tx=0).stop 2024-02-19T19:15:05.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.937+0000 7f8b65b9a700 1 -- 172.21.15.96:0/2488584159 shutdown_connections 2024-02-19T19:15:05.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.937+0000 7f8b65b9a700 1 --2- 172.21.15.96:0/2488584159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b601025f0 0x7f8b6010aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:15:05.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.937+0000 7f8b65b9a700 1 --2- 172.21.15.96:0/2488584159 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b60101cd0 0x7f8b601020b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:15:05.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.937+0000 7f8b65b9a700 1 -- 172.21.15.96:0/2488584159 >> 172.21.15.96:0/2488584159 conn(0x7f8b600fb500 msgr2=0x7f8b600fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:15:05.961 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.937+0000 7f8b65b9a700 1 -- 172.21.15.96:0/2488584159 shutdown_connections 2024-02-19T19:15:05.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.937+0000 7f8b65b9a700 1 -- 172.21.15.96:0/2488584159 wait complete. 2024-02-19T19:15:05.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.938+0000 7f8b65b9a700 1 Processor -- start 2024-02-19T19:15:05.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.938+0000 7f8b65b9a700 1 -- start start 2024-02-19T19:15:05.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.938+0000 7f8b65b9a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b60101cd0 0x7f8b600ff930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:15:05.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.938+0000 7f8b65b9a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b601025f0 0x7f8b600ffe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:15:05.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.938+0000 7f8b65b9a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b601003b0 con 0x7f8b60101cd0 2024-02-19T19:15:05.962 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.938+0000 7f8b65b9a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b601004f0 con 0x7f8b601025f0 2024-02-19T19:15:05.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.938+0000 7f8b5f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b60101cd0 0x7f8b600ff930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:15:05.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.938+0000 7f8b5f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b60101cd0 0x7f8b600ff930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:34478/0 (socket says 172.21.15.96:34478) 2024-02-19T19:15:05.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.938+0000 7f8b5f7fe700 1 -- 172.21.15.96:0/1630885315 learned_addr learned my addr 172.21.15.96:0/1630885315 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:15:05.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.939+0000 7f8b56ffd700 1 --2- 172.21.15.96:0/1630885315 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b601025f0 0x7f8b600ffe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:15:05.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.939+0000 7f8b5f7fe700 1 -- 172.21.15.96:0/1630885315 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b601025f0 msgr2=0x7f8b600ffe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:15:05.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.939+0000 7f8b5f7fe700 1 --2- 172.21.15.96:0/1630885315 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b601025f0 0x7f8b600ffe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:15:05.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.939+0000 7f8b5f7fe700 1 -- 172.21.15.96:0/1630885315 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b500095f0 con 0x7f8b60101cd0 2024-02-19T19:15:05.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.939+0000 7f8b5f7fe700 1 --2- 172.21.15.96:0/1630885315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b60101cd0 0x7f8b600ff930 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000b5c0 tx=0x7f8b5000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:15:05.963 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.939+0000 7f8b5d7fa700 1 -- 172.21.15.96:0/1630885315 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b5001d070 con 0x7f8b60101cd0 2024-02-19T19:15:05.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.939+0000 7f8b65b9a700 1 -- 172.21.15.96:0/1630885315 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b60100770 con 0x7f8b60101cd0 2024-02-19T19:15:05.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.939+0000 7f8b5d7fa700 1 -- 172.21.15.96:0/1630885315 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8b50005e00 con 0x7f8b60101cd0 2024-02-19T19:15:05.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.939+0000 7f8b5d7fa700 1 -- 172.21.15.96:0/1630885315 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b50017400 con 0x7f8b60101cd0 2024-02-19T19:15:05.964 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.939+0000 7f8b65b9a700 1 -- 172.21.15.96:0/1630885315 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b601a2bd0 con 0x7f8b60101cd0 2024-02-19T19:15:05.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.940+0000 7f8b65b9a700 1 -- 172.21.15.96:0/1630885315 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b601081e0 con 0x7f8b60101cd0 2024-02-19T19:15:05.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.941+0000 7f8b5d7fa700 1 -- 172.21.15.96:0/1630885315 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f8b50003a60 con 0x7f8b60101cd0 2024-02-19T19:15:05.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.941+0000 7f8b5d7fa700 1 --2- 172.21.15.96:0/1630885315 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f8b4c06d8a0 0x7f8b4c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:15:05.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.941+0000 7f8b5d7fa700 1 -- 172.21.15.96:0/1630885315 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6629+0+0 (secure 0 0 0) 0x7f8b5008ea80 con 0x7f8b60101cd0 2024-02-19T19:15:05.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.941+0000 7f8b56ffd700 1 --2- 172.21.15.96:0/1630885315 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f8b4c06d8a0 0x7f8b4c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:15:05.965 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.941+0000 7f8b56ffd700 1 --2- 172.21.15.96:0/1630885315 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f8b4c06d8a0 0x7f8b4c06fd60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8b48005950 tx=0x7f8b480058e0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:15:05.967 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:05.946+0000 7f8b5d7fa700 1 -- 172.21.15.96:0/1630885315 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8b50058200 con 0x7f8b60101cd0 2024-02-19T19:15:06.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:06.218+0000 7f8b65b9a700 1 -- 172.21.15.96:0/1630885315 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8b6004f2e0 con 0x7f8b60101cd0 2024-02-19T19:15:06.240 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:06.219+0000 7f8b5d7fa700 1 -- 172.21.15.96:0/1630885315 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f8b5005b8c0 con 0x7f8b60101cd0 2024-02-19T19:15:06.241 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:15:06.241 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:15:06.241 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:15:06.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:15:06.241 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:15:06.241 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:15:06.241 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:15:06.242 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:15:06.242 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-19T19:15:06.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:15:06.242 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:15:06.242 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-19T19:15:06.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:15:06.242 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:15:06.243 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 14 2024-02-19T19:15:06.243 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:15:06.243 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:15:06.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:06.221+0000 7f8b65b9a700 1 -- 172.21.15.96:0/1630885315 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f8b4c06d8a0 msgr2=0x7f8b4c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:15:06.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:06.221+0000 7f8b65b9a700 1 --2- 172.21.15.96:0/1630885315 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f8b4c06d8a0 0x7f8b4c06fd60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8b48005950 tx=0x7f8b480058e0 comp rx=0 tx=0).stop 2024-02-19T19:15:06.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:06.221+0000 7f8b65b9a700 1 -- 172.21.15.96:0/1630885315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b60101cd0 msgr2=0x7f8b600ff930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:15:06.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:06.221+0000 7f8b65b9a700 1 --2- 172.21.15.96:0/1630885315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b60101cd0 0x7f8b600ff930 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8b5000b5c0 tx=0x7f8b5000be20 comp rx=0 tx=0).stop 2024-02-19T19:15:06.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:06.221+0000 7f8b65b9a700 1 -- 172.21.15.96:0/1630885315 shutdown_connections 2024-02-19T19:15:06.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:06.221+0000 7f8b65b9a700 1 --2- 172.21.15.96:0/1630885315 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f8b4c06d8a0 0x7f8b4c06fd60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:15:06.244 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:06.221+0000 7f8b65b9a700 1 --2- 172.21.15.96:0/1630885315 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8b60101cd0 0x7f8b600ff930 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:15:06.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:06.221+0000 7f8b65b9a700 1 --2- 172.21.15.96:0/1630885315 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8b601025f0 0x7f8b600ffe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:15:06.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:06.221+0000 7f8b65b9a700 1 -- 172.21.15.96:0/1630885315 >> 172.21.15.96:0/1630885315 conn(0x7f8b600fb500 msgr2=0x7f8b60105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:15:06.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:06.221+0000 7f8b65b9a700 1 -- 172.21.15.96:0/1630885315 shutdown_connections 2024-02-19T19:15:06.245 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:15:06.221+0000 7f8b65b9a700 1 -- 172.21.15.96:0/1630885315 wait complete. 2024-02-19T19:15:06.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:15:06.537 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:15:06.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:06 smithi096 ceph-mon[112483]: pgmap v250: 65 pgs: 65 active+clean; 134 MiB data, 710 MiB used, 536 GiB / 536 GiB avail; 5.6 MiB/s rd, 513 KiB/s wr, 232 op/s 2024-02-19T19:15:06.538 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:06 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/1630885315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:15:06.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:15:06.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:15:06.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:06 smithi125 ceph-mon[86115]: pgmap v250: 65 pgs: 65 active+clean; 134 MiB data, 710 MiB used, 536 GiB / 536 GiB avail; 5.6 MiB/s rd, 513 KiB/s wr, 232 op/s 2024-02-19T19:15:06.703 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:06 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/1630885315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:15:06.826 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-02-19T19:15:07.031 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:15:08.657 INFO:teuthology.orchestra.run.smithi096.stdout:wait for servicemap items w/ changing names to refresh 2024-02-19T19:15:08.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:08 smithi125 ceph-mon[86115]: pgmap v251: 65 pgs: 65 active+clean; 134 MiB data, 714 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 204 KiB/s wr, 148 op/s 2024-02-19T19:15:08.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:08 smithi096 ceph-mon[112483]: pgmap v251: 65 pgs: 65 active+clean; 134 MiB data, 714 MiB used, 536 GiB / 536 GiB avail; 2.2 MiB/s rd, 204 KiB/s wr, 148 op/s 2024-02-19T19:15:09.518 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'sleep 60' 2024-02-19T19:15:09.727 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:15:10.702 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:10 smithi125 ceph-mon[86115]: pgmap v252: 65 pgs: 65 active+clean; 134 MiB data, 714 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 212 KiB/s wr, 114 op/s 2024-02-19T19:15:10.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:10 smithi096 ceph-mon[112483]: pgmap v252: 65 pgs: 65 active+clean; 134 MiB data, 714 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 212 KiB/s wr, 114 op/s 2024-02-19T19:15:12.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:12 smithi096 ceph-mon[112483]: pgmap v253: 65 pgs: 65 active+clean; 134 MiB data, 714 MiB used, 536 GiB / 536 GiB avail; 473 KiB/s rd, 184 KiB/s wr, 48 op/s 2024-02-19T19:15:12.923 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:12 smithi125 ceph-mon[86115]: pgmap v253: 65 pgs: 65 active+clean; 134 MiB data, 714 MiB used, 536 GiB / 536 GiB avail; 473 KiB/s rd, 184 KiB/s wr, 48 op/s 2024-02-19T19:15:14.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:14 smithi096 ceph-mon[112483]: pgmap v254: 65 pgs: 65 active+clean; 134 MiB data, 714 MiB used, 536 GiB / 536 GiB avail; 162 KiB/s rd, 181 KiB/s wr, 45 op/s 2024-02-19T19:15:14.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:14 smithi125 ceph-mon[86115]: pgmap v254: 65 pgs: 65 active+clean; 134 MiB data, 714 MiB used, 536 GiB / 536 GiB avail; 162 KiB/s rd, 181 KiB/s wr, 45 op/s 2024-02-19T19:15:16.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:16 smithi096 ceph-mon[112483]: pgmap v255: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 183 KiB/s rd, 202 KiB/s wr, 49 op/s 2024-02-19T19:15:16.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:16 smithi125 ceph-mon[86115]: pgmap v255: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 183 KiB/s rd, 202 KiB/s wr, 49 op/s 2024-02-19T19:15:18.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:18 smithi096 ceph-mon[112483]: pgmap v256: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 30 KiB/s rd, 29 KiB/s wr, 9 op/s 2024-02-19T19:15:18.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:18 smithi125 ceph-mon[86115]: pgmap v256: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 30 KiB/s rd, 29 KiB/s wr, 9 op/s 2024-02-19T19:15:20.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:20 smithi096 ceph-mon[112483]: pgmap v257: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 32 KiB/s rd, 32 KiB/s wr, 11 op/s 2024-02-19T19:15:20.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:15:20.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:20 smithi125 ceph-mon[86115]: pgmap v257: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 32 KiB/s rd, 32 KiB/s wr, 11 op/s 2024-02-19T19:15:20.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:15:22.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:22 smithi096 ceph-mon[112483]: pgmap v258: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 25 KiB/s rd, 24 KiB/s wr, 8 op/s 2024-02-19T19:15:22.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:22 smithi125 ceph-mon[86115]: pgmap v258: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 25 KiB/s rd, 24 KiB/s wr, 8 op/s 2024-02-19T19:15:23.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:15:23.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:15:23.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:15:23.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:15:23.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:15:23.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:15:23.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:15:23.952 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:15:24.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:24 smithi096 ceph-mon[112483]: pgmap v259: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 24 KiB/s rd, 24 KiB/s wr, 7 op/s 2024-02-19T19:15:24.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:24 smithi125 ceph-mon[86115]: pgmap v259: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 24 KiB/s rd, 24 KiB/s wr, 7 op/s 2024-02-19T19:15:26.787 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:26 smithi096 ceph-mon[112483]: pgmap v260: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 26 KiB/s rd, 25 KiB/s wr, 9 op/s 2024-02-19T19:15:26.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:26 smithi125 ceph-mon[86115]: pgmap v260: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 26 KiB/s rd, 25 KiB/s wr, 9 op/s 2024-02-19T19:15:28.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:28 smithi096 ceph-mon[112483]: pgmap v261: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 5.5 KiB/s rd, 4.0 KiB/s wr, 5 op/s 2024-02-19T19:15:28.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:28 smithi125 ceph-mon[86115]: pgmap v261: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 5.5 KiB/s rd, 4.0 KiB/s wr, 5 op/s 2024-02-19T19:15:30.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:30 smithi096 ceph-mon[112483]: pgmap v262: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 6.4 KiB/s rd, 5.1 KiB/s wr, 6 op/s 2024-02-19T19:15:30.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:30 smithi125 ceph-mon[86115]: pgmap v262: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 6.4 KiB/s rd, 5.1 KiB/s wr, 6 op/s 2024-02-19T19:15:31.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:31 smithi096 ceph-mon[112483]: pgmap v263: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s rd, 2.5 KiB/s wr, 5 op/s 2024-02-19T19:15:31.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:31 smithi125 ceph-mon[86115]: pgmap v263: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s rd, 2.5 KiB/s wr, 5 op/s 2024-02-19T19:15:34.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:34 smithi096 ceph-mon[112483]: pgmap v264: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 3.7 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2024-02-19T19:15:34.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:34 smithi125 ceph-mon[86115]: pgmap v264: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 3.7 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2024-02-19T19:15:35.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:15:35.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:15:36.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:36 smithi096 ceph-mon[112483]: pgmap v265: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s rd, 2.5 KiB/s wr, 5 op/s 2024-02-19T19:15:36.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:36 smithi125 ceph-mon[86115]: pgmap v265: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s rd, 2.5 KiB/s wr, 5 op/s 2024-02-19T19:15:38.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:38 smithi096 ceph-mon[112483]: pgmap v266: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-02-19T19:15:38.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:38 smithi125 ceph-mon[86115]: pgmap v266: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-02-19T19:15:40.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:40 smithi096 ceph-mon[112483]: pgmap v267: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 3.8 KiB/s rd, 2.3 KiB/s wr, 5 op/s 2024-02-19T19:15:40.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:40 smithi125 ceph-mon[86115]: pgmap v267: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 3.8 KiB/s rd, 2.3 KiB/s wr, 5 op/s 2024-02-19T19:15:42.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:42 smithi096 ceph-mon[112483]: pgmap v268: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-02-19T19:15:42.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:42 smithi125 ceph-mon[86115]: pgmap v268: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-02-19T19:15:44.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:44 smithi096 ceph-mon[112483]: pgmap v269: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-02-19T19:15:44.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:44 smithi125 ceph-mon[86115]: pgmap v269: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-02-19T19:15:46.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:46 smithi096 ceph-mon[112483]: pgmap v270: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-02-19T19:15:46.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:46 smithi125 ceph-mon[86115]: pgmap v270: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2024-02-19T19:15:48.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:48 smithi125 ceph-mon[86115]: pgmap v271: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-02-19T19:15:48.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:48 smithi096 ceph-mon[112483]: pgmap v271: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-02-19T19:15:50.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:50 smithi096 ceph-mon[112483]: pgmap v272: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 3.6 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-02-19T19:15:50.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:15:50.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:50 smithi125 ceph-mon[86115]: pgmap v272: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 3.6 KiB/s rd, 1.8 KiB/s wr, 5 op/s 2024-02-19T19:15:50.951 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:15:51.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:51 smithi096 ceph-mon[112483]: pgmap v273: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-19T19:15:51.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:51 smithi125 ceph-mon[86115]: pgmap v273: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-19T19:15:54.786 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:54 smithi096 ceph-mon[112483]: pgmap v274: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 767 B/s wr, 3 op/s 2024-02-19T19:15:54.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:54 smithi125 ceph-mon[86115]: pgmap v274: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.3 KiB/s rd, 767 B/s wr, 3 op/s 2024-02-19T19:15:56.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:56 smithi096 ceph-mon[112483]: pgmap v275: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-19T19:15:56.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:56 smithi125 ceph-mon[86115]: pgmap v275: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-19T19:15:58.700 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:15:58 smithi125 ceph-mon[86115]: pgmap v276: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-19T19:15:58.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:15:58 smithi096 ceph-mon[112483]: pgmap v276: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-19T19:16:00.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:00 smithi096 ceph-mon[112483]: pgmap v277: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-02-19T19:16:00.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:00 smithi125 ceph-mon[86115]: pgmap v277: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-02-19T19:16:02.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:02 smithi096 ceph-mon[112483]: pgmap v278: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s rd, 597 B/s wr, 4 op/s 2024-02-19T19:16:02.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:02 smithi125 ceph-mon[86115]: pgmap v278: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s rd, 597 B/s wr, 4 op/s 2024-02-19T19:16:04.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:04 smithi096 ceph-mon[112483]: pgmap v279: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 597 B/s wr, 3 op/s 2024-02-19T19:16:04.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:04 smithi125 ceph-mon[86115]: pgmap v279: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 597 B/s wr, 3 op/s 2024-02-19T19:16:05.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:16:05.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:16:06.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:06 smithi096 ceph-mon[112483]: pgmap v280: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s rd, 597 B/s wr, 4 op/s 2024-02-19T19:16:06.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:06 smithi125 ceph-mon[86115]: pgmap v280: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s rd, 597 B/s wr, 4 op/s 2024-02-19T19:16:08.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:08 smithi096 ceph-mon[112483]: pgmap v281: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s rd, 597 B/s wr, 4 op/s 2024-02-19T19:16:08.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:08 smithi125 ceph-mon[86115]: pgmap v281: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s rd, 597 B/s wr, 4 op/s 2024-02-19T19:16:09.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:09 smithi096 ceph-mon[112483]: pgmap v282: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 938 B/s wr, 5 op/s 2024-02-19T19:16:09.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:09 smithi125 ceph-mon[86115]: pgmap v282: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 938 B/s wr, 5 op/s 2024-02-19T19:16:11.985 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph orch ps' 2024-02-19T19:16:12.202 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:16:12.653 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:12 smithi096 ceph-mon[112483]: pgmap v283: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 341 B/s wr, 3 op/s 2024-02-19T19:16:12.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:12 smithi125 ceph-mon[86115]: pgmap v283: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 341 B/s wr, 3 op/s 2024-02-19T19:16:13.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.875+0000 7fbbe5b27700 1 -- 172.21.15.96:0/2587730540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe00fff50 msgr2=0x7fbbe0105840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:16:13.896 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.875+0000 7fbbe5b27700 1 --2- 172.21.15.96:0/2587730540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe00fff50 0x7fbbe0105840 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbbc8009910 tx=0x7fbbc8009c20 comp rx=0 tx=0).stop 2024-02-19T19:16:13.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.875+0000 7fbbe5b27700 1 -- 172.21.15.96:0/2587730540 shutdown_connections 2024-02-19T19:16:13.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.875+0000 7fbbe5b27700 1 --2- 172.21.15.96:0/2587730540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe00fff50 0x7fbbe0105840 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:13.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.875+0000 7fbbe5b27700 1 --2- 172.21.15.96:0/2587730540 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe00ff5a0 0x7fbbe00ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:13.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.875+0000 7fbbe5b27700 1 -- 172.21.15.96:0/2587730540 >> 172.21.15.96:0/2587730540 conn(0x7fbbe0074e30 msgr2=0x7fbbe0075240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:16:13.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.875+0000 7fbbe5b27700 1 -- 172.21.15.96:0/2587730540 shutdown_connections 2024-02-19T19:16:13.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.875+0000 7fbbe5b27700 1 -- 172.21.15.96:0/2587730540 wait complete. 2024-02-19T19:16:13.897 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.876+0000 7fbbe5b27700 1 Processor -- start 2024-02-19T19:16:13.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.876+0000 7fbbe5b27700 1 -- start start 2024-02-19T19:16:13.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.876+0000 7fbbe5b27700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe00ff5a0 0x7fbbe019c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:16:13.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.876+0000 7fbbe5b27700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe00fff50 0x7fbbe019cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:16:13.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.876+0000 7fbbe5b27700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe019d190 con 0x7fbbe00fff50 2024-02-19T19:16:13.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.876+0000 7fbbe5b27700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe01966d0 con 0x7fbbe00ff5a0 2024-02-19T19:16:13.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.876+0000 7fbbd7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe00fff50 0x7fbbe019cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:16:13.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.876+0000 7fbbd7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe00fff50 0x7fbbe019cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44824/0 (socket says 172.21.15.96:44824) 2024-02-19T19:16:13.898 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.876+0000 7fbbd7fff700 1 -- 172.21.15.96:0/351782208 learned_addr learned my addr 172.21.15.96:0/351782208 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:16:13.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.876+0000 7fbbd7fff700 1 -- 172.21.15.96:0/351782208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe00ff5a0 msgr2=0x7fbbe019c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:16:13.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.876+0000 7fbbdf7fe700 1 --2- 172.21.15.96:0/351782208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe00ff5a0 0x7fbbe019c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:16:13.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.876+0000 7fbbd7fff700 1 --2- 172.21.15.96:0/351782208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe00ff5a0 0x7fbbe019c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:13.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.876+0000 7fbbd7fff700 1 -- 172.21.15.96:0/351782208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc80095f0 con 0x7fbbe00fff50 2024-02-19T19:16:13.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.876+0000 7fbbdf7fe700 1 --2- 172.21.15.96:0/351782208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe00ff5a0 0x7fbbe019c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:16:13.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.877+0000 7fbbd7fff700 1 --2- 172.21.15.96:0/351782208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe00fff50 0x7fbbe019cb90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbbc800bda0 tx=0x7fbbc800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:16:13.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.877+0000 7fbbdd7fa700 1 -- 172.21.15.96:0/351782208 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbc801d070 con 0x7fbbe00fff50 2024-02-19T19:16:13.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.877+0000 7fbbe5b27700 1 -- 172.21.15.96:0/351782208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe0196950 con 0x7fbbe00fff50 2024-02-19T19:16:13.899 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.877+0000 7fbbdd7fa700 1 -- 172.21.15.96:0/351782208 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbbc8004fb0 con 0x7fbbe00fff50 2024-02-19T19:16:13.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.877+0000 7fbbe5b27700 1 -- 172.21.15.96:0/351782208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe0196e40 con 0x7fbbe00fff50 2024-02-19T19:16:13.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.877+0000 7fbbdd7fa700 1 -- 172.21.15.96:0/351782208 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbc800f460 con 0x7fbbe00fff50 2024-02-19T19:16:13.900 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.878+0000 7fbbe5b27700 1 -- 172.21.15.96:0/351782208 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe0109200 con 0x7fbbe00fff50 2024-02-19T19:16:13.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.878+0000 7fbbdd7fa700 1 -- 172.21.15.96:0/351782208 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fbbc8022800 con 0x7fbbe00fff50 2024-02-19T19:16:13.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.879+0000 7fbbdd7fa700 1 --2- 172.21.15.96:0/351782208 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fbbcc06d8a0 0x7fbbcc06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:16:13.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.879+0000 7fbbdd7fa700 1 -- 172.21.15.96:0/351782208 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6629+0+0 (secure 0 0 0) 0x7fbbc808ec70 con 0x7fbbe00fff50 2024-02-19T19:16:13.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.879+0000 7fbbdf7fe700 1 --2- 172.21.15.96:0/351782208 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fbbcc06d8a0 0x7fbbcc06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:16:13.901 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.879+0000 7fbbdf7fe700 1 --2- 172.21.15.96:0/351782208 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fbbcc06d8a0 0x7fbbcc06fd60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0005fd0 tx=0x7fbbd0005e20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:16:13.902 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:13.883+0000 7fbbdd7fa700 1 -- 172.21.15.96:0/351782208 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbbc805c0f0 con 0x7fbbe00fff50 2024-02-19T19:16:14.112 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:14.093+0000 7fbbe5b27700 1 -- 172.21.15.96:0/351782208 --> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbbe01970b0 con 0x7fbbcc06d8a0 2024-02-19T19:16:14.122 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:14.103+0000 7fbbdd7fa700 1 -- 172.21.15.96:0/351782208 <== mgr.34104 v2:172.21.15.96:6800/619116925 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fbbe01970b0 con 0x7fbbcc06d8a0 2024-02-19T19:16:14.122 INFO:teuthology.orchestra.run.smithi096.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-19T19:16:14.123 INFO:teuthology.orchestra.run.smithi096.stdout:alertmanager.smithi096 smithi096 *:9093,9094 running (10m) 117s ago 20m 24.9M - 0.25.0 c8568f914cd2 bbaf83a1e476 2024-02-19T19:16:14.123 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi096 smithi096 running (2m) 117s ago 20m 7788k - 19.0.0-1450-gf78a58c0 f081f847070a 29198555e2a7 2024-02-19T19:16:14.123 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-exporter.smithi125 smithi125 running (2m) 119s ago 19m 6916k - 19.0.0-1450-gf78a58c0 f081f847070a 0fb4dbdd3442 2024-02-19T19:16:14.123 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi096 smithi096 running (7m) 117s ago 20m 6669k - 19.0.0-1450-gf78a58c0 f081f847070a deea0ffefa0f 2024-02-19T19:16:14.123 INFO:teuthology.orchestra.run.smithi096.stdout:crash.smithi125 smithi125 running (7m) 119s ago 19m 6660k - 19.0.0-1450-gf78a58c0 f081f847070a 3421965dc5b0 2024-02-19T19:16:14.123 INFO:teuthology.orchestra.run.smithi096.stdout:grafana.smithi096 smithi096 *:3000 running (9m) 117s ago 19m 86.7M - 9.4.12 a0ea5e3c46d9 0102d90938e4 2024-02-19T19:16:14.123 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.pccmys smithi096 running (2m) 117s ago 14m 50.4M - 19.0.0-1450-gf78a58c0 f081f847070a 26f13e1700e9 2024-02-19T19:16:14.123 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi096.usrmcg smithi096 running (3m) 117s ago 14m 57.9M - 19.0.0-1450-gf78a58c0 f081f847070a a24f6ad0b131 2024-02-19T19:16:14.123 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.pwyuga smithi125 running (2m) 119s ago 14m 14.8M - 19.0.0-1450-gf78a58c0 f081f847070a c1bb02a0982a 2024-02-19T19:16:14.124 INFO:teuthology.orchestra.run.smithi096.stdout:mds.cephfs.smithi125.srnlol smithi125 running (2m) 119s ago 14m 15.9M - 19.0.0-1450-gf78a58c0 f081f847070a d0d33ee245a0 2024-02-19T19:16:14.124 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi096.zsjdff smithi096 *:8443,9283,8765 running (11m) 117s ago 21m 510M - 19.0.0-1450-gf78a58c0 f081f847070a a86fbe94fe3f 2024-02-19T19:16:14.124 INFO:teuthology.orchestra.run.smithi096.stdout:mgr.smithi125.ygdmdu smithi125 *:8443,9283,8765 running (11m) 119s ago 18m 451M - 19.0.0-1450-gf78a58c0 f081f847070a e250486d572d 2024-02-19T19:16:14.124 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi096 smithi096 running (8m) 117s ago 21m 59.6M 2048M 19.0.0-1450-gf78a58c0 f081f847070a d70090d516e3 2024-02-19T19:16:14.124 INFO:teuthology.orchestra.run.smithi096.stdout:mon.smithi125 smithi125 running (7m) 119s ago 18m 48.2M 2048M 19.0.0-1450-gf78a58c0 f081f847070a f56b17bdc9a0 2024-02-19T19:16:14.124 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi096 smithi096 *:9100 running (11m) 117s ago 20m 15.3M - 1.5.0 0da6a335fe13 51f622ea33d6 2024-02-19T19:16:14.124 INFO:teuthology.orchestra.run.smithi096.stdout:node-exporter.smithi125 smithi125 *:9100 running (11m) 119s ago 18m 17.3M - 1.5.0 0da6a335fe13 464e076a52a1 2024-02-19T19:16:14.124 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 smithi096 running (6m) 117s ago 18m 106M 1216M 19.0.0-1450-gf78a58c0 f081f847070a b3dffd6a3fb2 2024-02-19T19:16:14.124 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 smithi096 running (6m) 117s ago 17m 108M 1216M 19.0.0-1450-gf78a58c0 f081f847070a f0dd6d8f952f 2024-02-19T19:16:14.125 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 smithi096 running (5m) 117s ago 17m 97.4M 1216M 19.0.0-1450-gf78a58c0 f081f847070a 51b70eaaa7a9 2024-02-19T19:16:14.125 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 smithi125 running (5m) 119s ago 16m 82.8M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 73b832b7b243 2024-02-19T19:16:14.125 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 smithi125 running (4m) 119s ago 16m 81.8M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 1309ffc459f9 2024-02-19T19:16:14.125 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 smithi125 running (3m) 119s ago 15m 78.7M 2240M 19.0.0-1450-gf78a58c0 f081f847070a 247b0927920b 2024-02-19T19:16:14.125 INFO:teuthology.orchestra.run.smithi096.stdout:prometheus.smithi096 smithi096 *:9095 running (10m) 117s ago 19m 67.0M - 2.43.0 a07b618ecd1d a4edcf6ed669 2024-02-19T19:16:14.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:14.106+0000 7fbbe5b27700 1 -- 172.21.15.96:0/351782208 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fbbcc06d8a0 msgr2=0x7fbbcc06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:16:14.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:14.106+0000 7fbbe5b27700 1 --2- 172.21.15.96:0/351782208 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fbbcc06d8a0 0x7fbbcc06fd60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0005fd0 tx=0x7fbbd0005e20 comp rx=0 tx=0).stop 2024-02-19T19:16:14.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:14.106+0000 7fbbe5b27700 1 -- 172.21.15.96:0/351782208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe00fff50 msgr2=0x7fbbe019cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:16:14.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:14.106+0000 7fbbe5b27700 1 --2- 172.21.15.96:0/351782208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe00fff50 0x7fbbe019cb90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fbbc800bda0 tx=0x7fbbc800be80 comp rx=0 tx=0).stop 2024-02-19T19:16:14.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:14.106+0000 7fbbe5b27700 1 -- 172.21.15.96:0/351782208 shutdown_connections 2024-02-19T19:16:14.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:14.106+0000 7fbbe5b27700 1 --2- 172.21.15.96:0/351782208 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fbbcc06d8a0 0x7fbbcc06fd60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:14.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:14.106+0000 7fbbe5b27700 1 --2- 172.21.15.96:0/351782208 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fbbe00ff5a0 0x7fbbe019c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:14.126 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:14.106+0000 7fbbe5b27700 1 --2- 172.21.15.96:0/351782208 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbbe00fff50 0x7fbbe019cb90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:14.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:14.106+0000 7fbbe5b27700 1 -- 172.21.15.96:0/351782208 >> 172.21.15.96:0/351782208 conn(0x7fbbe0074e30 msgr2=0x7fbbe00fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:16:14.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:14.106+0000 7fbbe5b27700 1 -- 172.21.15.96:0/351782208 shutdown_connections 2024-02-19T19:16:14.127 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:14.106+0000 7fbbe5b27700 1 -- 172.21.15.96:0/351782208 wait complete. 2024-02-19T19:16:14.662 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:14 smithi096 ceph-mon[112483]: pgmap v284: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 341 B/s wr, 3 op/s 2024-02-19T19:16:14.785 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions' 2024-02-19T19:16:14.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:14 smithi125 ceph-mon[86115]: pgmap v284: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 341 B/s wr, 3 op/s 2024-02-19T19:16:15.001 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:16:15.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:15 smithi096 ceph-mon[112483]: from='client.34578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:16:15.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:15 smithi125 ceph-mon[86115]: from='client.34578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-19T19:16:16.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.689+0000 7f961f259700 1 -- 172.21.15.96:0/1741219583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9618101850 msgr2=0x7f96181058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:16:16.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.689+0000 7f961f259700 1 --2- 172.21.15.96:0/1741219583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9618101850 0x7f96181058a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9604009910 tx=0x7f9604009c20 comp rx=0 tx=0).stop 2024-02-19T19:16:16.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.689+0000 7f961f259700 1 -- 172.21.15.96:0/1741219583 shutdown_connections 2024-02-19T19:16:16.708 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.689+0000 7f961f259700 1 --2- 172.21.15.96:0/1741219583 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9618101850 0x7f96181058a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:16.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.689+0000 7f961f259700 1 --2- 172.21.15.96:0/1741219583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9618100ea0 0x7f9618101280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:16.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.689+0000 7f961f259700 1 -- 172.21.15.96:0/1741219583 >> 172.21.15.96:0/1741219583 conn(0x7f96180fc750 msgr2=0x7f96180feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:16:16.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.689+0000 7f961f259700 1 -- 172.21.15.96:0/1741219583 shutdown_connections 2024-02-19T19:16:16.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.689+0000 7f961f259700 1 -- 172.21.15.96:0/1741219583 wait complete. 2024-02-19T19:16:16.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.690+0000 7f961f259700 1 Processor -- start 2024-02-19T19:16:16.709 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.690+0000 7f961f259700 1 -- start start 2024-02-19T19:16:16.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.690+0000 7f961f259700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9618100ea0 0x7f9618073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:16:16.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.690+0000 7f961f259700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9618101850 0x7f96180735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:16:16.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.690+0000 7f961f259700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9618073b10 con 0x7f9618100ea0 2024-02-19T19:16:16.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.690+0000 7f961f259700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9618073c50 con 0x7f9618101850 2024-02-19T19:16:16.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.690+0000 7f961cff5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9618100ea0 0x7f9618073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:16:16.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.690+0000 7f961cff5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9618100ea0 0x7f9618073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44856/0 (socket says 172.21.15.96:44856) 2024-02-19T19:16:16.712 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.690+0000 7f961cff5700 1 -- 172.21.15.96:0/791901660 learned_addr learned my addr 172.21.15.96:0/791901660 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:16:16.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.690+0000 7f9617fff700 1 --2- 172.21.15.96:0/791901660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9618101850 0x7f96180735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:16:16.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.690+0000 7f961cff5700 1 -- 172.21.15.96:0/791901660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9618101850 msgr2=0x7f96180735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:16:16.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.690+0000 7f961cff5700 1 --2- 172.21.15.96:0/791901660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9618101850 0x7f96180735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:16.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.690+0000 7f961cff5700 1 -- 172.21.15.96:0/791901660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96040095f0 con 0x7f9618100ea0 2024-02-19T19:16:16.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.690+0000 7f9617fff700 1 --2- 172.21.15.96:0/791901660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9618101850 0x7f96180735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-19T19:16:16.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.690+0000 7f961cff5700 1 --2- 172.21.15.96:0/791901660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9618100ea0 0x7f9618073090 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f960c00b4b0 tx=0x7f960c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:16:16.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.690+0000 7f9615ffb700 1 -- 172.21.15.96:0/791901660 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f960c011800 con 0x7f9618100ea0 2024-02-19T19:16:16.713 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.691+0000 7f9615ffb700 1 -- 172.21.15.96:0/791901660 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f960c011e20 con 0x7f9618100ea0 2024-02-19T19:16:16.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.691+0000 7f961f259700 1 -- 172.21.15.96:0/791901660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96181a2b90 con 0x7f9618100ea0 2024-02-19T19:16:16.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.691+0000 7f9615ffb700 1 -- 172.21.15.96:0/791901660 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f960c00f2e0 con 0x7f9618100ea0 2024-02-19T19:16:16.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.691+0000 7f961f259700 1 -- 172.21.15.96:0/791901660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96181a2fa0 con 0x7f9618100ea0 2024-02-19T19:16:16.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.692+0000 7f961f259700 1 -- 172.21.15.96:0/791901660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96181091d0 con 0x7f9618100ea0 2024-02-19T19:16:16.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.692+0000 7f9615ffb700 1 -- 172.21.15.96:0/791901660 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7f960c010380 con 0x7f9618100ea0 2024-02-19T19:16:16.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.692+0000 7f9615ffb700 1 --2- 172.21.15.96:0/791901660 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f960806d8a0 0x7f960806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:16:16.714 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.692+0000 7f9615ffb700 1 -- 172.21.15.96:0/791901660 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6629+0+0 (secure 0 0 0) 0x7f960c08d040 con 0x7f9618100ea0 2024-02-19T19:16:16.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.692+0000 7f9617fff700 1 --2- 172.21.15.96:0/791901660 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f960806d8a0 0x7f960806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:16:16.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.693+0000 7f9617fff700 1 --2- 172.21.15.96:0/791901660 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f960806d8a0 0x7f960806fd60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f960400b5c0 tx=0x7f9604005480 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:16:16.715 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.697+0000 7f9615ffb700 1 -- 172.21.15.96:0/791901660 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f960c056840 con 0x7f9618100ea0 2024-02-19T19:16:16.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:16 smithi096 ceph-mon[112483]: pgmap v285: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 341 B/s wr, 4 op/s 2024-02-19T19:16:16.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:16 smithi125 ceph-mon[86115]: pgmap v285: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 341 B/s wr, 4 op/s 2024-02-19T19:16:16.994 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.976+0000 7f961f259700 1 -- 172.21.15.96:0/791901660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9618073e10 con 0x7f9618100ea0 2024-02-19T19:16:16.995 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.976+0000 7f9615ffb700 1 -- 172.21.15.96:0/791901660 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f960c059f00 con 0x7f9618100ea0 2024-02-19T19:16:16.995 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-02-19T19:16:16.995 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": { 2024-02-19T19:16:16.995 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:16:16.995 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:16:16.995 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": { 2024-02-19T19:16:16.996 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 2 2024-02-19T19:16:16.996 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:16:16.996 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": { 2024-02-19T19:16:16.996 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 6 2024-02-19T19:16:16.996 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:16:16.996 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": { 2024-02-19T19:16:16.996 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 4 2024-02-19T19:16:16.996 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-02-19T19:16:16.997 INFO:teuthology.orchestra.run.smithi096.stdout: "overall": { 2024-02-19T19:16:16.997 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)": 14 2024-02-19T19:16:16.997 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-02-19T19:16:16.997 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-02-19T19:16:16.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.978+0000 7f961f259700 1 -- 172.21.15.96:0/791901660 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f960806d8a0 msgr2=0x7f960806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:16:16.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.978+0000 7f961f259700 1 --2- 172.21.15.96:0/791901660 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f960806d8a0 0x7f960806fd60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f960400b5c0 tx=0x7f9604005480 comp rx=0 tx=0).stop 2024-02-19T19:16:16.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.978+0000 7f961f259700 1 -- 172.21.15.96:0/791901660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9618100ea0 msgr2=0x7f9618073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:16:16.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.978+0000 7f961f259700 1 --2- 172.21.15.96:0/791901660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9618100ea0 0x7f9618073090 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f960c00b4b0 tx=0x7f960c00b870 comp rx=0 tx=0).stop 2024-02-19T19:16:16.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.978+0000 7f961f259700 1 -- 172.21.15.96:0/791901660 shutdown_connections 2024-02-19T19:16:16.998 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.978+0000 7f961f259700 1 --2- 172.21.15.96:0/791901660 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7f960806d8a0 0x7f960806fd60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:16.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.978+0000 7f961f259700 1 --2- 172.21.15.96:0/791901660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9618100ea0 0x7f9618073090 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:16.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.978+0000 7f961f259700 1 --2- 172.21.15.96:0/791901660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9618101850 0x7f96180735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:16.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.978+0000 7f961f259700 1 -- 172.21.15.96:0/791901660 >> 172.21.15.96:0/791901660 conn(0x7f96180fc750 msgr2=0x7f96180fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:16:16.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.978+0000 7f961f259700 1 -- 172.21.15.96:0/791901660 shutdown_connections 2024-02-19T19:16:16.999 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:16.978+0000 7f961f259700 1 -- 172.21.15.96:0/791901660 wait complete. 2024-02-19T19:16:17.654 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:17 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/791901660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:16:17.676 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-02-19T19:16:17.886 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:16:17.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:17 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/791901660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:16:18.669 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:18 smithi096 ceph-mon[112483]: pgmap v286: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 341 B/s wr, 3 op/s 2024-02-19T19:16:18.851 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:18 smithi125 ceph-mon[86115]: pgmap v286: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 341 B/s wr, 3 op/s 2024-02-19T19:16:19.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.436+0000 7fa54b51c700 1 -- 172.21.15.96:0/1216279154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa544100ea0 msgr2=0x7fa544101280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:16:19.456 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.436+0000 7fa54b51c700 1 --2- 172.21.15.96:0/1216279154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa544100ea0 0x7fa544101280 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa540009910 tx=0x7fa540009c20 comp rx=0 tx=0).stop 2024-02-19T19:16:19.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.436+0000 7fa54b51c700 1 -- 172.21.15.96:0/1216279154 shutdown_connections 2024-02-19T19:16:19.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.436+0000 7fa54b51c700 1 --2- 172.21.15.96:0/1216279154 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa544101850 0x7fa5441058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:19.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.436+0000 7fa54b51c700 1 --2- 172.21.15.96:0/1216279154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa544100ea0 0x7fa544101280 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:19.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.436+0000 7fa54b51c700 1 -- 172.21.15.96:0/1216279154 >> 172.21.15.96:0/1216279154 conn(0x7fa5440fc750 msgr2=0x7fa5440feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:16:19.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.436+0000 7fa54b51c700 1 -- 172.21.15.96:0/1216279154 shutdown_connections 2024-02-19T19:16:19.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.436+0000 7fa54b51c700 1 -- 172.21.15.96:0/1216279154 wait complete. 2024-02-19T19:16:19.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.436+0000 7fa54b51c700 1 Processor -- start 2024-02-19T19:16:19.457 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.436+0000 7fa54b51c700 1 -- start start 2024-02-19T19:16:19.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.437+0000 7fa54b51c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa544100ea0 0x7fa544196990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:16:19.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.437+0000 7fa54b51c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa544101850 0x7fa544196ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:16:19.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.437+0000 7fa54b51c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa544197560 con 0x7fa544100ea0 2024-02-19T19:16:19.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.437+0000 7fa54b51c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54419b370 con 0x7fa544101850 2024-02-19T19:16:19.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.437+0000 7fa5492b8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa544100ea0 0x7fa544196990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:16:19.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.437+0000 7fa5492b8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa544100ea0 0x7fa544196990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44880/0 (socket says 172.21.15.96:44880) 2024-02-19T19:16:19.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.437+0000 7fa5492b8700 1 -- 172.21.15.96:0/1033410399 learned_addr learned my addr 172.21.15.96:0/1033410399 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:16:19.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.437+0000 7fa548ab7700 1 --2- 172.21.15.96:0/1033410399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa544101850 0x7fa544196ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:16:19.458 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.437+0000 7fa5492b8700 1 -- 172.21.15.96:0/1033410399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa544101850 msgr2=0x7fa544196ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:16:19.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.437+0000 7fa5492b8700 1 --2- 172.21.15.96:0/1033410399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa544101850 0x7fa544196ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:19.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.437+0000 7fa5492b8700 1 -- 172.21.15.96:0/1033410399 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5400095f0 con 0x7fa544100ea0 2024-02-19T19:16:19.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.437+0000 7fa5492b8700 1 --2- 172.21.15.96:0/1033410399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa544100ea0 0x7fa544196990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa540000c00 tx=0x7fa54000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:16:19.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.437+0000 7fa53a7fc700 1 -- 172.21.15.96:0/1033410399 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa54001d070 con 0x7fa544100ea0 2024-02-19T19:16:19.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.438+0000 7fa54b51c700 1 -- 172.21.15.96:0/1033410399 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54419b5f0 con 0x7fa544100ea0 2024-02-19T19:16:19.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.438+0000 7fa53a7fc700 1 -- 172.21.15.96:0/1033410399 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa54000f460 con 0x7fa544100ea0 2024-02-19T19:16:19.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.438+0000 7fa53a7fc700 1 -- 172.21.15.96:0/1033410399 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa540017630 con 0x7fa544100ea0 2024-02-19T19:16:19.459 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.438+0000 7fa54b51c700 1 -- 172.21.15.96:0/1033410399 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa54419bae0 con 0x7fa544100ea0 2024-02-19T19:16:19.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.438+0000 7fa54b51c700 1 -- 172.21.15.96:0/1033410399 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa544109240 con 0x7fa544100ea0 2024-02-19T19:16:19.460 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.439+0000 7fa53a7fc700 1 -- 172.21.15.96:0/1033410399 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fa54000f5d0 con 0x7fa544100ea0 2024-02-19T19:16:19.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.439+0000 7fa53a7fc700 1 --2- 172.21.15.96:0/1033410399 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa53006d8a0 0x7fa53006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:16:19.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.439+0000 7fa53a7fc700 1 -- 172.21.15.96:0/1033410399 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6629+0+0 (secure 0 0 0) 0x7fa54008ebc0 con 0x7fa544100ea0 2024-02-19T19:16:19.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.439+0000 7fa548ab7700 1 --2- 172.21.15.96:0/1033410399 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa53006d8a0 0x7fa53006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:16:19.461 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.440+0000 7fa548ab7700 1 --2- 172.21.15.96:0/1033410399 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa53006d8a0 0x7fa53006fd60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa534006fd0 tx=0x7fa534008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:16:19.462 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.444+0000 7fa53a7fc700 1 -- 172.21.15.96:0/1033410399 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa54005be70 con 0x7fa544100ea0 2024-02-19T19:16:19.740 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.722+0000 7fa54b51c700 1 -- 172.21.15.96:0/1033410399 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa54404f2e0 con 0x7fa544100ea0 2024-02-19T19:16:19.741 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.722+0000 7fa53a7fc700 1 -- 172.21.15.96:0/1033410399 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fa54008e070 con 0x7fa544100ea0 2024-02-19T19:16:19.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.724+0000 7fa54b51c700 1 -- 172.21.15.96:0/1033410399 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa53006d8a0 msgr2=0x7fa53006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:16:19.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.724+0000 7fa54b51c700 1 --2- 172.21.15.96:0/1033410399 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa53006d8a0 0x7fa53006fd60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa534006fd0 tx=0x7fa534008040 comp rx=0 tx=0).stop 2024-02-19T19:16:19.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.724+0000 7fa54b51c700 1 -- 172.21.15.96:0/1033410399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa544100ea0 msgr2=0x7fa544196990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:16:19.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.724+0000 7fa54b51c700 1 --2- 172.21.15.96:0/1033410399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa544100ea0 0x7fa544196990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa540000c00 tx=0x7fa54000be20 comp rx=0 tx=0).stop 2024-02-19T19:16:19.743 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.724+0000 7fa54b51c700 1 -- 172.21.15.96:0/1033410399 shutdown_connections 2024-02-19T19:16:19.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.724+0000 7fa54b51c700 1 --2- 172.21.15.96:0/1033410399 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fa53006d8a0 0x7fa53006fd60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:19.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.724+0000 7fa54b51c700 1 --2- 172.21.15.96:0/1033410399 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa544100ea0 0x7fa544196990 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:19.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.724+0000 7fa54b51c700 1 --2- 172.21.15.96:0/1033410399 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa544101850 0x7fa544196ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:19.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.724+0000 7fa54b51c700 1 -- 172.21.15.96:0/1033410399 >> 172.21.15.96:0/1033410399 conn(0x7fa5440fc750 msgr2=0x7fa5440fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:16:19.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.724+0000 7fa54b51c700 1 -- 172.21.15.96:0/1033410399 shutdown_connections 2024-02-19T19:16:19.744 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:19.724+0000 7fa54b51c700 1 -- 172.21.15.96:0/1033410399 wait complete. 2024-02-19T19:16:19.753 INFO:teuthology.orchestra.run.smithi096.stdout:true 2024-02-19T19:16:20.402 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 -e sha1=f78a58c0ffd401d1493058a1022c35f011d65275 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-02-19T19:16:20.614 INFO:teuthology.orchestra.run.smithi096.stderr:Inferring config /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/mon.smithi096/config 2024-02-19T19:16:20.735 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:20 smithi096 ceph-mon[112483]: pgmap v287: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s rd, 597 B/s wr, 5 op/s 2024-02-19T19:16:20.735 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:20 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/1033410399' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:16:20.735 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:16:20.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:20 smithi125 ceph-mon[86115]: pgmap v287: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.6 KiB/s rd, 597 B/s wr, 5 op/s 2024-02-19T19:16:20.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:20 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/1033410399' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:16:20.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:16:22.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.188+0000 7fc5d514a700 1 -- 172.21.15.96:0/1055862764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5d0100750 msgr2=0x7fc5d01047a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:16:22.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.188+0000 7fc5d514a700 1 --2- 172.21.15.96:0/1055862764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5d0100750 0x7fc5d01047a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8009910 tx=0x7fc5b8009c20 comp rx=0 tx=0).stop 2024-02-19T19:16:22.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.188+0000 7fc5d514a700 1 -- 172.21.15.96:0/1055862764 shutdown_connections 2024-02-19T19:16:22.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.188+0000 7fc5d514a700 1 --2- 172.21.15.96:0/1055862764 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5d0100750 0x7fc5d01047a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:22.207 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.188+0000 7fc5d514a700 1 --2- 172.21.15.96:0/1055862764 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5d00ffda0 0x7fc5d0100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:22.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.188+0000 7fc5d514a700 1 -- 172.21.15.96:0/1055862764 >> 172.21.15.96:0/1055862764 conn(0x7fc5d00fb650 msgr2=0x7fc5d00fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:16:22.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.188+0000 7fc5d514a700 1 -- 172.21.15.96:0/1055862764 shutdown_connections 2024-02-19T19:16:22.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.188+0000 7fc5d514a700 1 -- 172.21.15.96:0/1055862764 wait complete. 2024-02-19T19:16:22.208 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.189+0000 7fc5d514a700 1 Processor -- start 2024-02-19T19:16:22.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.189+0000 7fc5d514a700 1 -- start start 2024-02-19T19:16:22.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.189+0000 7fc5d514a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5d00ffda0 0x7fc5d019b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:16:22.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.189+0000 7fc5d514a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5d0100750 0x7fc5d019bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:16:22.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.189+0000 7fc5d514a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d019c280 con 0x7fc5d00ffda0 2024-02-19T19:16:22.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.189+0000 7fc5d514a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d0195730 con 0x7fc5d0100750 2024-02-19T19:16:22.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.189+0000 7fc5ced9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5d00ffda0 0x7fc5d019b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:16:22.210 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.189+0000 7fc5ced9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5d00ffda0 0x7fc5d019b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:44912/0 (socket says 172.21.15.96:44912) 2024-02-19T19:16:22.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.189+0000 7fc5ced9d700 1 -- 172.21.15.96:0/398380625 learned_addr learned my addr 172.21.15.96:0/398380625 (peer_addr_for_me v2:172.21.15.96:0/0) 2024-02-19T19:16:22.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.189+0000 7fc5c659c700 1 --2- 172.21.15.96:0/398380625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5d0100750 0x7fc5d019bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:16:22.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.189+0000 7fc5ced9d700 1 -- 172.21.15.96:0/398380625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5d0100750 msgr2=0x7fc5d019bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:16:22.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.189+0000 7fc5ced9d700 1 --2- 172.21.15.96:0/398380625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5d0100750 0x7fc5d019bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:22.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.190+0000 7fc5ced9d700 1 -- 172.21.15.96:0/398380625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b80095f0 con 0x7fc5d00ffda0 2024-02-19T19:16:22.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.190+0000 7fc5ced9d700 1 --2- 172.21.15.96:0/398380625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5d00ffda0 0x7fc5d019b6b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000b4b0 tx=0x7fc5c000b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:16:22.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.190+0000 7fc5ccd99700 1 -- 172.21.15.96:0/398380625 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5c0011800 con 0x7fc5d00ffda0 2024-02-19T19:16:22.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.190+0000 7fc5ccd99700 1 -- 172.21.15.96:0/398380625 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5c0011e20 con 0x7fc5d00ffda0 2024-02-19T19:16:22.211 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.190+0000 7fc5d514a700 1 -- 172.21.15.96:0/398380625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d0195a10 con 0x7fc5d00ffda0 2024-02-19T19:16:22.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.190+0000 7fc5ccd99700 1 -- 172.21.15.96:0/398380625 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5c000f2e0 con 0x7fc5d00ffda0 2024-02-19T19:16:22.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.190+0000 7fc5d514a700 1 -- 172.21.15.96:0/398380625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d0195f60 con 0x7fc5d00ffda0 2024-02-19T19:16:22.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.191+0000 7fc5d514a700 1 -- 172.21.15.96:0/398380625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d01080d0 con 0x7fc5d00ffda0 2024-02-19T19:16:22.212 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.191+0000 7fc5ccd99700 1 -- 172.21.15.96:0/398380625 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 37) v1 ==== 91493+0+0 (secure 0 0 0) 0x7fc5c0010380 con 0x7fc5d00ffda0 2024-02-19T19:16:22.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.192+0000 7fc5ccd99700 1 --2- 172.21.15.96:0/398380625 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc5bc06d8a0 0x7fc5bc06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-19T19:16:22.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.192+0000 7fc5ccd99700 1 -- 172.21.15.96:0/398380625 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6629+0+0 (secure 0 0 0) 0x7fc5c008d080 con 0x7fc5d00ffda0 2024-02-19T19:16:22.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.192+0000 7fc5c659c700 1 --2- 172.21.15.96:0/398380625 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc5bc06d8a0 0x7fc5bc06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-19T19:16:22.213 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.192+0000 7fc5c659c700 1 --2- 172.21.15.96:0/398380625 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc5bc06d8a0 0x7fc5bc06fd60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0196ba0 tx=0x7fc5b801a040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-19T19:16:22.215 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.197+0000 7fc5ccd99700 1 -- 172.21.15.96:0/398380625 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc5c005a330 con 0x7fc5d00ffda0 2024-02-19T19:16:22.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.473+0000 7fc5d514a700 1 -- 172.21.15.96:0/398380625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc5d0196230 con 0x7fc5d00ffda0 2024-02-19T19:16:22.492 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.473+0000 7fc5ccd99700 1 -- 172.21.15.96:0/398380625 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fc5c0059ec0 con 0x7fc5d00ffda0 2024-02-19T19:16:22.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.475+0000 7fc5d514a700 1 -- 172.21.15.96:0/398380625 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc5bc06d8a0 msgr2=0x7fc5bc06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:16:22.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.475+0000 7fc5d514a700 1 --2- 172.21.15.96:0/398380625 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc5bc06d8a0 0x7fc5bc06fd60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0196ba0 tx=0x7fc5b801a040 comp rx=0 tx=0).stop 2024-02-19T19:16:22.494 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.475+0000 7fc5d514a700 1 -- 172.21.15.96:0/398380625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5d00ffda0 msgr2=0x7fc5d019b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-19T19:16:22.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.475+0000 7fc5d514a700 1 --2- 172.21.15.96:0/398380625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5d00ffda0 0x7fc5d019b6b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000b4b0 tx=0x7fc5c000b7c0 comp rx=0 tx=0).stop 2024-02-19T19:16:22.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.476+0000 7fc5d514a700 1 -- 172.21.15.96:0/398380625 shutdown_connections 2024-02-19T19:16:22.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.476+0000 7fc5d514a700 1 --2- 172.21.15.96:0/398380625 >> [v2:172.21.15.96:6800/619116925,v1:172.21.15.96:6801/619116925] conn(0x7fc5bc06d8a0 0x7fc5bc06fd60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:22.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.476+0000 7fc5d514a700 1 --2- 172.21.15.96:0/398380625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5d00ffda0 0x7fc5d019b6b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:22.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.476+0000 7fc5d514a700 1 --2- 172.21.15.96:0/398380625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5d0100750 0x7fc5d019bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-19T19:16:22.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.476+0000 7fc5d514a700 1 -- 172.21.15.96:0/398380625 >> 172.21.15.96:0/398380625 conn(0x7fc5d00fb650 msgr2=0x7fc5d00fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-19T19:16:22.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.476+0000 7fc5d514a700 1 -- 172.21.15.96:0/398380625 shutdown_connections 2024-02-19T19:16:22.495 INFO:teuthology.orchestra.run.smithi096.stderr:2024-02-19T19:16:22.476+0000 7fc5d514a700 1 -- 172.21.15.96:0/398380625 wait complete. 2024-02-19T19:16:22.504 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph version 19.0.0-1450-gf78a58c0 (f78a58c0ffd401d1493058a1022c35f011d65275) squid (dev)" 2024-02-19T19:16:22.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:22 smithi096 ceph-mon[112483]: pgmap v288: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-02-19T19:16:22.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:22 smithi125 ceph-mon[86115]: pgmap v288: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-02-19T19:16:23.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:23 smithi096 ceph-mon[112483]: from='client.? 172.21.15.96:0/398380625' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:16:23.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:23 smithi096 ceph-mon[112483]: pgmap v289: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-02-19T19:16:23.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:16:23.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:23 smithi125 ceph-mon[86115]: from='client.? 172.21.15.96:0/398380625' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-19T19:16:23.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:23 smithi125 ceph-mon[86115]: pgmap v289: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-02-19T19:16:23.950 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:16:25.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:24 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:16:25.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:24 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:16:25.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:24 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:16:25.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:24 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:16:25.285 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:24 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:16:25.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:24 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:16:25.450 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:24 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:16:25.450 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:24 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:16:25.450 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:24 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:16:25.450 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:24 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:16:26.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:25 smithi096 ceph-mon[112483]: pgmap v290: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-02-19T19:16:26.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:25 smithi125 ceph-mon[86115]: pgmap v290: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-02-19T19:16:28.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:28 smithi096 ceph-mon[112483]: pgmap v291: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-02-19T19:16:28.786 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:28 smithi125 ceph-mon[86115]: pgmap v291: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-02-19T19:16:30.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:30 smithi096 ceph-mon[112483]: pgmap v292: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-02-19T19:16:30.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:30 smithi125 ceph-mon[86115]: pgmap v292: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 4 op/s 2024-02-19T19:16:32.785 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:32 smithi096 ceph-mon[112483]: pgmap v293: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:16:32.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:32 smithi125 ceph-mon[86115]: pgmap v293: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:16:34.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:34 smithi096 ceph-mon[112483]: pgmap v294: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:16:34.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:34 smithi125 ceph-mon[86115]: pgmap v294: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:16:35.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:16:35.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:16:36.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:36 smithi096 ceph-mon[112483]: pgmap v295: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:16:36.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:36 smithi125 ceph-mon[86115]: pgmap v295: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:16:38.284 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:37 smithi096 ceph-mon[112483]: pgmap v296: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:16:38.449 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:37 smithi125 ceph-mon[86115]: pgmap v296: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:16:40.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:40 smithi096 ceph-mon[112483]: pgmap v297: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:16:40.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:40 smithi125 ceph-mon[86115]: pgmap v297: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:16:42.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:42 smithi096 ceph-mon[112483]: pgmap v298: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:16:42.949 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:42 smithi125 ceph-mon[86115]: pgmap v298: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:16:44.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:44 smithi096 ceph-mon[112483]: pgmap v299: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-19T19:16:44.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:44 smithi125 ceph-mon[86115]: pgmap v299: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-19T19:16:46.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:46 smithi096 ceph-mon[112483]: pgmap v300: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:16:46.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:46 smithi125 ceph-mon[86115]: pgmap v300: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:16:48.751 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:48 smithi125 ceph-mon[86115]: pgmap v301: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:16:48.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:48 smithi096 ceph-mon[112483]: pgmap v301: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:16:50.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:50 smithi096 ceph-mon[112483]: pgmap v302: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:16:50.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:16:50.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:50 smithi125 ceph-mon[86115]: pgmap v302: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:16:50.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:16:52.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:52 smithi096 ceph-mon[112483]: pgmap v303: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:16:52.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:52 smithi125 ceph-mon[86115]: pgmap v303: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:16:54.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:54 smithi096 ceph-mon[112483]: pgmap v304: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:16:54.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:54 smithi125 ceph-mon[86115]: pgmap v304: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:16:55.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:55 smithi096 ceph-mon[112483]: pgmap v305: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:16:55.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:55 smithi125 ceph-mon[86115]: pgmap v305: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:16:58.736 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:16:58 smithi096 ceph-mon[112483]: pgmap v306: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:16:58.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:16:58 smithi125 ceph-mon[86115]: pgmap v306: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:00.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:00 smithi096 ceph-mon[112483]: pgmap v307: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:00.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:00 smithi125 ceph-mon[86115]: pgmap v307: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:02.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:02 smithi096 ceph-mon[112483]: pgmap v308: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:02.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:02 smithi125 ceph-mon[86115]: pgmap v308: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:04.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:04 smithi096 ceph-mon[112483]: pgmap v309: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:17:04.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:04 smithi125 ceph-mon[86115]: pgmap v309: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:17:05.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:17:05.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:17:06.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:06 smithi096 ceph-mon[112483]: pgmap v310: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:06.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:06 smithi125 ceph-mon[86115]: pgmap v310: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:07.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:07 smithi125 ceph-mon[86115]: pgmap v311: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:08.033 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:07 smithi096 ceph-mon[112483]: pgmap v311: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:10.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:10 smithi096 ceph-mon[112483]: pgmap v312: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:10.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:10 smithi125 ceph-mon[86115]: pgmap v312: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:12.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:12 smithi096 ceph-mon[112483]: pgmap v313: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:12.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:12 smithi125 ceph-mon[86115]: pgmap v313: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:14.698 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:14 smithi125 ceph-mon[86115]: pgmap v314: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:17:14.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:14 smithi096 ceph-mon[112483]: pgmap v314: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:17:16.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:16 smithi096 ceph-mon[112483]: pgmap v315: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:16.947 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:16 smithi125 ceph-mon[86115]: pgmap v315: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:18.750 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:18 smithi125 ceph-mon[86115]: pgmap v316: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:18.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:18 smithi096 ceph-mon[112483]: pgmap v316: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:20.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:20 smithi096 ceph-mon[112483]: pgmap v317: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:20.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:17:20.947 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:20 smithi125 ceph-mon[86115]: pgmap v317: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:20.947 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:17:21.794 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:21 smithi096 ceph-mon[112483]: pgmap v318: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:21.947 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:21 smithi125 ceph-mon[86115]: pgmap v318: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:24.697 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:24 smithi125 ceph-mon[86115]: pgmap v319: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:17:24.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:24 smithi096 ceph-mon[112483]: pgmap v319: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:17:25.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:25 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:17:25.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:25 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:17:25.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:25 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:17:25.783 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:25 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:17:25.947 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:25 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:17:25.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:25 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:17:25.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:25 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:17:25.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:25 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:17:26.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:26 smithi096 ceph-mon[112483]: pgmap v320: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:26.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:26 smithi125 ceph-mon[86115]: pgmap v320: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:28.784 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:28 smithi096 ceph-mon[112483]: pgmap v321: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:28.947 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:28 smithi125 ceph-mon[86115]: pgmap v321: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:30.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:30 smithi096 ceph-mon[112483]: pgmap v322: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:30.947 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:30 smithi125 ceph-mon[86115]: pgmap v322: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:32.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:32 smithi096 ceph-mon[112483]: pgmap v323: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:32.947 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:32 smithi125 ceph-mon[86115]: pgmap v323: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:34.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:34 smithi096 ceph-mon[112483]: pgmap v324: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:17:34.947 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:34 smithi125 ceph-mon[86115]: pgmap v324: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:17:35.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:17:35.947 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:17:36.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:36 smithi096 ceph-mon[112483]: pgmap v325: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:36.947 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:36 smithi125 ceph-mon[86115]: pgmap v325: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:37.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:37 smithi096 ceph-mon[112483]: pgmap v326: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:37.947 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:37 smithi125 ceph-mon[86115]: pgmap v326: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:40.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:40 smithi096 ceph-mon[112483]: pgmap v327: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:40.947 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:40 smithi125 ceph-mon[86115]: pgmap v327: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:42.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:42 smithi096 ceph-mon[112483]: pgmap v328: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:42.946 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:42 smithi125 ceph-mon[86115]: pgmap v328: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:44.532 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:44 smithi096 ceph-mon[112483]: pgmap v329: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:17:44.946 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:44 smithi125 ceph-mon[86115]: pgmap v329: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:17:46.782 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:46 smithi096 ceph-mon[112483]: pgmap v330: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:46.946 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:46 smithi125 ceph-mon[86115]: pgmap v330: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:48.749 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:48 smithi125 ceph-mon[86115]: pgmap v331: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:48.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:48 smithi096 ceph-mon[112483]: pgmap v331: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:49.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:49 smithi096 ceph-mon[112483]: pgmap v332: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:49.947 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:49 smithi125 ceph-mon[86115]: pgmap v332: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:50.947 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:17:51.031 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:17:51.946 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:51 smithi125 ceph-mon[86115]: pgmap v333: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:52.031 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:51 smithi096 ceph-mon[112483]: pgmap v333: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:54.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:54 smithi096 ceph-mon[112483]: pgmap v334: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:17:54.946 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:54 smithi125 ceph-mon[86115]: pgmap v334: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:17:56.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:56 smithi096 ceph-mon[112483]: pgmap v335: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:56.946 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:56 smithi125 ceph-mon[86115]: pgmap v335: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:17:58.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:17:58 smithi096 ceph-mon[112483]: pgmap v336: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:17:58.946 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:17:58 smithi125 ceph-mon[86115]: pgmap v336: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:00.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:00 smithi096 ceph-mon[112483]: pgmap v337: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:00.946 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:00 smithi125 ceph-mon[86115]: pgmap v337: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:02.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:02 smithi096 ceph-mon[112483]: pgmap v338: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:02.946 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:02 smithi125 ceph-mon[86115]: pgmap v338: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:03.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:03 smithi096 ceph-mon[112483]: pgmap v339: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:18:03.946 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:03 smithi125 ceph-mon[86115]: pgmap v339: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:18:05.696 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:18:05.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:18:06.696 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:06 smithi125 ceph-mon[86115]: pgmap v340: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:06.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:06 smithi096 ceph-mon[112483]: pgmap v340: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:08.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:08 smithi096 ceph-mon[112483]: pgmap v341: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:08.946 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:08 smithi125 ceph-mon[86115]: pgmap v341: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:10.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:10 smithi096 ceph-mon[112483]: pgmap v342: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:10.946 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:10 smithi125 ceph-mon[86115]: pgmap v342: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:12.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:12 smithi096 ceph-mon[112483]: pgmap v343: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:12.946 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:12 smithi125 ceph-mon[86115]: pgmap v343: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:14.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:14 smithi096 ceph-mon[112483]: pgmap v344: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:18:14.946 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:14 smithi125 ceph-mon[86115]: pgmap v344: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:18:15.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:15 smithi096 ceph-mon[112483]: pgmap v345: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:15.946 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:15 smithi125 ceph-mon[86115]: pgmap v345: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:18.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:18 smithi096 ceph-mon[112483]: pgmap v346: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:18.946 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:18 smithi125 ceph-mon[86115]: pgmap v346: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:20.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:20 smithi096 ceph-mon[112483]: pgmap v347: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:20.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:18:20.946 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:20 smithi125 ceph-mon[86115]: pgmap v347: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:20.946 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:18:22.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:22 smithi096 ceph-mon[112483]: pgmap v348: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:22.947 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:22 smithi125 ceph-mon[86115]: pgmap v348: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:24.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:24 smithi096 ceph-mon[112483]: pgmap v349: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:18:24.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:24 smithi125 ceph-mon[86115]: pgmap v349: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:18:25.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:25 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:18:25.781 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:25 smithi096 ceph-mon[112483]: pgmap v350: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:25.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:25 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:18:25.946 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:25 smithi125 ceph-mon[86115]: pgmap v350: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:27.195 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:26 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:18:27.196 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:26 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:18:27.196 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:26 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:18:27.196 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:26 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:18:27.196 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:26 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:18:27.281 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:26 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:18:27.281 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:26 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:18:27.281 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:26 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:18:27.281 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:26 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:18:27.281 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:26 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:18:28.280 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:27 smithi096 ceph-mon[112483]: pgmap v351: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:28.445 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:27 smithi125 ceph-mon[86115]: pgmap v351: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:30.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:30 smithi096 ceph-mon[112483]: pgmap v352: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:30.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:30 smithi125 ceph-mon[86115]: pgmap v352: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:32.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:32 smithi096 ceph-mon[112483]: pgmap v353: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:32.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:32 smithi125 ceph-mon[86115]: pgmap v353: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:34.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:34 smithi096 ceph-mon[112483]: pgmap v354: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:18:34.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:34 smithi125 ceph-mon[86115]: pgmap v354: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:18:35.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:18:35.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:18:36.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:36 smithi096 ceph-mon[112483]: pgmap v355: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:36.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:36 smithi125 ceph-mon[86115]: pgmap v355: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:38.280 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:38 smithi096 ceph-mon[112483]: pgmap v356: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:38.445 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:38 smithi125 ceph-mon[86115]: pgmap v356: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:40.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:40 smithi096 ceph-mon[112483]: pgmap v357: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:40.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:40 smithi125 ceph-mon[86115]: pgmap v357: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:42.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:42 smithi096 ceph-mon[112483]: pgmap v358: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:42.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:42 smithi125 ceph-mon[86115]: pgmap v358: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:43.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:43 smithi125 ceph-mon[86115]: pgmap v359: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:18:44.030 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:43 smithi096 ceph-mon[112483]: pgmap v359: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:18:46.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:46 smithi096 ceph-mon[112483]: pgmap v360: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:46.946 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:46 smithi125 ceph-mon[86115]: pgmap v360: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:48.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:48 smithi096 ceph-mon[112483]: pgmap v361: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:48.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:48 smithi125 ceph-mon[86115]: pgmap v361: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:49.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:49 smithi125 ceph-mon[86115]: pgmap v362: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:49.969 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:49 smithi096 ceph-mon[112483]: pgmap v362: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:50.695 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:18:51.030 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:18:51.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:51 smithi125 ceph-mon[86115]: pgmap v363: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:52.030 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:51 smithi096 ceph-mon[112483]: pgmap v363: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:54.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:54 smithi096 ceph-mon[112483]: pgmap v364: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:18:54.944 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:54 smithi125 ceph-mon[86115]: pgmap v364: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:18:56.780 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:56 smithi096 ceph-mon[112483]: pgmap v365: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:56.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:56 smithi125 ceph-mon[86115]: pgmap v365: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:18:57.945 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:18:57 smithi125 ceph-mon[86115]: pgmap v366: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:18:58.029 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:18:57 smithi096 ceph-mon[112483]: pgmap v366: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:00.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:00 smithi096 ceph-mon[112483]: pgmap v367: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:00.944 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:00 smithi125 ceph-mon[86115]: pgmap v367: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:02.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:02 smithi096 ceph-mon[112483]: pgmap v368: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:02.944 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:02 smithi125 ceph-mon[86115]: pgmap v368: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:03.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:03 smithi096 ceph-mon[112483]: pgmap v369: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:19:03.944 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:03 smithi125 ceph-mon[86115]: pgmap v369: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:19:05.694 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:19:05.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:19:06.694 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:06 smithi125 ceph-mon[86115]: pgmap v370: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:06.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:06 smithi096 ceph-mon[112483]: pgmap v370: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:08.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:08 smithi096 ceph-mon[112483]: pgmap v371: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:08.944 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:08 smithi125 ceph-mon[86115]: pgmap v371: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:09.948 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:09 smithi125 ceph-mon[86115]: pgmap v372: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:10.029 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:09 smithi096 ceph-mon[112483]: pgmap v372: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:12.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:12 smithi096 ceph-mon[112483]: pgmap v373: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:12.944 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:12 smithi125 ceph-mon[86115]: pgmap v373: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:13.944 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:13 smithi125 ceph-mon[86115]: pgmap v374: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:19:14.029 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:13 smithi096 ceph-mon[112483]: pgmap v374: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:19:16.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:16 smithi096 ceph-mon[112483]: pgmap v375: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:16.944 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:16 smithi125 ceph-mon[86115]: pgmap v375: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:17.944 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:17 smithi125 ceph-mon[86115]: pgmap v376: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:18.029 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:17 smithi096 ceph-mon[112483]: pgmap v376: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:20.732 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:20 smithi096 ceph-mon[112483]: pgmap v377: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:20.733 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:19:20.944 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:20 smithi125 ceph-mon[86115]: pgmap v377: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:20.944 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:19:21.944 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:21 smithi125 ceph-mon[86115]: pgmap v378: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:22.029 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:21 smithi096 ceph-mon[112483]: pgmap v378: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:24.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:24 smithi096 ceph-mon[112483]: pgmap v379: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:19:24.944 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:24 smithi125 ceph-mon[86115]: pgmap v379: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:19:25.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:25 smithi096 ceph-mon[112483]: pgmap v380: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:25.944 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:25 smithi125 ceph-mon[86115]: pgmap v380: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:27.029 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:26 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:19:27.194 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:26 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:19:28.029 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:27 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:19:28.029 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:27 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:19:28.030 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:27 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:19:28.030 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:27 smithi096 ceph-mon[112483]: pgmap v381: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:28.194 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:27 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:19:28.194 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:27 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:19:28.194 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:27 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:19:28.194 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:27 smithi125 ceph-mon[86115]: pgmap v381: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:30.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:30 smithi096 ceph-mon[112483]: pgmap v382: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:30.798 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:30 smithi125 ceph-mon[86115]: pgmap v382: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:31.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:31 smithi096 ceph-mon[112483]: pgmap v383: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:31.944 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:31 smithi125 ceph-mon[86115]: pgmap v383: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:34.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:34 smithi096 ceph-mon[112483]: pgmap v384: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:19:34.943 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:34 smithi125 ceph-mon[86115]: pgmap v384: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:19:35.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:19:35.779 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:35 smithi096 ceph-mon[112483]: pgmap v385: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:35.854 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:19:35.854 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:35 smithi125 ceph-mon[86115]: pgmap v385: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:37.944 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:37 smithi125 ceph-mon[86115]: pgmap v386: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:38.029 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:37 smithi096 ceph-mon[112483]: pgmap v386: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:39.943 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:39 smithi125 ceph-mon[86115]: pgmap v387: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:40.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:39 smithi096 ceph-mon[112483]: pgmap v387: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:41.943 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:41 smithi125 ceph-mon[86115]: pgmap v388: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:42.029 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:41 smithi096 ceph-mon[112483]: pgmap v388: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:43.944 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:43 smithi125 ceph-mon[86115]: pgmap v389: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:19:44.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:43 smithi096 ceph-mon[112483]: pgmap v389: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:19:45.943 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:45 smithi125 ceph-mon[86115]: pgmap v390: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:46.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:45 smithi096 ceph-mon[112483]: pgmap v390: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:47.943 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:47 smithi125 ceph-mon[86115]: pgmap v391: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:48.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:47 smithi096 ceph-mon[112483]: pgmap v391: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:49.943 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:49 smithi125 ceph-mon[86115]: pgmap v392: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:50.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:49 smithi096 ceph-mon[112483]: pgmap v392: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:50.845 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:19:50.930 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:19:51.943 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:51 smithi125 ceph-mon[86115]: pgmap v393: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:52.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:51 smithi096 ceph-mon[112483]: pgmap v393: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:53.943 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:53 smithi125 ceph-mon[86115]: pgmap v394: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:19:54.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:53 smithi096 ceph-mon[112483]: pgmap v394: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:19:55.943 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:55 smithi125 ceph-mon[86115]: pgmap v395: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:56.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:55 smithi096 ceph-mon[112483]: pgmap v395: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:19:57.943 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:57 smithi125 ceph-mon[86115]: pgmap v396: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:58.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:57 smithi096 ceph-mon[112483]: pgmap v396: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:19:59.943 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:19:59 smithi125 ceph-mon[86115]: pgmap v397: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:00.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:19:59 smithi096 ceph-mon[112483]: pgmap v397: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:00.943 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:00 smithi125 ceph-mon[86115]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T19:20:01.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:00 smithi096 ceph-mon[112483]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T19:20:01.943 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:01 smithi125 ceph-mon[86115]: pgmap v398: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:02.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:01 smithi096 ceph-mon[112483]: pgmap v398: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:03.943 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:03 smithi125 ceph-mon[86115]: pgmap v399: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:20:04.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:03 smithi096 ceph-mon[112483]: pgmap v399: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:20:05.693 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:20:05.778 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:20:06.443 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:06 smithi125 ceph-mon[86115]: pgmap v400: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:06.778 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:06 smithi096 ceph-mon[112483]: pgmap v400: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:07.943 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:07 smithi125 ceph-mon[86115]: pgmap v401: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:08.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:07 smithi096 ceph-mon[112483]: pgmap v401: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:09.883 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:09 smithi096 ceph-mon[112483]: pgmap v402: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:09.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:09 smithi125 ceph-mon[86115]: pgmap v402: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:11.943 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:11 smithi125 ceph-mon[86115]: pgmap v403: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:12.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:11 smithi096 ceph-mon[112483]: pgmap v403: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:13.943 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:13 smithi125 ceph-mon[86115]: pgmap v404: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:20:14.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:13 smithi096 ceph-mon[112483]: pgmap v404: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:20:15.926 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:15 smithi096 ceph-mon[112483]: pgmap v405: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:15.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:15 smithi125 ceph-mon[86115]: pgmap v405: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:17.943 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:17 smithi125 ceph-mon[86115]: pgmap v406: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:18.028 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:17 smithi096 ceph-mon[112483]: pgmap v406: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:19.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:19 smithi125 ceph-mon[86115]: pgmap v407: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:20.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:19 smithi096 ceph-mon[112483]: pgmap v407: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:20.844 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:20:20.929 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:20:21.692 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:21 smithi125 ceph-mon[86115]: pgmap v408: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:22.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:21 smithi096 ceph-mon[112483]: pgmap v408: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:23.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:23 smithi125 ceph-mon[86115]: pgmap v409: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:20:24.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:23 smithi096 ceph-mon[112483]: pgmap v409: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:20:25.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:25 smithi125 ceph-mon[86115]: pgmap v410: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:26.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:25 smithi096 ceph-mon[112483]: pgmap v410: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:27.692 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:27 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:20:27.777 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:27 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:20:28.692 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:28 smithi125 ceph-mon[86115]: pgmap v411: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:28.693 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:28 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:20:28.693 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:28 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:20:28.693 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:28 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:20:28.778 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:28 smithi096 ceph-mon[112483]: pgmap v411: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:28.778 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:28 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:20:28.778 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:28 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:20:28.778 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:28 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:20:29.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:29 smithi125 ceph-mon[86115]: pgmap v412: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:30.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:29 smithi096 ceph-mon[112483]: pgmap v412: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:31.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:31 smithi125 ceph-mon[86115]: pgmap v413: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:32.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:31 smithi096 ceph-mon[112483]: pgmap v413: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:33.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:33 smithi125 ceph-mon[86115]: pgmap v414: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:20:34.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:33 smithi096 ceph-mon[112483]: pgmap v414: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:20:35.692 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:20:35.777 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:20:36.692 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:36 smithi125 ceph-mon[86115]: pgmap v415: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:36.777 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:36 smithi096 ceph-mon[112483]: pgmap v415: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:37.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:37 smithi125 ceph-mon[86115]: pgmap v416: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:38.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:37 smithi096 ceph-mon[112483]: pgmap v416: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:39.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:39 smithi125 ceph-mon[86115]: pgmap v417: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:40.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:39 smithi096 ceph-mon[112483]: pgmap v417: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:41.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:41 smithi125 ceph-mon[86115]: pgmap v418: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:42.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:41 smithi096 ceph-mon[112483]: pgmap v418: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:43.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:43 smithi125 ceph-mon[86115]: pgmap v419: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:20:44.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:43 smithi096 ceph-mon[112483]: pgmap v419: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:20:45.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:45 smithi125 ceph-mon[86115]: pgmap v420: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:46.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:45 smithi096 ceph-mon[112483]: pgmap v420: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:47.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:47 smithi125 ceph-mon[86115]: pgmap v421: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:48.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:47 smithi096 ceph-mon[112483]: pgmap v421: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:49.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:49 smithi125 ceph-mon[86115]: pgmap v422: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:50.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:49 smithi096 ceph-mon[112483]: pgmap v422: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:50.843 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:20:50.928 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:20:51.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:51 smithi125 ceph-mon[86115]: pgmap v423: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:52.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:51 smithi096 ceph-mon[112483]: pgmap v423: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:53.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:53 smithi125 ceph-mon[86115]: pgmap v424: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:20:54.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:53 smithi096 ceph-mon[112483]: pgmap v424: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:20:55.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:55 smithi125 ceph-mon[86115]: pgmap v425: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:56.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:55 smithi096 ceph-mon[112483]: pgmap v425: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:20:57.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:57 smithi125 ceph-mon[86115]: pgmap v426: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:58.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:57 smithi096 ceph-mon[112483]: pgmap v426: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:20:59.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:20:59 smithi125 ceph-mon[86115]: pgmap v427: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:00.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:20:59 smithi096 ceph-mon[112483]: pgmap v427: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:01.777 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:01 smithi096 ceph-mon[112483]: pgmap v428: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:01.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:01 smithi125 ceph-mon[86115]: pgmap v428: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:03.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:03 smithi125 ceph-mon[86115]: pgmap v429: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:21:04.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:03 smithi096 ceph-mon[112483]: pgmap v429: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:21:05.692 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:21:05.777 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:21:06.691 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:06 smithi125 ceph-mon[86115]: pgmap v430: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:06.777 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:06 smithi096 ceph-mon[112483]: pgmap v430: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:07.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:07 smithi125 ceph-mon[86115]: pgmap v431: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:08.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:07 smithi096 ceph-mon[112483]: pgmap v431: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:09.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:09 smithi125 ceph-mon[86115]: pgmap v432: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:10.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:09 smithi096 ceph-mon[112483]: pgmap v432: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:11.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:11 smithi125 ceph-mon[86115]: pgmap v433: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:12.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:11 smithi096 ceph-mon[112483]: pgmap v433: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:13.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:13 smithi125 ceph-mon[86115]: pgmap v434: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:21:14.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:13 smithi096 ceph-mon[112483]: pgmap v434: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:21:15.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:15 smithi125 ceph-mon[86115]: pgmap v435: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:16.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:15 smithi096 ceph-mon[112483]: pgmap v435: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:17.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:17 smithi125 ceph-mon[86115]: pgmap v436: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:18.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:17 smithi096 ceph-mon[112483]: pgmap v436: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:19.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:19 smithi125 ceph-mon[86115]: pgmap v437: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:20.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:19 smithi096 ceph-mon[112483]: pgmap v437: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:20.843 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:21:20.927 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:21:21.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:21 smithi125 ceph-mon[86115]: pgmap v438: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:22.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:21 smithi096 ceph-mon[112483]: pgmap v438: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:23.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:23 smithi125 ceph-mon[86115]: pgmap v439: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:21:24.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:23 smithi096 ceph-mon[112483]: pgmap v439: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:21:25.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:25 smithi125 ceph-mon[86115]: pgmap v440: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:26.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:25 smithi096 ceph-mon[112483]: pgmap v440: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:27.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:27 smithi125 ceph-mon[86115]: pgmap v441: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:28.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:27 smithi096 ceph-mon[112483]: pgmap v441: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:28.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:28 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:21:29.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:28 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:21:29.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:29 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:21:29.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:29 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:21:29.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:29 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:21:29.942 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:29 smithi125 ceph-mon[86115]: pgmap v442: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:30.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:29 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:21:30.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:29 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:21:30.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:29 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:21:30.027 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:29 smithi096 ceph-mon[112483]: pgmap v442: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:31.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:31 smithi125 ceph-mon[86115]: pgmap v443: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:32.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:31 smithi096 ceph-mon[112483]: pgmap v443: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:33.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:33 smithi125 ceph-mon[86115]: pgmap v444: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:21:34.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:33 smithi096 ceph-mon[112483]: pgmap v444: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:21:35.691 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:21:35.776 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:21:36.691 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:36 smithi125 ceph-mon[86115]: pgmap v445: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:36.776 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:36 smithi096 ceph-mon[112483]: pgmap v445: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:38.441 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:38 smithi125 ceph-mon[86115]: pgmap v446: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:38.526 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:38 smithi096 ceph-mon[112483]: pgmap v446: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:39.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:39 smithi125 ceph-mon[86115]: pgmap v447: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:40.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:39 smithi096 ceph-mon[112483]: pgmap v447: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:41.887 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:41 smithi096 ceph-mon[112483]: pgmap v448: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:41.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:41 smithi125 ceph-mon[86115]: pgmap v448: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:43.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:43 smithi125 ceph-mon[86115]: pgmap v449: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:21:44.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:43 smithi096 ceph-mon[112483]: pgmap v449: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:21:45.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:45 smithi125 ceph-mon[86115]: pgmap v450: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:46.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:45 smithi096 ceph-mon[112483]: pgmap v450: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:47.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:47 smithi125 ceph-mon[86115]: pgmap v451: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:48.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:47 smithi096 ceph-mon[112483]: pgmap v451: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:49.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:49 smithi125 ceph-mon[86115]: pgmap v452: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:50.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:49 smithi096 ceph-mon[112483]: pgmap v452: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:50.842 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:21:50.927 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:21:51.941 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:51 smithi125 ceph-mon[86115]: pgmap v453: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:51.999 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:51 smithi096 ceph-mon[112483]: pgmap v453: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:53.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:53 smithi125 ceph-mon[86115]: pgmap v454: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:21:54.026 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:53 smithi096 ceph-mon[112483]: pgmap v454: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:21:55.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:55 smithi125 ceph-mon[86115]: pgmap v455: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:56.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:55 smithi096 ceph-mon[112483]: pgmap v455: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:21:57.690 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:57 smithi125 ceph-mon[86115]: pgmap v456: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:58.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:57 smithi096 ceph-mon[112483]: pgmap v456: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:21:59.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:21:59 smithi125 ceph-mon[86115]: pgmap v457: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:00.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:21:59 smithi096 ceph-mon[112483]: pgmap v457: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:01.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:01 smithi125 ceph-mon[86115]: pgmap v458: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:02.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:01 smithi096 ceph-mon[112483]: pgmap v458: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:03.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:03 smithi125 ceph-mon[86115]: pgmap v459: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:22:04.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:03 smithi096 ceph-mon[112483]: pgmap v459: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:22:05.690 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:22:05.775 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:22:06.690 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:06 smithi125 ceph-mon[86115]: pgmap v460: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:06.775 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:06 smithi096 ceph-mon[112483]: pgmap v460: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:07.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:07 smithi125 ceph-mon[86115]: pgmap v461: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:08.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:07 smithi096 ceph-mon[112483]: pgmap v461: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:09.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:09 smithi125 ceph-mon[86115]: pgmap v462: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:10.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:09 smithi096 ceph-mon[112483]: pgmap v462: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:11.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:11 smithi125 ceph-mon[86115]: pgmap v463: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:12.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:11 smithi096 ceph-mon[112483]: pgmap v463: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:13.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:13 smithi125 ceph-mon[86115]: pgmap v464: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:22:14.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:13 smithi096 ceph-mon[112483]: pgmap v464: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:22:15.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:15 smithi125 ceph-mon[86115]: pgmap v465: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:16.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:15 smithi096 ceph-mon[112483]: pgmap v465: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:17.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:17 smithi125 ceph-mon[86115]: pgmap v466: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:18.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:17 smithi096 ceph-mon[112483]: pgmap v466: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:19.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:19 smithi125 ceph-mon[86115]: pgmap v467: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:20.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:19 smithi096 ceph-mon[112483]: pgmap v467: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:20.841 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:22:20.926 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:22:21.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:21 smithi125 ceph-mon[86115]: pgmap v468: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:22.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:21 smithi096 ceph-mon[112483]: pgmap v468: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:23.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:23 smithi125 ceph-mon[86115]: pgmap v469: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:22:24.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:23 smithi096 ceph-mon[112483]: pgmap v469: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:22:25.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:25 smithi125 ceph-mon[86115]: pgmap v470: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:26.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:25 smithi096 ceph-mon[112483]: pgmap v470: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:27.775 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:27 smithi096 ceph-mon[112483]: pgmap v471: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:27.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:27 smithi125 ceph-mon[86115]: pgmap v471: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:29.190 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:28 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:22:29.275 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:28 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:22:30.190 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:29 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:22:30.190 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:29 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:22:30.190 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:29 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:22:30.191 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:29 smithi125 ceph-mon[86115]: pgmap v472: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:30.275 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:29 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:22:30.275 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:29 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:22:30.275 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:29 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:22:30.275 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:29 smithi096 ceph-mon[112483]: pgmap v472: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:31.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:31 smithi125 ceph-mon[86115]: pgmap v473: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:32.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:31 smithi096 ceph-mon[112483]: pgmap v473: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:33.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:33 smithi125 ceph-mon[86115]: pgmap v474: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:22:34.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:33 smithi096 ceph-mon[112483]: pgmap v474: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:22:35.690 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:22:35.775 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:22:36.690 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:36 smithi125 ceph-mon[86115]: pgmap v475: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:36.775 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:36 smithi096 ceph-mon[112483]: pgmap v475: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:38.190 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:38 smithi125 ceph-mon[86115]: pgmap v476: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:38.525 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:38 smithi096 ceph-mon[112483]: pgmap v476: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:39.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:39 smithi125 ceph-mon[86115]: pgmap v477: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:40.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:39 smithi096 ceph-mon[112483]: pgmap v477: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:41.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:41 smithi125 ceph-mon[86115]: pgmap v478: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:42.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:41 smithi096 ceph-mon[112483]: pgmap v478: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:43.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:43 smithi125 ceph-mon[86115]: pgmap v479: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:22:44.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:43 smithi096 ceph-mon[112483]: pgmap v479: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:22:45.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:45 smithi125 ceph-mon[86115]: pgmap v480: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:46.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:45 smithi096 ceph-mon[112483]: pgmap v480: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:47.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:47 smithi125 ceph-mon[86115]: pgmap v481: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:48.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:47 smithi096 ceph-mon[112483]: pgmap v481: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:49.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:49 smithi125 ceph-mon[86115]: pgmap v482: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:50.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:49 smithi096 ceph-mon[112483]: pgmap v482: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:50.841 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:22:50.926 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:22:51.940 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:51 smithi125 ceph-mon[86115]: pgmap v483: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:52.025 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:51 smithi096 ceph-mon[112483]: pgmap v483: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:53.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:53 smithi125 ceph-mon[86115]: pgmap v484: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:22:54.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:53 smithi096 ceph-mon[112483]: pgmap v484: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:22:55.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:55 smithi125 ceph-mon[86115]: pgmap v485: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:56.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:55 smithi096 ceph-mon[112483]: pgmap v485: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:22:57.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:57 smithi125 ceph-mon[86115]: pgmap v486: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:58.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:57 smithi096 ceph-mon[112483]: pgmap v486: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:22:59.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:22:59 smithi125 ceph-mon[86115]: pgmap v487: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:00.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:22:59 smithi096 ceph-mon[112483]: pgmap v487: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:01.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:01 smithi125 ceph-mon[86115]: pgmap v488: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:02.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:01 smithi096 ceph-mon[112483]: pgmap v488: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:03.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:03 smithi125 ceph-mon[86115]: pgmap v489: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:23:04.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:03 smithi096 ceph-mon[112483]: pgmap v489: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:23:05.689 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:23:05.774 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:23:06.689 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:06 smithi125 ceph-mon[86115]: pgmap v490: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:06.775 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:06 smithi096 ceph-mon[112483]: pgmap v490: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:07.844 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:07 smithi096 ceph-mon[112483]: pgmap v491: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:07.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:07 smithi125 ceph-mon[86115]: pgmap v491: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:09.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:09 smithi125 ceph-mon[86115]: pgmap v492: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:10.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:09 smithi096 ceph-mon[112483]: pgmap v492: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:11.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:11 smithi125 ceph-mon[86115]: pgmap v493: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:12.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:11 smithi096 ceph-mon[112483]: pgmap v493: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:13.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:13 smithi125 ceph-mon[86115]: pgmap v494: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:23:14.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:13 smithi096 ceph-mon[112483]: pgmap v494: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:23:15.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:15 smithi125 ceph-mon[86115]: pgmap v495: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:16.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:15 smithi096 ceph-mon[112483]: pgmap v495: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:17.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:17 smithi125 ceph-mon[86115]: pgmap v496: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:17.957 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:17 smithi096 ceph-mon[112483]: pgmap v496: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:19.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:19 smithi125 ceph-mon[86115]: pgmap v497: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:20.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:19 smithi096 ceph-mon[112483]: pgmap v497: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:20.840 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:23:21.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:23:21.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:21 smithi125 ceph-mon[86115]: pgmap v498: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:22.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:21 smithi096 ceph-mon[112483]: pgmap v498: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:23.689 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:23 smithi125 ceph-mon[86115]: pgmap v499: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:23:24.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:23 smithi096 ceph-mon[112483]: pgmap v499: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:23:25.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:25 smithi125 ceph-mon[86115]: pgmap v500: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:26.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:25 smithi096 ceph-mon[112483]: pgmap v500: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:27.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:27 smithi125 ceph-mon[86115]: pgmap v501: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:28.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:27 smithi096 ceph-mon[112483]: pgmap v501: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:29.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:29 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:23:30.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:29 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:23:30.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:30 smithi125 ceph-mon[86115]: pgmap v502: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:30.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:30 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:23:30.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:30 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:23:30.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:30 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:23:31.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:30 smithi096 ceph-mon[112483]: pgmap v502: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:31.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:30 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:23:31.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:30 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:23:31.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:30 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:23:32.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:32 smithi125 ceph-mon[86115]: pgmap v503: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:33.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:32 smithi096 ceph-mon[112483]: pgmap v503: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:34.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:34 smithi125 ceph-mon[86115]: pgmap v504: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:23:35.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:34 smithi096 ceph-mon[112483]: pgmap v504: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:23:35.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:23:36.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:23:36.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:36 smithi125 ceph-mon[86115]: pgmap v505: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:37.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:36 smithi096 ceph-mon[112483]: pgmap v505: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:38.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:38 smithi125 ceph-mon[86115]: pgmap v506: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:39.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:38 smithi096 ceph-mon[112483]: pgmap v506: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:39.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:39 smithi125 ceph-mon[86115]: pgmap v507: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:40.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:39 smithi096 ceph-mon[112483]: pgmap v507: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:41.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:41 smithi125 ceph-mon[86115]: pgmap v508: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:42.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:41 smithi096 ceph-mon[112483]: pgmap v508: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:43.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:43 smithi125 ceph-mon[86115]: pgmap v509: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:23:44.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:43 smithi096 ceph-mon[112483]: pgmap v509: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:23:45.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:45 smithi125 ceph-mon[86115]: pgmap v510: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:46.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:45 smithi096 ceph-mon[112483]: pgmap v510: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:47.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:47 smithi125 ceph-mon[86115]: pgmap v511: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:48.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:47 smithi096 ceph-mon[112483]: pgmap v511: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:49.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:49 smithi125 ceph-mon[86115]: pgmap v512: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:50.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:49 smithi096 ceph-mon[112483]: pgmap v512: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:50.925 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:23:50.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:23:51.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:51 smithi125 ceph-mon[86115]: pgmap v513: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:52.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:51 smithi096 ceph-mon[112483]: pgmap v513: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:53.774 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:53 smithi096 ceph-mon[112483]: pgmap v514: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:23:53.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:53 smithi125 ceph-mon[86115]: pgmap v514: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:23:55.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:55 smithi125 ceph-mon[86115]: pgmap v515: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:56.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:55 smithi096 ceph-mon[112483]: pgmap v515: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:23:57.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:57 smithi125 ceph-mon[86115]: pgmap v516: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:58.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:57 smithi096 ceph-mon[112483]: pgmap v516: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:23:59.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:23:59 smithi125 ceph-mon[86115]: pgmap v517: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:00.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:23:59 smithi096 ceph-mon[112483]: pgmap v517: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:01.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:01 smithi125 ceph-mon[86115]: pgmap v518: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:02.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:01 smithi096 ceph-mon[112483]: pgmap v518: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:03.774 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:03 smithi096 ceph-mon[112483]: pgmap v519: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:24:03.850 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:03 smithi125 ceph-mon[86115]: pgmap v519: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:24:05.688 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:24:05.773 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:24:06.688 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:06 smithi125 ceph-mon[86115]: pgmap v520: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:06.773 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:06 smithi096 ceph-mon[112483]: pgmap v520: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:07.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:07 smithi125 ceph-mon[86115]: pgmap v521: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:08.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:07 smithi096 ceph-mon[112483]: pgmap v521: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:09.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:09 smithi125 ceph-mon[86115]: pgmap v522: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:10.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:09 smithi096 ceph-mon[112483]: pgmap v522: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:11.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:11 smithi125 ceph-mon[86115]: pgmap v523: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:12.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:11 smithi096 ceph-mon[112483]: pgmap v523: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:13.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:13 smithi125 ceph-mon[86115]: pgmap v524: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:24:14.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:13 smithi096 ceph-mon[112483]: pgmap v524: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:24:15.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:15 smithi125 ceph-mon[86115]: pgmap v525: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:16.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:15 smithi096 ceph-mon[112483]: pgmap v525: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:17.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:17 smithi125 ceph-mon[86115]: pgmap v526: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:18.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:17 smithi096 ceph-mon[112483]: pgmap v526: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:19.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:19 smithi125 ceph-mon[86115]: pgmap v527: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:20.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:19 smithi096 ceph-mon[112483]: pgmap v527: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:20.925 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:24:20.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:24:21.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:21 smithi125 ceph-mon[86115]: pgmap v528: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:22.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:21 smithi096 ceph-mon[112483]: pgmap v528: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:23.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:23 smithi125 ceph-mon[86115]: pgmap v529: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:24:24.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:23 smithi096 ceph-mon[112483]: pgmap v529: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:24:25.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:25 smithi125 ceph-mon[86115]: pgmap v530: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:26.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:25 smithi096 ceph-mon[112483]: pgmap v530: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:27.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:27 smithi125 ceph-mon[86115]: pgmap v531: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:28.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:27 smithi096 ceph-mon[112483]: pgmap v531: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:29.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:29 smithi125 ceph-mon[86115]: pgmap v532: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:30.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:29 smithi096 ceph-mon[112483]: pgmap v532: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:30.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:30 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:24:30.996 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:30 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:24:31.861 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:31 smithi125 ceph-mon[86115]: pgmap v533: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:31.882 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:31 smithi096 ceph-mon[112483]: pgmap v533: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:33.688 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:33 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:24:33.688 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:33 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:24:33.773 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:33 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:24:33.773 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:33 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:24:34.523 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:34 smithi096 ceph-mon[112483]: pgmap v534: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:24:34.688 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:34 smithi125 ceph-mon[86115]: pgmap v534: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:24:36.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:24:36.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:24:36.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:24:36.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:24:36.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:24:36.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:24:36.024 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:35 smithi096 ceph-mon[112483]: pgmap v535: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:36.188 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:24:36.188 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:24:36.188 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:24:36.189 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:24:36.189 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:24:36.189 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:24:36.189 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:35 smithi125 ceph-mon[86115]: pgmap v535: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:37.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:37 smithi125 ceph-mon[86115]: pgmap v536: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:38.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:37 smithi096 ceph-mon[112483]: pgmap v536: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:39.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:39 smithi125 ceph-mon[86115]: pgmap v537: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:40.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:39 smithi096 ceph-mon[112483]: pgmap v537: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:41.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:41 smithi125 ceph-mon[86115]: pgmap v538: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:42.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:41 smithi096 ceph-mon[112483]: pgmap v538: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:43.927 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:43 smithi096 ceph-mon[112483]: pgmap v539: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:24:43.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:43 smithi125 ceph-mon[86115]: pgmap v539: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:24:45.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:45 smithi125 ceph-mon[86115]: pgmap v540: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:46.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:45 smithi096 ceph-mon[112483]: pgmap v540: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:47.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:47 smithi125 ceph-mon[86115]: pgmap v541: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:48.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:47 smithi096 ceph-mon[112483]: pgmap v541: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:49.688 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:49 smithi125 ceph-mon[86115]: pgmap v542: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:50.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:49 smithi096 ceph-mon[112483]: pgmap v542: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:50.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:24:51.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:24:51.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:51 smithi125 ceph-mon[86115]: pgmap v543: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:52.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:51 smithi096 ceph-mon[112483]: pgmap v543: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:53.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:53 smithi125 ceph-mon[86115]: pgmap v544: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:24:54.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:53 smithi096 ceph-mon[112483]: pgmap v544: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:24:55.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:55 smithi125 ceph-mon[86115]: pgmap v545: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:56.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:55 smithi096 ceph-mon[112483]: pgmap v545: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:24:57.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:57 smithi125 ceph-mon[86115]: pgmap v546: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:58.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:57 smithi096 ceph-mon[112483]: pgmap v546: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:24:59.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:24:59 smithi125 ceph-mon[86115]: pgmap v547: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:00.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:24:59 smithi096 ceph-mon[112483]: pgmap v547: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:01.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:01 smithi125 ceph-mon[86115]: pgmap v548: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:02.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:01 smithi096 ceph-mon[112483]: pgmap v548: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:03.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:03 smithi125 ceph-mon[86115]: pgmap v549: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:25:04.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:03 smithi096 ceph-mon[112483]: pgmap v549: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:25:05.688 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:25:05.773 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:25:06.687 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:06 smithi125 ceph-mon[86115]: pgmap v550: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:06.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:06 smithi096 ceph-mon[112483]: pgmap v550: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:07.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:07 smithi125 ceph-mon[86115]: pgmap v551: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:08.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:07 smithi096 ceph-mon[112483]: pgmap v551: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:09.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:09 smithi125 ceph-mon[86115]: pgmap v552: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:10.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:09 smithi096 ceph-mon[112483]: pgmap v552: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:11.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:11 smithi125 ceph-mon[86115]: pgmap v553: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:12.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:11 smithi096 ceph-mon[112483]: pgmap v553: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:13.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:13 smithi125 ceph-mon[86115]: pgmap v554: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:25:14.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:13 smithi096 ceph-mon[112483]: pgmap v554: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:25:15.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:15 smithi125 ceph-mon[86115]: pgmap v555: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:16.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:15 smithi096 ceph-mon[112483]: pgmap v555: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:17.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:17 smithi125 ceph-mon[86115]: pgmap v556: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:18.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:17 smithi096 ceph-mon[112483]: pgmap v556: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:19.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:19 smithi125 ceph-mon[86115]: pgmap v557: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:20.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:19 smithi096 ceph-mon[112483]: pgmap v557: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:20.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:25:21.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:25:21.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:21 smithi125 ceph-mon[86115]: pgmap v558: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:22.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:21 smithi096 ceph-mon[112483]: pgmap v558: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:23.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:23 smithi125 ceph-mon[86115]: pgmap v559: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:25:24.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:23 smithi096 ceph-mon[112483]: pgmap v559: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:25:25.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:25 smithi125 ceph-mon[86115]: pgmap v560: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:26.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:25 smithi096 ceph-mon[112483]: pgmap v560: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:27.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:27 smithi125 ceph-mon[86115]: pgmap v561: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:28.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:27 smithi096 ceph-mon[112483]: pgmap v561: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:29.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:29 smithi096 ceph-mon[112483]: pgmap v562: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:29.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:29 smithi125 ceph-mon[86115]: pgmap v562: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:31.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:31 smithi125 ceph-mon[86115]: pgmap v563: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:32.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:31 smithi096 ceph-mon[112483]: pgmap v563: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:33.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:33 smithi125 ceph-mon[86115]: pgmap v564: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:25:34.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:33 smithi096 ceph-mon[112483]: pgmap v564: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:25:35.687 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:25:35.687 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:25:35.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:25:35.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:25:36.687 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:36 smithi125 ceph-mon[86115]: pgmap v565: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:36.687 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:25:36.688 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:25:36.688 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:25:36.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:36 smithi096 ceph-mon[112483]: pgmap v565: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:36.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:25:36.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:25:36.773 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:25:37.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:37 smithi125 ceph-mon[86115]: pgmap v566: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:38.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:37 smithi096 ceph-mon[112483]: pgmap v566: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:39.929 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:39 smithi125 ceph-mon[86115]: pgmap v567: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:40.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:39 smithi096 ceph-mon[112483]: pgmap v567: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:41.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:41 smithi125 ceph-mon[86115]: pgmap v568: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:42.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:41 smithi096 ceph-mon[112483]: pgmap v568: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:43.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:43 smithi125 ceph-mon[86115]: pgmap v569: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:25:44.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:43 smithi096 ceph-mon[112483]: pgmap v569: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:25:45.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:45 smithi125 ceph-mon[86115]: pgmap v570: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:46.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:45 smithi096 ceph-mon[112483]: pgmap v570: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:47.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:47 smithi125 ceph-mon[86115]: pgmap v571: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:48.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:47 smithi096 ceph-mon[112483]: pgmap v571: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:49.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:49 smithi125 ceph-mon[86115]: pgmap v572: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:50.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:49 smithi096 ceph-mon[112483]: pgmap v572: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:50.924 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:25:50.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:25:51.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:51 smithi125 ceph-mon[86115]: pgmap v573: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:52.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:51 smithi096 ceph-mon[112483]: pgmap v573: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:53.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:53 smithi125 ceph-mon[86115]: pgmap v574: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:25:54.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:53 smithi096 ceph-mon[112483]: pgmap v574: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:25:55.938 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:55 smithi125 ceph-mon[86115]: pgmap v575: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:56.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:55 smithi096 ceph-mon[112483]: pgmap v575: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:25:57.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:57 smithi125 ceph-mon[86115]: pgmap v576: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:58.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:57 smithi096 ceph-mon[112483]: pgmap v576: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:25:59.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:25:59 smithi125 ceph-mon[86115]: pgmap v577: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:26:00.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:25:59 smithi096 ceph-mon[112483]: pgmap v577: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:26:01.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:01 smithi125 ceph-mon[86115]: pgmap v578: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:26:02.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:01 smithi096 ceph-mon[112483]: pgmap v578: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:26:03.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:03 smithi125 ceph-mon[86115]: pgmap v579: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:26:04.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:03 smithi096 ceph-mon[112483]: pgmap v579: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:26:05.687 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:26:05.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:26:06.687 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:06 smithi125 ceph-mon[86115]: pgmap v580: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:26:06.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:06 smithi096 ceph-mon[112483]: pgmap v580: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:26:07.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:07 smithi125 ceph-mon[86115]: pgmap v581: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:26:08.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:07 smithi096 ceph-mon[112483]: pgmap v581: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:26:09.889 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:09 smithi096 ceph-mon[112483]: pgmap v582: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:26:09.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:09 smithi125 ceph-mon[86115]: pgmap v582: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:26:11.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:11 smithi125 ceph-mon[86115]: pgmap v583: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:26:12.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:11 smithi096 ceph-mon[112483]: pgmap v583: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:26:13.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:13 smithi125 ceph-mon[86115]: pgmap v584: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:26:14.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:13 smithi096 ceph-mon[112483]: pgmap v584: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:26:15.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:15 smithi125 ceph-mon[86115]: pgmap v585: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:26:16.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:15 smithi096 ceph-mon[112483]: pgmap v585: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:26:17.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:17 smithi125 ceph-mon[86115]: pgmap v586: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:26:18.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:17 smithi096 ceph-mon[112483]: pgmap v586: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:26:19.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:19 smithi125 ceph-mon[86115]: pgmap v587: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:26:20.003 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:19 smithi096 ceph-mon[112483]: pgmap v587: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:26:20.687 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:26:21.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:26:21.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:21 smithi125 ceph-mon[86115]: pgmap v588: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:26:22.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:21 smithi096 ceph-mon[112483]: pgmap v588: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:26:23.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:23 smithi125 ceph-mon[86115]: pgmap v589: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-19T19:26:24.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:23 smithi096 ceph-mon[112483]: pgmap v589: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-19T19:26:25.687 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:25 smithi125 ceph-mon[86115]: pgmap v590: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:26:26.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:25 smithi096 ceph-mon[112483]: pgmap v590: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:26:27.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:27 smithi125 ceph-mon[86115]: pgmap v591: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:26:28.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:27 smithi096 ceph-mon[112483]: pgmap v591: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:26:29.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:29 smithi125 ceph-mon[86115]: pgmap v592: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:26:30.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:29 smithi096 ceph-mon[112483]: pgmap v592: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:26:31.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:31 smithi125 ceph-mon[86115]: pgmap v593: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:26:32.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:31 smithi096 ceph-mon[112483]: pgmap v593: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:26:33.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:33 smithi125 ceph-mon[86115]: pgmap v594: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:26:34.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:33 smithi096 ceph-mon[112483]: pgmap v594: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:26:35.687 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:26:35.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:26:36.687 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:36 smithi125 ceph-mon[86115]: pgmap v595: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:26:36.687 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:26:36.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:36 smithi096 ceph-mon[112483]: pgmap v595: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:26:36.772 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:26:37.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:37 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:26:37.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:37 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:26:37.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:37 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:26:37.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:37 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:26:37.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:37 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:26:37.937 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:37 smithi125 ceph-mon[86115]: pgmap v596: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:26:38.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:37 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:26:38.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:37 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:26:38.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:37 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:26:38.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:37 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:26:38.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:37 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:26:38.023 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:37 smithi096 ceph-mon[112483]: pgmap v596: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:26:39.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:39 smithi125 ceph-mon[86115]: pgmap v597: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:26:40.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:39 smithi096 ceph-mon[112483]: pgmap v597: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:26:41.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:41 smithi125 ceph-mon[86115]: pgmap v598: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:26:42.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:41 smithi096 ceph-mon[112483]: pgmap v598: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:26:43.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:43 smithi125 ceph-mon[86115]: pgmap v599: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:26:44.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:43 smithi096 ceph-mon[112483]: pgmap v599: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:26:45.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:45 smithi125 ceph-mon[86115]: pgmap v600: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:26:46.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:45 smithi096 ceph-mon[112483]: pgmap v600: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:26:47.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:47 smithi125 ceph-mon[86115]: pgmap v601: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:26:48.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:47 smithi096 ceph-mon[112483]: pgmap v601: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:26:49.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:49 smithi125 ceph-mon[86115]: pgmap v602: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:26:50.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:49 smithi096 ceph-mon[112483]: pgmap v602: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:26:50.885 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:26:50.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:26:51.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:51 smithi125 ceph-mon[86115]: pgmap v603: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:26:52.022 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:51 smithi096 ceph-mon[112483]: pgmap v603: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:26:53.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:53 smithi125 ceph-mon[86115]: pgmap v604: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:26:54.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:53 smithi096 ceph-mon[112483]: pgmap v604: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:26:55.771 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:55 smithi096 ceph-mon[112483]: pgmap v605: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:26:55.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:55 smithi125 ceph-mon[86115]: pgmap v605: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:26:57.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:57 smithi125 ceph-mon[86115]: pgmap v606: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:26:58.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:57 smithi096 ceph-mon[112483]: pgmap v606: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:26:59.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:26:59 smithi125 ceph-mon[86115]: pgmap v607: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:00.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:26:59 smithi096 ceph-mon[112483]: pgmap v607: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:01.874 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:01 smithi096 ceph-mon[112483]: pgmap v608: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:01.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:01 smithi125 ceph-mon[86115]: pgmap v608: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:03.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:03 smithi125 ceph-mon[86115]: pgmap v609: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:27:04.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:03 smithi096 ceph-mon[112483]: pgmap v609: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:27:05.686 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:27:05.771 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:27:06.771 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:06 smithi096 ceph-mon[112483]: pgmap v610: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:06.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:06 smithi125 ceph-mon[86115]: pgmap v610: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:07.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:07 smithi125 ceph-mon[86115]: pgmap v611: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:08.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:07 smithi096 ceph-mon[112483]: pgmap v611: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:09.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:09 smithi125 ceph-mon[86115]: pgmap v612: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:10.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:09 smithi096 ceph-mon[112483]: pgmap v612: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:11.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:11 smithi125 ceph-mon[86115]: pgmap v613: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:12.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:11 smithi096 ceph-mon[112483]: pgmap v613: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:13.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:13 smithi125 ceph-mon[86115]: pgmap v614: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:27:14.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:13 smithi096 ceph-mon[112483]: pgmap v614: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:27:15.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:15 smithi125 ceph-mon[86115]: pgmap v615: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:16.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:15 smithi096 ceph-mon[112483]: pgmap v615: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:17.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:17 smithi125 ceph-mon[86115]: pgmap v616: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:18.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:17 smithi096 ceph-mon[112483]: pgmap v616: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:19.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:19 smithi125 ceph-mon[86115]: pgmap v617: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:20.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:19 smithi096 ceph-mon[112483]: pgmap v617: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:20.923 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:27:20.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:27:21.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:21 smithi125 ceph-mon[86115]: pgmap v618: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:22.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:21 smithi096 ceph-mon[112483]: pgmap v618: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:23.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:23 smithi125 ceph-mon[86115]: pgmap v619: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:27:24.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:23 smithi096 ceph-mon[112483]: pgmap v619: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:27:25.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:25 smithi125 ceph-mon[86115]: pgmap v620: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:26.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:25 smithi096 ceph-mon[112483]: pgmap v620: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:27.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:27 smithi125 ceph-mon[86115]: pgmap v621: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:28.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:27 smithi096 ceph-mon[112483]: pgmap v621: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:29.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:29 smithi125 ceph-mon[86115]: pgmap v622: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:30.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:29 smithi096 ceph-mon[112483]: pgmap v622: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:31.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:31 smithi125 ceph-mon[86115]: pgmap v623: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:32.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:31 smithi096 ceph-mon[112483]: pgmap v623: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:33.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:33 smithi125 ceph-mon[86115]: pgmap v624: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:27:34.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:33 smithi096 ceph-mon[112483]: pgmap v624: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:27:35.686 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:27:35.771 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:27:36.686 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:36 smithi125 ceph-mon[86115]: pgmap v625: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:36.771 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:36 smithi096 ceph-mon[112483]: pgmap v625: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:38.436 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:38 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:27:38.436 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:38 smithi125 ceph-mon[86115]: pgmap v626: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:38.437 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:38 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:27:38.437 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:38 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:27:38.437 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:38 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:27:38.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:38 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:27:38.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:38 smithi096 ceph-mon[112483]: pgmap v626: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:38.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:38 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:27:38.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:38 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:27:38.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:38 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:27:39.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:39 smithi125 ceph-mon[86115]: pgmap v627: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:40.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:39 smithi096 ceph-mon[112483]: pgmap v627: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:41.939 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:41 smithi125 ceph-mon[86115]: pgmap v628: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:42.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:41 smithi096 ceph-mon[112483]: pgmap v628: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:43.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:43 smithi125 ceph-mon[86115]: pgmap v629: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:27:44.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:43 smithi096 ceph-mon[112483]: pgmap v629: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:27:45.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:45 smithi125 ceph-mon[86115]: pgmap v630: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:45.963 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:45 smithi096 ceph-mon[112483]: pgmap v630: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:47.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:47 smithi125 ceph-mon[86115]: pgmap v631: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:48.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:47 smithi096 ceph-mon[112483]: pgmap v631: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:49.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:49 smithi125 ceph-mon[86115]: pgmap v632: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:50.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:49 smithi096 ceph-mon[112483]: pgmap v632: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:50.922 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:27:50.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:27:51.686 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:51 smithi125 ceph-mon[86115]: pgmap v633: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:52.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:51 smithi096 ceph-mon[112483]: pgmap v633: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:53.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:53 smithi125 ceph-mon[86115]: pgmap v634: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:27:54.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:53 smithi096 ceph-mon[112483]: pgmap v634: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:27:55.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:55 smithi125 ceph-mon[86115]: pgmap v635: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:56.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:55 smithi096 ceph-mon[112483]: pgmap v635: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:27:57.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:57 smithi125 ceph-mon[86115]: pgmap v636: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:58.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:57 smithi096 ceph-mon[112483]: pgmap v636: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:27:59.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:27:59 smithi125 ceph-mon[86115]: pgmap v637: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:00.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:27:59 smithi096 ceph-mon[112483]: pgmap v637: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:01.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:01 smithi125 ceph-mon[86115]: pgmap v638: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:02.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:01 smithi096 ceph-mon[112483]: pgmap v638: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:03.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:03 smithi125 ceph-mon[86115]: pgmap v639: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:28:04.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:03 smithi096 ceph-mon[112483]: pgmap v639: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:28:05.686 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:28:05.771 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:28:06.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:06 smithi096 ceph-mon[112483]: pgmap v640: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:06.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:06 smithi125 ceph-mon[86115]: pgmap v640: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:07.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:07 smithi125 ceph-mon[86115]: pgmap v641: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:08.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:07 smithi096 ceph-mon[112483]: pgmap v641: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:09.935 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:09 smithi125 ceph-mon[86115]: pgmap v642: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:10.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:09 smithi096 ceph-mon[112483]: pgmap v642: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:11.935 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:11 smithi125 ceph-mon[86115]: pgmap v643: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:12.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:11 smithi096 ceph-mon[112483]: pgmap v643: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:13.935 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:13 smithi125 ceph-mon[86115]: pgmap v644: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:28:14.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:13 smithi096 ceph-mon[112483]: pgmap v644: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:28:15.935 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:15 smithi125 ceph-mon[86115]: pgmap v645: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:16.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:15 smithi096 ceph-mon[112483]: pgmap v645: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:17.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:17 smithi125 ceph-mon[86115]: pgmap v646: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:18.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:17 smithi096 ceph-mon[112483]: pgmap v646: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:19.935 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:19 smithi125 ceph-mon[86115]: pgmap v647: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:20.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:19 smithi096 ceph-mon[112483]: pgmap v647: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:20.922 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:28:20.935 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:28:21.935 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:21 smithi125 ceph-mon[86115]: pgmap v648: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:22.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:21 smithi096 ceph-mon[112483]: pgmap v648: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:23.935 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:23 smithi125 ceph-mon[86115]: pgmap v649: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:28:24.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:23 smithi096 ceph-mon[112483]: pgmap v649: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:28:25.935 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:25 smithi125 ceph-mon[86115]: pgmap v650: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:26.020 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:25 smithi096 ceph-mon[112483]: pgmap v650: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:28.935 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:28 smithi125 ceph-mon[86115]: pgmap v651: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:29.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:28 smithi096 ceph-mon[112483]: pgmap v651: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:30.935 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:30 smithi125 ceph-mon[86115]: pgmap v652: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:31.020 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:30 smithi096 ceph-mon[112483]: pgmap v652: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:32.935 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:32 smithi125 ceph-mon[86115]: pgmap v653: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:33.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:32 smithi096 ceph-mon[112483]: pgmap v653: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:34.935 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:34 smithi125 ceph-mon[86115]: pgmap v654: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:28:35.020 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:34 smithi096 ceph-mon[112483]: pgmap v654: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:28:35.935 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:28:36.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:28:36.900 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:36 smithi125 ceph-mon[86115]: pgmap v655: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:37.020 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:36 smithi096 ceph-mon[112483]: pgmap v655: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:38.935 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:38 smithi125 ceph-mon[86115]: pgmap v656: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:38.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:38 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:28:38.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:38 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:28:38.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:38 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:28:39.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:38 smithi096 ceph-mon[112483]: pgmap v656: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:39.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:38 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:28:39.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:38 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:28:39.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:38 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:28:39.935 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:39 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:28:39.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:39 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:28:39.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:39 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:28:40.020 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:39 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:28:40.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:39 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:28:40.021 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:39 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:28:41.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:41 smithi096 ceph-mon[112483]: pgmap v657: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:41.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:41 smithi125 ceph-mon[86115]: pgmap v657: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:43.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:43 smithi096 ceph-mon[112483]: pgmap v658: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:43.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:43 smithi125 ceph-mon[86115]: pgmap v658: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:45.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:45 smithi096 ceph-mon[112483]: pgmap v659: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:28:45.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:45 smithi125 ceph-mon[86115]: pgmap v659: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:28:47.435 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:47 smithi125 ceph-mon[86115]: pgmap v660: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:47.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:47 smithi096 ceph-mon[112483]: pgmap v660: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:49.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:49 smithi096 ceph-mon[112483]: pgmap v661: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:49.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:49 smithi125 ceph-mon[86115]: pgmap v661: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:51.487 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:51 smithi125 ceph-mon[86115]: pgmap v662: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:51.488 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:28:51.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:51 smithi096 ceph-mon[112483]: pgmap v662: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:51.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:28:53.521 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:53 smithi096 ceph-mon[112483]: pgmap v663: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:53.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:53 smithi125 ceph-mon[86115]: pgmap v663: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:55.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:55 smithi096 ceph-mon[112483]: pgmap v664: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:28:55.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:55 smithi125 ceph-mon[86115]: pgmap v664: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:28:57.435 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:57 smithi125 ceph-mon[86115]: pgmap v665: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:57.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:57 smithi096 ceph-mon[112483]: pgmap v665: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:28:59.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:28:59 smithi096 ceph-mon[112483]: pgmap v666: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:28:59.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:28:59 smithi125 ceph-mon[86115]: pgmap v666: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:29:01.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:01 smithi096 ceph-mon[112483]: pgmap v667: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:29:01.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:01 smithi125 ceph-mon[86115]: pgmap v667: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:29:03.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:03 smithi096 ceph-mon[112483]: pgmap v668: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:29:03.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:03 smithi125 ceph-mon[86115]: pgmap v668: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:29:05.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:05 smithi096 ceph-mon[112483]: pgmap v669: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:29:05.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:05 smithi125 ceph-mon[86115]: pgmap v669: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:29:06.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:29:06.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:29:07.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:07 smithi096 ceph-mon[112483]: pgmap v670: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:29:07.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:07 smithi125 ceph-mon[86115]: pgmap v670: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:29:09.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:09 smithi096 ceph-mon[112483]: pgmap v671: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:29:09.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:09 smithi125 ceph-mon[86115]: pgmap v671: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:29:11.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:11 smithi096 ceph-mon[112483]: pgmap v672: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:29:11.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:11 smithi125 ceph-mon[86115]: pgmap v672: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:29:13.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:13 smithi096 ceph-mon[112483]: pgmap v673: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:29:13.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:13 smithi125 ceph-mon[86115]: pgmap v673: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:29:15.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:15 smithi096 ceph-mon[112483]: pgmap v674: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:29:15.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:15 smithi125 ceph-mon[86115]: pgmap v674: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:29:17.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:17 smithi096 ceph-mon[112483]: pgmap v675: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:29:17.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:17 smithi125 ceph-mon[86115]: pgmap v675: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:29:19.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:19 smithi096 ceph-mon[112483]: pgmap v676: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:29:19.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:19 smithi125 ceph-mon[86115]: pgmap v676: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:29:21.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:21 smithi096 ceph-mon[112483]: pgmap v677: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:29:21.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:29:21.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:21 smithi125 ceph-mon[86115]: pgmap v677: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:29:21.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:29:23.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:23 smithi096 ceph-mon[112483]: pgmap v678: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:29:23.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:23 smithi125 ceph-mon[86115]: pgmap v678: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:29:25.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:25 smithi096 ceph-mon[112483]: pgmap v679: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:29:25.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:25 smithi125 ceph-mon[86115]: pgmap v679: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:29:27.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:27 smithi096 ceph-mon[112483]: pgmap v680: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:29:27.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:27 smithi125 ceph-mon[86115]: pgmap v680: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:29:29.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:29 smithi125 ceph-mon[86115]: pgmap v681: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:29:29.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:29 smithi096 ceph-mon[112483]: pgmap v681: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:29:31.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:31 smithi125 ceph-mon[86115]: pgmap v682: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:29:31.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:31 smithi096 ceph-mon[112483]: pgmap v682: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:29:33.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:33 smithi096 ceph-mon[112483]: pgmap v683: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:29:33.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:33 smithi125 ceph-mon[86115]: pgmap v683: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:29:35.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:35 smithi125 ceph-mon[86115]: pgmap v684: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:29:35.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:35 smithi096 ceph-mon[112483]: pgmap v684: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:29:36.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:29:36.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:29:37.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:37 smithi096 ceph-mon[112483]: pgmap v685: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:29:37.586 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:37 smithi125 ceph-mon[86115]: pgmap v685: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:29:39.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:39 smithi125 ceph-mon[86115]: pgmap v686: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:29:39.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:39 smithi096 ceph-mon[112483]: pgmap v686: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:29:40.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:40 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:29:40.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:40 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:29:40.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:40 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:29:40.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:40 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:29:40.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:40 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:29:40.771 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:40 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:29:40.771 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:40 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:29:40.771 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:40 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:29:41.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:41 smithi125 ceph-mon[86115]: pgmap v687: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:29:41.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:41 smithi096 ceph-mon[112483]: pgmap v687: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:29:43.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:43 smithi096 ceph-mon[112483]: pgmap v688: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:29:43.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:43 smithi125 ceph-mon[86115]: pgmap v688: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:29:45.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:45 smithi125 ceph-mon[86115]: pgmap v689: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-19T19:29:45.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:45 smithi096 ceph-mon[112483]: pgmap v689: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-19T19:29:47.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:47 smithi125 ceph-mon[86115]: pgmap v690: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:29:47.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:47 smithi096 ceph-mon[112483]: pgmap v690: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:29:49.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:49 smithi125 ceph-mon[86115]: pgmap v691: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:29:49.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:49 smithi096 ceph-mon[112483]: pgmap v691: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:29:51.572 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:51 smithi096 ceph-mon[112483]: pgmap v692: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:29:51.572 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:29:51.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:51 smithi125 ceph-mon[86115]: pgmap v692: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:29:51.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:29:53.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:53 smithi125 ceph-mon[86115]: pgmap v693: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:29:53.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:53 smithi096 ceph-mon[112483]: pgmap v693: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:29:55.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:55 smithi125 ceph-mon[86115]: pgmap v694: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:29:55.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:55 smithi096 ceph-mon[112483]: pgmap v694: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:29:57.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:57 smithi125 ceph-mon[86115]: pgmap v695: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:29:57.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:57 smithi096 ceph-mon[112483]: pgmap v695: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:29:59.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:29:59 smithi125 ceph-mon[86115]: pgmap v696: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:29:59.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:29:59 smithi096 ceph-mon[112483]: pgmap v696: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:00.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:00 smithi125 ceph-mon[86115]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T19:30:00.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:00 smithi096 ceph-mon[112483]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T19:30:01.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:01 smithi125 ceph-mon[86115]: pgmap v697: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:01.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:01 smithi096 ceph-mon[112483]: pgmap v697: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:03.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:03 smithi125 ceph-mon[86115]: pgmap v698: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:03.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:03 smithi096 ceph-mon[112483]: pgmap v698: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:05.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:05 smithi125 ceph-mon[86115]: pgmap v699: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:30:05.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:05 smithi096 ceph-mon[112483]: pgmap v699: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:30:06.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:30:06.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:30:07.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:07 smithi125 ceph-mon[86115]: pgmap v700: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:07.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:07 smithi096 ceph-mon[112483]: pgmap v700: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:09.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:09 smithi125 ceph-mon[86115]: pgmap v701: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:09.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:09 smithi096 ceph-mon[112483]: pgmap v701: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:11.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:11 smithi125 ceph-mon[86115]: pgmap v702: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:11.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:11 smithi096 ceph-mon[112483]: pgmap v702: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:13.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:13 smithi125 ceph-mon[86115]: pgmap v703: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:13.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:13 smithi096 ceph-mon[112483]: pgmap v703: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:15.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:15 smithi125 ceph-mon[86115]: pgmap v704: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:30:15.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:15 smithi096 ceph-mon[112483]: pgmap v704: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:30:17.654 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:17 smithi096 ceph-mon[112483]: pgmap v705: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:17.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:17 smithi125 ceph-mon[86115]: pgmap v705: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:19.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:19 smithi125 ceph-mon[86115]: pgmap v706: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:19.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:19 smithi096 ceph-mon[112483]: pgmap v706: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:21.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:21 smithi125 ceph-mon[86115]: pgmap v707: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:21.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:30:21.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:21 smithi096 ceph-mon[112483]: pgmap v707: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:21.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:30:23.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:23 smithi125 ceph-mon[86115]: pgmap v708: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:23.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:23 smithi096 ceph-mon[112483]: pgmap v708: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:25.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:25 smithi125 ceph-mon[86115]: pgmap v709: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:30:25.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:25 smithi096 ceph-mon[112483]: pgmap v709: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:30:27.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:27 smithi125 ceph-mon[86115]: pgmap v710: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:27.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:27 smithi096 ceph-mon[112483]: pgmap v710: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:29.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:29 smithi125 ceph-mon[86115]: pgmap v711: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:29.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:29 smithi096 ceph-mon[112483]: pgmap v711: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:31.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:31 smithi125 ceph-mon[86115]: pgmap v712: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:31.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:31 smithi096 ceph-mon[112483]: pgmap v712: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:33.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:33 smithi125 ceph-mon[86115]: pgmap v713: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:33.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:33 smithi096 ceph-mon[112483]: pgmap v713: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:35.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:35 smithi125 ceph-mon[86115]: pgmap v714: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:30:35.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:30:35.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:35 smithi096 ceph-mon[112483]: pgmap v714: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:30:35.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:30:37.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:37 smithi125 ceph-mon[86115]: pgmap v715: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:37.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:37 smithi096 ceph-mon[112483]: pgmap v715: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:39.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:39 smithi125 ceph-mon[86115]: pgmap v716: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:39.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:39 smithi096 ceph-mon[112483]: pgmap v716: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:40.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:40 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:30:40.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:40 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:30:41.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:41 smithi125 ceph-mon[86115]: pgmap v717: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:41.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:41 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:30:41.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:41 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:30:41.685 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:41 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:30:41.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:41 smithi096 ceph-mon[112483]: pgmap v717: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:41.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:41 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:30:41.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:41 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:30:41.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:41 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:30:43.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:43 smithi125 ceph-mon[86115]: pgmap v718: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:43.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:43 smithi096 ceph-mon[112483]: pgmap v718: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:45.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:45 smithi125 ceph-mon[86115]: pgmap v719: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:30:45.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:45 smithi096 ceph-mon[112483]: pgmap v719: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:30:47.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:47 smithi125 ceph-mon[86115]: pgmap v720: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:47.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:47 smithi096 ceph-mon[112483]: pgmap v720: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:49.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:49 smithi125 ceph-mon[86115]: pgmap v721: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:49.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:49 smithi096 ceph-mon[112483]: pgmap v721: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:50.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:30:50.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:30:51.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:51 smithi125 ceph-mon[86115]: pgmap v722: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:51.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:51 smithi096 ceph-mon[112483]: pgmap v722: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:53.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:53 smithi125 ceph-mon[86115]: pgmap v723: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:53.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:53 smithi096 ceph-mon[112483]: pgmap v723: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:55.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:55 smithi125 ceph-mon[86115]: pgmap v724: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:30:55.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:55 smithi096 ceph-mon[112483]: pgmap v724: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:30:57.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:57 smithi096 ceph-mon[112483]: pgmap v725: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:57.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:57 smithi125 ceph-mon[86115]: pgmap v725: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:30:59.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:30:59 smithi096 ceph-mon[112483]: pgmap v726: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:30:59.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:30:59 smithi125 ceph-mon[86115]: pgmap v726: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:01.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:01 smithi096 ceph-mon[112483]: pgmap v727: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:01.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:01 smithi125 ceph-mon[86115]: pgmap v727: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:03.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:03 smithi096 ceph-mon[112483]: pgmap v728: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:03.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:03 smithi125 ceph-mon[86115]: pgmap v728: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:05.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:05 smithi096 ceph-mon[112483]: pgmap v729: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:31:05.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:31:05.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:05 smithi125 ceph-mon[86115]: pgmap v729: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:31:05.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:31:07.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:07 smithi096 ceph-mon[112483]: pgmap v730: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:07.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:07 smithi125 ceph-mon[86115]: pgmap v730: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:09.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:09 smithi096 ceph-mon[112483]: pgmap v731: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:09.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:09 smithi125 ceph-mon[86115]: pgmap v731: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:11.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:11 smithi096 ceph-mon[112483]: pgmap v732: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:11.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:11 smithi125 ceph-mon[86115]: pgmap v732: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:13.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:13 smithi096 ceph-mon[112483]: pgmap v733: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:13.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:13 smithi125 ceph-mon[86115]: pgmap v733: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:15.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:15 smithi096 ceph-mon[112483]: pgmap v734: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:31:15.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:15 smithi125 ceph-mon[86115]: pgmap v734: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:31:17.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:17 smithi096 ceph-mon[112483]: pgmap v735: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:17.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:17 smithi125 ceph-mon[86115]: pgmap v735: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:19.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:19 smithi096 ceph-mon[112483]: pgmap v736: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:19.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:19 smithi125 ceph-mon[86115]: pgmap v736: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:20.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:31:20.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:31:21.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:21 smithi096 ceph-mon[112483]: pgmap v737: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:21.835 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:21 smithi125 ceph-mon[86115]: pgmap v737: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:23.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:23 smithi096 ceph-mon[112483]: pgmap v738: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:23.785 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:23 smithi125 ceph-mon[86115]: pgmap v738: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:25.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:25 smithi096 ceph-mon[112483]: pgmap v739: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:31:25.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:25 smithi125 ceph-mon[86115]: pgmap v739: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:31:27.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:27 smithi096 ceph-mon[112483]: pgmap v740: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:27.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:27 smithi125 ceph-mon[86115]: pgmap v740: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:29.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:29 smithi096 ceph-mon[112483]: pgmap v741: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:29.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:29 smithi125 ceph-mon[86115]: pgmap v741: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:31.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:31 smithi096 ceph-mon[112483]: pgmap v742: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:31.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:31 smithi125 ceph-mon[86115]: pgmap v742: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:33.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:33 smithi096 ceph-mon[112483]: pgmap v743: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:33.900 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:33 smithi125 ceph-mon[86115]: pgmap v743: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:35.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:35 smithi096 ceph-mon[112483]: pgmap v744: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:31:35.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:31:35.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:35 smithi125 ceph-mon[86115]: pgmap v744: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:31:35.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:31:37.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:37 smithi096 ceph-mon[112483]: pgmap v745: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:37.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:37 smithi125 ceph-mon[86115]: pgmap v745: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:39.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:39 smithi096 ceph-mon[112483]: pgmap v746: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:39.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:39 smithi125 ceph-mon[86115]: pgmap v746: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:41.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:41 smithi096 ceph-mon[112483]: pgmap v747: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:41.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:41 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:31:41.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:41 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:31:41.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:41 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:31:41.770 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:41 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:31:41.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:41 smithi125 ceph-mon[86115]: pgmap v747: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:41.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:41 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:31:41.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:41 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:31:41.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:41 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:31:41.935 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:41 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:31:43.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:43 smithi125 ceph-mon[86115]: pgmap v748: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:44.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:43 smithi096 ceph-mon[112483]: pgmap v748: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:45.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:45 smithi125 ceph-mon[86115]: pgmap v749: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:31:46.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:45 smithi096 ceph-mon[112483]: pgmap v749: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:31:47.936 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:47 smithi125 ceph-mon[86115]: pgmap v750: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:48.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:47 smithi096 ceph-mon[112483]: pgmap v750: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:49.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:49 smithi125 ceph-mon[86115]: pgmap v751: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:50.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:49 smithi096 ceph-mon[112483]: pgmap v751: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:50.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:31:51.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:31:51.835 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:51 smithi125 ceph-mon[86115]: pgmap v752: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:51.920 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:51 smithi096 ceph-mon[112483]: pgmap v752: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:53.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:53 smithi125 ceph-mon[86115]: pgmap v753: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:54.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:53 smithi096 ceph-mon[112483]: pgmap v753: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:31:55.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:55 smithi125 ceph-mon[86115]: pgmap v754: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:31:56.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:55 smithi096 ceph-mon[112483]: pgmap v754: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:31:57.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:57 smithi125 ceph-mon[86115]: pgmap v755: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:58.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:57 smithi096 ceph-mon[112483]: pgmap v755: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:31:59.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:31:59 smithi125 ceph-mon[86115]: pgmap v756: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:00.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:31:59 smithi096 ceph-mon[112483]: pgmap v756: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:01.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:01 smithi125 ceph-mon[86115]: pgmap v757: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:02.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:01 smithi096 ceph-mon[112483]: pgmap v757: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:03.834 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:03 smithi096 ceph-mon[112483]: pgmap v758: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:03.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:03 smithi125 ceph-mon[86115]: pgmap v758: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:05.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:05 smithi125 ceph-mon[86115]: pgmap v759: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:32:05.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:32:06.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:05 smithi096 ceph-mon[112483]: pgmap v759: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:32:06.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:32:07.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:07 smithi125 ceph-mon[86115]: pgmap v760: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:08.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:07 smithi096 ceph-mon[112483]: pgmap v760: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:09.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:09 smithi125 ceph-mon[86115]: pgmap v761: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:10.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:09 smithi096 ceph-mon[112483]: pgmap v761: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:11.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:11 smithi125 ceph-mon[86115]: pgmap v762: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:12.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:11 smithi096 ceph-mon[112483]: pgmap v762: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:13.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:13 smithi125 ceph-mon[86115]: pgmap v763: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:13.946 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:13 smithi096 ceph-mon[112483]: pgmap v763: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:15.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:15 smithi125 ceph-mon[86115]: pgmap v764: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:32:16.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:15 smithi096 ceph-mon[112483]: pgmap v764: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:32:17.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:17 smithi125 ceph-mon[86115]: pgmap v765: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:18.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:17 smithi096 ceph-mon[112483]: pgmap v765: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:19.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:19 smithi125 ceph-mon[86115]: pgmap v766: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:20.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:19 smithi096 ceph-mon[112483]: pgmap v766: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:20.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:32:21.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:32:21.835 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:21 smithi125 ceph-mon[86115]: pgmap v767: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:21.920 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:21 smithi096 ceph-mon[112483]: pgmap v767: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:23.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:23 smithi125 ceph-mon[86115]: pgmap v768: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:24.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:23 smithi096 ceph-mon[112483]: pgmap v768: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:25.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:25 smithi125 ceph-mon[86115]: pgmap v769: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:32:26.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:25 smithi096 ceph-mon[112483]: pgmap v769: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:32:27.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:27 smithi125 ceph-mon[86115]: pgmap v770: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:28.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:27 smithi096 ceph-mon[112483]: pgmap v770: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:29.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:29 smithi125 ceph-mon[86115]: pgmap v771: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:30.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:29 smithi096 ceph-mon[112483]: pgmap v771: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:31.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:31 smithi125 ceph-mon[86115]: pgmap v772: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:32.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:31 smithi096 ceph-mon[112483]: pgmap v772: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:33.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:33 smithi125 ceph-mon[86115]: pgmap v773: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:34.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:33 smithi096 ceph-mon[112483]: pgmap v773: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:35.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:35 smithi125 ceph-mon[86115]: pgmap v774: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:32:35.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:32:36.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:35 smithi096 ceph-mon[112483]: pgmap v774: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:32:36.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:32:37.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:37 smithi125 ceph-mon[86115]: pgmap v775: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:38.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:37 smithi096 ceph-mon[112483]: pgmap v775: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:39.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:39 smithi125 ceph-mon[86115]: pgmap v776: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:40.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:39 smithi096 ceph-mon[112483]: pgmap v776: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:41.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:41 smithi125 ceph-mon[86115]: pgmap v777: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:41.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:41 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:32:42.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:41 smithi096 ceph-mon[112483]: pgmap v777: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:42.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:41 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:32:42.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:42 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:32:42.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:42 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:32:42.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:42 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:32:43.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:42 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:32:43.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:42 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:32:43.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:42 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:32:43.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:43 smithi125 ceph-mon[86115]: pgmap v778: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:44.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:43 smithi096 ceph-mon[112483]: pgmap v778: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:44.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:44 smithi125 ceph-mon[86115]: pgmap v779: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:32:45.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:44 smithi096 ceph-mon[112483]: pgmap v779: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:32:47.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:46 smithi096 ceph-mon[112483]: pgmap v780: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:47.184 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:46 smithi125 ceph-mon[86115]: pgmap v780: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:49.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:48 smithi096 ceph-mon[112483]: pgmap v781: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:49.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:48 smithi125 ceph-mon[86115]: pgmap v781: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:51.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:50 smithi096 ceph-mon[112483]: pgmap v782: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:51.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:32:51.085 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:50 smithi125 ceph-mon[86115]: pgmap v782: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:51.085 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:32:53.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:52 smithi096 ceph-mon[112483]: pgmap v783: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:53.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:52 smithi125 ceph-mon[86115]: pgmap v783: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:55.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:54 smithi096 ceph-mon[112483]: pgmap v784: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:32:55.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:54 smithi125 ceph-mon[86115]: pgmap v784: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:32:57.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:56 smithi096 ceph-mon[112483]: pgmap v785: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:57.184 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:56 smithi125 ceph-mon[86115]: pgmap v785: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:32:59.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:32:58 smithi096 ceph-mon[112483]: pgmap v786: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:32:59.184 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:32:58 smithi125 ceph-mon[86115]: pgmap v786: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:01.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:00 smithi096 ceph-mon[112483]: pgmap v787: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:01.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:00 smithi125 ceph-mon[86115]: pgmap v787: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:03.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:02 smithi096 ceph-mon[112483]: pgmap v788: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:03.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:02 smithi125 ceph-mon[86115]: pgmap v788: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:04.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:04 smithi096 ceph-mon[112483]: pgmap v789: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:33:05.184 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:04 smithi125 ceph-mon[86115]: pgmap v789: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:33:06.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:33:06.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:33:07.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:06 smithi096 ceph-mon[112483]: pgmap v790: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:07.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:06 smithi125 ceph-mon[86115]: pgmap v790: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:09.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:08 smithi096 ceph-mon[112483]: pgmap v791: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:09.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:08 smithi125 ceph-mon[86115]: pgmap v791: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:11.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:10 smithi096 ceph-mon[112483]: pgmap v792: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:11.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:10 smithi125 ceph-mon[86115]: pgmap v792: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:13.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:12 smithi096 ceph-mon[112483]: pgmap v793: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:13.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:12 smithi125 ceph-mon[86115]: pgmap v793: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:15.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:14 smithi096 ceph-mon[112483]: pgmap v794: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:33:15.025 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:14 smithi125 ceph-mon[86115]: pgmap v794: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:33:17.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:16 smithi096 ceph-mon[112483]: pgmap v795: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:17.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:16 smithi125 ceph-mon[86115]: pgmap v795: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:19.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:18 smithi096 ceph-mon[112483]: pgmap v796: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:19.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:18 smithi125 ceph-mon[86115]: pgmap v796: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:21.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:20 smithi096 ceph-mon[112483]: pgmap v797: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:21.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:33:21.184 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:20 smithi125 ceph-mon[86115]: pgmap v797: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:21.184 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:33:23.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:22 smithi096 ceph-mon[112483]: pgmap v798: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:23.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:22 smithi125 ceph-mon[86115]: pgmap v798: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:25.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:24 smithi096 ceph-mon[112483]: pgmap v799: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:33:25.137 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:24 smithi125 ceph-mon[86115]: pgmap v799: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:33:27.019 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:26 smithi096 ceph-mon[112483]: pgmap v800: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:27.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:26 smithi125 ceph-mon[86115]: pgmap v800: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:29.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:28 smithi096 ceph-mon[112483]: pgmap v801: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:29.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:28 smithi125 ceph-mon[86115]: pgmap v801: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:31.184 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:30 smithi125 ceph-mon[86115]: pgmap v802: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:31.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:30 smithi096 ceph-mon[112483]: pgmap v802: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:33.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:32 smithi096 ceph-mon[112483]: pgmap v803: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:33.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:32 smithi125 ceph-mon[86115]: pgmap v803: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:35.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:34 smithi125 ceph-mon[86115]: pgmap v804: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:33:35.269 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:34 smithi096 ceph-mon[112483]: pgmap v804: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:33:36.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:33:36.269 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:33:37.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:36 smithi125 ceph-mon[86115]: pgmap v805: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:37.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:36 smithi096 ceph-mon[112483]: pgmap v805: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:39.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:38 smithi125 ceph-mon[86115]: pgmap v806: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:39.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:38 smithi096 ceph-mon[112483]: pgmap v806: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:41.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:40 smithi125 ceph-mon[86115]: pgmap v807: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:41.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:40 smithi096 ceph-mon[112483]: pgmap v807: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:43.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:42 smithi096 ceph-mon[112483]: pgmap v808: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:43.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:42 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:33:43.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:42 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:33:43.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:42 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:33:43.057 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:42 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:33:43.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:42 smithi125 ceph-mon[86115]: pgmap v808: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:43.184 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:42 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:33:43.184 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:42 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:33:43.184 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:42 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:33:43.184 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:42 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:33:45.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:44 smithi125 ceph-mon[86115]: pgmap v809: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:33:45.269 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:44 smithi096 ceph-mon[112483]: pgmap v809: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:33:47.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:46 smithi125 ceph-mon[86115]: pgmap v810: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:47.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:46 smithi096 ceph-mon[112483]: pgmap v810: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:49.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:48 smithi125 ceph-mon[86115]: pgmap v811: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:49.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:48 smithi096 ceph-mon[112483]: pgmap v811: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:51.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:50 smithi125 ceph-mon[86115]: pgmap v812: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:51.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:33:51.269 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:50 smithi096 ceph-mon[112483]: pgmap v812: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:51.269 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:33:53.070 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:52 smithi096 ceph-mon[112483]: pgmap v813: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:53.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:52 smithi125 ceph-mon[86115]: pgmap v813: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:55.070 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:54 smithi096 ceph-mon[112483]: pgmap v814: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:33:55.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:54 smithi125 ceph-mon[86115]: pgmap v814: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:33:57.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:56 smithi125 ceph-mon[86115]: pgmap v815: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:57.269 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:56 smithi096 ceph-mon[112483]: pgmap v815: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:33:59.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:33:58 smithi125 ceph-mon[86115]: pgmap v816: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:33:59.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:33:58 smithi096 ceph-mon[112483]: pgmap v816: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:01.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:00 smithi125 ceph-mon[86115]: pgmap v817: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:01.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:00 smithi096 ceph-mon[112483]: pgmap v817: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:03.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:02 smithi125 ceph-mon[86115]: pgmap v818: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:03.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:02 smithi096 ceph-mon[112483]: pgmap v818: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:05.182 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:04 smithi096 ceph-mon[112483]: pgmap v819: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:34:05.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:04 smithi125 ceph-mon[86115]: pgmap v819: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:34:05.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:34:06.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:34:07.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:06 smithi125 ceph-mon[86115]: pgmap v820: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:07.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:06 smithi096 ceph-mon[112483]: pgmap v820: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:09.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:08 smithi125 ceph-mon[86115]: pgmap v821: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:09.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:08 smithi096 ceph-mon[112483]: pgmap v821: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:10.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:10 smithi125 ceph-mon[86115]: pgmap v822: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:11.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:10 smithi096 ceph-mon[112483]: pgmap v822: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:13.433 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:13 smithi125 ceph-mon[86115]: pgmap v823: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:13.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:13 smithi096 ceph-mon[112483]: pgmap v823: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:15.433 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:15 smithi125 ceph-mon[86115]: pgmap v824: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:34:15.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:15 smithi096 ceph-mon[112483]: pgmap v824: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:34:17.433 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:17 smithi125 ceph-mon[86115]: pgmap v825: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:17.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:17 smithi096 ceph-mon[112483]: pgmap v825: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:19.433 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:19 smithi125 ceph-mon[86115]: pgmap v826: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:19.519 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:19 smithi096 ceph-mon[112483]: pgmap v826: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:21.433 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:21 smithi125 ceph-mon[86115]: pgmap v827: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:21.433 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:34:21.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:21 smithi096 ceph-mon[112483]: pgmap v827: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:21.519 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:34:23.321 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:23 smithi096 ceph-mon[112483]: pgmap v828: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:23.433 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:23 smithi125 ceph-mon[86115]: pgmap v828: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:25.433 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:25 smithi125 ceph-mon[86115]: pgmap v829: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:34:25.520 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:25 smithi096 ceph-mon[112483]: pgmap v829: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:34:27.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:27 smithi096 ceph-mon[112483]: pgmap v830: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:27.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:27 smithi125 ceph-mon[86115]: pgmap v830: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:29.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:29 smithi096 ceph-mon[112483]: pgmap v831: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:29.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:29 smithi125 ceph-mon[86115]: pgmap v831: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:31.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:31 smithi096 ceph-mon[112483]: pgmap v832: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:31.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:31 smithi125 ceph-mon[86115]: pgmap v832: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:33.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:33 smithi096 ceph-mon[112483]: pgmap v833: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:33.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:33 smithi125 ceph-mon[86115]: pgmap v833: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:35.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:35 smithi096 ceph-mon[112483]: pgmap v834: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:34:35.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:35 smithi125 ceph-mon[86115]: pgmap v834: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:34:36.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:34:36.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:34:37.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:37 smithi096 ceph-mon[112483]: pgmap v835: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:37.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:37 smithi125 ceph-mon[86115]: pgmap v835: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:39.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:39 smithi096 ceph-mon[112483]: pgmap v836: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:39.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:39 smithi125 ceph-mon[86115]: pgmap v836: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:41.433 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:41 smithi125 ceph-mon[86115]: pgmap v837: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:41.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:41 smithi096 ceph-mon[112483]: pgmap v837: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:43.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:43 smithi096 ceph-mon[112483]: pgmap v838: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:43.519 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:43 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:34:43.562 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:43 smithi125 ceph-mon[86115]: pgmap v838: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:43.563 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:43 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:34:45.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:45 smithi096 ceph-mon[112483]: pgmap v839: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:34:45.519 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:45 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:34:45.519 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:45 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:34:45.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:45 smithi125 ceph-mon[86115]: pgmap v839: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:34:45.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:45 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:34:45.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:45 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:34:47.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:47 smithi096 ceph-mon[112483]: pgmap v840: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:47.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:47 smithi125 ceph-mon[86115]: pgmap v840: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:48.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:48 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:34:48.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:48 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:34:48.519 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:48 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:34:48.519 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:48 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:34:48.519 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:48 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:34:48.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:48 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:34:48.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:48 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:34:48.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:48 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:34:48.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:48 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:34:48.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:48 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:34:49.519 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:49 smithi096 ceph-mon[112483]: pgmap v841: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:49.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:49 smithi125 ceph-mon[86115]: pgmap v841: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:51.433 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:51 smithi125 ceph-mon[86115]: pgmap v842: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:51.433 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:34:51.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:51 smithi096 ceph-mon[112483]: pgmap v842: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:51.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:34:53.321 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:53 smithi096 ceph-mon[112483]: pgmap v843: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:53.627 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:53 smithi125 ceph-mon[86115]: pgmap v843: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:55.519 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:55 smithi096 ceph-mon[112483]: pgmap v844: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:34:55.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:55 smithi125 ceph-mon[86115]: pgmap v844: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:34:57.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:57 smithi096 ceph-mon[112483]: pgmap v845: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:57.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:57 smithi125 ceph-mon[86115]: pgmap v845: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:34:59.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:34:59 smithi096 ceph-mon[112483]: pgmap v846: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:34:59.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:34:59 smithi125 ceph-mon[86115]: pgmap v846: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:01.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:01 smithi096 ceph-mon[112483]: pgmap v847: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:01.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:01 smithi125 ceph-mon[86115]: pgmap v847: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:03.433 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:03 smithi125 ceph-mon[86115]: pgmap v848: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:03.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:03 smithi096 ceph-mon[112483]: pgmap v848: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:05.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:05 smithi096 ceph-mon[112483]: pgmap v849: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:35:05.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:05 smithi125 ceph-mon[86115]: pgmap v849: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:35:06.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:35:06.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:35:07.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:07 smithi125 ceph-mon[86115]: pgmap v850: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:07.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:07 smithi096 ceph-mon[112483]: pgmap v850: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:09.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:09 smithi125 ceph-mon[86115]: pgmap v851: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:09.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:09 smithi096 ceph-mon[112483]: pgmap v851: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:11.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:11 smithi125 ceph-mon[86115]: pgmap v852: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:11.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:11 smithi096 ceph-mon[112483]: pgmap v852: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:13.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:13 smithi096 ceph-mon[112483]: pgmap v853: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:13.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:13 smithi125 ceph-mon[86115]: pgmap v853: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:15.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:15 smithi125 ceph-mon[86115]: pgmap v854: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:35:15.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:15 smithi096 ceph-mon[112483]: pgmap v854: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:35:17.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:17 smithi125 ceph-mon[86115]: pgmap v855: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:17.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:17 smithi096 ceph-mon[112483]: pgmap v855: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:19.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:19 smithi125 ceph-mon[86115]: pgmap v856: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:19.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:19 smithi096 ceph-mon[112483]: pgmap v856: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:21.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:21 smithi125 ceph-mon[86115]: pgmap v857: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:21.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:35:21.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:21 smithi096 ceph-mon[112483]: pgmap v857: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:21.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:35:23.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:23 smithi096 ceph-mon[112483]: pgmap v858: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:23.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:23 smithi125 ceph-mon[86115]: pgmap v858: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:25.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:25 smithi125 ceph-mon[86115]: pgmap v859: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:35:25.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:25 smithi096 ceph-mon[112483]: pgmap v859: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:35:27.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:27 smithi125 ceph-mon[86115]: pgmap v860: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:27.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:27 smithi096 ceph-mon[112483]: pgmap v860: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:29.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:29 smithi125 ceph-mon[86115]: pgmap v861: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:29.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:29 smithi096 ceph-mon[112483]: pgmap v861: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:31.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:31 smithi096 ceph-mon[112483]: pgmap v862: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:31.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:31 smithi125 ceph-mon[86115]: pgmap v862: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:33.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:33 smithi125 ceph-mon[86115]: pgmap v863: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:33.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:33 smithi096 ceph-mon[112483]: pgmap v863: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:35.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:35 smithi125 ceph-mon[86115]: pgmap v864: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:35:35.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:35 smithi096 ceph-mon[112483]: pgmap v864: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:35:36.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:35:36.608 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:35:37.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:37 smithi125 ceph-mon[86115]: pgmap v865: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:37.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:37 smithi096 ceph-mon[112483]: pgmap v865: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:39.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:39 smithi125 ceph-mon[86115]: pgmap v866: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:39.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:39 smithi096 ceph-mon[112483]: pgmap v866: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:41.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:41 smithi096 ceph-mon[112483]: pgmap v867: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:41.664 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:41 smithi125 ceph-mon[86115]: pgmap v867: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:43.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:43 smithi125 ceph-mon[86115]: pgmap v868: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:43.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:43 smithi096 ceph-mon[112483]: pgmap v868: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:45.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:45 smithi125 ceph-mon[86115]: pgmap v869: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:35:45.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:45 smithi096 ceph-mon[112483]: pgmap v869: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:35:47.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:47 smithi125 ceph-mon[86115]: pgmap v870: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:47.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:47 smithi096 ceph-mon[112483]: pgmap v870: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:48.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:48 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:35:48.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:48 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:35:49.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:49 smithi125 ceph-mon[86115]: pgmap v871: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:49.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:35:49.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:35:49.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:35:49.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:49 smithi096 ceph-mon[112483]: pgmap v871: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:49.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:35:49.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:35:49.769 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:35:51.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:51 smithi125 ceph-mon[86115]: pgmap v872: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:51.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:35:51.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:51 smithi096 ceph-mon[112483]: pgmap v872: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:51.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:35:53.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:53 smithi125 ceph-mon[86115]: pgmap v873: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:53.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:53 smithi096 ceph-mon[112483]: pgmap v873: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:55.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:55 smithi125 ceph-mon[86115]: pgmap v874: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:35:55.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:55 smithi096 ceph-mon[112483]: pgmap v874: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:35:57.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:57 smithi125 ceph-mon[86115]: pgmap v875: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:57.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:57 smithi096 ceph-mon[112483]: pgmap v875: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:35:59.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:35:59 smithi125 ceph-mon[86115]: pgmap v876: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:35:59.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:35:59 smithi096 ceph-mon[112483]: pgmap v876: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:01.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:01 smithi125 ceph-mon[86115]: pgmap v877: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:01.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:01 smithi096 ceph-mon[112483]: pgmap v877: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:03.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:03 smithi125 ceph-mon[86115]: pgmap v878: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:03.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:03 smithi096 ceph-mon[112483]: pgmap v878: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:05.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:05 smithi125 ceph-mon[86115]: pgmap v879: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:36:05.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:05 smithi096 ceph-mon[112483]: pgmap v879: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:36:06.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:36:06.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:36:07.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:07 smithi125 ceph-mon[86115]: pgmap v880: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:07.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:07 smithi096 ceph-mon[112483]: pgmap v880: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:09.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:09 smithi125 ceph-mon[86115]: pgmap v881: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:09.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:09 smithi096 ceph-mon[112483]: pgmap v881: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:11.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:11 smithi125 ceph-mon[86115]: pgmap v882: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:11.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:11 smithi096 ceph-mon[112483]: pgmap v882: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:13.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:13 smithi125 ceph-mon[86115]: pgmap v883: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:13.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:13 smithi096 ceph-mon[112483]: pgmap v883: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:15.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:15 smithi125 ceph-mon[86115]: pgmap v884: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:36:15.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:15 smithi096 ceph-mon[112483]: pgmap v884: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:36:17.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:17 smithi125 ceph-mon[86115]: pgmap v885: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:17.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:17 smithi096 ceph-mon[112483]: pgmap v885: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:19.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:19 smithi125 ceph-mon[86115]: pgmap v886: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:19.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:19 smithi096 ceph-mon[112483]: pgmap v886: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:20.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:36:20.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:36:21.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:21 smithi125 ceph-mon[86115]: pgmap v887: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:21.704 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:21 smithi096 ceph-mon[112483]: pgmap v887: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:23.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:23 smithi125 ceph-mon[86115]: pgmap v888: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:23.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:23 smithi096 ceph-mon[112483]: pgmap v888: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:25.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:25 smithi125 ceph-mon[86115]: pgmap v889: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:36:25.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:25 smithi096 ceph-mon[112483]: pgmap v889: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:36:27.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:27 smithi125 ceph-mon[86115]: pgmap v890: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:27.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:27 smithi096 ceph-mon[112483]: pgmap v890: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:29.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:29 smithi125 ceph-mon[86115]: pgmap v891: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:29.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:29 smithi096 ceph-mon[112483]: pgmap v891: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:31.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:31 smithi125 ceph-mon[86115]: pgmap v892: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:31.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:31 smithi096 ceph-mon[112483]: pgmap v892: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:33.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:33 smithi096 ceph-mon[112483]: pgmap v893: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:33.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:33 smithi125 ceph-mon[86115]: pgmap v893: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:35.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:35 smithi096 ceph-mon[112483]: pgmap v894: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:36:35.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:36:35.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:35 smithi125 ceph-mon[86115]: pgmap v894: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:36:35.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:36:37.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:37 smithi125 ceph-mon[86115]: pgmap v895: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:37.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:37 smithi096 ceph-mon[112483]: pgmap v895: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:39.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:39 smithi096 ceph-mon[112483]: pgmap v896: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:39.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:39 smithi125 ceph-mon[86115]: pgmap v896: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:41.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:41 smithi096 ceph-mon[112483]: pgmap v897: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:41.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:41 smithi125 ceph-mon[86115]: pgmap v897: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:43.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:43 smithi096 ceph-mon[112483]: pgmap v898: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:43.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:43 smithi125 ceph-mon[86115]: pgmap v898: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:45.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:45 smithi096 ceph-mon[112483]: pgmap v899: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:36:45.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:45 smithi125 ceph-mon[86115]: pgmap v899: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:36:47.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:47 smithi125 ceph-mon[86115]: pgmap v900: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:47.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:47 smithi096 ceph-mon[112483]: pgmap v900: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:49.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:49 smithi096 ceph-mon[112483]: pgmap v901: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:49.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:36:49.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:36:49.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:49 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:36:49.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:49 smithi125 ceph-mon[86115]: pgmap v901: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:49.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:36:49.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:36:49.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:49 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:36:50.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:36:50.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:36:50.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:36:50.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:36:50.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:36:50.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:36:50.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:36:50.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:36:51.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:51 smithi096 ceph-mon[112483]: pgmap v902: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:51.834 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:51 smithi125 ceph-mon[86115]: pgmap v902: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:53.693 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:53 smithi096 ceph-mon[112483]: pgmap v903: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:53.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:53 smithi125 ceph-mon[86115]: pgmap v903: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:55.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:55 smithi096 ceph-mon[112483]: pgmap v904: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:36:55.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:55 smithi125 ceph-mon[86115]: pgmap v904: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:36:57.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:57 smithi096 ceph-mon[112483]: pgmap v905: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:57.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:57 smithi125 ceph-mon[86115]: pgmap v905: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:36:59.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:36:59 smithi096 ceph-mon[112483]: pgmap v906: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:36:59.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:36:59 smithi125 ceph-mon[86115]: pgmap v906: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:01.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:01 smithi096 ceph-mon[112483]: pgmap v907: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:01.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:01 smithi125 ceph-mon[86115]: pgmap v907: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:03.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:03 smithi096 ceph-mon[112483]: pgmap v908: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:03.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:03 smithi125 ceph-mon[86115]: pgmap v908: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:05.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:05 smithi096 ceph-mon[112483]: pgmap v909: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:37:05.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:37:05.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:05 smithi125 ceph-mon[86115]: pgmap v909: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:37:05.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:37:07.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:07 smithi096 ceph-mon[112483]: pgmap v910: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:07.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:07 smithi125 ceph-mon[86115]: pgmap v910: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:09.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:09 smithi096 ceph-mon[112483]: pgmap v911: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:09.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:09 smithi125 ceph-mon[86115]: pgmap v911: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:11.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:11 smithi096 ceph-mon[112483]: pgmap v912: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:11.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:11 smithi125 ceph-mon[86115]: pgmap v912: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:13.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:13 smithi096 ceph-mon[112483]: pgmap v913: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:13.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:13 smithi125 ceph-mon[86115]: pgmap v913: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:15.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:15 smithi096 ceph-mon[112483]: pgmap v914: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:37:15.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:15 smithi125 ceph-mon[86115]: pgmap v914: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:37:17.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:17 smithi096 ceph-mon[112483]: pgmap v915: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:17.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:17 smithi125 ceph-mon[86115]: pgmap v915: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:19.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:19 smithi096 ceph-mon[112483]: pgmap v916: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:19.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:19 smithi125 ceph-mon[86115]: pgmap v916: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:20.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:37:20.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:37:21.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:21 smithi096 ceph-mon[112483]: pgmap v917: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:21.834 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:21 smithi125 ceph-mon[86115]: pgmap v917: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:23.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:23 smithi096 ceph-mon[112483]: pgmap v918: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:23.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:23 smithi125 ceph-mon[86115]: pgmap v918: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:25.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:25 smithi125 ceph-mon[86115]: pgmap v919: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:37:26.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:25 smithi096 ceph-mon[112483]: pgmap v919: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:37:27.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:27 smithi096 ceph-mon[112483]: pgmap v920: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:27.850 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:27 smithi125 ceph-mon[86115]: pgmap v920: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:29.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:29 smithi125 ceph-mon[86115]: pgmap v921: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:30.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:29 smithi096 ceph-mon[112483]: pgmap v921: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:31.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:31 smithi125 ceph-mon[86115]: pgmap v922: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:32.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:31 smithi096 ceph-mon[112483]: pgmap v922: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:33.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:33 smithi125 ceph-mon[86115]: pgmap v923: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:34.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:33 smithi096 ceph-mon[112483]: pgmap v923: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:35.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:35 smithi125 ceph-mon[86115]: pgmap v924: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:37:35.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:37:36.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:35 smithi096 ceph-mon[112483]: pgmap v924: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:37:36.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:37:37.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:37 smithi125 ceph-mon[86115]: pgmap v925: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:38.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:37 smithi096 ceph-mon[112483]: pgmap v925: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:39.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:39 smithi125 ceph-mon[86115]: pgmap v926: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:40.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:39 smithi096 ceph-mon[112483]: pgmap v926: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:41.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:41 smithi125 ceph-mon[86115]: pgmap v927: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:42.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:41 smithi096 ceph-mon[112483]: pgmap v927: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:43.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:43 smithi125 ceph-mon[86115]: pgmap v928: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:44.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:43 smithi096 ceph-mon[112483]: pgmap v928: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:45.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:45 smithi125 ceph-mon[86115]: pgmap v929: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:37:46.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:45 smithi096 ceph-mon[112483]: pgmap v929: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:37:47.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:47 smithi125 ceph-mon[86115]: pgmap v930: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:48.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:47 smithi096 ceph-mon[112483]: pgmap v930: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:49.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:49 smithi125 ceph-mon[86115]: pgmap v931: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:50.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:49 smithi096 ceph-mon[112483]: pgmap v931: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:50.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:37:50.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:37:50.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:37:50.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:37:50.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:37:51.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:37:51.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:37:51.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:37:51.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:37:51.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:37:51.833 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:51 smithi125 ceph-mon[86115]: pgmap v932: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:52.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:51 smithi096 ceph-mon[112483]: pgmap v932: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:53.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:53 smithi125 ceph-mon[86115]: pgmap v933: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:54.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:53 smithi096 ceph-mon[112483]: pgmap v933: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:37:55.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:55 smithi125 ceph-mon[86115]: pgmap v934: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:37:56.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:55 smithi096 ceph-mon[112483]: pgmap v934: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:37:57.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:57 smithi125 ceph-mon[86115]: pgmap v935: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:58.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:57 smithi096 ceph-mon[112483]: pgmap v935: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:37:59.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:37:59 smithi125 ceph-mon[86115]: pgmap v936: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:38:00.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:37:59 smithi096 ceph-mon[112483]: pgmap v936: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:38:01.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:01 smithi125 ceph-mon[86115]: pgmap v937: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:38:02.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:01 smithi096 ceph-mon[112483]: pgmap v937: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:38:03.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:03 smithi125 ceph-mon[86115]: pgmap v938: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:38:04.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:03 smithi096 ceph-mon[112483]: pgmap v938: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:38:05.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:05 smithi125 ceph-mon[86115]: pgmap v939: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:38:05.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:38:06.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:05 smithi096 ceph-mon[112483]: pgmap v939: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:38:06.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:38:07.893 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:07 smithi096 ceph-mon[112483]: pgmap v940: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:38:07.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:07 smithi125 ceph-mon[86115]: pgmap v940: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:38:09.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:09 smithi125 ceph-mon[86115]: pgmap v941: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:38:10.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:09 smithi096 ceph-mon[112483]: pgmap v941: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:38:11.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:11 smithi125 ceph-mon[86115]: pgmap v942: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:38:12.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:11 smithi096 ceph-mon[112483]: pgmap v942: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:38:13.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:13 smithi125 ceph-mon[86115]: pgmap v943: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:38:14.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:13 smithi096 ceph-mon[112483]: pgmap v943: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:38:15.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:15 smithi125 ceph-mon[86115]: pgmap v944: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:38:16.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:15 smithi096 ceph-mon[112483]: pgmap v944: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:38:17.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:17 smithi125 ceph-mon[86115]: pgmap v945: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:38:18.007 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:17 smithi096 ceph-mon[112483]: pgmap v945: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:38:19.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:19 smithi125 ceph-mon[86115]: pgmap v946: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:38:20.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:19 smithi096 ceph-mon[112483]: pgmap v946: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:38:20.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:38:21.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:38:21.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:21 smithi125 ceph-mon[86115]: pgmap v947: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:38:22.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:21 smithi096 ceph-mon[112483]: pgmap v947: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:38:23.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:23 smithi125 ceph-mon[86115]: pgmap v948: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:38:24.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:23 smithi096 ceph-mon[112483]: pgmap v948: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:38:25.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:25 smithi125 ceph-mon[86115]: pgmap v949: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-19T19:38:26.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:25 smithi096 ceph-mon[112483]: pgmap v949: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-19T19:38:27.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:27 smithi125 ceph-mon[86115]: pgmap v950: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:38:28.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:27 smithi096 ceph-mon[112483]: pgmap v950: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:38:29.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:29 smithi125 ceph-mon[86115]: pgmap v951: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:38:30.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:29 smithi096 ceph-mon[112483]: pgmap v951: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:38:31.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:31 smithi125 ceph-mon[86115]: pgmap v952: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:38:32.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:31 smithi096 ceph-mon[112483]: pgmap v952: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:38:33.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:33 smithi125 ceph-mon[86115]: pgmap v953: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:38:34.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:33 smithi096 ceph-mon[112483]: pgmap v953: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:38:35.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:35 smithi125 ceph-mon[86115]: pgmap v954: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:38:35.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:38:36.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:35 smithi096 ceph-mon[112483]: pgmap v954: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:38:36.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:38:37.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:37 smithi125 ceph-mon[86115]: pgmap v955: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:38:38.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:37 smithi096 ceph-mon[112483]: pgmap v955: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:38:39.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:39 smithi125 ceph-mon[86115]: pgmap v956: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:38:40.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:39 smithi096 ceph-mon[112483]: pgmap v956: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:38:41.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:41 smithi125 ceph-mon[86115]: pgmap v957: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:38:42.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:41 smithi096 ceph-mon[112483]: pgmap v957: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:38:43.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:43 smithi125 ceph-mon[86115]: pgmap v958: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:38:44.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:43 smithi096 ceph-mon[112483]: pgmap v958: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:38:45.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:45 smithi125 ceph-mon[86115]: pgmap v959: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:38:46.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:45 smithi096 ceph-mon[112483]: pgmap v959: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:38:47.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:47 smithi125 ceph-mon[86115]: pgmap v960: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:38:48.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:47 smithi096 ceph-mon[112483]: pgmap v960: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:38:49.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:49 smithi125 ceph-mon[86115]: pgmap v961: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:38:50.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:49 smithi096 ceph-mon[112483]: pgmap v961: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:38:50.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:38:50.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:38:51.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:38:51.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:38:51.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:51 smithi125 ceph-mon[86115]: pgmap v962: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:38:51.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:38:51.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:38:52.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:51 smithi096 ceph-mon[112483]: pgmap v962: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:38:52.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:38:52.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:38:52.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:52 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:38:52.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:52 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:38:52.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:52 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:38:53.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:52 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:38:53.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:52 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:38:53.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:52 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:38:53.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:53 smithi125 ceph-mon[86115]: pgmap v963: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:38:54.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:53 smithi096 ceph-mon[112483]: pgmap v963: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:38:55.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:55 smithi125 ceph-mon[86115]: pgmap v964: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:38:56.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:55 smithi096 ceph-mon[112483]: pgmap v964: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:38:57.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:57 smithi125 ceph-mon[86115]: pgmap v965: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:38:58.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:57 smithi096 ceph-mon[112483]: pgmap v965: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:38:59.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:38:58 smithi096 ceph-mon[112483]: pgmap v966: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:38:59.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:38:58 smithi125 ceph-mon[86115]: pgmap v966: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:01.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:00 smithi125 ceph-mon[86115]: pgmap v967: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:01.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:00 smithi096 ceph-mon[112483]: pgmap v967: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:03.055 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:02 smithi096 ceph-mon[112483]: pgmap v968: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:03.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:02 smithi125 ceph-mon[86115]: pgmap v968: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:05.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:04 smithi125 ceph-mon[86115]: pgmap v969: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:39:05.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:04 smithi096 ceph-mon[112483]: pgmap v969: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:39:06.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:39:06.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:39:07.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:06 smithi125 ceph-mon[86115]: pgmap v970: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:07.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:06 smithi096 ceph-mon[112483]: pgmap v970: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:09.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:08 smithi096 ceph-mon[112483]: pgmap v971: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:09.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:08 smithi125 ceph-mon[86115]: pgmap v971: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:11.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:10 smithi125 ceph-mon[86115]: pgmap v972: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:11.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:10 smithi096 ceph-mon[112483]: pgmap v972: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:13.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:12 smithi125 ceph-mon[86115]: pgmap v973: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:13.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:12 smithi096 ceph-mon[112483]: pgmap v973: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:15.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:14 smithi125 ceph-mon[86115]: pgmap v974: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:39:15.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:14 smithi096 ceph-mon[112483]: pgmap v974: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:39:17.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:16 smithi125 ceph-mon[86115]: pgmap v975: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:17.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:16 smithi096 ceph-mon[112483]: pgmap v975: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:19.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:18 smithi096 ceph-mon[112483]: pgmap v976: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:19.104 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:18 smithi125 ceph-mon[86115]: pgmap v976: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:21.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:20 smithi125 ceph-mon[86115]: pgmap v977: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:21.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:39:21.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:20 smithi096 ceph-mon[112483]: pgmap v977: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:21.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:39:23.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:22 smithi125 ceph-mon[86115]: pgmap v978: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:23.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:22 smithi096 ceph-mon[112483]: pgmap v978: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:25.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:24 smithi125 ceph-mon[86115]: pgmap v979: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:39:25.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:24 smithi096 ceph-mon[112483]: pgmap v979: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:39:27.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:26 smithi125 ceph-mon[86115]: pgmap v980: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:27.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:26 smithi096 ceph-mon[112483]: pgmap v980: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:29.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:28 smithi125 ceph-mon[86115]: pgmap v981: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:29.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:28 smithi096 ceph-mon[112483]: pgmap v981: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:31.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:30 smithi125 ceph-mon[86115]: pgmap v982: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:31.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:30 smithi096 ceph-mon[112483]: pgmap v982: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:33.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:32 smithi125 ceph-mon[86115]: pgmap v983: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:33.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:32 smithi096 ceph-mon[112483]: pgmap v983: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:35.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:34 smithi125 ceph-mon[86115]: pgmap v984: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:39:35.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:34 smithi096 ceph-mon[112483]: pgmap v984: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:39:36.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:39:36.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:39:37.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:36 smithi125 ceph-mon[86115]: pgmap v985: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:37.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:36 smithi096 ceph-mon[112483]: pgmap v985: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:39.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:38 smithi125 ceph-mon[86115]: pgmap v986: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:39.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:38 smithi096 ceph-mon[112483]: pgmap v986: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:41.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:40 smithi125 ceph-mon[86115]: pgmap v987: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:41.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:40 smithi096 ceph-mon[112483]: pgmap v987: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:43.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:42 smithi125 ceph-mon[86115]: pgmap v988: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:43.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:42 smithi096 ceph-mon[112483]: pgmap v988: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:45.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:44 smithi125 ceph-mon[86115]: pgmap v989: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:39:45.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:44 smithi096 ceph-mon[112483]: pgmap v989: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:39:47.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:46 smithi125 ceph-mon[86115]: pgmap v990: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:47.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:46 smithi096 ceph-mon[112483]: pgmap v990: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:49.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:48 smithi125 ceph-mon[86115]: pgmap v991: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:49.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:48 smithi096 ceph-mon[112483]: pgmap v991: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:51.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:50 smithi125 ceph-mon[86115]: pgmap v992: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:51.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:39:51.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:50 smithi096 ceph-mon[112483]: pgmap v992: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:51.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:39:52.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:39:52.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:39:53.168 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:52 smithi096 ceph-mon[112483]: pgmap v993: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:53.168 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:52 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:39:53.168 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:52 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:39:53.169 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:52 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:39:53.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:52 smithi125 ceph-mon[86115]: pgmap v993: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:53.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:52 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:39:53.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:52 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:39:53.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:52 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:39:55.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:54 smithi125 ceph-mon[86115]: pgmap v994: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:39:55.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:54 smithi096 ceph-mon[112483]: pgmap v994: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:39:57.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:56 smithi125 ceph-mon[86115]: pgmap v995: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:57.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:56 smithi096 ceph-mon[112483]: pgmap v995: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:39:59.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:39:58 smithi125 ceph-mon[86115]: pgmap v996: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:39:59.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:39:58 smithi096 ceph-mon[112483]: pgmap v996: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:01.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:00 smithi125 ceph-mon[86115]: pgmap v997: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:01.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:00 smithi125 ceph-mon[86115]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T19:40:01.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:00 smithi096 ceph-mon[112483]: pgmap v997: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:01.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:00 smithi096 ceph-mon[112483]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T19:40:03.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:02 smithi125 ceph-mon[86115]: pgmap v998: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:03.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:02 smithi096 ceph-mon[112483]: pgmap v998: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:05.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:04 smithi125 ceph-mon[86115]: pgmap v999: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:40:05.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:04 smithi096 ceph-mon[112483]: pgmap v999: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:40:06.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:40:06.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:40:07.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:06 smithi125 ceph-mon[86115]: pgmap v1000: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:07.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:06 smithi096 ceph-mon[112483]: pgmap v1000: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:09.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:08 smithi125 ceph-mon[86115]: pgmap v1001: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:09.250 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:08 smithi096 ceph-mon[112483]: pgmap v1001: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:11.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:10 smithi125 ceph-mon[86115]: pgmap v1002: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:11.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:10 smithi096 ceph-mon[112483]: pgmap v1002: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:13.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:12 smithi125 ceph-mon[86115]: pgmap v1003: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:13.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:12 smithi096 ceph-mon[112483]: pgmap v1003: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:15.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:14 smithi125 ceph-mon[86115]: pgmap v1004: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:40:15.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:14 smithi096 ceph-mon[112483]: pgmap v1004: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:40:17.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:16 smithi125 ceph-mon[86115]: pgmap v1005: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:17.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:16 smithi096 ceph-mon[112483]: pgmap v1005: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:19.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:18 smithi096 ceph-mon[112483]: pgmap v1006: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:19.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:18 smithi125 ceph-mon[86115]: pgmap v1006: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:21.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:20 smithi096 ceph-mon[112483]: pgmap v1007: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:21.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:40:21.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:20 smithi125 ceph-mon[86115]: pgmap v1007: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:21.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:40:23.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:22 smithi096 ceph-mon[112483]: pgmap v1008: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:23.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:22 smithi125 ceph-mon[86115]: pgmap v1008: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:25.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:24 smithi125 ceph-mon[86115]: pgmap v1009: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:40:25.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:24 smithi096 ceph-mon[112483]: pgmap v1009: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:40:27.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:26 smithi096 ceph-mon[112483]: pgmap v1010: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:27.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:26 smithi125 ceph-mon[86115]: pgmap v1010: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:29.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:28 smithi096 ceph-mon[112483]: pgmap v1011: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:29.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:28 smithi125 ceph-mon[86115]: pgmap v1011: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:31.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:30 smithi096 ceph-mon[112483]: pgmap v1012: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:31.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:30 smithi125 ceph-mon[86115]: pgmap v1012: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:33.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:32 smithi096 ceph-mon[112483]: pgmap v1013: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:33.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:32 smithi125 ceph-mon[86115]: pgmap v1013: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:35.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:34 smithi096 ceph-mon[112483]: pgmap v1014: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:40:35.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:34 smithi125 ceph-mon[86115]: pgmap v1014: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:40:36.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:40:36.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:40:37.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:36 smithi096 ceph-mon[112483]: pgmap v1015: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:37.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:36 smithi125 ceph-mon[86115]: pgmap v1015: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:39.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:38 smithi096 ceph-mon[112483]: pgmap v1016: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:39.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:38 smithi125 ceph-mon[86115]: pgmap v1016: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:41.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:40 smithi096 ceph-mon[112483]: pgmap v1017: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:41.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:40 smithi125 ceph-mon[86115]: pgmap v1017: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:43.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:42 smithi096 ceph-mon[112483]: pgmap v1018: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:43.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:42 smithi125 ceph-mon[86115]: pgmap v1018: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:45.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:44 smithi096 ceph-mon[112483]: pgmap v1019: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:40:45.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:44 smithi125 ceph-mon[86115]: pgmap v1019: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:40:47.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:46 smithi096 ceph-mon[112483]: pgmap v1020: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:47.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:46 smithi125 ceph-mon[86115]: pgmap v1020: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:49.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:48 smithi096 ceph-mon[112483]: pgmap v1021: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:49.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:48 smithi125 ceph-mon[86115]: pgmap v1021: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:51.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:50 smithi096 ceph-mon[112483]: pgmap v1022: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:51.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:40:51.333 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:50 smithi125 ceph-mon[86115]: pgmap v1022: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:51.333 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:40:53.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:52 smithi096 ceph-mon[112483]: pgmap v1023: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:53.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:52 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:40:53.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:52 smithi125 ceph-mon[86115]: pgmap v1023: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:53.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:52 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:40:54.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:53 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:40:54.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:53 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:40:54.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:53 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:40:54.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:53 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:40:54.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:53 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:40:54.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:53 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:40:55.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:55 smithi125 ceph-mon[86115]: pgmap v1024: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:40:55.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:55 smithi096 ceph-mon[112483]: pgmap v1024: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:40:57.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:57 smithi125 ceph-mon[86115]: pgmap v1025: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:57.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:57 smithi096 ceph-mon[112483]: pgmap v1025: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:40:59.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:40:59 smithi125 ceph-mon[86115]: pgmap v1026: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:40:59.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:40:59 smithi096 ceph-mon[112483]: pgmap v1026: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:41:01.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:01 smithi125 ceph-mon[86115]: pgmap v1027: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:01.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:01 smithi096 ceph-mon[112483]: pgmap v1027: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:03.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:03 smithi125 ceph-mon[86115]: pgmap v1028: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:41:03.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:03 smithi096 ceph-mon[112483]: pgmap v1028: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:41:05.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:05 smithi125 ceph-mon[86115]: pgmap v1029: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:41:05.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:05 smithi096 ceph-mon[112483]: pgmap v1029: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:41:06.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:41:06.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:41:07.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:07 smithi125 ceph-mon[86115]: pgmap v1030: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:07.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:07 smithi096 ceph-mon[112483]: pgmap v1030: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:09.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:09 smithi125 ceph-mon[86115]: pgmap v1031: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:41:09.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:09 smithi096 ceph-mon[112483]: pgmap v1031: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:41:11.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:11 smithi125 ceph-mon[86115]: pgmap v1032: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:11.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:11 smithi096 ceph-mon[112483]: pgmap v1032: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:13.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:13 smithi125 ceph-mon[86115]: pgmap v1033: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:41:13.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:13 smithi096 ceph-mon[112483]: pgmap v1033: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:41:15.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:15 smithi096 ceph-mon[112483]: pgmap v1034: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:41:15.412 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:15 smithi125 ceph-mon[86115]: pgmap v1034: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:41:17.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:17 smithi125 ceph-mon[86115]: pgmap v1035: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:17.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:17 smithi096 ceph-mon[112483]: pgmap v1035: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:19.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:19 smithi125 ceph-mon[86115]: pgmap v1036: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:41:19.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:19 smithi096 ceph-mon[112483]: pgmap v1036: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:41:21.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:21 smithi125 ceph-mon[86115]: pgmap v1037: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:21.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:41:21.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:21 smithi096 ceph-mon[112483]: pgmap v1037: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:21.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:41:23.319 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:23 smithi096 ceph-mon[112483]: pgmap v1038: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:41:23.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:23 smithi125 ceph-mon[86115]: pgmap v1038: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:41:25.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:25 smithi125 ceph-mon[86115]: pgmap v1039: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:25.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:25 smithi096 ceph-mon[112483]: pgmap v1039: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:27.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:27 smithi125 ceph-mon[86115]: pgmap v1040: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:27.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:27 smithi096 ceph-mon[112483]: pgmap v1040: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:29.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:29 smithi125 ceph-mon[86115]: pgmap v1041: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:41:29.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:29 smithi096 ceph-mon[112483]: pgmap v1041: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:41:31.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:31 smithi125 ceph-mon[86115]: pgmap v1042: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:31.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:31 smithi096 ceph-mon[112483]: pgmap v1042: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:33.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:33 smithi125 ceph-mon[86115]: pgmap v1043: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:41:33.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:33 smithi096 ceph-mon[112483]: pgmap v1043: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:41:35.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:35 smithi096 ceph-mon[112483]: pgmap v1044: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:35.634 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:35 smithi125 ceph-mon[86115]: pgmap v1044: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:36.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:41:36.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:41:37.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:37 smithi096 ceph-mon[112483]: pgmap v1045: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:41:37.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:37 smithi125 ceph-mon[86115]: pgmap v1045: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:41:39.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:39 smithi096 ceph-mon[112483]: pgmap v1046: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:41:39.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:39 smithi125 ceph-mon[86115]: pgmap v1046: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:41:41.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:41 smithi096 ceph-mon[112483]: pgmap v1047: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:41.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:41 smithi125 ceph-mon[86115]: pgmap v1047: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:43.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:43 smithi096 ceph-mon[112483]: pgmap v1048: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:41:43.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:43 smithi125 ceph-mon[86115]: pgmap v1048: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:41:45.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:45 smithi096 ceph-mon[112483]: pgmap v1049: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:45.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:45 smithi125 ceph-mon[86115]: pgmap v1049: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:47.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:47 smithi096 ceph-mon[112483]: pgmap v1050: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:41:47.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:47 smithi125 ceph-mon[86115]: pgmap v1050: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:41:49.519 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:49 smithi096 ceph-mon[112483]: pgmap v1051: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:41:49.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:49 smithi125 ceph-mon[86115]: pgmap v1051: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:41:51.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:51 smithi096 ceph-mon[112483]: pgmap v1052: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:51.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:41:51.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:51 smithi125 ceph-mon[86115]: pgmap v1052: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:41:51.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:41:53.319 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:53 smithi096 ceph-mon[112483]: pgmap v1053: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:41:53.319 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:53 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:41:53.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:53 smithi125 ceph-mon[86115]: pgmap v1053: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:41:53.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:53 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:41:54.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:54 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:41:54.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:54 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:41:54.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:54 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:41:54.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:54 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:41:54.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:54 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:41:54.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:54 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:41:55.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:55 smithi096 ceph-mon[112483]: pgmap v1054: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:41:55.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:55 smithi125 ceph-mon[86115]: pgmap v1054: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:41:57.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:57 smithi096 ceph-mon[112483]: pgmap v1055: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-19T19:41:57.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:57 smithi125 ceph-mon[86115]: pgmap v1055: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-19T19:41:59.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:41:59 smithi096 ceph-mon[112483]: pgmap v1056: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:41:59.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:41:59 smithi125 ceph-mon[86115]: pgmap v1056: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:42:01.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:01 smithi096 ceph-mon[112483]: pgmap v1057: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:42:01.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:01 smithi125 ceph-mon[86115]: pgmap v1057: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:42:03.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:03 smithi096 ceph-mon[112483]: pgmap v1058: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:42:03.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:03 smithi125 ceph-mon[86115]: pgmap v1058: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:42:05.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:05 smithi096 ceph-mon[112483]: pgmap v1059: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:42:05.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:05 smithi125 ceph-mon[86115]: pgmap v1059: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:42:06.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:42:06.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:42:07.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:07 smithi096 ceph-mon[112483]: pgmap v1060: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:42:07.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:07 smithi125 ceph-mon[86115]: pgmap v1060: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:42:09.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:09 smithi125 ceph-mon[86115]: pgmap v1061: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:42:09.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:09 smithi096 ceph-mon[112483]: pgmap v1061: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:42:11.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:11 smithi125 ceph-mon[86115]: pgmap v1062: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:42:11.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:11 smithi096 ceph-mon[112483]: pgmap v1062: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:42:13.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:13 smithi096 ceph-mon[112483]: pgmap v1063: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:42:13.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:13 smithi125 ceph-mon[86115]: pgmap v1063: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:42:15.666 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:15 smithi096 ceph-mon[112483]: pgmap v1064: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:42:15.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:15 smithi125 ceph-mon[86115]: pgmap v1064: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:42:17.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:17 smithi125 ceph-mon[86115]: pgmap v1065: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:42:17.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:17 smithi096 ceph-mon[112483]: pgmap v1065: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:42:19.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:19 smithi125 ceph-mon[86115]: pgmap v1066: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:42:19.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:19 smithi096 ceph-mon[112483]: pgmap v1066: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:42:21.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:21 smithi125 ceph-mon[86115]: pgmap v1067: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:42:21.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:42:21.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:21 smithi096 ceph-mon[112483]: pgmap v1067: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:42:21.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:42:23.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:23 smithi096 ceph-mon[112483]: pgmap v1068: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:42:23.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:23 smithi125 ceph-mon[86115]: pgmap v1068: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:42:25.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:25 smithi125 ceph-mon[86115]: pgmap v1069: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:42:25.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:25 smithi096 ceph-mon[112483]: pgmap v1069: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:42:27.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:27 smithi125 ceph-mon[86115]: pgmap v1070: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:42:27.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:27 smithi096 ceph-mon[112483]: pgmap v1070: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:42:29.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:29 smithi125 ceph-mon[86115]: pgmap v1071: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:42:29.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:29 smithi096 ceph-mon[112483]: pgmap v1071: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:42:31.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:31 smithi125 ceph-mon[86115]: pgmap v1072: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:42:31.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:31 smithi096 ceph-mon[112483]: pgmap v1072: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:42:33.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:33 smithi125 ceph-mon[86115]: pgmap v1073: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:42:33.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:33 smithi096 ceph-mon[112483]: pgmap v1073: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:42:35.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:35 smithi125 ceph-mon[86115]: pgmap v1074: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:42:35.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:35 smithi096 ceph-mon[112483]: pgmap v1074: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:42:36.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:42:36.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:42:37.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:37 smithi125 ceph-mon[86115]: pgmap v1075: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:42:37.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:37 smithi096 ceph-mon[112483]: pgmap v1075: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:42:39.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:39 smithi125 ceph-mon[86115]: pgmap v1076: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:42:39.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:39 smithi096 ceph-mon[112483]: pgmap v1076: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:42:41.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:41 smithi125 ceph-mon[86115]: pgmap v1077: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:42:41.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:41 smithi096 ceph-mon[112483]: pgmap v1077: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:42:43.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:43 smithi125 ceph-mon[86115]: pgmap v1078: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:42:43.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:43 smithi096 ceph-mon[112483]: pgmap v1078: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:42:45.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:45 smithi125 ceph-mon[86115]: pgmap v1079: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:42:45.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:45 smithi096 ceph-mon[112483]: pgmap v1079: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:42:47.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:47 smithi125 ceph-mon[86115]: pgmap v1080: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:42:47.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:47 smithi096 ceph-mon[112483]: pgmap v1080: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:42:49.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:49 smithi125 ceph-mon[86115]: pgmap v1081: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:42:49.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:49 smithi096 ceph-mon[112483]: pgmap v1081: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:42:51.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:51 smithi125 ceph-mon[86115]: pgmap v1082: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:42:51.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:42:51.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:51 smithi096 ceph-mon[112483]: pgmap v1082: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:42:51.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:42:53.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:53 smithi125 ceph-mon[86115]: pgmap v1083: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:42:53.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:53 smithi096 ceph-mon[112483]: pgmap v1083: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:42:54.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:54 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:42:54.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:54 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:42:55.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:55 smithi125 ceph-mon[86115]: pgmap v1084: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:42:55.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:55 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:42:55.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:55 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:42:55.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:55 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:42:55.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:55 smithi096 ceph-mon[112483]: pgmap v1084: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:42:55.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:55 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:42:55.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:55 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:42:55.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:55 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:42:57.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:57 smithi125 ceph-mon[86115]: pgmap v1085: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:42:57.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:57 smithi096 ceph-mon[112483]: pgmap v1085: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:42:59.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:42:59 smithi125 ceph-mon[86115]: pgmap v1086: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:42:59.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:42:59 smithi096 ceph-mon[112483]: pgmap v1086: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:01.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:01 smithi096 ceph-mon[112483]: pgmap v1087: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:01.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:01 smithi125 ceph-mon[86115]: pgmap v1087: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:03.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:03 smithi125 ceph-mon[86115]: pgmap v1088: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:03.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:03 smithi096 ceph-mon[112483]: pgmap v1088: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:05.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:05 smithi125 ceph-mon[86115]: pgmap v1089: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:05.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:05 smithi096 ceph-mon[112483]: pgmap v1089: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:06.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:43:06.648 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:43:07.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:07 smithi125 ceph-mon[86115]: pgmap v1090: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:43:07.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:07 smithi096 ceph-mon[112483]: pgmap v1090: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:43:09.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:09 smithi125 ceph-mon[86115]: pgmap v1091: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:09.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:09 smithi096 ceph-mon[112483]: pgmap v1091: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:11.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:11 smithi125 ceph-mon[86115]: pgmap v1092: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:11.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:11 smithi096 ceph-mon[112483]: pgmap v1092: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:13.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:13 smithi125 ceph-mon[86115]: pgmap v1093: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:13.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:13 smithi096 ceph-mon[112483]: pgmap v1093: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:15.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:15 smithi125 ceph-mon[86115]: pgmap v1094: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:15.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:15 smithi096 ceph-mon[112483]: pgmap v1094: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:17.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:17 smithi125 ceph-mon[86115]: pgmap v1095: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:43:17.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:17 smithi096 ceph-mon[112483]: pgmap v1095: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:43:19.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:19 smithi125 ceph-mon[86115]: pgmap v1096: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:19.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:19 smithi096 ceph-mon[112483]: pgmap v1096: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:21.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:21 smithi125 ceph-mon[86115]: pgmap v1097: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:21.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:43:21.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:21 smithi096 ceph-mon[112483]: pgmap v1097: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:21.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:43:23.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:23 smithi125 ceph-mon[86115]: pgmap v1098: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:23.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:23 smithi096 ceph-mon[112483]: pgmap v1098: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:25.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:25 smithi125 ceph-mon[86115]: pgmap v1099: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:25.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:25 smithi096 ceph-mon[112483]: pgmap v1099: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:27.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:27 smithi125 ceph-mon[86115]: pgmap v1100: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:43:27.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:27 smithi096 ceph-mon[112483]: pgmap v1100: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:43:29.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:29 smithi125 ceph-mon[86115]: pgmap v1101: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:29.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:29 smithi096 ceph-mon[112483]: pgmap v1101: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:31.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:31 smithi125 ceph-mon[86115]: pgmap v1102: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:31.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:31 smithi096 ceph-mon[112483]: pgmap v1102: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:33.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:33 smithi125 ceph-mon[86115]: pgmap v1103: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:33.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:33 smithi096 ceph-mon[112483]: pgmap v1103: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:35.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:35 smithi125 ceph-mon[86115]: pgmap v1104: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:35.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:43:35.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:35 smithi096 ceph-mon[112483]: pgmap v1104: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:35.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:43:37.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:37 smithi125 ceph-mon[86115]: pgmap v1105: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:43:37.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:37 smithi096 ceph-mon[112483]: pgmap v1105: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:43:39.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:39 smithi125 ceph-mon[86115]: pgmap v1106: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:39.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:39 smithi096 ceph-mon[112483]: pgmap v1106: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:41.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:41 smithi125 ceph-mon[86115]: pgmap v1107: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:41.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:41 smithi096 ceph-mon[112483]: pgmap v1107: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:43.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:43 smithi096 ceph-mon[112483]: pgmap v1108: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:43.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:43 smithi125 ceph-mon[86115]: pgmap v1108: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:45.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:45 smithi096 ceph-mon[112483]: pgmap v1109: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:45.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:45 smithi125 ceph-mon[86115]: pgmap v1109: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:47.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:47 smithi096 ceph-mon[112483]: pgmap v1110: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:43:47.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:47 smithi125 ceph-mon[86115]: pgmap v1110: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:43:49.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:49 smithi096 ceph-mon[112483]: pgmap v1111: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:49.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:49 smithi125 ceph-mon[86115]: pgmap v1111: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:50.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:43:50.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:43:51.741 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:51 smithi096 ceph-mon[112483]: pgmap v1112: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:51.833 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:51 smithi125 ceph-mon[86115]: pgmap v1112: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:53.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:53 smithi096 ceph-mon[112483]: pgmap v1113: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:53.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:53 smithi125 ceph-mon[86115]: pgmap v1113: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:55.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:55 smithi096 ceph-mon[112483]: pgmap v1114: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:55.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:55 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:43:55.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:55 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:43:55.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:55 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:43:55.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:55 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:43:55.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:55 smithi125 ceph-mon[86115]: pgmap v1114: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:43:55.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:55 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:43:55.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:55 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:43:55.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:55 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:43:55.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:55 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:43:57.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:57 smithi125 ceph-mon[86115]: pgmap v1115: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:43:57.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:57 smithi096 ceph-mon[112483]: pgmap v1115: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:43:59.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:43:59 smithi096 ceph-mon[112483]: pgmap v1116: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:43:59.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:43:59 smithi125 ceph-mon[86115]: pgmap v1116: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:01.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:01 smithi096 ceph-mon[112483]: pgmap v1117: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:01.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:01 smithi125 ceph-mon[86115]: pgmap v1117: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:03.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:03 smithi096 ceph-mon[112483]: pgmap v1118: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:03.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:03 smithi125 ceph-mon[86115]: pgmap v1118: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:05.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:05 smithi096 ceph-mon[112483]: pgmap v1119: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:05.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:44:05.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:05 smithi125 ceph-mon[86115]: pgmap v1119: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:05.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:44:07.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:07 smithi125 ceph-mon[86115]: pgmap v1120: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:44:07.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:07 smithi096 ceph-mon[112483]: pgmap v1120: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:44:09.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:09 smithi096 ceph-mon[112483]: pgmap v1121: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:09.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:09 smithi125 ceph-mon[86115]: pgmap v1121: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:11.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:11 smithi096 ceph-mon[112483]: pgmap v1122: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:11.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:11 smithi125 ceph-mon[86115]: pgmap v1122: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:13.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:13 smithi096 ceph-mon[112483]: pgmap v1123: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:13.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:13 smithi125 ceph-mon[86115]: pgmap v1123: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:15.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:15 smithi096 ceph-mon[112483]: pgmap v1124: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:15.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:15 smithi125 ceph-mon[86115]: pgmap v1124: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:17.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:17 smithi096 ceph-mon[112483]: pgmap v1125: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:44:17.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:17 smithi125 ceph-mon[86115]: pgmap v1125: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:44:19.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:19 smithi096 ceph-mon[112483]: pgmap v1126: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:19.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:19 smithi125 ceph-mon[86115]: pgmap v1126: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:20.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:44:20.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:44:21.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:21 smithi096 ceph-mon[112483]: pgmap v1127: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:21.832 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:21 smithi125 ceph-mon[86115]: pgmap v1127: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:23.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:23 smithi096 ceph-mon[112483]: pgmap v1128: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:23.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:23 smithi125 ceph-mon[86115]: pgmap v1128: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:25.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:25 smithi096 ceph-mon[112483]: pgmap v1129: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:25.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:25 smithi125 ceph-mon[86115]: pgmap v1129: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:27.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:27 smithi096 ceph-mon[112483]: pgmap v1130: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:44:27.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:27 smithi125 ceph-mon[86115]: pgmap v1130: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:44:29.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:29 smithi096 ceph-mon[112483]: pgmap v1131: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:29.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:29 smithi125 ceph-mon[86115]: pgmap v1131: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:31.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:31 smithi096 ceph-mon[112483]: pgmap v1132: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:31.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:31 smithi125 ceph-mon[86115]: pgmap v1132: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:33.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:33 smithi096 ceph-mon[112483]: pgmap v1133: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:33.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:33 smithi125 ceph-mon[86115]: pgmap v1133: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:35.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:35 smithi125 ceph-mon[86115]: pgmap v1134: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:35.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:44:36.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:35 smithi096 ceph-mon[112483]: pgmap v1134: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:36.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:44:37.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:37 smithi125 ceph-mon[86115]: pgmap v1135: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:44:38.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:37 smithi096 ceph-mon[112483]: pgmap v1135: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:44:39.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:39 smithi125 ceph-mon[86115]: pgmap v1136: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:40.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:39 smithi096 ceph-mon[112483]: pgmap v1136: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:41.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:41 smithi125 ceph-mon[86115]: pgmap v1137: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:42.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:41 smithi096 ceph-mon[112483]: pgmap v1137: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:43.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:43 smithi125 ceph-mon[86115]: pgmap v1138: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:44.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:43 smithi096 ceph-mon[112483]: pgmap v1138: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:45.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:45 smithi125 ceph-mon[86115]: pgmap v1139: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:46.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:45 smithi096 ceph-mon[112483]: pgmap v1139: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:47.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:47 smithi096 ceph-mon[112483]: pgmap v1140: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:44:47.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:47 smithi125 ceph-mon[86115]: pgmap v1140: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:44:49.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:49 smithi125 ceph-mon[86115]: pgmap v1141: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:50.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:49 smithi096 ceph-mon[112483]: pgmap v1141: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:50.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:44:51.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:44:51.832 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:51 smithi125 ceph-mon[86115]: pgmap v1142: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:52.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:51 smithi096 ceph-mon[112483]: pgmap v1142: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:53.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:53 smithi125 ceph-mon[86115]: pgmap v1143: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:54.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:53 smithi096 ceph-mon[112483]: pgmap v1143: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:55.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:55 smithi125 ceph-mon[86115]: pgmap v1144: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:55.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:55 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:44:56.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:55 smithi096 ceph-mon[112483]: pgmap v1144: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:44:56.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:55 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:44:57.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:57 smithi096 ceph-mon[112483]: pgmap v1145: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:44:57.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:57 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:44:57.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:57 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:44:57.887 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:57 smithi125 ceph-mon[86115]: pgmap v1145: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:44:57.887 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:57 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:44:57.887 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:57 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:44:59.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:59 smithi125 ceph-mon[86115]: pgmap v1146: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:44:59.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:59 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:44:59.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:44:59 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:45:00.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:59 smithi096 ceph-mon[112483]: pgmap v1146: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:00.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:59 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:45:00.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:44:59 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:45:01.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:45:01.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:00 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:45:01.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:00 smithi125 ceph-mon[86115]: pgmap v1147: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:01.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:45:01.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:00 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:45:01.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:00 smithi096 ceph-mon[112483]: pgmap v1147: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:02.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:01 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:45:02.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:01 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:45:02.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:01 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:45:02.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:01 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:45:02.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:01 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:45:02.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:01 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:45:02.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:01 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:45:02.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:01 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:45:03.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:02 smithi096 ceph-mon[112483]: pgmap v1148: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:03.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:02 smithi125 ceph-mon[86115]: pgmap v1148: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:05.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:05 smithi096 ceph-mon[112483]: pgmap v1149: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:05.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:45:05.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:45:05.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:45:05.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:45:05.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:45:05.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:45:05.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:05 smithi125 ceph-mon[86115]: pgmap v1149: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:05.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:45:05.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:45:05.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:45:05.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:45:05.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:45:05.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:45:07.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:07 smithi096 ceph-mon[112483]: pgmap v1150: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:45:07.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:07 smithi125 ceph-mon[86115]: pgmap v1150: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:45:09.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:09 smithi096 ceph-mon[112483]: pgmap v1151: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:09.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:09 smithi125 ceph-mon[86115]: pgmap v1151: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:11.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:11 smithi096 ceph-mon[112483]: pgmap v1152: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:11.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:11 smithi125 ceph-mon[86115]: pgmap v1152: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:13.746 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:13 smithi096 ceph-mon[112483]: pgmap v1153: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:13.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:13 smithi125 ceph-mon[86115]: pgmap v1153: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:15.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:15 smithi096 ceph-mon[112483]: pgmap v1154: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:15.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:15 smithi125 ceph-mon[86115]: pgmap v1154: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:17.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:17 smithi096 ceph-mon[112483]: pgmap v1155: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:45:17.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:17 smithi125 ceph-mon[86115]: pgmap v1155: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:45:19.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:19 smithi096 ceph-mon[112483]: pgmap v1156: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:19.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:19 smithi125 ceph-mon[86115]: pgmap v1156: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:20.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:45:20.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:45:21.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:21 smithi096 ceph-mon[112483]: pgmap v1157: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:21.833 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:21 smithi125 ceph-mon[86115]: pgmap v1157: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:23.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:23 smithi096 ceph-mon[112483]: pgmap v1158: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:23.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:23 smithi125 ceph-mon[86115]: pgmap v1158: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:25.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:25 smithi096 ceph-mon[112483]: pgmap v1159: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:25.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:25 smithi125 ceph-mon[86115]: pgmap v1159: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:27.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:27 smithi096 ceph-mon[112483]: pgmap v1160: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:45:27.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:27 smithi125 ceph-mon[86115]: pgmap v1160: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:45:29.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:29 smithi096 ceph-mon[112483]: pgmap v1161: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:29.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:29 smithi125 ceph-mon[86115]: pgmap v1161: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:31.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:31 smithi096 ceph-mon[112483]: pgmap v1162: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:31.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:31 smithi125 ceph-mon[86115]: pgmap v1162: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:33.533 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:33 smithi125 ceph-mon[86115]: pgmap v1163: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:33.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:33 smithi096 ceph-mon[112483]: pgmap v1163: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:35.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:35 smithi096 ceph-mon[112483]: pgmap v1164: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:35.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:45:35.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:35 smithi125 ceph-mon[86115]: pgmap v1164: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:35.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:45:37.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:37 smithi096 ceph-mon[112483]: pgmap v1165: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:45:37.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:37 smithi125 ceph-mon[86115]: pgmap v1165: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:45:39.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:39 smithi096 ceph-mon[112483]: pgmap v1166: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:39.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:39 smithi125 ceph-mon[86115]: pgmap v1166: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:41.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:41 smithi096 ceph-mon[112483]: pgmap v1167: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:41.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:41 smithi125 ceph-mon[86115]: pgmap v1167: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:43.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:43 smithi125 ceph-mon[86115]: pgmap v1168: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:43.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:43 smithi096 ceph-mon[112483]: pgmap v1168: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:45.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:45 smithi096 ceph-mon[112483]: pgmap v1169: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:45.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:45 smithi125 ceph-mon[86115]: pgmap v1169: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:47.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:47 smithi125 ceph-mon[86115]: pgmap v1170: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:45:48.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:47 smithi096 ceph-mon[112483]: pgmap v1170: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:45:49.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:49 smithi125 ceph-mon[86115]: pgmap v1171: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:50.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:49 smithi096 ceph-mon[112483]: pgmap v1171: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:50.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:45:51.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:45:51.832 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:51 smithi125 ceph-mon[86115]: pgmap v1172: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:52.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:51 smithi096 ceph-mon[112483]: pgmap v1172: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:53.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:53 smithi125 ceph-mon[86115]: pgmap v1173: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:54.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:53 smithi096 ceph-mon[112483]: pgmap v1173: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:45:55.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:55 smithi125 ceph-mon[86115]: pgmap v1174: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:56.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:55 smithi096 ceph-mon[112483]: pgmap v1174: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:45:57.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:57 smithi125 ceph-mon[86115]: pgmap v1175: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:45:58.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:57 smithi096 ceph-mon[112483]: pgmap v1175: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:45:59.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:45:59 smithi125 ceph-mon[86115]: pgmap v1176: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:00.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:45:59 smithi096 ceph-mon[112483]: pgmap v1176: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:01.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:01 smithi125 ceph-mon[86115]: pgmap v1177: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:02.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:01 smithi096 ceph-mon[112483]: pgmap v1177: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:03.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:03 smithi125 ceph-mon[86115]: pgmap v1178: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:04.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:03 smithi096 ceph-mon[112483]: pgmap v1178: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:05.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:05 smithi125 ceph-mon[86115]: pgmap v1179: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:05.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:46:05.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:46:05.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:46:05.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:46:05.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:46:06.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:05 smithi096 ceph-mon[112483]: pgmap v1179: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:06.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:46:06.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:46:06.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:46:06.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:46:06.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:46:07.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:07 smithi125 ceph-mon[86115]: pgmap v1180: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:46:08.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:07 smithi096 ceph-mon[112483]: pgmap v1180: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:46:09.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:09 smithi125 ceph-mon[86115]: pgmap v1181: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:10.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:09 smithi096 ceph-mon[112483]: pgmap v1181: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:11.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:11 smithi125 ceph-mon[86115]: pgmap v1182: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:12.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:11 smithi096 ceph-mon[112483]: pgmap v1182: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:13.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:13 smithi096 ceph-mon[112483]: pgmap v1183: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:13.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:13 smithi125 ceph-mon[86115]: pgmap v1183: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:15.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:15 smithi125 ceph-mon[86115]: pgmap v1184: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:16.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:15 smithi096 ceph-mon[112483]: pgmap v1184: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:17.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:17 smithi125 ceph-mon[86115]: pgmap v1185: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:46:18.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:17 smithi096 ceph-mon[112483]: pgmap v1185: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:46:19.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:19 smithi125 ceph-mon[86115]: pgmap v1186: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:20.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:19 smithi096 ceph-mon[112483]: pgmap v1186: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:20.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:46:21.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:46:21.832 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:21 smithi125 ceph-mon[86115]: pgmap v1187: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:22.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:21 smithi096 ceph-mon[112483]: pgmap v1187: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:23.713 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:23 smithi096 ceph-mon[112483]: pgmap v1188: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:23.839 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:23 smithi125 ceph-mon[86115]: pgmap v1188: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:25.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:25 smithi125 ceph-mon[86115]: pgmap v1189: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:26.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:25 smithi096 ceph-mon[112483]: pgmap v1189: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:27.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:27 smithi125 ceph-mon[86115]: pgmap v1190: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:46:28.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:27 smithi096 ceph-mon[112483]: pgmap v1190: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:46:29.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:29 smithi125 ceph-mon[86115]: pgmap v1191: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:30.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:29 smithi096 ceph-mon[112483]: pgmap v1191: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:31.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:31 smithi125 ceph-mon[86115]: pgmap v1192: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:32.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:31 smithi096 ceph-mon[112483]: pgmap v1192: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:33.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:33 smithi125 ceph-mon[86115]: pgmap v1193: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:34.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:33 smithi096 ceph-mon[112483]: pgmap v1193: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:35.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:35 smithi125 ceph-mon[86115]: pgmap v1194: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:35.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:46:36.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:35 smithi096 ceph-mon[112483]: pgmap v1194: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:36.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:46:37.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:37 smithi125 ceph-mon[86115]: pgmap v1195: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:46:38.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:37 smithi096 ceph-mon[112483]: pgmap v1195: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:46:39.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:39 smithi125 ceph-mon[86115]: pgmap v1196: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:40.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:39 smithi096 ceph-mon[112483]: pgmap v1196: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:41.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:41 smithi125 ceph-mon[86115]: pgmap v1197: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:42.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:41 smithi096 ceph-mon[112483]: pgmap v1197: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:43.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:43 smithi125 ceph-mon[86115]: pgmap v1198: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:44.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:43 smithi096 ceph-mon[112483]: pgmap v1198: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:45.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:45 smithi125 ceph-mon[86115]: pgmap v1199: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:46.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:45 smithi096 ceph-mon[112483]: pgmap v1199: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:47.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:47 smithi125 ceph-mon[86115]: pgmap v1200: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:46:48.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:47 smithi096 ceph-mon[112483]: pgmap v1200: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:46:49.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:49 smithi125 ceph-mon[86115]: pgmap v1201: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:50.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:49 smithi096 ceph-mon[112483]: pgmap v1201: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:50.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:46:51.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:46:51.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:51 smithi125 ceph-mon[86115]: pgmap v1202: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:52.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:51 smithi096 ceph-mon[112483]: pgmap v1202: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:53.777 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:53 smithi096 ceph-mon[112483]: pgmap v1203: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:53.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:53 smithi125 ceph-mon[86115]: pgmap v1203: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:46:55.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:55 smithi125 ceph-mon[86115]: pgmap v1204: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:56.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:55 smithi096 ceph-mon[112483]: pgmap v1204: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:46:57.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:57 smithi125 ceph-mon[86115]: pgmap v1205: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:46:58.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:57 smithi096 ceph-mon[112483]: pgmap v1205: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:46:59.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:46:59 smithi125 ceph-mon[86115]: pgmap v1206: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:00.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:46:59 smithi096 ceph-mon[112483]: pgmap v1206: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:01.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:01 smithi125 ceph-mon[86115]: pgmap v1207: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:02.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:01 smithi096 ceph-mon[112483]: pgmap v1207: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:03.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:03 smithi125 ceph-mon[86115]: pgmap v1208: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:04.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:03 smithi096 ceph-mon[112483]: pgmap v1208: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:05.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:05 smithi125 ceph-mon[86115]: pgmap v1209: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:05.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:47:05.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:47:06.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:05 smithi096 ceph-mon[112483]: pgmap v1209: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:06.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:47:06.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:47:07.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:47:07.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:47:07.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:06 smithi125 ceph-mon[86115]: pgmap v1210: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:47:07.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:47:07.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:47:07.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:47:07.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:47:07.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:47:07.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:06 smithi096 ceph-mon[112483]: pgmap v1210: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:47:07.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:47:07.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:47:07.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:47:09.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:08 smithi125 ceph-mon[86115]: pgmap v1211: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:09.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:08 smithi096 ceph-mon[112483]: pgmap v1211: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:11.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:10 smithi125 ceph-mon[86115]: pgmap v1212: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:11.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:10 smithi096 ceph-mon[112483]: pgmap v1212: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:13.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:12 smithi125 ceph-mon[86115]: pgmap v1213: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:13.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:12 smithi096 ceph-mon[112483]: pgmap v1213: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:15.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:14 smithi096 ceph-mon[112483]: pgmap v1214: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:15.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:14 smithi125 ceph-mon[86115]: pgmap v1214: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:17.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:16 smithi096 ceph-mon[112483]: pgmap v1215: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:47:17.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:16 smithi125 ceph-mon[86115]: pgmap v1215: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:47:19.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:18 smithi096 ceph-mon[112483]: pgmap v1216: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:19.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:18 smithi125 ceph-mon[86115]: pgmap v1216: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:21.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:20 smithi096 ceph-mon[112483]: pgmap v1217: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:21.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:47:21.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:20 smithi125 ceph-mon[86115]: pgmap v1217: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:21.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:47:23.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:22 smithi096 ceph-mon[112483]: pgmap v1218: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:23.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:22 smithi125 ceph-mon[86115]: pgmap v1218: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:25.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:24 smithi096 ceph-mon[112483]: pgmap v1219: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:25.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:24 smithi125 ceph-mon[86115]: pgmap v1219: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:27.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:26 smithi096 ceph-mon[112483]: pgmap v1220: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:47:27.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:26 smithi125 ceph-mon[86115]: pgmap v1220: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:47:29.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:28 smithi096 ceph-mon[112483]: pgmap v1221: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:29.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:28 smithi125 ceph-mon[86115]: pgmap v1221: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:31.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:30 smithi096 ceph-mon[112483]: pgmap v1222: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:31.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:30 smithi125 ceph-mon[86115]: pgmap v1222: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:33.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:32 smithi096 ceph-mon[112483]: pgmap v1223: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:33.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:32 smithi125 ceph-mon[86115]: pgmap v1223: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:35.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:34 smithi096 ceph-mon[112483]: pgmap v1224: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:35.430 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:34 smithi125 ceph-mon[86115]: pgmap v1224: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:36.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:47:36.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:47:37.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:36 smithi096 ceph-mon[112483]: pgmap v1225: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:47:37.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:36 smithi125 ceph-mon[86115]: pgmap v1225: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:47:39.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:38 smithi096 ceph-mon[112483]: pgmap v1226: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:39.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:38 smithi125 ceph-mon[86115]: pgmap v1226: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:41.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:40 smithi096 ceph-mon[112483]: pgmap v1227: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:41.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:40 smithi125 ceph-mon[86115]: pgmap v1227: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:43.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:42 smithi096 ceph-mon[112483]: pgmap v1228: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:43.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:42 smithi125 ceph-mon[86115]: pgmap v1228: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:45.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:44 smithi125 ceph-mon[86115]: pgmap v1229: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:45.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:44 smithi096 ceph-mon[112483]: pgmap v1229: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:47.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:46 smithi096 ceph-mon[112483]: pgmap v1230: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:47:47.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:46 smithi125 ceph-mon[86115]: pgmap v1230: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:47:49.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:48 smithi096 ceph-mon[112483]: pgmap v1231: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:49.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:48 smithi125 ceph-mon[86115]: pgmap v1231: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:51.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:50 smithi096 ceph-mon[112483]: pgmap v1232: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:51.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:47:51.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:50 smithi125 ceph-mon[86115]: pgmap v1232: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:51.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:47:53.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:52 smithi096 ceph-mon[112483]: pgmap v1233: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:53.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:52 smithi125 ceph-mon[86115]: pgmap v1233: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:55.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:55 smithi125 ceph-mon[86115]: pgmap v1234: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:55.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:55 smithi096 ceph-mon[112483]: pgmap v1234: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:47:57.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:57 smithi096 ceph-mon[112483]: pgmap v1235: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:47:57.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:57 smithi125 ceph-mon[86115]: pgmap v1235: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:47:59.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:47:59 smithi096 ceph-mon[112483]: pgmap v1236: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:47:59.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:47:59 smithi125 ceph-mon[86115]: pgmap v1236: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:01.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:01 smithi096 ceph-mon[112483]: pgmap v1237: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:01.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:01 smithi125 ceph-mon[86115]: pgmap v1237: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:03.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:03 smithi096 ceph-mon[112483]: pgmap v1238: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:03.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:03 smithi125 ceph-mon[86115]: pgmap v1238: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:05.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:05 smithi096 ceph-mon[112483]: pgmap v1239: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:05.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:05 smithi125 ceph-mon[86115]: pgmap v1239: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:06.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:48:06.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:48:07.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:07 smithi125 ceph-mon[86115]: pgmap v1240: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:48:07.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:07 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:48:07.515 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:07 smithi096 ceph-mon[112483]: pgmap v1240: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:48:07.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:07 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:48:08.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:08 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:48:08.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:08 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:48:08.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:08 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:48:08.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:08 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:48:08.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:08 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:48:08.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:08 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:48:09.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:09 smithi125 ceph-mon[86115]: pgmap v1241: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:09.515 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:09 smithi096 ceph-mon[112483]: pgmap v1241: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:11.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:11 smithi125 ceph-mon[86115]: pgmap v1242: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:11.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:11 smithi096 ceph-mon[112483]: pgmap v1242: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:13.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:13 smithi125 ceph-mon[86115]: pgmap v1243: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:13.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:13 smithi096 ceph-mon[112483]: pgmap v1243: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:15.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:15 smithi125 ceph-mon[86115]: pgmap v1244: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:15.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:15 smithi096 ceph-mon[112483]: pgmap v1244: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:17.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:17 smithi096 ceph-mon[112483]: pgmap v1245: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:48:17.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:17 smithi125 ceph-mon[86115]: pgmap v1245: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:48:19.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:19 smithi096 ceph-mon[112483]: pgmap v1246: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:19.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:19 smithi125 ceph-mon[86115]: pgmap v1246: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:21.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:21 smithi096 ceph-mon[112483]: pgmap v1247: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:21.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:48:21.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:21 smithi125 ceph-mon[86115]: pgmap v1247: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:21.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:48:23.318 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:23 smithi096 ceph-mon[112483]: pgmap v1248: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:23.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:23 smithi125 ceph-mon[86115]: pgmap v1248: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:25.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:25 smithi096 ceph-mon[112483]: pgmap v1249: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:25.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:25 smithi125 ceph-mon[86115]: pgmap v1249: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:27.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:27 smithi096 ceph-mon[112483]: pgmap v1250: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:48:27.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:27 smithi125 ceph-mon[86115]: pgmap v1250: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:48:29.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:29 smithi096 ceph-mon[112483]: pgmap v1251: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:29.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:29 smithi125 ceph-mon[86115]: pgmap v1251: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:31.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:31 smithi096 ceph-mon[112483]: pgmap v1252: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:31.680 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:31 smithi125 ceph-mon[86115]: pgmap v1252: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:33.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:33 smithi096 ceph-mon[112483]: pgmap v1253: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:33.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:33 smithi125 ceph-mon[86115]: pgmap v1253: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:35.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:35 smithi096 ceph-mon[112483]: pgmap v1254: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:35.680 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:35 smithi125 ceph-mon[86115]: pgmap v1254: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:36.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:48:36.680 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:48:37.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:37 smithi096 ceph-mon[112483]: pgmap v1255: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:48:37.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:37 smithi125 ceph-mon[86115]: pgmap v1255: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:48:39.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:39 smithi096 ceph-mon[112483]: pgmap v1256: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:39.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:39 smithi125 ceph-mon[86115]: pgmap v1256: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:41.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:41 smithi096 ceph-mon[112483]: pgmap v1257: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:41.680 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:41 smithi125 ceph-mon[86115]: pgmap v1257: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:43.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:43 smithi096 ceph-mon[112483]: pgmap v1258: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:43.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:43 smithi125 ceph-mon[86115]: pgmap v1258: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:45.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:45 smithi096 ceph-mon[112483]: pgmap v1259: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:45.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:45 smithi125 ceph-mon[86115]: pgmap v1259: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:47.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:47 smithi096 ceph-mon[112483]: pgmap v1260: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:48:47.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:47 smithi125 ceph-mon[86115]: pgmap v1260: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:48:49.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:49 smithi096 ceph-mon[112483]: pgmap v1261: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:49.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:49 smithi125 ceph-mon[86115]: pgmap v1261: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:51.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:51 smithi096 ceph-mon[112483]: pgmap v1262: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:51.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:48:51.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:51 smithi125 ceph-mon[86115]: pgmap v1262: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:51.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:48:53.318 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:53 smithi096 ceph-mon[112483]: pgmap v1263: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:53.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:53 smithi125 ceph-mon[86115]: pgmap v1263: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:55.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:55 smithi096 ceph-mon[112483]: pgmap v1264: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:55.534 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:55 smithi125 ceph-mon[86115]: pgmap v1264: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:48:57.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:57 smithi096 ceph-mon[112483]: pgmap v1265: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:48:57.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:57 smithi125 ceph-mon[86115]: pgmap v1265: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:48:59.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:48:59 smithi096 ceph-mon[112483]: pgmap v1266: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:48:59.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:48:59 smithi125 ceph-mon[86115]: pgmap v1266: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:49:01.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:01 smithi096 ceph-mon[112483]: pgmap v1267: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:49:01.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:01 smithi125 ceph-mon[86115]: pgmap v1267: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:49:03.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:03 smithi096 ceph-mon[112483]: pgmap v1268: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:49:03.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:03 smithi125 ceph-mon[86115]: pgmap v1268: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:49:05.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:05 smithi096 ceph-mon[112483]: pgmap v1269: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:49:05.650 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:05 smithi125 ceph-mon[86115]: pgmap v1269: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:49:06.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:49:06.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:49:07.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:07 smithi096 ceph-mon[112483]: pgmap v1270: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:49:07.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:07 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:49:07.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:07 smithi125 ceph-mon[86115]: pgmap v1270: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:49:07.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:07 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:49:09.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:08 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:49:09.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:08 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:49:09.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:08 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:49:09.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:08 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:49:09.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:08 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:49:09.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:08 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:49:09.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:08 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:49:09.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:08 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:49:09.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:08 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:49:09.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:08 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:49:10.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:09 smithi125 ceph-mon[86115]: pgmap v1271: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:49:10.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:09 smithi096 ceph-mon[112483]: pgmap v1271: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:49:12.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:11 smithi125 ceph-mon[86115]: pgmap v1272: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:49:12.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:11 smithi096 ceph-mon[112483]: pgmap v1272: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:49:14.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:13 smithi125 ceph-mon[86115]: pgmap v1273: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:49:14.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:13 smithi096 ceph-mon[112483]: pgmap v1273: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:49:16.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:15 smithi125 ceph-mon[86115]: pgmap v1274: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:49:16.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:15 smithi096 ceph-mon[112483]: pgmap v1274: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:49:17.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:16 smithi125 ceph-mon[86115]: pgmap v1275: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:49:17.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:16 smithi096 ceph-mon[112483]: pgmap v1275: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:49:19.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:18 smithi096 ceph-mon[112483]: pgmap v1276: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:49:19.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:18 smithi125 ceph-mon[86115]: pgmap v1276: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:49:21.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:20 smithi125 ceph-mon[86115]: pgmap v1277: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:49:21.181 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:49:21.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:20 smithi096 ceph-mon[112483]: pgmap v1277: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:49:21.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:49:23.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:22 smithi096 ceph-mon[112483]: pgmap v1278: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:49:23.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:22 smithi125 ceph-mon[86115]: pgmap v1278: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:49:25.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:24 smithi096 ceph-mon[112483]: pgmap v1279: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:49:25.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:24 smithi125 ceph-mon[86115]: pgmap v1279: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:49:27.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:26 smithi096 ceph-mon[112483]: pgmap v1280: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-19T19:49:27.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:26 smithi125 ceph-mon[86115]: pgmap v1280: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-19T19:49:29.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:28 smithi096 ceph-mon[112483]: pgmap v1281: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:49:29.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:28 smithi125 ceph-mon[86115]: pgmap v1281: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:49:31.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:30 smithi096 ceph-mon[112483]: pgmap v1282: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:49:31.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:30 smithi125 ceph-mon[86115]: pgmap v1282: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:49:33.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:32 smithi096 ceph-mon[112483]: pgmap v1283: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:49:33.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:32 smithi125 ceph-mon[86115]: pgmap v1283: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:49:35.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:34 smithi096 ceph-mon[112483]: pgmap v1284: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:49:35.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:34 smithi125 ceph-mon[86115]: pgmap v1284: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:49:36.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:49:36.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:49:37.266 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:36 smithi096 ceph-mon[112483]: pgmap v1285: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:49:37.431 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:36 smithi125 ceph-mon[86115]: pgmap v1285: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:49:39.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:39 smithi125 ceph-mon[86115]: pgmap v1286: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:49:39.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:39 smithi096 ceph-mon[112483]: pgmap v1286: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:49:41.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:41 smithi125 ceph-mon[86115]: pgmap v1287: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:49:41.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:41 smithi096 ceph-mon[112483]: pgmap v1287: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:49:43.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:43 smithi125 ceph-mon[86115]: pgmap v1288: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:49:43.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:43 smithi096 ceph-mon[112483]: pgmap v1288: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:49:45.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:45 smithi125 ceph-mon[86115]: pgmap v1289: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:49:45.690 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:45 smithi096 ceph-mon[112483]: pgmap v1289: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:49:47.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:47 smithi125 ceph-mon[86115]: pgmap v1290: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:49:47.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:47 smithi096 ceph-mon[112483]: pgmap v1290: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:49:49.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:49 smithi125 ceph-mon[86115]: pgmap v1291: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:49:49.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:49 smithi096 ceph-mon[112483]: pgmap v1291: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:49:51.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:51 smithi125 ceph-mon[86115]: pgmap v1292: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:49:51.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:49:51.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:51 smithi096 ceph-mon[112483]: pgmap v1292: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:49:51.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:49:53.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:53 smithi125 ceph-mon[86115]: pgmap v1293: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:49:53.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:53 smithi096 ceph-mon[112483]: pgmap v1293: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:49:55.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:55 smithi125 ceph-mon[86115]: pgmap v1294: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:49:55.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:55 smithi096 ceph-mon[112483]: pgmap v1294: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:49:57.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:57 smithi125 ceph-mon[86115]: pgmap v1295: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:49:57.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:57 smithi096 ceph-mon[112483]: pgmap v1295: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:49:59.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:49:59 smithi125 ceph-mon[86115]: pgmap v1296: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:49:59.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:49:59 smithi096 ceph-mon[112483]: pgmap v1296: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:00.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:00 smithi125 ceph-mon[86115]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T19:50:00.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:00 smithi096 ceph-mon[112483]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T19:50:01.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:01 smithi125 ceph-mon[86115]: pgmap v1297: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:01.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:01 smithi096 ceph-mon[112483]: pgmap v1297: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:03.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:03 smithi125 ceph-mon[86115]: pgmap v1298: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:03.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:03 smithi096 ceph-mon[112483]: pgmap v1298: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:05.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:05 smithi125 ceph-mon[86115]: pgmap v1299: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:05.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:05 smithi096 ceph-mon[112483]: pgmap v1299: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:06.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:50:06.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:50:07.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:07 smithi125 ceph-mon[86115]: pgmap v1300: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:50:07.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:07 smithi096 ceph-mon[112483]: pgmap v1300: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:50:09.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:09 smithi125 ceph-mon[86115]: pgmap v1301: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:09.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:09 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:50:09.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:09 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:50:09.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:09 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:50:09.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:09 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:50:09.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:09 smithi096 ceph-mon[112483]: pgmap v1301: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:09.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:09 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:50:09.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:09 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:50:09.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:09 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:50:09.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:09 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:50:11.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:11 smithi125 ceph-mon[86115]: pgmap v1302: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:11.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:11 smithi096 ceph-mon[112483]: pgmap v1302: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:13.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:13 smithi125 ceph-mon[86115]: pgmap v1303: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:13.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:13 smithi096 ceph-mon[112483]: pgmap v1303: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:15.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:15 smithi125 ceph-mon[86115]: pgmap v1304: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:15.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:15 smithi096 ceph-mon[112483]: pgmap v1304: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:17.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:17 smithi125 ceph-mon[86115]: pgmap v1305: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:50:17.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:17 smithi096 ceph-mon[112483]: pgmap v1305: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:50:19.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:19 smithi125 ceph-mon[86115]: pgmap v1306: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:19.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:19 smithi096 ceph-mon[112483]: pgmap v1306: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:21.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:21 smithi125 ceph-mon[86115]: pgmap v1307: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:21.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:50:21.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:21 smithi096 ceph-mon[112483]: pgmap v1307: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:21.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:50:23.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:23 smithi125 ceph-mon[86115]: pgmap v1308: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:23.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:23 smithi096 ceph-mon[112483]: pgmap v1308: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:25.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:25 smithi125 ceph-mon[86115]: pgmap v1309: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:25.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:25 smithi096 ceph-mon[112483]: pgmap v1309: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:27.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:27 smithi125 ceph-mon[86115]: pgmap v1310: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:50:27.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:27 smithi096 ceph-mon[112483]: pgmap v1310: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:50:29.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:29 smithi125 ceph-mon[86115]: pgmap v1311: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:29.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:29 smithi096 ceph-mon[112483]: pgmap v1311: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:31.516 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:31 smithi096 ceph-mon[112483]: pgmap v1312: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:31.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:31 smithi125 ceph-mon[86115]: pgmap v1312: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:33.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:33 smithi125 ceph-mon[86115]: pgmap v1313: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:33.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:33 smithi096 ceph-mon[112483]: pgmap v1313: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:35.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:35 smithi125 ceph-mon[86115]: pgmap v1314: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:35.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:50:35.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:35 smithi096 ceph-mon[112483]: pgmap v1314: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:35.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:50:37.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:37 smithi125 ceph-mon[86115]: pgmap v1315: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:50:37.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:37 smithi096 ceph-mon[112483]: pgmap v1315: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:50:39.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:39 smithi125 ceph-mon[86115]: pgmap v1316: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:39.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:39 smithi096 ceph-mon[112483]: pgmap v1316: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:41.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:41 smithi125 ceph-mon[86115]: pgmap v1317: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:41.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:41 smithi096 ceph-mon[112483]: pgmap v1317: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:43.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:43 smithi096 ceph-mon[112483]: pgmap v1318: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:43.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:43 smithi125 ceph-mon[86115]: pgmap v1318: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:45.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:45 smithi096 ceph-mon[112483]: pgmap v1319: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:45.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:45 smithi125 ceph-mon[86115]: pgmap v1319: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:47.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:47 smithi096 ceph-mon[112483]: pgmap v1320: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:50:47.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:47 smithi125 ceph-mon[86115]: pgmap v1320: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:50:49.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:49 smithi096 ceph-mon[112483]: pgmap v1321: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:49.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:49 smithi125 ceph-mon[86115]: pgmap v1321: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:50.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:50:50.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:50:51.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:51 smithi096 ceph-mon[112483]: pgmap v1322: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:51.833 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:51 smithi125 ceph-mon[86115]: pgmap v1322: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:53.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:53 smithi096 ceph-mon[112483]: pgmap v1323: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:53.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:53 smithi125 ceph-mon[86115]: pgmap v1323: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:55.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:55 smithi096 ceph-mon[112483]: pgmap v1324: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:55.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:55 smithi125 ceph-mon[86115]: pgmap v1324: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:50:57.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:57 smithi096 ceph-mon[112483]: pgmap v1325: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:50:57.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:57 smithi125 ceph-mon[86115]: pgmap v1325: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:50:59.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:50:59 smithi096 ceph-mon[112483]: pgmap v1326: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:50:59.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:50:59 smithi125 ceph-mon[86115]: pgmap v1326: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:51:01.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:01 smithi096 ceph-mon[112483]: pgmap v1327: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:51:01.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:01 smithi125 ceph-mon[86115]: pgmap v1327: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:51:03.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:03 smithi096 ceph-mon[112483]: pgmap v1328: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:51:03.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:03 smithi125 ceph-mon[86115]: pgmap v1328: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:51:05.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:05 smithi096 ceph-mon[112483]: pgmap v1329: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:51:05.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:51:05.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:05 smithi125 ceph-mon[86115]: pgmap v1329: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:51:05.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:51:07.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:07 smithi096 ceph-mon[112483]: pgmap v1330: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:51:07.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:07 smithi125 ceph-mon[86115]: pgmap v1330: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:51:09.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:09 smithi096 ceph-mon[112483]: pgmap v1331: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:51:09.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:09 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:51:09.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:09 smithi125 ceph-mon[86115]: pgmap v1331: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:51:09.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:09 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:51:10.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:10 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:51:10.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:10 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:51:10.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:10 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:51:10.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:10 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:51:10.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:10 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:51:10.934 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:10 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:51:11.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:11 smithi096 ceph-mon[112483]: pgmap v1332: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:51:11.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:11 smithi125 ceph-mon[86115]: pgmap v1332: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:51:13.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:13 smithi096 ceph-mon[112483]: pgmap v1333: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:51:13.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:13 smithi125 ceph-mon[86115]: pgmap v1333: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:51:15.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:15 smithi096 ceph-mon[112483]: pgmap v1334: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:51:15.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:15 smithi125 ceph-mon[86115]: pgmap v1334: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:51:17.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:17 smithi096 ceph-mon[112483]: pgmap v1335: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:51:17.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:17 smithi125 ceph-mon[86115]: pgmap v1335: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:51:19.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:19 smithi096 ceph-mon[112483]: pgmap v1336: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:51:19.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:19 smithi125 ceph-mon[86115]: pgmap v1336: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:51:20.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:51:20.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:51:21.760 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:21 smithi096 ceph-mon[112483]: pgmap v1337: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:51:21.833 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:21 smithi125 ceph-mon[86115]: pgmap v1337: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:51:23.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:23 smithi096 ceph-mon[112483]: pgmap v1338: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:51:23.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:23 smithi125 ceph-mon[86115]: pgmap v1338: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:51:25.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:25 smithi096 ceph-mon[112483]: pgmap v1339: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:51:25.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:25 smithi125 ceph-mon[86115]: pgmap v1339: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:51:27.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:27 smithi096 ceph-mon[112483]: pgmap v1340: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:51:27.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:27 smithi125 ceph-mon[86115]: pgmap v1340: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:51:29.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:29 smithi125 ceph-mon[86115]: pgmap v1341: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:51:30.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:29 smithi096 ceph-mon[112483]: pgmap v1341: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:51:31.873 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:31 smithi096 ceph-mon[112483]: pgmap v1342: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:51:31.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:31 smithi125 ceph-mon[86115]: pgmap v1342: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:51:33.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:33 smithi125 ceph-mon[86115]: pgmap v1343: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:51:34.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:33 smithi096 ceph-mon[112483]: pgmap v1343: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:51:35.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:35 smithi125 ceph-mon[86115]: pgmap v1344: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:51:35.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:51:36.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:35 smithi096 ceph-mon[112483]: pgmap v1344: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:51:36.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:51:37.681 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:37 smithi125 ceph-mon[86115]: pgmap v1345: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:51:38.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:37 smithi096 ceph-mon[112483]: pgmap v1345: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:51:39.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:39 smithi125 ceph-mon[86115]: pgmap v1346: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:51:40.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:39 smithi096 ceph-mon[112483]: pgmap v1346: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:51:41.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:41 smithi125 ceph-mon[86115]: pgmap v1347: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:51:41.984 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:41 smithi096 ceph-mon[112483]: pgmap v1347: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:51:43.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:43 smithi125 ceph-mon[86115]: pgmap v1348: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:51:44.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:43 smithi096 ceph-mon[112483]: pgmap v1348: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:51:45.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:45 smithi125 ceph-mon[86115]: pgmap v1349: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:51:46.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:45 smithi096 ceph-mon[112483]: pgmap v1349: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:51:47.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:47 smithi125 ceph-mon[86115]: pgmap v1350: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:51:48.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:47 smithi096 ceph-mon[112483]: pgmap v1350: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:51:49.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:49 smithi125 ceph-mon[86115]: pgmap v1351: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:51:50.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:49 smithi096 ceph-mon[112483]: pgmap v1351: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:51:50.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:51:51.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:51:51.833 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:51 smithi125 ceph-mon[86115]: pgmap v1352: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:51:52.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:51 smithi096 ceph-mon[112483]: pgmap v1352: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:51:53.766 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:53 smithi096 ceph-mon[112483]: pgmap v1353: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:51:53.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:53 smithi125 ceph-mon[86115]: pgmap v1353: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:51:55.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:55 smithi125 ceph-mon[86115]: pgmap v1354: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:51:56.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:55 smithi096 ceph-mon[112483]: pgmap v1354: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:51:57.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:57 smithi125 ceph-mon[86115]: pgmap v1355: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-19T19:51:58.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:57 smithi096 ceph-mon[112483]: pgmap v1355: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-19T19:51:59.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:51:59 smithi125 ceph-mon[86115]: pgmap v1356: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:52:00.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:51:59 smithi096 ceph-mon[112483]: pgmap v1356: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:52:01.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:01 smithi125 ceph-mon[86115]: pgmap v1357: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:52:02.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:01 smithi096 ceph-mon[112483]: pgmap v1357: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T19:52:03.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:03 smithi125 ceph-mon[86115]: pgmap v1358: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:52:04.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:03 smithi096 ceph-mon[112483]: pgmap v1358: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T19:52:05.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:05 smithi125 ceph-mon[86115]: pgmap v1359: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:52:05.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:52:06.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:05 smithi096 ceph-mon[112483]: pgmap v1359: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:52:06.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:52:07.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:07 smithi125 ceph-mon[86115]: pgmap v1360: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:52:08.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:07 smithi096 ceph-mon[112483]: pgmap v1360: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:52:09.931 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:09 smithi125 ceph-mon[86115]: pgmap v1361: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:52:10.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:09 smithi096 ceph-mon[112483]: pgmap v1361: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:52:10.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:10 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:52:10.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:10 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:52:10.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:10 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:52:10.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:10 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:52:11.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:10 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:52:11.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:10 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:52:11.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:10 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:52:11.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:10 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:52:11.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:11 smithi125 ceph-mon[86115]: pgmap v1362: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:52:12.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:11 smithi096 ceph-mon[112483]: pgmap v1362: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:52:13.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:13 smithi125 ceph-mon[86115]: pgmap v1363: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:52:14.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:13 smithi096 ceph-mon[112483]: pgmap v1363: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:52:15.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:15 smithi125 ceph-mon[86115]: pgmap v1364: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:52:16.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:15 smithi096 ceph-mon[112483]: pgmap v1364: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:52:17.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:17 smithi096 ceph-mon[112483]: pgmap v1365: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:52:17.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:17 smithi125 ceph-mon[86115]: pgmap v1365: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:52:19.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:19 smithi125 ceph-mon[86115]: pgmap v1366: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:52:20.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:19 smithi096 ceph-mon[112483]: pgmap v1366: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:52:20.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:52:21.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:52:21.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:21 smithi125 ceph-mon[86115]: pgmap v1367: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:52:22.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:21 smithi096 ceph-mon[112483]: pgmap v1367: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:52:23.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:23 smithi125 ceph-mon[86115]: pgmap v1368: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:52:24.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:23 smithi096 ceph-mon[112483]: pgmap v1368: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:52:25.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:25 smithi125 ceph-mon[86115]: pgmap v1369: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:52:26.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:25 smithi096 ceph-mon[112483]: pgmap v1369: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:52:27.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:27 smithi096 ceph-mon[112483]: pgmap v1370: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:52:27.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:27 smithi125 ceph-mon[86115]: pgmap v1370: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:52:29.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:29 smithi125 ceph-mon[86115]: pgmap v1371: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:52:30.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:29 smithi096 ceph-mon[112483]: pgmap v1371: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:52:31.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:31 smithi125 ceph-mon[86115]: pgmap v1372: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:52:32.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:31 smithi096 ceph-mon[112483]: pgmap v1372: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:52:33.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:33 smithi125 ceph-mon[86115]: pgmap v1373: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:52:34.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:33 smithi096 ceph-mon[112483]: pgmap v1373: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:52:35.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:35 smithi125 ceph-mon[86115]: pgmap v1374: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:52:35.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:52:36.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:35 smithi096 ceph-mon[112483]: pgmap v1374: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:52:36.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:52:37.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:37 smithi125 ceph-mon[86115]: pgmap v1375: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:52:38.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:37 smithi096 ceph-mon[112483]: pgmap v1375: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:52:39.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:39 smithi125 ceph-mon[86115]: pgmap v1376: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:52:40.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:39 smithi096 ceph-mon[112483]: pgmap v1376: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:52:41.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:41 smithi125 ceph-mon[86115]: pgmap v1377: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:52:42.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:41 smithi096 ceph-mon[112483]: pgmap v1377: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:52:43.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:43 smithi125 ceph-mon[86115]: pgmap v1378: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:52:44.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:43 smithi096 ceph-mon[112483]: pgmap v1378: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:52:45.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:45 smithi125 ceph-mon[86115]: pgmap v1379: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:52:46.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:45 smithi096 ceph-mon[112483]: pgmap v1379: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:52:47.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:47 smithi125 ceph-mon[86115]: pgmap v1380: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:52:48.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:47 smithi096 ceph-mon[112483]: pgmap v1380: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:52:49.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:49 smithi125 ceph-mon[86115]: pgmap v1381: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:52:50.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:49 smithi096 ceph-mon[112483]: pgmap v1381: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:52:50.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:52:51.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:52:51.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:51 smithi125 ceph-mon[86115]: pgmap v1382: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:52:52.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:51 smithi096 ceph-mon[112483]: pgmap v1382: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:52:53.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:53 smithi125 ceph-mon[86115]: pgmap v1383: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:52:54.016 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:53 smithi096 ceph-mon[112483]: pgmap v1383: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:52:55.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:55 smithi125 ceph-mon[86115]: pgmap v1384: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:52:56.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:55 smithi096 ceph-mon[112483]: pgmap v1384: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:52:57.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:57 smithi125 ceph-mon[86115]: pgmap v1385: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:52:58.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:57 smithi096 ceph-mon[112483]: pgmap v1385: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:52:59.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:52:59 smithi125 ceph-mon[86115]: pgmap v1386: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:00.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:52:59 smithi096 ceph-mon[112483]: pgmap v1386: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:01.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:01 smithi125 ceph-mon[86115]: pgmap v1387: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:02.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:01 smithi096 ceph-mon[112483]: pgmap v1387: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:04.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:03 smithi096 ceph-mon[112483]: pgmap v1388: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:04.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:03 smithi125 ceph-mon[86115]: pgmap v1388: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:06.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:05 smithi096 ceph-mon[112483]: pgmap v1389: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:06.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:53:06.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:05 smithi125 ceph-mon[86115]: pgmap v1389: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:06.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:53:07.948 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:07 smithi096 ceph-mon[112483]: pgmap v1390: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:53:08.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:07 smithi125 ceph-mon[86115]: pgmap v1390: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:53:10.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:09 smithi096 ceph-mon[112483]: pgmap v1391: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:10.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:09 smithi125 ceph-mon[86115]: pgmap v1391: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:11.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:10 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:53:11.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:10 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:53:12.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:11 smithi096 ceph-mon[112483]: pgmap v1392: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:12.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:11 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:53:12.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:11 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:53:12.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:11 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:53:12.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:11 smithi125 ceph-mon[86115]: pgmap v1392: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:12.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:11 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:53:12.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:11 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:53:12.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:11 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:53:14.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:13 smithi096 ceph-mon[112483]: pgmap v1393: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:14.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:13 smithi125 ceph-mon[86115]: pgmap v1393: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:16.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:15 smithi096 ceph-mon[112483]: pgmap v1394: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:16.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:15 smithi125 ceph-mon[86115]: pgmap v1394: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:18.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:17 smithi096 ceph-mon[112483]: pgmap v1395: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:53:18.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:17 smithi125 ceph-mon[86115]: pgmap v1395: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:53:20.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:19 smithi096 ceph-mon[112483]: pgmap v1396: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:20.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:19 smithi125 ceph-mon[86115]: pgmap v1396: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:21.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:53:21.083 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:53:22.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:21 smithi096 ceph-mon[112483]: pgmap v1397: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:22.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:21 smithi125 ceph-mon[86115]: pgmap v1397: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:23.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:23 smithi125 ceph-mon[86115]: pgmap v1398: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:24.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:23 smithi096 ceph-mon[112483]: pgmap v1398: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:26.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:25 smithi096 ceph-mon[112483]: pgmap v1399: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:26.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:25 smithi125 ceph-mon[86115]: pgmap v1399: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:28.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:27 smithi096 ceph-mon[112483]: pgmap v1400: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:53:28.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:27 smithi125 ceph-mon[86115]: pgmap v1400: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:53:30.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:29 smithi096 ceph-mon[112483]: pgmap v1401: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:30.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:29 smithi125 ceph-mon[86115]: pgmap v1401: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:32.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:31 smithi096 ceph-mon[112483]: pgmap v1402: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:32.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:31 smithi125 ceph-mon[86115]: pgmap v1402: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:34.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:33 smithi096 ceph-mon[112483]: pgmap v1403: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:34.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:33 smithi125 ceph-mon[86115]: pgmap v1403: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:36.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:35 smithi096 ceph-mon[112483]: pgmap v1404: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:36.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:53:36.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:35 smithi125 ceph-mon[86115]: pgmap v1404: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:36.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:53:38.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:37 smithi096 ceph-mon[112483]: pgmap v1405: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:53:38.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:37 smithi125 ceph-mon[86115]: pgmap v1405: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:53:40.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:39 smithi096 ceph-mon[112483]: pgmap v1406: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:40.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:39 smithi125 ceph-mon[86115]: pgmap v1406: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:42.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:41 smithi096 ceph-mon[112483]: pgmap v1407: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:42.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:41 smithi125 ceph-mon[86115]: pgmap v1407: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:44.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:43 smithi096 ceph-mon[112483]: pgmap v1408: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:44.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:43 smithi125 ceph-mon[86115]: pgmap v1408: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:46.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:45 smithi096 ceph-mon[112483]: pgmap v1409: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:46.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:45 smithi125 ceph-mon[86115]: pgmap v1409: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:48.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:47 smithi096 ceph-mon[112483]: pgmap v1410: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:53:48.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:47 smithi125 ceph-mon[86115]: pgmap v1410: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:53:50.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:49 smithi096 ceph-mon[112483]: pgmap v1411: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:50.184 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:49 smithi125 ceph-mon[86115]: pgmap v1411: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:51.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:53:51.083 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:53:52.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:51 smithi125 ceph-mon[86115]: pgmap v1412: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:52.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:51 smithi096 ceph-mon[112483]: pgmap v1412: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:54.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:53 smithi125 ceph-mon[86115]: pgmap v1413: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:54.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:53 smithi096 ceph-mon[112483]: pgmap v1413: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:53:56.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:55 smithi125 ceph-mon[86115]: pgmap v1414: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:56.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:55 smithi096 ceph-mon[112483]: pgmap v1414: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:53:58.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:57 smithi125 ceph-mon[86115]: pgmap v1415: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:53:58.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:57 smithi096 ceph-mon[112483]: pgmap v1415: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:54:00.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:53:59 smithi125 ceph-mon[86115]: pgmap v1416: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:00.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:53:59 smithi096 ceph-mon[112483]: pgmap v1416: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:02.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:01 smithi125 ceph-mon[86115]: pgmap v1417: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:02.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:01 smithi096 ceph-mon[112483]: pgmap v1417: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:04.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:03 smithi096 ceph-mon[112483]: pgmap v1418: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:04.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:03 smithi125 ceph-mon[86115]: pgmap v1418: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:06.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:05 smithi125 ceph-mon[86115]: pgmap v1419: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:06.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:54:06.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:05 smithi096 ceph-mon[112483]: pgmap v1419: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:06.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:54:08.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:07 smithi125 ceph-mon[86115]: pgmap v1420: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:54:08.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:07 smithi096 ceph-mon[112483]: pgmap v1420: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:54:10.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:09 smithi125 ceph-mon[86115]: pgmap v1421: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:10.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:09 smithi096 ceph-mon[112483]: pgmap v1421: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:12.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:11 smithi125 ceph-mon[86115]: pgmap v1422: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:12.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:11 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:54:12.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:11 smithi096 ceph-mon[112483]: pgmap v1422: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:12.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:11 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:54:13.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:12 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:54:13.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:12 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:54:13.056 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:12 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:54:13.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:12 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:54:13.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:12 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:54:13.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:12 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:54:14.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:13 smithi096 ceph-mon[112483]: pgmap v1423: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:14.136 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:13 smithi125 ceph-mon[86115]: pgmap v1423: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:16.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:15 smithi125 ceph-mon[86115]: pgmap v1424: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:16.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:15 smithi096 ceph-mon[112483]: pgmap v1424: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:18.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:17 smithi125 ceph-mon[86115]: pgmap v1425: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:54:18.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:17 smithi096 ceph-mon[112483]: pgmap v1425: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:54:20.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:19 smithi125 ceph-mon[86115]: pgmap v1426: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:20.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:19 smithi096 ceph-mon[112483]: pgmap v1426: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:21.083 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:54:21.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:54:22.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:21 smithi125 ceph-mon[86115]: pgmap v1427: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:22.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:21 smithi096 ceph-mon[112483]: pgmap v1427: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:24.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:23 smithi125 ceph-mon[86115]: pgmap v1428: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:24.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:23 smithi096 ceph-mon[112483]: pgmap v1428: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:26.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:25 smithi125 ceph-mon[86115]: pgmap v1429: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:26.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:25 smithi096 ceph-mon[112483]: pgmap v1429: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:28.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:27 smithi125 ceph-mon[86115]: pgmap v1430: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:54:28.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:27 smithi096 ceph-mon[112483]: pgmap v1430: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:54:30.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:29 smithi125 ceph-mon[86115]: pgmap v1431: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:30.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:29 smithi096 ceph-mon[112483]: pgmap v1431: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:32.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:31 smithi125 ceph-mon[86115]: pgmap v1432: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:32.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:31 smithi096 ceph-mon[112483]: pgmap v1432: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:33.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:32 smithi125 ceph-mon[86115]: pgmap v1433: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:33.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:32 smithi096 ceph-mon[112483]: pgmap v1433: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:35.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:35 smithi125 ceph-mon[86115]: pgmap v1434: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:35.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:35 smithi096 ceph-mon[112483]: pgmap v1434: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:36.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:54:36.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:54:37.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:37 smithi125 ceph-mon[86115]: pgmap v1435: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:54:37.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:37 smithi096 ceph-mon[112483]: pgmap v1435: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:54:39.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:39 smithi125 ceph-mon[86115]: pgmap v1436: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:39.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:39 smithi096 ceph-mon[112483]: pgmap v1436: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:41.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:41 smithi125 ceph-mon[86115]: pgmap v1437: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:41.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:41 smithi096 ceph-mon[112483]: pgmap v1437: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:43.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:43 smithi125 ceph-mon[86115]: pgmap v1438: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:43.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:43 smithi096 ceph-mon[112483]: pgmap v1438: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:45.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:45 smithi125 ceph-mon[86115]: pgmap v1439: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:45.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:45 smithi096 ceph-mon[112483]: pgmap v1439: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:47.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:47 smithi125 ceph-mon[86115]: pgmap v1440: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:54:47.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:47 smithi096 ceph-mon[112483]: pgmap v1440: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:54:49.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:49 smithi125 ceph-mon[86115]: pgmap v1441: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:49.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:49 smithi096 ceph-mon[112483]: pgmap v1441: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:51.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:51 smithi125 ceph-mon[86115]: pgmap v1442: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:51.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:54:51.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:51 smithi096 ceph-mon[112483]: pgmap v1442: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:51.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:54:53.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:53 smithi125 ceph-mon[86115]: pgmap v1443: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:53.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:53 smithi096 ceph-mon[112483]: pgmap v1443: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:55.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:55 smithi125 ceph-mon[86115]: pgmap v1444: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:55.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:55 smithi096 ceph-mon[112483]: pgmap v1444: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:54:57.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:57 smithi125 ceph-mon[86115]: pgmap v1445: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:54:57.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:57 smithi096 ceph-mon[112483]: pgmap v1445: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:54:59.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:54:59 smithi096 ceph-mon[112483]: pgmap v1446: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:54:59.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:54:59 smithi125 ceph-mon[86115]: pgmap v1446: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:01.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:01 smithi125 ceph-mon[86115]: pgmap v1447: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:01.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:01 smithi096 ceph-mon[112483]: pgmap v1447: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:03.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:03 smithi125 ceph-mon[86115]: pgmap v1448: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:03.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:03 smithi096 ceph-mon[112483]: pgmap v1448: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:05.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:05 smithi125 ceph-mon[86115]: pgmap v1449: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:05.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:05 smithi096 ceph-mon[112483]: pgmap v1449: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:06.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:55:06.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:55:07.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:07 smithi125 ceph-mon[86115]: pgmap v1450: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:55:07.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:07 smithi096 ceph-mon[112483]: pgmap v1450: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:55:09.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:09 smithi125 ceph-mon[86115]: pgmap v1451: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:09.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:09 smithi096 ceph-mon[112483]: pgmap v1451: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:11.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:11 smithi125 ceph-mon[86115]: pgmap v1452: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:11.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:11 smithi096 ceph-mon[112483]: pgmap v1452: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:12.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:12 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:55:12.761 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:12 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:55:13.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:13 smithi125 ceph-mon[86115]: pgmap v1453: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:13.683 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:13 smithi096 ceph-mon[112483]: pgmap v1453: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:15.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:15 smithi125 ceph-mon[86115]: pgmap v1454: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:15.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:15 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:55:15.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:15 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:55:15.688 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:15 smithi096 ceph-mon[112483]: pgmap v1454: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:15.688 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:15 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:55:15.689 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:15 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:55:17.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:17 smithi125 ceph-mon[86115]: pgmap v1455: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:55:17.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:17 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:55:17.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:17 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:55:17.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:17 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:55:17.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:17 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:55:17.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:17 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:55:17.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:17 smithi096 ceph-mon[112483]: pgmap v1455: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:55:17.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:55:17.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:55:17.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:55:17.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:55:17.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:55:19.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:19 smithi125 ceph-mon[86115]: pgmap v1456: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:19.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:19 smithi096 ceph-mon[112483]: pgmap v1456: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:20.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:55:20.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:55:21.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:21 smithi096 ceph-mon[112483]: pgmap v1457: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:21.833 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:21 smithi125 ceph-mon[86115]: pgmap v1457: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:23.709 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:23 smithi096 ceph-mon[112483]: pgmap v1458: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:23.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:23 smithi125 ceph-mon[86115]: pgmap v1458: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:25.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:25 smithi096 ceph-mon[112483]: pgmap v1459: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:25.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:25 smithi125 ceph-mon[86115]: pgmap v1459: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:27.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:27 smithi096 ceph-mon[112483]: pgmap v1460: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:55:27.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:27 smithi125 ceph-mon[86115]: pgmap v1460: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:55:29.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:29 smithi096 ceph-mon[112483]: pgmap v1461: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:29.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:29 smithi125 ceph-mon[86115]: pgmap v1461: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:31.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:31 smithi096 ceph-mon[112483]: pgmap v1462: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:31.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:31 smithi125 ceph-mon[86115]: pgmap v1462: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:33.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:33 smithi096 ceph-mon[112483]: pgmap v1463: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:33.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:33 smithi125 ceph-mon[86115]: pgmap v1463: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:35.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:35 smithi096 ceph-mon[112483]: pgmap v1464: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:35.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:55:35.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:35 smithi125 ceph-mon[86115]: pgmap v1464: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:35.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:55:37.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:37 smithi096 ceph-mon[112483]: pgmap v1465: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:55:37.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:37 smithi125 ceph-mon[86115]: pgmap v1465: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:55:39.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:39 smithi096 ceph-mon[112483]: pgmap v1466: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:39.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:39 smithi125 ceph-mon[86115]: pgmap v1466: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:41.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:41 smithi096 ceph-mon[112483]: pgmap v1467: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:41.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:41 smithi125 ceph-mon[86115]: pgmap v1467: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:43.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:43 smithi096 ceph-mon[112483]: pgmap v1468: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:43.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:43 smithi125 ceph-mon[86115]: pgmap v1468: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:45.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:45 smithi096 ceph-mon[112483]: pgmap v1469: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:45.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:45 smithi125 ceph-mon[86115]: pgmap v1469: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:47.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:47 smithi096 ceph-mon[112483]: pgmap v1470: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:55:47.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:47 smithi125 ceph-mon[86115]: pgmap v1470: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:55:49.756 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:49 smithi096 ceph-mon[112483]: pgmap v1471: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:49.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:49 smithi125 ceph-mon[86115]: pgmap v1471: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:50.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:55:50.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:55:51.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:51 smithi096 ceph-mon[112483]: pgmap v1472: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:51.833 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:51 smithi125 ceph-mon[86115]: pgmap v1472: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:53.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:53 smithi096 ceph-mon[112483]: pgmap v1473: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:53.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:53 smithi125 ceph-mon[86115]: pgmap v1473: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:55.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:55 smithi125 ceph-mon[86115]: pgmap v1474: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:55.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:55 smithi096 ceph-mon[112483]: pgmap v1474: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:55:57.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:57 smithi096 ceph-mon[112483]: pgmap v1475: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:55:57.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:57 smithi125 ceph-mon[86115]: pgmap v1475: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:55:59.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:55:59 smithi096 ceph-mon[112483]: pgmap v1476: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:55:59.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:55:59 smithi125 ceph-mon[86115]: pgmap v1476: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:01.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:01 smithi096 ceph-mon[112483]: pgmap v1477: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:01.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:01 smithi125 ceph-mon[86115]: pgmap v1477: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:03.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:03 smithi096 ceph-mon[112483]: pgmap v1478: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:03.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:03 smithi125 ceph-mon[86115]: pgmap v1478: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:05.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:05 smithi125 ceph-mon[86115]: pgmap v1479: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:05.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:56:05.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:05 smithi096 ceph-mon[112483]: pgmap v1479: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:05.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:56:07.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:07 smithi096 ceph-mon[112483]: pgmap v1480: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:56:07.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:07 smithi125 ceph-mon[86115]: pgmap v1480: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:56:09.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:09 smithi096 ceph-mon[112483]: pgmap v1481: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:09.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:09 smithi125 ceph-mon[86115]: pgmap v1481: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:11.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:11 smithi125 ceph-mon[86115]: pgmap v1482: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:12.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:11 smithi096 ceph-mon[112483]: pgmap v1482: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:13.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:13 smithi125 ceph-mon[86115]: pgmap v1483: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:14.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:13 smithi096 ceph-mon[112483]: pgmap v1483: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:15.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:15 smithi125 ceph-mon[86115]: pgmap v1484: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:16.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:15 smithi096 ceph-mon[112483]: pgmap v1484: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:17.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:17 smithi125 ceph-mon[86115]: pgmap v1485: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:56:17.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:17 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:56:18.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:17 smithi096 ceph-mon[112483]: pgmap v1485: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:56:18.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:56:18.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:18 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:56:18.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:18 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:56:18.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:18 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:56:19.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:18 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:56:19.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:18 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:56:19.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:18 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:56:20.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:19 smithi096 ceph-mon[112483]: pgmap v1486: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:20.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:19 smithi125 ceph-mon[86115]: pgmap v1486: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:20.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:56:21.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:56:22.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:21 smithi096 ceph-mon[112483]: pgmap v1487: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:22.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:21 smithi125 ceph-mon[86115]: pgmap v1487: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:24.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:23 smithi096 ceph-mon[112483]: pgmap v1488: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:24.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:23 smithi125 ceph-mon[86115]: pgmap v1488: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:25.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:25 smithi125 ceph-mon[86115]: pgmap v1489: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:26.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:25 smithi096 ceph-mon[112483]: pgmap v1489: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:28.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:27 smithi096 ceph-mon[112483]: pgmap v1490: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:56:28.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:27 smithi125 ceph-mon[86115]: pgmap v1490: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:56:30.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:29 smithi096 ceph-mon[112483]: pgmap v1491: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:30.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:29 smithi125 ceph-mon[86115]: pgmap v1491: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:32.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:31 smithi096 ceph-mon[112483]: pgmap v1492: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:32.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:31 smithi125 ceph-mon[86115]: pgmap v1492: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:34.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:33 smithi096 ceph-mon[112483]: pgmap v1493: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:34.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:33 smithi125 ceph-mon[86115]: pgmap v1493: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:36.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:35 smithi096 ceph-mon[112483]: pgmap v1494: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:36.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:56:36.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:35 smithi125 ceph-mon[86115]: pgmap v1494: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:36.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:56:38.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:37 smithi096 ceph-mon[112483]: pgmap v1495: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:56:38.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:37 smithi125 ceph-mon[86115]: pgmap v1495: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:56:40.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:39 smithi125 ceph-mon[86115]: pgmap v1496: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:40.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:39 smithi096 ceph-mon[112483]: pgmap v1496: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:42.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:41 smithi125 ceph-mon[86115]: pgmap v1497: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:42.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:41 smithi096 ceph-mon[112483]: pgmap v1497: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:44.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:43 smithi125 ceph-mon[86115]: pgmap v1498: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:44.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:43 smithi096 ceph-mon[112483]: pgmap v1498: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:46.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:45 smithi125 ceph-mon[86115]: pgmap v1499: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:46.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:45 smithi096 ceph-mon[112483]: pgmap v1499: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:48.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:47 smithi125 ceph-mon[86115]: pgmap v1500: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:56:48.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:47 smithi096 ceph-mon[112483]: pgmap v1500: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:56:50.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:49 smithi125 ceph-mon[86115]: pgmap v1501: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:50.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:49 smithi096 ceph-mon[112483]: pgmap v1501: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:51.083 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:56:51.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:56:52.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:51 smithi125 ceph-mon[86115]: pgmap v1502: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:52.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:51 smithi096 ceph-mon[112483]: pgmap v1502: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:54.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:53 smithi125 ceph-mon[86115]: pgmap v1503: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:54.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:53 smithi096 ceph-mon[112483]: pgmap v1503: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:56:56.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:55 smithi125 ceph-mon[86115]: pgmap v1504: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:56.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:55 smithi096 ceph-mon[112483]: pgmap v1504: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:56:58.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:57 smithi125 ceph-mon[86115]: pgmap v1505: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:56:58.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:57 smithi096 ceph-mon[112483]: pgmap v1505: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:57:00.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:56:59 smithi125 ceph-mon[86115]: pgmap v1506: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:00.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:56:59 smithi096 ceph-mon[112483]: pgmap v1506: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:02.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:01 smithi125 ceph-mon[86115]: pgmap v1507: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:02.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:01 smithi096 ceph-mon[112483]: pgmap v1507: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:04.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:03 smithi125 ceph-mon[86115]: pgmap v1508: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:04.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:03 smithi096 ceph-mon[112483]: pgmap v1508: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:06.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:05 smithi096 ceph-mon[112483]: pgmap v1509: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:06.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:57:06.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:05 smithi125 ceph-mon[86115]: pgmap v1509: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:06.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:57:08.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:07 smithi125 ceph-mon[86115]: pgmap v1510: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:57:08.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:07 smithi096 ceph-mon[112483]: pgmap v1510: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:57:10.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:09 smithi125 ceph-mon[86115]: pgmap v1511: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:10.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:09 smithi096 ceph-mon[112483]: pgmap v1511: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:12.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:11 smithi125 ceph-mon[86115]: pgmap v1512: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:12.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:11 smithi096 ceph-mon[112483]: pgmap v1512: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:14.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:13 smithi125 ceph-mon[86115]: pgmap v1513: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:14.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:13 smithi096 ceph-mon[112483]: pgmap v1513: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:16.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:15 smithi096 ceph-mon[112483]: pgmap v1514: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:16.158 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:15 smithi125 ceph-mon[86115]: pgmap v1514: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:18.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:17 smithi125 ceph-mon[86115]: pgmap v1515: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:57:18.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:17 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:57:18.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:17 smithi096 ceph-mon[112483]: pgmap v1515: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:57:18.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:17 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:57:19.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:19 smithi125 ceph-mon[86115]: pgmap v1516: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:19.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:19 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:57:19.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:19 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:57:19.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:19 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:57:19.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:19 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:57:19.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:19 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:57:19.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:19 smithi096 ceph-mon[112483]: pgmap v1516: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:19.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:19 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:57:19.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:19 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:57:19.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:19 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:57:19.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:19 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:57:19.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:19 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:57:21.485 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:21 smithi125 ceph-mon[86115]: pgmap v1517: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:21.485 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:57:21.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:21 smithi096 ceph-mon[112483]: pgmap v1517: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:21.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:57:23.604 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:23 smithi096 ceph-mon[112483]: pgmap v1518: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:23.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:23 smithi125 ceph-mon[86115]: pgmap v1518: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:25.684 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:25 smithi125 ceph-mon[86115]: pgmap v1519: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:25.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:25 smithi096 ceph-mon[112483]: pgmap v1519: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:27.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:27 smithi125 ceph-mon[86115]: pgmap v1520: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:57:27.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:27 smithi096 ceph-mon[112483]: pgmap v1520: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:57:29.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:29 smithi125 ceph-mon[86115]: pgmap v1521: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:29.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:29 smithi096 ceph-mon[112483]: pgmap v1521: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:31.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:31 smithi125 ceph-mon[86115]: pgmap v1522: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:31.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:31 smithi096 ceph-mon[112483]: pgmap v1522: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:33.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:33 smithi125 ceph-mon[86115]: pgmap v1523: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:33.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:33 smithi096 ceph-mon[112483]: pgmap v1523: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:35.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:35 smithi125 ceph-mon[86115]: pgmap v1524: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:35.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:35 smithi096 ceph-mon[112483]: pgmap v1524: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:36.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:57:36.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:57:37.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:37 smithi125 ceph-mon[86115]: pgmap v1525: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:57:37.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:37 smithi096 ceph-mon[112483]: pgmap v1525: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:57:39.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:39 smithi125 ceph-mon[86115]: pgmap v1526: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:39.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:39 smithi096 ceph-mon[112483]: pgmap v1526: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:41.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:41 smithi125 ceph-mon[86115]: pgmap v1527: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:41.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:41 smithi096 ceph-mon[112483]: pgmap v1527: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:43.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:43 smithi125 ceph-mon[86115]: pgmap v1528: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:43.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:43 smithi096 ceph-mon[112483]: pgmap v1528: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:45.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:45 smithi125 ceph-mon[86115]: pgmap v1529: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:45.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:45 smithi096 ceph-mon[112483]: pgmap v1529: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:47.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:47 smithi125 ceph-mon[86115]: pgmap v1530: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:47.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:47 smithi096 ceph-mon[112483]: pgmap v1530: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:49.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:49 smithi125 ceph-mon[86115]: pgmap v1531: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:49.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:49 smithi096 ceph-mon[112483]: pgmap v1531: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:51.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:51 smithi125 ceph-mon[86115]: pgmap v1532: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:51.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:57:51.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:51 smithi096 ceph-mon[112483]: pgmap v1532: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:51.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:57:53.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:53 smithi125 ceph-mon[86115]: pgmap v1533: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:53.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:53 smithi096 ceph-mon[112483]: pgmap v1533: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:55.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:55 smithi125 ceph-mon[86115]: pgmap v1534: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:55.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:55 smithi096 ceph-mon[112483]: pgmap v1534: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:57:57.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:57 smithi125 ceph-mon[86115]: pgmap v1535: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:57.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:57 smithi096 ceph-mon[112483]: pgmap v1535: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:57:59.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:57:59 smithi125 ceph-mon[86115]: pgmap v1536: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:57:59.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:57:59 smithi096 ceph-mon[112483]: pgmap v1536: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:58:01.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:01 smithi096 ceph-mon[112483]: pgmap v1537: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:01.662 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:01 smithi125 ceph-mon[86115]: pgmap v1537: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:03.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:03 smithi125 ceph-mon[86115]: pgmap v1538: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:03.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:03 smithi096 ceph-mon[112483]: pgmap v1538: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:05.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:05 smithi125 ceph-mon[86115]: pgmap v1539: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:05.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:05 smithi096 ceph-mon[112483]: pgmap v1539: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:06.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:58:06.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:58:07.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:07 smithi125 ceph-mon[86115]: pgmap v1540: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:07.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:07 smithi096 ceph-mon[112483]: pgmap v1540: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:09.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:09 smithi125 ceph-mon[86115]: pgmap v1541: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:58:09.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:09 smithi096 ceph-mon[112483]: pgmap v1541: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:58:11.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:11 smithi125 ceph-mon[86115]: pgmap v1542: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:11.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:11 smithi096 ceph-mon[112483]: pgmap v1542: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:13.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:13 smithi125 ceph-mon[86115]: pgmap v1543: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:13.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:13 smithi096 ceph-mon[112483]: pgmap v1543: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:15.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:15 smithi125 ceph-mon[86115]: pgmap v1544: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:15.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:15 smithi096 ceph-mon[112483]: pgmap v1544: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:17.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:17 smithi125 ceph-mon[86115]: pgmap v1545: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:17.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:17 smithi096 ceph-mon[112483]: pgmap v1545: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:19.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:19 smithi125 ceph-mon[86115]: pgmap v1546: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:58:19.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:19 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:58:19.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:19 smithi096 ceph-mon[112483]: pgmap v1546: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:58:19.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:19 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:58:20.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:58:20.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:58:20.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:58:20.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:58:20.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:58:20.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:58:20.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:58:20.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:58:21.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:21 smithi096 ceph-mon[112483]: pgmap v1547: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:22.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:21 smithi125 ceph-mon[86115]: pgmap v1547: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:24.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:23 smithi096 ceph-mon[112483]: pgmap v1548: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:24.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:23 smithi125 ceph-mon[86115]: pgmap v1548: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:26.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:25 smithi096 ceph-mon[112483]: pgmap v1549: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:26.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:25 smithi125 ceph-mon[86115]: pgmap v1549: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:28.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:27 smithi096 ceph-mon[112483]: pgmap v1550: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:28.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:27 smithi125 ceph-mon[86115]: pgmap v1550: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:30.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:29 smithi096 ceph-mon[112483]: pgmap v1551: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:58:30.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:29 smithi125 ceph-mon[86115]: pgmap v1551: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:58:32.000 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:31 smithi125 ceph-mon[86115]: pgmap v1552: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:32.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:31 smithi096 ceph-mon[112483]: pgmap v1552: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:34.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:33 smithi096 ceph-mon[112483]: pgmap v1553: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:34.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:33 smithi125 ceph-mon[86115]: pgmap v1553: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:36.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:35 smithi096 ceph-mon[112483]: pgmap v1554: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:36.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:58:36.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:35 smithi125 ceph-mon[86115]: pgmap v1554: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:36.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:58:38.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:37 smithi096 ceph-mon[112483]: pgmap v1555: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:38.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:37 smithi125 ceph-mon[86115]: pgmap v1555: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:40.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:39 smithi096 ceph-mon[112483]: pgmap v1556: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:58:40.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:39 smithi125 ceph-mon[86115]: pgmap v1556: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:58:42.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:41 smithi096 ceph-mon[112483]: pgmap v1557: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:42.112 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:41 smithi125 ceph-mon[86115]: pgmap v1557: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:44.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:43 smithi096 ceph-mon[112483]: pgmap v1558: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:44.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:43 smithi125 ceph-mon[86115]: pgmap v1558: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:46.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:45 smithi096 ceph-mon[112483]: pgmap v1559: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:46.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:45 smithi125 ceph-mon[86115]: pgmap v1559: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:48.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:47 smithi096 ceph-mon[112483]: pgmap v1560: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:48.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:47 smithi125 ceph-mon[86115]: pgmap v1560: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:50.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:49 smithi096 ceph-mon[112483]: pgmap v1561: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:58:50.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:49 smithi125 ceph-mon[86115]: pgmap v1561: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:58:51.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:58:51.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:58:52.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:51 smithi096 ceph-mon[112483]: pgmap v1562: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:52.083 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:51 smithi125 ceph-mon[86115]: pgmap v1562: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:54.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:53 smithi096 ceph-mon[112483]: pgmap v1563: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:54.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:53 smithi125 ceph-mon[86115]: pgmap v1563: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:56.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:55 smithi096 ceph-mon[112483]: pgmap v1564: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:56.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:55 smithi125 ceph-mon[86115]: pgmap v1564: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:58:58.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:57 smithi096 ceph-mon[112483]: pgmap v1565: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:58:58.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:57 smithi125 ceph-mon[86115]: pgmap v1565: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:00.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:58:59 smithi096 ceph-mon[112483]: pgmap v1566: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:59:00.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:58:59 smithi125 ceph-mon[86115]: pgmap v1566: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:59:02.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:01 smithi096 ceph-mon[112483]: pgmap v1567: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:02.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:01 smithi125 ceph-mon[86115]: pgmap v1567: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:04.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:03 smithi096 ceph-mon[112483]: pgmap v1568: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:04.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:03 smithi125 ceph-mon[86115]: pgmap v1568: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:06.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:05 smithi125 ceph-mon[86115]: pgmap v1569: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:06.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:59:06.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:05 smithi096 ceph-mon[112483]: pgmap v1569: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:06.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:59:08.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:07 smithi125 ceph-mon[86115]: pgmap v1570: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:08.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:07 smithi096 ceph-mon[112483]: pgmap v1570: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:10.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:09 smithi125 ceph-mon[86115]: pgmap v1571: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:59:10.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:09 smithi096 ceph-mon[112483]: pgmap v1571: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:59:12.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:11 smithi125 ceph-mon[86115]: pgmap v1572: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:12.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:11 smithi096 ceph-mon[112483]: pgmap v1572: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:14.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:13 smithi125 ceph-mon[86115]: pgmap v1573: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:14.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:13 smithi096 ceph-mon[112483]: pgmap v1573: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:16.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:15 smithi125 ceph-mon[86115]: pgmap v1574: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:16.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:15 smithi096 ceph-mon[112483]: pgmap v1574: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:18.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:17 smithi125 ceph-mon[86115]: pgmap v1575: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:18.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:17 smithi096 ceph-mon[112483]: pgmap v1575: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:20.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:19 smithi125 ceph-mon[86115]: pgmap v1576: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:59:20.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:19 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:59:20.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:19 smithi096 ceph-mon[112483]: pgmap v1576: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:59:20.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:19 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T19:59:21.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:21 smithi125 ceph-mon[86115]: pgmap v1577: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:21.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:59:21.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:59:21.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:59:21.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:59:21.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:59:21.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:59:21.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:21 smithi096 ceph-mon[112483]: pgmap v1577: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:21.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:59:21.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:59:21.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:59:21.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T19:59:21.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T19:59:21.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T19:59:23.419 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:23 smithi096 ceph-mon[112483]: pgmap v1578: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:23.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:23 smithi125 ceph-mon[86115]: pgmap v1578: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:25.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:25 smithi125 ceph-mon[86115]: pgmap v1579: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:25.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:25 smithi096 ceph-mon[112483]: pgmap v1579: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:27.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:27 smithi096 ceph-mon[112483]: pgmap v1580: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:27.613 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:27 smithi125 ceph-mon[86115]: pgmap v1580: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:29.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:29 smithi125 ceph-mon[86115]: pgmap v1581: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:59:29.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:29 smithi096 ceph-mon[112483]: pgmap v1581: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:59:31.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:31 smithi125 ceph-mon[86115]: pgmap v1582: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:31.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:31 smithi096 ceph-mon[112483]: pgmap v1582: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:33.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:33 smithi125 ceph-mon[86115]: pgmap v1583: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:33.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:33 smithi096 ceph-mon[112483]: pgmap v1583: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:35.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:35 smithi125 ceph-mon[86115]: pgmap v1584: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:35.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:35 smithi096 ceph-mon[112483]: pgmap v1584: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:36.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:59:36.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:59:37.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:37 smithi125 ceph-mon[86115]: pgmap v1585: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:37.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:37 smithi096 ceph-mon[112483]: pgmap v1585: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:39.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:39 smithi125 ceph-mon[86115]: pgmap v1586: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:59:39.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:39 smithi096 ceph-mon[112483]: pgmap v1586: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:59:41.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:41 smithi125 ceph-mon[86115]: pgmap v1587: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:41.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:41 smithi096 ceph-mon[112483]: pgmap v1587: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:43.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:43 smithi125 ceph-mon[86115]: pgmap v1588: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:43.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:43 smithi096 ceph-mon[112483]: pgmap v1588: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:45.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:45 smithi125 ceph-mon[86115]: pgmap v1589: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:45.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:45 smithi096 ceph-mon[112483]: pgmap v1589: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:47.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:47 smithi125 ceph-mon[86115]: pgmap v1590: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:47.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:47 smithi096 ceph-mon[112483]: pgmap v1590: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:49.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:49 smithi125 ceph-mon[86115]: pgmap v1591: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:59:49.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:49 smithi096 ceph-mon[112483]: pgmap v1591: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:59:51.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:51 smithi125 ceph-mon[86115]: pgmap v1592: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:51.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:59:51.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:51 smithi096 ceph-mon[112483]: pgmap v1592: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:51.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T19:59:53.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:53 smithi125 ceph-mon[86115]: pgmap v1593: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:53.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:53 smithi096 ceph-mon[112483]: pgmap v1593: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:55.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:55 smithi125 ceph-mon[86115]: pgmap v1594: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:55.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:55 smithi096 ceph-mon[112483]: pgmap v1594: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T19:59:57.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:57 smithi125 ceph-mon[86115]: pgmap v1595: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:57.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:57 smithi096 ceph-mon[112483]: pgmap v1595: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T19:59:59.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 19:59:59 smithi125 ceph-mon[86115]: pgmap v1596: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T19:59:59.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 19:59:59 smithi096 ceph-mon[112483]: pgmap v1596: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:00:00.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:00 smithi125 ceph-mon[86115]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T20:00:00.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:00 smithi096 ceph-mon[112483]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T20:00:01.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:01 smithi125 ceph-mon[86115]: pgmap v1597: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:00:01.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:01 smithi096 ceph-mon[112483]: pgmap v1597: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:00:03.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:03 smithi125 ceph-mon[86115]: pgmap v1598: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:00:03.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:03 smithi096 ceph-mon[112483]: pgmap v1598: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:00:05.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:05 smithi125 ceph-mon[86115]: pgmap v1599: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:00:05.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:05 smithi096 ceph-mon[112483]: pgmap v1599: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:00:06.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:00:06.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:00:07.634 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:07 smithi096 ceph-mon[112483]: pgmap v1600: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:00:07.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:07 smithi125 ceph-mon[86115]: pgmap v1600: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:00:09.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:09 smithi125 ceph-mon[86115]: pgmap v1601: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:00:09.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:09 smithi096 ceph-mon[112483]: pgmap v1601: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:00:11.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:11 smithi125 ceph-mon[86115]: pgmap v1602: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:00:11.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:11 smithi096 ceph-mon[112483]: pgmap v1602: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:00:13.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:13 smithi125 ceph-mon[86115]: pgmap v1603: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:00:13.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:13 smithi096 ceph-mon[112483]: pgmap v1603: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:00:15.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:15 smithi125 ceph-mon[86115]: pgmap v1604: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:00:15.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:15 smithi096 ceph-mon[112483]: pgmap v1604: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:00:17.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:17 smithi125 ceph-mon[86115]: pgmap v1605: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:00:17.746 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:17 smithi096 ceph-mon[112483]: pgmap v1605: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:00:19.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:19 smithi125 ceph-mon[86115]: pgmap v1606: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:00:19.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:19 smithi096 ceph-mon[112483]: pgmap v1606: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:00:21.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:21 smithi125 ceph-mon[86115]: pgmap v1607: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:00:21.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:00:21.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:00:21.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:21 smithi096 ceph-mon[112483]: pgmap v1607: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:00:21.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:00:21.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:00:22.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:00:22.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:00:22.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:00:22.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:00:22.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:00:22.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:00:23.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:23 smithi125 ceph-mon[86115]: pgmap v1608: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:00:24.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:23 smithi096 ceph-mon[112483]: pgmap v1608: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:00:25.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:25 smithi125 ceph-mon[86115]: pgmap v1609: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:00:26.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:25 smithi096 ceph-mon[112483]: pgmap v1609: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:00:27.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:27 smithi125 ceph-mon[86115]: pgmap v1610: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:00:28.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:27 smithi096 ceph-mon[112483]: pgmap v1610: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:00:29.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:29 smithi125 ceph-mon[86115]: pgmap v1611: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:00:30.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:29 smithi096 ceph-mon[112483]: pgmap v1611: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:00:31.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:31 smithi125 ceph-mon[86115]: pgmap v1612: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:00:32.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:31 smithi096 ceph-mon[112483]: pgmap v1612: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:00:33.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:33 smithi125 ceph-mon[86115]: pgmap v1613: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:00:34.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:33 smithi096 ceph-mon[112483]: pgmap v1613: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:00:35.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:35 smithi125 ceph-mon[86115]: pgmap v1614: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T20:00:35.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:00:36.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:35 smithi096 ceph-mon[112483]: pgmap v1614: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T20:00:36.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:00:37.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:37 smithi125 ceph-mon[86115]: pgmap v1615: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T20:00:37.971 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:37 smithi096 ceph-mon[112483]: pgmap v1615: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T20:00:39.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:39 smithi125 ceph-mon[86115]: pgmap v1616: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-19T20:00:40.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:39 smithi096 ceph-mon[112483]: pgmap v1616: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-19T20:00:41.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:41 smithi125 ceph-mon[86115]: pgmap v1617: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T20:00:42.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:41 smithi096 ceph-mon[112483]: pgmap v1617: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T20:00:43.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:43 smithi125 ceph-mon[86115]: pgmap v1618: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T20:00:44.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:43 smithi096 ceph-mon[112483]: pgmap v1618: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T20:00:46.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:45 smithi096 ceph-mon[112483]: pgmap v1619: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T20:00:46.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:45 smithi125 ceph-mon[86115]: pgmap v1619: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T20:00:48.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:47 smithi096 ceph-mon[112483]: pgmap v1620: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:00:48.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:47 smithi125 ceph-mon[86115]: pgmap v1620: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:00:50.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:49 smithi096 ceph-mon[112483]: pgmap v1621: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:00:50.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:49 smithi125 ceph-mon[86115]: pgmap v1621: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:00:51.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:00:51.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:00:52.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:51 smithi096 ceph-mon[112483]: pgmap v1622: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:00:52.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:51 smithi125 ceph-mon[86115]: pgmap v1622: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:00:53.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:53 smithi125 ceph-mon[86115]: pgmap v1623: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:00:54.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:53 smithi096 ceph-mon[112483]: pgmap v1623: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:00:56.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:55 smithi096 ceph-mon[112483]: pgmap v1624: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:00:56.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:55 smithi125 ceph-mon[86115]: pgmap v1624: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:00:58.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:57 smithi096 ceph-mon[112483]: pgmap v1625: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:00:58.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:57 smithi125 ceph-mon[86115]: pgmap v1625: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:00.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:00:59 smithi096 ceph-mon[112483]: pgmap v1626: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:01:00.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:00:59 smithi125 ceph-mon[86115]: pgmap v1626: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:01:01.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:01 smithi125 ceph-mon[86115]: pgmap v1627: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:02.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:01 smithi096 ceph-mon[112483]: pgmap v1627: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:04.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:03 smithi096 ceph-mon[112483]: pgmap v1628: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:04.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:03 smithi125 ceph-mon[86115]: pgmap v1628: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:06.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:05 smithi096 ceph-mon[112483]: pgmap v1629: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:06.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:01:06.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:05 smithi125 ceph-mon[86115]: pgmap v1629: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:06.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:01:08.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:07 smithi096 ceph-mon[112483]: pgmap v1630: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:08.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:07 smithi125 ceph-mon[86115]: pgmap v1630: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:10.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:09 smithi096 ceph-mon[112483]: pgmap v1631: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:01:10.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:09 smithi125 ceph-mon[86115]: pgmap v1631: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:01:12.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:11 smithi096 ceph-mon[112483]: pgmap v1632: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:12.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:11 smithi125 ceph-mon[86115]: pgmap v1632: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:14.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:13 smithi096 ceph-mon[112483]: pgmap v1633: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:14.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:13 smithi125 ceph-mon[86115]: pgmap v1633: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:16.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:15 smithi096 ceph-mon[112483]: pgmap v1634: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:16.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:15 smithi125 ceph-mon[86115]: pgmap v1634: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:18.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:17 smithi096 ceph-mon[112483]: pgmap v1635: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:18.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:17 smithi125 ceph-mon[86115]: pgmap v1635: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:20.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:19 smithi096 ceph-mon[112483]: pgmap v1636: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:01:20.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:19 smithi125 ceph-mon[86115]: pgmap v1636: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:01:21.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:01:21.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:01:22.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:21 smithi096 ceph-mon[112483]: pgmap v1637: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:22.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:21 smithi125 ceph-mon[86115]: pgmap v1637: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:23.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:01:23.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:01:23.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:01:23.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:01:23.084 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:01:23.084 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:01:23.084 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:01:23.084 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:01:24.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:23 smithi096 ceph-mon[112483]: pgmap v1638: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:24.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:23 smithi125 ceph-mon[86115]: pgmap v1638: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:26.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:25 smithi096 ceph-mon[112483]: pgmap v1639: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:26.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:25 smithi125 ceph-mon[86115]: pgmap v1639: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:28.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:27 smithi096 ceph-mon[112483]: pgmap v1640: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:28.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:27 smithi125 ceph-mon[86115]: pgmap v1640: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:30.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:29 smithi096 ceph-mon[112483]: pgmap v1641: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:01:30.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:29 smithi125 ceph-mon[86115]: pgmap v1641: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:01:32.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:31 smithi125 ceph-mon[86115]: pgmap v1642: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:32.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:31 smithi096 ceph-mon[112483]: pgmap v1642: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:34.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:33 smithi096 ceph-mon[112483]: pgmap v1643: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:34.024 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:33 smithi125 ceph-mon[86115]: pgmap v1643: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:36.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:35 smithi125 ceph-mon[86115]: pgmap v1644: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:36.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:01:36.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:35 smithi096 ceph-mon[112483]: pgmap v1644: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:36.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:01:38.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:37 smithi125 ceph-mon[86115]: pgmap v1645: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:38.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:37 smithi096 ceph-mon[112483]: pgmap v1645: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:40.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:39 smithi125 ceph-mon[86115]: pgmap v1646: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:01:40.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:39 smithi096 ceph-mon[112483]: pgmap v1646: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:01:42.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:41 smithi125 ceph-mon[86115]: pgmap v1647: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:42.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:41 smithi096 ceph-mon[112483]: pgmap v1647: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:44.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:43 smithi096 ceph-mon[112483]: pgmap v1648: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:44.141 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:43 smithi125 ceph-mon[86115]: pgmap v1648: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:46.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:45 smithi125 ceph-mon[86115]: pgmap v1649: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:46.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:45 smithi096 ceph-mon[112483]: pgmap v1649: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:48.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:47 smithi125 ceph-mon[86115]: pgmap v1650: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:48.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:47 smithi096 ceph-mon[112483]: pgmap v1650: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:50.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:49 smithi125 ceph-mon[86115]: pgmap v1651: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:01:50.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:49 smithi096 ceph-mon[112483]: pgmap v1651: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:01:51.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:01:51.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:01:52.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:51 smithi125 ceph-mon[86115]: pgmap v1652: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:52.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:51 smithi096 ceph-mon[112483]: pgmap v1652: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:54.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:53 smithi125 ceph-mon[86115]: pgmap v1653: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:54.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:53 smithi096 ceph-mon[112483]: pgmap v1653: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:56.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:55 smithi125 ceph-mon[86115]: pgmap v1654: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:56.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:55 smithi096 ceph-mon[112483]: pgmap v1654: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:01:58.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:57 smithi125 ceph-mon[86115]: pgmap v1655: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:01:58.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:57 smithi096 ceph-mon[112483]: pgmap v1655: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:00.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:01:59 smithi125 ceph-mon[86115]: pgmap v1656: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:02:00.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:01:59 smithi096 ceph-mon[112483]: pgmap v1656: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:02:02.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:01 smithi125 ceph-mon[86115]: pgmap v1657: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:02.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:01 smithi096 ceph-mon[112483]: pgmap v1657: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:04.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:03 smithi125 ceph-mon[86115]: pgmap v1658: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:04.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:03 smithi096 ceph-mon[112483]: pgmap v1658: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:06.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:05 smithi125 ceph-mon[86115]: pgmap v1659: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:06.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:02:06.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:05 smithi096 ceph-mon[112483]: pgmap v1659: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:06.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:02:08.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:07 smithi125 ceph-mon[86115]: pgmap v1660: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:08.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:07 smithi096 ceph-mon[112483]: pgmap v1660: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:10.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:09 smithi125 ceph-mon[86115]: pgmap v1661: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:02:10.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:09 smithi096 ceph-mon[112483]: pgmap v1661: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:02:12.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:11 smithi125 ceph-mon[86115]: pgmap v1662: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:12.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:11 smithi096 ceph-mon[112483]: pgmap v1662: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:14.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:13 smithi125 ceph-mon[86115]: pgmap v1663: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:14.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:13 smithi096 ceph-mon[112483]: pgmap v1663: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:16.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:15 smithi125 ceph-mon[86115]: pgmap v1664: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:16.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:15 smithi096 ceph-mon[112483]: pgmap v1664: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:18.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:17 smithi125 ceph-mon[86115]: pgmap v1665: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:18.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:17 smithi096 ceph-mon[112483]: pgmap v1665: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:20.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:19 smithi125 ceph-mon[86115]: pgmap v1666: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:02:20.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:19 smithi096 ceph-mon[112483]: pgmap v1666: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:02:21.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:02:21.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:02:22.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:21 smithi125 ceph-mon[86115]: pgmap v1667: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:22.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:21 smithi096 ceph-mon[112483]: pgmap v1667: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:23.168 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:22 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:02:23.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:22 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:02:24.156 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:23 smithi096 ceph-mon[112483]: pgmap v1668: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:24.157 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:02:24.157 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:02:24.157 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:02:24.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:23 smithi125 ceph-mon[86115]: pgmap v1668: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:24.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:02:24.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:02:24.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:02:26.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:25 smithi125 ceph-mon[86115]: pgmap v1669: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:26.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:25 smithi096 ceph-mon[112483]: pgmap v1669: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:28.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:27 smithi125 ceph-mon[86115]: pgmap v1670: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:28.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:27 smithi096 ceph-mon[112483]: pgmap v1670: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:29.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:29 smithi125 ceph-mon[86115]: pgmap v1671: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:02:30.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:29 smithi096 ceph-mon[112483]: pgmap v1671: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:02:32.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:31 smithi125 ceph-mon[86115]: pgmap v1672: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:32.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:31 smithi096 ceph-mon[112483]: pgmap v1672: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:34.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:33 smithi125 ceph-mon[86115]: pgmap v1673: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:34.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:33 smithi096 ceph-mon[112483]: pgmap v1673: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:36.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:35 smithi125 ceph-mon[86115]: pgmap v1674: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:36.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:02:36.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:35 smithi096 ceph-mon[112483]: pgmap v1674: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:36.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:02:38.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:37 smithi125 ceph-mon[86115]: pgmap v1675: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:38.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:37 smithi096 ceph-mon[112483]: pgmap v1675: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:40.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:39 smithi125 ceph-mon[86115]: pgmap v1676: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:02:40.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:39 smithi096 ceph-mon[112483]: pgmap v1676: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:02:42.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:41 smithi125 ceph-mon[86115]: pgmap v1677: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:42.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:41 smithi096 ceph-mon[112483]: pgmap v1677: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:44.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:43 smithi125 ceph-mon[86115]: pgmap v1678: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:44.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:43 smithi096 ceph-mon[112483]: pgmap v1678: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:46.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:45 smithi125 ceph-mon[86115]: pgmap v1679: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:46.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:45 smithi096 ceph-mon[112483]: pgmap v1679: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:48.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:47 smithi125 ceph-mon[86115]: pgmap v1680: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:48.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:47 smithi096 ceph-mon[112483]: pgmap v1680: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:50.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:49 smithi125 ceph-mon[86115]: pgmap v1681: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:02:50.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:49 smithi096 ceph-mon[112483]: pgmap v1681: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:02:51.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:02:51.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:02:52.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:51 smithi125 ceph-mon[86115]: pgmap v1682: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:52.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:51 smithi096 ceph-mon[112483]: pgmap v1682: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:53.169 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:52 smithi096 ceph-mon[112483]: pgmap v1683: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:53.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:52 smithi125 ceph-mon[86115]: pgmap v1683: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:55.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:55 smithi125 ceph-mon[86115]: pgmap v1684: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:55.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:55 smithi096 ceph-mon[112483]: pgmap v1684: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:02:57.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:57 smithi125 ceph-mon[86115]: pgmap v1685: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:57.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:57 smithi096 ceph-mon[112483]: pgmap v1685: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:02:59.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:02:59 smithi125 ceph-mon[86115]: pgmap v1686: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:02:59.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:02:59 smithi096 ceph-mon[112483]: pgmap v1686: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:03:01.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:01 smithi096 ceph-mon[112483]: pgmap v1687: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:03:01.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:01 smithi125 ceph-mon[86115]: pgmap v1687: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:03:03.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:03 smithi096 ceph-mon[112483]: pgmap v1688: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T20:03:03.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:03 smithi125 ceph-mon[86115]: pgmap v1688: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T20:03:05.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:05 smithi125 ceph-mon[86115]: pgmap v1689: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T20:03:05.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:05 smithi096 ceph-mon[112483]: pgmap v1689: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T20:03:06.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:03:06.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:03:07.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:07 smithi096 ceph-mon[112483]: pgmap v1690: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T20:03:07.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:07 smithi125 ceph-mon[86115]: pgmap v1690: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T20:03:09.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:09 smithi096 ceph-mon[112483]: pgmap v1691: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-19T20:03:09.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:09 smithi125 ceph-mon[86115]: pgmap v1691: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-02-19T20:03:11.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:11 smithi096 ceph-mon[112483]: pgmap v1692: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T20:03:11.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:11 smithi125 ceph-mon[86115]: pgmap v1692: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-02-19T20:03:13.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:13 smithi096 ceph-mon[112483]: pgmap v1693: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T20:03:13.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:13 smithi125 ceph-mon[86115]: pgmap v1693: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-02-19T20:03:15.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:15 smithi125 ceph-mon[86115]: pgmap v1694: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:03:15.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:15 smithi096 ceph-mon[112483]: pgmap v1694: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:03:17.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:17 smithi096 ceph-mon[112483]: pgmap v1695: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:03:17.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:17 smithi125 ceph-mon[86115]: pgmap v1695: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:03:19.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:19 smithi096 ceph-mon[112483]: pgmap v1696: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:03:19.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:19 smithi125 ceph-mon[86115]: pgmap v1696: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:03:20.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:03:20.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:03:21.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:21 smithi096 ceph-mon[112483]: pgmap v1697: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:03:21.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:21 smithi125 ceph-mon[86115]: pgmap v1697: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:03:23.734 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:23 smithi125 ceph-mon[86115]: pgmap v1698: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:03:23.735 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:03:23.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:23 smithi096 ceph-mon[112483]: pgmap v1698: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:03:23.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:03:24.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:24 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:03:24.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:24 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:03:24.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:24 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:03:24.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:24 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:03:24.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:24 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:03:24.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:24 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:03:26.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:25 smithi125 ceph-mon[86115]: pgmap v1699: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:03:26.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:25 smithi096 ceph-mon[112483]: pgmap v1699: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:03:28.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:27 smithi125 ceph-mon[86115]: pgmap v1700: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:03:28.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:27 smithi096 ceph-mon[112483]: pgmap v1700: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:03:30.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:29 smithi125 ceph-mon[86115]: pgmap v1701: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:03:30.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:29 smithi096 ceph-mon[112483]: pgmap v1701: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:03:32.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:31 smithi125 ceph-mon[86115]: pgmap v1702: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:03:32.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:31 smithi096 ceph-mon[112483]: pgmap v1702: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:03:34.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:33 smithi125 ceph-mon[86115]: pgmap v1703: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:03:34.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:33 smithi096 ceph-mon[112483]: pgmap v1703: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:03:36.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:35 smithi125 ceph-mon[86115]: pgmap v1704: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:03:36.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:03:36.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:35 smithi096 ceph-mon[112483]: pgmap v1704: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:03:36.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:03:38.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:37 smithi125 ceph-mon[86115]: pgmap v1705: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:03:38.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:37 smithi096 ceph-mon[112483]: pgmap v1705: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:03:40.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:39 smithi125 ceph-mon[86115]: pgmap v1706: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:03:40.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:39 smithi096 ceph-mon[112483]: pgmap v1706: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:03:42.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:41 smithi125 ceph-mon[86115]: pgmap v1707: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:03:42.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:41 smithi096 ceph-mon[112483]: pgmap v1707: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:03:44.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:43 smithi125 ceph-mon[86115]: pgmap v1708: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:03:44.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:43 smithi096 ceph-mon[112483]: pgmap v1708: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:03:46.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:45 smithi125 ceph-mon[86115]: pgmap v1709: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:03:46.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:45 smithi096 ceph-mon[112483]: pgmap v1709: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:03:48.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:47 smithi125 ceph-mon[86115]: pgmap v1710: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:03:48.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:47 smithi096 ceph-mon[112483]: pgmap v1710: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:03:50.116 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:49 smithi096 ceph-mon[112483]: pgmap v1711: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:03:50.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:49 smithi125 ceph-mon[86115]: pgmap v1711: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:03:51.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:03:51.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:03:52.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:51 smithi125 ceph-mon[86115]: pgmap v1712: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:03:52.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:51 smithi096 ceph-mon[112483]: pgmap v1712: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:03:54.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:53 smithi125 ceph-mon[86115]: pgmap v1713: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:03:54.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:53 smithi096 ceph-mon[112483]: pgmap v1713: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:03:55.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:55 smithi125 ceph-mon[86115]: pgmap v1714: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:03:56.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:55 smithi096 ceph-mon[112483]: pgmap v1714: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:03:58.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:57 smithi125 ceph-mon[86115]: pgmap v1715: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:03:58.271 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:57 smithi096 ceph-mon[112483]: pgmap v1715: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:00.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:03:59 smithi125 ceph-mon[86115]: pgmap v1716: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:04:00.229 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:03:59 smithi096 ceph-mon[112483]: pgmap v1716: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:04:02.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:01 smithi125 ceph-mon[86115]: pgmap v1717: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:02.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:01 smithi096 ceph-mon[112483]: pgmap v1717: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:04.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:03 smithi125 ceph-mon[86115]: pgmap v1718: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:04.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:03 smithi096 ceph-mon[112483]: pgmap v1718: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:06.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:05 smithi125 ceph-mon[86115]: pgmap v1719: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:06.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:04:06.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:05 smithi096 ceph-mon[112483]: pgmap v1719: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:06.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:04:08.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:07 smithi125 ceph-mon[86115]: pgmap v1720: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:08.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:07 smithi096 ceph-mon[112483]: pgmap v1720: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:10.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:09 smithi125 ceph-mon[86115]: pgmap v1721: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:04:10.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:09 smithi096 ceph-mon[112483]: pgmap v1721: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:04:12.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:11 smithi125 ceph-mon[86115]: pgmap v1722: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:12.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:11 smithi096 ceph-mon[112483]: pgmap v1722: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:14.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:13 smithi125 ceph-mon[86115]: pgmap v1723: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:14.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:13 smithi096 ceph-mon[112483]: pgmap v1723: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:16.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:15 smithi125 ceph-mon[86115]: pgmap v1724: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:16.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:15 smithi096 ceph-mon[112483]: pgmap v1724: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:18.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:17 smithi125 ceph-mon[86115]: pgmap v1725: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:18.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:17 smithi096 ceph-mon[112483]: pgmap v1725: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:20.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:19 smithi125 ceph-mon[86115]: pgmap v1726: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:04:20.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:19 smithi096 ceph-mon[112483]: pgmap v1726: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:04:21.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:04:21.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:04:22.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:21 smithi125 ceph-mon[86115]: pgmap v1727: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:22.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:21 smithi096 ceph-mon[112483]: pgmap v1727: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:24.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:23 smithi125 ceph-mon[86115]: pgmap v1728: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:24.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:23 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:04:24.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:23 smithi096 ceph-mon[112483]: pgmap v1728: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:24.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:23 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:04:25.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:24 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:04:25.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:24 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:04:25.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:24 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:04:25.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:24 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:04:25.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:24 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:04:25.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:24 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:04:26.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:25 smithi125 ceph-mon[86115]: pgmap v1729: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:26.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:25 smithi096 ceph-mon[112483]: pgmap v1729: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:28.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:27 smithi125 ceph-mon[86115]: pgmap v1730: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:28.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:27 smithi096 ceph-mon[112483]: pgmap v1730: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:30.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:29 smithi125 ceph-mon[86115]: pgmap v1731: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:04:30.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:29 smithi096 ceph-mon[112483]: pgmap v1731: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:04:32.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:31 smithi125 ceph-mon[86115]: pgmap v1732: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:32.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:31 smithi096 ceph-mon[112483]: pgmap v1732: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:34.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:33 smithi125 ceph-mon[86115]: pgmap v1733: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:34.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:33 smithi096 ceph-mon[112483]: pgmap v1733: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:36.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:35 smithi125 ceph-mon[86115]: pgmap v1734: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:36.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:04:36.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:35 smithi096 ceph-mon[112483]: pgmap v1734: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:36.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:04:38.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:37 smithi125 ceph-mon[86115]: pgmap v1735: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:38.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:37 smithi096 ceph-mon[112483]: pgmap v1735: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:40.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:39 smithi125 ceph-mon[86115]: pgmap v1736: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:04:40.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:39 smithi096 ceph-mon[112483]: pgmap v1736: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:04:42.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:41 smithi125 ceph-mon[86115]: pgmap v1737: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:42.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:41 smithi096 ceph-mon[112483]: pgmap v1737: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:44.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:43 smithi125 ceph-mon[86115]: pgmap v1738: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:44.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:43 smithi096 ceph-mon[112483]: pgmap v1738: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:46.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:45 smithi096 ceph-mon[112483]: pgmap v1739: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:46.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:45 smithi125 ceph-mon[86115]: pgmap v1739: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:48.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:47 smithi125 ceph-mon[86115]: pgmap v1740: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:48.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:47 smithi096 ceph-mon[112483]: pgmap v1740: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:49.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:48 smithi096 ceph-mon[112483]: pgmap v1741: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:04:49.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:48 smithi125 ceph-mon[86115]: pgmap v1741: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:04:51.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:51 smithi096 ceph-mon[112483]: pgmap v1742: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:51.519 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:51 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:04:51.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:51 smithi125 ceph-mon[86115]: pgmap v1742: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:51.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:51 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:04:53.319 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:53 smithi096 ceph-mon[112483]: pgmap v1743: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:53.485 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:53 smithi125 ceph-mon[86115]: pgmap v1743: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:55.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:55 smithi096 ceph-mon[112483]: pgmap v1744: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:55.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:55 smithi125 ceph-mon[86115]: pgmap v1744: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:04:57.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:57 smithi096 ceph-mon[112483]: pgmap v1745: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:57.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:57 smithi125 ceph-mon[86115]: pgmap v1745: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:04:59.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:04:59 smithi096 ceph-mon[112483]: pgmap v1746: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:04:59.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:04:59 smithi125 ceph-mon[86115]: pgmap v1746: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:05:01.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:01 smithi125 ceph-mon[86115]: pgmap v1747: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:01.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:01 smithi096 ceph-mon[112483]: pgmap v1747: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:03.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:03 smithi096 ceph-mon[112483]: pgmap v1748: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:03.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:03 smithi125 ceph-mon[86115]: pgmap v1748: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:05.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:05 smithi096 ceph-mon[112483]: pgmap v1749: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:05.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:05:05.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:05 smithi125 ceph-mon[86115]: pgmap v1749: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:05.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:05:07.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:07 smithi096 ceph-mon[112483]: pgmap v1750: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:07.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:07 smithi125 ceph-mon[86115]: pgmap v1750: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:09.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:09 smithi096 ceph-mon[112483]: pgmap v1751: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:05:09.933 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:09 smithi125 ceph-mon[86115]: pgmap v1751: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:05:11.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:11 smithi096 ceph-mon[112483]: pgmap v1752: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:11.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:11 smithi125 ceph-mon[86115]: pgmap v1752: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:13.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:13 smithi096 ceph-mon[112483]: pgmap v1753: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:13.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:13 smithi125 ceph-mon[86115]: pgmap v1753: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:15.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:15 smithi096 ceph-mon[112483]: pgmap v1754: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:15.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:15 smithi125 ceph-mon[86115]: pgmap v1754: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:17.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:17 smithi096 ceph-mon[112483]: pgmap v1755: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:17.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:17 smithi125 ceph-mon[86115]: pgmap v1755: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:19.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:19 smithi096 ceph-mon[112483]: pgmap v1756: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:05:19.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:19 smithi125 ceph-mon[86115]: pgmap v1756: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:05:20.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:05:20.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:05:21.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:21 smithi096 ceph-mon[112483]: pgmap v1757: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:21.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:21 smithi125 ceph-mon[86115]: pgmap v1757: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:23.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:23 smithi096 ceph-mon[112483]: pgmap v1758: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:23.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:23 smithi125 ceph-mon[86115]: pgmap v1758: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:25.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:25 smithi125 ceph-mon[86115]: pgmap v1759: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:25.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:25 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:05:25.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:25 smithi096 ceph-mon[112483]: pgmap v1759: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:25.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:25 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:05:27.905 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:27 smithi096 ceph-mon[112483]: pgmap v1760: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:27.905 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:27 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:05:27.906 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:27 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:05:28.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:27 smithi125 ceph-mon[86115]: pgmap v1760: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:28.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:27 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:05:28.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:27 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:05:30.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:29 smithi125 ceph-mon[86115]: pgmap v1761: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:05:30.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:29 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:05:30.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:29 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:05:30.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:29 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:05:30.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:29 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:05:30.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:29 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:05:30.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:29 smithi096 ceph-mon[112483]: pgmap v1761: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:05:30.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:29 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:05:30.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:29 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:05:30.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:29 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:05:30.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:29 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:05:30.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:29 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:05:32.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:31 smithi125 ceph-mon[86115]: pgmap v1762: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:32.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:31 smithi096 ceph-mon[112483]: pgmap v1762: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:34.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:33 smithi125 ceph-mon[86115]: pgmap v1763: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:34.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:33 smithi096 ceph-mon[112483]: pgmap v1763: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:36.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:35 smithi125 ceph-mon[86115]: pgmap v1764: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:36.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:05:36.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:35 smithi096 ceph-mon[112483]: pgmap v1764: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:36.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:05:38.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:37 smithi125 ceph-mon[86115]: pgmap v1765: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:38.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:37 smithi096 ceph-mon[112483]: pgmap v1765: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:40.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:39 smithi125 ceph-mon[86115]: pgmap v1766: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:05:40.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:39 smithi096 ceph-mon[112483]: pgmap v1766: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:05:42.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:41 smithi125 ceph-mon[86115]: pgmap v1767: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:42.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:41 smithi096 ceph-mon[112483]: pgmap v1767: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:44.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:43 smithi125 ceph-mon[86115]: pgmap v1768: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:44.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:43 smithi096 ceph-mon[112483]: pgmap v1768: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:46.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:45 smithi125 ceph-mon[86115]: pgmap v1769: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:46.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:45 smithi096 ceph-mon[112483]: pgmap v1769: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:48.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:47 smithi125 ceph-mon[86115]: pgmap v1770: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:48.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:47 smithi096 ceph-mon[112483]: pgmap v1770: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:50.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:49 smithi125 ceph-mon[86115]: pgmap v1771: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:05:50.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:49 smithi096 ceph-mon[112483]: pgmap v1771: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:05:51.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:05:51.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:05:52.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:51 smithi125 ceph-mon[86115]: pgmap v1772: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:52.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:51 smithi096 ceph-mon[112483]: pgmap v1772: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:54.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:53 smithi125 ceph-mon[86115]: pgmap v1773: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:54.184 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:53 smithi096 ceph-mon[112483]: pgmap v1773: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:56.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:55 smithi125 ceph-mon[86115]: pgmap v1774: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:56.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:55 smithi096 ceph-mon[112483]: pgmap v1774: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:05:58.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:57 smithi125 ceph-mon[86115]: pgmap v1775: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:05:58.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:57 smithi096 ceph-mon[112483]: pgmap v1775: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:00.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:05:59 smithi125 ceph-mon[86115]: pgmap v1776: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:06:00.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:05:59 smithi096 ceph-mon[112483]: pgmap v1776: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:06:01.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:01 smithi125 ceph-mon[86115]: pgmap v1777: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:02.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:01 smithi096 ceph-mon[112483]: pgmap v1777: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:04.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:03 smithi125 ceph-mon[86115]: pgmap v1778: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:04.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:03 smithi096 ceph-mon[112483]: pgmap v1778: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:06.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:05 smithi125 ceph-mon[86115]: pgmap v1779: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:06.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:06:06.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:05 smithi096 ceph-mon[112483]: pgmap v1779: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:06.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:06:08.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:07 smithi125 ceph-mon[86115]: pgmap v1780: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:08.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:07 smithi096 ceph-mon[112483]: pgmap v1780: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:10.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:09 smithi125 ceph-mon[86115]: pgmap v1781: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:06:10.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:09 smithi096 ceph-mon[112483]: pgmap v1781: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:06:12.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:11 smithi096 ceph-mon[112483]: pgmap v1782: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:12.140 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:11 smithi125 ceph-mon[86115]: pgmap v1782: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:14.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:13 smithi125 ceph-mon[86115]: pgmap v1783: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:14.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:13 smithi096 ceph-mon[112483]: pgmap v1783: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:16.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:15 smithi125 ceph-mon[86115]: pgmap v1784: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:16.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:15 smithi096 ceph-mon[112483]: pgmap v1784: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:18.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:17 smithi125 ceph-mon[86115]: pgmap v1785: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:18.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:17 smithi096 ceph-mon[112483]: pgmap v1785: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:20.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:19 smithi125 ceph-mon[86115]: pgmap v1786: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:06:20.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:19 smithi096 ceph-mon[112483]: pgmap v1786: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:06:21.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:06:21.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:06:22.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:21 smithi125 ceph-mon[86115]: pgmap v1787: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:22.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:21 smithi096 ceph-mon[112483]: pgmap v1787: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:24.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:23 smithi125 ceph-mon[86115]: pgmap v1788: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:24.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:23 smithi096 ceph-mon[112483]: pgmap v1788: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:26.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:25 smithi125 ceph-mon[86115]: pgmap v1789: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:26.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:25 smithi096 ceph-mon[112483]: pgmap v1789: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:28.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:27 smithi125 ceph-mon[86115]: pgmap v1790: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:28.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:27 smithi096 ceph-mon[112483]: pgmap v1790: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:30.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:29 smithi125 ceph-mon[86115]: pgmap v1791: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:06:30.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:29 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:06:30.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:29 smithi096 ceph-mon[112483]: pgmap v1791: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:06:30.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:29 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:06:31.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:30 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:06:31.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:30 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:06:31.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:30 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:06:31.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:30 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:06:31.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:30 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:06:31.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:30 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:06:32.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:31 smithi125 ceph-mon[86115]: pgmap v1792: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:32.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:31 smithi096 ceph-mon[112483]: pgmap v1792: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:34.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:33 smithi096 ceph-mon[112483]: pgmap v1793: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:34.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:33 smithi125 ceph-mon[86115]: pgmap v1793: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:36.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:35 smithi125 ceph-mon[86115]: pgmap v1794: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:36.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:06:36.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:35 smithi096 ceph-mon[112483]: pgmap v1794: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:36.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:06:38.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:37 smithi125 ceph-mon[86115]: pgmap v1795: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:38.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:37 smithi096 ceph-mon[112483]: pgmap v1795: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:40.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:39 smithi125 ceph-mon[86115]: pgmap v1796: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:06:40.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:39 smithi096 ceph-mon[112483]: pgmap v1796: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:06:42.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:41 smithi125 ceph-mon[86115]: pgmap v1797: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:42.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:41 smithi096 ceph-mon[112483]: pgmap v1797: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:44.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:43 smithi125 ceph-mon[86115]: pgmap v1798: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:44.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:43 smithi096 ceph-mon[112483]: pgmap v1798: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:46.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:45 smithi125 ceph-mon[86115]: pgmap v1799: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:46.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:45 smithi096 ceph-mon[112483]: pgmap v1799: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:48.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:47 smithi125 ceph-mon[86115]: pgmap v1800: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:48.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:47 smithi096 ceph-mon[112483]: pgmap v1800: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:50.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:49 smithi125 ceph-mon[86115]: pgmap v1801: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:06:50.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:49 smithi096 ceph-mon[112483]: pgmap v1801: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:06:51.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:06:51.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:06:52.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:51 smithi096 ceph-mon[112483]: pgmap v1802: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:52.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:51 smithi125 ceph-mon[86115]: pgmap v1802: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:54.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:53 smithi096 ceph-mon[112483]: pgmap v1803: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:54.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:53 smithi125 ceph-mon[86115]: pgmap v1803: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:56.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:55 smithi096 ceph-mon[112483]: pgmap v1804: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:56.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:55 smithi125 ceph-mon[86115]: pgmap v1804: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:06:58.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:57 smithi096 ceph-mon[112483]: pgmap v1805: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:06:58.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:57 smithi125 ceph-mon[86115]: pgmap v1805: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:00.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:06:59 smithi096 ceph-mon[112483]: pgmap v1806: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:07:00.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:06:59 smithi125 ceph-mon[86115]: pgmap v1806: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:07:02.254 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:01 smithi096 ceph-mon[112483]: pgmap v1807: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:02.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:01 smithi125 ceph-mon[86115]: pgmap v1807: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:03.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:03 smithi096 ceph-mon[112483]: pgmap v1808: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:03.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:03 smithi125 ceph-mon[86115]: pgmap v1808: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:05.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:05 smithi096 ceph-mon[112483]: pgmap v1809: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:05.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:05 smithi125 ceph-mon[86115]: pgmap v1809: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:06.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:07:06.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:07:07.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:07 smithi096 ceph-mon[112483]: pgmap v1810: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:07.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:07 smithi125 ceph-mon[86115]: pgmap v1810: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:09.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:09 smithi096 ceph-mon[112483]: pgmap v1811: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:07:09.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:09 smithi125 ceph-mon[86115]: pgmap v1811: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:07:11.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:11 smithi096 ceph-mon[112483]: pgmap v1812: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:11.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:11 smithi125 ceph-mon[86115]: pgmap v1812: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:13.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:13 smithi096 ceph-mon[112483]: pgmap v1813: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:13.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:13 smithi125 ceph-mon[86115]: pgmap v1813: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:15.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:15 smithi096 ceph-mon[112483]: pgmap v1814: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:15.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:15 smithi125 ceph-mon[86115]: pgmap v1814: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:17.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:17 smithi096 ceph-mon[112483]: pgmap v1815: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:17.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:17 smithi125 ceph-mon[86115]: pgmap v1815: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:19.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:19 smithi096 ceph-mon[112483]: pgmap v1816: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:07:19.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:19 smithi125 ceph-mon[86115]: pgmap v1816: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:07:21.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:21 smithi125 ceph-mon[86115]: pgmap v1817: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:21.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:07:21.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:21 smithi096 ceph-mon[112483]: pgmap v1817: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:21.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:07:23.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:23 smithi096 ceph-mon[112483]: pgmap v1818: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:23.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:23 smithi125 ceph-mon[86115]: pgmap v1818: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:25.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:25 smithi125 ceph-mon[86115]: pgmap v1819: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:25.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:25 smithi096 ceph-mon[112483]: pgmap v1819: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:27.536 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:27 smithi096 ceph-mon[112483]: pgmap v1820: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:27.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:27 smithi125 ceph-mon[86115]: pgmap v1820: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:29.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:29 smithi125 ceph-mon[86115]: pgmap v1821: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:07:29.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:29 smithi096 ceph-mon[112483]: pgmap v1821: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:07:31.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:31 smithi125 ceph-mon[86115]: pgmap v1822: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:31.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:31 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:07:31.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:31 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:07:31.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:31 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:07:31.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:31 smithi096 ceph-mon[112483]: pgmap v1822: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:31.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:31 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:07:31.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:31 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:07:31.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:31 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:07:32.592 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:32 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:07:32.592 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:32 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:07:32.592 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:32 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:07:32.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:32 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:07:32.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:32 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:07:32.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:32 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:07:33.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:33 smithi125 ceph-mon[86115]: pgmap v1823: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:34.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:33 smithi096 ceph-mon[112483]: pgmap v1823: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:35.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:35 smithi125 ceph-mon[86115]: pgmap v1824: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:35.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:07:36.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:35 smithi096 ceph-mon[112483]: pgmap v1824: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:36.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:07:37.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:37 smithi125 ceph-mon[86115]: pgmap v1825: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:38.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:37 smithi096 ceph-mon[112483]: pgmap v1825: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:39.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:39 smithi125 ceph-mon[86115]: pgmap v1826: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:07:40.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:39 smithi096 ceph-mon[112483]: pgmap v1826: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:07:41.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:41 smithi125 ceph-mon[86115]: pgmap v1827: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:42.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:41 smithi096 ceph-mon[112483]: pgmap v1827: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:43.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:43 smithi125 ceph-mon[86115]: pgmap v1828: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:44.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:43 smithi096 ceph-mon[112483]: pgmap v1828: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:45.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:45 smithi125 ceph-mon[86115]: pgmap v1829: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:46.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:45 smithi096 ceph-mon[112483]: pgmap v1829: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:47.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:47 smithi125 ceph-mon[86115]: pgmap v1830: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:48.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:47 smithi096 ceph-mon[112483]: pgmap v1830: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:49.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:49 smithi125 ceph-mon[86115]: pgmap v1831: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:07:50.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:49 smithi096 ceph-mon[112483]: pgmap v1831: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:07:50.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:07:51.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:07:51.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:51 smithi125 ceph-mon[86115]: pgmap v1832: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:52.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:51 smithi096 ceph-mon[112483]: pgmap v1832: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:53.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:53 smithi125 ceph-mon[86115]: pgmap v1833: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:54.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:53 smithi096 ceph-mon[112483]: pgmap v1833: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:55.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:55 smithi125 ceph-mon[86115]: pgmap v1834: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:56.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:55 smithi096 ceph-mon[112483]: pgmap v1834: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:07:57.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:57 smithi125 ceph-mon[86115]: pgmap v1835: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:58.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:57 smithi096 ceph-mon[112483]: pgmap v1835: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:07:59.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:07:59 smithi125 ceph-mon[86115]: pgmap v1836: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:08:00.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:07:59 smithi096 ceph-mon[112483]: pgmap v1836: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:08:01.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:01 smithi125 ceph-mon[86115]: pgmap v1837: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:02.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:01 smithi096 ceph-mon[112483]: pgmap v1837: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:03.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:03 smithi125 ceph-mon[86115]: pgmap v1838: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:04.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:03 smithi096 ceph-mon[112483]: pgmap v1838: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:06.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:05 smithi096 ceph-mon[112483]: pgmap v1839: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:06.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:08:06.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:05 smithi125 ceph-mon[86115]: pgmap v1839: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:06.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:08:07.982 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:07 smithi096 ceph-mon[112483]: pgmap v1840: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:08.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:07 smithi125 ceph-mon[86115]: pgmap v1840: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:10.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:09 smithi096 ceph-mon[112483]: pgmap v1841: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:08:10.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:09 smithi125 ceph-mon[86115]: pgmap v1841: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:08:12.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:11 smithi096 ceph-mon[112483]: pgmap v1842: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:12.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:11 smithi125 ceph-mon[86115]: pgmap v1842: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:13.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:13 smithi125 ceph-mon[86115]: pgmap v1843: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:14.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:13 smithi096 ceph-mon[112483]: pgmap v1843: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:16.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:15 smithi096 ceph-mon[112483]: pgmap v1844: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:16.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:15 smithi125 ceph-mon[86115]: pgmap v1844: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:18.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:17 smithi096 ceph-mon[112483]: pgmap v1845: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:18.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:17 smithi125 ceph-mon[86115]: pgmap v1845: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:20.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:19 smithi096 ceph-mon[112483]: pgmap v1846: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:08:20.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:19 smithi125 ceph-mon[86115]: pgmap v1846: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:08:21.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:08:21.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:08:22.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:21 smithi096 ceph-mon[112483]: pgmap v1847: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:22.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:21 smithi125 ceph-mon[86115]: pgmap v1847: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:23.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:23 smithi125 ceph-mon[86115]: pgmap v1848: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:24.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:23 smithi096 ceph-mon[112483]: pgmap v1848: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:26.001 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:25 smithi125 ceph-mon[86115]: pgmap v1849: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:26.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:25 smithi096 ceph-mon[112483]: pgmap v1849: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:28.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:27 smithi096 ceph-mon[112483]: pgmap v1850: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:28.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:27 smithi125 ceph-mon[86115]: pgmap v1850: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:30.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:29 smithi096 ceph-mon[112483]: pgmap v1851: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:08:30.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:29 smithi125 ceph-mon[86115]: pgmap v1851: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:08:32.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:31 smithi096 ceph-mon[112483]: pgmap v1852: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:32.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:31 smithi125 ceph-mon[86115]: pgmap v1852: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:33.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:32 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:08:33.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:32 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:08:33.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:32 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:08:33.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:32 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:08:33.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:32 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:08:33.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:32 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:08:33.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:32 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:08:33.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:32 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:08:34.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:33 smithi096 ceph-mon[112483]: pgmap v1853: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:34.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:33 smithi125 ceph-mon[86115]: pgmap v1853: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:36.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:35 smithi096 ceph-mon[112483]: pgmap v1854: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:36.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:08:36.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:35 smithi125 ceph-mon[86115]: pgmap v1854: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:36.183 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:08:38.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:37 smithi096 ceph-mon[112483]: pgmap v1855: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:38.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:37 smithi125 ceph-mon[86115]: pgmap v1855: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:40.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:39 smithi096 ceph-mon[112483]: pgmap v1856: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:08:40.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:39 smithi125 ceph-mon[86115]: pgmap v1856: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:08:42.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:41 smithi096 ceph-mon[112483]: pgmap v1857: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:42.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:41 smithi125 ceph-mon[86115]: pgmap v1857: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:44.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:43 smithi096 ceph-mon[112483]: pgmap v1858: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:44.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:43 smithi125 ceph-mon[86115]: pgmap v1858: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:46.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:45 smithi096 ceph-mon[112483]: pgmap v1859: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:46.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:45 smithi125 ceph-mon[86115]: pgmap v1859: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:48.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:47 smithi096 ceph-mon[112483]: pgmap v1860: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:48.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:47 smithi125 ceph-mon[86115]: pgmap v1860: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:50.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:49 smithi096 ceph-mon[112483]: pgmap v1861: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:08:50.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:49 smithi125 ceph-mon[86115]: pgmap v1861: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:08:51.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:08:51.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:08:52.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:51 smithi096 ceph-mon[112483]: pgmap v1862: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:52.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:51 smithi125 ceph-mon[86115]: pgmap v1862: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:54.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:53 smithi125 ceph-mon[86115]: pgmap v1863: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:54.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:53 smithi096 ceph-mon[112483]: pgmap v1863: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:56.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:55 smithi125 ceph-mon[86115]: pgmap v1864: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:56.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:55 smithi096 ceph-mon[112483]: pgmap v1864: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:08:58.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:57 smithi125 ceph-mon[86115]: pgmap v1865: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:08:58.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:57 smithi096 ceph-mon[112483]: pgmap v1865: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:00.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:08:59 smithi125 ceph-mon[86115]: pgmap v1866: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:09:00.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:08:59 smithi096 ceph-mon[112483]: pgmap v1866: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:09:02.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:01 smithi125 ceph-mon[86115]: pgmap v1867: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:02.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:01 smithi096 ceph-mon[112483]: pgmap v1867: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:04.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:03 smithi096 ceph-mon[112483]: pgmap v1868: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:04.058 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:03 smithi125 ceph-mon[86115]: pgmap v1868: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:06.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:05 smithi125 ceph-mon[86115]: pgmap v1869: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:06.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:09:06.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:05 smithi096 ceph-mon[112483]: pgmap v1869: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:06.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:09:08.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:07 smithi125 ceph-mon[86115]: pgmap v1870: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:08.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:07 smithi096 ceph-mon[112483]: pgmap v1870: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:10.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:09 smithi125 ceph-mon[86115]: pgmap v1871: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:09:10.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:09 smithi096 ceph-mon[112483]: pgmap v1871: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:09:12.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:11 smithi125 ceph-mon[86115]: pgmap v1872: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:12.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:11 smithi096 ceph-mon[112483]: pgmap v1872: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:14.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:13 smithi096 ceph-mon[112483]: pgmap v1873: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:14.174 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:13 smithi125 ceph-mon[86115]: pgmap v1873: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:16.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:15 smithi125 ceph-mon[86115]: pgmap v1874: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:16.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:15 smithi096 ceph-mon[112483]: pgmap v1874: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:18.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:17 smithi125 ceph-mon[86115]: pgmap v1875: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:18.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:17 smithi096 ceph-mon[112483]: pgmap v1875: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:20.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:19 smithi125 ceph-mon[86115]: pgmap v1876: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:09:20.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:19 smithi096 ceph-mon[112483]: pgmap v1876: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:09:21.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:20 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:09:21.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:20 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:09:22.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:21 smithi125 ceph-mon[86115]: pgmap v1877: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:22.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:21 smithi096 ceph-mon[112483]: pgmap v1877: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:24.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:23 smithi125 ceph-mon[86115]: pgmap v1878: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:24.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:23 smithi096 ceph-mon[112483]: pgmap v1878: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:26.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:25 smithi125 ceph-mon[86115]: pgmap v1879: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:26.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:25 smithi096 ceph-mon[112483]: pgmap v1879: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:28.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:27 smithi125 ceph-mon[86115]: pgmap v1880: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:28.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:27 smithi096 ceph-mon[112483]: pgmap v1880: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:30.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:29 smithi125 ceph-mon[86115]: pgmap v1881: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:09:30.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:29 smithi096 ceph-mon[112483]: pgmap v1881: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:09:32.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:31 smithi125 ceph-mon[86115]: pgmap v1882: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:32.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:31 smithi096 ceph-mon[112483]: pgmap v1882: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:33.182 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:32 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:09:33.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:32 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:09:34.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:33 smithi096 ceph-mon[112483]: pgmap v1883: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:34.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:33 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:09:34.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:33 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:09:34.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:33 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:09:34.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:33 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:09:34.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:33 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:09:34.399 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:33 smithi125 ceph-mon[86115]: pgmap v1883: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:34.400 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:33 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:09:34.400 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:33 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:09:34.400 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:33 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:09:34.400 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:33 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:09:34.400 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:33 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:09:36.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:35 smithi096 ceph-mon[112483]: pgmap v1884: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:36.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:35 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:09:36.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:35 smithi125 ceph-mon[86115]: pgmap v1884: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:36.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:35 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:09:38.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:37 smithi096 ceph-mon[112483]: pgmap v1885: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:38.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:37 smithi125 ceph-mon[86115]: pgmap v1885: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:40.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:39 smithi096 ceph-mon[112483]: pgmap v1886: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:09:40.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:39 smithi125 ceph-mon[86115]: pgmap v1886: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:09:42.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:41 smithi096 ceph-mon[112483]: pgmap v1887: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:42.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:41 smithi125 ceph-mon[86115]: pgmap v1887: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:44.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:43 smithi096 ceph-mon[112483]: pgmap v1888: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:44.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:43 smithi125 ceph-mon[86115]: pgmap v1888: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:46.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:45 smithi096 ceph-mon[112483]: pgmap v1889: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:46.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:45 smithi125 ceph-mon[86115]: pgmap v1889: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:48.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:47 smithi096 ceph-mon[112483]: pgmap v1890: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:48.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:47 smithi125 ceph-mon[86115]: pgmap v1890: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:50.268 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:49 smithi096 ceph-mon[112483]: pgmap v1891: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:09:50.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:49 smithi125 ceph-mon[86115]: pgmap v1891: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:09:51.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:09:51.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:09:52.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:51 smithi096 ceph-mon[112483]: pgmap v1892: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:52.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:51 smithi125 ceph-mon[86115]: pgmap v1892: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:53.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:52 smithi096 ceph-mon[112483]: pgmap v1893: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:53.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:52 smithi125 ceph-mon[86115]: pgmap v1893: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:55.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:55 smithi125 ceph-mon[86115]: pgmap v1894: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:55.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:55 smithi096 ceph-mon[112483]: pgmap v1894: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:09:57.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:57 smithi125 ceph-mon[86115]: pgmap v1895: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:57.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:57 smithi096 ceph-mon[112483]: pgmap v1895: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:09:59.517 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:09:59 smithi096 ceph-mon[112483]: pgmap v1896: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:09:59.680 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:09:59 smithi125 ceph-mon[86115]: pgmap v1896: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:10:00.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:00 smithi125 ceph-mon[86115]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T20:10:00.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:00 smithi096 ceph-mon[112483]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-02-19T20:10:01.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:01 smithi125 ceph-mon[86115]: pgmap v1897: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:01.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:01 smithi096 ceph-mon[112483]: pgmap v1897: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:03.518 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:03 smithi096 ceph-mon[112483]: pgmap v1898: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:03.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:03 smithi125 ceph-mon[86115]: pgmap v1898: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:05.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:05 smithi125 ceph-mon[86115]: pgmap v1899: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:05.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:05 smithi096 ceph-mon[112483]: pgmap v1899: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:06.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:06 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:10:06.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:06 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:10:07.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:07 smithi125 ceph-mon[86115]: pgmap v1900: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:07.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:07 smithi096 ceph-mon[112483]: pgmap v1900: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:09.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:09 smithi125 ceph-mon[86115]: pgmap v1901: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:10:09.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:09 smithi096 ceph-mon[112483]: pgmap v1901: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:10:11.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:11 smithi125 ceph-mon[86115]: pgmap v1902: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:11.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:11 smithi096 ceph-mon[112483]: pgmap v1902: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:13.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:13 smithi125 ceph-mon[86115]: pgmap v1903: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:13.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:13 smithi096 ceph-mon[112483]: pgmap v1903: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:15.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:15 smithi125 ceph-mon[86115]: pgmap v1904: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:15.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:15 smithi096 ceph-mon[112483]: pgmap v1904: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:17.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:17 smithi125 ceph-mon[86115]: pgmap v1905: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:17.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:17 smithi096 ceph-mon[112483]: pgmap v1905: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:19.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:19 smithi125 ceph-mon[86115]: pgmap v1906: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:10:19.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:19 smithi096 ceph-mon[112483]: pgmap v1906: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:10:21.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:21 smithi125 ceph-mon[86115]: pgmap v1907: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:21.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:21 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:10:21.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:21 smithi096 ceph-mon[112483]: pgmap v1907: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:21.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:21 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:10:23.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:23 smithi125 ceph-mon[86115]: pgmap v1908: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:23.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:23 smithi096 ceph-mon[112483]: pgmap v1908: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:25.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:25 smithi125 ceph-mon[86115]: pgmap v1909: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:25.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:25 smithi096 ceph-mon[112483]: pgmap v1909: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:27.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:27 smithi125 ceph-mon[86115]: pgmap v1910: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:27.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:27 smithi096 ceph-mon[112483]: pgmap v1910: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:29.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:29 smithi125 ceph-mon[86115]: pgmap v1911: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:10:29.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:29 smithi096 ceph-mon[112483]: pgmap v1911: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:10:31.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:31 smithi125 ceph-mon[86115]: pgmap v1912: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:31.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:31 smithi096 ceph-mon[112483]: pgmap v1912: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:33.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:33 smithi125 ceph-mon[86115]: pgmap v1913: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:33.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:33 smithi096 ceph-mon[112483]: pgmap v1913: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:34.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:34 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:10:34.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:34 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:10:34.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:34 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:10:34.683 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:34 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:10:34.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:34 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-19T20:10:34.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:34 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-19T20:10:34.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:34 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-19T20:10:34.768 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:34 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' 2024-02-19T20:10:35.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:35 smithi125 ceph-mon[86115]: pgmap v1914: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:35.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:35 smithi096 ceph-mon[112483]: pgmap v1914: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:36.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:36 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:10:36.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:36 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:10:37.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:37 smithi125 ceph-mon[86115]: pgmap v1915: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:37.767 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:37 smithi096 ceph-mon[112483]: pgmap v1915: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:39.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:39 smithi125 ceph-mon[86115]: pgmap v1916: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:10:40.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:39 smithi096 ceph-mon[112483]: pgmap v1916: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:10:41.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:41 smithi125 ceph-mon[86115]: pgmap v1917: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:42.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:41 smithi096 ceph-mon[112483]: pgmap v1917: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:43.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:43 smithi125 ceph-mon[86115]: pgmap v1918: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:44.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:43 smithi096 ceph-mon[112483]: pgmap v1918: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:45.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:45 smithi125 ceph-mon[86115]: pgmap v1919: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:46.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:45 smithi096 ceph-mon[112483]: pgmap v1919: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:47.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:47 smithi125 ceph-mon[86115]: pgmap v1920: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:48.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:47 smithi096 ceph-mon[112483]: pgmap v1920: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:49.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:49 smithi125 ceph-mon[86115]: pgmap v1921: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:10:50.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:49 smithi096 ceph-mon[112483]: pgmap v1921: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:10:50.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:50 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:10:51.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:50 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:10:51.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:51 smithi125 ceph-mon[86115]: pgmap v1922: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:52.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:51 smithi096 ceph-mon[112483]: pgmap v1922: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:53.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:53 smithi125 ceph-mon[86115]: pgmap v1923: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:54.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:53 smithi096 ceph-mon[112483]: pgmap v1923: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:55.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:55 smithi125 ceph-mon[86115]: pgmap v1924: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:56.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:55 smithi096 ceph-mon[112483]: pgmap v1924: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:10:57.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:57 smithi125 ceph-mon[86115]: pgmap v1925: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:58.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:57 smithi096 ceph-mon[112483]: pgmap v1925: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:10:59.883 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:10:59 smithi096 ceph-mon[112483]: pgmap v1926: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:10:59.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:10:59 smithi125 ceph-mon[86115]: pgmap v1926: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-02-19T20:11:01.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:11:01 smithi125 ceph-mon[86115]: pgmap v1927: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:11:02.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:11:01 smithi096 ceph-mon[112483]: pgmap v1927: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:11:03.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:11:03 smithi125 ceph-mon[86115]: pgmap v1928: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:11:04.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:11:03 smithi096 ceph-mon[112483]: pgmap v1928: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:11:05.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:11:05 smithi125 ceph-mon[86115]: pgmap v1929: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:11:05.682 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:11:05 smithi125 ceph-mon[86115]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:11:06.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:11:05 smithi096 ceph-mon[112483]: pgmap v1929: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-02-19T20:11:06.018 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:11:05 smithi096 ceph-mon[112483]: from='mgr.34104 172.21.15.96:0/632389634' entity='mgr.smithi096.zsjdff' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-19T20:11:07.932 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:11:07 smithi125 ceph-mon[86115]: pgmap v1930: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:11:08.017 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:11:07 smithi096 ceph-mon[112483]: pgmap v1930: 65 pgs: 65 active+clean; 134 MiB data, 719 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-02-19T20:11:08.866 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-19T20:11:08.881 INFO:tasks.cephadm:Teardown begin 2024-02-19T20:11:08.882 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-19T20:11:08.919 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-19T20:11:08.955 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-19T20:11:08.956 DEBUG:teuthology.orchestra.run.smithi096:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-19T20:11:08.976 DEBUG:teuthology.orchestra.run.smithi125:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-19T20:11:09.014 INFO:tasks.cephadm:Stopping all daemons... 2024-02-19T20:11:09.015 INFO:tasks.cephadm.mon.smithi096:Stopping mon.smithi096... 2024-02-19T20:11:09.015 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ceph-06580d2c-cf58-11ee-95bb-87774f69a715@mon.smithi096 2024-02-19T20:11:09.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:11:09 smithi096 systemd[1]: Stopping Ceph mon.smithi096 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T20:11:09.707 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:11:09 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096[112479]: 2024-02-19T20:11:09.321+0000 7f3a8caae700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi096 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T20:11:09.707 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:11:09 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096[112479]: 2024-02-19T20:11:09.321+0000 7f3a8caae700 -1 mon.smithi096@0(leader) e3 *** Got Signal Terminated *** 2024-02-19T20:11:09.708 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:11:09 smithi096 podman[170455]: 2024-02-19 20:11:09.413276968 +0000 UTC m=+0.197234058 container died d70090d516e3e15263547e1a5a03c1e415208f10236f95bb463f99e57327d52c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-02-19T20:11:09.996 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:11:09 smithi096 podman[170455]: 2024-02-19 20:11:09.922051375 +0000 UTC m=+0.706008471 container cleanup d70090d516e3e15263547e1a5a03c1e415208f10236f95bb463f99e57327d52c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-19T20:11:09.997 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:11:09 smithi096 bash[170455]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096 2024-02-19T20:11:10.267 INFO:journalctl@ceph.mon.smithi096.smithi096.stdout:Feb 19 20:11:10 smithi096 podman[170481]: 2024-02-19 20:11:10.173633975 +0000 UTC m=+0.756715520 container remove d70090d516e3e15263547e1a5a03c1e415208f10236f95bb463f99e57327d52c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi096, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-02-19T20:11:10.349 DEBUG:teuthology.orchestra.run.smithi096:> sudo pkill -f 'journalctl -f -n 0 -u ceph-06580d2c-cf58-11ee-95bb-87774f69a715@mon.smithi096.service' 2024-02-19T20:11:10.416 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T20:11:10.416 INFO:tasks.cephadm.mon.smithi096:Stopped mon.smithi096 2024-02-19T20:11:10.417 INFO:tasks.cephadm.mon.smithi125:Stopping mon.smithi125... 2024-02-19T20:11:10.417 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ceph-06580d2c-cf58-11ee-95bb-87774f69a715@mon.smithi125 2024-02-19T20:11:10.717 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:11:10 smithi125 systemd[1]: Stopping Ceph mon.smithi125 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T20:11:11.083 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:11:10 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi125[86111]: 2024-02-19T20:11:10.715+0000 7f1aa9dbc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi125 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T20:11:11.084 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:11:10 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi125[86111]: 2024-02-19T20:11:10.715+0000 7f1aa9dbc700 -1 mon.smithi125@1(peon) e3 *** Got Signal Terminated *** 2024-02-19T20:11:11.084 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:11:10 smithi125 podman[134386]: 2024-02-19 20:11:10.807457911 +0000 UTC m=+0.196231680 container died f56b17bdc9a041e4bb0514a8f440155c780167860a928ca0d196ec5992c68c23 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi125, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T20:11:11.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:11:11 smithi125 podman[134386]: 2024-02-19 20:11:11.28283773 +0000 UTC m=+0.671611549 container cleanup f56b17bdc9a041e4bb0514a8f440155c780167860a928ca0d196ec5992c68c23 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi125, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True) 2024-02-19T20:11:11.432 INFO:journalctl@ceph.mon.smithi125.smithi125.stdout:Feb 19 20:11:11 smithi125 bash[134386]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715-mon-smithi125 2024-02-19T20:11:11.697 DEBUG:teuthology.orchestra.run.smithi125:> sudo pkill -f 'journalctl -f -n 0 -u ceph-06580d2c-cf58-11ee-95bb-87774f69a715@mon.smithi125.service' 2024-02-19T20:11:11.747 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T20:11:11.747 INFO:tasks.cephadm.mon.smithi125:Stopped mon.smithi125 2024-02-19T20:11:11.747 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-19T20:11:11.747 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.0 2024-02-19T20:11:12.052 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 20:11:11 smithi096 systemd[1]: Stopping Ceph osd.0 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T20:11:12.517 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 20:11:12 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0[124214]: 2024-02-19T20:11:12.050+0000 7fa1f3274700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T20:11:12.517 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 20:11:12 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0[124214]: 2024-02-19T20:11:12.050+0000 7fa1f3274700 -1 osd.0 86 *** Got signal Terminated *** 2024-02-19T20:11:12.518 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 20:11:12 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0[124214]: 2024-02-19T20:11:12.050+0000 7fa1f3274700 -1 osd.0 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T20:11:17.644 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 20:11:17 smithi096 podman[170588]: 2024-02-19 20:11:17.365702079 +0000 UTC m=+5.424875066 container died b3dffd6a3fb28a0182955e8226a4dc4773c71b331c611db468ed0590fa95b84a (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T20:11:18.012 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 20:11:17 smithi096 podman[170588]: 2024-02-19 20:11:17.742938064 +0000 UTC m=+5.802111048 container cleanup b3dffd6a3fb28a0182955e8226a4dc4773c71b331c611db468ed0590fa95b84a (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-02-19T20:11:18.012 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 20:11:17 smithi096 bash[170588]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0 2024-02-19T20:11:18.267 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 20:11:18 smithi096 podman[170605]: 2024-02-19 20:11:18.011268387 +0000 UTC m=+0.640075779 container remove b3dffd6a3fb28a0182955e8226a4dc4773c71b331c611db468ed0590fa95b84a (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240214) 2024-02-19T20:11:18.665 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 20:11:18 smithi096 podman[170695]: 2024-02-19 20:11:18.214412867 +0000 UTC m=+0.018271141 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T20:11:18.665 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 20:11:18 smithi096 podman[170695]: 2024-02-19 20:11:18.337226919 +0000 UTC m=+0.141085228 container create 8ad4d1946e88e46093f98f8655d82699270b2a6b0ca1ea7c3a54e2cfd4558d4c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-02-19T20:11:18.665 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 20:11:18 smithi096 podman[170695]: 2024-02-19 20:11:18.556439344 +0000 UTC m=+0.360297619 container init 8ad4d1946e88e46093f98f8655d82699270b2a6b0ca1ea7c3a54e2cfd4558d4c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-02-19T20:11:18.665 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 20:11:18 smithi096 podman[170695]: 2024-02-19 20:11:18.559457129 +0000 UTC m=+0.363315404 container start 8ad4d1946e88e46093f98f8655d82699270b2a6b0ca1ea7c3a54e2cfd4558d4c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-19T20:11:18.666 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 20:11:18 smithi096 podman[170695]: 2024-02-19 20:11:18.664610198 +0000 UTC m=+0.468468478 container attach 8ad4d1946e88e46093f98f8655d82699270b2a6b0ca1ea7c3a54e2cfd4558d4c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-02-19T20:11:19.017 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 20:11:18 smithi096 podman[170695]: 2024-02-19 20:11:18.856792412 +0000 UTC m=+0.660650696 container died 8ad4d1946e88e46093f98f8655d82699270b2a6b0ca1ea7c3a54e2cfd4558d4c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-deactivate, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T20:11:19.424 INFO:journalctl@ceph.osd.0.smithi096.stdout:Feb 19 20:11:19 smithi096 podman[170721]: 2024-02-19 20:11:19.410020566 +0000 UTC m=+0.547691461 container remove 8ad4d1946e88e46093f98f8655d82699270b2a6b0ca1ea7c3a54e2cfd4558d4c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-19T20:11:19.430 DEBUG:teuthology.orchestra.run.smithi096:> sudo pkill -f 'journalctl -f -n 0 -u ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.0.service' 2024-02-19T20:11:19.471 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T20:11:19.471 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-19T20:11:19.471 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-19T20:11:19.472 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.1 2024-02-19T20:11:19.700 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 20:11:19 smithi096 systemd[1]: Stopping Ceph osd.1 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T20:11:20.017 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 20:11:19 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1[129633]: 2024-02-19T20:11:19.829+0000 7f40024e9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T20:11:20.017 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 20:11:19 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1[129633]: 2024-02-19T20:11:19.829+0000 7f40024e9700 -1 osd.1 86 *** Got signal Terminated *** 2024-02-19T20:11:20.018 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 20:11:19 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1[129633]: 2024-02-19T20:11:19.829+0000 7f40024e9700 -1 osd.1 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T20:11:25.473 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 20:11:25 smithi096 podman[170801]: 2024-02-19 20:11:25.214437641 +0000 UTC m=+5.506657237 container died f0dd6d8f952f641be74d2a6670510f264717de61f3fde536d05424af2ff285f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-02-19T20:11:25.767 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 20:11:25 smithi096 podman[170801]: 2024-02-19 20:11:25.562698635 +0000 UTC m=+5.854918240 container cleanup f0dd6d8f952f641be74d2a6670510f264717de61f3fde536d05424af2ff285f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True) 2024-02-19T20:11:25.767 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 20:11:25 smithi096 bash[170801]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1 2024-02-19T20:11:26.235 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 20:11:25 smithi096 podman[170831]: 2024-02-19 20:11:25.897457869 +0000 UTC m=+0.680225853 container remove f0dd6d8f952f641be74d2a6670510f264717de61f3fde536d05424af2ff285f9 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS) 2024-02-19T20:11:26.493 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 20:11:26 smithi096 podman[170931]: 2024-02-19 20:11:26.137757118 +0000 UTC m=+0.018266823 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T20:11:26.493 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 20:11:26 smithi096 podman[170931]: 2024-02-19 20:11:26.239952147 +0000 UTC m=+0.120461917 container create 13a900e481512c1860bf77cbcc7f2b0a3e70b2f5d26cd9000fc807811121721f (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T20:11:26.493 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 20:11:26 smithi096 podman[170931]: 2024-02-19 20:11:26.492591893 +0000 UTC m=+0.373101590 container init 13a900e481512c1860bf77cbcc7f2b0a3e70b2f5d26cd9000fc807811121721f (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-02-19T20:11:26.768 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 20:11:26 smithi096 podman[170931]: 2024-02-19 20:11:26.495802043 +0000 UTC m=+0.376311748 container start 13a900e481512c1860bf77cbcc7f2b0a3e70b2f5d26cd9000fc807811121721f (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-deactivate, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T20:11:26.768 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 20:11:26 smithi096 podman[170931]: 2024-02-19 20:11:26.575760696 +0000 UTC m=+0.456270412 container attach 13a900e481512c1860bf77cbcc7f2b0a3e70b2f5d26cd9000fc807811121721f (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T20:11:27.163 INFO:journalctl@ceph.osd.1.smithi096.stdout:Feb 19 20:11:26 smithi096 podman[170931]: 2024-02-19 20:11:26.794721935 +0000 UTC m=+0.675231642 container died 13a900e481512c1860bf77cbcc7f2b0a3e70b2f5d26cd9000fc807811121721f (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-1-deactivate, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-19T20:11:27.458 DEBUG:teuthology.orchestra.run.smithi096:> sudo pkill -f 'journalctl -f -n 0 -u ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.1.service' 2024-02-19T20:11:27.505 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T20:11:27.505 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-19T20:11:27.505 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-19T20:11:27.505 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.2 2024-02-19T20:11:27.767 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 20:11:27 smithi096 systemd[1]: Stopping Ceph osd.2 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T20:11:28.267 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 20:11:27 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2[134991]: 2024-02-19T20:11:27.823+0000 7f2b93b8b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T20:11:28.268 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 20:11:27 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2[134991]: 2024-02-19T20:11:27.823+0000 7f2b93b8b700 -1 osd.2 86 *** Got signal Terminated *** 2024-02-19T20:11:28.268 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 20:11:27 smithi096 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2[134991]: 2024-02-19T20:11:27.823+0000 7f2b93b8b700 -1 osd.2 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T20:11:33.608 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 20:11:33 smithi096 podman[171036]: 2024-02-19 20:11:33.347810863 +0000 UTC m=+5.652812759 container died 51b70eaaa7a92f35c9b6ef094d45dfd667b821e74ba1c94ed2112ebe13a30c56 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, ceph=True, CEPH_POINT_RELEASE=) 2024-02-19T20:11:34.017 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 20:11:33 smithi096 podman[171036]: 2024-02-19 20:11:33.706678107 +0000 UTC m=+6.011680002 container cleanup 51b70eaaa7a92f35c9b6ef094d45dfd667b821e74ba1c94ed2112ebe13a30c56 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2, org.label-schema.build-date=20240214, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-19T20:11:34.018 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 20:11:33 smithi096 bash[171036]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2 2024-02-19T20:11:34.368 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 20:11:34 smithi096 podman[171053]: 2024-02-19 20:11:34.041738036 +0000 UTC m=+0.689970439 container remove 51b70eaaa7a92f35c9b6ef094d45dfd667b821e74ba1c94ed2112ebe13a30c56 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2) 2024-02-19T20:11:34.662 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 20:11:34 smithi096 podman[171144]: 2024-02-19 20:11:34.367651178 +0000 UTC m=+0.114265698 container create 73a52d633542b7b8bcde3459c251cbd3e7e1425cdbd315e239324b6c3156a1b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True) 2024-02-19T20:11:34.663 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 20:11:34 smithi096 podman[171144]: 2024-02-19 20:11:34.271327755 +0000 UTC m=+0.017942238 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T20:11:34.663 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 20:11:34 smithi096 podman[171144]: 2024-02-19 20:11:34.566510978 +0000 UTC m=+0.313125469 container init 73a52d633542b7b8bcde3459c251cbd3e7e1425cdbd315e239324b6c3156a1b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-02-19T20:11:34.663 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 20:11:34 smithi096 podman[171144]: 2024-02-19 20:11:34.57011498 +0000 UTC m=+0.316729463 container start 73a52d633542b7b8bcde3459c251cbd3e7e1425cdbd315e239324b6c3156a1b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, org.label-schema.license=GPLv2, ceph=True) 2024-02-19T20:11:34.663 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 20:11:34 smithi096 podman[171144]: 2024-02-19 20:11:34.661593633 +0000 UTC m=+0.408208124 container attach 73a52d633542b7b8bcde3459c251cbd3e7e1425cdbd315e239324b6c3156a1b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T20:11:35.018 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 20:11:34 smithi096 podman[171144]: 2024-02-19 20:11:34.857715823 +0000 UTC m=+0.604330302 container died 73a52d633542b7b8bcde3459c251cbd3e7e1425cdbd315e239324b6c3156a1b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-02-19T20:11:35.421 INFO:journalctl@ceph.osd.2.smithi096.stdout:Feb 19 20:11:35 smithi096 podman[171170]: 2024-02-19 20:11:35.406629494 +0000 UTC m=+0.543486447 container remove 73a52d633542b7b8bcde3459c251cbd3e7e1425cdbd315e239324b6c3156a1b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-02-19T20:11:35.426 DEBUG:teuthology.orchestra.run.smithi096:> sudo pkill -f 'journalctl -f -n 0 -u ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.2.service' 2024-02-19T20:11:35.468 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T20:11:35.468 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-19T20:11:35.468 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-19T20:11:35.469 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.3 2024-02-19T20:11:35.786 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 20:11:35 smithi125 systemd[1]: Stopping Ceph osd.3 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T20:11:36.182 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 20:11:35 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3[95402]: 2024-02-19T20:11:35.784+0000 7f408cc6c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T20:11:36.182 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 20:11:35 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3[95402]: 2024-02-19T20:11:35.784+0000 7f408cc6c700 -1 osd.3 86 *** Got signal Terminated *** 2024-02-19T20:11:36.182 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 20:11:35 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3[95402]: 2024-02-19T20:11:35.784+0000 7f408cc6c700 -1 osd.3 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T20:11:39.182 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:38 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:38.718+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.656496+0000 front 2024-02-19T20:11:15.656401+0000 (oldest deadline 2024-02-19T20:11:38.556095+0000) 2024-02-19T20:11:40.064 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:39 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:39.732+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.656496+0000 front 2024-02-19T20:11:15.656401+0000 (oldest deadline 2024-02-19T20:11:38.556095+0000) 2024-02-19T20:11:40.432 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 20:11:40 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3[95402]: 2024-02-19T20:11:40.062+0000 7f4089a61700 -1 osd.3 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.292663+0000 front 2024-02-19T20:11:15.292643+0000 (oldest deadline 2024-02-19T20:11:39.992549+0000) 2024-02-19T20:11:41.182 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:40 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:40.706+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.656496+0000 front 2024-02-19T20:11:15.656401+0000 (oldest deadline 2024-02-19T20:11:38.556095+0000) 2024-02-19T20:11:41.570 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 20:11:41 smithi125 podman[134519]: 2024-02-19 20:11:41.310600594 +0000 UTC m=+5.649028936 container died 73b832b7b2432f3a367935e9fcf11f7e4e81dae64bf50fbd0346eb06446946e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-02-19T20:11:41.570 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 20:11:41 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4[100602]: 2024-02-19T20:11:41.230+0000 7fada1063700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.012000+0000 front 2024-02-19T20:11:15.011918+0000 (oldest deadline 2024-02-19T20:11:40.212202+0000) 2024-02-19T20:11:41.877 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:41 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:41.703+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.656496+0000 front 2024-02-19T20:11:15.656401+0000 (oldest deadline 2024-02-19T20:11:38.556095+0000) 2024-02-19T20:11:41.877 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 20:11:41 smithi125 podman[134519]: 2024-02-19 20:11:41.677185768 +0000 UTC m=+6.015614109 container cleanup 73b832b7b2432f3a367935e9fcf11f7e4e81dae64bf50fbd0346eb06446946e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-19T20:11:41.877 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 20:11:41 smithi125 bash[134519]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3 2024-02-19T20:11:42.182 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 20:11:41 smithi125 podman[134536]: 2024-02-19 20:11:41.903319826 +0000 UTC m=+0.586936138 container remove 73b832b7b2432f3a367935e9fcf11f7e4e81dae64bf50fbd0346eb06446946e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-02-19T20:11:42.524 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 20:11:42 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4[100602]: 2024-02-19T20:11:42.265+0000 7fada1063700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.012000+0000 front 2024-02-19T20:11:15.011918+0000 (oldest deadline 2024-02-19T20:11:40.212202+0000) 2024-02-19T20:11:42.524 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 20:11:42 smithi125 podman[134628]: 2024-02-19 20:11:42.229311318 +0000 UTC m=+0.106370749 container create ee0da58745d1e62bb6e0c5f87f234a953f008894771652f981e9b481d9725589 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T20:11:42.524 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 20:11:42 smithi125 podman[134628]: 2024-02-19 20:11:42.140607759 +0000 UTC m=+0.017667199 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T20:11:42.524 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 20:11:42 smithi125 podman[134628]: 2024-02-19 20:11:42.448485341 +0000 UTC m=+0.325544769 container init ee0da58745d1e62bb6e0c5f87f234a953f008894771652f981e9b481d9725589 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-02-19T20:11:42.525 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 20:11:42 smithi125 podman[134628]: 2024-02-19 20:11:42.451761996 +0000 UTC m=+0.328821426 container start ee0da58745d1e62bb6e0c5f87f234a953f008894771652f981e9b481d9725589 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-19T20:11:42.525 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 20:11:42 smithi125 podman[134628]: 2024-02-19 20:11:42.523514347 +0000 UTC m=+0.400573795 container attach ee0da58745d1e62bb6e0c5f87f234a953f008894771652f981e9b481d9725589 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-02-19T20:11:42.932 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:42 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:42.707+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.656496+0000 front 2024-02-19T20:11:15.656401+0000 (oldest deadline 2024-02-19T20:11:38.556095+0000) 2024-02-19T20:11:42.932 INFO:journalctl@ceph.osd.3.smithi125.stdout:Feb 19 20:11:42 smithi125 podman[134628]: 2024-02-19 20:11:42.731643763 +0000 UTC m=+0.608703194 container died ee0da58745d1e62bb6e0c5f87f234a953f008894771652f981e9b481d9725589 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-3-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-02-19T20:11:43.303 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 20:11:43 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4[100602]: 2024-02-19T20:11:43.246+0000 7fada1063700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.012000+0000 front 2024-02-19T20:11:15.011918+0000 (oldest deadline 2024-02-19T20:11:40.212202+0000) 2024-02-19T20:11:43.327 DEBUG:teuthology.orchestra.run.smithi125:> sudo pkill -f 'journalctl -f -n 0 -u ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.3.service' 2024-02-19T20:11:43.368 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T20:11:43.368 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-19T20:11:43.368 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-19T20:11:43.368 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.4 2024-02-19T20:11:43.682 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 20:11:43 smithi125 systemd[1]: Stopping Ceph osd.4 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T20:11:44.182 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:43 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:43.719+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.656496+0000 front 2024-02-19T20:11:15.656401+0000 (oldest deadline 2024-02-19T20:11:38.556095+0000) 2024-02-19T20:11:44.182 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 20:11:43 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4[100602]: 2024-02-19T20:11:43.721+0000 7fada8276700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T20:11:44.183 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 20:11:43 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4[100602]: 2024-02-19T20:11:43.721+0000 7fada8276700 -1 osd.4 86 *** Got signal Terminated *** 2024-02-19T20:11:44.183 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 20:11:43 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4[100602]: 2024-02-19T20:11:43.721+0000 7fada8276700 -1 osd.4 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T20:11:44.682 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 20:11:44 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4[100602]: 2024-02-19T20:11:44.250+0000 7fada1063700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.012000+0000 front 2024-02-19T20:11:15.011918+0000 (oldest deadline 2024-02-19T20:11:40.212202+0000) 2024-02-19T20:11:45.182 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:44 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:44.735+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.656496+0000 front 2024-02-19T20:11:15.656401+0000 (oldest deadline 2024-02-19T20:11:38.556095+0000) 2024-02-19T20:11:45.682 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 20:11:45 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4[100602]: 2024-02-19T20:11:45.300+0000 7fada1063700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.012000+0000 front 2024-02-19T20:11:15.011918+0000 (oldest deadline 2024-02-19T20:11:40.212202+0000) 2024-02-19T20:11:46.182 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:45 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:45.725+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.656496+0000 front 2024-02-19T20:11:15.656401+0000 (oldest deadline 2024-02-19T20:11:38.556095+0000) 2024-02-19T20:11:46.182 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:45 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:45.725+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6814 osd.1 since back 2024-02-19T20:11:23.257035+0000 front 2024-02-19T20:11:23.257177+0000 (oldest deadline 2024-02-19T20:11:45.556877+0000) 2024-02-19T20:11:46.682 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 20:11:46 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4[100602]: 2024-02-19T20:11:46.254+0000 7fada1063700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.012000+0000 front 2024-02-19T20:11:15.011918+0000 (oldest deadline 2024-02-19T20:11:40.212202+0000) 2024-02-19T20:11:47.182 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:46 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:46.684+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.656496+0000 front 2024-02-19T20:11:15.656401+0000 (oldest deadline 2024-02-19T20:11:38.556095+0000) 2024-02-19T20:11:47.182 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:46 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:46.684+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6814 osd.1 since back 2024-02-19T20:11:23.257035+0000 front 2024-02-19T20:11:23.257177+0000 (oldest deadline 2024-02-19T20:11:45.556877+0000) 2024-02-19T20:11:47.682 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 20:11:47 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4[100602]: 2024-02-19T20:11:47.220+0000 7fada1063700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.012000+0000 front 2024-02-19T20:11:15.011918+0000 (oldest deadline 2024-02-19T20:11:40.212202+0000) 2024-02-19T20:11:48.182 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:47 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:47.720+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.656496+0000 front 2024-02-19T20:11:15.656401+0000 (oldest deadline 2024-02-19T20:11:38.556095+0000) 2024-02-19T20:11:48.182 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:47 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:47.720+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6814 osd.1 since back 2024-02-19T20:11:23.257035+0000 front 2024-02-19T20:11:23.257177+0000 (oldest deadline 2024-02-19T20:11:45.556877+0000) 2024-02-19T20:11:48.682 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 20:11:48 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4[100602]: 2024-02-19T20:11:48.212+0000 7fada1063700 -1 osd.4 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.012000+0000 front 2024-02-19T20:11:15.011918+0000 (oldest deadline 2024-02-19T20:11:40.212202+0000) 2024-02-19T20:11:49.085 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:48 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:48.736+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.656496+0000 front 2024-02-19T20:11:15.656401+0000 (oldest deadline 2024-02-19T20:11:38.556095+0000) 2024-02-19T20:11:49.085 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:48 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:48.736+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6814 osd.1 since back 2024-02-19T20:11:23.257035+0000 front 2024-02-19T20:11:23.257177+0000 (oldest deadline 2024-02-19T20:11:45.556877+0000) 2024-02-19T20:11:49.348 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 20:11:49 smithi125 podman[134735]: 2024-02-19 20:11:49.08440002 +0000 UTC m=+5.497121792 container died 1309ffc459f9768d149c0e6d3975120f388dce3366f4c6e3e5aab8992941f893 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-02-19T20:11:49.682 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 20:11:49 smithi125 podman[134735]: 2024-02-19 20:11:49.430547853 +0000 UTC m=+5.843269628 container cleanup 1309ffc459f9768d149c0e6d3975120f388dce3366f4c6e3e5aab8992941f893 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4, org.label-schema.build-date=20240214, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-19T20:11:49.682 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 20:11:49 smithi125 bash[134735]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4 2024-02-19T20:11:50.033 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 20:11:49 smithi125 podman[134752]: 2024-02-19 20:11:49.690407765 +0000 UTC m=+0.608387685 container remove 1309ffc459f9768d149c0e6d3975120f388dce3366f4c6e3e5aab8992941f893 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-02-19T20:11:50.033 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:49 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:49.752+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.656496+0000 front 2024-02-19T20:11:15.656401+0000 (oldest deadline 2024-02-19T20:11:38.556095+0000) 2024-02-19T20:11:50.034 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:49 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:49.752+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6814 osd.1 since back 2024-02-19T20:11:23.257035+0000 front 2024-02-19T20:11:23.257177+0000 (oldest deadline 2024-02-19T20:11:45.556877+0000) 2024-02-19T20:11:50.310 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 20:11:50 smithi125 podman[134846]: 2024-02-19 20:11:50.032991152 +0000 UTC m=+0.102457944 container create d6aa6332f42159a35816ea70180c783dae49828c9fa131d2c9ed8c56b1bfdb2c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-02-19T20:11:50.311 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 20:11:50 smithi125 podman[134846]: 2024-02-19 20:11:49.948365493 +0000 UTC m=+0.017832287 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T20:11:50.311 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 20:11:50 smithi125 podman[134846]: 2024-02-19 20:11:50.227178578 +0000 UTC m=+0.296645377 container init d6aa6332f42159a35816ea70180c783dae49828c9fa131d2c9ed8c56b1bfdb2c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240214, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-19T20:11:50.311 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 20:11:50 smithi125 podman[134846]: 2024-02-19 20:11:50.2304889 +0000 UTC m=+0.299955693 container start d6aa6332f42159a35816ea70180c783dae49828c9fa131d2c9ed8c56b1bfdb2c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-02-19T20:11:50.311 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 20:11:50 smithi125 podman[134846]: 2024-02-19 20:11:50.310213844 +0000 UTC m=+0.379680645 container attach d6aa6332f42159a35816ea70180c783dae49828c9fa131d2c9ed8c56b1bfdb2c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240214, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True) 2024-02-19T20:11:50.682 INFO:journalctl@ceph.osd.4.smithi125.stdout:Feb 19 20:11:50 smithi125 podman[134846]: 2024-02-19 20:11:50.513909387 +0000 UTC m=+0.583376180 container died d6aa6332f42159a35816ea70180c783dae49828c9fa131d2c9ed8c56b1bfdb2c (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-4-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240214) 2024-02-19T20:11:51.039 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:50 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:50.761+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.656496+0000 front 2024-02-19T20:11:15.656401+0000 (oldest deadline 2024-02-19T20:11:38.556095+0000) 2024-02-19T20:11:51.039 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:50 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:50.761+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6814 osd.1 since back 2024-02-19T20:11:23.257035+0000 front 2024-02-19T20:11:23.257177+0000 (oldest deadline 2024-02-19T20:11:45.556877+0000) 2024-02-19T20:11:51.068 DEBUG:teuthology.orchestra.run.smithi125:> sudo pkill -f 'journalctl -f -n 0 -u ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.4.service' 2024-02-19T20:11:51.109 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T20:11:51.109 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-19T20:11:51.109 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-19T20:11:51.109 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.5 2024-02-19T20:11:51.432 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:51 smithi125 systemd[1]: Stopping Ceph osd.5 for 06580d2c-cf58-11ee-95bb-87774f69a715... 2024-02-19T20:11:51.726 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:51 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:51.433+0000 7f6038214700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-19T20:11:51.727 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:51 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:51.433+0000 7f6038214700 -1 osd.5 86 *** Got signal Terminated *** 2024-02-19T20:11:51.727 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:51 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:51.433+0000 7f6038214700 -1 osd.5 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-19T20:11:51.727 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:51 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:51.725+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.656496+0000 front 2024-02-19T20:11:15.656401+0000 (oldest deadline 2024-02-19T20:11:38.556095+0000) 2024-02-19T20:11:51.727 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:51 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:51.725+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6814 osd.1 since back 2024-02-19T20:11:23.257035+0000 front 2024-02-19T20:11:23.257177+0000 (oldest deadline 2024-02-19T20:11:45.556877+0000) 2024-02-19T20:11:53.182 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:52 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:52.715+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.656496+0000 front 2024-02-19T20:11:15.656401+0000 (oldest deadline 2024-02-19T20:11:38.556095+0000) 2024-02-19T20:11:53.182 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:52 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:52.715+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6814 osd.1 since back 2024-02-19T20:11:23.257035+0000 front 2024-02-19T20:11:23.257177+0000 (oldest deadline 2024-02-19T20:11:45.556877+0000) 2024-02-19T20:11:54.182 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:53 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:53.721+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.656496+0000 front 2024-02-19T20:11:15.656401+0000 (oldest deadline 2024-02-19T20:11:38.556095+0000) 2024-02-19T20:11:54.182 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:53 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:53.721+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6814 osd.1 since back 2024-02-19T20:11:23.257035+0000 front 2024-02-19T20:11:23.257177+0000 (oldest deadline 2024-02-19T20:11:45.556877+0000) 2024-02-19T20:11:55.182 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:54 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:54.763+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.656496+0000 front 2024-02-19T20:11:15.656401+0000 (oldest deadline 2024-02-19T20:11:38.556095+0000) 2024-02-19T20:11:55.182 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:54 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:54.763+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6814 osd.1 since back 2024-02-19T20:11:23.257035+0000 front 2024-02-19T20:11:23.257177+0000 (oldest deadline 2024-02-19T20:11:45.556877+0000) 2024-02-19T20:11:56.182 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:55 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:55.722+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6806 osd.0 since back 2024-02-19T20:11:15.656496+0000 front 2024-02-19T20:11:15.656401+0000 (oldest deadline 2024-02-19T20:11:38.556095+0000) 2024-02-19T20:11:56.182 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:55 smithi125 ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5[105542]: 2024-02-19T20:11:55.722+0000 7f6031001700 -1 osd.5 86 heartbeat_check: no reply from 172.21.15.96:6814 osd.1 since back 2024-02-19T20:11:23.257035+0000 front 2024-02-19T20:11:23.257177+0000 (oldest deadline 2024-02-19T20:11:45.556877+0000) 2024-02-19T20:11:57.251 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:56 smithi125 podman[134954]: 2024-02-19 20:11:56.973008632 +0000 UTC m=+5.647180423 container died 247b0927920be087bd1eaa6057164fecf739479407202f095354a9c51fd48ca5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240214, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-02-19T20:11:57.576 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:57 smithi125 podman[134954]: 2024-02-19 20:11:57.324785058 +0000 UTC m=+5.998956858 container cleanup 247b0927920be087bd1eaa6057164fecf739479407202f095354a9c51fd48ca5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214) 2024-02-19T20:11:57.576 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:57 smithi125 bash[134954]: ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5 2024-02-19T20:11:57.932 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:57 smithi125 podman[134973]: 2024-02-19 20:11:57.575988272 +0000 UTC m=+0.600867168 container remove 247b0927920be087bd1eaa6057164fecf739479407202f095354a9c51fd48ca5 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214) 2024-02-19T20:11:58.229 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:57 smithi125 podman[135066]: 2024-02-19 20:11:57.837612781 +0000 UTC m=+0.018187501 image pull f081f847070acba44285717fbebd438c29e1171bb26f61956e59e7adb866ff0a quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526 2024-02-19T20:11:58.230 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:57 smithi125 podman[135066]: 2024-02-19 20:11:57.935142812 +0000 UTC m=+0.115717524 container create cbb7f2b91b4cd577836627d574f43a9c46a9da5c877bbfc29c49e4e512675ee0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-batrick-testing-20240215.160715-f78a58c) 2024-02-19T20:11:58.230 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:58 smithi125 podman[135066]: 2024-02-19 20:11:58.146124773 +0000 UTC m=+0.326699488 container init cbb7f2b91b4cd577836627d574f43a9c46a9da5c877bbfc29c49e4e512675ee0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-02-19T20:11:58.230 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:58 smithi125 podman[135066]: 2024-02-19 20:11:58.149353993 +0000 UTC m=+0.329928709 container start cbb7f2b91b4cd577836627d574f43a9c46a9da5c877bbfc29c49e4e512675ee0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-batrick-testing-20240215.160715-f78a58c, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-02-19T20:11:58.230 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:58 smithi125 podman[135066]: 2024-02-19 20:11:58.229254394 +0000 UTC m=+0.409829116 container attach cbb7f2b91b4cd577836627d574f43a9c46a9da5c877bbfc29c49e4e512675ee0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-deactivate, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240214) 2024-02-19T20:11:58.682 INFO:journalctl@ceph.osd.5.smithi125.stdout:Feb 19 20:11:58 smithi125 podman[135066]: 2024-02-19 20:11:58.440577412 +0000 UTC m=+0.621152125 container died cbb7f2b91b4cd577836627d574f43a9c46a9da5c877bbfc29c49e4e512675ee0 (image=quay.ceph.io/ceph-ci/ceph@sha256:20c75febd3cc6fee70b3b846b358905b187f9293f7c7c6707c7c369b69fd0526, name=ceph-06580d2c-cf58-11ee-95bb-87774f69a715-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240214, io.buildah.version=1.33.5, RELEASE=wip-batrick-testing-20240215.160715-f78a58c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-02-19T20:11:59.039 DEBUG:teuthology.orchestra.run.smithi125:> sudo pkill -f 'journalctl -f -n 0 -u ceph-06580d2c-cf58-11ee-95bb-87774f69a715@osd.5.service' 2024-02-19T20:11:59.079 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-19T20:11:59.080 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-19T20:11:59.080 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 --force --keep-logs 2024-02-19T20:11:59.239 INFO:teuthology.orchestra.run.smithi096.stdout:Deleting cluster with fsid: 06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T20:12:27.360 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 --force --keep-logs 2024-02-19T20:12:27.517 INFO:teuthology.orchestra.run.smithi125.stdout:Deleting cluster with fsid: 06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T20:12:41.319 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-19T20:12:41.356 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-19T20:12:41.385 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-19T20:12:41.388 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/crash to /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566595/remote/smithi096/crash 2024-02-19T20:12:41.388 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/crash -- . 2024-02-19T20:12:41.425 INFO:teuthology.orchestra.run.smithi096.stderr:tar: /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/crash: Cannot open: No such file or directory 2024-02-19T20:12:41.425 INFO:teuthology.orchestra.run.smithi096.stderr:tar: Error is not recoverable: exiting now 2024-02-19T20:12:41.427 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/crash to /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566595/remote/smithi125/crash 2024-02-19T20:12:41.428 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/crash -- . 2024-02-19T20:12:41.453 INFO:teuthology.orchestra.run.smithi125.stderr:tar: /var/lib/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/crash: Cannot open: No such file or directory 2024-02-19T20:12:41.453 INFO:teuthology.orchestra.run.smithi125.stderr:tar: Error is not recoverable: exiting now 2024-02-19T20:12:41.454 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-19T20:12:41.455 DEBUG:teuthology.orchestra.run.smithi096:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-19T20:12:41.503 INFO:tasks.cephadm:Compressing logs... 2024-02-19T20:12:41.503 DEBUG:teuthology.orchestra.run.smithi096:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-19T20:12:41.545 DEBUG:teuthology.orchestra.run.smithi125:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-19T20:12:41.570 INFO:teuthology.orchestra.run.smithi096.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-19T20:12:41.570 INFO:teuthology.orchestra.run.smithi096.stderr:: No such file or directory 2024-02-19T20:12:41.571 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mgr.smithi096.zsjdff.log 2024-02-19T20:12:41.573 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph.audit.log 2024-02-19T20:12:41.573 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi096.usrmcg.log 2024-02-19T20:12:41.573 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mgr.smithi096.zsjdff.log: /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-osd.1.log 2024-02-19T20:12:41.574 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mon.smithi096.log 2024-02-19T20:12:41.574 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi096.usrmcg.log: /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-osd.0.log 2024-02-19T20:12:41.574 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mon.smithi096.log: gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph.cephadm.log 2024-02-19T20:12:41.574 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph.log 2024-02-19T20:12:41.577 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph.cephadm.log: 85.9% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph.cephadm.log.gz 2024-02-19T20:12:41.577 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-osd.2.log 2024-02-19T20:12:41.580 INFO:teuthology.orchestra.run.smithi125.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-19T20:12:41.580 INFO:teuthology.orchestra.run.smithi125.stderr:: No such file or directory 2024-02-19T20:12:41.580 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi125.pwyuga.log 2024-02-19T20:12:41.580 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph.audit.log 2024-02-19T20:12:41.580 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi125.pwyuga.log: gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-osd.4.log 2024-02-19T20:12:41.580 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-osd.5.log 2024-02-19T20:12:41.580 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi125.srnlol.log 2024-02-19T20:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-osd.4.log: /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-osd.3.log 2024-02-19T20:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi125.srnlol.log: gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mgr.smithi125.ygdmdu.log 2024-02-19T20:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mon.smithi125.log 2024-02-19T20:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mgr.smithi125.ygdmdu.log: 92.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-19T20:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph.cephadm.log 2024-02-19T20:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mon.smithi125.log: 92.1% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph.audit.log.gz 2024-02-19T20:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph.log 2024-02-19T20:12:41.581 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph.cephadm.log: 85.9% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph.cephadm.log.gz 2024-02-19T20:12:41.584 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph.log: 91.9% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph.audit.log.gz 2024-02-19T20:12:41.584 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-volume.log 2024-02-19T20:12:41.584 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-osd.2.log: 90.8% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph.log.gz 2024-02-19T20:12:41.584 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi096.pccmys.log 2024-02-19T20:12:41.588 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-volume.log: 89.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-19T20:12:41.591 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-client.ceph-exporter.smithi096.log 2024-02-19T20:12:41.595 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-client.ceph-exporter.smithi125.log 2024-02-19T20:12:41.603 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph.log: 90.9% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph.log.gz 2024-02-19T20:12:41.603 INFO:teuthology.orchestra.run.smithi125.stderr:gzip -5 --verbose -- /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-volume.log 2024-02-19T20:12:41.604 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi096.pccmys.log: 91.0% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-volume.log.gz 2024-02-19T20:12:41.611 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-client.ceph-exporter.smithi125.log: 94.6% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-client.ceph-exporter.smithi125.log.gz 2024-02-19T20:12:41.612 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-client.ceph-exporter.smithi096.log: 94.6% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-client.ceph-exporter.smithi096.log.gz 2024-02-19T20:12:41.620 INFO:teuthology.orchestra.run.smithi125.stderr:/var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-volume.log: 90.5% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mgr.smithi125.ygdmdu.log.gz 2024-02-19T20:12:41.626 INFO:teuthology.orchestra.run.smithi125.stderr: 91.0% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-volume.log.gz 2024-02-19T20:12:42.102 INFO:teuthology.orchestra.run.smithi125.stderr: 94.7% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi125.pwyuga.log.gz 2024-02-19T20:12:42.344 INFO:teuthology.orchestra.run.smithi096.stderr: 89.4% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mgr.smithi096.zsjdff.log.gz 2024-02-19T20:12:42.455 INFO:teuthology.orchestra.run.smithi125.stderr: 92.6% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mon.smithi125.log.gz 2024-02-19T20:12:43.532 INFO:teuthology.orchestra.run.smithi125.stderr: 95.6% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi125.srnlol.log.gz 2024-02-19T20:12:43.709 INFO:teuthology.orchestra.run.smithi125.stderr: 93.4% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-osd.4.log.gz 2024-02-19T20:12:43.717 INFO:teuthology.orchestra.run.smithi096.stderr: 90.1% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mon.smithi096.log.gz 2024-02-19T20:12:43.720 INFO:teuthology.orchestra.run.smithi096.stderr: 93.2% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-osd.2.log.gz 2024-02-19T20:12:44.430 INFO:teuthology.orchestra.run.smithi125.stderr: 93.7% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-osd.5.log.gz 2024-02-19T20:12:44.639 INFO:teuthology.orchestra.run.smithi096.stderr: 93.5% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-osd.0.log.gz 2024-02-19T20:12:45.033 INFO:teuthology.orchestra.run.smithi096.stderr: 93.5% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-osd.1.log.gz 2024-02-19T20:12:45.227 INFO:teuthology.orchestra.run.smithi096.stderr: 95.2% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi096.usrmcg.log.gz 2024-02-19T20:12:45.588 INFO:teuthology.orchestra.run.smithi125.stderr: 93.3% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-osd.3.log.gz 2024-02-19T20:12:45.590 INFO:teuthology.orchestra.run.smithi125.stderr: 2024-02-19T20:12:45.590 INFO:teuthology.orchestra.run.smithi125.stderr:real 0m4.031s 2024-02-19T20:12:45.590 INFO:teuthology.orchestra.run.smithi125.stderr:user 0m12.024s 2024-02-19T20:12:45.591 INFO:teuthology.orchestra.run.smithi125.stderr:sys 0m0.444s 2024-02-19T20:12:56.036 INFO:teuthology.orchestra.run.smithi096.stderr: 93.1% -- replaced with /var/log/ceph/06580d2c-cf58-11ee-95bb-87774f69a715/ceph-mds.cephfs.smithi096.pccmys.log.gz 2024-02-19T20:12:56.037 INFO:teuthology.orchestra.run.smithi096.stderr: 2024-02-19T20:12:56.038 INFO:teuthology.orchestra.run.smithi096.stderr:real 0m14.480s 2024-02-19T20:12:56.038 INFO:teuthology.orchestra.run.smithi096.stderr:user 0m28.824s 2024-02-19T20:12:56.038 INFO:teuthology.orchestra.run.smithi096.stderr:sys 0m0.896s 2024-02-19T20:12:56.038 INFO:tasks.cephadm:Archiving logs... 2024-02-19T20:12:56.039 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566595/remote/smithi096/log 2024-02-19T20:12:56.040 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-19T20:13:00.114 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566595/remote/smithi125/log 2024-02-19T20:13:00.115 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-19T20:13:01.857 INFO:tasks.cephadm:Removing cluster... 2024-02-19T20:13:01.857 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 --force 2024-02-19T20:13:02.016 INFO:teuthology.orchestra.run.smithi096.stdout:Deleting cluster with fsid: 06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T20:13:02.319 DEBUG:teuthology.orchestra.run.smithi125:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 06580d2c-cf58-11ee-95bb-87774f69a715 --force 2024-02-19T20:13:02.466 INFO:teuthology.orchestra.run.smithi125.stdout:Deleting cluster with fsid: 06580d2c-cf58-11ee-95bb-87774f69a715 2024-02-19T20:13:02.767 INFO:tasks.cephadm:Removing cephadm ... 2024-02-19T20:13:02.767 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-19T20:13:02.783 DEBUG:teuthology.orchestra.run.smithi125:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-19T20:13:02.798 INFO:tasks.cephadm:Teardown complete 2024-02-19T20:13:02.799 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-19T20:13:02.810 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-19T20:13:02.811 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-19T20:13:02.826 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-19T20:13:02.917 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-19T20:13:02.929 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-19T20:13:02.929 DEBUG:teuthology.orchestra.run.smithi096:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-19T20:13:02.931 DEBUG:teuthology.orchestra.run.smithi125:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-19T20:13:02.943 INFO:teuthology.orchestra.run.smithi096.stderr:bash: line 1: ntpq: command not found 2024-02-19T20:13:02.945 INFO:teuthology.orchestra.run.smithi125.stderr:bash: line 1: ntpq: command not found 2024-02-19T20:13:02.948 INFO:teuthology.orchestra.run.smithi096.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-19T20:13:02.948 INFO:teuthology.orchestra.run.smithi096.stdout:=============================================================================== 2024-02-19T20:13:02.948 INFO:teuthology.orchestra.run.smithi096.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 56 +996us[ +996us] +/- 84ms 2024-02-19T20:13:02.948 INFO:teuthology.orchestra.run.smithi096.stdout:^* hv02.front.sepia.ceph.com 3 8 377 191 -1215us[-1269us] +/- 58ms 2024-02-19T20:13:02.949 INFO:teuthology.orchestra.run.smithi096.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 56 +898us[ +898us] +/- 67ms 2024-02-19T20:13:02.949 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T20:13:02.950 INFO:teuthology.orchestra.run.smithi125.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-19T20:13:02.950 INFO:teuthology.orchestra.run.smithi125.stdout:=============================================================================== 2024-02-19T20:13:02.950 INFO:teuthology.orchestra.run.smithi125.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 57 +962us[ +977us] +/- 84ms 2024-02-19T20:13:02.950 INFO:teuthology.orchestra.run.smithi125.stdout:^* hv02.front.sepia.ceph.com 3 6 377 57 -1264us[-1249us] +/- 60ms 2024-02-19T20:13:02.950 INFO:teuthology.orchestra.run.smithi125.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 +821us[ +821us] +/- 67ms 2024-02-19T20:13:02.951 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-02-19T20:13:02.951 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-19T20:13:02.983 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-19T20:13:02.984 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-19T20:13:03.002 DEBUG:teuthology.orchestra.run.smithi096:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-19T20:13:03.091 DEBUG:teuthology.orchestra.run.smithi125:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-19T20:13:03.174 DEBUG:teuthology.orchestra.run.smithi096:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-19T20:13:03.205 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T20:13:03.205 DEBUG:teuthology.orchestra.run.smithi125:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-19T20:13:03.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T20:13:03.236 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-19T20:13:03.248 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-19T20:13:03.269 INFO:teuthology.task.internal:Duration was 5367.017429 seconds 2024-02-19T20:13:03.270 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-19T20:13:03.289 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-19T20:13:03.289 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-19T20:13:03.292 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-19T20:13:03.333 INFO:teuthology.orchestra.run.smithi096.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-19T20:13:03.335 INFO:teuthology.orchestra.run.smithi125.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-19T20:13:03.557 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-19T20:13:03.558 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi096.front.sepia.ceph.com 2024-02-19T20:13:03.558 DEBUG:teuthology.orchestra.run.smithi096:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-19T20:13:03.618 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi125.front.sepia.ceph.com 2024-02-19T20:13:03.618 DEBUG:teuthology.orchestra.run.smithi125:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-19T20:13:03.649 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-19T20:13:03.649 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-19T20:13:03.660 DEBUG:teuthology.orchestra.run.smithi125:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-19T20:13:03.717 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-19T20:13:03.718 DEBUG:teuthology.orchestra.run.smithi096:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-19T20:13:03.728 DEBUG:teuthology.orchestra.run.smithi125:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-19T20:13:04.409 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-19T20:13:04.420 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-19T20:13:04.420 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-19T20:13:04.447 DEBUG:teuthology.orchestra.run.smithi125:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-19T20:13:04.475 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-19T20:13:04.487 DEBUG:teuthology.orchestra.run.smithi096:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-19T20:13:04.489 DEBUG:teuthology.orchestra.run.smithi125:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-19T20:13:04.512 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = core 2024-02-19T20:13:04.540 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern = core 2024-02-19T20:13:04.556 DEBUG:teuthology.orchestra.run.smithi096:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-19T20:13:04.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T20:13:04.582 DEBUG:teuthology.orchestra.run.smithi125:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-19T20:13:04.610 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T20:13:04.611 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-19T20:13:04.623 INFO:teuthology.task.internal:Transferring archived files... 2024-02-19T20:13:04.624 DEBUG:teuthology.misc:Transferring archived files from smithi096:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566595/remote/smithi096 2024-02-19T20:13:04.624 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-19T20:13:04.678 DEBUG:teuthology.misc:Transferring archived files from smithi125:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566595/remote/smithi125 2024-02-19T20:13:04.678 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-19T20:13:04.719 INFO:teuthology.task.internal:Removing archive directory... 2024-02-19T20:13:04.719 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-19T20:13:04.721 DEBUG:teuthology.orchestra.run.smithi125:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-19T20:13:04.767 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-19T20:13:04.781 INFO:teuthology.task.internal:Not uploading archives. 2024-02-19T20:13:04.781 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-19T20:13:04.793 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-19T20:13:04.793 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-19T20:13:04.795 DEBUG:teuthology.orchestra.run.smithi125:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-19T20:13:04.807 INFO:teuthology.orchestra.run.smithi096.stdout: 265412 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 19 20:13 /home/ubuntu/cephtest 2024-02-19T20:13:04.822 INFO:teuthology.orchestra.run.smithi125.stdout: 262166 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 19 20:13 /home/ubuntu/cephtest 2024-02-19T20:13:04.822 INFO:teuthology.orchestra.run.smithi125.stdout: 673761 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 19 19:12 /home/ubuntu/cephtest/mnt.1 2024-02-19T20:13:04.822 INFO:teuthology.orchestra.run.smithi125.stdout: 673762 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 19 19:12 /home/ubuntu/cephtest/mnt.1/client.1 2024-02-19T20:13:04.823 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-19T20:13:04.823 INFO:teuthology.orchestra.run.smithi125.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-02-19T20:13:04.824 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi125 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-02-19T20:13:04.831 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-19T20:13:04.845 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-19T20:13:04.858 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi125 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-02-19T20:13:04.858 INFO:teuthology.nuke:Checking targets against current locks 2024-02-19T20:13:04.885 DEBUG:teuthology.nuke:shortname: smithi096 2024-02-19T20:13:04.885 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-19T20:13:04.904 DEBUG:teuthology.nuke:shortname: smithi125 2024-02-19T20:13:04.905 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-19T20:13:04.908 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566595', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-19 18:29:39.234270', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNaiu2TWkuWMgMARXIjr/sxbakwkusxgXjCZA7XV+yNjUvznbL84PKjCiP8lawFKnC48LvVvCNilFmjL47o8+/g='} 2024-02-19T20:13:04.927 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-02-19_18:28:45-fs:upgrade:mds_upgrade_sequence-wip-batrick-testing-20240215.160715-distro-default-smithi/7566595', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-19 18:29:39.232832', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCOsE1pTyJA+Xbf63U9JrYTq90ldeiLzSJ/F+pNVpxUnICd6SwhSNmvgQR5noQg7Sqzt+O5KsAfH5IrR4OdQ99A='} 2024-02-19T20:13:04.957 INFO:teuthology.orchestra.console.smithi096:Power off 2024-02-19T20:13:04.958 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T20:13:04.982 DEBUG:teuthology.orchestra.console.smithi096:power off output: Chassis Power Control: Down/Off 2024-02-19T20:13:04.983 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T20:13:04.998 INFO:teuthology.orchestra.console.smithi125:Power off 2024-02-19T20:13:04.999 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T20:13:05.007 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2024-02-19T20:13:05.021 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2024-02-19T20:13:05.021 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T20:13:05.043 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2024-02-19T20:13:09.008 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T20:13:09.043 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T20:13:09.118 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2024-02-19T20:13:09.153 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2024-02-19T20:13:13.123 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T20:13:13.154 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T20:13:13.233 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2024-02-19T20:13:13.263 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2024-02-19T20:13:13.363 INFO:teuthology.orchestra.console.smithi125:Power off completed 2024-02-19T20:13:17.236 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T20:13:17.346 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2024-02-19T20:13:17.447 INFO:teuthology.orchestra.console.smithi096:Power off completed 2024-02-19T20:13:17.553 INFO:teuthology.run:Summary data: description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 0a 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 5367.017428636551 failure_reason: 'Command failed (workunit test suites/fsstress.sh) on smithi096 with status 126: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1ce7ea8877c709fa862eac608550374bd96e166e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh''' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=be1d0e5ca65b4e01906097c8da08a82b status: fail success: false 2024-02-19T20:13:17.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T20:13:17.639 INFO:teuthology.run:FAIL